What is the best model the NVIDIA GeForce RTX 5060 Ti 8GB can run locally?

gpt-oss 20B (MXFP4) fits fully in its memory at 8k context and generates at about 63 tok/s, an estimate from its memory bandwidth. 38 of the 129 models we track fit at that context.

Can the NVIDIA GeForce RTX 5060 Ti 8GB run DeepSeek V4 Flash?

No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 92 GB at 8k context, more than the NVIDIA GeForce RTX 5060 Ti 8GB and system RAM can hold.

NVIDIA GeForce RTX 5060 Ti 8GB

8 GB · 448 GB/s · 180 W

In short

The NVIDIA GeForce RTX 5060 Ti 8GB has 8 GB of GDDR7 memory with 448 GB/s of bandwidth, which sets how fast it generates text. At 8k context it runs 38 of the 129 open models we track fully in memory; the most capable is gpt-oss 20B at MXFP4, at about 63 tok/s (estimated). The best new price for the NVIDIA GeForce RTX 5060 Ti 8GB in Germany is 518 € at eBay; used, it starts at 529 € (asking price).

Updated 3 November 2026. Speeds are estimates; how they are worked out.

Prices

Every retailer we track in Germany, cheapest first. Buy links may earn us a commission.

Retailer	Condition	Price	Stock	Checked	Buy
eBayMSI GeForce RTX 5060 Ti 8G Ventus 2X OC Plus	New	518 €	In stock	39 min ago	Buy
AmazonPNY Geforce RTX 5060 Ti 8GB Overclocked Dual Fan DLSS 4	New	525 €	In stock	11 h ago	Buy
eBayMSI GeForce RTX 5060 Ti GAMING TRIO OC Grafikkarte 8GB GDDR7	used, asking price	529 €	In stock	39 min ago	Buy
AmazonMSI GeForce RTX 5060 Ti 8G Ventus 2X OC Plus Gaming Graphics Card	New	533 €	In stock	5 h ago	Buy
AmazonASUS Dual GeForce RTX 5060 Ti 8GB GDDR7 Graphics Card OC Edition Gaming	New	548 €	In stock	5 h ago	Buy
eBayPny	New	550 €	In stock	39 min ago	Buy
AmazonGigabyte GeForce RTX 5060 Ti WINDFORCE OC 8G Graphics Card	New	554 €	In stock	4 h ago	Buy
AmazonGigabyte GeForce RTX 5060 Ti WINDFORCE MAX OC 8G Graphics Card	New	567 €	In stock	5 h ago	Buy
AmazonASUS Dual GeForce RTX 5060 Ti 8GB GDDR7 Gaming Graphics Card	New	570 €	In stock	5 h ago	Buy
AmazonGIGABYTE GeForce RTX 5060 Ti Windforce OC 8G	New	578 €	In stock	4 h ago	Buy
eBayASUS DUAL-RTX5060TI-O8G NVIDIA Grafikkarte	used, asking price	579 €	In stock	39 min ago	Buy
eBayASUS DUAL-RTX5060TI-O8G NVIDIA Grafikkarte	New	579 €	In stock	39 min ago	Buy
eBayZOTAC GeForce RTX 5060 Ti Twin Edge 8GB GDDR7 DLSS 4 HDMI 3x DP	New	580 €	In stock	39 min ago	Buy
eBayASUS DUAL-RTX5060TI-O8G NVIDIA Grafikkarte	used, asking price	585 €	In stock	39 min ago	Buy
eBayMSI GeForce RTX 5060 TI 8G VENTUS 2X OC PLUS NVIDIA 8 GB GDDR7	New	586 €	In stock	39 min ago	Buy
eBay8GB Zotac Gaming GeForce RTX 5060 Ti Twin Edge 5060Ti NVIDIA GDDR7	New	587 €	In stock	39 min ago	Buy
eBayGIGABYTE GeForce RTX 5060 Ti WINDFORCE OC 8G Grafikkarte	New	592 €	In stock	39 min ago	Buy
eBayINNO3D GeForce RTX 5060 Ti TWIN X2 8GB	New	596 €	In stock	39 min ago	Buy
eBayPalit RTX 5060 Ti Dual OC 8GB	New	596 €	In stock	39 min ago	Buy
eBay8GB Gainward GeForce RTX 5060 Ti Ghost GDDR7 NVIDIA RTX5060Ti	New	597 €	In stock	39 min ago	Buy
AmazonPNY Placa Gráfica GeForce RTX 5060 Ti ARGB OC 8GB GDDR7	New	599 €	In stock	4 h ago	Buy
AmazonMSI Gaming RTX 5060 Ti 8G Ventus 2X OC Plus Graphics Card	New	607 €	In stock	4 h ago	Buy
eBayASUS Prime GeForce RTX 5060 Ti 8GB GDDR7	New	599 €+ 8 € delivery	In stock	39 min ago	Buy
eBayINNO3D GeForce RTX 5060 Ti TWIN X2 OC 8GB	New	608 €	In stock	39 min ago	Buy
eBayASUS GeForce RTX 5060 Ti Dual OC 8GB GDDR7 DLSS4	New	611 €	In stock	39 min ago	Buy
eBayGigabyte GeForce RTX 5060 Ti Windforce OC 8GB GDDR7 DLSS4	New	611 €	In stock	39 min ago	Buy
AmazonGigabyte GeForce RTX 5060 Ti Gaming OC 8G Graphics Card	New	619 €	In stock	5 h ago	Buy
AmazonPNY GeForce RTX 5060 Ti 8GB ARGB OC Triple Fan Graphics Card DLSS 4	New	634 €	In stock	5 h ago	Buy
AmazonMSI Gaming RTX 5060 Ti 8G Gaming Trio OC Graphics Card	New	636 €	In stock	4 h ago	Buy
AmazonASUS TUF Gaming GeForce RTX 5060 Ti OC Edition 8GB GDDR7 Gaming Graphics	New	664 €	In stock	4 h ago	Buy

Price history

Lowest price shown each day over the last 90 days.

Lowest new priceLowest used asking price

What two of them run

Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.

Model	Quant	Fits	Memory	Max context	Decode @8k	Prefill	Good for
gpt-oss 20B OpenAI	MXFP4	fits	12.6 GB	82k128k with q8 cache	63tok/sest.	1157 tok/s	chat, coding, agents, long documents
Gemma 4 12B Google	Q8_0	fits	13.4 GB	73k122k with q8 cache	21tok/sest.	425 tok/s	chat, coding
Qwen 3.5 9B Alibaba Qwen	Q8_0	fits	10.3 GB	128k212k with q8 cache	28tok/sest.	538 tok/s	chat, coding, long documents
Ministral 3 14B Mistral AI	Q6_K	fits	12.7 GB	20k37k with q8 cache	22tok/sest.	349 tok/s	chat
Qwen3 14B Alibaba Qwen	Q6_K	fits	13.7 GB	14k27k with q8 cache	21tok/sest.	324 tok/s	chat
DeepSeek R1 0528 Qwen3 8B DeepSeek	Q8_0	fits	10.4 GB	38k69k with q8 cache	28tok/sest.	568 tok/s	chat, coding
Qwen3 8B Alibaba Qwen	Q8_0	fits	10.4 GB	38k40k with q8 cache	28tok/sest.	568 tok/s	chat, coding
Phi-4 14B Microsoft	Q6_K	fits	13.9 GB	12k16k with q8 cache	20tok/sest.	327 tok/s	chat
Qwen 3.5 4B Alibaba Qwen	Q8_0	fits	5.6 GB	255k256k with q8 cache	58tok/sest.	1082 tok/s	chat, coding, long documents
Ministral 3 8B Mistral AI	Q8_0	fits	10.6 GB	38k69k with q8 cache	27tok/sest.	530 tok/s	chat, coding
Granite 4.2 8B IBM	Q8_0	fits	11.1 GB	30k56k with q8 cache	26tok/sest.	526 tok/s	chat
Gemma 4 E4B Google	Q8_0	fits	9.0 GB	128k	33tok/sest.	651 tok/s	chat, coding, long documents
LFM2.5 8B-A1B Liquid AI	Q8_0	fits	9.9 GB	100k125k with q8 cache	114tok/sest.	3802 tok/s	chat, coding, long documents
Llama 3.1 8B Meta	Q6_K	fits	8.3 GB	57k104k with q8 cache	36tok/sest.	586 tok/s	chat, coding
Qwen2.5 0.5B Alibaba Qwen	Q8_0	fits	1.7 GB	32k	440tok/sest.	7958 tok/s	chat, coding, long documents
Qwen3.5 0.8B Alibaba Qwen	Q8_0	fits	2.0 GB	256k	298tok/sest.	5475 tok/s	chat, coding, agents, long documents
Qwen3.5 2B Alibaba Qwen	Q5_K_M	fits	2.6 GB	256k	179tok/sest.	2246 tok/s	chat, coding, agents, long documents
LFM3 1.7B Liquid AI	Q8_0	fits	3.0 GB	256k	142tok/sest.	2886 tok/s	chat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B DeepSeek	Q8_0	fits	3.1 GB	128k	130tok/sest.	2505 tok/s	chat, coding, long documents
MiniCPM5 2B openbmb	Q8_0	fits	4.0 GB	128k	92tok/sest.	1656 tok/s	chat, coding, agents, long documents
LFM2.5 2.6B Liquid AI	Q8_0	fits	4.3 GB	128k	82tok/sest.	1666 tok/s	chat, coding, agents, long documents
LFM2.5 VL 3B Liquid AI	Q8_0	fits	4.3 GB	32k	82tok/sest.	1471 tok/s	chat, coding, agents, long documents
Spark X2.5 4B XHToken	mlx-4bit	fits	4.3 GB	263k441k with q8 cache	82tok/sest.	1178 tok/s	chat, coding, agents, long documents
Kimi VL A3B Thinking 2506 Moonshot AI	Q4_K_M	fits	11.2 GB	109k128k with q8 cache	76tok/sest.	1545 tok/s	chat, coding, long documents
granite vision 4.1 4b IBM	Q8_0	fits	5.1 GB	122k128k with q8 cache	65tok/sest.	1103 tok/s	chat, coding, long documents
Ministral 3 3B Instruct 2512 Mistral AI	Q8_0	fits	5.4 GB	95k172k with q8 cache	61tok/sest.	1130 tok/s	chat, coding, agents
granite 4.2 3b IBM	Q8_0	fits	5.4 GB	119k128k with q8 cache	61tok/sest.	1186 tok/s	chat, coding, agents, long documents
Kimi VL A3B Moonshot AI	mlx-6bit	fits	14.3 GB	23k37k with q8 cache	60tok/sest.	1450 tok/s	chat, coding, agents
Mellum2.1 12B A2.5B Thinking JetBrains	Q8_0	fits	13.3 GB	83k125k with q8 cache	59tok/sest.	1832 tok/s	chat, coding, agents, long documents
FrogNano 4B 2609 Microsoft	Q8_0	fits	5.7 GB	251k256k with q8 cache	56tok/sest.	1082 tok/s	chat, coding, agents, long documents
DeepSeek R1 Distill Qwen 7B DeepSeek	Q8_0	fits	9.1 GB	101k128k with q8 cache	32tok/sest.	632 tok/s	chat, coding
GLM 4 9B 0414 Z.ai	mlx-5bit	fits	9.1 GB	32k	32tok/sest.	497 tok/s	chat, coding
DeepSeek R1 Distill Llama 8B DeepSeek	Q8_0	fits	10.1 GB	43k79k with q8 cache	29tok/sest.	586 tok/s	chat, coding
Ministral 3 8B Reasoning 2512 Mistral AI	Q8_0	fits	10.6 GB	38k69k with q8 cache	27tok/sest.	530 tok/s	chat, coding
GLM 4.6V Flash Z.ai	Q8_0	fits	10.8 GB	97k128k with q8 cache	27tok/sest.	458 tok/s	chat, coding
GLM 4.1V 9B Thinking Z.ai	mlx-8bit	fits	12.4 GB	60k64k with q8 cache	23tok/sest.	458 tok/s	chat, coding
Ministral 3 14B Reasoning 2512 Mistral AI	Q6_K	fits	12.7 GB	20k37k with q8 cache	22tok/sest.	349 tok/s	chat
DeepSeek R1 Distill Qwen 14B DeepSeek	Q6_K	fits	13.9 GB	12k22k with q8 cache	20tok/sest.	318 tok/s	chat
Qwen 3.8 27B Alibaba Qwen	UD-Q4_K_M	offload	17.1 GB	–	10tok/sest.	170 tok/s	–
Qwen 3.5 122B-A10B Alibaba Qwen	UD-Q2_K_XL	offload	40.4 GB	–	12tok/sest.	300 tok/s	–
Qwen 3.6 27B Alibaba Qwen	Q4_K_M	offload	17.4 GB	–	10tok/sest.	168 tok/s	–
Gemma 4 31B Google	Q4_K_M	offload	19.6 GB	–	7tok/sest.	137 tok/s	–
Mistral Small 4 119B Mistral AI	UD-Q2_K_XL	offload	38.8 GB	–	18tok/sest.	399 tok/s	chat
Qwen 3.6 35B-A3B Alibaba Qwen	MXFP4	offload	21.6 GB	–	34tok/sest.	1281 tok/s	chat, coding
Qwen 3.5 27B Alibaba Qwen	Q4_K_M	offload	17.4 GB	–	10tok/sest.	169 tok/s	–
Gemma 4 26B-A4B Google	MXFP4	offload	16.9 GB	–	36tok/sest.	1120 tok/s	chat, coding
Qwen 3.5 35B-A3B Alibaba Qwen	Q4_K_M	offload	21.9 GB	–	33tok/sest.	1272 tok/s	chat, coding
GLM 4.7 Flash Z.ai	Q4_K_M	offload	18.6 GB	–	25tok/sest.	778 tok/s	chat
Devstral Small 2 24B Mistral AI	Q4_K_M	offload	15.7 GB	2k3k with q8 cache	14tok/sest.	202 tok/s	–
Nemotron 3.5 Lightning 30B-A3B NVIDIA	MXFP4	offload	22.9 GB	–	28tok/sest.	1295 tok/s	chat, coding, long documents
Qwen3 Coder 30B-A3B Alibaba Qwen	Q4_K_M	offload	19.2 GB	–	32tok/sest.	988 tok/s	chat
Kimi Linear 48B-A3B Moonshot AI	Q4_K_M	offload	29.2 GB	–	27tok/sest.	1051 tok/s	chat, coding, long documents
Qwen3 32B Alibaba Qwen	Q4_K_M	offload	21.6 GB	–	5tok/sest.	115 tok/s	–
Mistral Small 3.2 24B Mistral AI	Q4_K_M	offload	15.7 GB	2k3k with q8 cache	14tok/sest.	202 tok/s	–
Gemma 3 27B Google	Q4_K_M	offload	17.6 GB	–	9tok/sest.	170 tok/s	–
DeepSeek R1 Distill Qwen 32B DeepSeek	Q4_K_M	offload	21.6 GB	–	5tok/sest.	120 tok/s	–
LFM2.5 24B A2B Liquid AI	Q4_K_M	offload	16.1 GB	–	63tok/sest.	1895 tok/s	chat, coding
Devstral Small 2507 Mistral AI	Q4_K_M	offload	15.7 GB	2k3k with q8 cache	14tok/sest.	206 tok/s	–
Magistral Small 2506 Mistral AI	Q4_K_M	offload	15.7 GB	2k3k with q8 cache	14tok/sest.	206 tok/s	–
Magistral Small 2507 Mistral AI	Q4_K_M	offload	15.7 GB	2k3k with q8 cache	14tok/sest.	206 tok/s	–
Magistral Small 2509 Mistral AI	Q4_K_M	offload	15.7 GB	2k3k with q8 cache	14tok/sest.	202 tok/s	–
Muse Glimmer 30B meta-models	Q4_K_M	offload	17.4 GB	–	10tok/sest.	156 tok/s	–
granite 4.2 30b IBM	Q4_K_M	offload	19.9 GB	–	6tok/sest.	142 tok/s	–
Qwen3.8 27B OBLITERATED OBLITERATUS	mlx-4bit	offload	21.0 GB	–	6tok/sest.	152 tok/s	–
DeepSeek V4 Flash DeepSeek	UD-Q2_K_XL	won't run	92.0 GB	–	–	–	–
GLM 5.3 Flash Z.ai	UD-Q2_K_XL	won't run	102.6 GB	–	–	–	–
Qwen 3.8 Flash Next Alibaba Qwen	UD-Q2_K_XL	won't run	74.9 GB	–	–	–	–
MiniMax M2.7 MiniMax	UD-Q2_K_XL	won't run	73.2 GB	–	–	–	–
Nemotron 3 Super 120B-A12B NVIDIA	UD-Q2_K_XL	won't run	52.3 GB	–	–	–	–
Qwen3 Coder Next Alibaba Qwen	Q4_K_M	won't run	46.6 GB	–	–	–	–
gpt-oss 120B OpenAI	Q4_K_M	won't run	59.9 GB	–	–	–	–
GLM 4.5 Air Z.ai	Q2_K	won't run	44.8 GB	–	–	–	–
Qwen3 Next 80B-A3B Alibaba Qwen	Q4_K_M	won't run	46.6 GB	–	–	–	–
Llama 3.3 70B Meta	Q4_K_M	won't run	43.2 GB	–	–	–	–
DeepSeek R1 DeepSeek	Q4_K_M	won't run	378.3 GB	–	–	–	–
DeepSeek R1 0528 DeepSeek	Q4_K_M	won't run	378.8 GB	–	–	–	–
DeepSeek R1 Distill Llama 70B DeepSeek	Q4_K_M	won't run	43.2 GB	–	–	–	–
DeepSeek R1 Zero DeepSeek	Q4_K_M	won't run	378.3 GB	–	–	–	–
DeepSeek V3 DeepSeek	Q4_K_M	won't run	378.3 GB	–	–	–	–
DeepSeek V3 0324 DeepSeek	Q4_K_M	won't run	378.3 GB	–	–	–	–
DeepSeek V3.1 DeepSeek	Q4_K_M	won't run	379.2 GB	–	–	–	–
DeepSeek V3.1 Terminus DeepSeek	Q4_K_M	won't run	379.2 GB	–	–	–	–
DeepSeek V3.2 DeepSeek	Q4_K_M	won't run	379.2 GB	–	–	–	–
DeepSeek V4 Flash 0731 DeepSeek	MXFP4	won't run	147.5 GB	–	–	–	–
DeepSeek V4 Flash Vision Exp DeepSeek	MXFP4	won't run	156.2 GB	–	–	–	–
Devstral 2 123B Instruct 2512 Mistral AI	Q4_K_M	won't run	73.7 GB	–	–	–	–
GLM 4.5 Z.ai	Q4_K_M	won't run	205.6 GB	–	–	–	–
GLM 4.5V Z.ai	Q4_K_M	won't run	61.8 GB	–	–	–	–
GLM 4.6 Z.ai	Q4_K_M	won't run	204.8 GB	–	–	–	–
GLM 4.6V Z.ai	Q4_K_M	won't run	68.2 GB	–	–	–	–
GLM 4.7 Z.ai	Q4_K_M	won't run	205.6 GB	–	–	–	–
GLM 5 Z.ai	MXFP4	won't run	384.2 GB	–	–	–	–
GLM 5.1 Z.ai	MXFP4	won't run	421.8 GB	–	–	–	–
GLM 5.2 Z.ai	UD-Q4_K_M	won't run	435.7 GB	–	–	–	–
GLM 5.3 Z.ai	Q8_0	won't run	748.2 GB	–	–	–	–
Kimi Dev 72B Moonshot AI	Q6_K	won't run	63.6 GB	–	–	–	–
Kimi K2 Moonshot AI	Q4_K_M	won't run	579.8 GB	–	–	–	–
Kimi K2 Instruct 0905 Moonshot AI	Q4_K_M	won't run	580.3 GB	–	–	–	–
Kimi K2 Thinking Moonshot AI	Q4_K_M	won't run	580.3 GB	–	–	–	–
Kimi K2.5 Moonshot AI	Q4_K_M	won't run	580.3 GB	–	–	–	–
MiniMax M2 MiniMax	Q4_K_M	won't run	131.9 GB	–	–	–	–
MiniMax M2.1 MiniMax	Q4_K_M	won't run	131.9 GB	–	–	–	–
MiniMax M2.5 MiniMax	MXFP4	won't run	118.4 GB	–	–	–	–
MiniMax M3 MiniMax	MXFP4	won't run	241.8 GB	–	–	–	–
Mistral Medium 3.5 128B Mistral AI	Q4_K_M	won't run	73.7 GB	–	–	–	–

Specifications

From the manufacturer's published specifications; sources are linked where we have them.

GPU: GeForce RTX 5060 Ti 8GB
Memory: 8 GB GDDR7
Memory bus: 128-bit
Memory bandwidth: 448 GB/s
FP16 compute: 23.704 TFLOPS
Software: CUDA
Board power: 180 W
PCIe generation: Gen 5
PCIe lanes: x8

Compare with

Questions

How much memory does the NVIDIA GeForce RTX 5060 Ti 8GB have for AI models?: The NVIDIA GeForce RTX 5060 Ti 8GB has 8 GB of GDDR7 memory with 448 GB/s of bandwidth, which sets how fast it generates text.
What is the best model the NVIDIA GeForce RTX 5060 Ti 8GB can run locally?: gpt-oss 20B (MXFP4) fits fully in its memory at 8k context and generates at about 63 tok/s, an estimate from its memory bandwidth. 38 of the 129 models we track fit at that context.
Can the NVIDIA GeForce RTX 5060 Ti 8GB run DeepSeek V4 Flash?: No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 92 GB at 8k context, more than the NVIDIA GeForce RTX 5060 Ti 8GB and system RAM can hold.
How much does the NVIDIA GeForce RTX 5060 Ti 8GB cost in Germany?: The best new price for the NVIDIA GeForce RTX 5060 Ti 8GB in Germany is 518 € at eBay; used, it starts at 529 € (asking price).

Speeds on this page are for 8k context. See the best hardware for local AI at every budget.