What is the best model the NVIDIA GeForce RTX 5070 can run locally?

Gemma 4 26B-A4B (Q5_K_M) fits fully in its memory at 128k context and generates at about 43 tok/s, an estimate from its memory bandwidth. 23 of the 113 models we track fit at that context.

Can the NVIDIA GeForce RTX 5070 run DeepSeek V4 Flash?

No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 103 GB at 128k context, more than the NVIDIA GeForce RTX 5070 and system RAM can hold.

NVIDIA GeForce RTX 5070

12 GB · 672 GB/s · 250 W

In short

The NVIDIA GeForce RTX 5070 has 12 GB of GDDR7 memory with 672 GB/s of bandwidth, which sets how fast it generates text. At 128k context it runs 23 of the 113 open models we track fully in memory; the most capable is Gemma 4 26B-A4B at Q5_K_M, at about 43 tok/s (estimated). The best new price for the NVIDIA GeForce RTX 5070 in Germany is 699 € at eBay; used, it starts at 780 € (asking price).

Updated 15 October 2026. Speeds are estimates; how they are worked out.

Prices

Every retailer we track in Germany, cheapest first. Buy links may earn us a commission.

Retailer	Condition	Price	Stock	Checked	Buy
eBayGIGABYTE GeForce RTX 5070 Eagle OC ICE SFF 12GB GDDR7 RAM 1x HDMI 3x DP Neu OVP	New	699 €+ 5 € delivery	In stock	3 h ago	Buy
eBayASUS Dual GeForce RTX 5070 OC 12GB DUAL-RTX5070-O12G Grafikkarte GDDR7 DP/HDMI	used, asking price	780 €+ 8 € delivery	In stock	3 h ago	Buy
eBayGIGABYTE EAGLE OC SFF GeForce RTX 5070 12GB Grafikkarte Raytracing	used, asking price	800 €	In stock	3 h ago	Buy
eBayGIGABYTE GeForce RTX 5070 GAMING OC 12GB GDDR7 PCIe 5.0 x16 Grafikkarte	New	798 €+ 8 € delivery	In stock	3 h ago	Buy
eBayASUS PRIME GeForce RTX 5070 OC 12GB	New	800 €+ 8 € delivery	In stock	3 h ago	Buy
AmazonASUS Dual GeForce RTX 5070 12GB GDDR7 OC Edition Gaming Graphics Card	New	817 €	In stock	1 h ago	Buy
AmazonMSI GeForce RTX 5070 12G Ventus 2X OC Gaming Graphics Card	New	835 €	In stock	1 h ago	Buy
eBayMSI GeForce RTX 5070 12GB VENTUS 3X OC 12GB GDDR7.	used, asking price	837 €+ 8 € delivery	In stock	3 h ago	Buy
eBayZotac Gaming GeForce RTX 5070 Twin Edge	used, asking price	849 €	In stock	3 h ago	Buy
eBayMSI GeForce RTX 12GB 5070 GAMING TRIO OC WHITE Grafikkarte + ARGB MSI Halter	used, asking price	865 €+ 8 € delivery	In stock	3 h ago	Buy
AmazonASUS Prime GeForce RTX 5070 12GB GDDR7 OC Edition Gaming Graphics Card	New	879 €	In stock	1 h ago	Buy
AmazonPNY GeForce RTX 5070 12GB Triple Fan Graphics Card DLSS 4	New	880 €	In stock	1 h ago	Buy
AmazonGigabyte GeForce RTX 5070 Eagle OC Ice SFF 12G Graphics Card	New	885 €	In stock	1 h ago	Buy
AmazonGIGABYTE GeForce RTX 5070 WINDFORCE SFF 12G Graphics Card	New	891 €	In stock	1 h ago	Buy
AmazonMSI GeForce RTX 5070 12G Shadow 2X OC Gaming Graphics Card	New	900 €	In stock	1 h ago	Buy
AmazonMSI GeForce RTX 5070 12G Gaming Trio OC Gaming Graphics Card	New	904 €	In stock	1 h ago	Buy
AmazonPNY GeForce RTX 5070 12GB ARGB OC Triple Fan Graphics Card DLSS 4	New	913 €	In stock	1 h ago	Buy
AmazonPNY NVIDIA GeForce RTX 5070 Slim Dual Fan 12GB GDDR7 OC Graphics Card	New	916 €	In stock	1 h ago	Buy
eBayASUS GeForce RTX 5070 Dual OC 12GB GDDR7 DLSS4	New	937 €	In stock	3 h ago	Buy
eBayGrafikkarte ASUS Prime GeForce RTX 5070 OC	New	940 €	In stock	3 h ago	Buy
eBayGIGABYTE GeForce RTX 5070 Eagle OC ICE SFF 12GB GDDR7 RAM 1x HDMI 3x DP Neu OVP	New	930 €+ 12 € delivery	In stock	3 h ago	Buy
eBayInno3D Nvidia GeForce RTX 5070 TwinX2 OC WHITE 12GB GDDR7 RAM HDMI 3x DP Neu OVP	New	930 €+ 12 € delivery	In stock	3 h ago	Buy
AmazonASUS Prime GeForce RTX 5070 12GB GDDR7 Gaming Graphics Card	New	949 €	In stock	1 h ago	Buy
eBayMSI GeForce Nvidia RTX 5070 VENTUS 2X OC 12GB GDDR7 HDMI 3x DP	New	940 €+ 12 € delivery	In stock	3 h ago	Buy
eBayASUS Dual GeForce RTX 5070 12GB GDDR7 OC Edition Gaming Grafikkarte	New	955 €	In stock	3 h ago	Buy
eBayPNY Nvidia GeForce RTX 5070 EPIC-X ARGB OC 12GB GDDR7 RAM 1x HDMI 3x DP Neu 19%	New	945 €+ 12 € delivery	In stock	3 h ago	Buy
eBayGIGABYTE GeForce RTX 5070 GAMING OC 12G Grafikkarte	New	960 €	In stock	3 h ago	Buy
eBayGigabyte GeForce RTX 5070 Gaming OC 12 GB GDDR7 PCIe 5.0 x16	New	968 €	In stock	3 h ago	Buy
eBayASUS PRIME GeForce RTX 5070 12GB GDDR7 OC Edition	New	975 €	In stock	3 h ago	Buy
AmazonGigabyte GeForce RTX 5070 WINDFORCE SFF 12G Graphics Card	New	975 €	In stock	1 h ago	Buy
eBayZotac GeForce RTX 5070 Twin Edge OC 12 GB GDDR7 PCIe 5.0 x16	New	980 €	In stock	3 h ago	Buy
AmazonASUS Prime GeForce RTX 5070 12GB GDDR7 White OC Edition Graphics Card	New	993 €	In stock	1 h ago	Buy
AmazonNVIDIA	New	1.000 €	In stock	1 h ago	Buy
eBayASUS PRIME GeForce RTX 5070 12 GB GDDR7 OC Edition Gaming Grafikkarte	New	1.003 €	In stock	3 h ago	Buy
eBayMSI GeForce RTX 5070 Gaming Trio OC 12 GB GDDR7 PCIe 5.0 x16	New	1.013 €	In stock	3 h ago	Buy
AmazonASUS The T1 GeForce RTX 5070 12GB GDDR7 Graphics Card	New	999 €+ 21 € delivery	In stock	1 h ago	Buy
AmazonGigabyte Aorus GeForce RTX 5070 Master 12G Graphics Card	New	1.046 €	In stock	1 h ago	Buy
AmazonASUS ROG Strix GeForce RTX 5070 OC Edition 12GB GDDR7 Gaming Graphics Card	New	1.344 €+ 41 € delivery	In stock	1 h ago	Buy

Used on eBay: median asking price 810 €, most between 790 € and 853 € (8 listings, 2026-10-15).

Price history

Lowest price shown each day over the last 90 days.

Not enough price history yet.

What two of them run

Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.

Model	Quant	Fits	Memory	Max context	Decode @128k	Prefill	Good for
Gemma 4 26B-A4B Google	Q5_K_M	fits	22.5 GB	138k221k with q8 cache	43tok/sest.	2024 tok/s	chat, coding, agents, long documents
gpt-oss 20B OpenAI	MXFP4	fits	16.1 GB	128k	44tok/sest.	1310 tok/s	chat, coding, agents, long documents
Gemma 4 12B Google	Q8_0	fits	16.0 GB	256k	28tok/sest.	841 tok/s	chat, coding, long documents
Qwen 3.5 9B Alibaba Qwen	Q8_0	fits	14.8 GB	256k	30tok/sest.	1000 tok/s	chat, coding, long documents
Qwen 3.5 4B Alibaba Qwen	Q8_0	fits	10.1 GB	256k	47tok/sest.	1558 tok/s	chat, coding, long documents
Gemma 4 E4B Google	Q8_0	fits	13.0 GB	128k	35tok/sest.	1402 tok/s	chat, coding, long documents
LFM2.5 8B-A1B Liquid AI	Q8_0	fits	16.2 GB	125k	33tok/sest.	1874 tok/s	chat, coding, long documents
Llama 3.1 8B Meta	Q4_K_M	fits	22.4 GB	128k	19tok/sest.	553 tok/s	chat, coding, long documents
Qwen2.5 0.5B Alibaba Qwen	Q8_0	fits	3.8 GB	32k	195tok/sest.	4211 tok/s	chat, coding, long documents
Qwen3.5 0.8B Alibaba Qwen	Q8_0	fits	4.1 GB	256k	171tok/sest.	5616 tok/s	chat, coding, agents, long documents
Qwen3.5 2B Alibaba Qwen	Q5_K_M	fits	4.7 GB	256k	136tok/sest.	3591 tok/s	chat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B DeepSeek	Q8_0	fits	7.1 GB	128k	74tok/sest.	1882 tok/s	chat, coding, long documents
Mellum2.1 12B A2.5B Thinking JetBrains	Q8_0	fits	15.7 GB	128k	55tok/sest.	2168 tok/s	chat, coding, agents, long documents
MiniCPM5 2B openbmb	Q8_0	fits	9.6 GB	128k	50tok/sest.	1012 tok/s	chat, coding, agents, long documents
LFM2.5 2.6B Liquid AI	Q8_0	fits	12.0 GB	128k	38tok/sest.	1298 tok/s	chat, coding, agents, long documents
LFM2.5 VL 3B Liquid AI	Q8_0	fits	12.0 GB	32k	38tok/sest.	1248 tok/s	chat, coding, agents, long documents
Kimi VL A3B Moonshot AI	mlx-8bit	fits	22.2 GB	128k	34tok/sest.	1361 tok/s	chat, coding, agents, long documents
granite vision 4.1 4b IBM	Q8_0	fits	15.2 GB	128k	29tok/sest.	801 tok/s	chat, coding, long documents
granite 4.2 3b IBM	Q8_0	fits	15.5 GB	128k	29tok/sest.	817 tok/s	chat, coding, agents, long documents
GLM 4.6V Flash Z.ai	Q8_0	fits	16.2 GB	128k	27tok/sest.	439 tok/s	chat, coding, agents, long documents
DeepSeek R1 Distill Qwen 7B DeepSeek	Q8_0	fits	16.4 GB	128k	27tok/sest.	672 tok/s	chat, coding, long documents
GLM 4.1V 9B Thinking Z.ai	mlx-8bit	fits	17.8 GB	64k	24tok/sest.	439 tok/s	chat, coding, long documents
DeepSeek R1 Distill Llama 8B DeepSeek	Q4_K_M	fits	22.4 GB	128k	19tok/sest.	553 tok/s	chat, coding, long documents
Qwen 3.8 27B Alibaba Qwen	UD-Q4_K_M	offload	25.3 GB	91k159k with q8 cache	10tok/sest.	321 tok/s	chat, coding
Qwen 3.5 122B-A10B Alibaba Qwen	UD-Q2_K_XL	offload	44.0 GB	–	9tok/sest.	426 tok/s	chat
Qwen 3.6 27B Alibaba Qwen	Q4_K_M	offload	25.7 GB	86k150k with q8 cache	9tok/sest.	318 tok/s	chat, coding
Gemma 4 31B Google	Q4_K_M	offload	29.7 GB	45k89k with q8 cache	5tok/sest.	277 tok/s	chat
Mistral Small 4 119B Mistral AI	UD-Q2_K_XL	offload	42.1 GB	–	11tok/sest.	377 tok/s	chat, coding
Qwen 3.6 35B-A3B Alibaba Qwen	MXFP4	offload	24.6 GB	56k87k with q8 cache	36tok/sest.	1587 tok/s	chat, coding, agents, long documents
Qwen 3.5 27B Alibaba Qwen	Q4_K_M	offload	25.6 GB	87k152k with q8 cache	9tok/sest.	319 tok/s	chat, coding
Qwen 3.5 35B-A3B Alibaba Qwen	Q4_K_M	offload	24.9 GB	44k70k with q8 cache	34tok/sest.	1575 tok/s	chat, coding, agents, long documents
GLM 4.7 Flash Z.ai	Q4_K_M	offload	25.5 GB	80k139k with q8 cache	14tok/sest.	732 tok/s	chat, coding, agents
Devstral Small 2 24B Mistral AI	Q4_K_M	offload	35.2 GB	51k93k with q8 cache	3tok/sest.	238 tok/s	chat, coding
Nemotron 3.5 Lightning 30B-A3B NVIDIA	UD-Q6_K_XL	offload	35.2 GB	–	17tok/sest.	1741 tok/s	chat, coding, long documents
Kimi Linear 48B-A3B Moonshot AI	Q4_K_M	offload	30.9 GB	–	30tok/sest.	1042 tok/s	chat, coding, long documents
Qwen3 Coder 30B-A3B Alibaba Qwen	Q4_K_M	offload	31.1 GB	44k79k with q8 cache	6tok/sest.	402 tok/s	chat, coding, agents
Gemma 3 27B Google	Q4_K_M	offload	27.7 GB	70k128k with q8 cache	7tok/sest.	372 tok/s	chat, coding
Mistral Small 3.2 24B Mistral AI	Q4_K_M	offload	35.2 GB	51k93k with q8 cache	3tok/sest.	238 tok/s	chat, coding
Ministral 3 14B Mistral AI	Q4_K_M	offload	29.5 GB	86k157k with q8 cache	5tok/sest.	336 tok/s	chat, coding
Qwen3 14B Alibaba Qwen	Q4_K_M	offload	30.2 GB	40k	5tok/sest.	283 tok/s	chat, coding
DeepSeek R1 0528 Qwen3 8B DeepSeek	Q4_K_M	offload	24.5 GB	116k128k with q8 cache	11tok/sest.	484 tok/s	chat, coding
Qwen3 8B Alibaba Qwen	Q4_K_M	offload	24.5 GB	40k	11tok/sest.	484 tok/s	chat, coding
Phi-4 14B Microsoft	Q4_K_M	offload	35.1 GB	16k	3tok/sest.	261 tok/s	chat, coding
Ministral 3 8B Mistral AI	Q4_K_M	offload	23.7 GB	121k220k with q8 cache	14tok/sest.	501 tok/s	chat, coding
Granite 4.2 8B IBM	Q4_K_M	offload	27.0 GB	102k128k with q8 cache	7tok/sest.	415 tok/s	chat, coding, agents
Ministral 3 8B Reasoning 2512 Mistral AI	Q4_K_M	offload	23.7 GB	121k220k with q8 cache	14tok/sest.	501 tok/s	chat, coding, agents
LFM2.5 24B A2B Liquid AI	Q4_K_M	offload	26.1 GB	88k128k with q8 cache	11tok/sest.	1005 tok/s	chat, coding, agents
DeepSeek R1 Distill Qwen 14B DeepSeek	Q4_K_M	offload	34.2 GB	68k126k with q8 cache	4tok/sest.	234 tok/s	chat, coding
Devstral Small 2507 Mistral AI	Q4_K_M	offload	35.2 GB	51k93k with q8 cache	3tok/sest.	241 tok/s	chat, coding
Magistral Small 2506 Mistral AI	Q4_K_M	offload	35.2 GB	40k	3tok/sest.	241 tok/s	chat, coding
Magistral Small 2507 Mistral AI	Q4_K_M	offload	35.2 GB	40k	3tok/sest.	241 tok/s	chat, coding
Magistral Small 2509 Mistral AI	Q4_K_M	offload	35.2 GB	51k93k with q8 cache	3tok/sest.	238 tok/s	chat, coding
DeepSeek V4 Flash DeepSeek	UD-Q2_K_XL	won't run	102.8 GB	–	–	–	–
GLM 5.3 Flash Z.ai	UD-Q2_K_XL	won't run	104.6 GB	–	–	–	–
Qwen 3.8 Flash Next Alibaba Qwen	UD-Q2_K_XL	won't run	78.4 GB	–	–	–	–
MiniMax M2.7 MiniMax	UD-Q2_K_XL	won't run	103.0 GB	–	–	–	–
Nemotron 3 Super 120B-A12B NVIDIA	UD-Q2_K_XL	won't run	53.9 GB	–	–	–	–
Qwen3 Coder Next Alibaba Qwen	Q4_K_M	won't run	50.1 GB	–	–	–	–
gpt-oss 120B OpenAI	Q4_K_M	won't run	64.8 GB	–	–	–	–
GLM 4.5 Air Z.ai	Q2_K	won't run	67.1 GB	–	–	–	–
Qwen3 Next 80B-A3B Alibaba Qwen	Q4_K_M	won't run	50.1 GB	–	–	–	–
Qwen3 32B Alibaba Qwen	Q4_K_M	won't run	52.3 GB	12k23k with q8 cache	–	–	–
DeepSeek R1 Distill Qwen 32B DeepSeek	Q4_K_M	won't run	52.3 GB	12k23k with q8 cache	–	–	–
Llama 3.3 70B Meta	Q4_K_M	won't run	81.5 GB	–	–	–	–
DeepSeek R1 DeepSeek	Q4_K_M	won't run	387.1 GB	–	–	–	–
DeepSeek R1 0528 DeepSeek	Q4_K_M	won't run	387.6 GB	–	–	–	–
DeepSeek R1 Distill Llama 70B DeepSeek	Q4_K_M	won't run	81.5 GB	–	–	–	–
DeepSeek V3 0324 DeepSeek	Q4_K_M	won't run	387.1 GB	–	–	–	–
DeepSeek V3.1 DeepSeek	Q4_K_M	won't run	388.0 GB	–	–	–	–
DeepSeek V3.2 DeepSeek	Q4_K_M	won't run	388.0 GB	–	–	–	–
DeepSeek V4 Flash 0731 DeepSeek	MXFP4	won't run	158.2 GB	–	–	–	–
DeepSeek V4 Flash Vision Exp DeepSeek	MXFP4	won't run	167.0 GB	–	–	–	–
Devstral 2 123B Instruct 2512 Mistral AI	Q8_0	won't run	169.6 GB	–	–	–	–
GLM 4.5V Z.ai	Q4_K_M	won't run	84.1 GB	–	–	–	–
GLM 4.6V Z.ai	Q4_K_M	won't run	90.5 GB	–	–	–	–
GLM 4.7 Z.ai	Q4_K_M	won't run	249.4 GB	–	–	–	–
GLM 5.1 Z.ai	MXFP4	won't run	432.8 GB	–	–	–	–
GLM 5.2 Z.ai	UD-Q4_K_M	won't run	446.7 GB	–	–	–	–
GLM 5.3 Z.ai	Q8_0	won't run	759.1 GB	–	–	–	–
Kimi K2 Moonshot AI	Q4_K_M	won't run	588.6 GB	–	–	–	–
Kimi K2 Instruct 0905 Moonshot AI	Q4_K_M	won't run	589.0 GB	–	–	–	–
Kimi K2 Thinking Moonshot AI	Q4_K_M	won't run	589.0 GB	–	–	–	–
Kimi K2.5 Moonshot AI	Q4_K_M	won't run	589.0 GB	–	–	–	–
MiniMax M2 MiniMax	Q4_K_M	won't run	161.7 GB	–	–	–	–
MiniMax M2.1 MiniMax	Q4_K_M	won't run	161.7 GB	–	–	–	–
MiniMax M2.5 MiniMax	MXFP4	won't run	148.1 GB	–	–	–	–
MiniMax M3 MiniMax	UD-Q4_K_M	won't run	263.6 GB	–	–	–	–
Mistral Medium 3.5 128B Mistral AI	Q4_K_M	won't run	115.6 GB	–	–	–	–
granite 4.2 30b IBM	Q4_K_M	won't run	50.6 GB	19k35k with q8 cache	–	–	–

Specifications

From the manufacturer's published specifications; sources are linked where we have them.

GPU: GeForce RTX 5070
Memory: 12 GB GDDR7
Memory bus: 192-bit
Memory bandwidth: 672 GB/s
FP16 compute: 62 TFLOPS
Software: CUDA
Board power: 250 W
PCIe generation: Gen 5
PCIe lanes: x16

Compare with

Questions

How much memory does the NVIDIA GeForce RTX 5070 have for AI models?: The NVIDIA GeForce RTX 5070 has 12 GB of GDDR7 memory with 672 GB/s of bandwidth, which sets how fast it generates text.
What is the best model the NVIDIA GeForce RTX 5070 can run locally?: Gemma 4 26B-A4B (Q5_K_M) fits fully in its memory at 128k context and generates at about 43 tok/s, an estimate from its memory bandwidth. 23 of the 113 models we track fit at that context.
Can the NVIDIA GeForce RTX 5070 run DeepSeek V4 Flash?: No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 103 GB at 128k context, more than the NVIDIA GeForce RTX 5070 and system RAM can hold.
How much does the NVIDIA GeForce RTX 5070 cost in Germany?: The best new price for the NVIDIA GeForce RTX 5070 in Germany is 699 € at eBay; used, it starts at 780 € (asking price).

Speeds on this page are for 128k context. See the best hardware for local AI at every budget.