NVIDIA GeForce RTX 5070 vs NVIDIA GeForce RTX 5070 Ti

For running models locally, priced in the US. At 64k context the first runs 5 models fully in memory, the second 10.

Specifications

SpecNVIDIA GeForce RTX 5070NVIDIA GeForce RTX 5070 Ti
GPUGeForce RTX 5070GeForce RTX 5070 Ti
Memory12 GB GDDR716 GB GDDR7
Memory bus192-bit256-bit
Memory bandwidth672 GB/s896 GB/s
FP16 compute62 TFLOPS88 TFLOPS
SoftwareCUDACUDA
Board power250 W300 W
PCIe generationGen 5Gen 5
PCIe lanesx16x16

What each runs

Estimated decode speed with the most precise quant that fits each one est.

ModelNVIDIA GeForce RTX 5070NVIDIA GeForce RTX 5070 Ti
gpt-oss 20Boffload83tok/sMXFP4
Gemma 4 12B42tok/sQ5_K_M40tok/sQ8_0
Qwen 3.5 9B43tok/sQ6_K47tok/sQ8_0
DeepSeek R1 0528 Qwen3 8Boffload38tok/sQ4_K_M
Qwen3 8Boffload38tok/sQ4_K_M
Qwen 3.5 4B62tok/sQ8_083tok/sQ8_0
Ministral 3 8Boffload37tok/sQ5_K_M
Gemma 4 E4B41tok/sQ8_055tok/sQ8_0
LFM2.5 8B-A1B62tok/sUD-Q6_K78tok/sQ8_0
Llama 3.1 8Boffload37tok/sQ6_K
Qwen 3.8 27Boffloadoffload
Qwen 3.6 27Boffloadoffload
Gemma 4 31Boffloadoffload
Mistral Small 4 119Bwon't runoffload
Qwen 3.6 35B-A3Boffloadoffload
Qwen 3.5 27Boffloadoffload
Gemma 4 26B-A4Boffloadoffload
Qwen 3.5 35B-A3Boffloadoffload
GLM 4.7 Flashoffloadoffload
Devstral Small 2 24Boffloadoffload
Nemotron 3.5 Lightning 30B-A3Boffloadoffload
Kimi Linear 48B-A3Boffloadoffload
Qwen3 Coder 30B-A3Boffloadoffload
Qwen3 32Boffloadoffload
Gemma 3 27Boffloadoffload
Mistral Small 3.2 24Boffloadoffload
DeepSeek R1 Distill Qwen 32Boffloadoffload
Ministral 3 14Boffloadoffload
Qwen3 14Boffloadoffload
Phi-4 14Boffloadoffload
Granite 4.2 8Boffloadoffload
DeepSeek V4 Flashwon't runwon't run
GLM 5.3 Flashwon't runwon't run
Qwen 3.8 Flash Nextwon't runwon't run
MiniMax M2.7won't runwon't run
Qwen 3.5 122B-A10Bwon't runwon't run
Nemotron 3 Super 120B-A12Bwon't runwon't run
Qwen3 Coder Nextwon't runwon't run
gpt-oss 120Bwon't runwon't run
GLM 4.5 Airwon't runwon't run
Qwen3 Next 80B-A3Bwon't runwon't run
Llama 3.3 70Bwon't runwon't run