NVIDIA GeForce RTX 4060 vs AMD Radeon RX 7900 XT
For running models locally, priced in the UK. At 128k context the first runs 5 models fully in memory, the second 26.
In short
The AMD Radeon RX 7900 XT has more memory for models: 20 GB against 8 GB. At 128k context the AMD Radeon RX 7900 XT runs 26 of the models we track fully in memory and the NVIDIA GeForce RTX 4060 5; only the AMD Radeon RX 7900 XT holds gpt-oss 20B. On the models both run fully in memory, the AMD Radeon RX 7900 XT is about 2.6× as fast as the NVIDIA GeForce RTX 4060 (estimated, median across models). In the UK the NVIDIA GeForce RTX 4060 costs £791 at Amazon and the AMD Radeon RX 7900 XT £829 at Amazon: the NVIDIA GeForce RTX 4060 is £38 cheaper.
Updated . Speeds are estimates; how they are worked out.
Specifications
| Spec | NVIDIA GeForce RTX 4060 | AMD Radeon RX 7900 XT |
|---|---|---|
| GPU | GeForce RTX 4060 | Radeon RX 7900 XT |
| Memory | 8 GB GDDR6 | 20 GB GDDR6 |
| Memory bus | 128-bit | 320-bit |
| Memory bandwidth | 272 GB/s | 800 GB/s |
| FP16 compute | 15.114 TFLOPS | 103 TFLOPS |
| Software | CUDA | ROCm |
| Board power | 115 W | 315 W |
| PCIe generation | Gen 4 | Gen 4 |
| PCIe lanes | x8 | x16 |
What each runs
Estimated decode speed with the most precise quant that fits each one est.
| Model | NVIDIA GeForce RTX 4060 | AMD Radeon RX 7900 XT |
|---|---|---|
| gpt-oss 20B | offload | 47tok/sMXFP4 |
| Gemma 4 12B | offload | 29tok/sQ8_0 |
| Qwen 3.5 9B | offload | 32tok/sQ8_0 |
| Qwen 3.5 4B | offload | 50tok/sQ8_0 |
| Gemma 4 E4B | offload | 37tok/sQ8_0 |
| LFM2.5 8B-A1B | offload | 35tok/sQ8_0 |
| Qwen2.5 0.5B | 79tok/sQ8_0 | 205tok/sQ8_0 |
| Qwen3.5 0.8B | 69tok/sQ8_0 | 180tok/sQ8_0 |
| Qwen3.5 2B | 55tok/sQ5_K_M | 144tok/sQ5_K_M |
| LFM3 1.7B | 49tok/sQ8_0 | 127tok/sQ8_0 |
| DeepSeek R1 Distill Qwen 1.5B | 30tok/sQ8_0 | 78tok/sQ8_0 |
| FrogNano 4B 2609 | offload | 49tok/sQ8_0 |
| MiniCPM5 2B | offload | 53tok/sQ8_0 |
| Spark X2.5 4B | offload | 56tok/smlx-4bit |
| Mellum2.1 12B A2.5B Thinking | offload | 58tok/sQ8_0 |
| LFM2.5 2.6B | offload | 40tok/sQ8_0 |
| LFM2.5 VL 3B | offload | 40tok/sQ8_0 |
| Kimi VL A3B Thinking 2506 | offload | 44tok/sQ4_K_M |
| GLM 4.6V Flash | offload | 29tok/sQ8_0 |
| Kimi VL A3B | offload | 40tok/smlx-6bit |
| DeepSeek R1 Distill Qwen 7B | offload | 28tok/sQ8_0 |
| GLM 4 9B 0414 | offload | 32tok/smlx-5bit |
| granite vision 4.1 4b | offload | 31tok/sQ8_0 |
| granite 4.2 3b | offload | 30tok/sQ8_0 |
| Ministral 3 3B Instruct 2512 | offload | 25tok/sQ8_0 |
| GLM 4.1V 9B Thinking | offload | 26tok/smlx-8bit |
| Qwen 3.8 27B | offload | offload |
| Qwen 3.5 122B-A10B | won't run | offload |
| Qwen 3.6 27B | offload | offload |
| Gemma 4 31B | offload | offload |
| Mistral Small 4 119B | won't run | offload |
| Qwen 3.6 35B-A3B | offload | offload |
| Qwen 3.5 27B | offload | offload |
| Gemma 4 26B-A4B | offload | offload |
| Qwen 3.5 35B-A3B | offload | offload |
| GLM 4.7 Flash | offload | offload |
| Devstral Small 2 24B | won't run | offload |
| Nemotron 3.5 Lightning 30B-A3B | offload | offload |
| Kimi Linear 48B-A3B | offload | offload |
| Qwen3 Coder 30B-A3B | offload | offload |
| Gemma 3 27B | offload | offload |
| Mistral Small 3.2 24B | won't run | offload |
| Ministral 3 14B | offload | offload |
| Qwen3 14B | offload | offload |
| DeepSeek R1 0528 Qwen3 8B | offload | offload |
| Qwen3 8B | offload | offload |
| Phi-4 14B | won't run | offload |
| Ministral 3 8B | offload | offload |
| Granite 4.2 8B | offload | offload |
| Llama 3.1 8B | offload | offload |
| Muse Glimmer 30B | offload | offload |
| LFM2.5 24B A2B | offload | offload |
| DeepSeek R1 Distill Llama 8B | offload | offload |
| Ministral 3 8B Reasoning 2512 | offload | offload |
| Ministral 3 14B Reasoning 2512 | offload | offload |
| Qwen3.8 27B OBLITERATED | offload | offload |
| DeepSeek R1 Distill Qwen 14B | won't run | offload |
| Devstral Small 2507 | won't run | offload |
| Magistral Small 2506 | won't run | offload |
| Magistral Small 2507 | won't run | offload |
| Magistral Small 2509 | won't run | offload |
| DeepSeek V4 Flash | won't run | won't run |
| GLM 5.3 Flash | won't run | won't run |
| Qwen 3.8 Flash Next | won't run | won't run |
| MiniMax M2.7 | won't run | won't run |
| Nemotron 3 Super 120B-A12B | won't run | won't run |
| Qwen3 Coder Next | won't run | won't run |
| gpt-oss 120B | won't run | won't run |
| GLM 4.5 Air | won't run | won't run |
| Qwen3 Next 80B-A3B | won't run | won't run |
| Qwen3 32B | won't run | won't run |
| DeepSeek R1 Distill Qwen 32B | won't run | won't run |
| Llama 3.3 70B | won't run | won't run |
| DeepSeek R1 | won't run | won't run |
| DeepSeek R1 0528 | won't run | won't run |
| DeepSeek R1 Distill Llama 70B | won't run | won't run |
| DeepSeek R1 Zero | won't run | won't run |
| DeepSeek V3 | won't run | won't run |
| DeepSeek V3 0324 | won't run | won't run |
| DeepSeek V3.1 | won't run | won't run |
| DeepSeek V3.1 Terminus | won't run | won't run |
| DeepSeek V3.2 | won't run | won't run |
| DeepSeek V4 Flash 0731 | won't run | won't run |
| DeepSeek V4 Flash Vision Exp | won't run | won't run |
| Devstral 2 123B Instruct 2512 | won't run | won't run |
| GLM 4.5 | won't run | won't run |
| GLM 4.5V | won't run | won't run |
| GLM 4.6 | won't run | won't run |
| GLM 4.6V | won't run | won't run |
| GLM 4.7 | won't run | won't run |
| GLM 5 | won't run | won't run |
| GLM 5.1 | won't run | won't run |
| GLM 5.2 | won't run | won't run |
| GLM 5.3 | won't run | won't run |
| Kimi Dev 72B | won't run | won't run |
| Kimi K2 | won't run | won't run |
| Kimi K2 Instruct 0905 | won't run | won't run |
| Kimi K2 Thinking | won't run | won't run |
| Kimi K2.5 | won't run | won't run |
| MiniMax M2 | won't run | won't run |
| MiniMax M2.1 | won't run | won't run |
| MiniMax M2.5 | won't run | won't run |
| MiniMax M3 | won't run | won't run |
| Mistral Medium 3.5 128B | won't run | won't run |
| granite 4.2 30b | won't run | won't run |
Questions
- Which is better for local AI, the NVIDIA GeForce RTX 4060 or the AMD Radeon RX 7900 XT?
- Choose the AMD Radeon RX 7900 XT to run bigger models. Choose the AMD Radeon RX 7900 XT for speed. Choose the NVIDIA GeForce RTX 4060 to spend less.
- Which can run bigger models, the NVIDIA GeForce RTX 4060 or the AMD Radeon RX 7900 XT?
- At 128k context the AMD Radeon RX 7900 XT runs 26 of the models we track fully in memory and the NVIDIA GeForce RTX 4060 5; only the AMD Radeon RX 7900 XT holds gpt-oss 20B.
- Which is faster for local AI, the NVIDIA GeForce RTX 4060 or the AMD Radeon RX 7900 XT?
- On the models both run fully in memory, the AMD Radeon RX 7900 XT is about 2.6× as fast as the NVIDIA GeForce RTX 4060 (estimated, median across models).
- What is the price difference between the NVIDIA GeForce RTX 4060 and the AMD Radeon RX 7900 XT?
- In the UK the NVIDIA GeForce RTX 4060 costs £791 at Amazon and the AMD Radeon RX 7900 XT £829 at Amazon: the NVIDIA GeForce RTX 4060 is £38 cheaper.
More comparisons
- Mac mini M4 16GB vs NVIDIA GeForce RTX 4060
- Mac mini M4 16GB vs AMD Radeon RX 7900 XT
- NVIDIA GeForce RTX 3060 12GB vs NVIDIA GeForce RTX 4060
- NVIDIA GeForce RTX 4060 vs NVIDIA GeForce RTX 4060 Ti 8GB
- NVIDIA GeForce RTX 4060 vs NVIDIA GeForce RTX 4070
- NVIDIA GeForce RTX 4060 vs NVIDIA GeForce RTX 5050
- NVIDIA GeForce RTX 4060 vs AMD Radeon RX 9070 XT
- NVIDIA GeForce RTX 4070 vs AMD Radeon RX 7900 XT
- NVIDIA GeForce RTX 4070 Super vs AMD Radeon RX 7900 XT
- NVIDIA GeForce RTX 4080 Super vs AMD Radeon RX 7900 XT