Best graphics cards for local AI
Ranked by what each one runs fully in memory at 32k context, with prices in Canada today.
In short
The top pick in Canada right now is the NVIDIA RTX PRO 6000 Blackwell, $3,133 at Amazon: it runs DeepSeek V4 Flash fully in memory at 32k context at about 69 tok/s (estimated). Ranked by the most capable open model each one runs fully in memory at 32k context and a usable speed, then by how many models it runs, then by speed on Qwen 3.8 27B, then by price.
Updated . Speeds are estimates; how they are worked out.
The list
Best first. Speeds are estimates est.
| # | Card | Memory | Price | Best model it runs at 32k | Models in memory | Qwen 3.8 27B | tok/s per $1,000 |
|---|---|---|---|---|---|---|---|
| 1 | NVIDIA RTX PRO 6000 Blackwell | 96 GB | $3,133Amazon | DeepSeek V4 FlashUD-Q2_K_XL69 tok/s | 40 | 35 tok/s | 11.3 |
| 2 | NVIDIA GeForce RTX 5090 | 32 GB | $10,300Amazon | Qwen 3.8 27BQ8_035 tok/s | 29 | 35 tok/s | 3.4 |
| 3 | NVIDIA GeForce RTX 3090 Ti | 24 GB | $3,999Amazon | Qwen 3.8 27BUD-Q5_K_M28 tok/s | 26 | 28 tok/s | 7.1 |
| 4 | NVIDIA GeForce RTX 4090 | 24 GB | $7,107Amazon | Qwen 3.8 27BUD-Q5_K_M28 tok/s | 26 | 28 tok/s | 4 |
| 5 | NVIDIA GeForce RTX 3090 | 24 GB | $2,800Amazon | Qwen 3.8 27BUD-Q5_K_M26 tok/s | 26 | 26 tok/s | 9.4 |
| 6 | AMD Radeon RX 7900 XT | 20 GB | $2,175Amazon | Qwen 3.8 27BUD-Q4_K_M24 tok/s | 18 | 24 tok/s | 10.8 |
| 7 | AMD Radeon AI PRO R9700 | 32 GB | $2,800Amazon | Qwen 3.6 35B-A3BUD-Q6_K66 tok/s | 20 | 11 tok/s | 4 |
| 8 | Intel Arc Pro B60 | 24 GB | $1,060Amazon | Qwen 3.6 35B-A3BUD-Q4_K_M49 tok/s | 16 | 10 tok/s | 9.7 |
| 9 | Intel Arc A770 16GB | 16 GB | $655Amazon | gpt-oss 20BMXFP448 tok/s | 13 | offload | – |
| 10 | NVIDIA GeForce RTX 5060 Ti 16GB | 16 GB | $1,120Amazon | gpt-oss 20BMXFP452 tok/s | 13 | offload | – |
| 11 | AMD Radeon RX 9070 XT | 16 GB | $1,200Amazon | gpt-oss 20BMXFP465 tok/s | 13 | offload | – |
| 12 | AMD Radeon RX 7800 XT | 16 GB | $1,397Amazon | gpt-oss 20BMXFP464 tok/s | 13 | offload | – |
Questions
- What is the best graphics card for running AI models locally?
- The top pick in Canada right now is the NVIDIA RTX PRO 6000 Blackwell, $3,133 at Amazon: it runs DeepSeek V4 Flash fully in memory at 32k context at about 69 tok/s (estimated).
- Which gives the most speed for the money?
- The NVIDIA RTX PRO 6000 Blackwell: about 35 tok/s on Qwen 3.8 27B for $3,133, the most tokens per second per unit of price on this list (estimated).
- What is the cheapest option here that runs Qwen 3.8 27B fully in memory?
- The Intel Arc Pro B60, $1,060 at Amazon, at about 10 tok/s at 32k context (estimated).