Best hardware for local AI
Ranked by the biggest open models each one runs fully in memory, then speed, with prices in the US checked through the day.
Lists
- Best graphics cards for local AI
Top pick: NVIDIA RTX PRO 6000 Blackwell, $16,000 at eBay. Runs DeepSeek V4 Flash at 32k context, about 69 tok/s (est.).
- Best graphics cards for local AI under $500
Top pick: NVIDIA Tesla P40, $405 at eBay. Runs Qwen 3.6 35B-A3B at 32k context, about 50 tok/s (est.).
- Best graphics cards for local AI under $1,000
Top pick: AMD Radeon RX 7900 XT, $800 at Amazon. Runs Qwen 3.8 27B at 32k context, about 24 tok/s (est.).
- Best graphics cards for local AI under $2,000
Top pick: NVIDIA GeForce RTX 3090, $1,600 at eBay. Runs Qwen 3.8 27B at 32k context, about 26 tok/s (est.).
- Best used graphics cards for local AI
Top pick: NVIDIA RTX PRO 6000 Blackwell, $18,000 at eBay. Runs DeepSeek V4 Flash at 32k context, about 69 tok/s (est.).