Best hardware for local AI
Ranked by the biggest open models each one runs fully in memory, then speed, with prices in Canada checked through the day.
Lists
- Best graphics cards for local AI
Top pick: NVIDIA RTX PRO 6000 Blackwell, $3,133 at Amazon. Runs DeepSeek V4 Flash at 32k context, about 69 tok/s (est.).
- Best graphics cards for local AI under $700
Top pick: Intel Arc A770 16GB, $655 at Amazon. Runs gpt-oss 20B at 32k context, about 48 tok/s (est.).
- Best graphics cards for local AI under $1,400
Top pick: Intel Arc Pro B60, $1,060 at Amazon. Runs Qwen 3.6 35B-A3B at 32k context, about 49 tok/s (est.).
- Best graphics cards for local AI under $2,800
Top pick: NVIDIA GeForce RTX 3090, $2,800 at Amazon. Runs Qwen 3.8 27B at 32k context, about 26 tok/s (est.).