Used RTX 3090 workhorse

Parts

Compatibility: No problems found.Est. load 490 W of 850 W · spikes to 700 W

ComponentSelectionPriceWhereBuy
GPUNVIDIA GeForce RTX 3090

24 GB · 936 GB/s · 350 W

$1,600eBayBuy
CPUAMD Ryzen 7 7700

AM5 · 8 cores · 24 PCIe lanes

$139eBay (used)Buy
MotherboardMSI MAG B650 Tomahawk WiFi

AM5 · DDR5 · ATX

$140eBayBuy
MemoryG.Skill Flare X5 64GB (2×32GB) DDR5-6000

64 GB · DDR5-6000

$1,133eBayBuy
Power supplyCorsair RM850x ATX 3.1 850W

850 W · ATX 3

$90eBayBuy
CaseFractal Design North

GPUs up to 355 mm

$80eBayBuy
StorageSamsung 990 Pro 2TB

2000 GB NVME

$300eBayBuy
Total$3,482
  • Note: Check the power connectors on the card you buy: this power supply has 1 12V-2x6 and 3 8-pin PCIe connectors.
  • Note: Fractal Design North fits graphics cards up to 355 mm: check the length of the card you buy.

What this build runs

The most precise quant that fits, at 32k context. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @32kPrefillGood for
Qwen 3.8 27B

Alibaba Qwen

Q5_K_Mfits22.5 GB44k78k with q8 cache

25tok/sest.

515 tok/schat, coding
Qwen 3.6 27B

Alibaba Qwen

Q5_K_Mfits21.2 GB64k112k with q8 cache

27tok/sest.

515 tok/schat, coding
Gemma 4 31B

Google

Q4_K_Mfits21.2 GB57k110k with q8 cache

27tok/sest.

459 tok/schat, coding
Qwen 3.6 35B-A3B

Alibaba Qwen

Q4_K_Mfits22.3 GB74k116k with q8 cache

134tok/sest.

3679 tok/schat, coding, agents, long documents
Qwen 3.5 27B

Alibaba Qwen

Q5_K_Mfits21.3 GB62k110k with q8 cache

27tok/sest.

515 tok/schat, coding
Gemma 4 26B-A4B

Google

UD-Q6_Kfits23.3 GB36k62k with q8 cache

78tok/sest.

3273 tok/schat, coding, agents, long documents
Qwen 3.5 35B-A3B

Alibaba Qwen

Q4_K_Mfits22.1 GB84k131k with q8 cache

135tok/sest.

3679 tok/schat, coding, agents, long documents
GLM 4.7 Flash

Z.ai

Q5_K_Mfits22.5 GB48k82k with q8 cache

65tok/sest.

1921 tok/schat, coding, agents
Devstral Small 2 24B

Mistral AI

Q5_K_Mfits21.5 GB43k79k with q8 cache

26tok/sest.

544 tok/schat, coding
gpt-oss 20B

OpenAI

MXFP4fits12.9 GB128k

108tok/sest.

2747 tok/schat, coding, agents, long documents
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q4_K_Mfits21.2 GB54k97k with q8 cache

69tok/sest.

1692 tok/schat, coding, agents
Gemma 4 12B

Google

Q8_0fits13.5 GB256k

43tok/sest.

1195 tok/schat, coding, long documents
Qwen 3.5 9B

Alibaba Qwen

Q8_0fits10.8 GB256k

55tok/sest.

1489 tok/schat, coding, long documents
Mistral Small 3.2 24B

Mistral AI

Q5_K_Mfits21.5 GB43k79k with q8 cache

26tok/sest.

544 tok/schat, coding
Gemma 3 27B

Google

Q5_K_Mfits21.7 GB51k95k with q8 cache

26tok/sest.

547 tok/schat, coding
Ministral 3 14B

Mistral AI

Q8_0fits19.3 GB57k104k with q8 cache

29tok/sest.

827 tok/schat, coding
Qwen3 14B

Alibaba Qwen

Q8_0fits20.5 GB40k

28tok/sest.

744 tok/schat, coding
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q8_0fits13.5 GB99k128k with q8 cache

43tok/sest.

1227 tok/schat, coding
Qwen3 8B

Alibaba Qwen

Q8_0fits13.5 GB40k

43tok/sest.

1227 tok/schat, coding
Phi-4 14B

Microsoft

Q8_0fits21.6 GB16k

26tok/sest.

748 tok/schat, coding
Qwen 3.5 4B

Alibaba Qwen

Q8_0fits6.1 GB256k

104tok/sest.

2786 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q8_0fits13.5 GB103k187k with q8 cache

43tok/sest.

1185 tok/schat, coding
Granite 4.2 8B

IBM

Q8_0fits14.6 GB86k128k with q8 cache

39tok/sest.

1128 tok/schat, coding, agents
Gemma 4 E4B

Google

Q8_0fits9.4 GB128k

63tok/sest.

1871 tok/schat, coding, long documents
LFM2.5 8B-A1B

Liquid AI

Q8_0fits10.8 GB125k

130tok/sest.

6119 tok/schat, coding, long documents
Llama 3.1 8B

Meta

Q6_Kfits11.0 GB126k128k with q8 cache

53tok/sest.

1296 tok/schat, coding, long documents
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits1.8 GB32k

622tok/sest.

13327 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits2.0 GB256k

471tok/sest.

12519 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits2.6 GB256k

313tok/sest.

5968 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits3.5 GB128k

205tok/sest.

5014 tok/schat, coding, long documents
MiniCPM5 2B

openbmb

Q8_0fits4.7 GB128k

142tok/sest.

2994 tok/schat, coding, agents, long documents
LFM2.5 2.6B

Liquid AI

Q8_0fits5.4 GB128k

119tok/sest.

3391 tok/schat, coding, agents, long documents
LFM2.5 VL 3B

Liquid AI

Q8_0fits5.4 GB32k

119tok/sest.

3110 tok/schat, coding, agents, long documents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q8_0fits13.4 GB128k

110tok/sest.

4418 tok/schat, coding, agents, long documents
granite vision 4.1 4b

IBM

Q8_0fits6.8 GB128k

92tok/sest.

2173 tok/schat, coding, long documents
granite 4.2 3b

IBM

Q8_0fits7.0 GB128k

88tok/sest.

2277 tok/schat, coding, agents, long documents
Kimi VL A3B

Moonshot AI

mlx-8bitfits18.4 GB128k

81tok/sest.

3320 tok/schat, coding, agents, long documents
LFM2.5 24B A2B

Liquid AI

Q6_Kfits23.1 GB35k63k with q8 cache

78tok/sest.

3410 tok/schat, coding, agents
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q8_0fits10.2 GB128k

58tok/sest.

1465 tok/schat, coding, long documents
GLM 4.6V Flash

Z.ai

Q8_0fits11.5 GB128k

51tok/sest.

1020 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Llama 8B

DeepSeek

Q8_0fits12.8 GB112k128k with q8 cache

45tok/sest.

1296 tok/schat, coding
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitfits13.1 GB64k

44tok/sest.

1020 tok/schat, coding, long documents
Ministral 3 8B Reasoning 2512

Mistral AI

Q8_0fits13.5 GB103k187k with q8 cache

43tok/sest.

1185 tok/schat, coding, agents
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q8_0fits21.5 GB41k76k with q8 cache

26tok/sest.

700 tok/schat, coding
Devstral Small 2507

Mistral AI

Q5_K_Mfits21.5 GB43k79k with q8 cache

26tok/sest.

552 tok/schat, coding
Magistral Small 2506

Mistral AI

Q5_K_Mfits21.5 GB40k

26tok/sest.

552 tok/schat, coding
Magistral Small 2507

Mistral AI

Q5_K_Mfits21.5 GB40k

26tok/sest.

552 tok/schat, coding
Magistral Small 2509

Mistral AI

Q5_K_Mfits21.5 GB43k79k with q8 cache

26tok/sest.

544 tok/schat, coding
Qwen 3.8 Flash Next

Alibaba Qwen

UD-Q2_K_XLoffload75.2 GB–

2tok/sest.

145 tok/s–
MiniMax M2.7

MiniMax

UD-Q2_K_XLoffload78.8 GB–

4tok/sest.

390 tok/s–
Qwen 3.5 122B-A10B

Alibaba Qwen

UD-Q2_K_XLoffload40.7 GB–

16tok/sest.

893 tok/schat
Qwen3 Coder Next

Alibaba Qwen

Q4_K_Moffload46.9 GB–

19tok/sest.

2020 tok/schat
gpt-oss 120B

OpenAI

Q4_K_Moffload60.5 GB–

12tok/sest.

1223 tok/schat
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q2_K_XLoffload52.2 GB–

10tok/sest.

810 tok/s–
Mistral Small 4 119B

Mistral AI

UD-Q2_K_XLoffload39.0 GB–

24tok/sest.

1013 tok/schat, coding
GLM 4.5 Air

Z.ai

Q2_Koffload48.8 GB–

5tok/sest.

306 tok/s–
Qwen3 Next 80B-A3B

Alibaba Qwen

Q4_K_Moffload46.9 GB–

23tok/sest.

2404 tok/schat, coding
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

UD-Q6_K_XLoffload33.7 GB–

25tok/sest.

3406 tok/schat, coding, long documents
Kimi Linear 48B-A3B

Moonshot AI

Q4_K_Moffload29.2 GB–

57tok/sest.

2783 tok/schat, coding, long documents
Qwen3 32B

Alibaba Qwen

Q4_K_Moffload27.3 GB16k30k with q8 cache

9tok/sest.

292 tok/schat
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q4_K_Moffload27.4 GB16k30k with q8 cache

9tok/sest.

334 tok/schat
Llama 3.3 70B

Meta

Q4_K_Moffload50.5 GB–

2tok/sest.

117 tok/s–
granite 4.2 30b

IBM

Q4_K_Moffload25.7 GB23k42k with q8 cache

12tok/sest.

399 tok/schat
GLM 4.5V

Z.ai

Q4_K_Moffload65.9 GB–

3tok/sest.

296 tok/s–
GLM 4.6V

Z.ai

Q4_K_Moffload72.2 GB–

3tok/sest.

287 tok/s–
DeepSeek R1 Distill Llama 70B

DeepSeek

Q4_K_Moffload50.5 GB–

2tok/sest.

117 tok/s–
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLwon't run93.8 GB––––
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLwon't run102.6 GB––––
DeepSeek R1

DeepSeek

Q4_K_Mwon't run379.7 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run380.2 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run379.7 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run380.6 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run380.6 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run149.2 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run158.0 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q8_0won't run135.6 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run214.0 GB––––
GLM 5.1

Z.ai

MXFP4won't run423.6 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run437.5 GB––––
GLM 5.3

Z.ai

Q8_0won't run750.0 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run581.2 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run581.6 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run581.6 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run581.6 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run137.5 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run137.5 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run123.9 GB––––
MiniMax M3

MiniMax

UD-Q4_K_Mwon't run251.4 GB––––
Mistral Medium 3.5 128B

Mistral AI

Q4_K_Mwon't run81.6 GB––––