Used RTX 3090 workhorse

Parts

Compatibility: No problems found.Est. load 490 W of 850 W · spikes to 700 W

ComponentSelectionPriceWhereBuy
GPUNVIDIA GeForce RTX 3090

24 GB · 936 GB/s · 350 W

$1,600eBayBuy
CPUAMD Ryzen 7 7700

AM5 · 8 cores · 24 PCIe lanes

$139eBay (used)Buy
MotherboardMSI MAG B650 Tomahawk WiFi

AM5 · DDR5 · ATX

$140eBayBuy
MemoryG.Skill Flare X5 64GB (2×32GB) DDR5-6000

64 GB · DDR5-6000

$1,133eBayBuy
Power supplyCorsair RM850x ATX 3.1 850W

850 W · ATX 3

$90eBayBuy
CaseFractal Design North

GPUs up to 355 mm

$80eBayBuy
StorageSamsung 990 Pro 2TB

2000 GB NVME

$300eBayBuy
Total$3,482
  • Note: Check the power connectors on the card you buy: this power supply has 1 12V-2x6 and 3 8-pin PCIe connectors.
  • Note: Fractal Design North fits graphics cards up to 355 mm: check the length of the card you buy.

What this build runs

The most precise quant that fits, at 64k context. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @64kPrefillGood for
Qwen 3.8 27B

Alibaba Qwen

Q4_K_Mfits21.5 GB92k161k with q8 cache

27tok/sest.

467 tok/schat, coding
Qwen 3.6 27B

Alibaba Qwen

Q5_K_Mfits23.4 GB64k112k with q8 cache

24tok/sest.

467 tok/schat, coding
Qwen 3.6 35B-A3B

Alibaba Qwen

Q4_K_Mfits23.1 GB74k116k with q8 cache

107tok/sest.

2810 tok/schat, coding, agents, long documents
Qwen 3.5 27B

Alibaba Qwen

Q4_K_Mfits20.8 GB101k178k with q8 cache

27tok/sest.

467 tok/schat, coding, agents
Gemma 4 26B-A4B

Google

UD-Q5_K_Mfits22.2 GB110k178k with q8 cache

72tok/sest.

2877 tok/schat, coding, agents, long documents
Qwen 3.5 35B-A3B

Alibaba Qwen

Q4_K_Mfits22.9 GB84k131k with q8 cache

107tok/sest.

2810 tok/schat, coding, agents, long documents
GLM 4.7 Flash

Z.ai

Q4_K_Mfits21.4 GB98k169k with q8 cache

53tok/sest.

1394 tok/schat, coding, agents, long documents
gpt-oss 20B

OpenAI

MXFP4fits13.9 GB128k

86tok/sest.

2151 tok/schat, coding, agents, long documents
Gemma 4 12B

Google

Q8_0fits14.2 GB256k

41tok/sest.

1106 tok/schat, coding, long documents
Qwen 3.5 9B

Alibaba Qwen

Q8_0fits12.0 GB256k

50tok/sest.

1354 tok/schat, coding, long documents
Gemma 3 27B

Google

Q4_K_Mfits21.9 GB81k128k with q8 cache

26tok/sest.

523 tok/schat, coding
Ministral 3 14B

Mistral AI

Q6_Kfits21.4 GB76k139k with q8 cache

27tok/sest.

647 tok/schat, coding
Qwen3 14B

Alibaba Qwen

Q6_Kfits22.4 GB40k

25tok/sest.

567 tok/schat, coding
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q8_0fits18.2 GB99k128k with q8 cache

32tok/sest.

895 tok/schat, coding
Qwen3 8B

Alibaba Qwen

Q8_0fits18.2 GB40k

32tok/sest.

895 tok/schat, coding
Phi-4 14B

Microsoft

Q5_K_Mfits23.3 GB16k

24tok/sest.

569 tok/schat, coding
Qwen 3.5 4B

Alibaba Qwen

Q8_0fits7.3 GB256k

87tok/sest.

2347 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q8_0fits18.0 GB103k187k with q8 cache

32tok/sest.

885 tok/schat, coding
Granite 4.2 8B

IBM

Q8_0fits19.8 GB86k128k with q8 cache

29tok/sest.

818 tok/schat, coding, agents
Gemma 4 E4B

Google

Q8_0fits10.5 GB128k

57tok/sest.

1773 tok/schat, coding, long documents
LFM2.5 8B-A1B

Liquid AI

Q8_0fits12.5 GB125k

81tok/sest.

3784 tok/schat, coding, long documents
Llama 3.1 8B

Meta

Q6_Kfits15.2 GB126k128k with q8 cache

38tok/sest.

961 tok/schat, coding, long documents
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits2.3 GB32k

434tok/sest.

8393 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits2.6 GB256k

355tok/sest.

9516 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits3.2 GB256k

257tok/sest.

5188 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits4.6 GB128k

154tok/sest.

3476 tok/schat, coding, long documents
MiniCPM5 2B

openbmb

Q8_0fits6.2 GB128k

106tok/sest.

1959 tok/schat, coding, agents, long documents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q8_0fits14.0 GB128k

96tok/sest.

3507 tok/schat, coding, agents, long documents
LFM2.5 2.6B

Liquid AI

Q8_0fits7.5 GB128k

84tok/sest.

2376 tok/schat, coding, agents, long documents
LFM2.5 VL 3B

Liquid AI

Q8_0fits7.5 GB32k

84tok/sest.

2234 tok/schat, coding, agents, long documents
Kimi VL A3B

Moonshot AI

mlx-8bitfits19.6 GB128k

66tok/sest.

2412 tok/schat, coding, agents, long documents
granite vision 4.1 4b

IBM

Q8_0fits9.4 GB128k

65tok/sest.

1492 tok/schat, coding, long documents
granite 4.2 3b

IBM

Q8_0fits9.7 GB128k

63tok/sest.

1540 tok/schat, coding, agents, long documents
LFM2.5 24B A2B

Liquid AI

Q5_K_Mfits23.3 GB65k115k with q8 cache

50tok/sest.

2168 tok/schat, coding, agents
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q8_0fits12.1 GB128k

49tok/sest.

1126 tok/schat, coding, long documents
GLM 4.6V Flash

Z.ai

Q8_0fits12.9 GB128k

46tok/sest.

760 tok/schat, coding, agents, long documents
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitfits14.5 GB64k

40tok/sest.

760 tok/schat, coding, long documents
DeepSeek R1 Distill Llama 8B

DeepSeek

Q8_0fits17.0 GB112k128k with q8 cache

34tok/sest.

961 tok/schat, coding
Ministral 3 8B Reasoning 2512

Mistral AI

Q8_0fits18.0 GB103k187k with q8 cache

32tok/sest.

885 tok/schat, coding, agents
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q5_K_Mfits22.9 GB66k122k with q8 cache

25tok/sest.

517 tok/schat, coding
Qwen 3.8 Flash Next

Alibaba Qwen

UD-Q2_K_XLoffload76.1 GB–

2tok/sest.

139 tok/s–
Qwen 3.5 122B-A10B

Alibaba Qwen

UD-Q2_K_XLoffload41.7 GB–

13tok/sest.

709 tok/schat
Gemma 4 31B

Google

Q4_K_Moffload23.9 GB57k110k with q8 cache

20tok/sest.

420 tok/schat, coding
Qwen3 Coder Next

Alibaba Qwen

Q4_K_Moffload47.8 GB–

15tok/sest.

1545 tok/schat
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q2_K_XLoffload52.6 GB–

9tok/sest.

745 tok/s–
gpt-oss 120B

OpenAI

Q4_K_Moffload61.8 GB–

9tok/sest.

935 tok/schat
Mistral Small 4 119B

Mistral AI

UD-Q2_K_XLoffload39.9 GB–

18tok/sest.

711 tok/schat, coding
GLM 4.5 Air

Z.ai

Q2_Koffload54.8 GB–

3tok/sest.

192 tok/s–
Qwen3 Next 80B-A3B

Alibaba Qwen

Q4_K_Moffload47.8 GB–

18tok/sest.

1763 tok/schat, coding
Devstral Small 2 24B

Mistral AI

Q4_K_Moffload24.4 GB57k105k with q8 cache

17tok/sest.

448 tok/schat, coding
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

UD-Q6_K_XLoffload34.1 GB–

23tok/sest.

2792 tok/schat, coding, long documents
Kimi Linear 48B-A3B

Moonshot AI

Q4_K_Moffload29.6 GB–

49tok/sest.

1963 tok/schat, coding, long documents
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q4_K_Moffload24.4 GB54k97k with q8 cache

31tok/sest.

981 tok/schat, coding, agents
Qwen3 32B

Alibaba Qwen

Q4_K_Moffload35.5 GB16k30k with q8 cache

4tok/sest.

188 tok/schat
Mistral Small 3.2 24B

Mistral AI

Q4_K_Moffload24.4 GB57k105k with q8 cache

17tok/sest.

448 tok/schat, coding
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q4_K_Moffload35.6 GB16k30k with q8 cache

4tok/sest.

232 tok/schat
Llama 3.3 70B

Meta

Q4_K_Moffload60.7 GB–

1tok/sest.

88 tok/s–
Devstral Small 2507

Mistral AI

Q4_K_Moffload24.4 GB57k105k with q8 cache

17tok/sest.

453 tok/schat, coding
Magistral Small 2506

Mistral AI

Q4_K_Moffload24.4 GB40k

17tok/sest.

453 tok/schat, coding
Magistral Small 2507

Mistral AI

Q4_K_Moffload24.4 GB40k

17tok/sest.

453 tok/schat, coding
Magistral Small 2509

Mistral AI

Q4_K_Moffload24.4 GB57k105k with q8 cache

17tok/sest.

448 tok/schat, coding
granite 4.2 30b

IBM

Q4_K_Moffload33.9 GB23k42k with q8 cache

4tok/sest.

278 tok/schat
GLM 4.5V

Z.ai

Q4_K_Moffload71.8 GB–

2tok/sest.

183 tok/s–
GLM 4.6V

Z.ai

Q4_K_Moffload78.2 GB–

2tok/sest.

179 tok/s–
DeepSeek R1 Distill Llama 70B

DeepSeek

Q4_K_Moffload60.7 GB–

1tok/sest.

88 tok/s–
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLwon't run96.6 GB––––
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLwon't run103.1 GB––––
MiniMax M2.7

MiniMax

UD-Q2_K_XLwon't run86.7 GB––––
DeepSeek R1

DeepSeek

Q4_K_Mwon't run382.0 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run382.5 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run382.0 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run382.9 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run382.9 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run152.1 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run160.9 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q8_0won't run146.8 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run225.7 GB––––
GLM 5.1

Z.ai

MXFP4won't run426.5 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run440.4 GB––––
GLM 5.3

Z.ai

Q8_0won't run752.9 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run583.5 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run583.9 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run583.9 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run583.9 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run145.4 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run145.4 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run131.8 GB––––
MiniMax M3

MiniMax

UD-Q4_K_Mwon't run255.3 GB––––
Mistral Medium 3.5 128B

Mistral AI

Q4_K_Mwon't run92.8 GB––––