DGX Spark 128GB

Parts

A complete machine needs no part checks.

ComponentSelectionPriceWhereBuy
MachineNVIDIA DGX Spark 128GB

128 GB unified · 273 GB/s

$8,650eBayBuy
Total$8,650

What this build runs

The most precise quant that fits, at 64k context. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @64kPrefillGood for
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLfits96.6 GB312k557k with q8 cache

8tok/sest.

124 tok/s–
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLfits103.1 GB1018k1024k with q8 cache

11tok/sest.

189 tok/s–
Qwen 3.8 Flash Next

Alibaba Qwen

Q4_K_Mfits114.1 GB232k256k with q8 cache

2tok/sest.

210 tok/s–
Qwen 3.8 27B

Alibaba Qwen

Q8_0fits32.3 GB256k

5tok/sest.

408 tok/s–
MiniMax M2.7

MiniMax

UD-Q3_K_Mfits110.9 GB96k178k with q8 cache

5tok/sest.

388 tok/s–
Qwen 3.5 122B-A10B

Alibaba Qwen

Q6_Kfits96.8 GB256k

10tok/sest.

848 tok/s–
Qwen 3.6 27B

Alibaba Qwen

Q8_0fits31.8 GB256k

5tok/sest.

408 tok/s–
gpt-oss 120B

OpenAI

MXFP4fits62.4 GB128k

18tok/sest.

1316 tok/schat, coding
Qwen3 Coder Next

Alibaba Qwen

Q8_0fits81.6 GB256k

18tok/sest.

1966 tok/schat, coding
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q6_Kfits108.6 GB256k

9tok/sest.

986 tok/s–
Gemma 4 31B

Google

Q8_0fits37.3 GB256k

4tok/sest.

372 tok/s–
Mistral Small 4 119B

Mistral AI

UD-Q6_Kfits95.1 GB923k1024k with q8 cache

14tok/sest.

834 tok/schat
Qwen 3.6 35B-A3B

Alibaba Qwen

Q8_0fits36.8 GB256k

23tok/sest.

2454 tok/schat, coding, long documents
Qwen 3.5 27B

Alibaba Qwen

Q8_0fits31.8 GB256k

5tok/sest.

408 tok/s–
Gemma 4 26B-A4B

Google

Q8_0fits27.5 GB256k

18tok/sest.

2513 tok/schat, coding
GLM 4.5 Air

Z.ai

Q6_Kfits104.8 GB128k

4tok/sest.

258 tok/s–
Qwen 3.5 35B-A3B

Alibaba Qwen

Q8_0fits36.8 GB256k

23tok/sest.

2454 tok/schat, coding, long documents
Qwen3 Next 80B-A3B

Alibaba Qwen

Q8_0fits81.6 GB256k

21tok/sest.

2242 tok/schat, coding, long documents
GLM 4.7 Flash

Z.ai

Q8_0fits34.0 GB198k

12tok/sest.

1217 tok/schat
Devstral Small 2 24B

Mistral AI

Q8_0fits34.4 GB384k

5tok/sest.

402 tok/s–
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

UD-Q6_K_XLfits34.1 GB256k

27tok/sest.

3026 tok/schat, coding, long documents
Kimi Linear 48B-A3B

Moonshot AI

Q8_0fits50.3 GB1024k

27tok/sest.

1971 tok/schat, coding, long documents
gpt-oss 20B

OpenAI

MXFP4fits13.9 GB128k

25tok/sest.

1878 tok/schat, coding, agents, long documents
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q8_0fits37.3 GB256k

11tok/sest.

878 tok/schat
Qwen3 32B

Alibaba Qwen

Q8_0fits49.5 GB40k

3tok/sest.

208 tok/s–
Gemma 4 12B

Google

Q8_0fits14.2 GB256k

12tok/sest.

966 tok/s–
Qwen 3.5 9B

Alibaba Qwen

Q8_0fits12.0 GB256k

14tok/sest.

1182 tok/schat
Gemma 3 27B

Google

Q8_0fits33.2 GB128k

5tok/sest.

457 tok/s–
Mistral Small 3.2 24B

Mistral AI

Q8_0fits34.4 GB128k

5tok/sest.

402 tok/s–
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q8_0fits49.5 GB128k

3tok/sest.

257 tok/s–
Llama 3.3 70B

Meta

Q8_0fits90.9 GB128k

2tok/sest.

123 tok/s–
Ministral 3 14B

Mistral AI

Q8_0fits24.4 GB256k

7tok/sest.

565 tok/s–
Qwen3 14B

Alibaba Qwen

Q8_0fits25.7 GB40k

6tok/sest.

495 tok/s–
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q8_0fits18.2 GB128k

9tok/sest.

781 tok/schat
Qwen3 8B

Alibaba Qwen

Q8_0fits18.2 GB40k

9tok/sest.

781 tok/schat
Phi-4 14B

Microsoft

Q8_0fits28.1 GB16k

6tok/sest.

497 tok/s–
Qwen 3.5 4B

Alibaba Qwen

Q8_0fits7.3 GB256k

25tok/sest.

2049 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q8_0fits18.0 GB256k

9tok/sest.

773 tok/schat
Granite 4.2 8B

IBM

Q8_0fits19.8 GB128k

8tok/sest.

714 tok/schat
Gemma 4 E4B

Google

Q8_0fits10.5 GB128k

17tok/sest.

1548 tok/schat
LFM2.5 8B-A1B

Liquid AI

Q8_0fits12.5 GB125k

24tok/sest.

3305 tok/schat, coding
Llama 3.1 8B

Meta

Q6_Kfits15.2 GB128k

11tok/sest.

839 tok/schat
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits2.3 GB32k

127tok/sest.

7329 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits2.6 GB256k

104tok/sest.

8310 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits3.2 GB256k

75tok/sest.

4530 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits4.6 GB128k

45tok/sest.

3036 tok/schat, coding, long documents
MiniCPM5 2B

openbmb

Q8_0fits6.2 GB128k

31tok/sest.

1711 tok/schat, coding, agents, long documents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q8_0fits14.0 GB128k

28tok/sest.

3062 tok/schat, coding, agents, long documents
LFM2.5 2.6B

Liquid AI

Q8_0fits7.5 GB128k

25tok/sest.

2075 tok/schat, coding, agents, long documents
LFM2.5 VL 3B

Liquid AI

Q8_0fits7.5 GB32k

25tok/sest.

1951 tok/schat, coding, agents, long documents
Kimi VL A3B

Moonshot AI

mlx-8bitfits19.6 GB128k

19tok/sest.

2106 tok/schat, coding
granite vision 4.1 4b

IBM

Q8_0fits9.4 GB128k

19tok/sest.

1303 tok/schat, coding
granite 4.2 3b

IBM

Q8_0fits9.7 GB128k

18tok/sest.

1345 tok/schat, coding
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q8_0fits12.1 GB128k

14tok/sest.

983 tok/schat
LFM2.5 24B A2B

Liquid AI

Q8_0fits29.8 GB128k

14tok/sest.

1893 tok/schat, coding
GLM 4.6V Flash

Z.ai

Q8_0fits12.9 GB128k

13tok/sest.

663 tok/schat
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitfits14.5 GB64k

12tok/sest.

663 tok/s–
DeepSeek R1 Distill Llama 8B

DeepSeek

Q8_0fits17.0 GB128k

10tok/sest.

839 tok/schat
Ministral 3 8B Reasoning 2512

Mistral AI

Q8_0fits18.0 GB256k

9tok/sest.

773 tok/schat
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q8_0fits27.7 GB128k

6tok/sest.

452 tok/s–
Devstral Small 2507

Mistral AI

Q8_0fits34.4 GB128k

5tok/sest.

407 tok/s–
Magistral Small 2506

Mistral AI

Q8_0fits34.4 GB40k

5tok/sest.

407 tok/s–
Magistral Small 2507

Mistral AI

Q8_0fits34.4 GB40k

5tok/sest.

407 tok/s–
Magistral Small 2509

Mistral AI

Q8_0fits34.4 GB128k

5tok/sest.

402 tok/s–
GLM 4.5V

Z.ai

Q8_0fits118.4 GB64k

4tok/sest.

272 tok/s–
GLM 4.6V

Z.ai

Q8_0fits118.4 GB67k123k with q8 cache

4tok/sest.

272 tok/s–
granite 4.2 30b

IBM

Q8_0fits46.1 GB128k

4tok/sest.

300 tok/s–
DeepSeek R1 Distill Llama 70B

DeepSeek

Q8_0fits90.9 GB128k

2tok/sest.

123 tok/s–
Mistral Medium 3.5 128B

Mistral AI

Q6_Kfits118.6 GB65k120k with q8 cache

1tok/sest.

70 tok/s–
DeepSeek R1

DeepSeek

Q4_K_Mwon't run382.0 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run382.5 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run382.0 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run382.9 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run382.9 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run152.1 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run160.9 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q8_0won't run146.8 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run225.7 GB––––
GLM 5.1

Z.ai

MXFP4won't run426.5 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run440.4 GB––––
GLM 5.3

Z.ai

Q8_0won't run752.9 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run583.5 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run583.9 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run583.9 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run583.9 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run145.4 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run145.4 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run131.8 GB12k22k with q8 cache–––
MiniMax M3

MiniMax

UD-Q4_K_Mwon't run255.3 GB––––