DGX Spark 128GB

Parts

A complete machine needs no part checks.

ComponentSelectionPriceWhereBuy
MachineNVIDIA DGX Spark 128GB

128 GB unified · 273 GB/s

$8,650eBayBuy
Total$8,650

What this build runs

The most precise quant that fits, at 128k context. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @128kPrefillGood for
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLfits102.4 GB312k557k with q8 cache

6tok/sest.

68 tok/s–
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLfits104.2 GB1018k1024k with q8 cache

10tok/sest.

114 tok/s–
Qwen 3.8 Flash Next

Alibaba Qwen

Q4_K_Mfits115.9 GB232k256k with q8 cache

2tok/sest.

196 tok/s–
Qwen 3.8 27B

Alibaba Qwen

Q8_0fits36.6 GB256k

5tok/sest.

343 tok/s–
MiniMax M2.7

MiniMax

UD-Q2_K_XLfits102.6 GB194k200k with q8 cache

3tok/sest.

229 tok/schat
Qwen 3.5 122B-A10B

Alibaba Qwen

Q6_Kfits98.7 GB256k

9tok/sest.

610 tok/s–
Qwen 3.6 27B

Alibaba Qwen

Q8_0fits36.2 GB256k

5tok/sest.

343 tok/s–
Qwen3 Coder Next

Alibaba Qwen

Q8_0fits83.5 GB256k

14tok/sest.

1352 tok/schat, coding
gpt-oss 120B

OpenAI

MXFP4fits65.0 GB128k

13tok/sest.

904 tok/schat, coding
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q6_Kfits109.5 GB256k

8tok/sest.

856 tok/s–
Gemma 4 31B

Google

Q8_0fits42.6 GB256k

4tok/sest.

326 tok/s–
Mistral Small 4 119B

Mistral AI

UD-Q6_Kfits96.9 GB923k1024k with q8 cache

11tok/sest.

529 tok/schat
Qwen 3.6 35B-A3B

Alibaba Qwen

Q8_0fits38.4 GB256k

17tok/sest.

1667 tok/schat, coding, long documents
Qwen 3.5 27B

Alibaba Qwen

Q8_0fits36.2 GB256k

5tok/sest.

343 tok/s–
Gemma 4 26B-A4B

Google

Q8_0fits29.2 GB256k

14tok/sest.

2024 tok/schat, coding
GLM 4.5 Air

Z.ai

Q6_Kfits116.7 GB128k

3tok/sest.

153 tok/s–
Qwen 3.5 35B-A3B

Alibaba Qwen

Q8_0fits38.4 GB256k

17tok/sest.

1667 tok/schat, coding, long documents
Qwen3 Next 80B-A3B

Alibaba Qwen

Q8_0fits83.5 GB256k

16tok/sest.

1477 tok/schat, coding, long documents
GLM 4.7 Flash

Z.ai

Q8_0fits37.7 GB198k

8tok/sest.

786 tok/schat
Devstral Small 2 24B

Mistral AI

Q8_0fits44.8 GB384k

4tok/sest.

307 tok/s–
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

UD-Q6_K_XLfits34.8 GB256k

24tok/sest.

2242 tok/schat, coding, long documents
Kimi Linear 48B-A3B

Moonshot AI

Q8_0fits51.1 GB1024k

24tok/sest.

1251 tok/schat, coding, long documents
gpt-oss 20B

OpenAI

MXFP4fits15.7 GB128k

18tok/sest.

1310 tok/schat, coding, agents, long documents
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q8_0fits43.7 GB256k

6tok/sest.

485 tok/schat
Qwen3 32B

Alibaba Qwen

Q8_0fits65.9 GB40k

2tok/sest.

138 tok/s–
Gemma 4 12B

Google

Q8_0fits15.6 GB256k

11tok/sest.

841 tok/s–
Qwen 3.5 9B

Alibaba Qwen

Q8_0fits14.4 GB256k

12tok/sest.

1000 tok/schat
Gemma 3 27B

Google

Q8_0fits38.6 GB128k

4tok/sest.

420 tok/s–
Mistral Small 3.2 24B

Mistral AI

Q8_0fits44.8 GB128k

4tok/sest.

307 tok/s–
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q8_0fits65.9 GB128k

2tok/sest.

184 tok/s–
Llama 3.3 70B

Meta

Q8_0fits111.3 GB128k

1tok/sest.

89 tok/s–
Ministral 3 14B

Mistral AI

Q8_0fits34.8 GB256k

5tok/sest.

394 tok/s–
Qwen3 14B

Alibaba Qwen

Q8_0fits36.1 GB40k

5tok/sest.

335 tok/s–
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q8_0fits27.6 GB128k

6tok/sest.

507 tok/schat
Qwen3 8B

Alibaba Qwen

Q8_0fits27.6 GB40k

6tok/sest.

507 tok/schat
Phi-4 14B

Microsoft

Q8_0fits41.0 GB16k

4tok/sest.

336 tok/s–
Qwen 3.5 4B

Alibaba Qwen

Q8_0fits9.7 GB256k

19tok/sest.

1558 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q8_0fits26.9 GB256k

6tok/sest.

513 tok/schat
Granite 4.2 8B

IBM

Q8_0fits30.2 GB128k

6tok/sest.

461 tok/schat
Gemma 4 E4B

Google

Q8_0fits12.6 GB128k

14tok/sest.

1402 tok/schat
LFM2.5 8B-A1B

Liquid AI

Q8_0fits15.8 GB125k

14tok/sest.

1874 tok/schat, coding
Llama 3.1 8B

Meta

Q6_Kfits23.6 GB128k

7tok/sest.

553 tok/schat
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits3.4 GB32k

79tok/sest.

4211 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits3.7 GB256k

69tok/sest.

5616 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits4.3 GB256k

55tok/sest.

3591 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits6.7 GB128k

30tok/sest.

1882 tok/schat, coding, long documents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q8_0fits15.3 GB128k

22tok/sest.

2168 tok/schat, coding, agents, long documents
MiniCPM5 2B

openbmb

Q8_0fits9.2 GB128k

20tok/sest.

1012 tok/schat, coding, agents, long documents
LFM2.5 2.6B

Liquid AI

Q8_0fits11.6 GB128k

16tok/sest.

1298 tok/schat, coding, agents, long documents
LFM2.5 VL 3B

Liquid AI

Q8_0fits11.6 GB32k

16tok/sest.

1248 tok/schat, coding, agents, long documents
Kimi VL A3B

Moonshot AI

mlx-8bitfits21.8 GB128k

14tok/sest.

1361 tok/schat, coding
granite vision 4.1 4b

IBM

Q8_0fits14.8 GB128k

12tok/sest.

801 tok/schat, coding
granite 4.2 3b

IBM

Q8_0fits15.1 GB128k

12tok/sest.

817 tok/schat, coding
GLM 4.6V Flash

Z.ai

Q8_0fits15.8 GB128k

11tok/sest.

439 tok/schat
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q8_0fits16.0 GB128k

11tok/sest.

672 tok/schat
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitfits17.4 GB64k

10tok/sest.

439 tok/s–
LFM2.5 24B A2B

Liquid AI

Q8_0fits35.2 GB128k

8tok/sest.

1095 tok/schat, coding
DeepSeek R1 Distill Llama 8B

DeepSeek

Q8_0fits25.4 GB128k

7tok/sest.

553 tok/schat
Ministral 3 8B Reasoning 2512

Mistral AI

Q8_0fits26.9 GB256k

6tok/sest.

513 tok/schat
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q8_0fits40.1 GB128k

4tok/sest.

297 tok/s–
Devstral Small 2507

Mistral AI

Q8_0fits44.8 GB128k

4tok/sest.

310 tok/s–
Magistral Small 2506

Mistral AI

Q8_0fits44.8 GB40k

4tok/sest.

310 tok/s–
Magistral Small 2507

Mistral AI

Q8_0fits44.8 GB40k

4tok/sest.

310 tok/s–
Magistral Small 2509

Mistral AI

Q8_0fits44.8 GB128k

4tok/sest.

307 tok/s–
GLM 4.5V

Z.ai

Q4_K_Mfits83.7 GB64k

3tok/sest.

158 tok/s–
GLM 4.6V

Z.ai

Q4_K_Mfits90.1 GB128k

3tok/sest.

158 tok/s–
granite 4.2 30b

IBM

Q8_0fits62.4 GB128k

3tok/sest.

219 tok/s–
DeepSeek R1 Distill Llama 70B

DeepSeek

Q8_0fits111.3 GB128k

1tok/sest.

89 tok/s–
Mistral Medium 3.5 128B

Mistral AI

Q4_K_Mfits115.2 GB138k256k with q8 cache

1tok/sest.

52 tok/s–
DeepSeek R1

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run387.2 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run157.8 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run166.6 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q8_0won't run169.2 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run249.0 GB––––
GLM 5.1

Z.ai

MXFP4won't run432.4 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run446.3 GB––––
GLM 5.3

Z.ai

Q8_0won't run758.7 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run588.2 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run161.3 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run161.3 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run147.7 GB12k22k with q8 cache–––
MiniMax M3

MiniMax

UD-Q4_K_Mwon't run263.2 GB––––