DGX Spark 128GB

Parts

A complete machine needs no part checks.

ComponentSelectionPriceWhereBuy
MachineNVIDIA DGX Spark 128GB

128 GB unified · 273 GB/s

$8,650eBayBuy
Total$8,650

What this build runs

The most precise quant that fits, at 32k context. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @32kPrefillGood for
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLfits93.8 GB312k557k with q8 cache

11tok/sest.

210 tok/s–
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLfits102.6 GB1018k1024k with q8 cache

11tok/sest.

282 tok/s–
Qwen 3.8 Flash Next

Alibaba Qwen

Q4_K_Mfits113.1 GB232k256k with q8 cache

2tok/sest.

218 tok/s–
MiniMax M2.7

MiniMax

UD-Q3_K_Mfits102.9 GB96k178k with q8 cache

8tok/sest.

593 tok/s–
Qwen 3.8 27B

Alibaba Qwen

Q8_0fits30.1 GB256k

5tok/sest.

450 tok/s–
Qwen 3.5 122B-A10B

Alibaba Qwen

Q6_Kfits95.9 GB256k

11tok/sest.

1055 tok/s–
Qwen 3.6 27B

Alibaba Qwen

Q8_0fits29.7 GB256k

6tok/sest.

450 tok/s–
gpt-oss 120B

OpenAI

MXFP4fits61.1 GB128k

23tok/sest.

1704 tok/schat, coding
Qwen3 Coder Next

Alibaba Qwen

Q8_0fits80.7 GB256k

20tok/sest.

2543 tok/schat, coding
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q6_Kfits108.2 GB256k

9tok/sest.

1067 tok/s–
Gemma 4 31B

Google

Q8_0fits34.6 GB256k

5tok/sest.

401 tok/s–
Mistral Small 4 119B

Mistral AI

UD-Q6_Kfits94.2 GB923k1024k with q8 cache

15tok/sest.

1173 tok/schat
Qwen 3.6 35B-A3B

Alibaba Qwen

Q8_0fits35.9 GB256k

27tok/sest.

3213 tok/schat, coding, long documents
Qwen 3.5 27B

Alibaba Qwen

Q8_0fits29.7 GB256k

6tok/sest.

450 tok/s–
Gemma 4 26B-A4B

Google

Q8_0fits26.7 GB256k

20tok/sest.

2858 tok/schat, coding
GLM 4.5 Air

Z.ai

Q8_0fits116.0 GB48k87k with q8 cache

4tok/sest.

392 tok/s–
Qwen 3.5 35B-A3B

Alibaba Qwen

Q8_0fits35.9 GB256k

27tok/sest.

3213 tok/schat, coding, long documents
Qwen3 Next 80B-A3B

Alibaba Qwen

Q8_0fits80.7 GB256k

25tok/sest.

3026 tok/schat, coding, long documents
GLM 4.7 Flash

Z.ai

Q8_0fits32.2 GB198k

14tok/sest.

1677 tok/schat
Devstral Small 2 24B

Mistral AI

Q8_0fits29.2 GB384k

6tok/sest.

475 tok/s–
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

UD-Q6_K_XLfits33.7 GB256k

28tok/sest.

3666 tok/schat, coding, long documents
gpt-oss 20B

OpenAI

MXFP4fits12.9 GB128k

31tok/sest.

2398 tok/schat, coding, agents, long documents
Kimi Linear 48B-A3B

Moonshot AI

Q8_0fits49.8 GB1024k

29tok/sest.

2769 tok/schat, coding, long documents
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q8_0fits34.1 GB256k

16tok/sest.

1477 tok/schat
Qwen3 32B

Alibaba Qwen

Q8_0fits41.3 GB40k

4tok/sest.

279 tok/s–
Gemma 4 12B

Google

Q8_0fits13.5 GB256k

13tok/sest.

1044 tok/s–
Qwen 3.5 9B

Alibaba Qwen

Q8_0fits10.8 GB256k

16tok/sest.

1301 tok/schat
Mistral Small 3.2 24B

Mistral AI

Q8_0fits29.2 GB128k

6tok/sest.

475 tok/s–
Gemma 3 27B

Google

Q8_0fits30.5 GB128k

5tok/sest.

478 tok/s–
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q8_0fits41.3 GB128k

4tok/sest.

321 tok/s–
Llama 3.3 70B

Meta

Q8_0fits80.7 GB128k

2tok/sest.

152 tok/s–
Ministral 3 14B

Mistral AI

Q8_0fits19.3 GB256k

9tok/sest.

722 tok/s–
Qwen3 14B

Alibaba Qwen

Q8_0fits20.5 GB40k

8tok/sest.

650 tok/s–
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q8_0fits13.5 GB128k

13tok/sest.

1071 tok/schat
Qwen3 8B

Alibaba Qwen

Q8_0fits13.5 GB40k

13tok/sest.

1071 tok/schat
Phi-4 14B

Microsoft

Q8_0fits21.6 GB16k

8tok/sest.

653 tok/s–
Qwen 3.5 4B

Alibaba Qwen

Q8_0fits6.1 GB256k

30tok/sest.

2433 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q8_0fits13.5 GB256k

13tok/sest.

1035 tok/schat
Granite 4.2 8B

IBM

Q8_0fits14.6 GB128k

12tok/sest.

985 tok/schat
Gemma 4 E4B

Google

Q8_0fits9.4 GB128k

19tok/sest.

1634 tok/schat
LFM2.5 8B-A1B

Liquid AI

Q8_0fits10.8 GB125k

38tok/sest.

5344 tok/schat, coding
Llama 3.1 8B

Meta

Q6_Kfits11.0 GB128k

16tok/sest.

1132 tok/schat
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits1.8 GB32k

181tok/sest.

11638 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits2.0 GB256k

137tok/sest.

10932 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits2.6 GB256k

91tok/sest.

5212 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits3.5 GB128k

60tok/sest.

4378 tok/schat, coding, long documents
MiniCPM5 2B

openbmb

Q8_0fits4.7 GB128k

41tok/sest.

2615 tok/schat, coding, agents, long documents
LFM2.5 2.6B

Liquid AI

Q8_0fits5.4 GB128k

35tok/sest.

2962 tok/schat, coding, agents, long documents
LFM2.5 VL 3B

Liquid AI

Q8_0fits5.4 GB32k

35tok/sest.

2716 tok/schat, coding, agents, long documents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q8_0fits13.4 GB128k

32tok/sest.

3858 tok/schat, coding, agents, long documents
granite vision 4.1 4b

IBM

Q8_0fits6.8 GB128k

27tok/sest.

1897 tok/schat, coding
granite 4.2 3b

IBM

Q8_0fits7.0 GB128k

26tok/sest.

1989 tok/schat, coding
Kimi VL A3B

Moonshot AI

mlx-8bitfits18.4 GB128k

24tok/sest.

2899 tok/schat, coding
LFM2.5 24B A2B

Liquid AI

Q8_0fits27.1 GB128k

21tok/sest.

2978 tok/schat, coding
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q8_0fits10.2 GB128k

17tok/sest.

1279 tok/schat
GLM 4.6V Flash

Z.ai

Q8_0fits11.5 GB128k

15tok/sest.

891 tok/schat
DeepSeek R1 Distill Llama 8B

DeepSeek

Q8_0fits12.8 GB128k

13tok/sest.

1132 tok/schat
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitfits13.1 GB64k

13tok/sest.

891 tok/s–
Ministral 3 8B Reasoning 2512

Mistral AI

Q8_0fits13.5 GB256k

13tok/sest.

1035 tok/schat
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q8_0fits21.5 GB128k

8tok/sest.

611 tok/s–
Devstral Small 2507

Mistral AI

Q8_0fits29.2 GB128k

6tok/sest.

482 tok/s–
Magistral Small 2506

Mistral AI

Q8_0fits29.2 GB40k

6tok/sest.

482 tok/s–
Magistral Small 2507

Mistral AI

Q8_0fits29.2 GB40k

6tok/sest.

482 tok/s–
Magistral Small 2509

Mistral AI

Q8_0fits29.2 GB128k

6tok/sest.

475 tok/s–
GLM 4.5V

Z.ai

Q8_0fits112.4 GB64k

5tok/sest.

425 tok/s–
GLM 4.6V

Z.ai

Q8_0fits112.4 GB67k123k with q8 cache

5tok/sest.

425 tok/s–
granite 4.2 30b

IBM

Q8_0fits37.9 GB128k

4tok/sest.

368 tok/s–
DeepSeek R1 Distill Llama 70B

DeepSeek

Q8_0fits80.7 GB128k

2tok/sest.

152 tok/s–
Mistral Medium 3.5 128B

Mistral AI

Q6_Kfits107.4 GB65k120k with q8 cache

2tok/sest.

86 tok/s–
DeepSeek R1

DeepSeek

Q4_K_Mwon't run379.7 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run380.2 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run379.7 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run380.6 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run380.6 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run149.2 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run158.0 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q8_0won't run135.6 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run214.0 GB––––
GLM 5.1

Z.ai

MXFP4won't run423.6 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run437.5 GB––––
GLM 5.3

Z.ai

Q8_0won't run750.0 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run581.2 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run581.6 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run581.6 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run581.6 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run137.5 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run137.5 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run123.9 GB12k22k with q8 cache–––
MiniMax M3

MiniMax

UD-Q4_K_Mwon't run251.4 GB––––