Framework Desktop Ryzen AI Max+ 395 128GB vs NVIDIA DGX Spark 128GB

For running models locally, priced in Germany. At 8k context the first runs 41 models fully in memory, the second 42.

Specifications

SpecFramework Desktop Ryzen AI Max+ 395 128GBNVIDIA DGX Spark 128GB
ChipRyzen AI Max+ 395 (Radeon 8060S)GB10 Grace Blackwell
Memory bus256-bit256-bit
Memory bandwidth256 GB/s273 GB/s
FP16 compute59.4 TFLOPS62 TFLOPS
SoftwareROCmCUDA
Unified memory128 GB128 GB
GPU can use by default96 GB119 GB
GPU can use, tuned120 GB122 GB
Operating systemlinuxdgx-os
ProcessorRyzen AI Max+ 39520-core Arm (GB10)
Storage1000 GB4000 GB

What each runs

Estimated decode speed with the most precise quant that fits each one est.

ModelFramework Desktop Ryzen AI Max+ 395 128GBNVIDIA DGX Spark 128GB
DeepSeek V4 Flash11tok/sUD-Q2_K_XL14tok/sUD-Q2_K_XL
Qwen 3.8 Flash Next3tok/sUD-Q3_K_XL3tok/sUD-Q4_K_XL
GLM 5.3 Flashwon't run12tok/sUD-Q2_K_XL
MiniMax M2.715tok/sUD-Q2_K_XL15tok/sUD-Q3_K_M
Qwen 3.8 27B5tok/sQ8_06tok/sQ8_0
Qwen 3.5 122B-A10B10tok/sQ6_K12tok/sQ6_K
Qwen 3.6 27B5tok/sQ8_06tok/sQ8_0
gpt-oss 120B25tok/sMXFP430tok/sMXFP4
Qwen3 Coder Next19tok/sQ8_023tok/sQ8_0
Nemotron 3 Super 120B-A12B10tok/sUD-Q4_K_M9tok/sUD-Q6_K
Gemma 4 31B4tok/sQ8_05tok/sQ8_0
Mistral Small 4 119B14tok/sUD-Q6_K13tok/sQ8_0
Qwen 3.6 35B-A3B26tok/sQ8_031tok/sQ8_0
Qwen 3.5 27B5tok/sQ8_06tok/sQ8_0
Gemma 4 26B-A4B19tok/sQ8_022tok/sQ8_0
GLM 4.5 Air5tok/sQ6_K5tok/sQ8_0
Qwen 3.5 35B-A3B26tok/sQ8_031tok/sQ8_0
Qwen3 Next 80B-A3B25tok/sQ8_030tok/sQ8_0
GLM 4.7 Flash15tok/sQ8_018tok/sQ8_0
Devstral Small 2 24B5tok/sQ8_06tok/sQ8_0
Nemotron 3.5 Lightning 30B-A3B25tok/sUD-Q6_K_XL30tok/sUD-Q6_K_XL
gpt-oss 20B32tok/sMXFP439tok/sMXFP4
Kimi Linear 48B-A3B26tok/sQ8_031tok/sQ8_0
Qwen3 Coder 30B-A3B21tok/sQ8_025tok/sQ8_0
Qwen3 32B4tok/sQ8_05tok/sQ8_0
Gemma 4 12B11tok/sQ8_013tok/sQ8_0
Qwen 3.5 9B14tok/sQ8_017tok/sQ8_0
Mistral Small 3.2 24B5tok/sQ8_06tok/sQ8_0
Gemma 3 27B5tok/sQ8_06tok/sQ8_0
DeepSeek R1 Distill Qwen 32B4tok/sQ8_05tok/sQ8_0
Llama 3.3 70B2tok/sQ8_02tok/sQ8_0
Ministral 3 14B9tok/sQ8_011tok/sQ8_0
Qwen3 14B8tok/sQ8_010tok/sQ8_0
DeepSeek R1 0528 Qwen3 8B14tok/sQ8_017tok/sQ8_0
Qwen3 8B14tok/sQ8_017tok/sQ8_0
Phi-4 14B8tok/sQ8_010tok/sQ8_0
Qwen 3.5 4B29tok/sQ8_035tok/sQ8_0
Ministral 3 8B14tok/sQ8_017tok/sQ8_0
Granite 4.2 8B13tok/sQ8_016tok/sQ8_0
Gemma 4 E4B17tok/sQ8_020tok/sQ8_0
LFM2.5 8B-A1B58tok/sQ8_069tok/sQ8_0
Llama 3.1 8B18tok/sQ6_K22tok/sQ6_K