Mac mini M4 32GB vs Framework Desktop Ryzen AI Max+ 395 128GB

For running models locally, priced in Germany. At 128k context the first runs 7 models fully in memory, the second 39.

Specifications

SpecMac mini M4 32GBFramework Desktop Ryzen AI Max+ 395 128GB
ChipApple M4 (10-core GPU)Ryzen AI Max+ 395 (Radeon 8060S)
Memory bus128-bit256-bit
Memory bandwidth120 GB/s256 GB/s
FP16 compute3.76 TFLOPS59.4 TFLOPS
SoftwareMetalROCm
Unified memory32 GB128 GB
GPU can use by default21.3 GB96 GB
GPU can use, tuned24 GB120 GB
Operating systemmacoslinux
ProcessorM4 10-coreRyzen AI Max+ 395
Storage512 GB1000 GB

What each runs

Estimated decode speed with the most precise quant that fits each one est.

ModelMac mini M4 32GBFramework Desktop Ryzen AI Max+ 395 128GB
Qwen 3.8 Flash Nextwon't run3tok/sUD-Q3_K_XL
Qwen 3.8 27Bwon't run4tok/sQ8_0
Qwen 3.5 122B-A10Bwon't run8tok/sQ5_K_M
Qwen 3.6 27Bwon't run4tok/sQ8_0
Gemma 4 31Bwon't run3tok/sQ8_0
Nemotron 3 Super 120B-A12Bwon't run9tok/sUD-Q4_K_M
Qwen3 Coder Nextwon't run11tok/sQ8_0
gpt-oss 120Bwon't run11tok/sMXFP4
Mistral Small 4 119Bwon't run10tok/sUD-Q5_K_M
Qwen 3.5 27Bwon't run4tok/sQ8_0
Qwen 3.6 35B-A3Bwon't run15tok/sQ8_0
Gemma 4 26B-A4B9tok/sUD-Q4_K_M12tok/sQ8_0
GLM 4.5 Airwon't run2tok/sQ4_K_M
Devstral Small 2 24Bwon't run3tok/sQ8_0
GLM 4.7 Flashwon't run7tok/sQ8_0
Qwen 3.5 35B-A3Bwon't run15tok/sQ8_0
Qwen3 Next 80B-A3Bwon't run13tok/sQ8_0
Nemotron 3.5 Lightning 30B-A3Bwon't run20tok/sUD-Q6_K_XL
gpt-oss 20B8tok/sMXFP415tok/sMXFP4
Kimi Linear 48B-A3Bwon't run20tok/sQ8_0
Qwen3 Coder 30B-A3Bwon't run5tok/sQ8_0
Qwen3 32Bwon't run2tok/sQ8_0
Gemma 4 12B5tok/sQ8_09tok/sQ8_0
Qwen 3.5 9B6tok/sQ8_010tok/sQ8_0
DeepSeek R1 Distill Qwen 32Bwon't run2tok/sQ8_0
Gemma 3 27Bwon't run4tok/sQ8_0
Llama 3.3 70Bwon't run2tok/sQ5_K_M
Mistral Small 3.2 24Bwon't run3tok/sQ8_0
Ministral 3 14Bwon't run4tok/sQ8_0
Qwen3 14Bwon't run4tok/sQ8_0
DeepSeek R1 0528 Qwen3 8Bwon't run5tok/sQ8_0
Phi-4 14Bwon't run3tok/sQ8_0
Qwen3 8Bwon't run5tok/sQ8_0
Qwen 3.5 4B9tok/sQ8_016tok/sQ8_0
Granite 4.2 8Bwon't run5tok/sQ8_0
Ministral 3 8Bwon't run5tok/sQ8_0
Gemma 4 E4B7tok/sQ8_012tok/sQ8_0
LFM2.5 8B-A1B6tok/sQ8_011tok/sQ8_0
Llama 3.1 8Bwon't run6tok/sQ6_K
DeepSeek V4 Flashwon't runwon't run
GLM 5.3 Flashwon't runwon't run
MiniMax M2.7won't runwon't run