NVIDIA RTX PRO 4000 Blackwell
24 GB · 672 GB/s · 145 W
In short
The NVIDIA RTX PRO 4000 Blackwell has 24 GB of GDDR7 memory with 672 GB/s of bandwidth, which sets how fast it generates text. At 32k context it runs 63 of the 125 open models we track fully in memory; the most capable is Qwen 3.8 27B at Q8_0, at about 13 tok/s (estimated). We have no current price for the NVIDIA RTX PRO 4000 Blackwell in Germany.
Updated . Speeds are estimates; how they are worked out.
Prices
Every retailer we track in Germany, cheapest first. Buy links may earn us a commission.
No retailer in this market lists it right now.
What two of them run
Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.
| Model | Quant | Fits | Memory | Max context | Decode @32k | Prefill | Good for |
|---|---|---|---|---|---|---|---|
| Qwen 3.8 27B Alibaba Qwen | Q8_0 | fits | 30.5 GB | 256k | 13tok/sest. | 340 tok/s | – |
| Qwen 3.5 122B-A10B Alibaba Qwen | UD-Q2_K_XL | fits | 41.1 GB | 224k256k with q8 cache | 58tok/sest. | 798 tok/s | chat, coding, agents, long documents |
| Qwen 3.6 27B Alibaba Qwen | Q8_0 | fits | 30.1 GB | 256k | 14tok/sest. | 340 tok/s | – |
| Gemma 4 31B | Q8_0 | fits | 35.0 GB | 172k256k with q8 cache | 12tok/sest. | 303 tok/s | – |
| Mistral Small 4 119B Mistral AI | UD-Q2_K_XL | fits | 39.4 GB | 296k471k with q8 cache | 80tok/sest. | 887 tok/s | chat, coding, agents, long documents |
| Qwen 3.6 35B-A3B Alibaba Qwen | Q8_0 | fits | 36.3 GB | 256k | 66tok/sest. | 2430 tok/s | chat, coding, agents, long documents |
| Qwen 3.5 27B Alibaba Qwen | Q8_0 | fits | 30.1 GB | 256k | 14tok/sest. | 340 tok/s | – |
| Gemma 4 26B-A4B | Q8_0 | fits | 27.1 GB | 256k | 50tok/sest. | 2162 tok/s | chat, coding, agents, long documents |
| Qwen 3.5 35B-A3B Alibaba Qwen | Q8_0 | fits | 36.3 GB | 256k | 66tok/sest. | 2430 tok/s | chat, coding, agents, long documents |
| GLM 4.7 Flash Z.ai | Q8_0 | fits | 32.6 GB | 198k | 35tok/sest. | 1269 tok/s | chat, coding, agents, long documents |
| Devstral Small 2 24B Mistral AI | Q8_0 | fits | 29.6 GB | 137k251k with q8 cache | 14tok/sest. | 359 tok/s | chat |
| Nemotron 3.5 Lightning 30B-A3B NVIDIA | UD-Q6_K_XL | fits | 34.1 GB | 256k | 70tok/sest. | 2773 tok/s | chat, coding, agents, long documents |
| Kimi Linear 48B-A3B Moonshot AI | Q6_K | fits | 39.3 GB | 588k802k with q8 cache | 90tok/sest. | 2094 tok/s | chat, coding, long documents |
| gpt-oss 20B OpenAI | MXFP4 | fits | 13.3 GB | 128k | 77tok/sest. | 1814 tok/s | chat, coding, agents, long documents |
| Qwen3 Coder 30B-A3B Alibaba Qwen | Q8_0 | fits | 34.5 GB | 155k256k with q8 cache | 39tok/sest. | 1118 tok/s | chat, coding, agents, long documents |
| Qwen3 32B Alibaba Qwen | Q8_0 | fits | 41.7 GB | 40k | 10tok/sest. | 211 tok/s | – |
| Gemma 4 12B | Q8_0 | fits | 13.9 GB | 256k | 31tok/sest. | 789 tok/s | chat, coding, long documents |
| Qwen 3.5 9B Alibaba Qwen | Q8_0 | fits | 11.2 GB | 256k | 39tok/sest. | 984 tok/s | chat, coding, long documents |
| Mistral Small 3.2 24B Mistral AI | Q8_0 | fits | 29.6 GB | 128k | 14tok/sest. | 359 tok/s | chat |
| Gemma 3 27B | Q8_0 | fits | 30.9 GB | 128k | 13tok/sest. | 361 tok/s | – |
| DeepSeek R1 Distill Qwen 32B DeepSeek | Q8_0 | fits | 41.7 GB | 51k95k with q8 cache | 10tok/sest. | 243 tok/s | – |
| Ministral 3 14B Mistral AI | Q8_0 | fits | 19.7 GB | 199k256k with q8 cache | 21tok/sest. | 546 tok/s | chat, coding |
| Qwen3 14B Alibaba Qwen | Q8_0 | fits | 20.9 GB | 40k | 20tok/sest. | 491 tok/s | chat |
| DeepSeek R1 0528 Qwen3 8B DeepSeek | Q8_0 | fits | 13.9 GB | 128k | 31tok/sest. | 810 tok/s | chat, coding |
| Qwen3 8B Alibaba Qwen | Q8_0 | fits | 13.9 GB | 40k | 31tok/sest. | 810 tok/s | chat, coding |
| Phi-4 14B Microsoft | Q8_0 | fits | 22.0 GB | 16k | 19tok/sest. | 494 tok/s | chat |
| Qwen 3.5 4B Alibaba Qwen | Q8_0 | fits | 6.5 GB | 256k | 74tok/sest. | 1841 tok/s | chat, coding, long documents |
| Ministral 3 8B Mistral AI | Q8_0 | fits | 13.9 GB | 256k | 31tok/sest. | 783 tok/s | chat, coding, long documents |
| Granite 4.2 8B IBM | Q8_0 | fits | 15.0 GB | 128k | 28tok/sest. | 745 tok/s | chat, coding |
| Gemma 4 E4B | Q8_0 | fits | 9.8 GB | 128k | 45tok/sest. | 1236 tok/s | chat, coding, long documents |
| LFM2.5 8B-A1B Liquid AI | Q8_0 | fits | 11.2 GB | 125k | 94tok/sest. | 4042 tok/s | chat, coding, long documents |
| Llama 3.1 8B Meta | Q6_K | fits | 11.4 GB | 128k | 38tok/sest. | 856 tok/s | chat, coding, long documents |
| Qwen2.5 0.5B Alibaba Qwen | Q8_0 | fits | 2.2 GB | 32k | 446tok/sest. | 8804 tok/s | chat, coding, long documents |
| Qwen3.5 0.8B Alibaba Qwen | Q8_0 | fits | 2.4 GB | 256k | 338tok/sest. | 8269 tok/s | chat, coding, agents, long documents |
| Qwen3.5 2B Alibaba Qwen | Q5_K_M | fits | 3.0 GB | 256k | 224tok/sest. | 3942 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Qwen 1.5B DeepSeek | Q8_0 | fits | 3.9 GB | 128k | 147tok/sest. | 3312 tok/s | chat, coding, long documents |
| MiniCPM5 2B openbmb | Q8_0 | fits | 5.1 GB | 128k | 102tok/sest. | 1978 tok/s | chat, coding, agents, long documents |
| Spark X2.5 4B XHToken | mlx-4bit | fits | 5.3 GB | 1024k | 97tok/sest. | 1942 tok/s | chat, coding, agents, long documents |
| LFM2.5 2.6B Liquid AI | Q8_0 | fits | 5.8 GB | 128k | 85tok/sest. | 2240 tok/s | chat, coding, agents, long documents |
| LFM2.5 VL 3B Liquid AI | Q8_0 | fits | 5.8 GB | 32k | 85tok/sest. | 2054 tok/s | chat, coding, agents, long documents |
| Mellum2.1 12B A2.5B Thinking JetBrains | Q8_0 | fits | 13.8 GB | 128k | 79tok/sest. | 2919 tok/s | chat, coding, agents, long documents |
| FrogNano 4B 2609 Microsoft | Q8_0 | fits | 6.6 GB | 256k | 73tok/sest. | 1841 tok/s | chat, coding, agents, long documents |
| granite vision 4.1 4b IBM | Q8_0 | fits | 7.2 GB | 128k | 66tok/sest. | 1435 tok/s | chat, coding, long documents |
| granite 4.2 3b IBM | Q8_0 | fits | 7.4 GB | 128k | 63tok/sest. | 1504 tok/s | chat, coding, agents, long documents |
| Kimi VL A3B Thinking 2506 Moonshot AI | Q8_0 | fits | 18.0 GB | 128k | 61tok/sest. | 2193 tok/s | chat, coding, long documents |
| Kimi VL A3B Moonshot AI | mlx-8bit | fits | 18.8 GB | 128k | 58tok/sest. | 2193 tok/s | chat, coding, agents, long documents |
| Ministral 3 3B Instruct 2512 Mistral AI | Q8_0 | fits | 7.9 GB | 256k | 58tok/sest. | 1438 tok/s | chat, coding, agents, long documents |
| LFM2.5 24B A2B Liquid AI | Q8_0 | fits | 27.5 GB | 128k | 52tok/sest. | 2253 tok/s | chat, coding, agents, long documents |
| GLM 4 9B 0414 Z.ai | mlx-5bit | fits | 10.2 GB | 32k | 43tok/sest. | 715 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Qwen 7B DeepSeek | Q8_0 | fits | 10.6 GB | 128k | 42tok/sest. | 968 tok/s | chat, coding, long documents |
| GLM 4.6V Flash Z.ai | Q8_0 | fits | 11.9 GB | 128k | 37tok/sest. | 674 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Llama 8B DeepSeek | Q8_0 | fits | 13.2 GB | 128k | 33tok/sest. | 856 tok/s | chat, coding, long documents |
| GLM 4.1V 9B Thinking Z.ai | mlx-8bit | fits | 13.5 GB | 64k | 32tok/sest. | 674 tok/s | chat, coding, long documents |
| Ministral 3 8B Reasoning 2512 Mistral AI | Q8_0 | fits | 13.9 GB | 256k | 31tok/sest. | 783 tok/s | chat, coding, agents, long documents |
| Ministral 3 14B Reasoning 2512 Mistral AI | Q8_0 | fits | 19.7 GB | 199k256k with q8 cache | 21tok/sest. | 546 tok/s | chat, coding |
| DeepSeek R1 Distill Qwen 14B DeepSeek | Q8_0 | fits | 21.9 GB | 128k | 19tok/sest. | 462 tok/s | chat |
| Qwen3.8 27B OBLITERATED OBLITERATUS | mlx-4bit | fits | 22.7 GB | 256k | 18tok/sest. | 340 tok/s | chat |
| Devstral Small 2507 Mistral AI | Q8_0 | fits | 29.6 GB | 128k | 14tok/sest. | 365 tok/s | chat |
| Magistral Small 2506 Mistral AI | Q8_0 | fits | 29.6 GB | 40k | 14tok/sest. | 365 tok/s | chat |
| Magistral Small 2507 Mistral AI | Q8_0 | fits | 29.6 GB | 40k | 14tok/sest. | 365 tok/s | chat |
| Magistral Small 2509 Mistral AI | Q8_0 | fits | 29.6 GB | 128k | 14tok/sest. | 359 tok/s | chat |
| Muse Glimmer 30B meta-models | Q8_0 | fits | 31.9 GB | 128k | 13tok/sest. | 328 tok/s | – |
| granite 4.2 30b IBM | Q8_0 | fits | 38.3 GB | 65k120k with q8 cache | 11tok/sest. | 279 tok/s | – |
| Qwen3 Coder Next Alibaba Qwen | Q4_K_M | offload | 47.3 GB | 14k23k with q8 cache | 72tok/sest. | 1911 tok/s | chat, coding, agents, long documents |
| Nemotron 3 Super 120B-A12B NVIDIA | UD-Q2_K_XL | offload | 52.6 GB | – | 25tok/sest. | 752 tok/s | chat, coding, long documents |
| gpt-oss 120B OpenAI | Q4_K_M | offload | 60.9 GB | – | 22tok/sest. | 1107 tok/s | chat, coding |
| GLM 4.5 Air Z.ai | Q2_K | offload | 49.2 GB | 18k34k with q8 cache | 16tok/sest. | 319 tok/s | chat |
| Qwen3 Next 80B-A3B Alibaba Qwen | Q4_K_M | offload | 47.3 GB | 15k24k with q8 cache | 87tok/sest. | 2274 tok/s | chat, coding, agents, long documents |
| Llama 3.3 70B Meta | Q4_K_M | offload | 50.9 GB | 19k35k with q8 cache | 5tok/sest. | 109 tok/s | – |
| GLM 4.5V Z.ai | Q4_K_M | offload | 66.3 GB | – | 6tok/sest. | 264 tok/s | – |
| DeepSeek R1 Distill Llama 70B DeepSeek | Q4_K_M | offload | 50.9 GB | 19k35k with q8 cache | 5tok/sest. | 109 tok/s | – |
| GLM 4.6V Z.ai | Q4_K_M | offload | 72.6 GB | – | 5tok/sest. | 252 tok/s | – |
| Kimi Dev 72B Moonshot AI | Q6_K | offload | 71.2 GB | – | 2tok/sest. | 89 tok/s | – |
| DeepSeek V4 Flash DeepSeek | UD-Q2_K_XL | won't run | 94.2 GB | – | – | – | – |
| GLM 5.3 Flash Z.ai | UD-Q2_K_XL | won't run | 103.0 GB | – | – | – | – |
| Qwen 3.8 Flash Next Alibaba Qwen | UD-Q2_K_XL | won't run | 75.6 GB | – | – | – | – |
| MiniMax M2.7 MiniMax | UD-Q2_K_XL | won't run | 79.2 GB | – | – | – | – |
| DeepSeek R1 DeepSeek | Q4_K_M | won't run | 380.1 GB | – | – | – | – |
| DeepSeek R1 0528 DeepSeek | Q4_K_M | won't run | 380.6 GB | – | – | – | – |
| DeepSeek R1 Zero DeepSeek | Q4_K_M | won't run | 380.1 GB | – | – | – | – |
| DeepSeek V3 DeepSeek | Q4_K_M | won't run | 380.1 GB | – | – | – | – |
| DeepSeek V3 0324 DeepSeek | Q4_K_M | won't run | 380.1 GB | – | – | – | – |
| DeepSeek V3.1 DeepSeek | Q4_K_M | won't run | 381.0 GB | – | – | – | – |
| DeepSeek V3.1 Terminus DeepSeek | Q4_K_M | won't run | 381.0 GB | – | – | – | – |
| DeepSeek V3.2 DeepSeek | Q4_K_M | won't run | 381.0 GB | – | – | – | – |
| DeepSeek V4 Flash 0731 DeepSeek | MXFP4 | won't run | 149.6 GB | – | – | – | – |
| DeepSeek V4 Flash Vision Exp DeepSeek | MXFP4 | won't run | 158.4 GB | – | – | – | – |
| Devstral 2 123B Instruct 2512 Mistral AI | Q4_K_M | won't run | 82.0 GB | – | – | – | – |
| GLM 4.5 Z.ai | Q4_K_M | won't run | 214.4 GB | – | – | – | – |
| GLM 4.6 Z.ai | Q4_K_M | won't run | 213.6 GB | – | – | – | – |
| GLM 4.7 Z.ai | Q4_K_M | won't run | 214.4 GB | – | – | – | – |
| GLM 5 Z.ai | MXFP4 | won't run | 386.4 GB | – | – | – | – |
| GLM 5.1 Z.ai | MXFP4 | won't run | 424.0 GB | – | – | – | – |
| GLM 5.2 Z.ai | UD-Q4_K_M | won't run | 437.9 GB | – | – | – | – |
| GLM 5.3 Z.ai | Q8_0 | won't run | 750.4 GB | – | – | – | – |
| Kimi K2 Moonshot AI | Q4_K_M | won't run | 581.6 GB | – | – | – | – |
| Kimi K2 Instruct 0905 Moonshot AI | Q4_K_M | won't run | 582.0 GB | – | – | – | – |
| Kimi K2 Thinking Moonshot AI | Q4_K_M | won't run | 582.0 GB | – | – | – | – |
| Kimi K2.5 Moonshot AI | Q4_K_M | won't run | 582.0 GB | – | – | – | – |
| MiniMax M2 MiniMax | Q4_K_M | won't run | 137.9 GB | – | – | – | – |
| MiniMax M2.1 MiniMax | Q4_K_M | won't run | 137.9 GB | – | – | – | – |
| MiniMax M2.5 MiniMax | MXFP4 | won't run | 124.3 GB | – | – | – | – |
| MiniMax M3 MiniMax | MXFP4 | won't run | 244.7 GB | – | – | – | – |
| Mistral Medium 3.5 128B Mistral AI | Q4_K_M | won't run | 82.0 GB | – | – | – | – |
Specifications
From the manufacturer's published specifications; sources are linked where we have them.
- GPU
- RTX PRO 4000 Blackwell
- Memory
- 24 GB GDDR7
- Memory bus
- 192-bit
- Memory bandwidth
- 672 GB/s
- FP16 compute
- 46.9 TFLOPS
- Software
- CUDA
- Board power
- 145 W
- PCIe generation
- Gen 5
- PCIe lanes
- x16
Compare with
Questions
- How much memory does the NVIDIA RTX PRO 4000 Blackwell have for AI models?
- The NVIDIA RTX PRO 4000 Blackwell has 24 GB of GDDR7 memory with 672 GB/s of bandwidth, which sets how fast it generates text.
- What is the best model the NVIDIA RTX PRO 4000 Blackwell can run locally?
- Qwen 3.8 27B (Q8_0) fits fully in its memory at 32k context and generates at about 13 tok/s, an estimate from its memory bandwidth. 63 of the 125 models we track fit at that context.
- Can the NVIDIA RTX PRO 4000 Blackwell run DeepSeek V4 Flash?
- No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 94 GB at 32k context, more than the NVIDIA RTX PRO 4000 Blackwell and system RAM can hold.
- How much does the NVIDIA RTX PRO 4000 Blackwell cost in Germany?
- We have no current price for the NVIDIA RTX PRO 4000 Blackwell in Germany.
Speeds on this page are for 32k context. See the best hardware for local AI at every budget.