NVIDIA RTX PRO 4500 Blackwell
32 GB · 896 GB/s · 200 W
In short
The NVIDIA RTX PRO 4500 Blackwell has 32 GB of GDDR7 memory with 896 GB/s of bandwidth, which sets how fast it generates text. At 128k context it runs 66 of the 125 open models we track fully in memory; the most capable is Qwen 3.8 27B at Q8_0, at about 15 tok/s (estimated). We have no current price for the NVIDIA RTX PRO 4500 Blackwell in the US.
Updated . Speeds are estimates; how they are worked out.
Prices
Every retailer we track in the US, cheapest first. Buy links may earn us a commission.
No retailer in this market lists it right now.
What two of them run
Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.
| Model | Quant | Fits | Memory | Max context | Decode @128k | Prefill | Good for |
|---|---|---|---|---|---|---|---|
| Qwen 3.8 27B Alibaba Qwen | Q8_0 | fits | 37.0 GB | 256k | 15tok/sest. | 304 tok/s | chat |
| Qwen 3.5 122B-A10B Alibaba Qwen | Q3_K_M | fits | 57.5 GB | 256k | 42tok/sest. | 540 tok/s | chat, coding, agents, long documents |
| Qwen 3.6 27B Alibaba Qwen | Q8_0 | fits | 36.6 GB | 256k | 15tok/sest. | 304 tok/s | chat |
| Qwen3 Coder Next Alibaba Qwen | Q5_K_M | fits | 57.9 GB | 256k | 55tok/sest. | 1198 tok/s | chat, coding, agents, long documents |
| Nemotron 3 Super 120B-A12B NVIDIA | UD-Q3_K_M | fits | 60.5 GB | 256k | 46tok/sest. | 759 tok/s | chat, coding, agents, long documents |
| Gemma 4 31B | Q8_0 | fits | 43.0 GB | 256k | 13tok/sest. | 289 tok/s | chat |
| Mistral Small 4 119B Mistral AI | UD-Q3_K_M | fits | 55.3 GB | 397k630k with q8 cache | 54tok/sest. | 468 tok/s | chat, coding, agents, long documents |
| Qwen 3.6 35B-A3B Alibaba Qwen | Q8_0 | fits | 38.8 GB | 256k | 57tok/sest. | 1477 tok/s | chat, coding, agents, long documents |
| Qwen 3.5 27B Alibaba Qwen | Q8_0 | fits | 36.6 GB | 256k | 15tok/sest. | 304 tok/s | chat |
| Gemma 4 26B-A4B | Q8_0 | fits | 29.6 GB | 256k | 47tok/sest. | 1793 tok/s | chat, coding, agents, long documents |
| Qwen3 Next 80B-A3B Alibaba Qwen | Q5_K_M | fits | 57.8 GB | 256k | 62tok/sest. | 1309 tok/s | chat, coding, agents, long documents |
| Qwen 3.5 35B-A3B Alibaba Qwen | Q8_0 | fits | 38.8 GB | 256k | 57tok/sest. | 1477 tok/s | chat, coding, agents, long documents |
| GLM 4.7 Flash Z.ai | Q8_0 | fits | 38.1 GB | 198k | 27tok/sest. | 697 tok/s | chat, coding, agents, long documents |
| Devstral Small 2 24B Mistral AI | Q8_0 | fits | 45.2 GB | 236k384k with q8 cache | 12tok/sest. | 272 tok/s | chat |
| Nemotron 3.5 Lightning 30B-A3B NVIDIA | UD-Q6_K_XL | fits | 35.2 GB | 256k | 80tok/sest. | 1987 tok/s | chat, coding, agents, long documents |
| Kimi Linear 48B-A3B Moonshot AI | Q8_0 | fits | 51.5 GB | 959k1024k with q8 cache | 78tok/sest. | 1108 tok/s | chat, coding, long documents |
| gpt-oss 20B OpenAI | MXFP4 | fits | 16.1 GB | 128k | 59tok/sest. | 1161 tok/s | chat, coding, agents, long documents |
| Qwen3 Coder 30B-A3B Alibaba Qwen | Q8_0 | fits | 44.1 GB | 256k | 21tok/sest. | 430 tok/s | chat, coding, agents, long documents |
| Qwen3 32B Alibaba Qwen | Q6_K | fits | 58.9 GB | 40k | 9tok/sest. | 122 tok/s | chat |
| Gemma 4 12B | Q8_0 | fits | 16.0 GB | 256k | 37tok/sest. | 745 tok/s | chat, coding, long documents |
| Qwen 3.5 9B Alibaba Qwen | Q8_0 | fits | 14.8 GB | 256k | 40tok/sest. | 886 tok/s | chat, coding, long documents |
| Gemma 3 27B | Q8_0 | fits | 39.0 GB | 128k | 14tok/sest. | 372 tok/s | chat |
| Mistral Small 3.2 24B Mistral AI | Q8_0 | fits | 45.2 GB | 128k | 12tok/sest. | 272 tok/s | chat |
| DeepSeek R1 Distill Qwen 32B DeepSeek | Q6_K | fits | 58.9 GB | 128k | 9tok/sest. | 163 tok/s | chat |
| Ministral 3 14B Mistral AI | Q8_0 | fits | 35.2 GB | 256k | 16tok/sest. | 349 tok/s | chat, coding, long documents |
| Qwen3 14B Alibaba Qwen | Q8_0 | fits | 36.5 GB | 40k | 15tok/sest. | 297 tok/s | chat, coding |
| DeepSeek R1 0528 Qwen3 8B DeepSeek | Q8_0 | fits | 28.0 GB | 128k | 20tok/sest. | 449 tok/s | chat, coding, long documents |
| Qwen3 8B Alibaba Qwen | Q8_0 | fits | 28.0 GB | 40k | 20tok/sest. | 449 tok/s | chat, coding, long documents |
| Phi-4 14B Microsoft | Q8_0 | fits | 41.4 GB | 16k | 13tok/sest. | 298 tok/s | chat, coding |
| Qwen 3.5 4B Alibaba Qwen | Q8_0 | fits | 10.1 GB | 256k | 63tok/sest. | 1380 tok/s | chat, coding, long documents |
| Ministral 3 8B Mistral AI | Q8_0 | fits | 27.3 GB | 256k | 20tok/sest. | 455 tok/s | chat, coding, long documents |
| Granite 4.2 8B IBM | Q8_0 | fits | 30.6 GB | 128k | 18tok/sest. | 408 tok/s | chat, coding, agents, long documents |
| Gemma 4 E4B | Q8_0 | fits | 13.0 GB | 128k | 46tok/sest. | 1243 tok/s | chat, coding, long documents |
| LFM2.5 8B-A1B Liquid AI | Q8_0 | fits | 16.2 GB | 125k | 44tok/sest. | 1661 tok/s | chat, coding, long documents |
| Llama 3.1 8B Meta | Q6_K | fits | 24.0 GB | 128k | 23tok/sest. | 490 tok/s | chat, coding, long documents |
| Qwen2.5 0.5B Alibaba Qwen | Q8_0 | fits | 3.8 GB | 32k | 259tok/sest. | 3732 tok/s | chat, coding, long documents |
| Qwen3.5 0.8B Alibaba Qwen | Q8_0 | fits | 4.1 GB | 256k | 228tok/sest. | 4976 tok/s | chat, coding, agents, long documents |
| Qwen3.5 2B Alibaba Qwen | Q5_K_M | fits | 4.7 GB | 256k | 181tok/sest. | 3182 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Qwen 1.5B DeepSeek | Q8_0 | fits | 7.1 GB | 128k | 98tok/sest. | 1667 tok/s | chat, coding, long documents |
| Mellum2.1 12B A2.5B Thinking JetBrains | Q8_0 | fits | 15.7 GB | 128k | 73tok/sest. | 1921 tok/s | chat, coding, agents, long documents |
| Spark X2.5 4B XHToken | mlx-4bit | fits | 9.2 GB | 1024k | 70tok/sest. | 1365 tok/s | chat, coding, agents, long documents |
| MiniCPM5 2B openbmb | Q8_0 | fits | 9.6 GB | 128k | 67tok/sest. | 896 tok/s | chat, coding, agents, long documents |
| FrogNano 4B 2609 Microsoft | Q8_0 | fits | 10.2 GB | 256k | 62tok/sest. | 1380 tok/s | chat, coding, agents, long documents |
| LFM2.5 2.6B Liquid AI | Q8_0 | fits | 12.0 GB | 128k | 51tok/sest. | 1150 tok/s | chat, coding, agents, long documents |
| LFM2.5 VL 3B Liquid AI | Q8_0 | fits | 12.0 GB | 32k | 51tok/sest. | 1106 tok/s | chat, coding, agents, long documents |
| Kimi VL A3B Thinking 2506 Moonshot AI | Q8_0 | fits | 21.5 GB | 128k | 46tok/sest. | 1206 tok/s | chat, coding, long documents |
| Kimi VL A3B Moonshot AI | mlx-8bit | fits | 22.2 GB | 128k | 45tok/sest. | 1206 tok/s | chat, coding, agents, long documents |
| GLM 4 9B 0414 Z.ai | mlx-5bit | fits | 14.5 GB | 32k | 41tok/sest. | 400 tok/s | chat, coding, agents, long documents |
| granite vision 4.1 4b IBM | Q8_0 | fits | 15.2 GB | 128k | 39tok/sest. | 710 tok/s | chat, coding, long documents |
| granite 4.2 3b IBM | Q8_0 | fits | 15.5 GB | 128k | 38tok/sest. | 724 tok/s | chat, coding, agents, long documents |
| GLM 4.6V Flash Z.ai | Q8_0 | fits | 16.2 GB | 128k | 36tok/sest. | 389 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Qwen 7B DeepSeek | Q8_0 | fits | 16.4 GB | 128k | 36tok/sest. | 595 tok/s | chat, coding, long documents |
| GLM 4.1V 9B Thinking Z.ai | mlx-8bit | fits | 17.8 GB | 64k | 32tok/sest. | 389 tok/s | chat, coding, long documents |
| Ministral 3 3B Instruct 2512 Mistral AI | Q8_0 | fits | 18.3 GB | 256k | 32tok/sest. | 694 tok/s | chat, coding, agents, long documents |
| LFM2.5 24B A2B Liquid AI | Q8_0 | fits | 35.6 GB | 128k | 26tok/sest. | 971 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Llama 8B DeepSeek | Q8_0 | fits | 25.8 GB | 128k | 22tok/sest. | 490 tok/s | chat, coding, long documents |
| Ministral 3 8B Reasoning 2512 Mistral AI | Q8_0 | fits | 27.3 GB | 256k | 20tok/sest. | 455 tok/s | chat, coding, agents, long documents |
| Qwen3.8 27B OBLITERATED OBLITERATUS | mlx-4bit | fits | 29.2 GB | 256k | 19tok/sest. | 304 tok/s | chat, coding, long documents |
| Muse Glimmer 30B meta-models | Q8_0 | fits | 33.7 GB | 128k | 16tok/sest. | 330 tok/s | chat, long documents |
| Ministral 3 14B Reasoning 2512 Mistral AI | Q8_0 | fits | 35.2 GB | 256k | 16tok/sest. | 349 tok/s | chat, coding, long documents |
| DeepSeek R1 Distill Qwen 14B DeepSeek | Q8_0 | fits | 40.5 GB | 128k | 13tok/sest. | 263 tok/s | chat, coding |
| Devstral Small 2507 Mistral AI | Q8_0 | fits | 45.2 GB | 128k | 12tok/sest. | 274 tok/s | chat |
| Magistral Small 2506 Mistral AI | Q8_0 | fits | 45.2 GB | 40k | 12tok/sest. | 274 tok/s | chat |
| Magistral Small 2507 Mistral AI | Q8_0 | fits | 45.2 GB | 40k | 12tok/sest. | 274 tok/s | chat |
| Magistral Small 2509 Mistral AI | Q8_0 | fits | 45.2 GB | 128k | 12tok/sest. | 272 tok/s | chat |
| granite 4.2 30b IBM | Q6_K | fits | 56.7 GB | 128k | 9tok/sest. | 194 tok/s | chat |
| Qwen 3.8 Flash Next Alibaba Qwen | UD-Q2_K_XL | offload | 78.4 GB | – | 4tok/sest. | 152 tok/s | – |
| gpt-oss 120B OpenAI | Q4_K_M | offload | 64.8 GB | 78k128k with q8 cache | 32tok/sest. | 786 tok/s | chat, coding, agents, long documents |
| GLM 4.5 Air Z.ai | Q2_K | offload | 67.1 GB | 105k128k with q8 cache | 7tok/sest. | 136 tok/s | chat, coding |
| Llama 3.3 70B Meta | Q4_K_M | offload | 81.5 GB | 69k128k with q8 cache | 2tok/sest. | 68 tok/s | – |
| GLM 4.5V Z.ai | Q4_K_M | offload | 84.1 GB | 13k24k with q8 cache | 3tok/sest. | 118 tok/s | chat |
| DeepSeek R1 Distill Llama 70B DeepSeek | Q4_K_M | offload | 81.5 GB | 69k128k with q8 cache | 2tok/sest. | 68 tok/s | – |
| DeepSeek V4 Flash DeepSeek | UD-Q2_K_XL | won't run | 102.8 GB | – | – | – | – |
| GLM 5.3 Flash Z.ai | UD-Q2_K_XL | won't run | 104.6 GB | – | – | – | – |
| MiniMax M2.7 MiniMax | UD-Q2_K_XL | won't run | 103.0 GB | – | – | – | – |
| DeepSeek R1 DeepSeek | Q4_K_M | won't run | 387.1 GB | – | – | – | – |
| DeepSeek R1 0528 DeepSeek | Q4_K_M | won't run | 387.6 GB | – | – | – | – |
| DeepSeek R1 Zero DeepSeek | Q4_K_M | won't run | 387.1 GB | – | – | – | – |
| DeepSeek V3 DeepSeek | Q4_K_M | won't run | 387.1 GB | – | – | – | – |
| DeepSeek V3 0324 DeepSeek | Q4_K_M | won't run | 387.1 GB | – | – | – | – |
| DeepSeek V3.1 DeepSeek | Q4_K_M | won't run | 388.0 GB | – | – | – | – |
| DeepSeek V3.1 Terminus DeepSeek | Q4_K_M | won't run | 388.0 GB | – | – | – | – |
| DeepSeek V3.2 DeepSeek | Q4_K_M | won't run | 388.0 GB | – | – | – | – |
| DeepSeek V4 Flash 0731 DeepSeek | MXFP4 | won't run | 158.2 GB | – | – | – | – |
| DeepSeek V4 Flash Vision Exp DeepSeek | MXFP4 | won't run | 167.0 GB | – | – | – | – |
| Devstral 2 123B Instruct 2512 Mistral AI | Q4_K_M | won't run | 115.6 GB | – | – | – | – |
| GLM 4.5 Z.ai | Q4_K_M | won't run | 249.4 GB | – | – | – | – |
| GLM 4.6 Z.ai | Q4_K_M | won't run | 248.6 GB | – | – | – | – |
| GLM 4.6V Z.ai | Q4_K_M | won't run | 90.5 GB | – | – | – | – |
| GLM 4.7 Z.ai | Q4_K_M | won't run | 249.4 GB | – | – | – | – |
| GLM 5 Z.ai | MXFP4 | won't run | 395.2 GB | – | – | – | – |
| GLM 5.1 Z.ai | MXFP4 | won't run | 432.8 GB | – | – | – | – |
| GLM 5.2 Z.ai | UD-Q4_K_M | won't run | 446.7 GB | – | – | – | – |
| GLM 5.3 Z.ai | Q8_0 | won't run | 759.1 GB | – | – | – | – |
| Kimi Dev 72B Moonshot AI | Q6_K | won't run | 101.8 GB | 5k10k with q8 cache | – | – | – |
| Kimi K2 Moonshot AI | Q4_K_M | won't run | 588.6 GB | – | – | – | – |
| Kimi K2 Instruct 0905 Moonshot AI | Q4_K_M | won't run | 589.0 GB | – | – | – | – |
| Kimi K2 Thinking Moonshot AI | Q4_K_M | won't run | 589.0 GB | – | – | – | – |
| Kimi K2.5 Moonshot AI | Q4_K_M | won't run | 589.0 GB | – | – | – | – |
| MiniMax M2 MiniMax | Q4_K_M | won't run | 161.7 GB | – | – | – | – |
| MiniMax M2.1 MiniMax | Q4_K_M | won't run | 161.7 GB | – | – | – | – |
| MiniMax M2.5 MiniMax | MXFP4 | won't run | 148.1 GB | – | – | – | – |
| MiniMax M3 MiniMax | MXFP4 | won't run | 256.5 GB | – | – | – | – |
| Mistral Medium 3.5 128B Mistral AI | Q4_K_M | won't run | 115.6 GB | – | – | – | – |
Specifications
From the manufacturer's published specifications; sources are linked where we have them.
- GPU
- RTX PRO 4500 Blackwell
- Memory
- 32 GB GDDR7
- Memory bus
- 256-bit
- Memory bandwidth
- 896 GB/s
- FP16 compute
- 54.94 TFLOPS
- Software
- CUDA
- Board power
- 200 W
- PCIe generation
- Gen 5
- PCIe lanes
- x16
Compare with
Questions
- How much memory does the NVIDIA RTX PRO 4500 Blackwell have for AI models?
- The NVIDIA RTX PRO 4500 Blackwell has 32 GB of GDDR7 memory with 896 GB/s of bandwidth, which sets how fast it generates text.
- What is the best model the NVIDIA RTX PRO 4500 Blackwell can run locally?
- Qwen 3.8 27B (Q8_0) fits fully in its memory at 128k context and generates at about 15 tok/s, an estimate from its memory bandwidth. 66 of the 125 models we track fit at that context.
- Can the NVIDIA RTX PRO 4500 Blackwell run DeepSeek V4 Flash?
- No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 103 GB at 128k context, more than the NVIDIA RTX PRO 4500 Blackwell and system RAM can hold.
- How much does the NVIDIA RTX PRO 4500 Blackwell cost in the US?
- We have no current price for the NVIDIA RTX PRO 4500 Blackwell in the US.
Speeds on this page are for 128k context. See the best hardware for local AI at every budget.