NVIDIA GeForce RTX 3090
24 GB · 936 GB/s · 350 W
In short
The NVIDIA GeForce RTX 3090 has 24 GB of GDDR6X memory with 936 GB/s of bandwidth, which sets how fast it generates text. At 32k context it runs 58 of the 128 open models we track fully in memory; the most capable is Qwen 3.8 27B at Q5_K_M, at about 25 tok/s (estimated). The best new price for the NVIDIA GeForce RTX 3090 in the US is $1,698 at Amazon; used, it starts at $1,549 (asking price).
Updated . Speeds are estimates; how they are worked out.
Prices
Every retailer we track in the US, cheapest first. Buy links may earn us a commission.
| Retailer | Condition | Price | Stock | Checked | Buy |
|---|---|---|---|---|---|
| eBayNVIDIA GeForce RTX 3090 Founders Edition FE 24GB GDDR6X Tested | used, asking price | $1,549 | In stock | 52 min ago | Buy |
| eBayZOTAC GeForce RTX 3090 24GB GDDR6X Trinity OC Graphics Card | refurbished | $1,599 | In stock | 52 min ago | Buy |
| eBayEVGA GeForce RTX 3090 FTW3 Ultra 24GB GDDR6X Graphics Card- Dust/Corrosion | used, asking price | $1,599 | In stock | 4 h ago | Buy |
| eBayNVIDIA GeForce RTX 3090 Founders Edition 24GB GDDR6 Graphics Card- Runs Hot | used, asking price | $1,599 | In stock | 4 h ago | Buy |
| eBayDell NVIDIA GeForce RTX 3090 24GB GDDR6X Graphics Card | used, asking price | $1,600 | In stock | 4 h ago | Buy |
| eBayEVGA GeForce RTX 3090 FTW3 ULTRA GAMING 24GB GDDR6X 24G-P5-3987-KR | used, asking price | $1,600 | In stock | 4 h ago | Buy |
| AmazonGIGABYTE GeForce RTX 3090 Gaming OC 24G Graphics Card | New | $1,698 | In stock | 44 min ago | Buy |
| AmazonPNY GeForce RTX 3090 24GB XLR8 Gaming Revel Epic-X RGB Triple Fan Graphics Card | New | $1,700 | In stock | 30 min ago | Buy |
| AmazonGigabyte GeForce RTX 3090 EAGLE OC 24G Graphics Card | refurbished | $1,700 | In stock | 30 min ago | Buy |
| AmazonGIGABYTE MSI Gaming GeForce RTX 3090 24GB GDRR6X 384-Bit HDMI/DP Nvlink Torx… | New | $1,700 | In stock | 2 h ago | Buy |
| AmazonZOTAC Gaming GeForce RTX 3090 Trinity OC 24GB GDDR6X 384-bit 19.5 Gbps PCIE… | refurbished | $1,730 | In stock | 30 min ago | Buy |
| AmazonGIGABYTE GeForce RTX 3090 Eagle OC 24G Graphics Card | New | $1,777 | In stock | 30 min ago | Buy |
| Amazonmsi Gaming GeForce RTX 3090 24GB GDRR6X 384-Bit HDMI/DP Nvlink Tri-Frozr 2… | New | $1,784 | In stock | 30 min ago | Buy |
| AmazonGigabyte 24GB NVIDIA GeForce RTX 3090 Turbo GDDR6X Graphics Card Model… | refurbished | $1,795 | In stock | 30 min ago | Buy |
| eBayUsed GeForce RTX 3090 on eBay | used, asking price | $1,799 | In stock | 5 h ago | Buy |
| AmazonnVidia GeForce RTX 3090 Founders Edition Graphics Card | New | $1,799 | In stock | 30 min ago | Buy |
| AmazonGIGABYTE AORUS GeForce RTX 3090 Master 24G | New | $1,800 | In stock | 30 min ago | Buy |
| AmazonEVGA 24G-P5-3975-KR GeForce RTX 3090 XC3 Ultra Gaming | refurbished | $1,850 | In stock | 44 min ago | Buy |
| AmazonGigabyte GeForce RTX 3090 GAMING OC 24G Graphics Card | refurbished | $1,880 | In stock | 30 min ago | Buy |
| AmazonASUS ROG STRIX NVIDIA GeForce RTX 3090 Gaming Graphics Card- PCIe 4.0 | refurbished | $1,900 | In stock | 30 min ago | Buy |
| AmazonMSI Gaming GeForce RTX 3090 24GB GDRR6X 384-Bit HDMI/DP Nvlink Torx Fan 3… | refurbished | $1,900 | In stock | 30 min ago | Buy |
| AmazonMSI Gaming GeForce RTX 3090 24GB GDRR6X 384-Bit HDMI/DP Nvlink Tri-Frozr 2… | refurbished | $1,900 | In stock | 30 min ago | Buy |
| AmazonASUS ROG Strix NVIDIA GeForce RTX 3090 White OC Edition Gaming Graphics Card | refurbished | $1,900 | In stock | 30 min ago | Buy |
| AmazonPNY 2021 GeForce RTX 3090 24GB XLR8 Gaming Uprising EPIC-X RGB Triple Fan… | refurbished | $1,900 | In stock | 30 min ago | Buy |
| AmazonNVIDIA GeForce RTX 3090 Founders Edition Graphics Card | refurbished | $1,950 | In stock | 30 min ago | Buy |
| AmazonGIGABYTE GeForce RTX 3090 Vision OC 24G Graphics Card | refurbished | $1,950 | In stock | 30 min ago | Buy |
| AmazonPNY GeForce RTX 3090 24GB XLR8 Gaming REVEL EPIC-X RGB Triple Fan Graphics Card | refurbished | $1,950 | In stock | 30 min ago | Buy |
| AmazonEVGA GeForce RTX 3090 FTW3 Ultra Gaming | New | $1,950 | In stock | 30 min ago | Buy |
| AmazonASUS ROG Strix GeForce RTX 3090 OC Edition 24GB GDDR6X Gaming Graphics Card… | refurbished | $1,950 | In stock | 30 min ago | Buy |
| eBay✅SEALED EVGA GeForce RTX 3090 FTW3 Ultra ✅🔥Fast Shipping! 🔥 24G-P5-3987-KR ✅ | New | $1,999 | In stock | 52 min ago | Buy |
| AmazonASUS TUF Gaming NVIDIA GeForce RTX 3090 OC Edition Graphics Card- PCIe 4.0 | refurbished | $2,100 | In stock | 30 min ago | Buy |
| eBayMSI Ventus Gaming GeForce RTX 3090 24GB GDRR6X 384-Bit HDMI/DP Nvlink Torx Fan 3 | New | $2,150 | In stock | 4 h ago | Buy |
| eBayEVGA GeForce RTX 3090 KINGPIN Graphics Card | New | $2,250 | In stock | 4 h ago | Buy |
| eBay✅NEW ASUS TUF GeForce RTX 3090 24GB GDDR6X 🔥 SEALED *IN HAND FAST 2DAY SHIP🚐 | New | $2,399 | In stock | 52 min ago | Buy |
| AmazonEVGA GeForce RTX 3090 FTW3 Ultra Gaming | New | $2,495 | In stock | 30 min ago | Buy |
| eBayASUS TUF Gaming GeForce RTX 3090 NON LHR OC 24GB GPU FAST/FREE SHIPPING✅🚚💨 | New | $2,500 | In stock | 52 min ago | Buy |
| eBayNVIDIA GeForce RTX 3090 Founders Edition 24GB GDDR6 Graphics Card NON-LHR | New | $2,500+ $100 delivery | In stock | 52 min ago | Buy |
| AmazonGigabyte 24GB NVIDIA GeForce RTX 3090 Turbo GDDR6X Graphics Card Model… | New | $2,795 | In stock | 44 min ago | Buy |
| Amazonmsi Gaming GeForce RTX 3090 24GB GDRR6X 384-Bit HDMI/DP 1875 MHz Ampere… | New | $2,799 | In stock | 30 min ago | Buy |
| AmazonGIGABYTE GeForce RTX 3090 Vision OC 24G Graphics Card | New | $2,799 | In stock | 30 min ago | Buy |
| AmazonASUS ROG STRIX NVIDIA GeForce RTX 3090 White OC Edition Gaming Graphics Card | New | $2,799 | In stock | 30 min ago | Buy |
| eBayMSI GEFORCE RTX 3090 VENTUS 3X 24G OC GPU GRAPHICS CARD 912-V388-055-RETAIL | New | $2,895 | In stock | 4 h ago | Buy |
| eBayEVGA GeForce RTX 3090 FTW3 Ultra 24GB GDDR6X Graphics Card | New | $1,600 | Out of stock | 52 min ago | Buy |
| eBayZOTAC NVIDIA GeForce RTX 3090 Trinity 24GB GDDR6X Graphics Card | New | $2,000+ $20 delivery | Out of stock | 4 h ago | Buy |
| eBayGIGABYTE GeForce RTX 3090 TURBO 24GB GDDR6X Graphics Card | New | $2,199 | Out of stock | 4 h ago | Buy |
Used on eBay: median asking price $1,799, most between $1,699 and $2,000 (118 listings, 2026-10-30). Used price history
Price history
Lowest price shown each day over the last 90 days.
What it runs
Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.
| Model | Quant | Fits | Memory | Max context | Decode @32k | Prefill | Good for |
|---|---|---|---|---|---|---|---|
| Qwen 3.8 27B Alibaba Qwen | Q5_K_M | fits | 22.5 GB | 44k78k with q8 cache | 25tok/sest. | 515 tok/s | chat, coding |
| Qwen 3.6 27B Alibaba Qwen | Q5_K_M | fits | 21.2 GB | 64k112k with q8 cache | 27tok/sest. | 515 tok/s | chat, coding |
| Gemma 4 31B | Q4_K_M | fits | 21.2 GB | 57k110k with q8 cache | 27tok/sest. | 459 tok/s | chat, coding |
| Qwen 3.6 35B-A3B Alibaba Qwen | Q4_K_M | fits | 22.3 GB | 74k116k with q8 cache | 134tok/sest. | 3679 tok/s | chat, coding, agents, long documents |
| Qwen 3.5 27B Alibaba Qwen | Q5_K_M | fits | 21.3 GB | 62k110k with q8 cache | 27tok/sest. | 515 tok/s | chat, coding |
| Gemma 4 26B-A4B | UD-Q6_K | fits | 23.3 GB | 36k62k with q8 cache | 78tok/sest. | 3273 tok/s | chat, coding, agents, long documents |
| Qwen 3.5 35B-A3B Alibaba Qwen | Q4_K_M | fits | 22.1 GB | 84k131k with q8 cache | 135tok/sest. | 3679 tok/s | chat, coding, agents, long documents |
| GLM 4.7 Flash Z.ai | Q5_K_M | fits | 22.5 GB | 48k82k with q8 cache | 65tok/sest. | 1921 tok/s | chat, coding, agents |
| Devstral Small 2 24B Mistral AI | Q5_K_M | fits | 21.5 GB | 43k79k with q8 cache | 26tok/sest. | 544 tok/s | chat, coding |
| Nemotron 3.5 Lightning 30B-A3B NVIDIA | MXFP4 | fits | 22.7 GB | 88k115k with q8 cache | 142tok/sest. | 4198 tok/s | chat, coding, agents, long documents |
| gpt-oss 20B OpenAI | MXFP4 | fits | 12.9 GB | 128k | 108tok/sest. | 2747 tok/s | chat, coding, agents, long documents |
| Qwen3 Coder 30B-A3B Alibaba Qwen | Q4_K_M | fits | 21.2 GB | 54k97k with q8 cache | 69tok/sest. | 1692 tok/s | chat, coding, agents |
| Gemma 4 12B | Q8_0 | fits | 13.5 GB | 256k | 43tok/sest. | 1195 tok/s | chat, coding, long documents |
| Qwen 3.5 9B Alibaba Qwen | Q8_0 | fits | 10.8 GB | 256k | 55tok/sest. | 1489 tok/s | chat, coding, long documents |
| Mistral Small 3.2 24B Mistral AI | Q5_K_M | fits | 21.5 GB | 43k79k with q8 cache | 26tok/sest. | 544 tok/s | chat, coding |
| Gemma 3 27B | Q5_K_M | fits | 21.7 GB | 51k95k with q8 cache | 26tok/sest. | 547 tok/s | chat, coding |
| Ministral 3 14B Mistral AI | Q8_0 | fits | 19.3 GB | 57k104k with q8 cache | 29tok/sest. | 827 tok/s | chat, coding |
| Qwen3 14B Alibaba Qwen | Q8_0 | fits | 20.5 GB | 40k | 28tok/sest. | 744 tok/s | chat, coding |
| DeepSeek R1 0528 Qwen3 8B DeepSeek | Q8_0 | fits | 13.5 GB | 99k128k with q8 cache | 43tok/sest. | 1227 tok/s | chat, coding |
| Qwen3 8B Alibaba Qwen | Q8_0 | fits | 13.5 GB | 40k | 43tok/sest. | 1227 tok/s | chat, coding |
| Phi-4 14B Microsoft | Q8_0 | fits | 21.6 GB | 16k | 26tok/sest. | 748 tok/s | chat, coding |
| Qwen 3.5 4B Alibaba Qwen | Q8_0 | fits | 6.1 GB | 256k | 104tok/sest. | 2786 tok/s | chat, coding, long documents |
| Ministral 3 8B Mistral AI | Q8_0 | fits | 13.5 GB | 103k187k with q8 cache | 43tok/sest. | 1185 tok/s | chat, coding |
| Granite 4.2 8B IBM | Q8_0 | fits | 14.6 GB | 86k128k with q8 cache | 39tok/sest. | 1128 tok/s | chat, coding, agents |
| Gemma 4 E4B | Q8_0 | fits | 9.4 GB | 128k | 63tok/sest. | 1871 tok/s | chat, coding, long documents |
| LFM2.5 8B-A1B Liquid AI | Q8_0 | fits | 10.8 GB | 125k | 130tok/sest. | 6119 tok/s | chat, coding, long documents |
| Llama 3.1 8B Meta | Q6_K | fits | 11.0 GB | 126k128k with q8 cache | 53tok/sest. | 1296 tok/s | chat, coding, long documents |
| Qwen2.5 0.5B Alibaba Qwen | Q8_0 | fits | 1.8 GB | 32k | 622tok/sest. | 13327 tok/s | chat, coding, long documents |
| Qwen3.5 0.8B Alibaba Qwen | Q8_0 | fits | 2.0 GB | 256k | 471tok/sest. | 12519 tok/s | chat, coding, agents, long documents |
| Qwen3.5 2B Alibaba Qwen | Q5_K_M | fits | 2.6 GB | 256k | 313tok/sest. | 5968 tok/s | chat, coding, agents, long documents |
| LFM3 1.7B Liquid AI | Q8_0 | fits | 3.0 GB | 256k | 257tok/sest. | 7429 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Qwen 1.5B DeepSeek | Q8_0 | fits | 3.5 GB | 128k | 205tok/sest. | 5014 tok/s | chat, coding, long documents |
| MiniCPM5 2B openbmb | Q8_0 | fits | 4.7 GB | 128k | 142tok/sest. | 2994 tok/s | chat, coding, agents, long documents |
| Spark X2.5 4B XHToken | mlx-4bit | fits | 4.9 GB | 483k808k with q8 cache | 135tok/sest. | 2940 tok/s | chat, coding, agents, long documents |
| LFM2.5 2.6B Liquid AI | Q8_0 | fits | 5.4 GB | 128k | 119tok/sest. | 3391 tok/s | chat, coding, agents, long documents |
| LFM2.5 VL 3B Liquid AI | Q8_0 | fits | 5.4 GB | 32k | 119tok/sest. | 3110 tok/s | chat, coding, agents, long documents |
| Mellum2.1 12B A2.5B Thinking JetBrains | Q8_0 | fits | 13.4 GB | 128k | 110tok/sest. | 4418 tok/s | chat, coding, agents, long documents |
| FrogNano 4B 2609 Microsoft | Q8_0 | fits | 6.2 GB | 256k | 101tok/sest. | 2786 tok/s | chat, coding, agents, long documents |
| granite vision 4.1 4b IBM | Q8_0 | fits | 6.8 GB | 128k | 92tok/sest. | 2173 tok/s | chat, coding, long documents |
| granite 4.2 3b IBM | Q8_0 | fits | 7.0 GB | 128k | 88tok/sest. | 2277 tok/s | chat, coding, agents, long documents |
| Kimi VL A3B Thinking 2506 Moonshot AI | Q8_0 | fits | 17.6 GB | 128k | 85tok/sest. | 3320 tok/s | chat, coding, long documents |
| Kimi VL A3B Moonshot AI | mlx-8bit | fits | 18.4 GB | 128k | 81tok/sest. | 2794 tok/s | chat, coding, agents, long documents |
| Ministral 3 3B Instruct 2512 Mistral AI | Q8_0 | fits | 7.5 GB | 179k256k with q8 cache | 81tok/sest. | 2177 tok/s | chat, coding, agents, long documents |
| LFM2.5 24B A2B Liquid AI | Q6_K | fits | 23.1 GB | 35k63k with q8 cache | 78tok/sest. | 3410 tok/s | chat, coding, agents |
| GLM 4 9B 0414 Z.ai | mlx-5bit | fits | 9.8 GB | 32k | 61tok/sest. | 1082 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Qwen 7B DeepSeek | Q8_0 | fits | 10.2 GB | 128k | 58tok/sest. | 1465 tok/s | chat, coding, long documents |
| GLM 4.6V Flash Z.ai | Q8_0 | fits | 11.5 GB | 128k | 51tok/sest. | 1020 tok/s | chat, coding, agents, long documents |
| DeepSeek R1 Distill Llama 8B DeepSeek | Q8_0 | fits | 12.8 GB | 112k128k with q8 cache | 45tok/sest. | 1296 tok/s | chat, coding |
| GLM 4.1V 9B Thinking Z.ai | mlx-8bit | fits | 13.1 GB | 64k | 44tok/sest. | 1020 tok/s | chat, coding, long documents |
| Ministral 3 8B Reasoning 2512 Mistral AI | Q8_0 | fits | 13.5 GB | 103k187k with q8 cache | 43tok/sest. | 1185 tok/s | chat, coding, agents |
| Ministral 3 14B Reasoning 2512 Mistral AI | Q8_0 | fits | 19.3 GB | 57k104k with q8 cache | 29tok/sest. | 827 tok/s | chat, coding |
| DeepSeek R1 Distill Qwen 14B DeepSeek | Q8_0 | fits | 21.5 GB | 41k76k with q8 cache | 26tok/sest. | 700 tok/s | chat, coding |
| Devstral Small 2507 Mistral AI | Q5_K_M | fits | 21.5 GB | 43k79k with q8 cache | 26tok/sest. | 552 tok/s | chat, coding |
| Magistral Small 2506 Mistral AI | Q5_K_M | fits | 21.5 GB | 40k | 26tok/sest. | 552 tok/s | chat, coding |
| Magistral Small 2507 Mistral AI | Q5_K_M | fits | 21.5 GB | 40k | 26tok/sest. | 552 tok/s | chat, coding |
| Magistral Small 2509 Mistral AI | Q5_K_M | fits | 21.5 GB | 43k79k with q8 cache | 26tok/sest. | 544 tok/s | chat, coding |
| Qwen3.8 27B OBLITERATED OBLITERATUS | mlx-4bit | fits | 22.3 GB | 48k84k with q8 cache | 25tok/sest. | 515 tok/s | chat, coding |
| Muse Glimmer 30B meta-models | Q6_K | fits | 23.2 GB | 44k67k with q8 cache | 24tok/sest. | 497 tok/s | chat, coding |
| Qwen 3.5 122B-A10B Alibaba Qwen | UD-Q2_K_XL | offload | 40.7 GB | – | 15tok/sest. | 893 tok/s | chat |
| Qwen3 Coder Next Alibaba Qwen | Q4_K_M | offload | 46.9 GB | – | 18tok/sest. | 2020 tok/s | chat |
| Mistral Small 4 119B Mistral AI | UD-Q2_K_XL | offload | 39.0 GB | – | 22tok/sest. | 1013 tok/s | chat, coding |
| GLM 4.5 Air Z.ai | Q2_K | offload | 48.8 GB | – | 5tok/sest. | 340 tok/s | – |
| Qwen3 Next 80B-A3B Alibaba Qwen | Q4_K_M | offload | 46.9 GB | – | 22tok/sest. | 2404 tok/s | chat, coding |
| Kimi Linear 48B-A3B Moonshot AI | Q4_K_M | offload | 29.2 GB | – | 54tok/sest. | 2783 tok/s | chat, coding, long documents |
| Qwen3 32B Alibaba Qwen | Q4_K_M | offload | 27.3 GB | 16k30k with q8 cache | 8tok/sest. | 292 tok/s | chat |
| DeepSeek R1 Distill Qwen 32B DeepSeek | Q4_K_M | offload | 27.4 GB | 16k30k with q8 cache | 8tok/sest. | 334 tok/s | chat |
| granite 4.2 30b IBM | Q4_K_M | offload | 25.7 GB | 23k42k with q8 cache | 12tok/sest. | 399 tok/s | chat |
| DeepSeek V4 Flash DeepSeek | UD-Q2_K_XL | won't run | 93.8 GB | – | – | – | – |
| GLM 5.3 Flash Z.ai | UD-Q2_K_XL | won't run | 102.6 GB | – | – | – | – |
| Qwen 3.8 Flash Next Alibaba Qwen | UD-Q2_K_XL | won't run | 75.2 GB | – | – | – | – |
| MiniMax M2.7 MiniMax | UD-Q2_K_XL | won't run | 78.8 GB | – | – | – | – |
| Nemotron 3 Super 120B-A12B NVIDIA | UD-Q2_K_XL | won't run | 52.2 GB | – | – | – | – |
| gpt-oss 120B OpenAI | Q4_K_M | won't run | 60.5 GB | – | – | – | – |
| Llama 3.3 70B Meta | Q4_K_M | won't run | 50.5 GB | – | – | – | – |
| DeepSeek R1 DeepSeek | Q4_K_M | won't run | 379.7 GB | – | – | – | – |
| DeepSeek R1 0528 DeepSeek | Q4_K_M | won't run | 380.2 GB | – | – | – | – |
| DeepSeek R1 Distill Llama 70B DeepSeek | Q4_K_M | won't run | 50.5 GB | – | – | – | – |
| DeepSeek R1 Zero DeepSeek | Q4_K_M | won't run | 379.7 GB | – | – | – | – |
| DeepSeek V3 DeepSeek | Q4_K_M | won't run | 379.7 GB | – | – | – | – |
| DeepSeek V3 0324 DeepSeek | Q4_K_M | won't run | 379.7 GB | – | – | – | – |
| DeepSeek V3.1 DeepSeek | Q4_K_M | won't run | 380.6 GB | – | – | – | – |
| DeepSeek V3.1 Terminus DeepSeek | Q4_K_M | won't run | 380.6 GB | – | – | – | – |
| DeepSeek V3.2 DeepSeek | Q4_K_M | won't run | 380.6 GB | – | – | – | – |
| DeepSeek V4 Flash 0731 DeepSeek | MXFP4 | won't run | 149.2 GB | – | – | – | – |
| DeepSeek V4 Flash Vision Exp DeepSeek | MXFP4 | won't run | 158.0 GB | – | – | – | – |
| Devstral 2 123B Instruct 2512 Mistral AI | Q4_K_M | won't run | 81.6 GB | – | – | – | – |
| GLM 4.5 Z.ai | Q4_K_M | won't run | 214.0 GB | – | – | – | – |
| GLM 4.5V Z.ai | Q4_K_M | won't run | 65.9 GB | – | – | – | – |
| GLM 4.6 Z.ai | Q4_K_M | won't run | 213.2 GB | – | – | – | – |
| GLM 4.6V Z.ai | Q4_K_M | won't run | 72.2 GB | – | – | – | – |
| GLM 4.7 Z.ai | Q4_K_M | won't run | 214.0 GB | – | – | – | – |
| GLM 5 Z.ai | MXFP4 | won't run | 386.0 GB | – | – | – | – |
| GLM 5.1 Z.ai | MXFP4 | won't run | 423.6 GB | – | – | – | – |
| GLM 5.2 Z.ai | UD-Q4_K_M | won't run | 437.5 GB | – | – | – | – |
| GLM 5.3 Z.ai | Q8_0 | won't run | 750.0 GB | – | – | – | – |
| Kimi Dev 72B Moonshot AI | Q6_K | won't run | 70.8 GB | – | – | – | – |
| Kimi K2 Moonshot AI | Q4_K_M | won't run | 581.2 GB | – | – | – | – |
| Kimi K2 Instruct 0905 Moonshot AI | Q4_K_M | won't run | 581.6 GB | – | – | – | – |
| Kimi K2 Thinking Moonshot AI | Q4_K_M | won't run | 581.6 GB | – | – | – | – |
| Kimi K2.5 Moonshot AI | Q4_K_M | won't run | 581.6 GB | – | – | – | – |
| MiniMax M2 MiniMax | Q4_K_M | won't run | 137.5 GB | – | – | – | – |
| MiniMax M2.1 MiniMax | Q4_K_M | won't run | 137.5 GB | – | – | – | – |
| MiniMax M2.5 MiniMax | MXFP4 | won't run | 123.9 GB | – | – | – | – |
| MiniMax M3 MiniMax | MXFP4 | won't run | 244.3 GB | – | – | – | – |
| Mistral Medium 3.5 128B Mistral AI | Q4_K_M | won't run | 81.6 GB | – | – | – | – |
Specifications
From the manufacturer's published specifications; sources are linked where we have them.
- GPU
- GeForce RTX 3090
- Memory
- 24 GB GDDR6X
- Memory bus
- 384-bit
- Memory bandwidth
- 936 GB/s
- FP16 compute
- 71 TFLOPS
- Software
- CUDA
- Board power
- 350 W
- PCIe generation
- Gen 4
- PCIe lanes
- x16
- Parts in our builds with it
- AMD Ryzen 7 7700, AMD Ryzen 9 9900X, MSI MAG B650 Tomahawk WiFi, ASUS ProArt X870E-Creator WiFi, Fractal Design North, Fractal Design Torrent, Corsair RM850x ATX 3.1 850W, Seasonic Vertex GX-1200 1200W, G.Skill Flare X5 64GB (2×32GB) DDR5-6000, Corsair Vengeance 128GB (4×32GB) DDR5-5200, Samsung 990 Pro 2TB
Compare with
Questions
- How much memory does the NVIDIA GeForce RTX 3090 have for AI models?
- The NVIDIA GeForce RTX 3090 has 24 GB of GDDR6X memory with 936 GB/s of bandwidth, which sets how fast it generates text.
- What is the best model the NVIDIA GeForce RTX 3090 can run locally?
- Qwen 3.8 27B (Q5_K_M) fits fully in its memory at 32k context and generates at about 25 tok/s, an estimate from its memory bandwidth. 58 of the 128 models we track fit at that context.
- Can the NVIDIA GeForce RTX 3090 run DeepSeek V4 Flash?
- No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 94 GB at 32k context, more than the NVIDIA GeForce RTX 3090 and system RAM can hold.
- How much does the NVIDIA GeForce RTX 3090 cost in the US?
- The best new price for the NVIDIA GeForce RTX 3090 in the US is $1,698 at Amazon; used, it starts at $1,549 (asking price).
Speeds on this page are for 32k context. See the best hardware for local AI at every budget.