NVIDIA GeForce RTX 4090

24 GB · 1,008 GB/s · 450 W

Prices

Every retailer we track in India, cheapest first. Buy links may earn us a commission.

No retailer in this market lists it right now.

What it runs

Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @64kPrefillGood for
Qwen 3.8 27B

Alibaba Qwen

UD-Q4_K_Mfits20.5 GB105k184k with q8 cache

30tok/sest.

1085 tok/schat, coding, agents
Qwen 3.6 27B

Alibaba Qwen

Q5_K_Mfits23.4 GB64k112k with q8 cache

26tok/sest.

1085 tok/schat, coding
Qwen 3.6 35B-A3B

Alibaba Qwen

UD-Q4_K_Mfits23.0 GB79k124k with q8 cache

115tok/sest.

6531 tok/schat, coding, agents, long documents
Qwen 3.5 27B

Alibaba Qwen

Q4_K_Mfits20.8 GB101k178k with q8 cache

30tok/sest.

1085 tok/schat, coding, agents
Gemma 4 26B-A4B

Google

UD-Q5_K_Mfits22.2 GB110k178k with q8 cache

78tok/sest.

6687 tok/schat, coding, agents, long documents
Qwen 3.5 35B-A3B

Alibaba Qwen

Q4_K_Mfits22.9 GB84k131k with q8 cache

116tok/sest.

6531 tok/schat, coding, agents, long documents
GLM 4.7 Flash

Z.ai

Q4_K_Mfits21.4 GB98k169k with q8 cache

57tok/sest.

3240 tok/schat, coding, agents, long documents
gpt-oss 20B

OpenAI

MXFP4fits13.9 GB128k

93tok/sest.

4999 tok/schat, coding, agents, long documents
Gemma 4 12B

Google

Q8_0fits14.2 GB256k

44tok/sest.

2571 tok/schat, coding, long documents
Qwen 3.5 9B

Alibaba Qwen

Q8_0fits12.0 GB256k

53tok/sest.

3146 tok/schat, coding, long documents
Gemma 3 27B

Google

Q4_K_Mfits21.9 GB81k128k with q8 cache

28tok/sest.

1215 tok/schat, coding
Ministral 3 14B

Mistral AI

Q6_Kfits21.4 GB76k139k with q8 cache

29tok/sest.

1504 tok/schat, coding
Qwen3 14B

Alibaba Qwen

Q6_Kfits22.4 GB40k

27tok/sest.

1317 tok/schat, coding
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q8_0fits18.2 GB99k128k with q8 cache

34tok/sest.

2079 tok/schat, coding
Qwen3 8B

Alibaba Qwen

Q8_0fits18.2 GB40k

34tok/sest.

2079 tok/schat, coding
Phi-4 14B

Microsoft

Q5_K_Mfits23.3 GB16k

26tok/sest.

1322 tok/schat, coding
Qwen 3.5 4B

Alibaba Qwen

Q8_0fits7.3 GB256k

94tok/sest.

5454 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q8_0fits18.0 GB103k187k with q8 cache

34tok/sest.

2057 tok/schat, coding
Granite 4.2 8B

IBM

Q8_0fits19.8 GB86k128k with q8 cache

31tok/sest.

1901 tok/schat, coding, agents
Gemma 4 E4B

Google

Q8_0fits10.5 GB128k

62tok/sest.

4121 tok/schat, coding, long documents
LFM2.5 8B-A1B

Liquid AI

Q8_0fits12.5 GB125k

88tok/sest.

8795 tok/schat, coding, long documents
Llama 3.1 8B

Meta

Q6_Kfits15.2 GB126k128k with q8 cache

41tok/sest.

2234 tok/schat, coding, long documents
Qwen 3.5 122B-A10B

Alibaba Qwen

UD-Q2_K_XLoffload41.7 GB–

13tok/sest.

1648 tok/schat
Gemma 4 31B

Google

Q4_K_Moffload23.9 GB57k110k with q8 cache

21tok/sest.

977 tok/schat, coding
Qwen3 Coder Next

Alibaba Qwen

Q4_K_Moffload47.8 GB–

14tok/sest.

3591 tok/schat
Mistral Small 4 119B

Mistral AI

UD-Q2_K_XLoffload39.9 GB–

18tok/sest.

1653 tok/schat, coding
Devstral Small 2 24B

Mistral AI

Q4_K_Moffload24.4 GB57k105k with q8 cache

17tok/sest.

1040 tok/schat, coding, agents
Qwen3 Next 80B-A3B

Alibaba Qwen

Q4_K_Moffload47.8 GB–

17tok/sest.

4097 tok/schat, coding
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

UD-Q6_K_XLoffload34.1 GB–

22tok/sest.

6487 tok/schat, coding, long documents
Kimi Linear 48B-A3B

Moonshot AI

Q4_K_Moffload29.6 GB–

47tok/sest.

4562 tok/schat, coding, long documents
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q4_K_Moffload24.4 GB54k97k with q8 cache

32tok/sest.

2280 tok/schat, coding, agents
Qwen3 32B

Alibaba Qwen

Q4_K_Moffload35.5 GB16k30k with q8 cache

4tok/sest.

437 tok/schat
Mistral Small 3.2 24B

Mistral AI

Q4_K_Moffload24.4 GB57k105k with q8 cache

17tok/sest.

1040 tok/schat, coding
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q4_K_Moffload35.6 GB16k30k with q8 cache

4tok/sest.

540 tok/schat
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLwon't run96.6 GB––––
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLwon't run103.1 GB––––
Qwen 3.8 Flash Next

Alibaba Qwen

UD-Q2_K_XLwon't run76.1 GB––––
MiniMax M2.7

MiniMax

UD-Q2_K_XLwon't run86.7 GB––––
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q2_K_XLwon't run52.6 GB––––
gpt-oss 120B

OpenAI

MXFP4won't run62.4 GB––––
GLM 4.5 Air

Z.ai

Q2_Kwon't run54.8 GB––––
Llama 3.3 70B

Meta

Q4_K_Mwon't run60.7 GB––––

Specifications

From the manufacturer's published specifications; sources are linked where we have them.

GPU
GeForce RTX 4090
Memory
24 GB GDDR6X
Memory bus
384-bit
Memory bandwidth
1,008 GB/s
FP16 compute
165 TFLOPS
Software
CUDA
Board power
450 W
PCIe generation
Gen 4
PCIe lanes
x16

Compare with