NVIDIA GeForce RTX 5060

8 GB · 448 GB/s · 145 W

In short

The NVIDIA GeForce RTX 5060 has 8 GB of GDDR7 memory with 448 GB/s of bandwidth, which sets how fast it generates text. At 128k context it runs 5 of the 129 open models we track fully in memory; the most capable is Qwen2.5 0.5B at Q8_0, at about 130 tok/s (estimated). The best new price for the NVIDIA GeForce RTX 5060 in Canada is $660 at Amazon; used, it starts at $575 (asking price).

Updated . Speeds are estimates; how they are worked out.

Prices

Every retailer we track in Canada, cheapest first. Buy links may earn us a commission.

RetailerConditionPriceStockCheckedBuy
eBayZOTAC GAMING GeForce RTX 5060 Twin Edge OC DLSS 4 8GB GDDR7 128-bit 28 Gbps PCIEused, asking price$575In stock2 h agoBuy
AmazonASUS Dual GeForce RTX 5060 8GB GDDR7 OC EditionNew$660In stock4 h agoBuy
AmazonMSI Gaming RTX 5060 8G Shadow 2X OC Graphics CardNew$690In stock4 h agoBuy
AmazonGIGABYTE GeForce RTX 5060 WINDFORCE OC 8G Graphics CardNew$710In stock4 h agoBuy
AmazonASUS Dual GeForce RTX 5060 8GB GDDR7 White OC Edition Gaming Graphics CardNew$720In stock4 h agoBuy
AmazonZOTAC Gaming GeForce RTX 5060 Twin Edge OC DLSS 4 8GB GDDR7 128-bit 28 Gbps…New$728In stock4 h agoBuy
AmazonASUS PRIME GeForce RTX 5060 8GB GDDR7 Gaming Graphics CardNew$740In stock4 h agoBuy
AmazonASUS The SFF-Ready Prime GeForce RTX 5060 8GB GDDR7 OC Edition Graphics CardNew$740In stock4 h agoBuy
AmazonMSI Gaming RTX 5060 8G Ventus 2X OC Graphics CardNew$745In stock4 h agoBuy
AmazonASUS GeForce RTX 5060 LP BRK 8GB GDDR7 OC Edition Graphics CardNew$752In stock10 h agoBuy
AmazonMSI Gaming RTX 5060 8G Ventus 3X OC Graphics CardNew$770In stock4 h agoBuy
AmazonMSI Gaming RTX 5060 8G Gaming Trio OC Graphics CardNew$775In stock4 h agoBuy
AmazonMSI Gaming RTX 5060 8G Gaming OC Graphics CardNew$780In stock4 h agoBuy
AmazonASUS TUF Gaming GeForce RTX 5060 8GB GDDR7 OC Edition Gaming Graphics CardNew$800In stock4 h agoBuy
eBayMSI GeForce RTX 5060 8G VENTUS 2X OC 8GB GDDR7 Graphics CardNew$975In stock2 h agoBuy

Price history

Lowest price shown each day over the last 90 days.

Not enough price history yet.

What it runs

Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @128kPrefillGood for
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits3.4 GB32k

130tok/sest.

1303 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits3.7 GB256k

114tok/sest.

1737 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits4.3 GB256k

91tok/sest.

1111 tok/schat, coding, agents, long documents
LFM3 1.7B

Liquid AI

Q8_0fits4.7 GB256k

80tok/sest.

1285 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits6.7 GB128k

49tok/sest.

582 tok/schat, coding, long documents
Qwen 3.8 27B

Alibaba Qwen

UD-Q4_K_Moffload24.9 GB–

3tok/sest.

59 tok/s–
Qwen 3.6 27B

Alibaba Qwen

Q4_K_Moffload25.3 GB–

3tok/sest.

58 tok/s–
Gemma 4 31B

Google

Q4_K_Moffload29.3 GB–

2tok/sest.

53 tok/s–
Qwen 3.6 35B-A3B

Alibaba Qwen

MXFP4offload24.2 GB–

9tok/sest.

287 tok/schat
Qwen 3.5 27B

Alibaba Qwen

Q4_K_Moffload25.2 GB–

3tok/sest.

58 tok/s–
Gemma 4 26B-A4B

Google

MXFP4offload19.6 GB–

8tok/sest.

374 tok/schat
Qwen 3.5 35B-A3B

Alibaba Qwen

Q4_K_Moffload24.5 GB–

9tok/sest.

286 tok/schat
GLM 4.7 Flash

Z.ai

Q4_K_Moffload25.1 GB–

4tok/sest.

134 tok/s–
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

MXFP4offload23.9 GB–

13tok/sest.

388 tok/schat
Kimi Linear 48B-A3B

Moonshot AI

Q4_K_Moffload30.5 GB–

13tok/sest.

202 tok/schat
gpt-oss 20B

OpenAI

Q4_K_Moffload15.3 GB–

9tok/sest.

267 tok/schat
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q4_K_Moffload30.7 GB–

3tok/sest.

78 tok/schat
Gemma 4 12B

Google

Q4_K_Moffload10.4 GB–

12tok/sest.

208 tok/schat, coding
Qwen 3.5 9B

Alibaba Qwen

Q4_K_Moffload10.8 GB36k60k with q8 cache

11tok/sest.

242 tok/schat, coding
Gemma 3 27B

Google

Q4_K_Moffload27.3 GB–

2tok/sest.

70 tok/s–
Ministral 3 14B

Mistral AI

Q4_K_Moffload29.1 GB–

2tok/sest.

64 tok/s–
Qwen3 14B

Alibaba Qwen

Q4_K_Moffload29.8 GB–

2tok/sest.

55 tok/s–
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q4_K_Moffload24.1 GB13k25k with q8 cache

3tok/sest.

87 tok/schat
Qwen3 8B

Alibaba Qwen

Q4_K_Moffload24.1 GB13k25k with q8 cache

3tok/sest.

87 tok/schat
Qwen 3.5 4B

Alibaba Qwen

Q4_K_Moffload8.0 GB110k182k with q8 cache

28tok/sest.

453 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q4_K_Moffload23.3 GB13k24k with q8 cache

3tok/sest.

90 tok/schat
Granite 4.2 8B

IBM

Q4_K_Moffload26.6 GB9k17k with q8 cache

3tok/sest.

77 tok/schat
Gemma 4 E4B

Google

Q4_K_Moffload9.6 GB61k100k with q8 cache

15tok/sest.

363 tok/schat, coding
LFM2.5 8B-A1B

Liquid AI

UD-Q4_K_Moffload12.4 GB33k56k with q8 cache

8tok/sest.

421 tok/schat, coding
Llama 3.1 8B

Meta

Q4_K_Moffload22.0 GB16k29k with q8 cache

3tok/sest.

98 tok/schat
FrogNano 4B 2609

Microsoft

Q4_K_Moffload8.1 GB109k180k with q8 cache

27tok/sest.

451 tok/schat, coding, agents, long documents
MiniCPM5 2B

openbmb

Q4_K_Moffload8.2 GB110k128k with q8 cache

26tok/sest.

291 tok/schat, coding, agents
Spark X2.5 4B

XHToken

mlx-4bitoffload8.8 GB93k156k with q8 cache

19tok/sest.

421 tok/schat, coding, agents, long documents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q4_K_Moffload11.5 GB–

17tok/sest.

508 tok/schat, coding, agents, long documents
LFM2.5 2.6B

Liquid AI

Q4_K_Moffload10.5 GB79k128k with q8 cache

12tok/sest.

319 tok/schat, coding, agents
LFM2.5 VL 3B

Liquid AI

Q4_K_Moffload10.5 GB32k

12tok/sest.

307 tok/schat, coding, agents
GLM 4.6V Flash

Z.ai

Q4_K_Moffload12.2 GB21k35k with q8 cache

8tok/sest.

100 tok/schat, coding
Kimi VL A3B Thinking 2506

Moonshot AI

Q4_K_Moffload15.1 GB–

8tok/sest.

279 tok/schat, coding
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q4_K_Moffload12.8 GB38k66k with q8 cache

8tok/sest.

148 tok/schat, coding
Kimi VL A3B

Moonshot AI

mlx-5bitoffload16.3 GB–

8tok/sest.

199 tok/schat
GLM 4 9B 0414

Z.ai

mlx-4bitoffload13.0 GB2k4k with q8 cache

7tok/sest.

99 tok/schat
granite vision 4.1 4b

IBM

Q4_K_Moffload13.4 GB56k100k with q8 cache

7tok/sest.

173 tok/schat, coding
granite 4.2 3b

IBM

Q4_K_Moffload13.6 GB54k95k with q8 cache

7tok/sest.

175 tok/schat, coding, agents
Ministral 3 3B Instruct 2512

Mistral AI

Q4_K_Moffload16.4 GB43k78k with q8 cache

5tok/sest.

155 tok/schat, coding, agents
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitoffload17.4 GB–

5tok/sest.

85 tok/s–
Muse Glimmer 30B

meta-models

Q4_K_Moffload19.3 GB–

4tok/sest.

69 tok/s–
LFM2.5 24B A2B

Liquid AI

Q4_K_Moffload25.7 GB–

3tok/sest.

185 tok/schat
DeepSeek R1 Distill Llama 8B

DeepSeek

Q4_K_Moffload22.0 GB16k29k with q8 cache

3tok/sest.

98 tok/schat
Ministral 3 8B Reasoning 2512

Mistral AI

Q4_K_Moffload23.3 GB13k24k with q8 cache

3tok/sest.

90 tok/schat
Ministral 3 14B Reasoning 2512

Mistral AI

Q4_K_Moffload29.1 GB–

2tok/sest.

64 tok/s–
Qwen3.8 27B OBLITERATED

OBLITERATUS

mlx-4bitoffload28.8 GB–

2tok/sest.

56 tok/s–
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLwon't run102.4 GB––––
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLwon't run104.2 GB––––
Qwen 3.8 Flash Next

Alibaba Qwen

UD-Q2_K_XLwon't run78.0 GB––––
MiniMax M2.7

MiniMax

UD-Q2_K_XLwon't run102.6 GB––––
Qwen 3.5 122B-A10B

Alibaba Qwen

UD-Q2_K_XLwon't run43.6 GB––––
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q2_K_XLwon't run53.5 GB––––
Qwen3 Coder Next

Alibaba Qwen

Q4_K_Mwon't run49.7 GB––––
gpt-oss 120B

OpenAI

Q4_K_Mwon't run64.4 GB––––
Mistral Small 4 119B

Mistral AI

UD-Q2_K_XLwon't run41.7 GB––––
GLM 4.5 Air

Z.ai

Q2_Kwon't run66.7 GB––––
Devstral Small 2 24B

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Qwen3 Next 80B-A3B

Alibaba Qwen

Q4_K_Mwon't run49.7 GB––––
Qwen3 32B

Alibaba Qwen

Q4_K_Mwon't run51.9 GB––––
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q4_K_Mwon't run51.9 GB––––
Llama 3.3 70B

Meta

Q4_K_Mwon't run81.1 GB––––
Mistral Small 3.2 24B

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Phi-4 14B

Microsoft

Q4_K_Mwon't run34.7 GB––––
DeepSeek R1

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run387.2 GB––––
DeepSeek R1 Distill Llama 70B

DeepSeek

Q4_K_Mwon't run81.1 GB––––
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q4_K_Mwon't run33.8 GB––––
DeepSeek R1 Zero

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek V3

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V3.1 Terminus

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run157.8 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run166.6 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q4_K_Mwon't run115.2 GB––––
Devstral Small 2507

Mistral AI

Q4_K_Mwon't run34.8 GB––––
GLM 4.5

Z.ai

Q4_K_Mwon't run249.0 GB––––
GLM 4.5V

Z.ai

Q4_K_Mwon't run83.7 GB––––
GLM 4.6

Z.ai

Q4_K_Mwon't run248.2 GB––––
GLM 4.6V

Z.ai

Q4_K_Mwon't run90.1 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run249.0 GB––––
GLM 5

Z.ai

MXFP4won't run394.8 GB––––
GLM 5.1

Z.ai

MXFP4won't run432.4 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run446.3 GB––––
GLM 5.3

Z.ai

Q8_0won't run758.7 GB––––
Kimi Dev 72B

Moonshot AI

Q6_Kwon't run101.4 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run588.2 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Magistral Small 2506

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Magistral Small 2507

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Magistral Small 2509

Mistral AI

Q4_K_Mwon't run34.8 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run161.3 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run161.3 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run147.7 GB––––
MiniMax M3

MiniMax

MXFP4won't run256.1 GB––––
Mistral Medium 3.5 128B

Mistral AI

Q4_K_Mwon't run115.2 GB––––
granite 4.2 30b

IBM

Q4_K_Mwon't run50.2 GB––––

Specifications

From the manufacturer's published specifications; sources are linked where we have them.

GPU
GeForce RTX 5060
Memory
8 GB GDDR7
Memory bus
128-bit
Memory bandwidth
448 GB/s
FP16 compute
19.177 TFLOPS
Software
CUDA
Board power
145 W
PCIe generation
Gen 5
PCIe lanes
x8

Compare with

Questions

How much memory does the NVIDIA GeForce RTX 5060 have for AI models?
The NVIDIA GeForce RTX 5060 has 8 GB of GDDR7 memory with 448 GB/s of bandwidth, which sets how fast it generates text.
What is the best model the NVIDIA GeForce RTX 5060 can run locally?
Qwen2.5 0.5B (Q8_0) fits fully in its memory at 128k context and generates at about 130 tok/s, an estimate from its memory bandwidth. 5 of the 129 models we track fit at that context.
Can the NVIDIA GeForce RTX 5060 run DeepSeek V4 Flash?
No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 102 GB at 128k context, more than the NVIDIA GeForce RTX 5060 and system RAM can hold.
How much does the NVIDIA GeForce RTX 5060 cost in Canada?
The best new price for the NVIDIA GeForce RTX 5060 in Canada is $660 at Amazon; used, it starts at $575 (asking price).

Speeds on this page are for 128k context. See the best hardware for local AI at every budget.

More hardware for local AI