NVIDIA GeForce RTX 5060

8 GB · 448 GB/s · 145 W

In short

The NVIDIA GeForce RTX 5060 has 8 GB of GDDR7 memory with 448 GB/s of bandwidth, which sets how fast it generates text. At 8k context it runs 38 of the 129 open models we track fully in memory; the most capable is gpt-oss 20B at MXFP4, at about 63 tok/s (estimated). The best new price for the NVIDIA GeForce RTX 5060 in Canada is $660 at Amazon; used, it starts at $575 (asking price).

Updated . Speeds are estimates; how they are worked out.

Prices

Every retailer we track in Canada, cheapest first. Buy links may earn us a commission.

RetailerConditionPriceStockCheckedBuy
eBayZOTAC GAMING GeForce RTX 5060 Twin Edge OC DLSS 4 8GB GDDR7 128-bit 28 Gbps PCIEused, asking price$575In stock3 h agoBuy
AmazonASUS Dual GeForce RTX 5060 8GB GDDR7 OC EditionNew$660In stock5 h agoBuy
AmazonMSI Gaming RTX 5060 8G Shadow 2X OC Graphics CardNew$690In stock5 h agoBuy
AmazonGIGABYTE GeForce RTX 5060 WINDFORCE OC 8G Graphics CardNew$710In stock5 h agoBuy
AmazonASUS Dual GeForce RTX 5060 8GB GDDR7 White OC Edition Gaming Graphics CardNew$720In stock5 h agoBuy
AmazonZOTAC Gaming GeForce RTX 5060 Twin Edge OC DLSS 4 8GB GDDR7 128-bit 28 Gbps…New$728In stock5 h agoBuy
AmazonASUS PRIME GeForce RTX 5060 8GB GDDR7 Gaming Graphics CardNew$740In stock5 h agoBuy
AmazonASUS The SFF-Ready Prime GeForce RTX 5060 8GB GDDR7 OC Edition Graphics CardNew$740In stock5 h agoBuy
AmazonMSI Gaming RTX 5060 8G Ventus 2X OC Graphics CardNew$745In stock5 h agoBuy
AmazonASUS GeForce RTX 5060 LP BRK 8GB GDDR7 OC Edition Graphics CardNew$752In stock11 h agoBuy
AmazonMSI Gaming RTX 5060 8G Ventus 3X OC Graphics CardNew$770In stock5 h agoBuy
AmazonMSI Gaming RTX 5060 8G Gaming Trio OC Graphics CardNew$775In stock5 h agoBuy
AmazonMSI Gaming RTX 5060 8G Gaming OC Graphics CardNew$780In stock5 h agoBuy
AmazonASUS TUF Gaming GeForce RTX 5060 8GB GDDR7 OC Edition Gaming Graphics CardNew$800In stock5 h agoBuy
eBayMSI GeForce RTX 5060 8G VENTUS 2X OC 8GB GDDR7 Graphics CardNew$975In stock3 h agoBuy

Price history

Lowest price shown each day over the last 90 days.

Not enough price history yet.

What two of them run

Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @8kPrefillGood for
gpt-oss 20B

OpenAI

MXFP4fits12.6 GB82k128k with q8 cache

63tok/sest.

936 tok/schat, coding, agents, long documents
Gemma 4 12B

Google

Q8_0fits13.4 GB73k122k with q8 cache

21tok/sest.

343 tok/schat, coding
Qwen 3.5 9B

Alibaba Qwen

Q8_0fits10.3 GB128k212k with q8 cache

28tok/sest.

435 tok/schat, coding, long documents
Ministral 3 14B

Mistral AI

Q6_Kfits12.7 GB20k37k with q8 cache

22tok/sest.

282 tok/schat
Qwen3 14B

Alibaba Qwen

Q6_Kfits13.7 GB14k27k with q8 cache

21tok/sest.

262 tok/schat
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q8_0fits10.4 GB38k69k with q8 cache

28tok/sest.

459 tok/schat, coding
Qwen3 8B

Alibaba Qwen

Q8_0fits10.4 GB38k40k with q8 cache

28tok/sest.

459 tok/schat, coding
Phi-4 14B

Microsoft

Q6_Kfits13.9 GB12k16k with q8 cache

20tok/sest.

264 tok/schat
Qwen 3.5 4B

Alibaba Qwen

Q8_0fits5.6 GB255k256k with q8 cache

58tok/sest.

876 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q8_0fits10.6 GB38k69k with q8 cache

27tok/sest.

429 tok/schat, coding
Granite 4.2 8B

IBM

Q8_0fits11.1 GB30k56k with q8 cache

26tok/sest.

426 tok/schat
Gemma 4 E4B

Google

Q8_0fits9.0 GB128k

33tok/sest.

527 tok/schat, coding, long documents
LFM2.5 8B-A1B

Liquid AI

Q8_0fits9.9 GB100k125k with q8 cache

114tok/sest.

3076 tok/schat, coding, long documents
Llama 3.1 8B

Meta

Q6_Kfits8.3 GB57k104k with q8 cache

36tok/sest.

474 tok/schat, coding
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits1.7 GB32k

440tok/sest.

6438 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits2.0 GB256k

298tok/sest.

4430 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits2.6 GB256k

179tok/sest.

1817 tok/schat, coding, agents, long documents
LFM3 1.7B

Liquid AI

Q8_0fits3.0 GB256k

142tok/sest.

2334 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits3.1 GB128k

130tok/sest.

2026 tok/schat, coding, long documents
MiniCPM5 2B

openbmb

Q8_0fits4.0 GB128k

92tok/sest.

1339 tok/schat, coding, agents, long documents
LFM2.5 2.6B

Liquid AI

Q8_0fits4.3 GB128k

82tok/sest.

1348 tok/schat, coding, agents, long documents
LFM2.5 VL 3B

Liquid AI

Q8_0fits4.3 GB32k

82tok/sest.

1190 tok/schat, coding, agents, long documents
Spark X2.5 4B

XHToken

mlx-4bitfits4.3 GB263k441k with q8 cache

82tok/sest.

953 tok/schat, coding, agents, long documents
Kimi VL A3B Thinking 2506

Moonshot AI

Q4_K_Mfits11.2 GB109k128k with q8 cache

76tok/sest.

1250 tok/schat, coding, long documents
granite vision 4.1 4b

IBM

Q8_0fits5.1 GB122k128k with q8 cache

65tok/sest.

892 tok/schat, coding
Ministral 3 3B Instruct 2512

Mistral AI

Q8_0fits5.4 GB95k172k with q8 cache

61tok/sest.

914 tok/schat, coding, agents
granite 4.2 3b

IBM

Q8_0fits5.4 GB119k128k with q8 cache

61tok/sest.

959 tok/schat, coding, agents
Kimi VL A3B

Moonshot AI

mlx-6bitfits14.3 GB23k37k with q8 cache

60tok/sest.

1173 tok/schat, coding, agents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q8_0fits13.3 GB83k125k with q8 cache

59tok/sest.

1482 tok/schat, coding, agents, long documents
FrogNano 4B 2609

Microsoft

Q8_0fits5.7 GB251k256k with q8 cache

56tok/sest.

876 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q8_0fits9.1 GB101k128k with q8 cache

32tok/sest.

511 tok/schat, coding
GLM 4 9B 0414

Z.ai

mlx-5bitfits9.1 GB32k

32tok/sest.

402 tok/schat, coding
DeepSeek R1 Distill Llama 8B

DeepSeek

Q8_0fits10.1 GB43k79k with q8 cache

29tok/sest.

474 tok/schat, coding
Ministral 3 8B Reasoning 2512

Mistral AI

Q8_0fits10.6 GB38k69k with q8 cache

27tok/sest.

429 tok/schat, coding
GLM 4.6V Flash

Z.ai

Q8_0fits10.8 GB97k128k with q8 cache

27tok/sest.

371 tok/schat, coding
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitfits12.4 GB60k64k with q8 cache

23tok/sest.

371 tok/schat, coding
Ministral 3 14B Reasoning 2512

Mistral AI

Q6_Kfits12.7 GB20k37k with q8 cache

22tok/sest.

282 tok/schat
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q6_Kfits13.9 GB12k22k with q8 cache

20tok/sest.

257 tok/schat
Qwen 3.8 27B

Alibaba Qwen

UD-Q4_K_Moffload17.1 GB–

10tok/sest.

138 tok/s–
Qwen 3.5 122B-A10B

Alibaba Qwen

UD-Q2_K_XLoffload40.4 GB–

12tok/sest.

243 tok/s–
Qwen 3.6 27B

Alibaba Qwen

Q4_K_Moffload17.4 GB–

10tok/sest.

136 tok/s–
Gemma 4 31B

Google

Q4_K_Moffload19.6 GB–

7tok/sest.

111 tok/s–
Mistral Small 4 119B

Mistral AI

UD-Q2_K_XLoffload38.8 GB–

18tok/sest.

322 tok/schat
Qwen 3.6 35B-A3B

Alibaba Qwen

MXFP4offload21.6 GB–

34tok/sest.

1036 tok/schat, coding
Qwen 3.5 27B

Alibaba Qwen

Q4_K_Moffload17.4 GB–

10tok/sest.

137 tok/s–
Gemma 4 26B-A4B

Google

MXFP4offload16.9 GB–

36tok/sest.

906 tok/schat, coding
Qwen 3.5 35B-A3B

Alibaba Qwen

Q4_K_Moffload21.9 GB–

33tok/sest.

1029 tok/schat, coding
GLM 4.7 Flash

Z.ai

Q4_K_Moffload18.6 GB–

25tok/sest.

629 tok/schat
Devstral Small 2 24B

Mistral AI

Q4_K_Moffload15.7 GB2k3k with q8 cache

14tok/sest.

164 tok/s–
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

MXFP4offload22.9 GB–

28tok/sest.

1048 tok/schat, coding, long documents
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q4_K_Moffload19.2 GB–

32tok/sest.

800 tok/schat
Kimi Linear 48B-A3B

Moonshot AI

Q4_K_Moffload29.2 GB–

27tok/sest.

850 tok/schat, coding
Qwen3 32B

Alibaba Qwen

Q4_K_Moffload21.6 GB–

5tok/sest.

93 tok/s–
Mistral Small 3.2 24B

Mistral AI

Q4_K_Moffload15.7 GB2k3k with q8 cache

14tok/sest.

164 tok/s–
Gemma 3 27B

Google

Q4_K_Moffload17.6 GB–

9tok/sest.

137 tok/s–
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q4_K_Moffload21.6 GB–

5tok/sest.

97 tok/s–
LFM2.5 24B A2B

Liquid AI

Q4_K_Moffload16.1 GB–

63tok/sest.

1533 tok/schat, coding
Devstral Small 2507

Mistral AI

Q4_K_Moffload15.7 GB2k3k with q8 cache

14tok/sest.

166 tok/s–
Magistral Small 2506

Mistral AI

Q4_K_Moffload15.7 GB2k3k with q8 cache

14tok/sest.

166 tok/s–
Magistral Small 2507

Mistral AI

Q4_K_Moffload15.7 GB2k3k with q8 cache

14tok/sest.

166 tok/s–
Magistral Small 2509

Mistral AI

Q4_K_Moffload15.7 GB2k3k with q8 cache

14tok/sest.

164 tok/s–
Muse Glimmer 30B

meta-models

Q4_K_Moffload17.4 GB–

10tok/sest.

126 tok/s–
granite 4.2 30b

IBM

Q4_K_Moffload19.9 GB–

6tok/sest.

115 tok/s–
Qwen3.8 27B OBLITERATED

OBLITERATUS

mlx-4bitoffload21.0 GB–

6tok/sest.

123 tok/s–
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLwon't run92.0 GB––––
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLwon't run102.6 GB––––
Qwen 3.8 Flash Next

Alibaba Qwen

UD-Q2_K_XLwon't run74.9 GB––––
MiniMax M2.7

MiniMax

UD-Q2_K_XLwon't run73.2 GB––––
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q2_K_XLwon't run52.3 GB––––
Qwen3 Coder Next

Alibaba Qwen

Q4_K_Mwon't run46.6 GB––––
gpt-oss 120B

OpenAI

Q4_K_Mwon't run59.9 GB––––
GLM 4.5 Air

Z.ai

Q2_Kwon't run44.8 GB––––
Qwen3 Next 80B-A3B

Alibaba Qwen

Q4_K_Mwon't run46.6 GB––––
Llama 3.3 70B

Meta

Q4_K_Mwon't run43.2 GB––––
DeepSeek R1

DeepSeek

Q4_K_Mwon't run378.3 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run378.8 GB––––
DeepSeek R1 Distill Llama 70B

DeepSeek

Q4_K_Mwon't run43.2 GB––––
DeepSeek R1 Zero

DeepSeek

Q4_K_Mwon't run378.3 GB––––
DeepSeek V3

DeepSeek

Q4_K_Mwon't run378.3 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run378.3 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run379.2 GB––––
DeepSeek V3.1 Terminus

DeepSeek

Q4_K_Mwon't run379.2 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run379.2 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run147.5 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run156.2 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q4_K_Mwon't run73.7 GB––––
GLM 4.5

Z.ai

Q4_K_Mwon't run205.6 GB––––
GLM 4.5V

Z.ai

Q4_K_Mwon't run61.8 GB––––
GLM 4.6

Z.ai

Q4_K_Mwon't run204.8 GB––––
GLM 4.6V

Z.ai

Q4_K_Mwon't run68.2 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run205.6 GB––––
GLM 5

Z.ai

MXFP4won't run384.2 GB––––
GLM 5.1

Z.ai

MXFP4won't run421.8 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run435.7 GB––––
GLM 5.3

Z.ai

Q8_0won't run748.2 GB––––
Kimi Dev 72B

Moonshot AI

Q6_Kwon't run63.6 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run579.8 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run580.3 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run580.3 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run580.3 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run131.9 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run131.9 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run118.4 GB––––
MiniMax M3

MiniMax

MXFP4won't run241.8 GB––––
Mistral Medium 3.5 128B

Mistral AI

Q4_K_Mwon't run73.7 GB––––

Specifications

From the manufacturer's published specifications; sources are linked where we have them.

GPU
GeForce RTX 5060
Memory
8 GB GDDR7
Memory bus
128-bit
Memory bandwidth
448 GB/s
FP16 compute
19.177 TFLOPS
Software
CUDA
Board power
145 W
PCIe generation
Gen 5
PCIe lanes
x8

Compare with

Questions

How much memory does the NVIDIA GeForce RTX 5060 have for AI models?
The NVIDIA GeForce RTX 5060 has 8 GB of GDDR7 memory with 448 GB/s of bandwidth, which sets how fast it generates text.
What is the best model the NVIDIA GeForce RTX 5060 can run locally?
gpt-oss 20B (MXFP4) fits fully in its memory at 8k context and generates at about 63 tok/s, an estimate from its memory bandwidth. 38 of the 129 models we track fit at that context.
Can the NVIDIA GeForce RTX 5060 run DeepSeek V4 Flash?
No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 92 GB at 8k context, more than the NVIDIA GeForce RTX 5060 and system RAM can hold.
How much does the NVIDIA GeForce RTX 5060 cost in Canada?
The best new price for the NVIDIA GeForce RTX 5060 in Canada is $660 at Amazon; used, it starts at $575 (asking price).

Speeds on this page are for 8k context. See the best hardware for local AI at every budget.

More hardware for local AI