NVIDIA GeForce RTX 4060 Ti 8GB

8 GB · 288 GB/s · 160 W

In short

The NVIDIA GeForce RTX 4060 Ti 8GB has 8 GB of GDDR6 memory with 288 GB/s of bandwidth, which sets how fast it generates text. At 128k context it runs 5 of the 129 open models we track fully in memory; the most capable is Qwen2.5 0.5B at Q8_0, at about 83 tok/s (estimated). The best new price for the NVIDIA GeForce RTX 4060 Ti 8GB in Canada is $864 at Amazon; used, it starts at $650 (asking price).

Updated . Speeds are estimates; how they are worked out.

Prices

Every retailer we track in Canada, cheapest first. Buy links may earn us a commission.

RetailerConditionPriceStockCheckedBuy
eBayUsed GeForce RTX 4060 Ti 8GB on eBayused, asking price$650In stock5 h agoBuy
eBayMSI GeForce RTX 4060 Ti Ventus 2X Black OC 8GB GDDR6 Graphics Cardused, asking price$766+ $26 deliveryIn stock2 h agoBuy
AmazonASUS Dual GeForce RTX 4060 Ti EVO OC Edition 8GB GDDR6New$864In stock4 h agoBuy
AmazonPNY GeForce RTX 4060 Ti 8GB XLR8 Gaming Verto RGB Triple Fan OC Graphics Card…New$902+ $23 deliveryIn stock4 h agoBuy

Used on eBay: median asking price $650, most between $650 and $766 (5 listings, 2026-11-03). Used price history

Price history

Lowest price shown each day over the last 90 days.

Not enough price history yet.

What it runs

Every model in the catalogue, with the best quant for this hardware. Estimates, not measurements.

ModelQuantFitsMemoryMax contextDecode @128kPrefillGood for
Qwen2.5 0.5B

Alibaba Qwen

Q8_0fits3.4 GB32k

83tok/sest.

1499 tok/schat, coding, long documents
Qwen3.5 0.8B

Alibaba Qwen

Q8_0fits3.7 GB256k

73tok/sest.

1999 tok/schat, coding, agents, long documents
Qwen3.5 2B

Alibaba Qwen

Q5_K_Mfits4.3 GB256k

58tok/sest.

1278 tok/schat, coding, agents, long documents
LFM3 1.7B

Liquid AI

Q8_0fits4.7 GB256k

52tok/sest.

1478 tok/schat, coding, agents, long documents
DeepSeek R1 Distill Qwen 1.5B

DeepSeek

Q8_0fits6.7 GB128k

32tok/sest.

670 tok/schat, coding, long documents
Qwen 3.8 27B

Alibaba Qwen

UD-Q4_K_Moffload24.9 GB–

3tok/sest.

67 tok/s–
Qwen 3.6 27B

Alibaba Qwen

Q4_K_Moffload25.3 GB–

3tok/sest.

67 tok/s–
Gemma 4 31B

Google

Q4_K_Moffload29.3 GB–

2tok/sest.

61 tok/s–
Qwen 3.6 35B-A3B

Alibaba Qwen

MXFP4offload24.2 GB–

9tok/sest.

330 tok/schat
Qwen 3.5 27B

Alibaba Qwen

Q4_K_Moffload25.2 GB–

3tok/sest.

67 tok/s–
Gemma 4 26B-A4B

Google

MXFP4offload19.6 GB–

8tok/sest.

430 tok/schat
Qwen 3.5 35B-A3B

Alibaba Qwen

Q4_K_Moffload24.5 GB–

9tok/sest.

329 tok/schat
GLM 4.7 Flash

Z.ai

Q4_K_Moffload25.1 GB–

4tok/sest.

154 tok/s–
Nemotron 3.5 Lightning 30B-A3B

NVIDIA

MXFP4offload23.9 GB–

13tok/sest.

446 tok/schat
Kimi Linear 48B-A3B

Moonshot AI

Q4_K_Moffload30.5 GB–

13tok/sest.

233 tok/schat
gpt-oss 20B

OpenAI

Q4_K_Moffload15.3 GB–

8tok/sest.

307 tok/schat
Qwen3 Coder 30B-A3B

Alibaba Qwen

Q4_K_Moffload30.7 GB–

3tok/sest.

90 tok/schat
Gemma 4 12B

Google

Q4_K_Moffload10.4 GB–

11tok/sest.

239 tok/schat
Qwen 3.5 9B

Alibaba Qwen

Q4_K_Moffload10.8 GB36k60k with q8 cache

10tok/sest.

279 tok/schat, coding
Gemma 3 27B

Google

Q4_K_Moffload27.3 GB–

2tok/sest.

80 tok/s–
Ministral 3 14B

Mistral AI

Q4_K_Moffload29.1 GB–

2tok/sest.

74 tok/s–
Qwen3 14B

Alibaba Qwen

Q4_K_Moffload29.8 GB–

2tok/sest.

63 tok/s–
DeepSeek R1 0528 Qwen3 8B

DeepSeek

Q4_K_Moffload24.1 GB13k25k with q8 cache

3tok/sest.

101 tok/schat
Qwen3 8B

Alibaba Qwen

Q4_K_Moffload24.1 GB13k25k with q8 cache

3tok/sest.

101 tok/schat
Qwen 3.5 4B

Alibaba Qwen

Q4_K_Moffload8.0 GB110k182k with q8 cache

21tok/sest.

522 tok/schat, coding, long documents
Ministral 3 8B

Mistral AI

Q4_K_Moffload23.3 GB13k24k with q8 cache

3tok/sest.

103 tok/schat
Granite 4.2 8B

IBM

Q4_K_Moffload26.6 GB9k17k with q8 cache

2tok/sest.

89 tok/schat
Gemma 4 E4B

Google

Q4_K_Moffload9.6 GB61k100k with q8 cache

13tok/sest.

418 tok/schat, coding
LFM2.5 8B-A1B

Liquid AI

UD-Q4_K_Moffload12.4 GB33k56k with q8 cache

7tok/sest.

484 tok/schat, coding
Llama 3.1 8B

Meta

Q4_K_Moffload22.0 GB16k29k with q8 cache

3tok/sest.

113 tok/schat
FrogNano 4B 2609

Microsoft

Q4_K_Moffload8.1 GB109k180k with q8 cache

20tok/sest.

519 tok/schat, coding, agents, long documents
MiniCPM5 2B

openbmb

Q4_K_Moffload8.2 GB110k128k with q8 cache

19tok/sest.

334 tok/schat, coding, agents, long documents
Spark X2.5 4B

XHToken

mlx-4bitoffload8.8 GB93k156k with q8 cache

16tok/sest.

484 tok/schat, coding, agents, long documents
Mellum2.1 12B A2.5B Thinking

JetBrains

Q4_K_Moffload11.5 GB–

15tok/sest.

584 tok/schat, coding
LFM2.5 2.6B

Liquid AI

Q4_K_Moffload10.5 GB79k128k with q8 cache

10tok/sest.

367 tok/schat, coding, agents
LFM2.5 VL 3B

Liquid AI

Q4_K_Moffload10.5 GB32k

10tok/sest.

353 tok/schat, coding, agents
Kimi VL A3B Thinking 2506

Moonshot AI

Q4_K_Moffload15.1 GB–

8tok/sest.

321 tok/schat
GLM 4.6V Flash

Z.ai

Q4_K_Moffload12.2 GB21k35k with q8 cache

8tok/sest.

114 tok/schat, coding
Kimi VL A3B

Moonshot AI

mlx-5bitoffload16.3 GB–

7tok/sest.

229 tok/schat
DeepSeek R1 Distill Qwen 7B

DeepSeek

Q4_K_Moffload12.8 GB38k66k with q8 cache

7tok/sest.

171 tok/schat, coding
GLM 4 9B 0414

Z.ai

mlx-4bitoffload13.0 GB2k4k with q8 cache

7tok/sest.

114 tok/schat
granite vision 4.1 4b

IBM

Q4_K_Moffload13.4 GB56k100k with q8 cache

6tok/sest.

199 tok/schat, coding
granite 4.2 3b

IBM

Q4_K_Moffload13.6 GB54k95k with q8 cache

6tok/sest.

202 tok/schat, coding, agents
Ministral 3 3B Instruct 2512

Mistral AI

Q4_K_Moffload16.4 GB43k78k with q8 cache

5tok/sest.

178 tok/schat, coding, agents
GLM 4.1V 9B Thinking

Z.ai

mlx-8bitoffload17.4 GB–

4tok/sest.

98 tok/s–
Muse Glimmer 30B

meta-models

Q4_K_Moffload19.3 GB–

4tok/sest.

80 tok/s–
LFM2.5 24B A2B

Liquid AI

Q4_K_Moffload25.7 GB–

3tok/sest.

213 tok/schat
DeepSeek R1 Distill Llama 8B

DeepSeek

Q4_K_Moffload22.0 GB16k29k with q8 cache

3tok/sest.

113 tok/schat
Ministral 3 8B Reasoning 2512

Mistral AI

Q4_K_Moffload23.3 GB13k24k with q8 cache

3tok/sest.

103 tok/schat
Qwen3.8 27B OBLITERATED

OBLITERATUS

mlx-4bitoffload28.8 GB–

2tok/sest.

65 tok/s–
Ministral 3 14B Reasoning 2512

Mistral AI

Q4_K_Moffload29.1 GB–

2tok/sest.

74 tok/s–
DeepSeek V4 Flash

DeepSeek

UD-Q2_K_XLwon't run102.4 GB––––
GLM 5.3 Flash

Z.ai

UD-Q2_K_XLwon't run104.2 GB––––
Qwen 3.8 Flash Next

Alibaba Qwen

UD-Q2_K_XLwon't run78.0 GB––––
MiniMax M2.7

MiniMax

UD-Q2_K_XLwon't run102.6 GB––––
Qwen 3.5 122B-A10B

Alibaba Qwen

UD-Q2_K_XLwon't run43.6 GB––––
Nemotron 3 Super 120B-A12B

NVIDIA

UD-Q2_K_XLwon't run53.5 GB––––
Qwen3 Coder Next

Alibaba Qwen

Q4_K_Mwon't run49.7 GB––––
gpt-oss 120B

OpenAI

Q4_K_Mwon't run64.4 GB––––
Mistral Small 4 119B

Mistral AI

UD-Q2_K_XLwon't run41.7 GB––––
GLM 4.5 Air

Z.ai

Q2_Kwon't run66.7 GB––––
Devstral Small 2 24B

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Qwen3 Next 80B-A3B

Alibaba Qwen

Q4_K_Mwon't run49.7 GB––––
Qwen3 32B

Alibaba Qwen

Q4_K_Mwon't run51.9 GB––––
DeepSeek R1 Distill Qwen 32B

DeepSeek

Q4_K_Mwon't run51.9 GB––––
Llama 3.3 70B

Meta

Q4_K_Mwon't run81.1 GB––––
Mistral Small 3.2 24B

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Phi-4 14B

Microsoft

Q4_K_Mwon't run34.7 GB––––
DeepSeek R1

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek R1 0528

DeepSeek

Q4_K_Mwon't run387.2 GB––––
DeepSeek R1 Distill Llama 70B

DeepSeek

Q4_K_Mwon't run81.1 GB––––
DeepSeek R1 Distill Qwen 14B

DeepSeek

Q4_K_Mwon't run33.8 GB––––
DeepSeek R1 Zero

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek V3

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek V3 0324

DeepSeek

Q4_K_Mwon't run386.7 GB––––
DeepSeek V3.1

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V3.1 Terminus

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V3.2

DeepSeek

Q4_K_Mwon't run387.6 GB––––
DeepSeek V4 Flash 0731

DeepSeek

MXFP4won't run157.8 GB––––
DeepSeek V4 Flash Vision Exp

DeepSeek

MXFP4won't run166.6 GB––––
Devstral 2 123B Instruct 2512

Mistral AI

Q4_K_Mwon't run115.2 GB––––
Devstral Small 2507

Mistral AI

Q4_K_Mwon't run34.8 GB––––
GLM 4.5

Z.ai

Q4_K_Mwon't run249.0 GB––––
GLM 4.5V

Z.ai

Q4_K_Mwon't run83.7 GB––––
GLM 4.6

Z.ai

Q4_K_Mwon't run248.2 GB––––
GLM 4.6V

Z.ai

Q4_K_Mwon't run90.1 GB––––
GLM 4.7

Z.ai

Q4_K_Mwon't run249.0 GB––––
GLM 5

Z.ai

MXFP4won't run394.8 GB––––
GLM 5.1

Z.ai

MXFP4won't run432.4 GB––––
GLM 5.2

Z.ai

UD-Q4_K_Mwon't run446.3 GB––––
GLM 5.3

Z.ai

Q8_0won't run758.7 GB––––
Kimi Dev 72B

Moonshot AI

Q6_Kwon't run101.4 GB––––
Kimi K2

Moonshot AI

Q4_K_Mwon't run588.2 GB––––
Kimi K2 Instruct 0905

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Kimi K2 Thinking

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Kimi K2.5

Moonshot AI

Q4_K_Mwon't run588.6 GB––––
Magistral Small 2506

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Magistral Small 2507

Mistral AI

Q4_K_Mwon't run34.8 GB––––
Magistral Small 2509

Mistral AI

Q4_K_Mwon't run34.8 GB––––
MiniMax M2

MiniMax

Q4_K_Mwon't run161.3 GB––––
MiniMax M2.1

MiniMax

Q4_K_Mwon't run161.3 GB––––
MiniMax M2.5

MiniMax

MXFP4won't run147.7 GB––––
MiniMax M3

MiniMax

MXFP4won't run256.1 GB––––
Mistral Medium 3.5 128B

Mistral AI

Q4_K_Mwon't run115.2 GB––––
granite 4.2 30b

IBM

Q4_K_Mwon't run50.2 GB––––

Specifications

From the manufacturer's published specifications; sources are linked where we have them.

GPU
GeForce RTX 4060 Ti 8GB
Memory
8 GB GDDR6
Memory bus
128-bit
Memory bandwidth
288 GB/s
FP16 compute
22.065 TFLOPS
Software
CUDA
Board power
160 W
PCIe generation
Gen 4
PCIe lanes
x8

Compare with

Questions

How much memory does the NVIDIA GeForce RTX 4060 Ti 8GB have for AI models?
The NVIDIA GeForce RTX 4060 Ti 8GB has 8 GB of GDDR6 memory with 288 GB/s of bandwidth, which sets how fast it generates text.
What is the best model the NVIDIA GeForce RTX 4060 Ti 8GB can run locally?
Qwen2.5 0.5B (Q8_0) fits fully in its memory at 128k context and generates at about 83 tok/s, an estimate from its memory bandwidth. 5 of the 129 models we track fit at that context.
Can the NVIDIA GeForce RTX 4060 Ti 8GB run DeepSeek V4 Flash?
No: even at UD-Q2_K_XL, DeepSeek V4 Flash needs about 102 GB at 128k context, more than the NVIDIA GeForce RTX 4060 Ti 8GB and system RAM can hold.
How much does the NVIDIA GeForce RTX 4060 Ti 8GB cost in Canada?
The best new price for the NVIDIA GeForce RTX 4060 Ti 8GB in Canada is $864 at Amazon; used, it starts at $650 (asking price).

Speeds on this page are for 128k context. See the best hardware for local AI at every budget.

More hardware for local AI