AMDDesktop GPUCurrent

AMD Radeon RX 9060 XT 8GB for local LLMs

Name: LLM Configurator — GPU VRAM Checker
Author: LLM Configurator

Written by Jakub Rusinowski · Last updated July 12, 2026

With 8 GB at 320 GB/s, the RX 9060 XT 8GB runs 59 catalogued models at Q4_K_M with 8K context. The largest that fits is K2 Horizon 7B (~7.4 GB), and the top pick is Qwen 3.5 9B at 22–46 tok/s.

Entry-level RDNA 4 card at $299. 8 GB VRAM covers 7–8B models in Q4. Same Navi 44 chip and bandwidth as the 16GB variant.

Check my hardware →Full benchmark table

Models that run on the RX 9060 XT 8GB

Q4_K_M, 8K context, 8 GB usable. Ranked by quality and speed.

Model	VRAM	Speed	Fit
Qwen 3.5 9B Qwen 3.5	6.6 GB	22–46 tok/s	Fits
GLM-4 9B GLM-4.7 / GLM-Z1	6.2 GB	20–41 tok/s	Fits
GLM-4.6V-Flash 9B GLM-4.6V	6.2 GB	20–41 tok/s	Fits
EuroLLM 9B EuroLLM	6.2 GB	20–41 tok/s	Fits
MiMo-V2.6 Distill 9B MiMo-V2.6	6.5 GB	23–47 tok/s	Fits
Ternary Bonsai 2 9B Ternary Bonsai 2	6.5 GB	23–47 tok/s	Fits
InternLM 3 8B Instruct InternLM 3	6.5 GB	22–47 tok/s	Fits
LFM2.5-8B-A1B LFM2.5	5.8 GB	51–106 tok/s	Fits
Qwen 3 8B Qwen 3	7 GB	21–44 tok/s	Fits
Aya Expanse 8B Aya Expanse	6.7 GB	22–45 tok/s	Fits
Ministral 8B Ministral	6.9 GB	21–44 tok/s	Fits
Gemma 4 E4B Gemma 4	5.6 GB	22–45 tok/s	Fits

Showing 12 of 59

Buy it or rent the same memory

Buy the card, or rent a GPU with the same memory by the hour to try models first.

Buy this hardware AMD Radeon RX 9060 XT 8GB — 8 GB VRAM · 150 W board power Deploy in the cloud now RTX 4090 on RunPod — from $0.34/hr · rate checked 2026-07

or compare on Vast.ai from $0.35/hr (typical low · varies)

As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

AMD Radeon RX 9060 XT 8GB

8 GB VRAM · 150 W board power

2026 prices are volatile — check the current listing.

Check price on Amazon

Speed vs other GPUs

Llama 3.1 8B, Q4_K_M. Estimated ranges. How this is calculated

RTX 508074–153 tok/s RTX 5070 Ti70–145 tok/s RTX 5080 Laptop GPU70–145 tok/s RTX 4080 Super68–130 tok/s RTX 408066–127 tok/s RTX 4070 Ti Super63–121 tok/s RTX 507056–116 tok/s RTX 5070 Ti Laptop GPU56–116 tok/s RX 9060 XT 8GB24–49 tok/s

Specifications

Specs last updated 2026-07-12.

Memory: 8 GB
Memory bandwidth: 320 GB/s
Architecture: RDNA 4 Navi 44
Series: RX 9000-series
Board power: 150 W
Release year: 2025
Launch price: $299
Usable for models: 8 GB

Best for8B modelsbudget AMD

Recommended first model (Ollama)

Frequently asked questions

Can the AMD Radeon RX 9060 XT 8GB run local LLMs?

Yes. With 8 GB (8 GB usable by a model) it runs 59 of the catalogued models at Q4_K_M with 8K context; the largest is K2 Horizon 7B, needing about 7.4 GB.

How fast is the AMD Radeon RX 9060 XT 8GB for AI inference?

It is estimated to run Llama 3.1 8B at 24–49 tok/s at Q4_K_M. Llama 3.3 70B does not fit: it needs about 44 GB against 8 GB usable. These are modelled estimates from memory bandwidth, not measurements; the methodology page shows the formula.

What LLMs can I run on 8 GB?

Among the best that fit: Qwen 3.5 9B, GLM-4 9B, GLM-4.6V-Flash 9B, EuroLLM 9B, MiMo-V2.6 Distill 9B. The quickest start is Ollama: ollama run llama3.1:8b.

Can I run it on the RX 9060 XT 8GB?

More for this card

Tools

Guides