Best Local LLMs for the AMD Radeon RX 7900 XT

Written by Jakub Rusinowski · Last updated July 12, 2026

Best all-round pick: Gemma 4 27B ⭐

The AMD Radeon RX 7900 XT has 20 GB of VRAM, of which about 20 GB is available to a model. The largest model it can hold is Gemma 4 31B (31B, 19.5 GB at Q4_K_M).

Best models overall on the AMD Radeon RX 7900 XT

ModelScoreMemory at Q4_K_MContextLicence
Gemma 4 27B ⭐97.417.1 GB125KGemma License (commercial OK)
Mistral Small 3.1 24B95.915 GB125KApache 2.0
Gemma 4 31B94.819.5 GB250KApache-2.0
Qwen 3 30B-A3B (MoE)9419.2 GB125KApache 2.0
Gemma 3 27B Instruct93.817.1 GB128KGemma
Qwen 3.6 27B93.717.6 GB256KApache-2.0

Best model by what you are doing

WorkloadRecommended on this GPU
CodingGemma 4 31B (97.4)
Gemma 4 27B ⭐ (96.8)
Qwen 3.6 27B (96.8)
General assistantGemma 4 27B ⭐ (97.4)
Mistral Small 3.1 24B (95.9)
Gemma 4 31B (94.8)
ReasoningGemma 4 27B ⭐ (100)
Gemma 4 31B (97.8)
Qwen 3.6 27B (96.5)
RAGGemma 4 31B (97.5)
Qwen 3.6 27B (96.7)
Ternary Bonsai 27B (90.2)
AgentsTernary Bonsai 27B (94)
GLM-4.7-Flash 30B-A3B (90.4)
GLM-6 9B (84)
VisionGemma 4 31B (97.8)
Gemma 4 27B ⭐ (96.8)
Mistral Small 3.1 24B (95.2)

What the AMD Radeon RX 7900 XT cannot run

These models are strong picks generally but exceed the 20 GB this card makes available.

ModelNeeds at Q4_K_MShort by
Qwen 3.7 35B-A3B22 GB~2 GB
Nemotron 70B Instruct43.5 GB~23.5 GB
Qwen 3.6 35B-A3B22 GB~2 GB
Kimi K2.620.2 GB~0.2 GB

How these numbers are calculated

FAQ

What is the best LLM for the AMD Radeon RX 7900 XT?

Gemma 4 27B ⭐ is the strongest all-round pick that fits its 20 GB.

What is the largest model the AMD Radeon RX 7900 XT can run?

Gemma 4 31B — 31B parameters, needing 19.5 GB at Q4_K_M.

How much of the AMD Radeon RX 7900 XT's memory can a model actually use?

About 20 GB of its 20 GB, before the desktop and runtime overhead are accounted for.

Compatibility Checks for the AMD Radeon RX 7900 XT

Similar GPUs

By Workload

More

← All GPUs | AMD Radeon RX 7900 XT specs