Best local LLMs by VRAM

Best LLMs for 20 GB

Pick your memory. We rank every catalogued model that fits at its recommended quantization, by task, and show what the next tier up unlocks.

Written by Jakub Rusinowski · Last updated

Memory tier20 GBFor example RX 7900 XT, RX 7900 XTX, RTX 3090
Models that fit111entirely in memory
Best overall95Qwen 2.5 14B Instruct
Largest that fits18.7 GBGemma 4 31B

Best at 20 GB, by task

Score is the task-specific quality score on a 0–100 scale; speed is estimated for the RX 7900 XT.

The strongest that fit

Top 15, by logic and coding

ModelVRAMSpeed on RX 7900 XT (est.)Score
Qwen 2.5 14B Instruct
Qwen 2.5 Family · Q4_K_M
8.5 GB~47 tok/s95
Qwen 3 14B
Qwen 3 · Q4_K_M
8.9 GB~46 tok/s94
Codestral 22B
Codestral · Q4_K_M
13.4 GB~32 tok/s93
DeepSeek R1 Distill Qwen 14B
DeepSeek R1 · Q4_K_M
8.5 GB~48 tok/s92
Phi-4 (14B)
Phi-4 Family · Q4_K_M
8.5 GB~47 tok/s92
Gemma 4 31B
Gemma 4 · Q4_K_M
18.7 GB—92
Gemma 3 27B Instruct
Gemma 3 · Q4_K_M
16.3 GB~27 tok/s92
Mistral Small 3.1 24B
Mistral Small 3.1 · Q4_K_M
14.2 GB~31 tok/s91
Qwen 3.6 27B
Qwen 3.6 · Q4_K_M
16.8 GB~27 tok/s91
InternLM 3 20B Instruct
InternLM 3 · Q4_K_M
12.1 GB~35 tok/s91
Qwen3.8 27B
Qwen3.8 · Q4_K_M
16.8 GB~27 tok/s91
Mistral Small 3 (24B)
Mistral Family · Q4_K_M
14.5 GB~30 tok/s90
Qwen 3 30B-A3B (MoE)
Qwen 3 · Q4_K_M
18.4 GB~123 tok/s90
Granite 3.0 8B Instruct
Granite 3.0 · Q4_K_M
4.8 GB~71 tok/s90
GLM-4.7-Flash 30B-A3B
GLM-4.7 / GLM-Z1 · Q4_K_M
18.1 GB~115 tok/s90

FAQ

What LLMs run well with 20 GB VRAM?

Qwen 2.5 Family, Qwen 3, Codestral, DeepSeek R1, Phi-4 Family all fit in 20 GB VRAM.

Which GPUs have 20 GB VRAM?

AMD Radeon RX 7900 XT, AMD Radeon RX 7900 XTX, NVIDIA GeForce RTX 3090, NVIDIA GeForce RTX 4090.

All tiers at a glance

MemoryModels fitBest overall
4 GB32Gemma 3 4B Instruct
6 GB56Granite 3.0 8B Instruct
8 GB71Granite 3.0 8B Instruct
10 GB83Qwen 2.5 14B Instruct
12 GB85Qwen 2.5 14B Instruct
16 GB95Qwen 2.5 14B Instruct
20 GB111Qwen 2.5 14B Instruct
24 GB131Qwen 2.5 Coder 32B
32 GB132Qwen 2.5 Coder 32B
48 GB138Qwen 2.5 72B Instruct
64 GB143Qwen 2.5 72B Instruct
80 GB152Qwen 2.5 72B Instruct