Best local LLMs by VRAM
Pick your memory. We rank every catalogued model that fits at its recommended quantization, by task, and show what the next tier up unlocks.
All tiers at a glance
| Memory | Models fit | Best overall | Largest that fits |
|---|---|---|---|
| 4 GB | 32 | Gemma 3 4B Instruct | Gemma 3 4B Instruct · 2.4 GB |
| 6 GB | 56 | Granite 3.0 8B Instruct | Qwen 2.5 VL 7B Instruct · 5 GB |
| 8 GB | 71 | Granite 3.0 8B Instruct | Falcon 3 10B Instruct · 6.2 GB |
| 10 GB | 83 | Qwen 2.5 14B Instruct | Qwen 3 14B · 8.9 GB |
| 12 GB | 85 | Qwen 2.5 14B Instruct | StarCoder 2 15B · 9.4 GB |
| 16 GB | 95 | Qwen 2.5 14B Instruct | Mistral Small 3 (24B) · 14.5 GB |
| 20 GB | 111 | Qwen 2.5 14B Instruct | Gemma 4 31B · 18.7 GB |
| 24 GB | 131 | Qwen 2.5 Coder 32B | Qwen 3.6 35B-A3B · 21.1 GB |
| 32 GB | 132 | Qwen 2.5 Coder 32B | Qwen 3.6 35B-A3B · 21.1 GB |
| 48 GB | 138 | Qwen 2.5 72B Instruct | Qwen 2.5 VL 72B Instruct · 44.3 GB |
| 64 GB | 143 | Qwen 2.5 72B Instruct | Qwen3-Coder-Next (80B-A3B MoE) · 48.3 GB |
| 80 GB | 152 | Qwen 2.5 72B Instruct | Qwen 3.5 122B-A10B · 73.7 GB |