Best LLMs for 6 GB
Pick your memory. We rank every catalogued model that fits at its recommended quantization, by task, and show what the next tier up unlocks.
Written by Jakub Rusinowski · Last updated
Memory tier6 GBFor example RTX 5050, RTX 5060, RTX 4060
Models that fit56entirely in memory
Best at 6 GB, by task
Score is the task-specific quality score on a 0–100 scale; speed is estimated for the RTX 5050.
CodingAll ranked →
1Granite 3.0 8B InstructQ4_K_M · 4.8 GB922Qwen 2.5 7B InstructQ4_K_M · 4.6 GB903StarCoder 2 7BQ4_K_M · 4.3 GB90ReasoningAll ranked →
1DeepSeek R1 Distill Llama 8BQ4_K_M · 4.8 GB922Qwen 3 8BQ4_K_M · 5 GB9031-bit Bonsai 27B1-bit (binary, ~1.125 bpw) · 3.8 GB87The strongest that fit
Top 15, by logic and coding
| Model | Memory · marker = 6 GB | VRAM | Speed on RTX 5050 (est.) | Score |
|---|---|---|---|---|
| Granite 3.0 8B Instruct Granite 3.0 · Q4_K_M | 4.8 GB | ~45 tok/s | 90 | |
| Qwen 2.5 7B Instruct Qwen 2.5 Family · Q4_K_M | 4.6 GB | ~50 tok/s | 89 | |
| Qwen 3 8B Qwen 3 · Q4_K_M | 5 GB | ~44 tok/s | 89 | |
| DeepSeek R1 Distill Llama 8B DeepSeek R1 · Q4_K_M | 4.8 GB | ~46 tok/s | 89 | |
| 1-bit Bonsai 27B Bonsai 27B · 1-bit (binary, ~1.125 bpw) | 3.8 GB | ~52 tok/s | 86 | |
| Llama 3.1 8B Instruct Llama 3.1 Family · Q4_K_M | 4.8 GB | ~46 tok/s | 83 | |
| Granite 4.1 8B IBM Granite 4.1 · Q4_K_M | 4.8 GB | ~45 tok/s | 83 | |
| EXAONE 3.5 7.8B EXAONE 3.5 · Q4_K_M | 4.7 GB | ~46 tok/s | 82 | |
| Ministral 8B Ministral · Q4_K_M | 4.8 GB | ~45 tok/s | 82 | |
| Qwen 2.5 VL 7B Instruct Qwen 2.5 VL · Q4_K_M | 5 GB | ~46 tok/s | 81 | |
| StarCoder 2 7B StarCoder 2 · Q4_K_M | 4.3 GB | ~52 tok/s | 81 | |
| Gemma 3 4B Instruct Gemma 3 · Q4_K_M | 2.4 GB | ~83 tok/s | 80 | |
| Falcon 3 7B Instruct Falcon 3 · Q4_K_M | 4.5 GB | ~49 tok/s | 80 | |
| Gemma 4 E4B Gemma 4 · Q4 (QAT) | 4.5 GB | ~48 tok/s | 80 | |
| Phi-4 Mini (3.8B) Phi-4 Mini · Q4_K_M | 2.3 GB | ~79 tok/s | 79 |
What 8 GB unlocks
The strongest models that need the next tier up.
FAQ
What LLMs run well with 6 GB VRAM?
Granite 3.0, Qwen 2.5 Family, Qwen 3, DeepSeek R1, Bonsai 27B all fit in 6 GB VRAM.
Which GPUs have 6 GB VRAM?
NVIDIA GeForce RTX 5050, NVIDIA GeForce RTX 5060, NVIDIA GeForce RTX 4060, AMD Radeon RX 9060 XT 8GB.
All tiers at a glance
| Memory | Models fit | Best overall | Largest that fits |
|---|---|---|---|
| 4 GB | 32 | Gemma 3 4B Instruct | Gemma 3 4B Instruct · 2.4 GB |
| 6 GB | 56 | Granite 3.0 8B Instruct | Qwen 2.5 VL 7B Instruct · 5 GB |
| 8 GB | 71 | Granite 3.0 8B Instruct | Falcon 3 10B Instruct · 6.2 GB |
| 10 GB | 83 | Qwen 2.5 14B Instruct | Qwen 3 14B · 8.9 GB |
| 12 GB | 85 | Qwen 2.5 14B Instruct | StarCoder 2 15B · 9.4 GB |
| 16 GB | 95 | Qwen 2.5 14B Instruct | Mistral Small 3 (24B) · 14.5 GB |
| 20 GB | 111 | Qwen 2.5 14B Instruct | Gemma 4 31B · 18.7 GB |
| 24 GB | 131 | Qwen 2.5 Coder 32B | Qwen 3.6 35B-A3B · 21.1 GB |
| 32 GB | 132 | Qwen 2.5 Coder 32B | Qwen 3.6 35B-A3B · 21.1 GB |
| 48 GB | 138 | Qwen 2.5 72B Instruct | Qwen 2.5 VL 72B Instruct · 44.3 GB |
| 64 GB | 143 | Qwen 2.5 72B Instruct | Qwen3-Coder-Next (80B-A3B MoE) · 48.3 GB |
| 80 GB | 152 | Qwen 2.5 72B Instruct | Qwen 3.5 122B-A10B · 73.7 GB |
Buy this hardware Intel Arc B570 10GB — 10 GB VRAM · 150 W board powerDeploy in the cloud now RTX 4090 on RunPod — from $0.34/hr · rate checked 2026-07
or compare on Vast.ai from $0.35/hr (typical low · varies)
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
Can-I-Run Pages Near 6 GB
- BitNet b1.58 on NVIDIA GeForce RTX 5060 Ti 8GB
- BitNet b1.58 on NVIDIA GeForce RTX 5060
- BitNet b1.58 on NVIDIA GeForce RTX 4060
- DeepSeek R1 on NVIDIA GeForce RTX 5060 Ti 8GB
- DeepSeek R1 on NVIDIA GeForce RTX 5060
- DeepSeek R1 on NVIDIA GeForce RTX 4060
- DeepSeek R1 on NVIDIA GeForce RTX 3070 Ti
- DeepSeek R1 on NVIDIA GeForce RTX 3070