Best local LLMs by VRAM

Best LLMs for 10 GB

Pick your memory. We rank every catalogued model that fits at its recommended quantization, by task, and show what the next tier up unlocks.

Written by Jakub Rusinowski · Last updated

Memory tier10 GBFor example Intel Arc B570, RTX 3080 (10GB), GTX 1080 Ti
Models that fit83entirely in memory
Best overall95Qwen 2.5 14B Instruct
Largest that fits8.9 GBQwen 3 14B

Best at 10 GB, by task

Score is the task-specific quality score on a 0–100 scale; speed is estimated for the Intel Arc B570.

The strongest that fit

Top 15, by logic and coding

ModelVRAMSpeed on Intel Arc B570 (est.)Score
Qwen 2.5 14B Instruct
Qwen 2.5 Family · Q4_K_M
8.5 GB—95
Qwen 3 14B
Qwen 3 · Q4_K_M
8.9 GB—94
DeepSeek R1 Distill Qwen 14B
DeepSeek R1 · Q4_K_M
8.5 GB~23 tok/s92
Phi-4 (14B)
Phi-4 Family · Q4_K_M
8.5 GB—92
Granite 3.0 8B Instruct
Granite 3.0 · Q4_K_M
4.8 GB~36 tok/s90
Ternary Bonsai 27B
Bonsai 27B · Ternary (1.58-bit, ~1.71 bpw)
5.8 GB~30 tok/s90
Qwen 2.5 7B Instruct
Qwen 2.5 Family · Q4_K_M
4.6 GB~40 tok/s89
Qwen 3 8B
Qwen 3 · Q4_K_M
5 GB~35 tok/s89
DeepSeek R1 Distill Llama 8B
DeepSeek R1 · Q4_K_M
4.8 GB~36 tok/s89
Mistral NeMo 12B
Mistral Family · Q4_K_M
7.2 GB~26 tok/s88
Gemma 3 12B Instruct
Gemma 3 · Q4_K_M
7.2 GB~26 tok/s87
InternLM 3 8B Instruct
InternLM 3 · Q4_K_M
5.3 GB~35 tok/s86
Qwen 3.5 9B
Qwen 3.5 · Q4_K_M
5.4 GB~35 tok/s86
1-bit Bonsai 27B
Bonsai 27B · 1-bit (binary, ~1.125 bpw)
3.8 GB~41 tok/s86
Yi 1.5 9B Chat
Yi 1.5 Family · Q4_K_M
5.3 GB~34 tok/s85

FAQ

What LLMs run well with 10 GB VRAM?

Qwen 2.5 Family, Qwen 3, DeepSeek R1, Phi-4 Family, Granite 3.0 all fit in 10 GB VRAM.

Which GPUs have 10 GB VRAM?

Intel Arc B570, NVIDIA GeForce RTX 3080 (10GB), NVIDIA GeForce GTX 1080 Ti, NVIDIA GeForce RTX 2080 Ti.

All tiers at a glance

MemoryModels fitBest overall
4 GB32Gemma 3 4B Instruct
6 GB56Granite 3.0 8B Instruct
8 GB71Granite 3.0 8B Instruct
10 GB83Qwen 2.5 14B Instruct
12 GB85Qwen 2.5 14B Instruct
16 GB95Qwen 2.5 14B Instruct
20 GB111Qwen 2.5 14B Instruct
24 GB131Qwen 2.5 Coder 32B
32 GB132Qwen 2.5 Coder 32B
48 GB138Qwen 2.5 72B Instruct
64 GB143Qwen 2.5 72B Instruct
80 GB152Qwen 2.5 72B Instruct