Best local LLMs by VRAM

Best LLMs for 64 GB

Pick your memory. We rank every catalogued model that fits at its recommended quantization, by task, and show what the next tier up unlocks.

Written by Jakub Rusinowski · Last updated

Memory tier64 GBFor example M1 Max, M5 Pro, RTX PRO 5000 Blackwell (72 GB)
Models that fit143entirely in memory
Best overall98Qwen 2.5 72B Instruct
Largest that fits48.3 GBQwen3-Coder-Next (80B-A3B MoE)

Best at 64 GB, by task

Score is the task-specific quality score on a 0–100 scale; speed is estimated for the M1 Max.

The strongest that fit

Top 15, by logic and coding

ModelVRAMSpeed on M1 Max (est.)Score
Qwen 2.5 72B Instruct
Qwen 2.5 Family · Q4_K_M
43.5 GB~5 tok/s98
Qwen 2.5 Coder 32B
Qwen 2.5 Family · Q4_K_M
19.3 GB~10 tok/s97
Llama 3.3 70B Instruct
Llama 3.3 · Q2_K_XS (Tight)
20.2 GB~10 tok/s97
Qwen 3 32B
Qwen 3 · Q4_K_M
19.8 GB~10 tok/s97
DeepSeek R1 Distill Qwen 32B
DeepSeek R1 · Q4_K_M
19.3 GB~10 tok/s96
Qwen 2.5 14B Instruct
Qwen 2.5 Family · Q4_K_M
8.5 GB~22 tok/s95
Nemotron 70B Instruct
Nemotron 70B · Q4_K_M
42.6 GB~5 tok/s94
Qwen 3 14B
Qwen 3 · Q4_K_M
8.9 GB~21 tok/s94
Codestral 22B
Codestral · Q4_K_M
13.4 GB~15 tok/s93
Qwen 3.6 35B-A3B
Qwen 3.6 · Q4_K_M
21.1 GB~84 tok/s93
DeepSeek R1 Distill Qwen 14B
DeepSeek R1 · Q4_K_M
8.5 GB~22 tok/s92
Phi-4 (14B)
Phi-4 Family · Q4_K_M
8.5 GB~22 tok/s92
Gemma 4 31B
Gemma 4 · Q4_K_M
18.7 GB~10 tok/s92
Qwen 2.5 VL 72B Instruct
Qwen 2.5 VL · Q4_K_M
44.3 GB~5 tok/s92
Qwen3-Coder-Next (80B-A3B MoE)
Qwen3-Coder · Q4_K_M
48.3 GB—92

FAQ

What LLMs run well with 64 GB VRAM?

Qwen 2.5 Family, Qwen 2.5 Family, Llama 3.3, Qwen 3, DeepSeek R1 all fit in 64 GB VRAM.

Which GPUs have 64 GB VRAM?

Apple M1 Max, Apple M5 Pro, NVIDIA RTX PRO 5000 Blackwell (72 GB), NVIDIA A100 80GB (PCIe).

All tiers at a glance

MemoryModels fitBest overall
4 GB32Gemma 3 4B Instruct
6 GB56Granite 3.0 8B Instruct
8 GB71Granite 3.0 8B Instruct
10 GB83Qwen 2.5 14B Instruct
12 GB85Qwen 2.5 14B Instruct
16 GB95Qwen 2.5 14B Instruct
20 GB111Qwen 2.5 14B Instruct
24 GB131Qwen 2.5 Coder 32B
32 GB132Qwen 2.5 Coder 32B
48 GB138Qwen 2.5 72B Instruct
64 GB143Qwen 2.5 72B Instruct
80 GB152Qwen 2.5 72B Instruct