Can I run it?
Every model and GPU pair we check, with a verdict at the recommended quantization. Pick your card to see what runs on it, then open a pair for VRAM by quantization, context limits and speed.
Written by Jakub Rusinowski · Last updated
- DeepSeek-R1-Distill-Qwen-32B on NVIDIA GeForce RTX 5090Runs
- DeepSeek-R1-Distill-Qwen-14B on NVIDIA GeForce RTX 5080Runs
- DeepSeek-R1-Distill-Qwen-14B on NVIDIA GeForce RTX 5070 TiRuns
- DeepSeek-R1-Distill-Qwen-14B on NVIDIA GeForce RTX 5070Runs
- DeepSeek-R1-Distill-Qwen-14B on NVIDIA GeForce RTX 5060 Ti 16GBRuns
- DeepSeek-R1-Distill-Llama-8B on NVIDIA GeForce RTX 5060 Ti 8GBRuns
- DeepSeek-R1-Distill-Llama-8B on NVIDIA GeForce RTX 5060Runs
- DeepSeek-R1-Distill-Qwen-32B on NVIDIA GeForce RTX 4090Runs
- All 38 DeepSeek R1 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 4090Runs
- on NVIDIA GeForce RTX 4080 SuperToo big
- on NVIDIA GeForce RTX 4080Too big
- All 35 Llama 3.3 pairings →
- on NVIDIA GeForce RTX 5090Offload
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 4090Offload
- on NVIDIA GeForce RTX 4080 SuperToo big
- on NVIDIA GeForce RTX 4080Too big
- All 44 Command R Family pairings →
- on NVIDIA GeForce RTX 5080Runs
- on NVIDIA GeForce RTX 5070 TiRuns
- on NVIDIA GeForce RTX 5070Runs
- on NVIDIA GeForce RTX 5060 Ti 16GBRuns
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4080 SuperRuns
- on NVIDIA GeForce RTX 4080Runs
- All 27 Phi-4 Family pairings →
- on NVIDIA GeForce RTX 5070Runs
- on NVIDIA GeForce RTX 5060 Ti 8GBOffload
- on NVIDIA GeForce RTX 5060Offload
- on NVIDIA GeForce RTX 4070 TiRuns
- on NVIDIA GeForce RTX 4070 SuperRuns
- on NVIDIA GeForce RTX 4070Runs
- on NVIDIA GeForce RTX 4060Offload
- on NVIDIA GeForce RTX 3080 (10GB)Runs
- All 14 Gemma 2 Family pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Offload
- on NVIDIA GeForce RTX 5070 TiOffload
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBOffload
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 38 Mistral Small 3.1 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Offload
- on NVIDIA GeForce RTX 5070 TiOffload
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBOffload
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 38 Codestral pairings →
- on NVIDIA GeForce RTX 5080Runs
- on NVIDIA GeForce RTX 5070 TiRuns
- on NVIDIA GeForce RTX 5060 Ti 16GBRuns
- on NVIDIA GeForce RTX 5060 Ti 8GBOffload
- on NVIDIA GeForce RTX 5060Offload
- on NVIDIA GeForce RTX 4080 SuperRuns
- on NVIDIA GeForce RTX 4080Runs
- on NVIDIA GeForce RTX 4070 Ti SuperRuns
- All 20 OLMo 2 pairings →
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4070 TiToo big
- on NVIDIA GeForce RTX 4070 SuperToo big
- on NVIDIA GeForce RTX 4070Too big
- on NVIDIA GeForce RTX 4060Too big
- on NVIDIA GeForce RTX 3080 (10GB)Too big
- All 20 Qwen3-Coder pairings →
- on NVIDIA GeForce RTX 5070Runs
- on NVIDIA GeForce RTX 5060 Ti 8GBOffload
- on NVIDIA GeForce RTX 5060Offload
- on NVIDIA GeForce RTX 4070 TiRuns
- on NVIDIA GeForce RTX 4070 SuperRuns
- on NVIDIA GeForce RTX 4070Runs
- on NVIDIA GeForce RTX 4060Offload
- on NVIDIA GeForce RTX 3080 (10GB)Runs
- All 23 Llama 3.2 Vision pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 49 Nemotron Cascade 2 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Offload
- on NVIDIA GeForce RTX 5070 TiOffload
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBOffload
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 47 Devstral pairings →
- on NVIDIA GeForce RTX 5090Too big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Too big
- on NVIDIA GeForce RTX 4070 TiToo big
- on NVIDIA GeForce RTX 4070 SuperToo big
- on NVIDIA GeForce RTX 4070Too big
- All 33 GLM-5 / GLM-5.1 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 41 Qwen 3.6 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 41 Poolside Laguna XS 2.1 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 41 IBM Granite 4.0 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Offload
- on NVIDIA GeForce RTX 5070 TiOffload
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBOffload
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 39 Magistral Small pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Offload
- on NVIDIA GeForce RTX 5070 TiOffload
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBOffload
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 38 Mistral Small 3.2 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 39 Nemotron 3 Nano Omni pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 41 Qwen3.8 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 4090Runs
- on NVIDIA GeForce RTX 4080 SuperToo big
- on NVIDIA GeForce RTX 4080Too big
- All 36 Nex-N2.5 pairings →
- on NVIDIA GeForce RTX 5090Runs
- on NVIDIA GeForce RTX 5080Too big
- on NVIDIA GeForce RTX 5070 TiToo big
- on NVIDIA GeForce RTX 5070Too big
- on NVIDIA GeForce RTX 5060 Ti 16GBToo big
- on NVIDIA GeForce RTX 5060 Ti 8GBToo big
- on NVIDIA GeForce RTX 5060Too big
- on NVIDIA GeForce RTX 4090Runs
- All 39 North Mini Code pairings →
By system RAM and by computer
Not everyone is asking about a graphics card. These check the same models against a system-RAM budget for CPU-only inference, or against a specific machine.
8 GB system RAM
16 GB system RAM
24 GB system RAM
32 GB system RAM
48 GB system RAM
64 GB system RAM
96 GB system RAM
128 GB system RAM
192 GB system RAM
256 GB system RAM
MacBook Pro 16" (M4 Max, 128 GB)
MacBook Pro 16" (M4 Max, 48 GB)
MacBook Pro 14" (M4 Pro, 24 GB)
MacBook Air (M4, 16 GB)
MacBook Pro 16" (M5 Max, 128 GB)
Mac Studio (M3 Ultra, 256 GB)
Mac Studio (M4 Max, 64 GB)
Mac mini (M4, 16 GB)
Mac mini (M4 Pro, 64 GB)
Mac Studio (M2 Ultra, 192 GB)
Framework Desktop (Ryzen AI Max+ 395, 128 GB)
Beelink SER9 (Ryzen AI 9, 32 GB)
RTX 5090 Desktop (32 GB VRAM, 64 GB RAM)
RTX 4090 Desktop (24 GB VRAM, 64 GB RAM)
RTX 3090 Desktop (24 GB VRAM, 64 GB RAM)
RTX 5080 Desktop (16 GB VRAM, 32 GB RAM)
RTX 5060 Ti 16 GB Desktop (16 GB VRAM, 32 GB RAM)
RTX 3060 12 GB Desktop (12 GB VRAM, 32 GB RAM)
RTX 4090 Laptop (16 GB VRAM, 32 GB RAM)