Can I Run Command R (35B) on NVIDIA GeForce RTX 5080?

Written by Jakub Rusinowski · Last updated September 29, 2026

No. Command R (35B) needs 32.7 GB at 8K context (21.1 GB weights + 11.6 GB KV cache/overhead) at Q4_K_M and the NVIDIA GeForce RTX 5080 has only 16 GB. No quantization we publish closes a gap that size.

Get a personalized upgrade path →

The numbers

ModelCommand R (35B)
Parameters35B
QuantizationQ4_K_M
VRAM needed (8K context)32.7 GB
NVIDIA GeForce RTX 5080 VRAM16 GB
VerdictDoes not fit

Command R (35B) on the NVIDIA GeForce RTX 5080: VRAM by quantization

QuantVRAM neededFits 16 GB?Max contextWhole PC
F1681.5 GB✗ No——
Q8_048.7 GB✗ No——
Q6_K40.2 GB✗ No——
Q5_K_M36.3 GB✗ No——
Q4_K_M32.7 GB✗ No——
Q3_K_M26.5 GB✗ No——
Q2_K23 GB✗ No——

Assumes an 8K-token context with an f16 KV cache. A longer window needs more; a quantized KV cache needs less. “Max context” is the largest window that still fits in 16 GB. Figures are estimates from parameter count, quantization and memory bandwidth — the analyzer lets you tune KV-cache quant and context.

Context costs VRAM too. At Q4_K_M on the NVIDIA GeForce RTX 5080: 8K 32.7 GB ✗ · 32K 64.9 GB ✗ · 125K 189.7 GB ✗. Past 8K it no longer fits 16 GB — a q8_0 KV cache buys roughly half of that back, which the calculator will price for you.

What to do next

Either step down to a smaller size in this family, or move to a NVIDIA RTX 6000 Ada Generation (48 GB), the card with the least memory we track that holds it.

No compatible GPU? Command R Family on 256 GB of system RAM, CPU only: runs, but too slowly to be worth it.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Cheapest card we track with enough VRAM for Command R (35B):

NVIDIA RTX 6000 Ada Generation 48GB
48 GB VRAM · 300 W board power
2026 prices are volatile — check the current listing.
Check price on Amazon

Won't fit — rent Command R (35B) instead

Command R (35B) needs ~33 GB but this GPU has 16 GB. Rent a A100 (40 GB)-class GPU by the hour instead of buying one:

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

Vast.ai $0.55/hr · typical low · varies
Rent on Vast.ai →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

Other Command R Family sizes on the NVIDIA GeForce RTX 5080

Command R (35B) on nearby hardware

All Command R Family sizes on the NVIDIA GeForce RTX 5080 | Command R (35B) model page | NVIDIA GeForce RTX 5080 GPU page | VRAM calculator | Check your hardware