Can I Run Gemma 4 on NVIDIA GeForce RTX 5090?

Written by Jakub Rusinowski · Last updated June 15, 2026

Yes — the Gemma 4 family runs on the NVIDIA GeForce RTX 5090.

NVIDIA GeForce RTX 5090 Specs

VRAM	32 GB
Memory Bandwidth	1792 GB/s

Gemma 4 Variants That Fit

Gemma 4 31B	Q4_K_M · 18 GB · ~100 tok/s (est.)
Gemma 4 26B-A4B	Q4_K_M · 16 GB · ~400 tok/s (est.)
Gemma 4 12B (Unified)	Q4_K_M · 10 GB · ~179 tok/s (est.)
Gemma 4 E4B	Q4 (QAT) · 5.5 GB · ~326 tok/s (est.)
Gemma 4 E2B	Q4 (QAT) · 5 GB · ~358 tok/s (est.)

FAQ

Can I run Gemma 4 on the NVIDIA GeForce RTX 5090?

Yes — the Gemma 4 family runs on the NVIDIA GeForce RTX 5090.

Which Gemma 4 variant fits best on the NVIDIA GeForce RTX 5090?

Gemma 4 31B at Q4_K_M quantization (18 GB), estimated ~100 tokens/sec.

← Can I Run It? | Gemma 4 Model Page | NVIDIA GeForce RTX 5090 GPU Page | Check Your Hardware