Can I Run Gemma 4 on NVIDIA GeForce RTX 4090?

Written by Jakub Rusinowski · Last updated June 15, 2026

Yes — the Gemma 4 family runs on the NVIDIA GeForce RTX 4090.

NVIDIA GeForce RTX 4090 Specs

VRAM	24 GB
Memory Bandwidth	1008 GB/s

Gemma 4 Variants That Fit

Gemma 4 31B	Q4_K_M · 18 GB · ~56 tok/s (est.)
Gemma 4 26B-A4B	Q4_K_M · 16 GB · ~400 tok/s (est.)
Gemma 4 12B (Unified)	Q4_K_M · 10 GB · ~101 tok/s (est.)
Gemma 4 E4B	Q4 (QAT) · 5.5 GB · ~183 tok/s (est.)
Gemma 4 E2B	Q4 (QAT) · 5 GB · ~202 tok/s (est.)

FAQ

Can I run Gemma 4 on the NVIDIA GeForce RTX 4090?

Yes — the Gemma 4 family runs on the NVIDIA GeForce RTX 4090.

Which Gemma 4 variant fits best on the NVIDIA GeForce RTX 4090?

Gemma 4 31B at Q4_K_M quantization (18 GB), estimated ~56 tokens/sec.

← Can I Run It? | Gemma 4 Model Page | NVIDIA GeForce RTX 4090 GPU Page | Check Your Hardware