Can I Run Gemma 3 on NVIDIA GeForce RTX 5090?

Written by Jakub Rusinowski · Last updated June 15, 2026

Yes — the Gemma 3 family runs on the NVIDIA GeForce RTX 5090.

NVIDIA GeForce RTX 5090 Specs

VRAM32 GB
Memory Bandwidth1792 GB/s

Gemma 3 Variants That Fit

Gemma 3 27B InstructQ4_K_M · 16.5 GB · ~109 tok/s (est.)
Gemma 3 12B InstructQ4_K_M · 8.1 GB · ~221 tok/s (est.)
Gemma 3 4B InstructQ4_K_M · 3.8 GB · ~400 tok/s (est.)
Gemma 3 1B InstructQ4_K_M · 0.9 GB · ~400 tok/s (est.)

FAQ

Can I run Gemma 3 on the NVIDIA GeForce RTX 5090?

Yes — the Gemma 3 family runs on the NVIDIA GeForce RTX 5090.

Which Gemma 3 variant fits best on the NVIDIA GeForce RTX 5090?

Gemma 3 27B Instruct at Q4_K_M quantization (16.5 GB), estimated ~109 tokens/sec.

← Can I Run It? | Gemma 3 Model Page | NVIDIA GeForce RTX 5090 GPU Page | Check Your Hardware