Can I Run Gemma 2 Family on NVIDIA GeForce RTX 4080 Super?

作者： Jakub Rusinowski · 最后更新： 2026年6月15日

Yes — the Gemma 2 Family family runs on the NVIDIA GeForce RTX 4080 Super.

NVIDIA GeForce RTX 4080 Super Specs

VRAM	16 GB
Memory Bandwidth	736 GB/s

Gemma 2 Family Variants That Fit

Gemma 2 9B IT

Q4_K_M · 6.8 GB · ~108 tok/s (est.)

FAQ

Can I run Gemma 2 Family on the NVIDIA GeForce RTX 4080 Super?

Yes — the Gemma 2 Family family runs on the NVIDIA GeForce RTX 4080 Super.

Which Gemma 2 Family variant fits best on the NVIDIA GeForce RTX 4080 Super?

Gemma 2 9B IT at Q4_K_M quantization (6.8 GB), estimated ~108 tokens/sec.

← Can I Run It? | Gemma 2 Family Model Page | NVIDIA GeForce RTX 4080 Super GPU Page | Check Your Hardware