Can I Run IBM Granite 4.1 on NVIDIA GeForce RTX 3090?

作者： Jakub Rusinowski · 最后更新： 2026年6月15日

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 3090.

NVIDIA GeForce RTX 3090 Specs

VRAM	24 GB
Memory Bandwidth	936 GB/s

IBM Granite 4.1 Variants That Fit

Granite 4.1 30B	FP8 (Q4 est. ~12-15GB, unconfirmed) · 18 GB · ~52 tok/s (est.)
Granite 4.1 8B	Q4_K_M · 5 GB · ~187 tok/s (est.)
Granite 4.1 3B	Q4_K_M · 2 GB · ~400 tok/s (est.)

FAQ

Can I run IBM Granite 4.1 on the NVIDIA GeForce RTX 3090?

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 3090.

Which IBM Granite 4.1 variant fits best on the NVIDIA GeForce RTX 3090?

Granite 4.1 30B at FP8 (Q4 est. ~12-15GB, unconfirmed) quantization (18 GB), estimated ~52 tokens/sec.

← Can I Run It? | IBM Granite 4.1 Model Page | NVIDIA GeForce RTX 3090 GPU Page | Check Your Hardware