Can I Run IBM Granite 4.1 on NVIDIA GeForce RTX 4090?

作者： Jakub Rusinowski · 最后更新： 2026年6月15日

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 4090.

NVIDIA GeForce RTX 4090 Specs

VRAM	24 GB
Memory Bandwidth	1008 GB/s

IBM Granite 4.1 Variants That Fit

Granite 4.1 30B	FP8 (Q4 est. ~12-15GB, unconfirmed) · 18 GB · ~56 tok/s (est.)
Granite 4.1 8B	Q4_K_M · 5 GB · ~202 tok/s (est.)
Granite 4.1 3B	Q4_K_M · 2 GB · ~400 tok/s (est.)

FAQ

Can I run IBM Granite 4.1 on the NVIDIA GeForce RTX 4090?

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 4090.

Which IBM Granite 4.1 variant fits best on the NVIDIA GeForce RTX 4090?

Granite 4.1 30B at FP8 (Q4 est. ~12-15GB, unconfirmed) quantization (18 GB), estimated ~56 tokens/sec.

← Can I Run It? | IBM Granite 4.1 Model Page | NVIDIA GeForce RTX 4090 GPU Page | Check Your Hardware