Can I Run IBM Granite 4.1 on NVIDIA GeForce RTX 5090?

Autor: Jakub Rusinowski · Ostatnia aktualizacja: 15 czerwca 2026

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 5090.

NVIDIA GeForce RTX 5090 Specs

VRAM	32 GB
Memory Bandwidth	1792 GB/s

IBM Granite 4.1 Variants That Fit

Granite 4.1 30B	FP8 (Q4 est. ~12-15GB, unconfirmed) · 18 GB · ~100 tok/s (est.)
Granite 4.1 8B	Q4_K_M · 5 GB · ~358 tok/s (est.)
Granite 4.1 3B	Q4_K_M · 2 GB · ~400 tok/s (est.)

FAQ

Can I run IBM Granite 4.1 on the NVIDIA GeForce RTX 5090?

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 5090.

Which IBM Granite 4.1 variant fits best on the NVIDIA GeForce RTX 5090?

Granite 4.1 30B at FP8 (Q4 est. ~12-15GB, unconfirmed) quantization (18 GB), estimated ~100 tokens/sec.

← Can I Run It? | IBM Granite 4.1 Model Page | NVIDIA GeForce RTX 5090 GPU Page | Check Your Hardware