Can I Run IBM Granite 4.1 on Apple M2?

作者： Jakub Rusinowski · 最后更新： 2026年7月10日

Yes — the IBM Granite 4.1 family runs on the Apple M2.

Apple M2 Specs

VRAM	24 GB unified memory
Memory Bandwidth	100 GB/s

Granite 4.1 30B	FP8 (Q4 est. ~12-15GB, unconfirmed) · 18 GB · ~6 tok/s (est.)
Granite 4.1 8B	Q4_K_M · 5 GB · ~20 tok/s (est.)
Granite 4.1 3B	Q4_K_M · 2 GB · ~50 tok/s (est.)

Yes — the IBM Granite 4.1 family runs on the Apple M2.

Granite 4.1 30B at FP8 (Q4 est. ~12-15GB, unconfirmed) quantization (18 GB), estimated ~6 tokens/sec.