Can I Run IBM Granite 4.1 on NVIDIA GeForce RTX 4070 Super?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 4070 Super.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA GeForce RTX 4070 Super 12GB

NVIDIA GeForce RTX 4070 Super Specs

VRAM12 GB
Memory Bandwidth504 GB/s

IBM Granite 4.1 Variants That Fit

Granite 4.1 8BQ4_K_M · 5 GB · ~101 tok/s (est.)
Granite 4.1 3BQ4_K_M · 2 GB · ~252 tok/s (est.)

FAQ

Can I run IBM Granite 4.1 on the NVIDIA GeForce RTX 4070 Super?

Yes — the IBM Granite 4.1 family runs on the NVIDIA GeForce RTX 4070 Super.

Which IBM Granite 4.1 variant fits best on the NVIDIA GeForce RTX 4070 Super?

Granite 4.1 8B at Q4_K_M quantization (5 GB), estimated ~101 tokens/sec.

IBM Granite 4.1 on Other GPUs

Popular Models on the NVIDIA GeForce RTX 4070 Super

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | IBM Granite 4.1 Model Page | NVIDIA GeForce RTX 4070 Super GPU Page | Check Your Hardware