Can I Run Granite 4.1 30B on NVIDIA L40S?

Name: LLM Configurator — GPU VRAM Checker
Author: LLM Configurator

Autor: Jakub Rusinowski · Ostatnia aktualizacja: 15 sierpnia 2026

Yes. Granite 4.1 30B needs 30.9 GB at FP8 (Q4 est. ~12-15GB, unconfirmed) and the NVIDIA L40S has 48 GB, leaving about 17.1 GB of headroom, at roughly 24 tok/s (estimated) with room for up to 64K of context.

The numbers

Model	Granite 4.1 30B
Parameters	30B
Quantization	FP8 (Q4 est. ~12-15GB, unconfirmed)
VRAM needed	30.9 GB
NVIDIA L40S VRAM	48 GB
Verdict	Runs
Max context	64K
Estimated speed	~24 tok/s

What to do next

Nothing to change — run it at FP8 (Q4 est. ~12-15GB, unconfirmed). If you want more capability, check whether the next size up also fits.

Ujawnienie afiliacyjne: Niektóre odnośniki na tej stronie to linki afiliacyjne — jeśli dokonasz zakupu za ich pośrednictwem, LLM Configurator może otrzymać prowizję bez dodatkowych kosztów dla Ciebie. Jako uczestnik programu Amazon Associates, LLM Configurator zarabia na kwalifikujących się zakupach.

Running Granite 4.1 30B on this card:

NVIDIA L40S 48GB

48 GB VRAM · 350 W board power

Ceny w 2026 są niestabilne — sprawdź aktualną ofertę.

Sprawdź cenę na Amazon

Buy vs. rent Granite 4.1 30B

Buy the GPU

~$7,499

NVIDIA L40S · MSRP

Rent by the hour

from $0.55/hr

A100 (40 GB) class

At 2 hrs/day, buying (~$7,499) beats renting at $0.55/hr after about 18.9 years.

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

Vast.ai $0.55/hr · typical low · varies

Rent on Vast.ai →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

Other IBM Granite 4.1 sizes on the NVIDIA L40S

Granite 4.1 8B — runs (4.8 GB)
Granite 4.1 3B — runs (1.8 GB)

Granite 4.1 30B on nearby hardware

Intel Arc B580 (12 GB) — does not fit
Apple M3 Max (64 GB) — runs

All IBM Granite 4.1 sizes on the NVIDIA L40S | VRAM calculator for Granite 4.1 30B | NVIDIA L40S GPU page | Check your hardware