Can I Run Nemotron Cascade 2 on AMD Ryzen AI Max+ 395?

Autor: Jakub Rusinowski · Ostatnia aktualizacja: 11 września 2026

Yes, comfortably — Nemotron-Cascade 2 30B-A3B at Q4_K_M needs 21.7 GB at 8K context (19.1 GB weights + 2.6 GB KV cache/overhead), leaving ~106.3 GB of the AMD Ryzen AI Max+ 395's 128 GB, at ~46 tok/s (est.), with room for up to 256K context.

See what else this hardware can run →

Kup ten sprzęt Ryzen AI Max+ 395 Laptop (Strix Halo, up to 128GB) — 128 GB VRAM · 120 W board powerUruchom w chmurze RTX 4090 w RunPod — od $0.34/godz. · stawka sprawdzona 2026-07

lub porównaj w Vast.ai od $0.35/godz. (typical low · varies)

Jako partner Amazon zarabiamy na kwalifikujących się zakupach. Linki do chmurowych GPU są linkami polecającymi — możemy otrzymać prowizję bez dodatkowych kosztów dla Ciebie.

Ujawnienie afiliacyjne: Niektóre odnośniki na tej stronie to linki afiliacyjne — jeśli dokonasz zakupu za ich pośrednictwem, LLM Configurator może otrzymać prowizję bez dodatkowych kosztów dla Ciebie. Jako uczestnik programu Amazon Associates, LLM Configurator zarabia na kwalifikujących się zakupach.

Ryzen AI Max+ 395 Laptop (Strix Halo, up to 128GB)
128 GB VRAM · 120 W board power
Ceny w 2026 są niestabilne — sprawdź aktualną ofertę.
Sprawdź cenę na Amazon

AMD Ryzen AI Max+ 395 Specs

VRAM128 GB
Memory Bandwidth256 GB/s

Nemotron-Cascade 2 30B-A3B on the AMD Ryzen AI Max+ 395: VRAM by quantization

QuantVRAM neededFits 128 GB?Max contextWhole PC
F1665.8 GB✓ Yes256K—
Q8_036.2 GB✓ Yes256KBuild for this
Q6_K28.5 GB✓ Yes256K—
Q5_K_M25 GB✓ Yes256KBuild for this
Q4_K_M21.7 GB✓ Yes256KBuild for this
Q3_K_M16.1 GB✓ Yes256K—
Q2_K13 GB✓ Yes512K—

Assumes an 8K-token context with an f16 KV cache, on an estimated architecture — this model publishes no config we can read. A longer window needs more; a quantized KV cache needs less. “Max context” is the largest window that still fits in 128 GB. Figures are estimates from parameter count, quantization and memory bandwidth — the analyzer lets you tune KV-cache quant and context.

Context costs VRAM too. At Q4_K_M on the AMD Ryzen AI Max+ 395: 8K 21.7 GB · 32K 27.1 GB · 128K 48.9 GB. Every window this model publishes still fits 128 GB.

No compatible GPU? Nemotron-Cascade 2 30B-A3B on 24 GB of system RAM, CPU only: runs.

Nemotron Cascade 2 Sizes That Fit the AMD Ryzen AI Max+ 395 (at 8K context)

Nemotron-Cascade 2 30B-A3BQ4_K_M · 21.7 GB at 8K context · ~46 tok/s (est.)
Won't fit — rent Nemotron Cascade 2 instead

Nemotron Cascade 2 needs ~22 GB but this GPU has 128 GB. Rent a RTX 4090 (24 GB)-class GPU by the hour instead of buying one:

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

RunPod $0.34/hr
Rent on RunPod →
Vast.ai $0.35/hr · typical low · varies
Rent on Vast.ai →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

FAQ

Nemotron Cascade 2 on the AMD Ryzen AI Max+ 395 — does it fit?

Yes, comfortably — Nemotron-Cascade 2 30B-A3B at Q4_K_M needs 21.7 GB at 8K context (19.1 GB weights + 2.6 GB KV cache/overhead), leaving ~106.3 GB of the AMD Ryzen AI Max+ 395's 128 GB, at ~46 tok/s (est.), with room for up to 256K context.

Which Nemotron Cascade 2 variant fits best on the AMD Ryzen AI Max+ 395?

Nemotron-Cascade 2 30B-A3B at Q4_K_M quantization needs 21.7 GB at 8K context (19.1 GB weights + 2.6 GB KV cache/overhead), estimated ~46 tokens/sec, up to 256K context.

Nemotron Cascade 2 on Other GPUs

Popular Models on the AMD Ryzen AI Max+ 395

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | Nemotron Cascade 2 Model Page | AMD Ryzen AI Max+ 395 GPU Page | VRAM calculator | Check Your Hardware