Can I Run Nemotron 70B on NVIDIA RTX PRO 6000 Blackwell?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the Nemotron 70B family runs on the NVIDIA RTX PRO 6000 Blackwell.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA RTX PRO 6000 Blackwell 96GB

NVIDIA RTX PRO 6000 Blackwell Specs

VRAM96 GB
Memory Bandwidth1792 GB/s

Nemotron 70B Variants That Fit

Nemotron 70B InstructQ4_K_M · 39 GB · ~46 tok/s (est.)

FAQ

Can I run Nemotron 70B on the NVIDIA RTX PRO 6000 Blackwell?

Yes — the Nemotron 70B family runs on the NVIDIA RTX PRO 6000 Blackwell.

Which Nemotron 70B variant fits best on the NVIDIA RTX PRO 6000 Blackwell?

Nemotron 70B Instruct at Q4_K_M quantization (39 GB), estimated ~46 tokens/sec.

Nemotron 70B on Other GPUs

Popular Models on the NVIDIA RTX PRO 6000 Blackwell

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | Nemotron 70B Model Page | NVIDIA RTX PRO 6000 Blackwell GPU Page | Check Your Hardware