Can I Run Llama 3.2 Vision on NVIDIA RTX PRO 6000 Blackwell?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the Llama 3.2 Vision family runs on the NVIDIA RTX PRO 6000 Blackwell.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA RTX PRO 6000 Blackwell 96GB

NVIDIA RTX PRO 6000 Blackwell Specs

VRAM96 GB
Memory Bandwidth1792 GB/s

Llama 3.2 Vision Variants That Fit

Llama 3.2 Vision 90BQ4_K_M · 55 GB · ~33 tok/s (est.)
Llama 3.2 Vision 11BQ4_K_M · 7.8 GB · ~230 tok/s (est.)

FAQ

Can I run Llama 3.2 Vision on the NVIDIA RTX PRO 6000 Blackwell?

Yes — the Llama 3.2 Vision family runs on the NVIDIA RTX PRO 6000 Blackwell.

Which Llama 3.2 Vision variant fits best on the NVIDIA RTX PRO 6000 Blackwell?

Llama 3.2 Vision 90B at Q4_K_M quantization (55 GB), estimated ~33 tokens/sec.

Llama 3.2 Vision on Other GPUs

Popular Models on the NVIDIA RTX PRO 6000 Blackwell

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | Llama 3.2 Vision Model Page | NVIDIA RTX PRO 6000 Blackwell GPU Page | Check Your Hardware