Can I Run Llama 3.2 Family on NVIDIA H100 80GB?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the Llama 3.2 Family family runs on the NVIDIA H100 80GB.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA H100 80GB PCIe

NVIDIA H100 80GB Specs

VRAM80 GB
Memory Bandwidth2000 GB/s

Llama 3.2 Family Variants That Fit

Llama 3.2 90B Vision InstructQ4_K_M · 54 GB · ~37 tok/s (est.)
Llama 3.2 11B Vision InstructQ4_K_M · 7.8 GB · ~256 tok/s (est.)
Llama 3.2 3B InstructQ4_K_M · 2.2 GB · ~400 tok/s (est.)
Llama 3.2 1B InstructQ4_K_M · 0.8 GB · ~400 tok/s (est.)

FAQ

Can I run Llama 3.2 Family on the NVIDIA H100 80GB?

Yes — the Llama 3.2 Family family runs on the NVIDIA H100 80GB.

Which Llama 3.2 Family variant fits best on the NVIDIA H100 80GB?

Llama 3.2 90B Vision Instruct at Q4_K_M quantization (54 GB), estimated ~37 tokens/sec.

Llama 3.2 Family on Other GPUs

Popular Models on the NVIDIA H100 80GB

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | Llama 3.2 Family Model Page | NVIDIA H100 80GB GPU Page | Check Your Hardware