Llama 3.2 90B Vision Instruct — VRAM Requirements

Written by Jakub Rusinowski · Last updated August 15, 2026

How much GPU VRAM you need to run Llama 3.2 Family Llama 3.2 90B Vision Instruct by Meta locally, a 88.8B-parameter model. Figures are quantized weights + KV cache + framework overhead, computed from the model's parameter count and published architecture — not a throughput model. See /en/methodology.

Llama 3.2 90B Vision Instruct needs about 58 GB VRAM at Q4_K_M.

VRAM by Quantization

QuantBits/weightWeightsTotal VRAM
Q2_K2.6329.2 GB33.3 GB
Q3_K_M3.4137.9 GB42.0 GB
Q4_K_M4.8353.6 GB57.8 GB
Q5_K_M5.6762.9 GB67.1 GB
Q6_K6.5672.8 GB77.0 GB
Q8_08.5094.3 GB98.5 GB
F1616.00177.6 GB181.8 GB

Switch quantization in the interactive calculator, or see the full Llama 3.2 Family model page.

Buy This HardwareApple MacBook Pro M5 Pro — 64 GB VRAM · 30 W board powerDeploy in the Cloud NowNVIDIA A100 80GB on RunPod — from $1.39/hr · rate checked 2026-07

or compare on Vast.ai from $0.77/hr (typical low · varies)

As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.

Add this badge to your model card

Model creators: paste this into your Hugging Face model card README to link readers straight to this VRAM breakdown.

VRAM Requirements

[![VRAM Requirements](https://img.shields.io/badge/Check_VRAM-LLM_Configurator-blue)](https://llmconfigurator.com/en/vram-calculator/llama-3.2-90b-vision?utm_source=badge&utm_medium=referral&utm_campaign=readme_badge&utm_content=llama-3.2-90b-vision)

Estimates only — actual VRAM varies with context length, batch size, runtime and KV-cache settings.