Qwen 3.5 397B-A17B — VRAM Requirements

Written by Jakub Rusinowski · Last updated February 16, 2026

How much GPU VRAM you need to run Qwen 3.5 Qwen 3.5 397B-A17B by Alibaba Cloud locally, a 397B-parameter model. Figures are quantized weights + KV cache + framework overhead, computed from the model's parameter count and published architecture — not a throughput model. See /en/methodology.

Qwen 3.5 397B-A17B needs about 240 GB VRAM at Q4_K_M.

VRAM by Quantization

QuantBits/weightWeightsTotal VRAM
Q2_K2.63130.5 GB131.3 GB
Q3_K_M3.41169.2 GB170.0 GB
Q4_K_M4.83239.7 GB240.5 GB
Q5_K_M5.67281.4 GB282.2 GB
Q6_K6.56325.5 GB326.3 GB
Q8_08.50421.8 GB422.6 GB
F1616.00794.0 GB794.8 GB

Switch quantization in the interactive calculator, or see the full Qwen 3.5 model page.

Buy This HardwareApple Mac Studio M3 Ultra — 512 GB VRAM · 60 W board powerDeploy in the Cloud NowRunPod

or compare on Vast.ai

As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.

Add this badge to your model card

Model creators: paste this into your Hugging Face model card README to link readers straight to this VRAM breakdown.

VRAM Requirements

[![VRAM Requirements](https://img.shields.io/badge/Check_VRAM-LLM_Configurator-blue)](https://llmconfigurator.com/en/vram-calculator/qwen3-5-397b-a17b?utm_source=badge&utm_medium=referral&utm_campaign=readme_badge&utm_content=qwen3-5-397b-a17b)

Estimates only — actual VRAM varies with context length, batch size, runtime and KV-cache settings.