Qwen 3.5 0.8B — VRAM Requirements

作者: Jakub Rusinowski · 最后更新: 2026年7月21日

How much GPU VRAM you need to run Qwen 3.5 Qwen 3.5 0.8B by Alibaba Cloud locally, a 0.8B-parameter model. Figures are quantized weights + KV cache + framework overhead from a memory-bandwidth roofline model.

Qwen 3.5 0.8B needs about 1 GB VRAM at Q4_K_M.

VRAM by Quantization

QuantBits/weightWeightsTotal VRAM
Q2_K2.630.3 GB1.1 GB
Q3_K_M3.410.3 GB1.1 GB
Q4_K_M4.830.5 GB1.3 GB
Q5_K_M5.670.6 GB1.4 GB
Q6_K6.560.7 GB1.5 GB
Q8_08.500.9 GB1.7 GB
F1616.001.6 GB2.4 GB

Switch quantization in the interactive calculator, or see the full Qwen 3.5 model page.

Add this badge to your model card

Model creators: paste this into your Hugging Face model card README to link readers straight to this VRAM breakdown.

VRAM Requirements

[![VRAM Requirements](https://img.shields.io/badge/Check_VRAM-LLM_Configurator-blue)](https://llmconfigurator.com/en/vram-calculator/qwen3-5-0.8b)

Estimates only — actual VRAM varies with context length, batch size, runtime and KV-cache settings.