Written by Jakub Rusinowski · Last updated September 19, 2026
Model library → GLM-4.6V → GLM-4.6V-Flash 9B
The 9B vision-language model in the GLM-4.6V family, built for low-latency multimodal work. The real small GLM: GLM-4.7 is a ~400B MoE and has no 9B checkpoint.
GLM-4.6V-Flash 9B needs about 6 GB of VRAM at Q4_K_M — quantized weights plus framework overhead, before any KV cache. On Apple Silicon that figure comes out of unified memory.
| Parameters | 9 Billion |
| Context window | 65,536 |
| Architecture | Dense vision-language |
| Provider | Zhipu AI (Z.ai) |
| Licence | MIT |
| Specified at | Q4_K_M |
| System RAM | 16 GB |
| Record updated | 2026-09-19 |
Corroborated — Two or more independent sources agree on these figures, but the model card itself was not retrieved. Treat the numbers as good rather than confirmed. Still unconfirmed: context.
MIT — commercial use permitted. Commercial use permitted. No usage restrictions beyond attribution.
Modelled on a reference NVIDIA RTX 4090 (24 GB). Weights plus framework overhead only — this model publishes no architecture we can read, so no KV cache is included. A real session needs more; the figure is a floor, not a target. Speed figures are ESTIMATES from the memory-bandwidth roofline described on the methodology page, not benchmarks we ran — rows marked measured come from published or reader-submitted runs. VRAM here includes the KV cache, so it reads higher than the headline figure above, which does not.
| Quant | Bits/weight | Weights | VRAM needed | Est. speed | Fit on 24 GB |
|---|---|---|---|---|---|
| Q2_K | 2.63 | 3 GB | 3.8 GB | ~144 tok/s (est.) | Fits comfortably |
| Q3_K_M | 3.41 | 3.8 GB | 4.6 GB | ~123 tok/s (est.) | Fits comfortably |
| Q4_K_M | 4.83 | 5.4 GB | 6.2 GB | ~98 tok/s (est.) | Fits comfortably |
| Q5_K_M | 5.67 | 6.4 GB | 7.2 GB | ~87 tok/s (est.) | Fits comfortably |
| Q6_K | 6.56 | 7.4 GB | 8.2 GB | ~78 tok/s (est.) | Fits comfortably |
| Q8_0 | 8.50 | 9.6 GB | 10.4 GB | ~64 tok/s (est.) | Fits comfortably |
| F16 | 16.00 | 18 GB | 18.8 GB | ~37 tok/s (est.) | Fits comfortably |
Want to set your own context length and KV-cache quantization? Use the interactive VRAM calculator.
or compare on Vast.ai from $0.35/hr (typical low · varies)
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
The cheapest catalogued GPU that runs GLM-4.6V-Flash 9B is the Intel Arc B570 (10 GB).
Install Ollama, then run:
ollama run glm-4-6vWeights on Hugging Face: zai-org/GLM-4.6V-Flash.
Best for: vision, multimodal, documents, local assistant.
← All GLM-4.6V models | VRAM calculator | Check your own hardware