Qwen 3.5 (Withdrawn Listings) — Alibaba Cloud 的本地 AI 模型
作者: Jakub Rusinowski · 最后更新:
Alibaba's February 2026 flagship generation. Qwen 3.5 immediately topped multiple open-source reasoning benchmarks, scoring 88.4 on GPQA Diamond and 76.4 on SWE-bench Verified. The MoE architecture delivers 8–19× higher decoding throughput vs earlier Qwen3 while supporting 200+ languages. Apache 2.0 licensed for full commercial use.
变体
Qwen 3.5 (Withdrawn Listings) 最小的变体在 Q4_K_M 下约需 5 GB 显存——量化权重加框架开销,不含 KV 缓存。
| 模型 | Q4 下显存 | 显存 | 上下文 | 运行 |
|---|---|---|---|---|
| Qwen 3.5 7B 7B | ~5 GB | 128,000 | ollama run qwen3.5:7b | |
| Qwen 3.5 14B 14B | ~9.3 GB | 128,000 | ollama run qwen3.5:14b | |
| Qwen 3.5 32B 32B | ~20.1 GB | 128,000 | ollama run qwen3.5:32b | |
| Qwen 3.5 122B-A10B (MoE) 122B/10B active | ~74.5 GB | 128,000 | ollama run qwen3.5:122b-a10b-q4 |
显存为 Q4_K_M 下的量化权重加开销,与 GPU 与显存检测器使用同一引擎计算。
如何在本地运行 Qwen 3.5 (Withdrawn Listings)
安装 Ollama,然后拉取标签。
ollama run qwen3.5:7b在上方选择一个尺寸,查看它自己的显存、速度估算和安装命令。
许可证
Commercial use permitted. No usage restrictions beyond attribution.
适用于: Qwen 3.5 7B, Qwen 3.5 14B, Qwen 3.5 32B, Qwen 3.5 122B-A10B (MoE)推荐 GPU
目录中能在本地运行 Qwen 3.5 (Withdrawn Listings)(至少 5 GB 显存)的最便宜 GPU 是 Intel Arc B570 (10 GB).
Qwen 3.5 (Withdrawn Listings) — 常见问题
How much VRAM does Qwen 3.5 (Withdrawn Listings) need?
Qwen 3.5 (Withdrawn Listings) needs about 5 GB VRAM at Q4_K_M quantization for its smallest variant. Variants: Qwen 3.5 7B (5 GB, Q4_K_M); Qwen 3.5 14B (9 GB, Q4_K_M); Qwen 3.5 32B (20 GB, Q4_K_M); Qwen 3.5 122B-A10B (MoE) (74 GB, Q4_K_M). On Apple Silicon, unified memory counts toward this requirement.
Can I run Qwen 3.5 (Withdrawn Listings) on an RTX 4090 (24 GB)?
Yes — Qwen 3.5 (Withdrawn Listings) runs on an RTX 4090 (24 GB) and other 24 GB cards such as the RTX 3090. Smaller variants also fit comfortably on 8–16 GB GPUs at Q4_K_M.
What quantization should I use for Qwen 3.5 (Withdrawn Listings)?
Q4_K_M is the best balance of quality and VRAM for Qwen 3.5 (Withdrawn Listings) in most cases. Choose Q8_0 for near-lossless quality if you have spare VRAM, or smaller quants (Q3/Q2) only when memory is tight.
How do I run Qwen 3.5 (Withdrawn Listings) with Ollama?
Install Ollama, then run: ollama run qwen3.5:7b. This downloads Qwen 3.5 (Withdrawn Listings) and starts a local, OpenAI-compatible endpoint — no internet connection is needed after the initial download.