Decider 35B-A3B (NVFP4) — VRAM & /v1/systemone setup
作者： Jakub Rusinowski · 最后更新：
Mapika 基于 Qwen3.5-35B-A3B-Base 的 35B 混合专家决策模型（3B 激活），提供 NVFP4 版本，面向 NVIDIA Blackwell GPU，通过 vLLM 或 TensorRT-LLM 运行。
Decider 35B-A3B (NVFP4) 在 Q4_K_M 下约需 23 GB 显存——量化权重加框架开销，不含 KV 缓存。在 Apple Silicon 上，这部分来自统一内存。
Call Decider 35B-A3B (NVFP4)
Served by decider.serve. This model does not run in Ollama.
- Question types
- choice noul (yes / no) score
- Inputs
- text
- Max candidates per question
- 255
- Serve with
decider.serve- Endpoint
/v1/systemone
Setup for servers other than Ollama →
Build a request for this model Decision models guide
Other decision models: Nimble 9B · Tev1 4B · Tev1 0.8B · Winnow 12B · Winnow E4B · Decider 2B · Decider 4B · JevK5 4B · Intern-Decision 4B · AutoJev 27B · Laya · Clef 27B · Clef-Flash 9B · Rune 26B-A4B v3 · OpenDecider-nano · OpenDecider-small · OpenDecider-small MLX 4-bit · Bosun v3.1 0.6B · Bosun v3.1 1.7B · d1-3B · d1-omni-600M · THX-01 322M
Affiliate links — we may earn a commission if you sign up, at no extra cost to you.
Hardware fit
Weights plus overhead plus the KV cache at a 8,192-token prompt, on NVIDIA RTX 4090 (24 GB). A publisher build is sized from its file; the other rows are modelled at a standard quant. Decision requests are short, so no long-context figure is shown.
| 量化 | 显存 | 显存 | 适配 |
|---|---|---|---|
| NVFP4 Publisher build · 19.6 GB file | 22.3 GB | 勉强 | |
| BF16 Publisher build · 65 GB file | 67.7 GB | 放不下 | |
| Q4_K_M 4.83 bpw · modelled quant | 24.4 GB | 需卸载 | |
| Q6_K 6.56 bpw · modelled quant | 32.2 GB | 需卸载 | |
| Q8_0 8.50 bpw · modelled quant | 40.9 GB | 需卸载 |
Published file size: NVFP4 19.6 GB · BF16 65 GB. A download size from the model publisher — not a VRAM requirement.
NVFP4 build targets NVIDIA Blackwell via vLLM or TensorRT-LLM. BF16 sibling repo Mapika/decider-35b-a3b is 65 GB.
How it was scored
Two different suites on two different scales. Never compare the numbers across the two cards.
Decision Index 0.2.1 (snapshot 2026-09-28)
Decision Index 0.2.1Community Decision Index (not by the model's authors)- ECE (lower is better)
- 0.0226
- Median compute
- 101.4 ms on 1x NVIDIA RTX PRO 6000 (96 GB)
Community-maintained; not affiliated with the model authors.
Source ↗Decision models are not ranked on chat, creative or coding scores.
规格
Verified — Checked against the primary source — the model card or the vendor spec page — and corroborated by a second independent source.
- 参数量
- 35.95B
- 上下文窗口
- Not published
- 架构
- Fine-tune of Qwen/Qwen3.5-35B-A3B-Base (mixture-of-experts)
- 提供商
- Mapika
- 许可证
- Apache-2.0
- Practical deployment
- Single consumer GPU
- 规格量化
- Q4_K_M
- 系统内存
- 46 GB
- 记录更新于
- 2026-09-30
Commercial use permitted. No usage restrictions beyond attribution.
Decider 的其他尺寸
Decider 35B-A3B (NVFP4) — 常见问题
What is Decider 35B-A3B (NVFP4)?
Decider 35B-A3B (NVFP4) is a decision model: you send it a state and typed questions (choice, yes/no/unknown, or a score) and it returns one answer per question with a probability for every option. It is not a chat model.
How do I run Decider 35B-A3B (NVFP4) locally?
Decider 35B-A3B (NVFP4) does not run in Ollama. Served by decider.serve. This model does not run in Ollama. See the setup guide for servers other than Ollama.
How much memory does Decider 35B-A3B (NVFP4) need?
About 23 GB for the weights plus overhead at Q4_K_M, before the prompt's KV cache. Decision prompts are short, so the cache stays small.
How accurate is Decider 35B-A3B (NVFP4)?
Its published score is on the community Decision Index 0.2.1, which its authors did not build. It is not a calibration guarantee: test on your own examples.