Decider 2B — VRAM & /v1/systemone setup
Autor: Jakub Rusinowski · Ostatnia aktualizacja:
Model decyzyjny 2B od Mapika na Qwen3.5-2B-Base, obsługiwany przez decider.serve ze zgodnym z TypeSafe /v1/systemone.
Decider 2B potrzebuje około 2 GB VRAM przy Q4_K_M — skwantyzowane wagi plus narzut frameworka, bez pamięci podręcznej KV. Na Apple Silicon ta wartość pochodzi z pamięci zunifikowanej.
Call Decider 2B
Served by decider.serve. This model does not run in Ollama.
- Question types
- choice noul (yes / no) score
- Inputs
- text
- Max candidates per question
- 255
- Serve with
decider.serve- Endpoint
/v1/systemone
Setup for servers other than Ollama →
Build a request for this model Decision models guide
Other decision models: Nimble 9B · Tev1 4B · Tev1 0.8B · Winnow 12B · Winnow E4B · Decider 4B · Decider 35B-A3B (NVFP4) · JevK5 4B · Intern-Decision 4B · AutoJev 27B · Laya · Clef 27B · Clef-Flash 9B · Rune 26B-A4B v3 · OpenDecider-nano · OpenDecider-small · OpenDecider-small MLX 4-bit · Bosun v3.1 0.6B · Bosun v3.1 1.7B · d1-3B · d1-omni-600M · THX-01 322M
Hardware fit
Weights plus overhead plus the KV cache at a 8,192-token prompt, on NVIDIA RTX 4090 (24 GB). A publisher build is sized from its file; the other rows are modelled at a standard quant. Decision requests are short, so no long-context figure is shown.
| Kwant. | Pamięć | VRAM | Dopasowanie |
|---|---|---|---|
| BF16 Publisher build · 3.8 GB file | 5.4 GB | Mieści się | |
| Q4_K_M 4.83 bpw · modelled quant | 2.9 GB | Mieści się | |
| Q6_K 6.56 bpw · modelled quant | 3.4 GB | Mieści się | |
| Q8_0 8.50 bpw · modelled quant | 4 GB | Mieści się |
Published file size: BF16 3.8 GB. A download size from the model publisher — not a VRAM requirement.
Needs torch, transformers>=5, flash-linear-attention (optional but several times faster). typesafe-sdk works against decider.serve via TYPESAFE_BASE_URL. Current revision v11; v10 available as a tag.
How it was scored
Two different suites on two different scales. Never compare the numbers across the two cards.
Decision Index 0.2.1 (snapshot 2026-09-28)
Decision Index 0.2.1Community Decision Index (not by the model's authors)- ECE (lower is better)
- 0.0771
- Median compute
- 8.1 ms on 1x NVIDIA RTX PRO 6000 (96 GB)
Community-maintained; not affiliated with the model authors.
Source ↗Decision models are not ranked on chat, creative or coding scores.
Specyfikacja
Verified — Checked against the primary source — the model card or the vendor spec page — and corroborated by a second independent source.
- Parametry
- 2.27B
- Okno kontekstu
- 32K
- Architektura
- Fine-tune of Qwen/Qwen3.5-2B-Base
- Dostawca
- Mapika
- Licencja
- Apache-2.0
- Practical deployment
- Edge device (phone, SBC)
- Określono przy
- Q4_K_M
- RAM systemowy
- 8 GB
- Rekord zaktualizowany
- 2026-09-30
Commercial use permitted. No usage restrictions beyond attribution.
Inne rozmiary Decider
Decider 2B — najczęściej zadawane pytania
What is Decider 2B?
Decider 2B is a decision model: you send it a state and typed questions (choice, yes/no/unknown, or a score) and it returns one answer per question with a probability for every option. It is not a chat model.
How do I run Decider 2B locally?
Decider 2B does not run in Ollama. Served by decider.serve. This model does not run in Ollama. See the setup guide for servers other than Ollama.
How much memory does Decider 2B need?
About 2 GB for the weights plus overhead at Q4_K_M, before the prompt's KV cache. Decision prompts are short, so the cache stays small.
How accurate is Decider 2B?
Its published score is on the community Decision Index 0.2.1, which its authors did not build. It is not a calibration guarantee: test on your own examples.