Decision models: run Jev-style System One models on your own hardware

Autor: Jakub Rusinowski · Ostatnia aktualizacja:

A decision model reads some text (the "state") and a set of typed questions, and returns a probability for every allowed answer in a single scoring pass. It never generates text. TypeSafe AI launched the category with its hosted model Jev on 15 September 2026. Since Ollama 0.35 (29 September 2026) you can run five decision models locally — nimble, tev1, tev1:0.8b, clef and clef-flash — through a new /v1/systemone endpoint. More than 70 open reproductions of Jev are now tracked on a community leaderboard, and the strongest of them score close to Jev on it.

This hub is the "can I run it and how" guide for the whole category.

Pick your starting point

If you are…Start here
New to the idea — "what is this and why should I care?"Decision models explained, with infographics
Ready to run one tonight on a laptopSet up Ollama decision models
A developer who needs more accuracy than Ollama's models give youOpen Jev reproductions beyond Ollama: Winnow, Decider, JevK5, Laya
Wiring probabilities into production codeConfidence, thresholds and calibration
Writing your first requestDecision request builder — generates curl, Python and JS for you
Sending photos, screenshots or scanned formsDecision models on images
Stuck on an errorOllama /v1/systemone errors and fixes
After a tiny model for a phone, a Jetson or a laptop CPUDecision models on phones, Jetson and laptops — the small models by device, with their published latency
Evaluating a model before productionHow to evaluate a decision model on your own data — public scores, DecisionBench, and a 200-row test of your own

What a decision model is good for

Think of it as a smart if-statement you can drop into ordinary code. Your program stays in control of the logic; the model only answers narrow questions about messy input:

  • Route a support ticket to billing, technical or other.
  • Gate an action: "does the customer explicitly ask for a refund?" → probability of yes.
  • Score urgency, quality or risk on a rubric you define.
  • Moderate or guard an LLM's input or output before it reaches a user.
  • Choose a tool or a skill from a fixed list for an agent.

It is the wrong tool for anything that needs words out: summaries, drafts, explanations, chat. For those, you still want a regular local LLM — see the model library.

Which decision model can your hardware run?

ModelRuns withPublished sizeDecision Index 0.2.1
Bosun v3.1 0.6B
Hanno Labs
jev-compatible-server :8000400 MB (Q4_K_M)14.32
THX-01 322M
HAL-X AI
thx01.server :8095640 MB (F16)—
OpenDecider-nano
Manjunath Janardhan
opendecider serve :8000790 MB (BF16)—
Tev1 0.8B
Together AI
ollama pull tev1:0.8b812 MB (Ollama build)12.85
Bosun v3.1 1.7B
Hanno Labs
jev-compatible-server :80001.26 GB (Q5_K_M)20.1
Decider 0.8B preview
Mapika
decider.serve1.4 GB (BF16)—
OpenDecider-small MLX 4-bit
Manjunath Janardhan
opendecider (MLX)2.26 GB (MLX 4-bit)—
d1-omni-600M
Liquid AI
Transformers (trust_remote_code)2.35 GB (F32)—
OpenDecider-small
Manjunath Janardhan
opendecider serve :80002.5 GB (Q4_K_M)—
Decider 2B
Mapika
decider.serve3.8 GB (BF16)28.97
Tev1 4B
Together AI
ollama pull tev14.5 GB (Ollama build)29.24
d1-3B
Liquid AI
Transformers (trust_remote_code)6.25 GB (BF16)—
Winnow E4B
EldanRing
winnow-inference :80918.01 GB (Q8_0)39.89
Decider 4B
Mapika
decider.serve8.4 GB (BF16)40.7
JevK5 4B
alibiserikbay
jevk5-serve :80909 GB (BF16)38.81
Nimble 9B
Bespoke Labs
ollama pull nimble9.5 GB (Ollama build)39.57
Clef-Flash 9B
Cloudflare
ollama pull clef-flash10.93 GB (Ollama build)—
Winnow 12B
EldanRing
winnow-inference :809112.67 GB (Q8_0)50.02
Clef 27B
Cloudflare
ollama pull clef17.99 GB (Ollama build)—
Decider 35B-A3B (NVFP4)
Mapika
decider.serve19.6 GB (NVFP4)47.11
Rune 26B-A4B v3
Surogate
surogate serve51.6 GB (BF16)57.44
AutoJev 27B
denis-pplx
autojev-serve :800052.6 GB (BF16 (49 GiB))56.4
Intern-Decision 4B
InternLM
reference Python code—37.81
Laya
ConvAI Innovations
laya-serve / Python Router—6.04

Fit on your hardware: set your GPU or unified memory in the hardware analyzer and this page shows whether each model fits it. Check your hardware

The short version, by published download size of the build you would actually run:

ModelRuns withPublished sizeDecision Index 0.2.1
THX-01 322M (HAL-X AI, provisional)Own server (thx01.server)0.64 GB (F16)— ³
OpenDecider-nano (Manjunath Janardhan)Own server (opendecider serve)0.79 GB (BF16)— ³
Tev1 0.8B (Together AI, experimental)✅ tev1:0.8b812 MB12.9
Bosun v3.1 0.6B (Hanno Labs)Own server (jev-compatible-server)1.54 GB (BF16 base + adapter)14.3
OpenDecider-small MLX 4-bit (Manjunath Janardhan)Python library, Apple Silicon2.26 GB (MLX 4-bit)— ³
d1-omni-600M (Liquid AI, experimental)Python library (Transformers)2.35 GB (F32)— ⁴
Decider 2B (Mapika)Own server3.8 GB (BF16)29.0
Bosun v3.1 1.7B (Hanno Labs)Own server (jev-compatible-server)4.15 GB (BF16 base + adapter)20.1
Tev1 4B (Together AI, experimental)✅ tev14.5 GB29.2
d1-3B (Liquid AI)Python library (Transformers)6.25 GB (BF16)— ⁴
Winnow-E4B (EldanRing)Own llama.cpp server8.0 GB (Q8_0)39.9
OpenDecider-small (Manjunath Janardhan)Own server (opendecider serve)8.19 GB (BF16 base + adapter)— ³
Decider 4B (Mapika)Own server8.4 GB (BF16)40.7
Nimble 9B (Bespoke Labs)✅ nimble9.5 GB39.6 ¹
Clef-Flash 9B (Cloudflare)✅ clef-flash10.9 GB— ²
Winnow-12B (EldanRing)Own llama.cpp server12.7 GB (Q8_0)50.0
Clef 27B (Cloudflare)✅ clef18.0 GB— ²
AutoJev-27BOwn server~49 GiB (BF16)56.4
Rune 26B-A4B v3 (Surogate)Own server (surogate serve, /v1/decisions)51.6 GB (BF16)57.4
Jev 1.13 (TypeSafe, hosted, closed weights)——57.9

¹ The Index scores the Bespoke-Nimble-9B-v2 repository; which checkpoint the Ollama nimble tag packages is not stated in one place. ² Clef and Clef-Flash were released on 1 October 2026, after the 28 September snapshot, so they have no Index score yet. ³ Not on the 28 September snapshot; their authors' own scores are under Other benchmarks. ⁴ Liquid AI scored d1 with the official Index scorer itself (48.57 for d1-3B, 15.95 for d1-omni-600M). That is not a leaderboard result, so it is listed under Other benchmarks, not in this column. Decision Index snapshot: 28 September 2026. Scores are chance-corrected (0 = random guessing, 100 = perfect). Download size is a floor, not a verdict — use the hardware analyzer for a fit check that includes runtime overhead.

Tiny decision models (under 1 GB to 3B)

The models small enough for a phone runtime, a Jetson, a single-board computer or a laptop CPU. Each latency is the figure its source published, on the device and under the condition shown, so the rows are not a race: different devices, different request shapes, different people measuring. There is no ranking here.

ModelPublished sizeInputsRuns withPublished latency (device · condition · who measured)
Bosun v3.1 0.6B
Hanno Labs
400 MB (Q4_K_M)textjev-compatible-server :800038.7 ms · 1x NVIDIA RTX PRO 6000 (96 GB)
median per request on the Decision Index 0.2.1 run — Community Decision Index (not by the model's authors)
THX-01 322M
HAL-X AI
provisional
640 MB (F16)textthx01.server :809510 ms · One GPU (model not stated)
1 request, local GPU. Jev 1.13 measured 331 ms through its API on the same set: different serving conditions — Authors' own internal benchmark — not independently reproduced
1 ms · One GPU (model not stated)
Batched, time per decision — Authors' own internal benchmark — not independently reproduced
OpenDecider-nano
Manjunath Janardhan
790 MB (BF16)textopendecider serve :800016.1 ms · NVIDIA L40S
1 question per call — Authors' own internal benchmark — not independently reproduced
3.8 ms · NVIDIA L40S
50 questions per call, time per question — Authors' own internal benchmark — not independently reproduced
Tev1 0.8B
Together AI
812 MB (Ollama build)textollama pull tev1:0.8b28.5 ms · 1x NVIDIA RTX PRO 6000 (96 GB)
median per request on the Decision Index 0.2.1 run — Community Decision Index (not by the model's authors)
d1-omni-600M
Liquid AI
experimental
2.35 GB (F32)text, image, audioTransformers (trust_remote_code)Not published
d1-3B
Liquid AI
6.25 GB (BF16)text, imageTransformers (trust_remote_code)8 ms · NVIDIA RTX 4090
1 question, warm, bf16, compiled as CUDA graphs (16 ms without) — Authors' own internal benchmark — not independently reproduced
9 ms · AMD MI325X
1 question, warm, bf16 — Authors' own internal benchmark — not independently reproduced

The wider field: the top 25 downloadable models on the Decision Index

Decision Index 0.2.1 · snapshot 28 Sep 2026 · community-maintained, not affiliated with TypeSafe AI. Top 25 of 54 entrants with downloadable weights (70 entrants in all; inference-technique entries excluded). Full leaderboard ↗
Index rankModelParamsBaseLicenceDecision Index 0.2.1ECELinks
—Jev 1.13 (TypeSafe AI) hosted, closed weights——Proprietary API57.910.074reference only
1Surogate Rune 26B-A4B v325.8Bgoogle/gemma-4-26B-A4B-itApache-2.057.440.1196weights ↗ · code ↗
3AutoJev-27B27.8BQwen/Qwen3.8-27BApache-2.056.40.0178weights ↗ · code ↗
5Jebadiah 27B27.8BQwen/Qwen3.8-27BApache-2.054.670.014weights ↗ · code ↗
6Eikos-27B27.8BQwen/Qwen3.8-27BMIT53.130.0574weights ↗ · code ↗
9Winnow-12B12Bgoogle/gemma-4-12BApache-2.050.020.1679weights ↗ · code ↗
12Decider 35B-A3B36BQwen/Qwen3.5-35B-A3B-BaseApache-2.047.110.0226weights ↗
13JPT-9B9.7BQwen/Qwen3.5-9B-BaseCC-BY-NC-4.0 NC46.890.0773weights ↗ · code ↗
14Decision 1.0 Lux9.7BQwen/Qwen3.5-9B-BaseApache-2.043.490.076weights ↗
15JPT-4B4.7BQwen/Qwen3.5-4B-BaseCC-BY-NC-4.0 NC43.040.0793weights ↗ · code ↗
16Jet v6.24.7BQwen/Qwen3.5-4B-BaseApache-2.042.60.1411weights ↗ · code ↗
17Xor36BQwen/Qwen3.6-35B-A3BApache-2.041.480.0149weights ↗
18Hopper (G) 1.24.7BQwen/Qwen3.5-4B-BaseOther40.770.0927weights ↗ · code ↗
19Decider 4B4.7BQwen/Qwen3.5-4B-BaseApache-2.040.70.0837weights ↗ · code ↗
20Jev-Omni12Bgoogle/gemma-4-12BApache-2.040.530.161weights ↗
22Winnow-E4B8Bgoogle/gemma-4-E4BApache-2.039.890.058weights ↗ · code ↗
23Bespoke Nimble 9B v29.7BQwen/Qwen3.5-9B-BaseApache-2.039.570.024weights ↗ · code ↗
24JevK54.7BQwen/Qwen3.5-4B-BaseApache-2.038.810.0268weights ↗ · code ↗
25lev4.7BQwen/Qwen3.5-4B-BaseApache-2.038.540.0638weights ↗ · code ↗
26Kev 9B9.7BQwen/Qwen3.5-9B-BaseApache-2.038.480.1378weights ↗ · code ↗
27Intern-Decision-4B4.7BQwen/Qwen3.5-4B-BaseApache-2.037.810.0278weights ↗ · code ↗
29NeoHorse-Jev-4B4.7BQwen/Qwen3.5-4B-BaseApache-2.036.750.1039weights ↗ · code ↗
30Solomon v1.127.8BQwen/Qwen3.8-27BApache-2.036.430.0807weights ↗
31Kev 4B4.7BQwen/Qwen3.5-4B-BaseApache-2.034.640.1756weights ↗ · code ↗
32Decision 1.0 Nox4.7BQwen/Qwen3.5-4B-BaseNot stated34.360.1399weights ↗
35open-jev (pngwn)4.7BQwen/Qwen3.5-4B-BaseCC-BY-NC-4.0 NC29.910.0589weights ↗

Index scores are chance-corrected (0 = random guessing, 100 = perfect); ECE is expected calibration error, lower is better. These are not the model authors' own benchmark numbers and are never plotted with them.

Other benchmarks (not comparable with the Index)

Scores the model authors published on their own suites. Each row is one model on one suite, with who ran it. A same-author benchmark is not independent even when its data is public, and rows on different suites measure different questions — never read this table as a ranking, and never set a number here against the Decision Index column above.

ModelSuiteWhat was scoredScoreECEWho measured itSource
Bosun v3.1 0.6B
Hanno Labs
DecisionBench 1.0 (Hanno Labs)Applied suite (22,700 rows)
+1 more row on the model page
83.2%0.0588Benchmark built by the same team that built this modelSource ↗
THX-01 322M
HAL-X AI
Support-ticket classification, 15 categories (HAL-X AI internal set)2,843 tickets in Azerbaijani, Russian, English and Turkish — average of 4 test sets98.4%0.003Authors' own internal benchmark — not independently reproducedSource ↗
THX-01 322M
HAL-X AI
Held-out multilingual documents (HAL-X AI internal set)Number lookup (exact value)
+2 more rows on the model page
93.4%—Authors' own internal benchmark — not independently reproducedSource ↗
THX-01 322M
HAL-X AI
39-task multilingual decision suite (HAL-X AI)Mean over 39 held-out tasks84.2%0.066Authors' own internal benchmark — not independently reproducedSource ↗
OpenDecider-nano
Manjunath Janardhan
typed-decisions (Antz AI harness, 2,000 decisions)Test split79.6%—Run by the authors on a public third-party harnessSource ↗
OpenDecider-nano
Manjunath Janardhan
200 general decisions (BANKING77, BoolQ, Yelp, ChaosNLI)200 decisions68%0.092Run by the authors on a public third-party harnessSource ↗
Bosun v3.1 1.7B
Hanno Labs
DecisionBench 1.0 (Hanno Labs)Applied suite (22,700 rows)
+1 more row on the model page
87.29%0.0397Benchmark built by the same team that built this modelSource ↗
OpenDecider-small MLX 4-bit
Manjunath Janardhan
typed-decisions (Antz AI harness, 2,000 decisions)Test split65.1%—Run by the authors on a public third-party harnessSource ↗
OpenDecider-small MLX 4-bit
Manjunath Janardhan
200 general decisions (BANKING77, BoolQ, Yelp, ChaosNLI)200 decisions74.5%—Run by the authors on a public third-party harnessSource ↗
d1-omni-600M
Liquid AI
Decision Index 0.2.1 suite, scored by Liquid AI with the official scorerBalanced skill · 0.2.115.95—Run by the authors on a public third-party harnessSource ↗
d1-omni-600M
Liquid AI
Public benchmarks read as decisions (Liquid AI’s own run)Mean of 7 (SQuAD 2.0, Civil Comments, MASSIVE, PubMedQA, BoolQ, XNLI, PAWS-X)78.4%—Authors' own internal benchmark — not independently reproducedSource ↗
OpenDecider-small
Manjunath Janardhan
typed-decisions (Antz AI harness, 2,000 decisions)Test split67.2%—Run by the authors on a public third-party harnessSource ↗
OpenDecider-small
Manjunath Janardhan
200 general decisions (BANKING77, BoolQ, Yelp, ChaosNLI)200 decisions73.5%0.087Run by the authors on a public third-party harnessSource ↗
d1-3B
Liquid AI
Decision Index 0.2.1 suite, scored by Liquid AI with the official scorerBalanced skill · 0.2.148.57—Run by the authors on a public third-party harnessSource ↗
d1-3B
Liquid AI
Public benchmarks read as decisions (Liquid AI’s own run)Mean of 7 (SQuAD 2.0, Civil Comments, MASSIVE, PubMedQA, BoolQ, XNLI, PAWS-X)
+1 more row on the model page
82.9%—Authors' own internal benchmark — not independently reproducedSource ↗
d1-3B
Liquid AI
11 public image benchmarks read as decisions (Liquid AI’s own run)Mean, at most 1,000 rows each74.1%—Authors' own internal benchmark — not independently reproducedSource ↗

Benchmark built by the same team that built this model · Run by the authors on a public third-party harness · Authors' own internal benchmark — not independently reproduced. Every row is a different suite; the Decision Index column above is the only shared yardstick.

The honest caveats, up front

  1. "Can't hallucinate" means "can't answer off-schema." The answer is always one of your options. It can still be the wrong option.
  2. Ollama's confidence is not a correctness score. Ollama's own API reference defines it as how concentrated the probability distribution is, and says it is not calibrated correctness. Test thresholds on your own data before you trust them — here's how.
  3. Two benchmarks, two stories. On Bespoke Labs' 13 human-labelled datasets, Nimble scores 75.7% against Jev's 76.0%. On the broader community Decision Index, Nimble v2 scores 39.6 against Jev's 57.9. Both are fair; they measure different things. We never put them on one chart.
  4. Score is the weakest primitive. Nimble's public-benchmark accuracy is 81.6% on choice, 80.2% on yes/no and 54.6% on score questions.
  5. Everything here is weeks old. Jev launched on 15 September, Ollama support on 29 September; Bosun v3.1 and DecisionBench on 22 September, OpenDecider on 27 September, Clef on 1 October, d1 on 7 October and THX-01 on 10 October. Expect model versions, limits and leaderboard positions to move. Every page in this cluster shows its last-verified date.

Keep going

Frequently asked questions

Is Jev open source?

No. Jev is a hosted API from TypeSafe AI with closed weights, and its training method (RLCD, Reinforcement Learning for Calibrated Decisions) is described only at blog-post level. Everything you can run locally is an independent open reproduction of the interface, not Jev itself.

Do I need a GPU?

Not for the smallest models. tev1:0.8b is an 812 MB download, and decision requests are short, so CPU inference is usable for low volumes. For interactive, sub-100 ms decisions you want the model fully in GPU or unified memory — Nimble 9B averaged 91 ms per decision on an M5 Max MacBook Pro in Ollama's own demo.

Can I use a normal chat model like Llama or Qwen on /v1/systemone?

No. Ollama requires a local model trained for System One with compatible GGUF weights and a scoring-capable runner. Chat models, cloud models and MLX/Safetensors models are rejected.

Why not just ask a chat model for JSON?

You can, and for low volumes it works. A decision model returns a probability for every option, guarantees the schema, answers all your questions in one request, and is much faster per decision. Chat models give you one sampled string that you still have to parse and validate.

Which one should I start with?

nimble (9.5 GB download) if the analyzer says it fits your GPU or unified memory with room to spare; tev1 (4.5 GB) if it doesn't; tev1:0.8b (812 MB) for a CPU-only box or a quick test. clef (18 GB) and clef-flash (11 GB) are Cloudflare's newer models: they have no community Decision Index score yet, and Ollama's API reference lists them as the models that accept images, so choose one of them if you need to send photos or screenshots, and test it on your own examples. Then measure on your own examples before deciding whether you need a larger open reproduction.

In this cluster