Nimble 9B — VRAM & /v1/systemone setup

Call Nimble 9B

Pull it with Ollama 0.35 or newer, then POST to /v1/systemone. Do not use ollama chat commands — this is not a chat model.

Question types

choice noul (yes / no) score

Inputs

text

Max candidates per question

255

Serve with

ollama pull nimble

Endpoint

/v1/systemone

curl http://localhost:11434/v1/systemone \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "nimble",
    "state": {
      "ticket": "I was charged twice. Please refund the extra payment."
    },
    "questions": {
      "team": {
        "type": "choice",
        "instructions": "Which team should handle this ticket?",
        "criteria": {
          "billing": "Payments and refunds",
          "technical": "Bugs and integrations",
          "other": "None of the above"
        }
      }
    }
  }'

Build a request for this model → Decision models guide

Other decision models: Tev1 4B · Tev1 0.8B · Winnow 12B · Winnow E4B · Decider 2B · Decider 4B · Decider 35B-A3B (NVFP4) · JevK5 4B · Intern-Decision 4B · AutoJev 27B · Laya · Clef 27B · Clef-Flash 9B · Rune 26B-A4B v3 · OpenDecider-nano · OpenDecider-small · OpenDecider-small MLX 4-bit · Bosun v3.1 0.6B · Bosun v3.1 1.7B · d1-3B · d1-omni-600M · THX-01 322M

Hardware fit

Weights plus overhead plus the KV cache at a 8,192-token prompt, on NVIDIA RTX 4090 (24 GB). A publisher build is sized from its file; the other rows are modelled at a standard quant. Decision requests are short, so no long-context figure is shown.

Published file size: Ollama build 9.5 GB. A download size from the model publisher — not a VRAM requirement.

Ollama build is 9.5 GB. Which Bespoke checkpoint the tag packages (Sep 24 update vs original-2676) is not stated in one place; do not print a version.

How it was scored

Two different suites on two different scales. Never compare the numbers across the two cards.

Published latency

As published, on the device and under the condition shown. A decision model answers in one forward pass, so this is time per decision, not tokens per second.

The Index scored the repository bespokelabs/Bespoke-Nimble-9B-v2, not the checkpoint this page describes.

Decision models are not ranked on chat, creative or coding scores.

规格

Verified — Checked against the primary source — the model card or the vendor spec page — and corroborated by a second independent source.

参数量

9.65B

上下文窗口

8K (prompt limit)

架构

Fine-tune of Qwen/Qwen3.5-9B

提供商

Bespoke Labs

许可证

Apache-2.0

Practical deployment

Laptop

规格量化

Q4_K_M

系统内存

14 GB

记录更新于

2026-09-30

Nimble 9B — 常见问题