Liquid AI3B~3 GB VRAM przy Q4_K_M

d1-3B — VRAM & Python setup

Autor: Jakub Rusinowski · Ostatnia aktualizacja:

Model decyzyjny 3B od Liquid AI na LFM2.5-VL-3B, dla tekstu i obrazów, zaprojektowany na urządzenia brzegowe: 8 ms na pytanie na RTX 4090 i 50 ms na Jetson Orin Nano (dane producenta). Biblioteka Pythona, nie serwer.

d1-3B potrzebuje około 3 GB VRAM przy Q4_K_M — skwantyzowane wagi plus narzut frameworka, bez pamięci podręcznej KV. Na Apple Silicon ta wartość pochodzi z pamięci zunifikowanej.

Call d1-3B

A Python library: you load it inside your own program. It has no HTTP server and does not run in Ollama.

Question types
choice noul (yes / no) score
Inputs
text image
Serve with
Transformers (trust_remote_code)
pip install "transformers>=5.14" torch torchvision pillow
Wagi na Hugging Face: LiquidAI/d1-3B ↗

Decision models guide

Not in the request builder: d1 is a Python library with no HTTP endpoint.

Related guides: Confidence, thresholds and calibration · Decision models on images

Other decision models: Nimble 9B · Tev1 4B · Tev1 0.8B · Winnow 12B · Winnow E4B · Decider 2B · Decider 4B · Decider 35B-A3B (NVFP4) · JevK5 4B · Intern-Decision 4B · AutoJev 27B · Laya · Clef 27B · Clef-Flash 9B · Rune 26B-A4B v3 · OpenDecider-nano · OpenDecider-small · OpenDecider-small MLX 4-bit · Bosun v3.1 0.6B · Bosun v3.1 1.7B · d1-omni-600M · THX-01 322M

Hardware fit

Weights plus overhead plus the KV cache at a 8,192-token prompt, on NVIDIA RTX 4090 (24 GB). A publisher build is sized from its file; the other rows are modelled at a standard quant. Decision requests are short, so no long-context figure is shown. Image tokens are not modelled: each image adds to the prompt, so a request with images needs more memory than these rows.

Kwant.VRAMDopasowanie
BF16
Publisher build · 6.25 GB file
7.9 GBMieści się
Q4_K_M
4.83 bpw · modelled quant
3.5 GBMieści się
Q6_K
6.56 bpw · modelled quant
4.2 GBMieści się
Q8_0
8.50 bpw · modelled quant
5 GBMieści się

Published file size: BF16 6.25 GB. A download size from the model publisher — not a VRAM requirement.

How it was scored

Each table is one suite. Numbers in different tables were measured on different questions and are not comparable, with each other or with the Decision Index.

Decision Index 0.2.1 (snapshot 2026-09-28)

Decision Index 0.2.1Community Decision Index (not by the model's authors)
Balanced skill—

d1 is not on the 28 September 2026 snapshot. Liquid AI scored it with the official scorer itself; that run is shown in its own table below and is not a leaderboard result. Community-maintained; not affiliated with the model authors.

Source ↗
Decision Index 0.2.1 suite, scored by Liquid AI with the official scorer — Run by the authors on a public third-party harness
What was scoredScoreSource
Balanced skill · 0.2.148.57Source ↗

Not a leaderboard submission, and not the community snapshot this site uses: Liquid AI ran the scorer itself.

Public benchmarks read as decisions (Liquid AI’s own run) — Authors' own internal benchmark — not independently reproduced
What was scoredScoreSource
Mean of 7 (SQuAD 2.0, Civil Comments, MASSIVE, PubMedQA, BoolQ, XNLI, PAWS-X)82.9%Source ↗
Mean of 8 (the 7 above plus HelpSteer2)77.1%Source ↗
11 public image benchmarks read as decisions (Liquid AI’s own run) — Authors' own internal benchmark — not independently reproduced
What was scoredScoreSource
Mean, at most 1,000 rows each74.1%Source ↗

Published latency

DeviceTimeConditionWho measured itSource
NVIDIA RTX 40908 ms1 question, warm, bf16, compiled as CUDA graphs (16 ms without)Authors' own internal benchmark — not independently reproducedSource ↗
AMD MI325X9 ms1 question, warm, bf16Authors' own internal benchmark — not independently reproducedSource ↗
NVIDIA Jetson AGX Thor16 ms1 question, warmAuthors' own internal benchmark — not independently reproducedSource ↗
NVIDIA Jetson AGX Orin 64 GB26 ms1 question, warmAuthors' own internal benchmark — not independently reproducedSource ↗
NVIDIA Jetson Orin Nano50 ms1 question, warmAuthors' own internal benchmark — not independently reproducedSource ↗
Apple M5 Pro (mps)30 ms1 question, warmAuthors' own internal benchmark — not independently reproducedSource ↗
NVIDIA RTX 409017 ms384 px image, warm, bf16Authors' own internal benchmark — not independently reproducedSource ↗
AMD MI325X18 ms384 px image, warm, bf16Authors' own internal benchmark — not independently reproducedSource ↗
NVIDIA Jetson AGX Thor35 ms384 px image, warmAuthors' own internal benchmark — not independently reproducedSource ↗
NVIDIA Jetson AGX Orin 64 GB83 ms384 px image, warmAuthors' own internal benchmark — not independently reproducedSource ↗
NVIDIA Jetson Orin Nano202 ms384 px image, warmAuthors' own internal benchmark — not independently reproducedSource ↗
Apple M5 Pro (mps)62 ms384 px image, warmAuthors' own internal benchmark — not independently reproducedSource ↗

As published, on the device and under the condition shown. A decision model answers in one forward pass, so this is time per decision, not tokens per second.

Decision models are not ranked on chat, creative or coding scores.

Specyfikacja

Verified — Checked against the primary source — the model card or the vendor spec page — and corroborated by a second independent source.

Parametry
3.12B
Okno kontekstu
32K (32,768)
Architektura
Fine-tune of LiquidAI/LFM2.5-VL-3B
Dostawca
Liquid AI
Licencja
LFM Open License v1.0
Availability
Weights downloadable
Practical deployment
Edge device (phone, SBC)
Określono przy
Q4_K_M
RAM systemowy
8 GB
Rekord zaktualizowany
2026-10-13
LicencjaLFM Open License v1.0Użycie komercyjne dozwolone

Weights are downloadable and commercial use is permitted, subject to the licence’s acceptable-use terms.

Commercial use is licensed only below $10M annual revenue; above that, a separate agreement.

Inne rozmiary d1

d1-3B — najczęściej zadawane pytania

What is d1-3B?

d1-3B is a decision model: you send it a state and typed questions (choice, yes/no/unknown, or a score) and it returns one answer per question with a probability for every option. It is not a chat model.

How do I run d1-3B locally?

A Python library: you load it inside your own program. It has no HTTP server and does not run in Ollama. Install: `pip install "transformers>=5.14" torch torchvision pillow`.

How much memory does d1-3B need?

About 3 GB for the weights plus overhead at Q4_K_M, before the prompt's KV cache. Decision prompts are short, so the cache stays small.

How accurate is d1-3B?

It has no community Decision Index score. Every score on this page comes from its authors, on the suites named beside each table; none is an independent result.