d1-3B — VRAM & Python setup
作者： Jakub Rusinowski · 最后更新：
Liquid AI 基于 LFM2.5-VL-3B 的 3B 决策模型，支持文本和图像，面向边缘设备：RTX 4090 上每个问题 8 ms，Jetson Orin Nano 上 50 ms（厂商数据）。是 Python 库，而非服务器。
d1-3B 在 Q4_K_M 下约需 3 GB 显存——量化权重加框架开销，不含 KV 缓存。在 Apple Silicon 上，这部分来自统一内存。
Call d1-3B
A Python library: you load it inside your own program. It has no HTTP server and does not run in Ollama.
- Question types
- choice noul (yes / no) score
- Inputs
- text image
- Serve with
Transformers (trust_remote_code)
pip install "transformers>=5.14" torch torchvision pillowNot in the request builder: d1 is a Python library with no HTTP endpoint.
Related guides: Confidence, thresholds and calibration · Decision models on images
Other decision models: Nimble 9B · Tev1 4B · Tev1 0.8B · Winnow 12B · Winnow E4B · Decider 2B · Decider 4B · Decider 35B-A3B (NVFP4) · JevK5 4B · Intern-Decision 4B · AutoJev 27B · Laya · Clef 27B · Clef-Flash 9B · Rune 26B-A4B v3 · OpenDecider-nano · OpenDecider-small · OpenDecider-small MLX 4-bit · Bosun v3.1 0.6B · Bosun v3.1 1.7B · d1-omni-600M · THX-01 322M
Hardware fit
Weights plus overhead plus the KV cache at a 8,192-token prompt, on NVIDIA RTX 4090 (24 GB). A publisher build is sized from its file; the other rows are modelled at a standard quant. Decision requests are short, so no long-context figure is shown. Image tokens are not modelled: each image adds to the prompt, so a request with images needs more memory than these rows.
| 量化 | 显存 | 显存 | 适配 |
|---|---|---|---|
| BF16 Publisher build · 6.25 GB file | 7.9 GB | 可运行 | |
| Q4_K_M 4.83 bpw · modelled quant | 3.5 GB | 可运行 | |
| Q6_K 6.56 bpw · modelled quant | 4.2 GB | 可运行 | |
| Q8_0 8.50 bpw · modelled quant | 5 GB | 可运行 |
Published file size: BF16 6.25 GB. A download size from the model publisher — not a VRAM requirement.
How it was scored
Each table is one suite. Numbers in different tables were measured on different questions and are not comparable, with each other or with the Decision Index.
Decision Index 0.2.1 (snapshot 2026-09-28)
Decision Index 0.2.1Community Decision Index (not by the model's authors)d1 is not on the 28 September 2026 snapshot. Liquid AI scored it with the official scorer itself; that run is shown in its own table below and is not a leaderboard result. Community-maintained; not affiliated with the model authors.
Source ↗| What was scored | Score | Source |
|---|---|---|
| Balanced skill · 0.2.1 | 48.57 | Source ↗ |
Not a leaderboard submission, and not the community snapshot this site uses: Liquid AI ran the scorer itself.
| What was scored | Score | Source |
|---|---|---|
| Mean of 7 (SQuAD 2.0, Civil Comments, MASSIVE, PubMedQA, BoolQ, XNLI, PAWS-X) | 82.9% | Source ↗ |
| Mean of 8 (the 7 above plus HelpSteer2) | 77.1% | Source ↗ |
| What was scored | Score | Source |
|---|---|---|
| Mean, at most 1,000 rows each | 74.1% | Source ↗ |
Published latency
| Device | Time | Condition | Who measured it | Source |
|---|---|---|---|---|
| NVIDIA RTX 4090 | 8 ms | 1 question, warm, bf16, compiled as CUDA graphs (16 ms without) | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| AMD MI325X | 9 ms | 1 question, warm, bf16 | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| NVIDIA Jetson AGX Thor | 16 ms | 1 question, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| NVIDIA Jetson AGX Orin 64 GB | 26 ms | 1 question, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| NVIDIA Jetson Orin Nano | 50 ms | 1 question, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| Apple M5 Pro (mps) | 30 ms | 1 question, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| NVIDIA RTX 4090 | 17 ms | 384 px image, warm, bf16 | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| AMD MI325X | 18 ms | 384 px image, warm, bf16 | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| NVIDIA Jetson AGX Thor | 35 ms | 384 px image, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| NVIDIA Jetson AGX Orin 64 GB | 83 ms | 384 px image, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| NVIDIA Jetson Orin Nano | 202 ms | 384 px image, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
| Apple M5 Pro (mps) | 62 ms | 384 px image, warm | Authors' own internal benchmark — not independently reproduced | Source ↗ |
As published, on the device and under the condition shown. A decision model answers in one forward pass, so this is time per decision, not tokens per second.
Decision models are not ranked on chat, creative or coding scores.
规格
Verified — Checked against the primary source — the model card or the vendor spec page — and corroborated by a second independent source.
- 参数量
- 3.12B
- 上下文窗口
- 32K (32,768)
- 架构
- Fine-tune of LiquidAI/LFM2.5-VL-3B
- 提供商
- Liquid AI
- 许可证
- LFM Open License v1.0
- Availability
- Weights downloadable
- Practical deployment
- Edge device (phone, SBC)
- 规格量化
- Q4_K_M
- 系统内存
- 8 GB
- 记录更新于
- 2026-10-13
- Runs with
- Transformers: supported source
Weights are downloadable and commercial use is permitted, subject to the licence’s acceptable-use terms.
Commercial use is licensed only below $10M annual revenue; above that, a separate agreement.
d1 的其他尺寸
d1-3B — 常见问题
What is d1-3B?
d1-3B is a decision model: you send it a state and typed questions (choice, yes/no/unknown, or a score) and it returns one answer per question with a probability for every option. It is not a chat model.
How do I run d1-3B locally?
A Python library: you load it inside your own program. It has no HTTP server and does not run in Ollama. Install: `pip install "transformers>=5.14" torch torchvision pillow`.
How much memory does d1-3B need?
About 3 GB for the weights plus overhead at Q4_K_M, before the prompt's KV cache. Decision prompts are short, so the cache stays small.
How accurate is d1-3B?
It has no community Decision Index score. Every score on this page comes from its authors, on the suites named beside each table; none is an independent result.