VibeThinker 1.5B — VRAM, Speed & Local Setup

Written by Jakub Rusinowski · Last updated September 6, 2026

Model libraryVibeThinker → VibeThinker 1.5B

The original VibeThinker, fine-tuned from Qwen2.5-Math-1.5B. Reports 80.3 / 74.4 / 50.4 on AIME24, AIME25 and HMMT25 — above DeepSeek R1 on those three at roughly 1/400th the parameter count. Under 2 GB at Q4_K_M, so it runs on a phone.

VibeThinker 1.5B needs about 2 GB of VRAM at Q4_K_M — quantized weights plus framework overhead, before any KV cache. On Apple Silicon that figure comes out of unified memory.

Specifications

Parameters1.54 Billion
Context window131,072
ArchitectureDense Transformer (Qwen2.5-Math-1.5B base)
ProviderWeiboAI
LicenceMIT
Specified atQ4_K_M
System RAM4 GB
Record updated2026-09-06

Licence

MITcommercial use permitted. Commercial use permitted. No usage restrictions beyond attribution.

VRAM and Speed by Quantization

Modelled on a reference NVIDIA RTX 4090 (24 GB), with no KV cache (this record has no published architecture). Speed figures are ESTIMATES from the memory-bandwidth roofline described on the methodology page, not benchmarks we ran — rows marked measured come from published or reader-submitted runs. VRAM here includes the KV cache, so it reads higher than the headline figure above, which does not.

QuantWeightsVRAM neededEst. speedFit on 24 GB
Q2_K0.5 GB1.3 GB~298 tok/s (est.)Fits comfortably
Q3_K_M0.7 GB1.5 GB~281 tok/s (est.)Fits comfortably
Q4_K_M0.9 GB1.7 GB~255 tok/s (est.)Fits comfortably
Q5_K_M1.1 GB1.9 GB~242 tok/s (est.)Fits comfortably
Q6_K1.3 GB2.1 GB~229 tok/s (est.)Fits comfortably
Q8_01.6 GB2.4 GB~206 tok/s (est.)Fits comfortably
F163.1 GB3.9 GB~148 tok/s (est.)Fits comfortably

Want the memory numbers alone, at every quantization level and your own context length? Use the VibeThinker 1.5B VRAM calculator.

Buy This HardwareIntel Arc B570 10GB — 10 GB VRAM · 150 W board powerDeploy in the Cloud NowRTX 4090 on RunPod — from $0.34/hr · rate checked 2026-07

or compare on Vast.ai from $0.35/hr (typical low · varies)

As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.

Recommended GPU

The cheapest catalogued GPU that runs VibeThinker 1.5B is the Intel Arc B570 (10 GB).

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.
Intel Arc B570 10GB
10 GB VRAM · 150 W board power
2026 prices are volatile — check the current listing.
Check price on Amazon

How to Run VibeThinker 1.5B

Install Ollama, then run:

ollama run vibethinker

Weights on Hugging Face: WeiboAI/VibeThinker-1.5B.

Published Benchmark Scores

Quality scores as published by the model's authors or an independent evaluator — not throughput, and not measured by us.

BenchmarkScoreProvenance
AIME 202480.3 / 100 %vendor-claimed · https://github.com/WeiboAI/VibeThinker
AIME 202574.4 / 100 %vendor-claimed · https://github.com/WeiboAI/VibeThinker

Best for: reasoning, math, edge devices, research.

Can I Run VibeThinker 1.5B on My GPU?

Other VibeThinker Sizes

VibeThinker 1.5B — Frequently Asked Questions

How much VRAM does VibeThinker 1.5B need?
About 2 GB at Q4_K_M — quantized weights plus framework overhead, before any KV cache. The cache grows with context length and is added on top; the table above folds it in. Apple Silicon counts unified memory toward the same figure.
Does VibeThinker 1.5B run on an RTX 4090 (24 GB)?
Yes. VibeThinker 1.5B needs about 2 GB at Q4_K_M, inside a 24 GB card, at an estimated 255 tokens/sec.
How do I run VibeThinker 1.5B locally?
Install Ollama and run `ollama run vibethinker`. That pulls the weights and starts a local OpenAI-compatible endpoint; after the download nothing leaves the machine.
What other sizes does VibeThinker come in?
VibeThinker 3B (3 GB), VibeThinker 1.5B (2 GB). Every size shares the family's training and licence; the larger ones score higher and need proportionally more memory.

← All VibeThinker models | VRAM calculator | Check your own hardware