Phi-4 Mini (3.8B) — VRAM Requirements

Autor: Jakub Rusinowski · Ostatnia aktualizacja: 21 lipca 2026

How much GPU VRAM you need to run Phi-4 Mini Phi-4 Mini (3.8B) by Microsoft locally, a 3.8B-parameter model. Figures are quantized weights + KV cache + framework overhead from a memory-bandwidth roofline model.

Phi-4 Mini (3.8B) needs about 3 GB VRAM at Q4_K_M.

VRAM by Quantization

QuantBits/weightWeightsTotal VRAM
Q2_K2.631.2 GB2.0 GB
Q3_K_M3.411.6 GB2.4 GB
Q4_K_M4.832.3 GB3.1 GB
Q5_K_M5.672.7 GB3.5 GB
Q6_K6.563.1 GB3.9 GB
Q8_08.504.0 GB4.8 GB
F1616.007.6 GB8.4 GB

Switch quantization in the interactive calculator, or see the full Phi-4 Mini model page.

Add this badge to your model card

Model creators: paste this into your Hugging Face model card README to link readers straight to this VRAM breakdown.

VRAM Requirements

[![VRAM Requirements](https://img.shields.io/badge/Check_VRAM-LLM_Configurator-blue)](https://llmconfigurator.com/en/vram-calculator/phi-4-mini-3.8b)

Estimates only — actual VRAM varies with context length, batch size, runtime and KV-cache settings.