Mistral Large 3 675B-A41B — VRAM, Speed & Local Setup

Written by Jakub Rusinowski · Last updated June 26, 2026

Model library → Mistral Large 3 → Mistral Large 3 675B-A41B

PREVIEW — unverified. ~675B-total MoE with ~41B active per token, multimodal, Apache 2.0, 256K context. At Q4 it needs ~400 GB — an 8×80 GB server or equivalent. Apache 2.0 would make it one of the most permissive frontier-scale open weights if confirmed. Verify against the Hugging Face model card.

Mistral Large 3 675B-A41B needs about 408 GB of VRAM at Q4_K_M — quantized weights plus framework overhead, before any KV cache. On Apple Silicon that figure comes out of unified memory.

Specifications

Parameters675 Billion (41B active)
Context window256,000
ArchitectureMixture-of-Experts (multimodal)
ProviderMistral AI
LicenceApache 2.0
Specified atQ4_K_M
System RAM1024 GB
Record updated2026-06-26

Licence

Apache-2.0 — commercial use permitted. Commercial use permitted. No usage restrictions beyond attribution.

VRAM and Speed by Quantization

Modelled on a reference NVIDIA RTX 4090 (24 GB), with no KV cache (this record has no published architecture). Speed figures are ESTIMATES from the memory-bandwidth roofline described on the methodology page, not benchmarks we ran — rows marked measured come from published or reader-submitted runs. VRAM here includes the KV cache, so it reads higher than the headline figure above, which does not.

QuantWeightsVRAM neededEst. speedFit on 24 GB
Q2_K221.9 GB222.7 GB—Won't fit
Q3_K_M287.7 GB288.5 GB—Won't fit
Q4_K_M407.5 GB408.3 GB—Won't fit
Q5_K_M478.4 GB479.2 GB—Won't fit
Q6_K553.5 GB554.3 GB—Won't fit
Q8_0717.2 GB718.0 GB—Won't fit
F161350.0 GB1350.8 GB—Won't fit

Want the memory numbers alone, at every quantization level and your own context length? Use the Mistral Large 3 675B-A41B VRAM calculator.

Buy This HardwareApple Mac Studio M3 Ultra — 512 GB VRAM · 60 W board powerDeploy in the Cloud NowRunPod

or compare on Vast.ai

As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.

Recommended GPU

The cheapest catalogued GPU that runs Mistral Large 3 675B-A41B is the Apple M3 Ultra (512 GB).

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.
Apple Mac Studio M3 Ultra
512 GB VRAM · 60 W board power
2026 prices are volatile — check the current listing.
Check price on Amazon

How to Run Mistral Large 3 675B-A41B

Install Ollama, then run:

ollama run mistral-large-3

Weights on Hugging Face: mistralai/Mistral-Large-3.

Best for: frontier tasks, multimodal, enterprise, research.

Can I Run Mistral Large 3 675B-A41B on My GPU?

Mistral Large 3 675B-A41B — Frequently Asked Questions

How much VRAM does Mistral Large 3 675B-A41B need?
About 408 GB at Q4_K_M — quantized weights plus framework overhead, before any KV cache. The cache grows with context length and is added on top; the table above folds it in. Apple Silicon counts unified memory toward the same figure.
Does Mistral Large 3 675B-A41B run on an RTX 4090 (24 GB)?
No. Mistral Large 3 675B-A41B needs about 408 GB at Q4_K_M, more than a single RTX 4090's 24 GB. It needs a larger card, several GPUs, or Apple Silicon with enough unified memory — or it runs with part of the weights offloaded to system RAM, which is much slower.
How do I run Mistral Large 3 675B-A41B locally?
Install Ollama and run `ollama run mistral-large-3`. That pulls the weights and starts a local OpenAI-compatible endpoint; after the download nothing leaves the machine.

← All Mistral Large 3 models | VRAM calculator | Check your own hardware