PC Build to Run Mistral Small 3 (24B) Locally (Q8_0)
Written by Jakub Rusinowski · Last updated January 28, 2025
A complete parts list — GPU, motherboard, RAM and PSU — worked backward from Mistral Small 3 (24B)'s VRAM requirement at Q8_0. Prices are 2026 street estimates and vary.
Requirements
| VRAM required | ~28 GB at Q8_0 |
| System RAM | 32 GB |
| Estimated speed | ~81 tok/s |
| Complete build (est.) | $3,264 |
or compare on Vast.ai
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.
GPU: NVIDIA GeForce RTX 5090
NVIDIA GeForce RTX 5090's 32 GB covers Mistral Small 3 (24B) at Q8_0 (~28 GB needed), with headroom.
NVIDIA GeForce RTX 5090 32GB
32 GB VRAM · 575 W board power
2026 prices are volatile — check the current listing.
Motherboard: ASUS ProArt X670E-Creator WIFI
X670E (AM5) — pairs with the AMD Ryzen 9 7900X; DDR5, dual PCIe 5.0 x16 (x8/x8) for multi-GPU, 4 DIMM slots to 192 GB.
ASUS ProArt X670E-Creator WIFI
2026 prices are volatile — check the current listing.
RAM: Corsair Vengeance 32GB (2x16GB) DDR5-6000 C30 (AMD EXPO)
32 GB DDR5-6000 (2x16GB) meets Mistral Small 3 (24B)'s 32 GB recommended system RAM.
Corsair Vengeance 32GB (2x16GB) DDR5-6000 C30
2026 prices are volatile — check the current listing.
PSU: Corsair RM1000e (ATX 3.1)
1000 W 80+ Gold covers NVIDIA GeForce RTX 5090 (575 W) + CPU 170 W with 30% headroom (~969 W required).
Corsair RM1000e (ATX 3.1)
2026 prices are volatile — check the current listing.
Swap Alternatives
- GPU: NVIDIA RTX 6000 Ada Generation — NVIDIA RTX 6000 Ada Generation's 48 GB covers Mistral Small 3 (24B) at Q8_0 (~28 GB needed), with headroom.
- GPU: NVIDIA RTX PRO 6000 Blackwell — NVIDIA RTX PRO 6000 Blackwell's 96 GB covers Mistral Small 3 (24B) at Q8_0 (~28 GB needed), with headroom.
- RAM: Corsair Vengeance 64GB (2x32GB) DDR5-6000 C30 (AMD EXPO) — More headroom: 64 GB DDR5-6000.
- PSU: Corsair HX1500i (ATX 3.1) — More headroom / future dual-GPU: 1500 W 80+ Platinum.
- The Corsair RM1000e (ATX 3.1) ships a native 12V-2x6 cable for the NVIDIA GeForce RTX 5090.
FAQ
What GPU do I need to run Mistral Small 3 (24B) at Q8_0?
NVIDIA GeForce RTX 5090's 32 GB covers Mistral Small 3 (24B) at Q8_0 (~28 GB needed), with headroom.
How much VRAM does Mistral Small 3 (24B) need at Q8_0?
About 28 GB of VRAM plus 32 GB of system RAM.
What power supply does a NVIDIA GeForce RTX 5090 build need?
1000 W 80+ Gold covers NVIDIA GeForce RTX 5090 (575 W) + CPU 170 W with 30% headroom (~969 W required).
How much does a Mistral Small 3 (24B) PC cost?
About $3,264 for a complete build (GPU, motherboard, RAM, PSU, CPU, case, SSD), at 2026 street-price estimates.
Mistral Small 3 (24B) at Other Quant Levels
Other Popular Build Targets
Model & GPU
More Ways to Build
← Budget-first build recommender | Mistral Family model page | NVIDIA GeForce RTX 5090 review