Can I Run Mistral Family on NVIDIA GeForce RTX 4090?

Written by Jakub Rusinowski · Last updated June 15, 2026

Yes — the Mistral Family family runs on the NVIDIA GeForce RTX 4090.

NVIDIA GeForce RTX 4090 Specs

VRAM	24 GB
Memory Bandwidth	1008 GB/s

Mistral Family Variants That Fit

Mistral Small 3 (24B)	Q4_K_M · 14.5 GB · ~70 tok/s (est.)
Mistral NeMo 12B	Q4_K_M · 8.5 GB · ~119 tok/s (est.)

FAQ

Can I run Mistral Family on the NVIDIA GeForce RTX 4090?

Yes — the Mistral Family family runs on the NVIDIA GeForce RTX 4090.

Which Mistral Family variant fits best on the NVIDIA GeForce RTX 4090?

Mistral Small 3 (24B) at Q4_K_M quantization (14.5 GB), estimated ~70 tokens/sec.

← Can I Run It? | Mistral Family Model Page | NVIDIA GeForce RTX 4090 GPU Page | Check Your Hardware