Can I Run Mistral Family on NVIDIA GeForce RTX 3090?

Written by Jakub Rusinowski · Last updated June 15, 2026

Yes — the Mistral Family family runs on the NVIDIA GeForce RTX 3090.

NVIDIA GeForce RTX 3090 Specs

VRAM24 GB
Memory Bandwidth936 GB/s

Mistral Family Variants That Fit

Mistral Small 3 (24B)Q4_K_M · 14.5 GB · ~65 tok/s (est.)
Mistral NeMo 12BQ4_K_M · 8.5 GB · ~110 tok/s (est.)

FAQ

Can I run Mistral Family on the NVIDIA GeForce RTX 3090?

Yes — the Mistral Family family runs on the NVIDIA GeForce RTX 3090.

Which Mistral Family variant fits best on the NVIDIA GeForce RTX 3090?

Mistral Small 3 (24B) at Q4_K_M quantization (14.5 GB), estimated ~65 tokens/sec.

← Can I Run It? | Mistral Family Model Page | NVIDIA GeForce RTX 3090 GPU Page | Check Your Hardware