Can I Run Mistral Small 3.1 on NVIDIA GeForce RTX 4090?

Written by Jakub Rusinowski · Last updated June 15, 2026

Yes — the Mistral Small 3.1 family runs on the NVIDIA GeForce RTX 4090.

NVIDIA GeForce RTX 4090 Specs

VRAM	24 GB
Memory Bandwidth	1008 GB/s

Mistral Small 3.1 Variants That Fit

Mistral Small 3.1 24B

Q4_K_M · 14.5 GB · ~70 tok/s (est.)

FAQ

Can I run Mistral Small 3.1 on the NVIDIA GeForce RTX 4090?

Yes — the Mistral Small 3.1 family runs on the NVIDIA GeForce RTX 4090.

Which Mistral Small 3.1 variant fits best on the NVIDIA GeForce RTX 4090?

Mistral Small 3.1 24B at Q4_K_M quantization (14.5 GB), estimated ~70 tokens/sec.

← Can I Run It? | Mistral Small 3.1 Model Page | NVIDIA GeForce RTX 4090 GPU Page | Check Your Hardware