Can I Run Mistral Small 3.1 on NVIDIA GeForce RTX 4090?

作者： Jakub Rusinowski · 最后更新： 2026年6月15日

Yes — the Mistral Small 3.1 family runs on the NVIDIA GeForce RTX 4090.

NVIDIA GeForce RTX 4090 Specs

VRAM	24 GB
Memory Bandwidth	1008 GB/s

Mistral Small 3.1 Variants That Fit

Mistral Small 3.1 24B

Q4_K_M · 14.5 GB · ~70 tok/s (est.)

FAQ

Can I run Mistral Small 3.1 on the NVIDIA GeForce RTX 4090?

Yes — the Mistral Small 3.1 family runs on the NVIDIA GeForce RTX 4090.

Which Mistral Small 3.1 variant fits best on the NVIDIA GeForce RTX 4090?

Mistral Small 3.1 24B at Q4_K_M quantization (14.5 GB), estimated ~70 tokens/sec.

← Can I Run It? | Mistral Small 3.1 Model Page | NVIDIA GeForce RTX 4090 GPU Page | Check Your Hardware