Can I Run Mistral Small 4 on NVIDIA GeForce RTX 5090?

Written by Jakub Rusinowski · Last updated June 15, 2026

Yes — the Mistral Small 4 family runs on the NVIDIA GeForce RTX 5090.

NVIDIA GeForce RTX 5090 Specs

VRAM32 GB
Memory Bandwidth1792 GB/s

Mistral Small 4 Variants That Fit

Mistral Small 4 119B-A6.5BQ4_K_M · 24 GB · ~400 tok/s (est.)

FAQ

Can I run Mistral Small 4 on the NVIDIA GeForce RTX 5090?

Yes — the Mistral Small 4 family runs on the NVIDIA GeForce RTX 5090.

Which Mistral Small 4 variant fits best on the NVIDIA GeForce RTX 5090?

Mistral Small 4 119B-A6.5B at Q4_K_M quantization (24 GB), estimated ~400 tokens/sec.

← Can I Run It? | Mistral Small 4 Model Page | NVIDIA GeForce RTX 5090 GPU Page | Check Your Hardware