Can I Run Devstral-2 on NVIDIA H100 80GB?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the Devstral-2 family runs on the NVIDIA H100 80GB.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA H100 80GB PCIe

NVIDIA H100 80GB Specs

VRAM80 GB
Memory Bandwidth2000 GB/s

Devstral-2 Variants That Fit

Devstral-2 123BQ4_K_M · 68 GB · ~90 tok/s (est.)
Devstral-2 22BQ4_K_M · 13 GB · ~154 tok/s (est.)

FAQ

Can I run Devstral-2 on the NVIDIA H100 80GB?

Yes — the Devstral-2 family runs on the NVIDIA H100 80GB.

Which Devstral-2 variant fits best on the NVIDIA H100 80GB?

Devstral-2 123B at Q4_K_M quantization (68 GB), estimated ~90 tokens/sec.

Devstral-2 on Other GPUs

Popular Models on the NVIDIA H100 80GB

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | Devstral-2 Model Page | NVIDIA H100 80GB GPU Page | Check Your Hardware