Can I Run GPT-oss 120B on NVIDIA A100 80GB?
Written by Jakub Rusinowski · Last updated July 10, 2026
Yes — the GPT-oss 120B family runs on the NVIDIA A100 80GB.
Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.
Check price on Amazon — NVIDIA A100 80GB PCIe
NVIDIA A100 80GB Specs
| VRAM | 80 GB |
| Memory Bandwidth | 1935 GB/s |
GPT-oss 120B Variants That Fit
| GPT-oss 120B | Q4_K_M · 65 GB · ~30 tok/s (est.) |
FAQ
Can I run GPT-oss 120B on the NVIDIA A100 80GB?
Yes — the GPT-oss 120B family runs on the NVIDIA A100 80GB.
Which GPT-oss 120B variant fits best on the NVIDIA A100 80GB?
GPT-oss 120B at Q4_K_M quantization (65 GB), estimated ~30 tokens/sec.
GPT-oss 120B on Other GPUs
Popular Models on the NVIDIA A100 80GB
VRAM Tier
Troubleshooting
Buying Guide
← Can I Run It? | GPT-oss 120B Model Page | NVIDIA A100 80GB GPU Page | Check Your Hardware