Can I Run GPT-oss 120B on NVIDIA GeForce RTX 4070 Ti Super?

Name: LLM Configurator — GPU VRAM Checker
Author: LLM Configurator

Written by Jakub Rusinowski · Last updated August 15, 2026

No. GPT-oss 120B needs 72.5 GB at Q4_K_M and the NVIDIA GeForce RTX 4070 Ti Super has only 16 GB. No quantization we publish closes a gap that size.

The numbers

Model	GPT-oss 120B
Parameters	120B
Quantization	Q4_K_M
VRAM needed	72.5 GB
NVIDIA GeForce RTX 4070 Ti Super VRAM	16 GB
Verdict	Does not fit

What to do next

Either step down to a smaller size in this family, or move to a NVIDIA A100 80GB (80 GB), the cheapest card we track with enough VRAM.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Cheapest card we track with enough VRAM for GPT-oss 120B:

NVIDIA A100 80GB PCIe

80 GB VRAM · 300 W board power

2026 prices are volatile — check the current listing.

Check price on Amazon

Won't fit — rent GPT-oss 120B instead

GPT-oss 120B needs ~72 GB but this GPU has 16 GB. Rent a A100 (80 GB)-class GPU by the hour instead of buying one:

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

Vast.ai $0.77/hr · typical low · varies

Rent on Vast.ai →

RunPod $1.39/hr

Rent on RunPod →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

Other GPT-OSS sizes on the NVIDIA GeForce RTX 4070 Ti Super

GPT-OSS 20B — runs (10.6 GB)

GPT-oss 120B on nearby hardware

Intel Arc B580 (12 GB) — does not fit
AMD Radeon RX 7900 XT (20 GB) — does not fit

All GPT-OSS sizes on the NVIDIA GeForce RTX 4070 Ti Super | VRAM calculator for GPT-oss 120B | NVIDIA GeForce RTX 4070 Ti Super GPU page | Check your hardware