Can I Run OLMo 2 on NVIDIA GeForce RTX 5080?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the OLMo 2 family runs on the NVIDIA GeForce RTX 5080.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA GeForce RTX 5080 16GB

NVIDIA GeForce RTX 5080 Specs

VRAM16 GB
Memory Bandwidth960 GB/s

OLMo 2 Variants That Fit

OLMo 2 13B InstructQ4_K_M · 8.5 GB · ~113 tok/s (est.)
OLMo 2 7B InstructQ4_K_M · 4.5 GB · ~213 tok/s (est.)

FAQ

Can I run OLMo 2 on the NVIDIA GeForce RTX 5080?

Yes — the OLMo 2 family runs on the NVIDIA GeForce RTX 5080.

Which OLMo 2 variant fits best on the NVIDIA GeForce RTX 5080?

OLMo 2 13B Instruct at Q4_K_M quantization (8.5 GB), estimated ~113 tokens/sec.

OLMo 2 on Other GPUs

Popular Models on the NVIDIA GeForce RTX 5080

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | OLMo 2 Model Page | NVIDIA GeForce RTX 5080 GPU Page | Check Your Hardware