Can I Run OLMo 2 on NVIDIA GeForce RTX 3080 (10GB)?

作者: Jakub Rusinowski · 最后更新: 2026年7月10日

Yes — the OLMo 2 family runs on the NVIDIA GeForce RTX 3080 (10GB).

联盟营销声明: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

在亚马逊查看价格 — NVIDIA GeForce RTX 3080 10GB

NVIDIA GeForce RTX 3080 (10GB) Specs

VRAM10 GB
Memory Bandwidth760 GB/s

OLMo 2 Variants That Fit

OLMo 2 13B InstructQ4_K_M · 8.5 GB · ~89 tok/s (est.)
OLMo 2 7B InstructQ4_K_M · 4.5 GB · ~169 tok/s (est.)

FAQ

Can I run OLMo 2 on the NVIDIA GeForce RTX 3080 (10GB)?

Yes — the OLMo 2 family runs on the NVIDIA GeForce RTX 3080 (10GB).

Which OLMo 2 variant fits best on the NVIDIA GeForce RTX 3080 (10GB)?

OLMo 2 13B Instruct at Q4_K_M quantization (8.5 GB), estimated ~89 tokens/sec.

OLMo 2 on Other GPUs

Popular Models on the NVIDIA GeForce RTX 3080 (10GB)

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | OLMo 2 Model Page | NVIDIA GeForce RTX 3080 (10GB) GPU Page | Check Your Hardware