Can I Run InternLM 3 on NVIDIA GeForce RTX 3090?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the InternLM 3 family runs on the NVIDIA GeForce RTX 3090.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA GeForce RTX 3090 24GB

NVIDIA GeForce RTX 3090 Specs

VRAM24 GB
Memory Bandwidth936 GB/s

InternLM 3 Variants That Fit

InternLM 3 20B InstructQ4_K_M · 12.5 GB · ~75 tok/s (est.)
InternLM 3 8B InstructQ4_K_M · 5.5 GB · ~170 tok/s (est.)

FAQ

Can I run InternLM 3 on the NVIDIA GeForce RTX 3090?

Yes — the InternLM 3 family runs on the NVIDIA GeForce RTX 3090.

Which InternLM 3 variant fits best on the NVIDIA GeForce RTX 3090?

InternLM 3 20B Instruct at Q4_K_M quantization (12.5 GB), estimated ~75 tokens/sec.

InternLM 3 on Other GPUs

Popular Models on the NVIDIA GeForce RTX 3090

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | InternLM 3 Model Page | NVIDIA GeForce RTX 3090 GPU Page | Check Your Hardware