Can I Run InternLM 3 on NVIDIA GeForce RTX 4090?

Written by Jakub Rusinowski · Last updated July 10, 2026

Yes — the InternLM 3 family runs on the NVIDIA GeForce RTX 4090.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Check price on Amazon — NVIDIA GeForce RTX 4090 24GB

NVIDIA GeForce RTX 4090 Specs

VRAM24 GB
Memory Bandwidth1008 GB/s

InternLM 3 Variants That Fit

InternLM 3 20B InstructQ4_K_M · 12.5 GB · ~81 tok/s (est.)
InternLM 3 8B InstructQ4_K_M · 5.5 GB · ~183 tok/s (est.)

FAQ

Can I run InternLM 3 on the NVIDIA GeForce RTX 4090?

Yes — the InternLM 3 family runs on the NVIDIA GeForce RTX 4090.

Which InternLM 3 variant fits best on the NVIDIA GeForce RTX 4090?

InternLM 3 20B Instruct at Q4_K_M quantization (12.5 GB), estimated ~81 tokens/sec.

InternLM 3 on Other GPUs

Popular Models on the NVIDIA GeForce RTX 4090

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | InternLM 3 Model Page | NVIDIA GeForce RTX 4090 GPU Page | Check Your Hardware