AI station / mini-PC
RTX 4090 Desktop (24 GB VRAM, 64 GB RAM) — Local LLM Performance
RTX 4090 Desktop (24 GB VRAM, 64 GB RAM) is a Desktop running Windows or Linux, with 24 GB VRAM + 64 GB system RAM.
Specifications
- Memory for models
- 24 GB
- Memory bandwidth
- 1,008 GB/s
- Memory upgradeable
- Yes
- Architecture
- Ada Lovelace AD102
- Form factor
- Desktop
- Operating system
- Windows or Linux
- Released
- 2022
- Llama 3.1 8B Q4_K_M
- 86–165 tok/s
Worth knowing before you buy
- 24 GB is the sweet spot for 27–32B models at Q4; 70B needs offload or a second card.
Models on the RTX 4090 desktop
- Yi 1.5 FamilyYes, but it is tight
- VibeThinkerYes — comfortably
- Aya 3B (Tiny Aya)Yes — comfortably
- StarCoder 2Yes — comfortably
- SmolLM3Yes — comfortably
- SmolLM2Yes — comfortably
- Qwen3-CoderYes, but it is tight
- Qwen3.8Yes
- Qwen 3.6Yes, but it is tight
- Qwen 3.5Yes, but it is tight
- Qwen 3Yes, but it is tight
- Qwen 2.5 VLYes — comfortably
- Qwen 2.5 FamilyYes, but it is tight
- Poolside Laguna XS 2.1Yes, but it is tight
- Phi-4 MiniYes — comfortably
- Phi-4 FamilyYes — comfortably
- Phi 3.5 FamilyYes — comfortably
- OLMo 2Yes, but it is tight
- North Mini CodeYes, but it is tight
- Nex-N2Yes, but it is tight
- Nex-N2.5Yes, but it is tight
- Nemotron Cascade 2Yes, but it is tight
- Nemotron 3 Nano OmniYes, but it is tight
- Mistral Small 3.1Yes
- Mistral Small 3.2Yes
- Mistral FamilyYes, but it is tight
- MinistralYes — comfortably
- Ministral 3Yes — comfortably
- MiniCPM-VYes — comfortably
- Magistral SmallYes, but it is tight
- Llama 3.2 VisionYes — comfortably
- Llama 3.2 FamilyYes — comfortably
- Llama 3.1 FamilyYes — comfortably
- LFM2.5Yes
- InternLM 3Yes, but it is tight
- IBM Granite 4.0Yes, but it is tight
- IBM Granite 4.2Yes, but it is tight
- IBM Granite 4.1Yes, but it is tight
- Granite 3.0Yes — comfortably
- GPT-OSSYes, but it is tight
- GLM-4.7 / GLM-Z1Yes, but it is tight
- GLM-5 / GLM-5.1No
- Gemma 4Yes
- Gemma 3nYes — comfortably
- Gemma 3Yes
- Gemma 2 FamilyYes — comfortably
- Falcon 3Yes — comfortably
- EXAONE 3.5Yes, but it is tight
- DevstralYes, but it is tight
- DeepSeek R1Yes, but it is tight
- DeepSeek-OCRYes — comfortably
- Cosmos 3Yes
- Command R FamilyYes, but it is tight
- Cogito v1Yes, but it is tight
- CodestralYes
- Bonsai 27BYes — comfortably
- BitNet b1.58Yes — comfortably
- Aya ExpanseYes