Written by Jakub Rusinowski · Last updated September 19, 2026
The fastest Ampere consumer card: 24 GB at 1,008 GB/s, matching the RTX 4090's bandwidth over the same capacity. Bought used it is one of the cheapest routes to 24 GB, at the cost of a 450 W board and no FP8.
| VRAM | 24 GB |
| Memory Bandwidth | 1008 GB/s |
| TDP | 450 W |
| Architecture | Ampere GA102 |
| Release Year | 2022 |
| MSRP at Launch | $1,999 |
| Inference Speed (Llama 3.1 8B Q4_K_M) | 63–122 tok/s (estimated) |
| Inference Speed (Llama 3.3 70B Q4_K_M) | Does not fit — needs ~44 GB of 24 GB usable |
or compare on Vast.ai from $0.35/hr (typical low · varies)
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
All models below run comfortably in 24 GB VRAM with Q4_K_M quantization.
| Command R Family | Command R (35B) · 22 GB VRAM · Q4_K_M · ollama run command-r |
| Qwen 3.5 | Qwen 3.5 35B-A3B · 22 GB VRAM · Q4_K_M · ollama run qwen3.5:35b-a3b |
| Qwen 3.6 | Qwen 3.6 35B-A3B · 22 GB VRAM · Q4_K_M · ollama run qwen3.6:35b-a3b |
| Nex-N2 | Nex-N2 mini · 22 GB VRAM · Q4_K_M · nex-n2 |
| Yi 1.5 Family | Yi 1.5 34B Chat · 22 GB VRAM · Q4_K_M · ollama run yi:34b |
| Qwen 3 | Qwen 3 32B · 21 GB VRAM · Q4_K_M · ollama run qwen3:32b |
| Aya Expanse | Aya Expanse 32B · 20 GB VRAM · Q4_K_M · ollama run aya-expanse:32b |
| DeepSeek R1 | DeepSeek R1 Distill Qwen 32B · 20 GB VRAM · Q4_K_M · ollama run deepseek-r1:32b |
56 more families also fit 24 GB — browse the full model library.
Yes — the NVIDIA GeForce RTX 3090 Ti has 24 GB VRAM and runs The fastest Ampere consumer card: 24 GB at 1,008 GB/s, matching the RTX 4090's bandwidth over the same capacity. Bought
The NVIDIA GeForce RTX 3090 Ti is estimated to run Llama 3.1 8B at 63–122 tok/s with Q4_K_M quantization. Llama 3.3 70B does not fit: it needs about 44 GB against 24 GB usable. These are modelled estimates, not measurements — see /en/methodology.
With 24 GB you can run: Command R Family, Qwen 3.5, Qwen 3.6, Nex-N2, Yi 1.5 Family. Use Ollama for the easiest setup: ollama run llama3.1:8b.
← All GPU Reviews | All Hardware | Check Your Hardware | Full Benchmarks | Can I Run It?