Written by Jakub Rusinowski · Last updated July 21, 2026
The datacenter workhorse of the 2021–2023 AI wave, now the value pick for on-prem business inference: 80 GB HBM2e at 1.9 TB/s runs Llama 3.3 70B at Q4 entirely on one card. No official MSRP — single-unit street pricing has fallen well below launch levels as H100/B200 fleets displace it, and the used/refurb market is active. PCIe version shown; SXM needs an HGX carrier board.
| VRAM | 80 GB |
| Memory Bandwidth | 1935 GB/s |
| TDP | 300 W |
| Architecture | Ampere GA100 |
| Release Year | 2021 |
| MSRP at Launch | $15,000 |
| Inference Speed (Llama 3.1 8B Q4_K_M) | 102–196 tok/s (estimated) |
| Inference Speed (Llama 3.3 70B Q4_K_M) | 18–34 tok/s (estimated) |
or compare on Vast.ai from $0.77/hr (typical low · varies)
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
All models below run comfortably in 80 GB VRAM with Q4_K_M quantization.
| Llama 4 | Llama 4 Scout 17B · 67 GB VRAM · Q4_K_M · ollama run llama4:scout |
| Llama 3.3 | Llama 3.3 70B Instruct · 43 GB VRAM · Q4_K_M · ollama run llama3.3 |
| Llama 3.1 Family | Llama 3.1 8B Instruct · 6 GB VRAM · Q4_K_M · ollama run llama3.1 |
| DeepSeek R1 | DeepSeek R1 Distill Qwen 32B · 20 GB VRAM · Q4_K_M · ollama run deepseek-r1:32b |
| Qwen 3 | Qwen 3 32B · 21 GB VRAM · Q4_K_M · ollama run qwen3:32b |
| Qwen 3.5 | Qwen 3.5 122B-A10B · 74 GB VRAM · Q4_K_M · ollama run qwen3.5:122b |
| Qwen 3.6 | Qwen 3.6 35B-A3B · 22 GB VRAM · Q4_K_M · ollama run qwen3.6:35b-a3b |
| Gemma 3 | Gemma 3 27B Instruct · 17 GB VRAM · Q4_K_M · ollama run gemma3:27b |
Install Ollama then run the recommended model for this GPU:
ollama run llama3.3:70b
Yes — the NVIDIA A100 80GB has 80 GB VRAM and runs The datacenter workhorse of the 2021–2023 AI wave, now the value pick for on-prem business inference: 80 GB HBM2e at 1.9
The NVIDIA A100 80GB is estimated to run Llama 3.1 8B at 102–196 tok/s with Q4_K_M quantization. For Llama 3.3 70B the estimate is 18–34 tok/s. These are modelled estimates, not measurements — see /en/methodology.
With 80 GB you can run: Llama 4, Llama 3.3, Llama 3.1 Family, DeepSeek R1, Qwen 3. Use Ollama for the easiest setup: ollama run llama3.3:70b.
← All GPU Reviews | Check Your Hardware | Full Benchmarks | Can I Run It?