PC Build to Run Gemma 3 12B Instruct Locally (Q4_K_M)
Written by Jakub Rusinowski · Last updated March 12, 2025
A complete parts list — GPU, motherboard, RAM and PSU — worked backward from Gemma 3 12B Instruct's VRAM requirement at Q4_K_M. Prices are 2026 street estimates and vary.
Requirements
| VRAM required | ~11 GB at Q4_K_M |
| System RAM | 32 GB |
| Estimated speed | ~24 tok/s |
| Complete build (est.) | $959 |
Assumes an 8K-token context with an f16 KV cache. A longer window needs more; a quantized KV cache needs less.
or compare on Vast.ai from $0.35/hr (typical low · varies)
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
GPU: NVIDIA GeForce RTX 3060 (12GB)
NVIDIA GeForce RTX 3060 (12GB)'s 12 GB covers Gemma 3 12B Instruct at Q4_K_M (~11 GB needed), a tight fit — little headroom.
Motherboard: MSI MAG B550 Tomahawk
B550 (AM4) — pairs with the AMD Ryzen 5 5600; DDR4, dual PCIe 4.0 x16 (x8/x8) for multi-GPU, 4 DIMM slots to 128 GB.
RAM: Corsair Vengeance LPX 32GB (2x16GB) DDR4-3600 C18 PREVIEW
32 GB DDR4-3600 (2x16GB) meets Gemma 3 12B Instruct's 32 GB recommended system RAM.
PSU: Corsair RM650e (ATX 3.1)
650 W 80+ Gold covers NVIDIA GeForce RTX 3060 (12GB) (170 W) + CPU 65 W with 30% headroom (~306 W required).
Swap Alternatives
- GPU: AMD Radeon RX 9060 XT 16GB — AMD Radeon RX 9060 XT 16GB's 16 GB covers Gemma 3 12B Instruct at Q4_K_M (~11 GB needed), with headroom.
- GPU: NVIDIA GeForce RTX 5060 Ti 16GB — NVIDIA GeForce RTX 5060 Ti 16GB's 16 GB covers Gemma 3 12B Instruct at Q4_K_M (~11 GB needed), with headroom.
- PSU: Corsair RM850e (ATX 3.1) — More headroom / future dual-GPU: 850 W 80+ Gold.
- The NVIDIA GeForce RTX 3060 (12GB) is a tight fit at Q4_K_M — consider an upgrade alternative for KV-cache/context headroom.
- Some component specs are marked "preview" (pending a second independent source) — see the badges.
FAQ
What GPU do I need to run Gemma 3 12B Instruct at Q4_K_M?
NVIDIA GeForce RTX 3060 (12GB)'s 12 GB covers Gemma 3 12B Instruct at Q4_K_M (~11 GB needed), a tight fit — little headroom.
How much VRAM does Gemma 3 12B Instruct need at Q4_K_M?
About 11 GB of VRAM plus 32 GB of system RAM.
What power supply does a NVIDIA GeForce RTX 3060 (12GB) build need?
650 W 80+ Gold covers NVIDIA GeForce RTX 3060 (12GB) (170 W) + CPU 65 W with 30% headroom (~306 W required).
How much does a Gemma 3 12B Instruct PC cost?
About $959 for a complete build (GPU, motherboard, RAM, PSU, CPU, case, SSD), at 2026 street-price estimates.
Gemma 3 12B Instruct at Other Quant Levels
Other Popular Build Targets
- Qwen 3 32B PC build
- Gemma 4 31B PC build
- Qwen 3.6 35B-A3B PC build
- Qwen 3.5 35B-A3B PC build
- DeepSeek R1 Distill Qwen 32B PC build
Model & GPU
- Gemma 3 model page
- NVIDIA GeForce RTX 3060 (12GB) review
- Can I run Gemma 3 on NVIDIA GeForce RTX 3060 (12GB)?
More Ways to Build
← Budget-first build recommender | Gemma 3 model page | NVIDIA GeForce RTX 3060 (12GB) review