Written by Jakub Rusinowski · Last updated August 15, 2026
Yes. Ternary Bonsai 27B needs 5.8 GB at Ternary (1.58-bit, ~1.71 bpw) and the NVIDIA GeForce RTX 3070 has 8 GB, leaving about 2.2 GB of headroom, at roughly 38 tok/s (estimated) with room for up to 2K of context.
| Model | Ternary Bonsai 27B |
| Parameters | 27B |
| Quantization | Ternary (1.58-bit, ~1.71 bpw) |
| VRAM needed | 5.8 GB |
| NVIDIA GeForce RTX 3070 VRAM | 8 GB |
| Verdict | Runs |
| Max context | 2K |
| Estimated speed | ~38 tok/s |
Nothing to change — run it at Ternary (1.58-bit, ~1.71 bpw). If you want more capability, check whether the next size up also fits.
Running Ternary Bonsai 27B on this card:
At 2 hrs/day, buying (~$499) beats renting at $0.34/hr after about 2.0 years.
Affiliate links — we may earn a commission if you sign up, at no extra cost to you.
Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.
All Bonsai 27B sizes on the NVIDIA GeForce RTX 3070 | VRAM calculator for Ternary Bonsai 27B | NVIDIA GeForce RTX 3070 GPU page | Check your hardware