Can I Run Ternary Bonsai 27B on NVIDIA GeForce RTX 5060 Ti 8GB?

作者: Jakub Rusinowski · 最后更新: 2026年8月15日

Yes. Ternary Bonsai 27B needs 5.8 GB at Ternary (1.58-bit, ~1.71 bpw) and the NVIDIA GeForce RTX 5060 Ti 8GB has 8 GB, leaving about 2.2 GB of headroom, at roughly 51 tok/s (estimated) with room for up to 2K of context.

The numbers

ModelTernary Bonsai 27B
Parameters27B
QuantizationTernary (1.58-bit, ~1.71 bpw)
VRAM needed5.8 GB
NVIDIA GeForce RTX 5060 Ti 8GB VRAM8 GB
VerdictRuns
Max context2K
Estimated speed~51 tok/s

What to do next

Nothing to change — run it at Ternary (1.58-bit, ~1.71 bpw). If you want more capability, check whether the next size up also fits.

联盟营销声明: 本页部分链接为联盟推广链接——如果你通过它们购买,LLM Configurator 可能会获得佣金,而你无需支付任何额外费用。作为亚马逊联盟成员(Amazon Associate),LLM Configurator 会从符合条件的购买中获得收益。

Running Ternary Bonsai 27B on this card:

NVIDIA GeForce RTX 5060 Ti 8GB
8 GB VRAM · 180 W board power
2026年价格波动较大——请以当前商品页价格为准。
在亚马逊查看价格

Buy vs. rent Ternary Bonsai 27B
Buy the GPU
~$379
NVIDIA GeForce RTX 5060 Ti 8GB · MSRP
Rent by the hour
from $0.34/hr
RTX 4090 (24 GB) class

At 2 hrs/day, buying (~$379) beats renting at $0.34/hr after about 19 months.

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

RunPod $0.34/hr
Rent on RunPod →
Vast.ai $0.35/hr · typical low · varies
Rent on Vast.ai →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

Other Bonsai 27B sizes on the NVIDIA GeForce RTX 5060 Ti 8GB

Ternary Bonsai 27B on nearby hardware

All Bonsai 27B sizes on the NVIDIA GeForce RTX 5060 Ti 8GB | VRAM calculator for Ternary Bonsai 27B | NVIDIA GeForce RTX 5060 Ti 8GB GPU page | Check your hardware