Llama 4 Scout 17B at Q4_K_M needs 68.2 GB once weights, KV cache at 8K context and framework overhead are counted. RTX 5070 12GB offers 12 GB, leaving you 56.2 GB short. 128 GB of unified memory leaves about 96 GB for a model after the OS takes its share, which holds Llama 4 Scout 17B at Q4_K_M.
128 GB of unified memory leaves about 96 GB for a model after the OS takes its share, which holds Llama 4 Scout 17B at Q4_K_M.
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
Your machine is not exactly this one. Run this for your exact setup — the form opens pre-filled with RTX 5070 12GB and Llama 4 Scout 17B.
Not as it stands. Llama 4 Scout 17B needs 68.2 GB at Q4_K_M and this machine has 12 GB available, a shortfall of 56.2 GB. 128 GB of unified memory leaves about 96 GB for a model after the OS takes its share, which holds Llama 4 Scout 17B at Q4_K_M.
More memory would let this model load, but the parts of it living in system RAM have to travel over PCIe, so it would run at roughly 2.3-4.7 tok/s — slower than reading speed. More VRAM, not more RAM, is what this needs.
DDR5 kit prices are roughly 3-4x their mid-2025 level, and the shortage is expected to run into 2027. Relief is not expected before 2027-Q4. The current estimate for relief is 2027-Q4. If you can run this some other way meanwhile, waiting is defensible; if you cannot, the part still does the job today.
Yes, and it is the figure people forget. The 68.2 GB above already includes the KV cache at 8K; that cache grows roughly linearly with context, so doubling the window adds real gigabytes rather than a rounding error. If you plan to work with long documents on RTX 5070 12GB, size for the context you will actually use, not the default.
Data behind this page last checked 2026-08-26.