Llama 4 Scout 17B at Q4_K_M needs 68.2 GB once weights, KV cache at 8K context and framework overhead are counted. RTX 5080 16GB offers 16 GB, leaving you 52.2 GB short. 128 GB of unified memory leaves about 96 GB for a model after the OS takes its share, which holds Llama 4 Scout 17B at Q4_K_M.
128 GB of unified memory leaves about 96 GB for a model after the OS takes its share, which holds Llama 4 Scout 17B at Q4_K_M.
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
Your machine is not exactly this one. Run this for your exact setup — the form opens pre-filled with RTX 5080 16GB and Llama 4 Scout 17B.
Not as it stands. Llama 4 Scout 17B needs 68.2 GB at Q4_K_M and this machine has 16 GB available, a shortfall of 52.2 GB. 128 GB of unified memory leaves about 96 GB for a model after the OS takes its share, which holds Llama 4 Scout 17B at Q4_K_M.
Here, yes — up to a point. You are 52.2 GB short in VRAM, and 96 GB of system RAM gives llama.cpp somewhere to put the overflow layers without changing your graphics card. It works because the shortfall is small enough that the layers living in system RAM do not dominate each token.
DDR5 kit prices are roughly 3-4x their mid-2025 level, and the shortage is expected to run into 2027. Relief is not expected before 2027-Q4. The current estimate for relief is 2027-Q4. If you can run this some other way meanwhile, waiting is defensible; if you cannot, the part still does the job today.
Yes, and it is the figure people forget. The 68.2 GB above already includes the KV cache at 8K; that cache grows roughly linearly with context, so doubling the window adds real gigabytes rather than a rounding error. If you plan to work with long documents on RTX 5080 16GB, size for the context you will actually use, not the default.
Data behind this page last checked 2026-08-26.