Can I Run GLM-6 355B-A32B on NVIDIA GeForce RTX 4070?

Name: LLM Configurator — GPU VRAM Checker
Author: LLM Configurator

Written by Jakub Rusinowski · Last updated August 15, 2026

No. GLM-6 355B-A32B needs 214.3 GB at Q4_K_M and the NVIDIA GeForce RTX 4070 has only 12 GB. No quantization we publish closes a gap that size.

The numbers

Model	GLM-6 355B-A32B
Parameters	355B (32B active)
Quantization	Q4_K_M
VRAM needed	214.3 GB
NVIDIA GeForce RTX 4070 VRAM	12 GB
Verdict	Does not fit

What to do next

Either step down to a smaller size in this family, or move to a Apple M3 Ultra (512 GB), the cheapest card we track with enough VRAM.

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.

Cheapest card we track with enough VRAM for GLM-6 355B-A32B:

Apple Mac Studio M3 Ultra

512 GB VRAM · 60 W board power

2026 prices are volatile — check the current listing.

Check price on Amazon

Won't fit — rent GLM-6 355B-A32B instead

GLM-6 355B-A32B needs ~214 GB but this GPU has 12 GB. Rent a 8× H100 (640 GB)-class GPU by the hour instead of buying one:

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

RunPod $23.12/hr

Rent on RunPod →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

Other GLM-6 sizes on the NVIDIA GeForce RTX 4070

GLM-6 9B — runs (5.4 GB)

GLM-6 355B-A32B on nearby hardware

Intel Arc B570 (10 GB) — does not fit
Apple M3 Ultra (512 GB) — runs

All GLM-6 sizes on the NVIDIA GeForce RTX 4070 | VRAM calculator for GLM-6 355B-A32B | NVIDIA GeForce RTX 4070 GPU page | Check your hardware