AMD Ryzen AI Max+ 395 — Local LLM Performance & Compatibility

"Strix Halo" SoC pairing 16 Zen 5 CPU cores with a 40-CU RDNA 3.5 iGPU (Radeon 8060S), sharing up to 128 GB of LPDDR5X-8000 memory at 256 GB/s. Up to 96 GB can be allocated to the GPU as VRAM via AMD Variable Graphics Memory (Windows) or GTT (Linux) — the figure used here. Powers AI mini-PCs like the Framework Desktop, GMKtec EVO-X2, and HP Z2 Mini G1a. ROCm support is improving but still behind CUDA.

Technical Specifications

VRAM96 GB
Memory Bandwidth256 GB/s
TDP120 W
ArchitectureZen 5 + RDNA 3.5 "Strix Halo"
Release Year2025
MSRP at Launch$1,999
Inference Speed (Llama 3.1 8B Q4_K_M)~40 tokens/sec
Inference Speed (Llama 3.3 70B Q4_K_M)~18 tokens/sec

LLMs Compatible with 96 GB VRAM

All models below run comfortably in 96 GB VRAM with Q4_K_M quantization.

Llama 3.324 GB VRAM · Q2_K_XS (Tight) · ollama run llama3.3
Llama 3.1 Family6 GB VRAM · Q4_K_M · ollama run llama3.1
Llama 424 GB VRAM · Q4_K_M · ollama run llama4:maverick
DeepSeek R120 GB VRAM · Q4_K_M · ollama run deepseek-r1:32b
Qwen 380 GB VRAM · Q4_K_M · ollama run qwen3:235b-a22b
Qwen3-Coder8 GB VRAM · Q4_K_M · ollama run qwen3-coder:80b-a3b-q4
Gemma 316 GB VRAM · Q4_K_M · ollama run gemma3:27b
Mistral Small 3.114 GB VRAM · Q4_K_M · ollama run mistral-small3.1

Best Use Cases

Quick Start with Ollama

Install Ollama then run the recommended model for this GPU:

ollama run llama3.3:70b

FAQ

Can the AMD Ryzen AI Max+ 395 run local LLMs?

Yes — the AMD Ryzen AI Max+ 395 has 96 GB VRAM and runs "Strix Halo" SoC pairing 16 Zen 5 CPU cores with a 40-CU RDNA 3.5 iGPU (Radeon 8060S), sharing up to 128 GB of LPDDR5X-8

How fast is the AMD Ryzen AI Max+ 395 for AI inference?

The AMD Ryzen AI Max+ 395 runs Llama 3.1 8B at ~40 tokens/sec with Q4_K_M quantization. For the 70B model it achieves ~18 tokens/sec.

What LLMs can I run on 96 GB VRAM?

With 96 GB you can run: Llama 3.3, Llama 3.1 Family, Llama 4, DeepSeek R1, Qwen 3. Use Ollama for the easiest setup: ollama run llama3.3:70b.

Compare Similar GPUs

← All GPU Reviews | Check Your Hardware | Full Benchmarks | Can I Run It?