AMD Ryzen AI Max+ 395 — Local LLM Performance & Compatibility

"Strix Halo" SoC pairing 16 Zen 5 CPU cores with a 40-CU RDNA 3.5 iGPU (Radeon 8060S), sharing up to 128 GB of LPDDR5X-8000 memory at 256 GB/s. Up to 96 GB can be allocated to the GPU as VRAM via AMD Variable Graphics Memory (Windows) or GTT (Linux) — the figure used here. Powers AI mini-PCs like the Framework Desktop, GMKtec EVO-X2, and HP Z2 Mini G1a. ROCm support is improving but still behind CUDA.

Technical Specifications

VRAM96 GB
Memory Bandwidth256 GB/s
TDP120 W
ArchitectureZen 5 + RDNA 3.5 "Strix Halo"
Release Year2025
MSRP at Launch$1,999
Inference Speed (Llama 3.1 8B Q4_K_M)~40 tokens/sec
Inference Speed (Llama 3.3 70B Q4_K_M)~18 tokens/sec
Ujawnienie afiliacyjne: Niektóre odnośniki na tej stronie to linki afiliacyjne — jeśli dokonasz zakupu za ich pośrednictwem, LLM Configurator może otrzymać prowizję bez dodatkowych kosztów dla Ciebie. Jako uczestnik programu Amazon Associates, LLM Configurator zarabia na kwalifikujących się zakupach.
GMKtec EVO-X2 (Ryzen AI Max+ 395, 128GB)
Sugerowana cena premierowa: $2,349
Ceny w 2026 są niestabilne — sprawdź aktualną ofertę.
Sprawdź cenę na Amazon

LLMs Compatible with 96 GB VRAM

All models below run comfortably in 96 GB VRAM with Q4_K_M quantization.

Llama 3.3Llama 3.3 70B Instruct · 43 GB VRAM · Q4_K_M · ollama run llama3.3
Llama 3.1 FamilyLlama 3.1 8B Instruct · 6 GB VRAM · Q4_K_M · ollama run llama3.1
Llama 4Llama 4 Scout 17B · 67 GB VRAM · Q4_K_M · ollama run llama4:scout
DeepSeek R1DeepSeek R1 Distill Qwen 32B · 20 GB VRAM · Q4_K_M · ollama run deepseek-r1:32b
Qwen 3Qwen 3 235B-A22B (MoE) · 80 GB VRAM · Q4_K_M · ollama run qwen3:235b-a22b
Qwen3-CoderQwen3-Coder 80B-A3B (MoE) · 49 GB VRAM · Q4_K_M · ollama run qwen3-coder:80b-a3b-q4
Gemma 3Gemma 3 27B Instruct · 17 GB VRAM · Q4_K_M · ollama run gemma3:27b
Mistral Small 3.1Mistral Small 3.1 24B · 14 GB VRAM · Q4_K_M · ollama run mistral-small3.1

Best Use Cases

Quick Start with Ollama

Install Ollama then run the recommended model for this GPU:

ollama run llama3.3:70b

FAQ

Can the AMD Ryzen AI Max+ 395 run local LLMs?

Yes — the AMD Ryzen AI Max+ 395 has 96 GB VRAM and runs "Strix Halo" SoC pairing 16 Zen 5 CPU cores with a 40-CU RDNA 3.5 iGPU (Radeon 8060S), sharing up to 128 GB of LPDDR5X-8

How fast is the AMD Ryzen AI Max+ 395 for AI inference?

The AMD Ryzen AI Max+ 395 runs Llama 3.1 8B at ~40 tokens/sec with Q4_K_M quantization. For the 70B model it achieves ~18 tokens/sec.

What LLMs can I run on 96 GB VRAM?

With 96 GB you can run: Llama 3.3, Llama 3.1 Family, Llama 4, DeepSeek R1, Qwen 3. Use Ollama for the easiest setup: ollama run llama3.3:70b.

Can I Run It? — AMD Ryzen AI Max+ 395

Compare Similar GPUs

VRAM Tier

Buying Guide

← All GPU Reviews | Check Your Hardware | Full Benchmarks | Can I Run It?