Best Local LLMs for the Apple M1 Ultra

Written by Jakub Rusinowski · Last updated July 12, 2026

Best all-round pick: GPT-oss 120B

The Apple M1 Ultra has 128 GB of unified memory, of which about 96 GB is available to a model. The largest model it can hold is Devstral-2 123B (123B, 75.1 GB at Q4_K_M).

Best models overall on the Apple M1 Ultra

ModelScoreMemory at Q4_K_MContextLicence
GPT-oss 120B96.473.3 GB125KApache-2.0
Nemotron 70B Instruct96.243.4 GB125KLlama Community
Qwen 3.5 122B-A10B (MoE)94.474.5 GB125KApache 2.0
GLM-5.1 72B92.844.3 GB125KMIT
Qwen 3.5 122B-A10B92.874.5 GB128KApache-2.0
Command R+ (104B)92.663.6 GB125KCC-BY-NC

Best model by what you are doing

WorkloadRecommended on this GPU
CodingDevstral-2 123B (98.7)
Qwen3-Coder 80B-A3B (MoE) (97.6)
Qwen 3.5 122B-A10B (MoE) (96.8)
General assistantGPT-oss 120B (96.4)
Nemotron 70B Instruct (96.2)
Qwen 3.5 122B-A10B (MoE) (94.4)
ReasoningGLM-5.1 72B (99.3)
Qwen 3.5 122B-A10B (MoE) (97.1)
Gemma 4 27B ⭐ (96.4)
RAGLlama 4 Scout 17B (94.4)
Gemma 4 31B (93.5)
Llama 4.5 Scout (93.1)
AgentsTernary Bonsai 27B (89.6)
Qwen 3.5 122B-A10B (MoE) (87.7)
GLM-5.1 72B (87)
VisionQwen 3.5 72B (98.2)
Llama 3.2 90B Vision Instruct (96.8)
Qwen 3.7 35B-A3B (93.9)

How these numbers are calculated

FAQ

What is the best LLM for the Apple M1 Ultra?

GPT-oss 120B is the strongest all-round pick that fits its 96 GB.

What is the largest model the Apple M1 Ultra can run?

Devstral-2 123B — 123B parameters, needing 75.1 GB at Q4_K_M.

How much of the Apple M1 Ultra's memory can a model actually use?

About 96 GB of its 128 GB, because macOS reserves a share of unified memory for the system.

Compatibility Checks for the Apple M1 Ultra

Similar GPUs

By Workload

More

← All GPUs | Apple M1 Ultra specs