Can I Run Codestral on Apple M4 Pro?

Superseded model. Codestral has been superseded by Devstral. This page is kept for reference; the newer family is a better starting point. View Devstral →

作者: Jakub Rusinowski · 最后更新: 2026年7月12日

Yes, comfortably — you'll have ~10.6 GB of headroom running Codestral 22B at Q4_K_M (13.40325 GB, ~10 tok/s (est.)) with room for up to 32K context.

Buy This HardwareApple Mac Mini M4 Pro — 24 GB VRAM · 30 W board powerDeploy in the Cloud NowRTX 4090 on RunPod — from $0.34/hr · rate checked 2026-07

or compare on Vast.ai from $0.35/hr (typical low · varies)

As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.

联盟营销声明: 本页部分链接为联盟推广链接——如果你通过它们购买,LLM Configurator 可能会获得佣金,而你无需支付任何额外费用。作为亚马逊联盟成员(Amazon Associate),LLM Configurator 会从符合条件的购买中获得收益。

Apple Mac Mini M4 Pro
24 GB VRAM · 30 W board power
2026年价格波动较大——请以当前商品页价格为准。
在亚马逊查看价格

Apple M4 Pro Specs

VRAM24 GB unified memory
Memory Bandwidth273 GB/s

Codestral 22B on the Apple M4 Pro: VRAM by quantization

QuantVRAM neededFits 24 GB?Max context
F1646.1 GB✗ No
Q8_025.3 GB✗ No
Q6_K19.9 GB✓ Yes16K
Q5_K_M17.5 GB✓ Yes16K
Q4_K_M15.1 GB✓ Yes32K
Q3_K_M11.2 GB✓ Yes32K
Q2_K9 GB✓ Yes32K

VRAM needed assumes a 4K-token context with an f16 KV cache; “Max context” is the largest window that still fits in 24 GB of unified memory. Figures are estimates from parameter count, quantization and memory bandwidth — the analyzer lets you tune KV-cache quant and context.

Codestral Sizes That Fit the Apple M4 Pro

Codestral 22BQ4_K_M · 13.40325 GB · ~10 tok/s (est.)
Buy vs. rent Codestral
Buy the GPU
~$1,999
Apple M4 Pro · MSRP
Rent by the hour
from $0.34/hr
RTX 4090 (24 GB) class

At 2 hrs/day, buying (~$1,999) beats renting at $0.34/hr after about 8.2 years.

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

RunPod $0.34/hr
Rent on RunPod →
Vast.ai $0.35/hr · typical low · varies
Rent on Vast.ai →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

FAQ

Codestral on the Apple M4 Pro — does it fit?

Yes, comfortably — you'll have ~10.6 GB of headroom running Codestral 22B at Q4_K_M (13.40325 GB, ~10 tok/s (est.)) with room for up to 32K context.

Which Codestral variant fits best on the Apple M4 Pro?

Codestral 22B at Q4_K_M quantization (13.40325 GB), estimated ~10 tokens/sec, up to 32K context.

Codestral on Other GPUs

VRAM Tier

Troubleshooting

Buying Guide

← Can I Run It? | Codestral Model Page | Apple M4 Pro GPU Page | Check Your Hardware