Local AI Advisor

What LLMs can MacBook Pro M4 Pro 24 GB run?

24 GB unified, 273 GB/s memory bandwidth, about $2,399. Every open model in our catalog, rated by the engine for chat and for agentic coding.

Best for chat

gpt-oss-20b

Excellent · MXFP4 · 60–80 tok/s

Best for agentic coding

Qwen3.5 9B

Acceptable · 6-bit · 19–25 tok/s

Best open-source (OSI) pick

gpt-oss-20b

Excellent · MXFP4 · 60–80 tok/s

Runs well (25)

Fast enough and with memory to spare for everyday chat.

ModelChatAgentic codingQuantChat speed
gpt-oss-20bOpenAIOpen sourceExcellentBorderlineMXFP460–80 tok/s
MiniCPM5 2BOpenBMBOpen sourceExcellentAcceptableQ8_060–85 tok/s
Qwen3.5 4BAlibaba QwenOpen sourceExcellentAcceptable6-bit40–55 tok/s
Qwen3.5 9BAlibaba QwenOpen sourceExcellentAcceptable6-bit20–30 tok/s
Gemma 4 12BGoogleOpen sourceExcellentAcceptable4-bit25–35 tok/s
GLM-4.6V-Flash (10B)Z.aiOpen sourceExcellentAcceptable4-bit30–40 tok/s
Qwen3 8BAlibaba QwenOpen sourceExcellentAcceptable6-bit25–30 tok/s
DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen sourceExcellentAcceptable6-bit25–30 tok/s
Gemma 4 E4BGoogleOpen sourceExcellentBorderline6-bit25–35 tok/s
Qwen3 14BAlibaba QwenOpen sourceExcellentBorderline4-bit19–25 tok/s
Llama 3.2 3B InstructMetaOpen weights (restricted)ExcellentTechnically Runs6-bit60–80 tok/s
Llama 3.1 8B InstructMetaOpen weights (restricted)ExcellentBorderline6-bit25–35 tok/s
Phi-4 (14B)MicrosoftOpen sourceExcellentAcceptable4-bit19–25 tok/s
Qwen2.5-Coder 7B InstructAlibaba QwenOpen sourceExcellentAcceptable6-bit25–35 tok/s
LFM2.5 24B-A2BLiquid AIComfortableBorderlineQ4_K_M100–140 tok/s
Gemma 4 26B-A4BGoogleOpen sourceComfortableAcceptable4-bit60–80 tok/s
GLM-4.7-Flash (30B-A3B)Z.aiOpen sourceComfortableDoes Not Fit3-bit90–120 tok/s
Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen sourceComfortableDoes Not Fit3-bit75–100 tok/s
Qwen3.8 27BAlibaba QwenOpen sourceComfortableBorderline3-bit14–19 tok/s
Qwen3.6 27BAlibaba QwenOpen sourceComfortableBorderline3-bit14–19 tok/s
Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen sourceComfortableDoes Not Fit3-bit75–100 tok/s
Qwen3.5 27BAlibaba QwenOpen sourceComfortableBorderline3-bit14–19 tok/s
Mistral Small 3.2 (24B)Mistral AIOpen sourceComfortableDoes Not Fit4-bit12–16 tok/s
Devstral Small 2 (24B)Mistral AIOpen sourceComfortableDoes Not Fit4-bit12–16 tok/s
Gemma 3 27BGoogleOpen weights (restricted)ComfortableDoes Not Fit3-bit14–19 tok/s

Loads, but not recommended (6)

Technically runs. Expect a frustrating experience.

ModelChatAgentic codingQuantChat speed
Qwen3.6 35B-A3BAlibaba QwenOpen sourceBorderlineDoes Not Fit3-bit95–130 tok/s
Qwen3.5 35B-A3BAlibaba QwenOpen sourceBorderlineDoes Not Fit3-bit95–130 tok/s
Gemma 4 31BGoogleOpen sourceBorderlineDoes Not Fit3-bit12–16 tok/s
Muse Glimmer (30B)MetaOpen sourceBorderlineDoes Not FitQ4_K_M10–14 tok/s
Qwen3 32BAlibaba QwenOpen sourceBorderlineDoes Not Fit3-bit11–15 tok/s
Qwen2.5-Coder 32B InstructAlibaba QwenOpen sourceBorderlineDoes Not Fit3-bit11–15 tok/s

Doesn't fit or isn't supported (17)

Not enough usable memory, or the runtime can't run it here.

ModelChatAgentic codingQuantChat speed
DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Kolibri-1 (78B-A3.5B)Aleph AlphaOpen sourceDoes Not FitDoes Not Fit——
Muse Spark Open 816B-A42BMetaDoes Not FitDoes Not Fit——
Nemotron 3.5 Bolt 74B-A9BNVIDIADoes Not FitDoes Not Fit——
Nemotron 3.5 Super VL 120B-A12BNVIDIADoes Not FitDoes Not Fit——
Reflection Beam (501B-A23B)Reflection AIOpen sourceDoes Not FitDoes Not Fit——
Step 5 Preview 600B-A27BStepfunDoes Not FitDoes Not Fit——
GLM-5.3 (753B-A40B)Z.aiDoes Not FitDoes Not Fit——
GLM-5.3-Flash (320B-A18B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Mistral Small 4 (119B-A6.5B)Mistral AIOpen sourceDoes Not FitDoes Not Fit——
Qwen3.5 122B-A10BAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Qwen3-Next 80B-A3B InstructAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
gpt-oss-120bOpenAIOpen sourceDoes Not FitDoes Not Fit——
GLM-4.5-Air (106B-A12B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
Llama 4 Scout (109B-A17B)MetaOpen weights (restricted)Does Not FitDoes Not Fit——
Llama 3.3 70B InstructMetaOpen weights (restricted)Does Not FitDoes Not Fit——

Want a specific tool, context size or workload?

The full check models your exact setup, including the apps you keep open.

Check this machine in detail