Local AI Advisor

What LLMs can MacBook Pro M2 Pro 32 GB run?

32 GB unified, 200 GB/s memory bandwidth, about $2,899. Every open model in our catalog, rated by the engine for chat and for agentic coding.

Best for chat

Qwen3.6 35B-A3B

Excellent · 4-bit · 55–75 tok/s

Best for agentic coding

gpt-oss-20b

Comfortable · MXFP4 · 35–50 tok/s

Best open-source (OSI) pick

Qwen3.6 35B-A3B

Excellent · 4-bit · 55–75 tok/s

Runs well (21)

Fast enough and with memory to spare for everyday chat.

ModelChatAgentic codingQuantChat speed
Qwen3.6 35B-A3BAlibaba QwenOpen sourceExcellentAcceptable4-bit55–75 tok/s
Gemma 4 26B-A4BGoogleOpen sourceExcellentAcceptable4-bit45–60 tok/s
LFM2.5 24B-A2BLiquid AIExcellentAcceptableQ4_K_M75–100 tok/s
gpt-oss-20bOpenAIOpen sourceExcellentComfortableMXFP445–60 tok/s
Qwen3.5 35B-A3BAlibaba QwenOpen sourceExcellentAcceptable4-bit55–75 tok/s
GLM-4.7-Flash (30B-A3B)Z.aiOpen sourceExcellentAcceptable4-bit50–70 tok/s
Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen sourceExcellentBorderline4-bit45–60 tok/s
MiniCPM5 2BOpenBMBOpen sourceExcellentAcceptableQ8_045–60 tok/s
Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen sourceExcellentAcceptable4-bit45–60 tok/s
Qwen3.5 4BAlibaba QwenOpen sourceExcellentAcceptable6-bit30–45 tok/s
Qwen3.5 9BAlibaba QwenOpen sourceExcellentAcceptable5-bit18–25 tok/s
Gemma 4 12BGoogleOpen sourceExcellentAcceptable4-bit18–25 tok/s
GLM-4.6V-Flash (10B)Z.aiOpen sourceExcellentAcceptable5-bit17–25 tok/s
Qwen3 8BAlibaba QwenOpen sourceExcellentAcceptable6-bit18–25 tok/s
DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen sourceExcellentAcceptable6-bit18–25 tok/s
Gemma 4 E4BGoogleOpen sourceExcellentBorderline6-bit19–25 tok/s
Llama 3.2 3B InstructMetaOpen weights (restricted)ExcellentTechnically Runs6-bit45–60 tok/s
Llama 3.1 8B InstructMetaOpen weights (restricted)ExcellentBorderline6-bit18–25 tok/s
Qwen2.5-Coder 7B InstructAlibaba QwenOpen sourceExcellentAcceptable6-bit19–25 tok/s
Qwen3 14BAlibaba QwenOpen sourceComfortableBorderline5-bit12–16 tok/s
Phi-4 (14B)MicrosoftOpen sourceComfortableAcceptable5-bit12–16 tok/s

Usable with compromises (10)

Works, but you'll notice slower replies or tight memory.

ModelChatAgentic codingQuantChat speed
Qwen3.8 27BAlibaba QwenOpen sourceAcceptableTechnically Runs4-bit8–11 tok/s
Qwen3.6 27BAlibaba QwenOpen sourceAcceptableTechnically Runs4-bit8–11 tok/s
Gemma 4 31BGoogleOpen sourceAcceptableTechnically Runs4-bit7–10 tok/s
Qwen3.5 27BAlibaba QwenOpen sourceAcceptableTechnically Runs4-bit8–11 tok/s
Muse Glimmer (30B)MetaOpen sourceAcceptableTechnically RunsQ4_K_M8–10 tok/s
Mistral Small 3.2 (24B)Mistral AIOpen sourceAcceptableTechnically Runs5-bit7–10 tok/s
Gemma 3 27BGoogleOpen weights (restricted)AcceptableTechnically Runs4-bit8–11 tok/s
Devstral Small 2 (24B)Mistral AIOpen sourceAcceptableTechnically Runs5-bit7–10 tok/s
Qwen3 32BAlibaba QwenOpen sourceAcceptableTechnically Runs4-bit7–9 tok/s
Qwen2.5-Coder 32B InstructAlibaba QwenOpen sourceAcceptableTechnically Runs4-bit7–9 tok/s

Doesn't fit or isn't supported (17)

Not enough usable memory, or the runtime can't run it here.

ModelChatAgentic codingQuantChat speed
DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Kolibri-1 (78B-A3.5B)Aleph AlphaOpen sourceDoes Not FitDoes Not Fit——
Muse Spark Open 816B-A42BMetaDoes Not FitDoes Not Fit——
Nemotron 3.5 Bolt 74B-A9BNVIDIADoes Not FitDoes Not Fit——
Nemotron 3.5 Super VL 120B-A12BNVIDIADoes Not FitDoes Not Fit——
Reflection Beam (501B-A23B)Reflection AIOpen sourceDoes Not FitDoes Not Fit——
Step 5 Preview 600B-A27BStepfunDoes Not FitDoes Not Fit——
GLM-5.3 (753B-A40B)Z.aiDoes Not FitDoes Not Fit——
GLM-5.3-Flash (320B-A18B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Mistral Small 4 (119B-A6.5B)Mistral AIOpen sourceDoes Not FitDoes Not Fit——
Qwen3.5 122B-A10BAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Qwen3-Next 80B-A3B InstructAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
gpt-oss-120bOpenAIOpen sourceDoes Not FitDoes Not Fit——
GLM-4.5-Air (106B-A12B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
Llama 4 Scout (109B-A17B)MetaOpen weights (restricted)Does Not FitDoes Not Fit——
Llama 3.3 70B InstructMetaOpen weights (restricted)Does Not FitDoes Not Fit——

Want a specific tool, context size or workload?

The full check models your exact setup, including the apps you keep open.

Check this machine in detail