Local AI Advisor

What LLMs can Laptop · Core Ultra 7 258V (Arc 140V) · 32 GB run?

32 GB unified, 136 GB/s memory bandwidth, about $1,300. Every open model in our catalog, rated by the engine for chat and for agentic coding.

Best for chat

LFM2.5 24B-A2B

Excellent · Q4_K_M · 30–50 tok/s

Best for agentic coding

LFM2.5 24B-A2B

Acceptable · Q4_K_M · 25–40 tok/s

Best open-source (OSI) pick

gpt-oss-20b

Excellent · MXFP4 · 18–30 tok/s

Runs well (17)

Fast enough and with memory to spare for everyday chat.

ModelChatAgentic codingQuantChat speed
LFM2.5 24B-A2BLiquid AIExcellentAcceptableQ4_K_M30–50 tok/s
gpt-oss-20bOpenAIOpen sourceExcellentBorderlineMXFP418–30 tok/s
Gemma 4 26B-A4BGoogleOpen sourceExcellentAcceptableQ4_K_M15–25 tok/s
Qwen3.6 35B-A3BAlibaba QwenOpen sourceExcellentAcceptableQ3_K_M25–45 tok/s
Qwen3.5 35B-A3BAlibaba QwenOpen sourceExcellentAcceptableQ3_K_M25–45 tok/s
MiniCPM5 2BOpenBMBOpen sourceExcellentAcceptableQ8_019–30 tok/s
Qwen3.5 4BAlibaba QwenOpen sourceExcellentAcceptableQ4_K_M19–30 tok/s
Llama 3.2 3B InstructMetaOpen weights (restricted)ExcellentTechnically RunsQ6_K17–30 tok/s
GLM-4.7-Flash (30B-A3B)Z.aiOpen sourceComfortableBorderlineQ4_K_M20–35 tok/s
Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen sourceComfortableBorderlineQ4_K_M17–30 tok/s
Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen sourceComfortableBorderlineQ4_K_M17–30 tok/s
Qwen3.5 9BAlibaba QwenOpen sourceComfortableBorderlineQ4_K_M9–15 tok/s
Qwen3 8BAlibaba QwenOpen sourceComfortableBorderlineQ4_K_M10–16 tok/s
DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen sourceComfortableBorderlineQ4_K_M10–16 tok/s
Gemma 4 E4BGoogleOpen sourceComfortableBorderlineQ4_K_M10–17 tok/s
Llama 3.1 8B InstructMetaOpen weights (restricted)ComfortableBorderlineQ4_K_M10–17 tok/s
Qwen2.5-Coder 7B InstructAlibaba QwenOpen sourceComfortableBorderlineQ5_K_M9–15 tok/s

Usable with compromises (10)

Works, but you'll notice slower replies or tight memory.

ModelChatAgentic codingQuantChat speed
Gemma 4 12BGoogleOpen sourceAcceptableBorderlineQ5_K_M6–10 tok/s
GLM-4.6V-Flash (10B)Z.aiOpen sourceAcceptableBorderlineQ6_K6–10 tok/s
Qwen3 14BAlibaba QwenOpen sourceAcceptableTechnically RunsQ4_K_M6–9 tok/s
Qwen3.8 27BAlibaba QwenOpen sourceAcceptableTechnically RunsQ3_K_M3.8–6 tok/s
Phi-4 (14B)MicrosoftOpen sourceAcceptableTechnically RunsQ4_K_M6–9 tok/s
Qwen3.6 27BAlibaba QwenOpen sourceAcceptableTechnically RunsQ3_K_M3.8–6 tok/s
Qwen3.5 27BAlibaba QwenOpen sourceAcceptableTechnically RunsQ3_K_M3.8–6 tok/s
Mistral Small 3.2 (24B)Mistral AIOpen sourceAcceptableTechnically RunsQ3_K_M4.3–7 tok/s
Gemma 3 27BGoogleOpen weights (restricted)AcceptableTechnically RunsQ3_K_M3.8–6 tok/s
Devstral Small 2 (24B)Mistral AIOpen sourceAcceptableTechnically RunsQ3_K_M4.3–7 tok/s

Loads, but not recommended (4)

Technically runs. Expect a frustrating experience.

ModelChatAgentic codingQuantChat speed
Gemma 4 31BGoogleOpen sourceBorderlineTechnically RunsQ4_K_M2.9–4.8 tok/s
Muse Glimmer (30B)MetaOpen sourceBorderlineTechnically RunsQ4_K_M3.1–5 tok/s
Qwen3 32BAlibaba QwenOpen sourceBorderlineDoes Not FitQ4_K_M2.6–4.4 tok/s
Qwen2.5-Coder 32B InstructAlibaba QwenOpen sourceBorderlineDoes Not FitQ4_K_M2.6–4.3 tok/s

Doesn't fit or isn't supported (17)

Not enough usable memory, or the runtime can't run it here.

ModelChatAgentic codingQuantChat speed
DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Kolibri-1 (78B-A3.5B)Aleph AlphaOpen sourceDoes Not FitDoes Not Fit——
Muse Spark Open 816B-A42BMetaDoes Not FitDoes Not Fit——
Nemotron 3.5 Bolt 74B-A9BNVIDIADoes Not FitDoes Not Fit——
GLM-5.3 (753B-A40B)Z.aiDoes Not FitDoes Not Fit——
GLM-5.3-Flash (320B-A18B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Mistral Small 4 (119B-A6.5B)Mistral AIOpen sourceDoes Not FitDoes Not Fit——
Qwen3.5 122B-A10BAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Qwen3-Next 80B-A3B InstructAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
gpt-oss-120bOpenAIOpen sourceDoes Not FitDoes Not Fit——
GLM-4.5-Air (106B-A12B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
Llama 4 Scout (109B-A17B)MetaOpen weights (restricted)Does Not FitDoes Not Fit——
Llama 3.3 70B InstructMetaOpen weights (restricted)Does Not FitDoes Not Fit——
Nemotron 3.5 Super VL 120B-A12BNVIDIAUnsupportedUnsupported——
Reflection Beam (501B-A23B)Reflection AIOpen sourceUnsupportedUnsupported——
Step 5 Preview 600B-A27BStepfunUnsupportedUnsupported——

Want a specific tool, context size or workload?

The full check models your exact setup, including the apps you keep open.

Check this machine in detail