Local AI Advisor

What LLMs can Surface Laptop Ultra · RTX Spark N1X (18-core) · 24 GB run?

24 GB unified, 300 GB/s memory bandwidth, about $2,600. Every open model in our catalog, rated by the engine for chat and for agentic coding.

Best for chat

gpt-oss-20b

Excellent · MXFP4 · 50–85 tok/s

Best for agentic coding

Qwen3.5 9B

Acceptable · Q6_K · 17–30 tok/s

Best open-source (OSI) pick

gpt-oss-20b

Excellent · MXFP4 · 50–85 tok/s

Runs well (17)

Fast enough and with memory to spare for everyday chat.

ModelChatAgentic codingQuantChat speed
gpt-oss-20bOpenAIOpen sourceExcellentBorderlineMXFP450–85 tok/s
MiniCPM5 2BOpenBMBOpen sourceExcellentAcceptableQ8_055–90 tok/s
Gemma 4 26B-A4BGoogleOpen sourceExcellentBorderlineQ3_K_M60–95 tok/s
Qwen3.5 4BAlibaba QwenOpen sourceExcellentAcceptableQ8_035–55 tok/s
Qwen3.5 9BAlibaba QwenOpen sourceExcellentAcceptableQ6_K18–30 tok/s
Gemma 4 12BGoogleOpen sourceExcellentAcceptableQ4_K_M20–35 tok/s
GLM-4.6V-Flash (10B)Z.aiOpen sourceExcellentAcceptableQ5_K_M20–35 tok/s
Qwen3 8BAlibaba QwenOpen sourceExcellentAcceptableQ6_K20–35 tok/s
DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen sourceExcellentAcceptableQ6_K20–35 tok/s
Gemma 4 E4BGoogleOpen sourceExcellentBorderlineQ6_K20–35 tok/s
Llama 3.2 3B InstructMetaOpen weights (restricted)ExcellentTechnically RunsQ6_K50–85 tok/s
Qwen3 14BAlibaba QwenOpen sourceExcellentBorderlineQ4_K_M16–25 tok/s
Llama 3.1 8B InstructMetaOpen weights (restricted)ExcellentBorderlineQ6_K20–35 tok/s
Phi-4 (14B)MicrosoftOpen sourceExcellentBorderlineQ4_K_M16–25 tok/s
Qwen2.5-Coder 7B InstructAlibaba QwenOpen sourceExcellentAcceptableQ6_K25–40 tok/s
Mistral Small 3.2 (24B)Mistral AIOpen sourceComfortableDoes Not FitQ3_K_M12–20 tok/s
Devstral Small 2 (24B)Mistral AIOpen sourceComfortableDoes Not FitQ3_K_M12–20 tok/s

Usable with compromises (3)

Works, but you'll notice slower replies or tight memory.

ModelChatAgentic codingQuantChat speed
Qwen3.8 27BAlibaba QwenOpen sourceAcceptableDoes Not FitQ3_K_M11–18 tok/s
Qwen3.6 27BAlibaba QwenOpen sourceAcceptableDoes Not FitQ3_K_M11–18 tok/s
Qwen3.5 27BAlibaba QwenOpen sourceAcceptableDoes Not FitQ3_K_M11–18 tok/s

Loads, but not recommended (5)

Technically runs. Expect a frustrating experience.

ModelChatAgentic codingQuantChat speed
LFM2.5 24B-A2BLiquid AIBorderlineDoes Not FitQ4_K_M85–150 tok/s
GLM-4.7-Flash (30B-A3B)Z.aiOpen sourceBorderlineDoes Not FitQ3_K_M70–120 tok/s
Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen sourceBorderlineDoes Not FitQ3_K_M60–100 tok/s
Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen sourceBorderlineDoes Not FitQ3_K_M60–100 tok/s
Gemma 3 27BGoogleOpen weights (restricted)BorderlineDoes Not FitQ3_K_M11–18 tok/s

Doesn't fit or isn't supported (23)

Not enough usable memory, or the runtime can't run it here.

ModelChatAgentic codingQuantChat speed
DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Kolibri-1 (78B-A3.5B)Aleph AlphaOpen sourceDoes Not FitDoes Not Fit——
Muse Spark Open 816B-A42BMetaDoes Not FitDoes Not Fit——
Nemotron 3.5 Bolt 74B-A9BNVIDIADoes Not FitDoes Not Fit——
GLM-5.3 (753B-A40B)Z.aiDoes Not FitDoes Not Fit——
GLM-5.3-Flash (320B-A18B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
Muse Glimmer (30B)MetaOpen sourceDoes Not FitDoes Not Fit——
DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen sourceDoes Not FitDoes Not Fit——
Gemma 4 31BGoogleOpen sourceDoes Not FitDoes Not Fit——
Qwen3.6 35B-A3BAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Mistral Small 4 (119B-A6.5B)Mistral AIOpen sourceDoes Not FitDoes Not Fit——
Qwen3.5 122B-A10BAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Qwen3.5 35B-A3BAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Qwen3-Next 80B-A3B InstructAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
gpt-oss-120bOpenAIOpen sourceDoes Not FitDoes Not Fit——
GLM-4.5-Air (106B-A12B)Z.aiOpen sourceDoes Not FitDoes Not Fit——
Llama 4 Scout (109B-A17B)MetaOpen weights (restricted)Does Not FitDoes Not Fit——
Qwen3 32BAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Llama 3.3 70B InstructMetaOpen weights (restricted)Does Not FitDoes Not Fit——
Qwen2.5-Coder 32B InstructAlibaba QwenOpen sourceDoes Not FitDoes Not Fit——
Nemotron 3.5 Super VL 120B-A12BNVIDIAUnsupportedUnsupported——
Reflection Beam (501B-A23B)Reflection AIOpen sourceUnsupportedUnsupported——
Step 5 Preview 600B-A27BStepfunUnsupportedUnsupported——

Want a specific tool, context size or workload?

The full check models your exact setup, including the apps you keep open.

Check this machine in detail