Local AI Advisor

Can Surface Laptop Ultra · RTX Spark N1X (18-core) · 24 GB run Mistral Small 4 (119B-A6.5B)?

24 GB unified · 300 GB/s memory bandwidth · Mistral Small 4 (119B-A6.5B) has 119.4B parameters (6.5B active per token).

Short answer

No. It doesn't fit in memory.

Needs ≈56 GB but only ≈16 GB is available after the OS, other apps and Open WebUI.

Why it doesn’t fit

Even its smallest practical version (Q3_K_M) needs about 56 GB for the model, its context memory and the runtime. After Windows (≈4.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Surface Laptop Ultra · RTX Spark N1X (18-core) · 24 GB has about 16 GB left, so it’s 40 GB short.

Ways to make it work

The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.

Different tool, context size or workload?

These pages use typical settings. The full check models your exact setup.