Local AI Advisor

Can Surface Laptop Ultra · RTX Spark N1X (18-core) · 24 GB run Nemotron 3.5 Bolt 74B-A9B?

24 GB unified · 300 GB/s memory bandwidth · Nemotron 3.5 Bolt 74B-A9B has 74B parameters (9B active per token).

Short answer

No. It doesn't fit in memory.

Needs ≈40 GB but only ≈16 GB is available after the OS, other apps and Open WebUI.

Why it doesn’t fit

Even its smallest practical version (4-bit) needs about 40 GB for the model, its context memory and the runtime. After Windows (≈4.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Surface Laptop Ultra · RTX Spark N1X (18-core) · 24 GB has about 16 GB left, so it’s 25 GB short.

Ways to make it work

  • Close everything else

    Not enough on its own: with every other app closed it’s still about 22 GB short.

  • Pick a smaller model from the same family

    No smaller Nemotron 3.5 model in our catalog runs well here. See the other models below.

  • Get more memory

    The same machine with 128 GB handles it: Excellent.

  • Check your exact setup

    These pages assume typical settings. A shorter context or a lighter chat app can change the answer.

    Check Surface Laptop Ultra · RTX Spark N1X (18-core) · 24 GB

The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.

Different tool, context size or workload?

These pages use typical settings. The full check models your exact setup.