Local AI Advisor

Can MacBook Pro M3 Pro 18 GB run Devstral Small 2 (24B)?

18 GB unified · 150 GB/s memory bandwidth · Devstral Small 2 (24B) has 24B parameters.

Short answer

No. It doesn't fit in memory.

Needs ≈12 GB but only ≈11 GB is available after the OS, other apps and Open WebUI.

Why it doesn’t fit

Even its smallest practical version (3-bit) needs about 12 GB for the model, its context memory and the runtime. After macOS (≈3.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), MacBook Pro M3 Pro 18 GB has about 11 GB left, so it’s 1.9 GB short.

Ways to make it work

  • Close everything else

    With no other apps open, Devstral Small 2 (24B) runs at 3-bit: Borderline at 9–12 tok/s. Expect the system to feel tight while it’s loaded.

  • Pick a smaller model from the same family

    No smaller Devstral model in our catalog runs well here. See the other models below.

  • Get more memory

    The same chip with 36 GB handles it: Acceptable.

  • Check your exact setup

    These pages assume typical settings. A shorter context or a lighter chat app can change the answer.

    Check MacBook Pro M3 Pro 18 GB

The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.

Different tool, context size or workload?

These pages use typical settings. The full check models your exact setup.