Local AI Advisor

Can Mac Pro M2 Ultra 64 GB run Nemotron 3.5 Super VL 120B-A12B?

64 GB unified · 800 GB/s memory bandwidth · Nemotron 3.5 Super VL 120B-A12B has 120B parameters (12B active per token).

Short answer

No. It doesn't fit in memory.

Needs ≈62 GB but only ≈54 GB is available after the OS, other apps and Open WebUI.

Why it doesn’t fit

Even its smallest practical version (MXFP4) needs about 62 GB for the model, its context memory and the runtime. After macOS (≈6.0 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Mac Pro M2 Ultra 64 GB has about 54 GB left, so it’s 7.9 GB short.

Ways to make it work

  • Close everything else

    Not enough on its own: with every other app closed it’s still about 4.9 GB short.

  • Pick a smaller model from the same family

  • Get more memory

    The same chip with 128 GB handles it: Excellent.

  • Check your exact setup

    These pages assume typical settings. A shorter context or a lighter chat app can change the answer.

    Check Mac Pro M2 Ultra 64 GB

The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.

Other models for Mac Pro M2 Ultra 64 GB

The best-rated models for chat on this machine.

Everything Mac Pro M2 Ultra 64 GB can run

Cheapest machines for Nemotron 3.5 Super VL 120B-A12B

Hardware rated comfortable or better for chat, lowest price first.

Same chip, other memory: 128 GB, 192 GB

Different tool, context size or workload?

These pages use typical settings. The full check models your exact setup.

Check my exact setup