Can Desktop PC · GeForce RTX 5080 · 32 GB RAM run Nemotron 3.5 Bolt 74B-A9B?
16 GB VRAM + 32 GB RAM · 960 GB/s memory bandwidth · Nemotron 3.5 Bolt 74B-A9B has 74B parameters (9B active per token).
Short answer
No. It doesn't fit in memory.
Needs ≈40 GB but only ≈39 GB of VRAM + system RAM is available after the OS and other apps.
Why it doesn’t fit
Even its smallest practical version (4-bit) needs about 40 GB for the model, its context memory and the runtime. After Windows (≈4.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Desktop PC · GeForce RTX 5080 · 32 GB RAM has about 39 GB left, so it’s 1.7 GB short.
Ways to make it work
Close everything else
With no other apps open, Nemotron 3.5 Bolt 74B-A9B runs at 4-bit: Borderline at 9–12 tok/s. Expect the system to feel tight while it’s loaded.
Pick a smaller model from the same family
No smaller Nemotron 3.5 model in our catalog runs well here. See the other models below.
Get more memory
You’d want at least 49 GB of VRAM plus RAM in total. The machines below are the cheapest that run it comfortably.
Check your exact setup
These pages assume typical settings. A shorter context or a lighter chat app can change the answer.
Check Desktop PC · GeForce RTX 5080 · 32 GB RAM
The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.
Other models for Desktop PC · GeForce RTX 5080 · 32 GB RAM
The best-rated models for chat on this machine.
- gpt-oss-20b≈190 tok/sExcellent
- Gemma 4 26B-A4B230–310 tok/sExcellent
- MiniCPM5 2B210–290 tok/sExcellent
- Qwen3.5 9B70–95 tok/sExcellent
- Qwen3.5 4B130–180 tok/sExcellent
- Gemma 4 12B60–80 tok/sExcellent
Cheapest machines for Nemotron 3.5 Bolt 74B-A9B
Hardware rated comfortable or better for chat, lowest price first.
- Ryzen AI Max+ 395 mini PC / Framework Desktop · 64 GB$1,600 · 30–40 tok/sExcellent
- Ryzen AI Max+ 395 mini PC / Framework Desktop · 128 GB$2,000 · 30–40 tok/sExcellent
- Mac mini M4 Pro 64 GB$2,199 · 25–35 tok/sExcellent
- Mac Studio M1 Max 64 GB$2,399 · 35–45 tok/sExcellent
- Mac mini M5 Pro 64 GB$2,499 · 20–35 tok/sExcellent
- Mac Studio M2 Max 64 GB$2,599 · 35–45 tok/sExcellent
Different tool, context size or workload?
These pages use typical settings. The full check models your exact setup.