Can Desktop PC · RTX PRO 6000 Blackwell · 128 GB RAM run Nemotron 3.5 Super VL 120B-A12B?
96 GB VRAM + 128 GB RAM · 1792 GB/s memory bandwidth · Nemotron 3.5 Super VL 120B-A12B has 120B parameters (12B active per token).
Short answer
No. This combination isn't supported.
Nemotron 3.5 Super VL 120B-A12B is not published in a format llama.cpp (llama-server) can load (GGUF).
The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.
Other models for Desktop PC · RTX PRO 6000 Blackwell · 128 GB RAM
The best-rated models for chat on this machine.
- Qwen3.6 35B-A3B260–360 tok/sExcellent
- Qwen3-Next 80B-A3B Instruct260–360 tok/sExcellent
- gpt-oss-120b≈180 tok/sExcellent
- Gemma 4 26B-A4B210–280 tok/sExcellent
- Qwen3.5 35B-A3B260–360 tok/sExcellent
- LFM2.5 24B-A2B530–720 tok/sExcellent
Cheapest machines for Nemotron 3.5 Super VL 120B-A12B
Hardware rated comfortable or better for chat, lowest price first.
- Mac Studio M2 Max 96 GB$3,799 · 25–35 tok/sExcellent
- MacBook Pro M3 Max 96 GB$3,999 · 20–30 tok/sExcellent
- Mac Studio M4 Max 128 GB$4,099 · 35–45 tok/sExcellent
- Mac Studio M5 Max 128 GB$4,099 · 30–50 tok/sExcellent
- MacBook Pro M2 Max 96 GB$5,099 · 25–35 tok/sExcellent
- MacBook Pro M4 Max 128 GB$5,299 · 35–45 tok/sExcellent
Different tool, context size or workload?
These pages use typical settings. The full check models your exact setup.