Can Desktop PC · Radeon RX 9070 XT · 32 GB RAM run Kolibri-1 (78B-A3.5B)?
16 GB VRAM + 32 GB RAM · 640 GB/s memory bandwidth · Kolibri-1 (78B-A3.5B) has 78.1B parameters (3.46B active per token).
Short answer
No. It doesn't fit in memory.
Needs ≈45 GB but only ≈39 GB of VRAM + system RAM is available after the OS and other apps.
Why it doesn’t fit
Even its smallest practical version (Q4_K_M) needs about 45 GB for the model, its context memory and the runtime. After Windows (≈4.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Desktop PC · Radeon RX 9070 XT · 32 GB RAM has about 39 GB left, so it’s 7.0 GB short.
Ways to make it work
Close everything else
Not enough on its own: with every other app closed it’s still about 4.0 GB short.
Pick a smaller model from the same family
No smaller Kolibri model in our catalog runs well here. See the other models below.
Get more memory
You’d want at least 54 GB of VRAM plus RAM in total. The machines below are the cheapest that run it comfortably.
Check your exact setup
These pages assume typical settings. A shorter context or a lighter chat app can change the answer.
Check Desktop PC · Radeon RX 9070 XT · 32 GB RAM
The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.
Other models for Desktop PC · Radeon RX 9070 XT · 32 GB RAM
The best-rated models for chat on this machine.
- gpt-oss-20b160–210 tok/sExcellent
- Gemma 4 26B-A4B170–240 tok/sExcellent
- MiniCPM5 2B160–220 tok/sExcellent
- Qwen3.5 9B55–75 tok/sExcellent
- Qwen3.5 4B100–130 tok/sExcellent
- Gemma 4 12B45–60 tok/sExcellent
Cheapest machines for Kolibri-1 (78B-A3.5B)
Hardware rated comfortable or better for chat, lowest price first.
- Desktop PC · Ryzen 9 9950X (no GPU) · 64 GB DDR5$1,400 · 13–20 tok/sComfortable
- Ryzen AI Max+ 395 mini PC / Framework Desktop · 64 GB$1,600 · 65–90 tok/sExcellent
- Ryzen AI Max+ 395 mini PC / Framework Desktop · 128 GB$2,000 · 40–55 tok/sExcellent
- Mac mini M4 Pro 64 GB$2,199 · 60–80 tok/sExcellent
- Mac Studio M1 Max 64 GB$2,399 · 80–110 tok/sExcellent
- Mac mini M5 Pro 64 GB$2,499 · 55–90 tok/sExcellent
Different tool, context size or workload?
These pages use typical settings. The full check models your exact setup.