Local AI Advisor

Can Mac mini M6 32 GB run Kolibri-1 (78B-A3.5B)?

32 GB unified · 170 GB/s memory bandwidth · Kolibri-1 (78B-A3.5B) has 78.1B parameters (3.46B active per token).

Short answer

No. It doesn't fit in memory.

Needs ≈46 GB but only ≈25 GB is available after the OS, other apps and Open WebUI.

Why it doesn’t fit

Even its smallest practical version (Q4_K_M) needs about 46 GB for the model, its context memory and the runtime. After macOS (≈3.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Mac mini M6 32 GB has about 25 GB left, so it’s 21 GB short.

Ways to make it work

  • Close everything else

    Not enough on its own: with every other app closed it’s still about 18 GB short.

  • Pick a smaller model from the same family

    No smaller Kolibri model in our catalog runs well here. See the other models below.

  • Get more memory

    You’d want at least 53 GB of memory in total. The machines below are the cheapest that run it comfortably.

  • Check your exact setup

    These pages assume typical settings. A shorter context or a lighter chat app can change the answer.

    Check Mac mini M6 32 GB

The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.

Other models for Mac mini M6 32 GB

The best-rated models for chat on this machine.

Everything Mac mini M6 32 GB can run

Cheapest machines for Kolibri-1 (78B-A3.5B)

Hardware rated comfortable or better for chat, lowest price first.

Same chip, other memory: 16 GB, 24 GB

Different tool, context size or workload?

These pages use typical settings. The full check models your exact setup.

Open sourceCheck my exact setup