Local AI Advisor

Can Desktop PC · Radeon RX 7900 XT · 32 GB RAM run GLM-4.5-Air (106B-A12B)?

20 GB VRAM + 32 GB RAM · 800 GB/s memory bandwidth · GLM-4.5-Air (106B-A12B) has 110.5B parameters (12B active per token).

Short answer

No. It doesn't fit in memory.

Needs ≈53 GB but only ≈43 GB of VRAM + system RAM is available after the OS and other apps.

Why it doesn’t fit

Even its smallest practical version (Q3_K_M) needs about 53 GB for the model, its context memory and the runtime. After Windows (≈4.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Desktop PC · Radeon RX 7900 XT · 32 GB RAM has about 43 GB left, so it’s 11 GB short.

Ways to make it work

The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.

Different tool, context size or workload?

These pages use typical settings. The full check models your exact setup.