Can Laptop · GeForce RTX 4090 Laptop · 32 GB RAM run GLM-4.5-Air (106B-A12B)?
16 GB VRAM + 32 GB RAM · 576 GB/s memory bandwidth · GLM-4.5-Air (106B-A12B) has 110.5B parameters (12B active per token).
Short answer
No. It doesn't fit in memory.
Needs ≈53 GB but only ≈39 GB of VRAM + system RAM is available after the OS and other apps.
Why it doesn’t fit
Even its smallest practical version (Q3_K_M) needs about 53 GB for the model, its context memory and the runtime. After Windows (≈4.5 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Laptop · GeForce RTX 4090 Laptop · 32 GB RAM has about 39 GB left, so it’s 15 GB short.
Ways to make it work
Close everything else
Not enough on its own: with every other app closed it’s still about 12 GB short.
Pick a smaller model from the same family
Get more memory
You’d want at least 62 GB of VRAM plus RAM in total. The machines below are the cheapest that run it comfortably.
Check your exact setup
These pages assume typical settings. A shorter context or a lighter chat app can change the answer.
Check Laptop · GeForce RTX 4090 Laptop · 32 GB RAM
The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.
Other models for Laptop · GeForce RTX 4090 Laptop · 32 GB RAM
The best-rated models for chat on this machine.
- gpt-oss-20b100–170 tok/sExcellent
- Gemma 4 26B-A4B110–190 tok/sExcellent
- MiniCPM5 2B100–170 tok/sExcellent
- Qwen3.5 9B35–55 tok/sExcellent
- Qwen3.5 4B65–100 tok/sExcellent
- Gemma 4 12B30–45 tok/sExcellent
Cheapest machines for GLM-4.5-Air (106B-A12B)
Hardware rated comfortable or better for chat, lowest price first.
- Ryzen AI Max+ 395 mini PC / Framework Desktop · 128 GB$2,000 · 17–25 tok/sExcellent
- Mac Studio M2 Max 96 GB$3,799 · 25–35 tok/sExcellent
- MacBook Pro M3 Max 96 GB$3,999 · 19–25 tok/sExcellent
- Mac Studio M5 Max 128 GB$4,099 · 25–45 tok/sExcellent
- Mac Studio M4 Max 128 GB$4,099 · 25–35 tok/sExcellent
- MacBook Pro M2 Max 96 GB$5,099 · 25–35 tok/sExcellent
Different tool, context size or workload?
These pages use typical settings. The full check models your exact setup.