Local AI Advisor

Can Desktop PC · RTX PRO 6000 Blackwell · 128 GB RAM run GLM-5.3 (753B-A40B)?

96 GB VRAM + 128 GB RAM · 1792 GB/s memory bandwidth · GLM-5.3 (753B-A40B) has 753B parameters (40B active per token).

Short answer

No. It doesn't fit in memory.

Needs ≈348 GB but only ≈211 GB of VRAM + system RAM is available after the OS and other apps.

Why it doesn’t fit

Even its smallest practical version (Q3_K_M) needs about 348 GB for the model, its context memory and the runtime. After Windows (≈8.0 GB), a browser with a few tabs (≈3.0 GB) and Open WebUI (≈1.0 GB), Desktop PC · RTX PRO 6000 Blackwell · 128 GB RAM has about 211 GB left, so it’s 137 GB short.

Ways to make it work

The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.

Different tool, context size or workload?

These pages use typical settings. The full check models your exact setup.