What LLMs can Desktop PC · GeForce RTX 4090 · 32 GB RAM run?
24 GB VRAM + 32 GB RAM, 1008 GB/s memory bandwidth, about $2,700. Every open model in our catalog, rated by the engine for chat and for agentic coding.
Runs well (31)
Fast enough and with memory to spare for everyday chat.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| Qwen3.6 35B-A3BAlibaba QwenOpen source | Excellent | Acceptable | Q4_K_M | 240–330 tok/s |
| Gemma 4 26B-A4BGoogleOpen source | Excellent | Comfortable | Q5_K_M | 160–220 tok/s |
| LFM2.5 24B-A2BLiquid AI | Excellent | Acceptable | Q4_K_M | 360–490 tok/s |
| Qwen3.5 35B-A3BAlibaba QwenOpen source | Excellent | Acceptable | Q4_K_M | 240–330 tok/s |
| GLM-4.7-Flash (30B-A3B)Z.aiOpen source | Excellent | Comfortable | Q4_K_M | 240–330 tok/s |
| gpt-oss-20bOpenAIOpen source | Excellent | Comfortable | MXFP4 | ≈210 tok/s |
| Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen source | Excellent | Acceptable | Q5_K_M | 180–240 tok/s |
| Qwen3.8 27BAlibaba QwenOpen source | Excellent | Comfortable | Q5_K_M | 30–40 tok/s |
| Qwen3.6 27BAlibaba QwenOpen source | Excellent | Comfortable | Q5_K_M | 30–40 tok/s |
| Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen source | Excellent | Comfortable | Q5_K_M | 180–240 tok/s |
| MiniCPM5 2BOpenBMBOpen source | Excellent | Acceptable | Q8_0 | 220–300 tok/s |
| Qwen3.5 9BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 75–100 tok/s |
| Qwen3.5 27BAlibaba QwenOpen source | Excellent | Comfortable | Q5_K_M | 30–40 tok/s |
| Gemma 4 31BGoogleOpen source | Excellent | Comfortable | Q4_K_M | 35–45 tok/s |
| Qwen3.5 4BAlibaba QwenOpen source | Excellent | Acceptable | Q8_0 | 130–180 tok/s |
| Gemma 4 12BGoogleOpen source | Excellent | Acceptable | Q6_K | 60–80 tok/s |
| GLM-4.6V-Flash (10B)Z.aiOpen source | Excellent | Acceptable | Q6_K | 70–95 tok/s |
| Qwen3 8BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 85–110 tok/s |
| Qwen3 14BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 50–65 tok/s |
| DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen source | Excellent | Acceptable | Q6_K | 85–110 tok/s |
| Muse Glimmer (30B)MetaOpen source | Excellent | Acceptable | Q4_K_M | 35–50 tok/s |
| Gemma 4 E4BGoogleOpen source | Excellent | Borderline | Q6_K | 90–120 tok/s |
| Mistral Small 3.2 (24B)Mistral AIOpen source | Excellent | Acceptable | Q5_K_M | 35–45 tok/s |
| Phi-4 (14B)MicrosoftOpen source | Excellent | Acceptable | Q6_K | 50–65 tok/s |
| Llama 3.2 3B InstructMetaOpen weights (restricted) | Excellent | Technically Runs | Q6_K | 200–280 tok/s |
| Llama 3.1 8B InstructMetaOpen weights (restricted) | Excellent | Borderline | Q6_K | 85–120 tok/s |
| Gemma 3 27BGoogleOpen weights (restricted) | Excellent | Acceptable | Q5_K_M | 30–40 tok/s |
| Devstral Small 2 (24B)Mistral AIOpen source | Excellent | Comfortable | Q5_K_M | 35–45 tok/s |
| Qwen3 32BAlibaba QwenOpen source | Excellent | Borderline | Q4_K_M | 30–40 tok/s |
| Qwen2.5-Coder 7B InstructAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 95–130 tok/s |
| Qwen2.5-Coder 32B InstructAlibaba QwenOpen source | Excellent | Borderline | Q4_K_M | 30–40 tok/s |
Loads, but not recommended (4)
Technically runs. Expect a frustrating experience.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| Qwen3-Next 80B-A3B InstructAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 30–40 tok/s |
| Kolibri-1 (78B-A3.5B)Aleph AlphaOpen source | Borderline | Does Not Fit | Q4_K_M | 25–35 tok/s |
| Nemotron 3.5 Bolt 74B-A9BNVIDIA | Borderline | Borderline | 4-bit | 13–17 tok/s |
| Llama 3.3 70B InstructMetaOpen weights (restricted) | Borderline | Technically Runs | Q4_K_M | 1.7–2.4 tok/s |
Doesn't fit or isn't supported (13)
Not enough usable memory, or the runtime can't run it here.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Muse Spark Open 816B-A42BMeta | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3 (753B-A40B)Z.ai | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3-Flash (320B-A18B)Z.aiOpen source | Does Not Fit | Does Not Fit | — | — |
| DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Mistral Small 4 (119B-A6.5B)Mistral AIOpen source | Does Not Fit | Does Not Fit | — | — |
| Qwen3.5 122B-A10BAlibaba QwenOpen source | Does Not Fit | Does Not Fit | — | — |
| gpt-oss-120bOpenAIOpen source | Does Not Fit | Does Not Fit | — | — |
| GLM-4.5-Air (106B-A12B)Z.aiOpen source | Does Not Fit | Does Not Fit | — | — |
| Llama 4 Scout (109B-A17B)MetaOpen weights (restricted) | Does Not Fit | Does Not Fit | — | — |
| Nemotron 3.5 Super VL 120B-A12BNVIDIA | Unsupported | Unsupported | — | — |
| Reflection Beam (501B-A23B)Reflection AIOpen source | Unsupported | Unsupported | — | — |
| Step 5 Preview 600B-A27BStepfun | Unsupported | Unsupported | — | — |
Want a specific tool, context size or workload?
The full check models your exact setup, including the apps you keep open.