What LLMs can Desktop PC · GeForce RTX 5090 · 32 GB RAM run?
32 GB VRAM + 32 GB RAM, 1792 GB/s memory bandwidth, about $2,900. Every open model in our catalog, rated by the engine for chat and for agentic coding.
Runs well (31)
Fast enough and with memory to spare for everyday chat.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| Qwen3.6 35B-A3BAlibaba QwenOpen source | Excellent | Comfortable | Q5_K_M | 320–440 tok/s |
| Gemma 4 26B-A4BGoogleOpen source | Excellent | Comfortable | Q6_K | 220–300 tok/s |
| LFM2.5 24B-A2BLiquid AI | Excellent | Comfortable | Q4_K_M | 560–760 tok/s |
| Qwen3.5 35B-A3BAlibaba QwenOpen source | Excellent | Comfortable | Q5_K_M | 320–440 tok/s |
| GLM-4.7-Flash (30B-A3B)Z.aiOpen source | Excellent | Comfortable | Q6_K | 270–370 tok/s |
| gpt-oss-20bOpenAIOpen source | Excellent | Comfortable | MXFP4 | ≈260 tok/s |
| Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen source | Excellent | Acceptable | Q6_K | 240–320 tok/s |
| Qwen3.8 27BAlibaba QwenOpen source | Excellent | Excellent | Q6_K | 40–55 tok/s |
| Qwen3.6 27BAlibaba QwenOpen source | Excellent | Excellent | Q6_K | 40–55 tok/s |
| Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen source | Excellent | Comfortable | Q6_K | 240–320 tok/s |
| MiniCPM5 2BOpenBMBOpen source | Excellent | Acceptable | Q8_0 | 340–460 tok/s |
| Gemma 4 31BGoogleOpen source | Excellent | Comfortable | Q6_K | 35–50 tok/s |
| Qwen3.5 27BAlibaba QwenOpen source | Excellent | Excellent | Q6_K | 40–55 tok/s |
| Qwen3.5 9BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 110–150 tok/s |
| Qwen3.5 4BAlibaba QwenOpen source | Excellent | Acceptable | Q8_0 | 210–280 tok/s |
| Gemma 4 12BGoogleOpen source | Excellent | Acceptable | Q6_K | 95–130 tok/s |
| GLM-4.6V-Flash (10B)Z.aiOpen source | Excellent | Acceptable | Q6_K | 110–150 tok/s |
| Qwen3 8BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 130–180 tok/s |
| Qwen3 14BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 75–100 tok/s |
| DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen source | Excellent | Acceptable | Q6_K | 130–180 tok/s |
| Muse Glimmer (30B)MetaOpen source | Excellent | Acceptable | Q4_K_M | 55–75 tok/s |
| Gemma 4 E4BGoogleOpen source | Excellent | Borderline | Q6_K | 140–190 tok/s |
| Mistral Small 3.2 (24B)Mistral AIOpen source | Excellent | Acceptable | Q6_K | 45–65 tok/s |
| Phi-4 (14B)MicrosoftOpen source | Excellent | Acceptable | Q6_K | 75–100 tok/s |
| Gemma 3 27BGoogleOpen weights (restricted) | Excellent | Acceptable | Q6_K | 40–55 tok/s |
| Llama 3.2 3B InstructMetaOpen weights (restricted) | Excellent | Technically Runs | Q6_K | 320–430 tok/s |
| Llama 3.1 8B InstructMetaOpen weights (restricted) | Excellent | Borderline | Q6_K | 130–180 tok/s |
| Qwen3 32BAlibaba QwenOpen source | Excellent | Acceptable | Q5_K_M | 40–55 tok/s |
| Devstral Small 2 (24B)Mistral AIOpen source | Excellent | Excellent | Q6_K | 45–65 tok/s |
| Qwen2.5-Coder 7B InstructAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 140–200 tok/s |
| Qwen2.5-Coder 32B InstructAlibaba QwenOpen source | Excellent | Acceptable | Q5_K_M | 40–55 tok/s |
Loads, but not recommended (6)
Technically runs. Expect a frustrating experience.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| Qwen3-Next 80B-A3B InstructAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 40–55 tok/s |
| Kolibri-1 (78B-A3.5B)Aleph AlphaOpen source | Borderline | Borderline | Q4_K_M | 35–45 tok/s |
| Nemotron 3.5 Bolt 74B-A9BNVIDIA | Borderline | Borderline | 4-bit | 20–25 tok/s |
| GLM-4.5-Air (106B-A12B)Z.aiOpen source | Borderline | Does Not Fit | Q3_K_M | 9–13 tok/s |
| Llama 3.3 70B InstructMetaOpen weights (restricted) | Borderline | Technically Runs | Q4_K_M | 2.4–3.3 tok/s |
| Llama 4 Scout (109B-A17B)MetaOpen weights (restricted) | Borderline | Does Not Fit | Q3_K_M | 7–9 tok/s |
Doesn't fit or isn't supported (11)
Not enough usable memory, or the runtime can't run it here.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Muse Spark Open 816B-A42BMeta | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3 (753B-A40B)Z.ai | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3-Flash (320B-A18B)Z.aiOpen source | Does Not Fit | Does Not Fit | — | — |
| DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Mistral Small 4 (119B-A6.5B)Mistral AIOpen source | Does Not Fit | Does Not Fit | — | — |
| Qwen3.5 122B-A10BAlibaba QwenOpen source | Does Not Fit | Does Not Fit | — | — |
| gpt-oss-120bOpenAIOpen source | Does Not Fit | Does Not Fit | — | — |
| Nemotron 3.5 Super VL 120B-A12BNVIDIA | Unsupported | Unsupported | — | — |
| Reflection Beam (501B-A23B)Reflection AIOpen source | Unsupported | Unsupported | — | — |
| Step 5 Preview 600B-A27BStepfun | Unsupported | Unsupported | — | — |
Want a specific tool, context size or workload?
The full check models your exact setup, including the apps you keep open.