What LLMs can Desktop PC · Radeon RX 9070 XT · 32 GB RAM run?
16 GB VRAM + 32 GB RAM, 640 GB/s memory bandwidth, about $1,500. Every open model in our catalog, rated by the engine for chat and for agentic coding.
Runs well (17)
Fast enough and with memory to spare for everyday chat.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| gpt-oss-20bOpenAIOpen source | Excellent | Comfortable | MXFP4 | 160–210 tok/s |
| Gemma 4 26B-A4BGoogleOpen source | Excellent | Acceptable | Q3_K_M | 170–240 tok/s |
| MiniCPM5 2BOpenBMBOpen source | Excellent | Acceptable | Q8_0 | 160–220 tok/s |
| Qwen3.5 9BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 55–75 tok/s |
| Qwen3.5 4BAlibaba QwenOpen source | Excellent | Acceptable | Q8_0 | 100–130 tok/s |
| Gemma 4 12BGoogleOpen source | Excellent | Acceptable | Q6_K | 45–60 tok/s |
| GLM-4.6V-Flash (10B)Z.aiOpen source | Excellent | Acceptable | Q6_K | 50–70 tok/s |
| Qwen3 8BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 60–85 tok/s |
| Qwen3 14BAlibaba QwenOpen source | Excellent | Borderline | Q5_K_M | 40–55 tok/s |
| DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen source | Excellent | Acceptable | Q6_K | 60–85 tok/s |
| Gemma 4 E4BGoogleOpen source | Excellent | Borderline | Q6_K | 65–90 tok/s |
| Phi-4 (14B)MicrosoftOpen source | Excellent | Acceptable | Q5_K_M | 40–55 tok/s |
| Llama 3.2 3B InstructMetaOpen weights (restricted) | Excellent | Technically Runs | Q6_K | 150–200 tok/s |
| Llama 3.1 8B InstructMetaOpen weights (restricted) | Excellent | Borderline | Q6_K | 65–85 tok/s |
| Qwen2.5-Coder 7B InstructAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 70–90 tok/s |
| Mistral Small 3.2 (24B)Mistral AIOpen source | Excellent | Borderline | Q3_K_M | 35–50 tok/s |
| Devstral Small 2 (24B)Mistral AIOpen source | Excellent | Borderline | Q3_K_M | 35–50 tok/s |
Loads, but not recommended (16)
Technically runs. Expect a frustrating experience.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| LFM2.5 24B-A2BLiquid AI | Borderline | Borderline | Q4_K_M | 260–360 tok/s |
| Qwen3.6 35B-A3BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 45–65 tok/s |
| GLM-4.7-Flash (30B-A3B)Z.aiOpen source | Borderline | Borderline | Q4_K_M | 65–90 tok/s |
| Qwen3.5 35B-A3BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 45–65 tok/s |
| Qwen3.8 27BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 13–17 tok/s |
| Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 50–70 tok/s |
| Qwen3.6 27BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 11–15 tok/s |
| Qwen3.5 27BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 12–16 tok/s |
| Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 50–70 tok/s |
| Gemma 4 31BGoogleOpen source | Borderline | Borderline | Q4_K_M | 7–10 tok/s |
| Qwen3-Next 80B-A3B InstructAlibaba QwenOpen source | Borderline | Does Not Fit | Q3_K_M | 35–45 tok/s |
| Muse Glimmer (30B)MetaOpen source | Borderline | Borderline | Q4_K_M | 12–17 tok/s |
| Gemma 3 27BGoogleOpen weights (restricted) | Borderline | Borderline | Q4_K_M | 11–15 tok/s |
| Qwen3 32BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 6–7 tok/s |
| Qwen2.5-Coder 32B InstructAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 5–7 tok/s |
| Llama 3.3 70B InstructMetaOpen weights (restricted) | Borderline | Does Not Fit | Q3_K_M | 1.9–2.5 tok/s |
Doesn't fit or isn't supported (15)
Not enough usable memory, or the runtime can't run it here.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Kolibri-1 (78B-A3.5B)Aleph AlphaOpen source | Does Not Fit | Does Not Fit | — | — |
| Muse Spark Open 816B-A42BMeta | Does Not Fit | Does Not Fit | — | — |
| Nemotron 3.5 Bolt 74B-A9BNVIDIA | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3 (753B-A40B)Z.ai | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3-Flash (320B-A18B)Z.aiOpen source | Does Not Fit | Does Not Fit | — | — |
| DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Mistral Small 4 (119B-A6.5B)Mistral AIOpen source | Does Not Fit | Does Not Fit | — | — |
| Qwen3.5 122B-A10BAlibaba QwenOpen source | Does Not Fit | Does Not Fit | — | — |
| gpt-oss-120bOpenAIOpen source | Does Not Fit | Does Not Fit | — | — |
| GLM-4.5-Air (106B-A12B)Z.aiOpen source | Does Not Fit | Does Not Fit | — | — |
| Llama 4 Scout (109B-A17B)MetaOpen weights (restricted) | Does Not Fit | Does Not Fit | — | — |
| Nemotron 3.5 Super VL 120B-A12BNVIDIA | Unsupported | Unsupported | — | — |
| Reflection Beam (501B-A23B)Reflection AIOpen source | Unsupported | Unsupported | — | — |
| Step 5 Preview 600B-A27BStepfun | Unsupported | Unsupported | — | — |
Want a specific tool, context size or workload?
The full check models your exact setup, including the apps you keep open.