Can Desktop PC · GeForce RTX 3060 12GB · 32 GB RAM run Mistral Large 4 (1T-A52B)?
12 GB VRAM + 32 GB RAM · 360 GB/s memory bandwidth · Mistral Large 4 (1T-A52B) has 1000B parameters (52B active per token).
Short answer
No. This combination isn't supported.
Mistral Large 4 (1T-A52B) is not published in a format llama.cpp (llama-server) can load (GGUF).
The same applies to every workload we rate (chat, coding questions, coding in a repository, agentic coding and long documents): they all need at least as much memory as chat.
Other models for Desktop PC · GeForce RTX 3060 12GB · 32 GB RAM
The best-rated models for chat on this machine.
- MiniCPM5 2B65–110 tok/sExcellent
- Qwen3.5 9B20–35 tok/sExcellent
- Qwen3.5 4B40–65 tok/sExcellent
- Gemma 4 12B25–40 tok/sExcellent
- GLM-4.6V-Flash (10B)25–40 tok/sExcellent
- Qwen3 8B25–40 tok/sExcellent
Cheapest machines for Mistral Large 4 (1T-A52B)
Hardware rated comfortable or better for chat, lowest price first.
No machine in our catalog runs it comfortably for chat.
Different tool, context size or workload?
These pages use typical settings. The full check models your exact setup.