Mac mini for running LLMs and AI agents 24/7: Prioritize RAM or CPU/GPU performance?

Wait 5 sec.

I’m planning to get a Mac mini mainly to run local LLMs and AI agents 24/7. I plan to run models up to 27B parameters with Q4 quantization, and maybe not for coding, maybe just for everday task and model exploration. I’m trying to figure out whether I should prioritize more RAM or a more powerful chip. For example, I’m considering: M4 with 32GB RAM M4 Pro with 24GB RAM For this kind of workload, which matters more: having more memory to run larger models, or better CPU/GPU performance for faster inference? I’d love to hear from anyone running a similar setup!   submitted by   /u/secsilm [link]   [comments]