I was buying a Mac mini and kept going back and forth between configs, trying to guess which one would actually run the models I want. So I built a configurator for people buying a Mac to run local LLMs: https://modelfit.io/ You can clearly see all the best llms it can read and at what efficiency all updating in real time according to the configuration you pick. You pick a Mac and a config, and it shows which models fit in memory and an estimated speed for each. The speed estimates come from a model fitted on real llama-bench runs, and every number shows its typical error, so you know how much to trust it. Apple list prices update daily. So I built my own configurator especially for people like me that are purchasing a mac in order to do some local ai. It's my own project. I'd love feedback, especially from people who can compare the estimates with their own numbers. Also Was hesitating between m6 32gb and m5pro 48gb, I'll pick the m5pro what do you think about that choice ?   submitted by   /u/WecK0 [link]   [comments]