I keep coming back to the 27B for coding. Curious if I'm the only one. I kinda want to know the most popular models for local inference, im working on an open source (Apache 2.0) project and it would be nice to know which models on for Apple Silicon should https://github.com/nace-ai/kapitsa trying to optimize first. Cool thing about our project is that it works on all M chips: from M1 up to M5 Ultras. I managed to get the SOTA for my M4 pro bot on decode and prefill for Qwen 35b/27b   submitted by   /u/DotaMate [link]   [comments]