Just wanted to hear feedback from those of you who have considered the M5U 512, and what decision you’ve made, or if you’re still undecided - as well as what has convinced you one way or another. Personally, I’m struggling with this choice. My primary concern, after reading reviews of the 256 M5U, is prefill speeds with a moderate context window of 75-125k, and general uncertainty as someone who has not run a local model greater than 8b parameters at 10-15k context. The value of an effective local AI would be immense to me, but the possibility of rapid development of far superior hardware in the next year or two, as well as switching from Windows to Mac, with limited MacOS experience, has been discouraging.   submitted by   /u/Submersed [link]   [comments]