M5 Ultra Mac 256GB Studio - 64 core vs. 80 core version, is the inference speed difference worth the extra 10 weeks wait time?

Wait 5 sec.

I’m seeing 6-7 week delivery wait time for M5 Ultra Mac Studio 64 core version versus 15-17 weeks for 80 core version. They both Ultra and have the same memory bandwidth. Is the speed difference that noticeable for prompt processing and token generation? Is it worth the $1200 price difference and extra 10 weeks wait time? I don’t think I’ve seen inference stats for the 60 core version from anyone. What are y’all going to buy?   submitted by   /u/Porespellar [link]   [comments]