How many t/s would you live with to run Fable/Carbon/Astra/etc locally? And what cliff?

Wait 5 sec.

I'll go first. Fifteen is my cutoff for the early buckets. Muse Spark currently crawling way down below 10 at ~300k context, but it's so token efficient it's still quicker than DSv41 in wall clock terms.   submitted by   /u/challis88ocarina [link]   [comments]