My sample size is not very big but it feels like since updating Qwen Flash Next to v3.1 and Strata to 0.2.11, IQ4_XS quant seems to fail tool calls even more often than the previous version did in both Hermes and Oh my Pi harnesses with int8 KV cache in Strata. Weird thing is, after failed tool calls, it just straight up stop generating altogether, I have to send a continue for it to finish. Tried addressing this on unsloth's subreddit and the post got nuked. Honestly could just be a Strata issue and not Unsloth's, I have yet to perform an investigation. Anyone else had this experience with new updated quants?   submitted by   /u/citrusalex [link]   [comments]