I am testing Cyber-Tiel-Coder-35B-A3B-MTP-UD-IQ3_XXS.gguf and as of now it is the best performing SMALL and quantized model I have seen SO FAR. Not as fast as Ling, but the reasoning is incredible and not degraded at this quant! (which usually is) Give it a try and tell me your results. 7-8 tok/sec on CPU only (azure standard 4 cpu config like github)   submitted by   /u/Robert__Sinclair [link]   [comments]