Currently having high success with this little niche finetune i found sitting in the corner of huggingface If you want to try it out here is a smaller quantisation iq3_s works really well in my codebases. Original Model: https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2-GGUF Smaller Quant: https://huggingface.co/tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF   submitted by   /u/Express_Quail_1493 [link]   [comments]