Made a quant: Swift 1.5 Qwen 3.8 Flash Next - Heretic - Unsloth Dynamic IQ4_XS

Wait 5 sec.

Really couldn't find any good existing quantization for this, only uncensored editions for the GSQ-RCO versions, so I made one. Strata is pre configured for the unsloth dynamic iq4_xs build. Sorry the model card is so cornbally This is the full precision swift 1.5 with the heretic method applied quantized down to iq4_xs. The tensor profile has been extracted from the regular UD-IQ4_XS gguf from qwen 3.8 flash next, and applied to this quant. The model was quantized with an imatrix covering math, code, english language, general instruct, and tools, generated for this model against a small custom dataset. Just IQ4_XS right now because that's what I needed but feel free to request new formats. Copying unsloth quants is pretty easy. https://huggingface.co/trubisky/Swift-1.5-Qwen-3.8-Flash-Next-Heretic-UD-IQ4_XS   submitted by   /u/jjusko20 [link]   [comments]