Hello, so lately I have been testing those two quants, since those are the ones that run decently enough on my old laptop. IQ3 destroys prefill. I have noticed IQ2_XS definately has better preserved world knowledge, but is much more prone to looping than q2_0 at the same recommended sampler settings, especially without thinking. What are your experiences running these quants? The benchmarks are also pretty interesting, there's some clear advantages for q2_0 but also for iq2_xs in specific areas.   submitted by   /u/dampflokfreund [link]   [comments]