Currently whats the best near 4-bit quantization method (excluding nvfp4)? [Only in term of quality, not speed]

Wait 5 sec.

Which quantization is most near to the full precision? excluding nvfp4. I am confused by mxfp4, EXL3 (4.0 bpw), int4-AWQ, etc And also is any one of it can match or beat nvfp4? Thankyou   submitted by   /u/9r4n4y [link]   [comments]