If you are on MacOS and using Clef models, make sure you are on the latest llama.cpp build. Initial support for Cloudflare Clef models had a major issue, causing very low accuracy on MacOS. This has now been fixed in b11476 onward. PR link: https://github.com/ggml-org/llama.cpp/pull/30100   submitted by   /u/yuicebox [link]   [comments]