Ref: release, PR Starting from v0.7.0, the default port for llama server is now 9931 (ggml) inside the container. Those who did not explicitly set the port, expect breaking change upon upgrading. Those who use harnesses that have hardcoded 8080 port, good luck.   submitted by   /u/413205 [link]   [comments]