It offers a very basic repl, shell one-liner and full conversation management for application integration. Fully stateless, no config needed, very lightweight (C + libcurl + cjson). Released for Linux (pre-packaged for distros and binaries) and Windows (one exe). https://github.com/dgdevel/llmkit I test and run on ArchLinux (btw), so if anyone can confirm that the packaged version works it would be helpful.   submitted by   /u/pentothal [link]   [comments]