I built Loft, a little notch that sits at the top of your screen. Click it and it opens into a chat where you can ask questions about your own docs, folders and code. It all runs locally on llama.cpp, with no cloud and no API key. How it works: Point it at a folder and it indexes it locally Ask a question and llama.cpp answers on your GPU or CPU (there are experimental NPU options too) Every answer cites the file it came from, so you can check it yourself Chat history stays local You pick the model and the performance settings It's built with Rust, Tauri and Svelte. To be honest, it's early. It's tested on Windows, initially validated on macOS, and Linux builds pass CI on Ubuntu 24.04 but need real-world testers. I'd love help from Linux testers, NPU tinkerers, Svelte folks and anyone with ideas for better chunking. Nothing for sale. It's MIT open source from EAN Digital. It's just a fun project I'd like people to hack on, so issues and PRs are very welcome. Fork it. Break it. Make it yours. https://github.com/nwaoga/loft   submitted by   /u/Nwaoga [link]   [comments]