A few weeks ago I posted about my project: Llamaforge. It's not another llama.cpp fork. It's a control panel that drives the real upstream stuff, so when they add a new model you just update from the panel and you have it that day. Now, v0.16 is out. It's kinda early, built with a lot of ai help. Before you load a model it shows you where it's going to land on each gpu, to scale, using the actual sizes measured on your machine. Tells you if it won't fit. I'm tired of oom crashes. You can run several models at once too. The main one goes on the fastest gpu that fits it, and worker models stay off that gpu. V0.16 also adds embers. They're small local agents that watch topics for you. Each one reads sources you point it at overnight, builds its own wiki, and writes you a brief in the morning. The rule is every claim has to quote its source word for word, and plain code checks the quote against the saved snapshot. If the quote isn't there the claim gets dropped. The model proposes, the code decides. They have no browser, no tools, can't send anything on your behalf. Nothing leaves the machine unless you turn on push notifications. Other small stuff from this week: a loading model shows real progress instead of a stopwatch, and there's a thinking switch (auto / on / off plus a token budget). It reads the model's chat template and tells you straight if off won't really stick, because some templates only print think tags and keep thinking anyway. Vision can be turned off too, which frees the projector's vram without deleting the file. There's also a voice tab. That's why the voiceover in the video is qwen3-tts running locally on my machine. The backend is python stdlib, frontend is vanilla js, no build step. Irm https://raw.githubusercontent.com/dadwritestech/llamaforge/master/install.ps1 | iex # windows Curl -fssl https://raw.githubusercontent.com/dadwritestech/llamaforge/master/install.sh | sh # linux / macos My main box is windows + nvidia (a 5080 and a 5060 ti stuck on a pcie x4 slot). Linux and macos pass ci but have had little real-hardware use, so bug reports are very welcome. Thoughts? :) https://github.com/dadwritestech/llamaforge   submitted by   /u/Sleepybear2611 [link]   [comments]