I run llama-swap, Ollama, ComfyUI, Strata and a game on one card. Here is what keeps it alive

Wait 5 sec.

Berth is one Go binary that leases your GPU to whatever asks for it. You start your engines with `berth run` instead of the engine's own command. They take turns: llama-swap is holding the card, you start ComfyUI, and Berth drains llama-swap, waits until the driver reports the memory free, then lets ComfyUI in. You launch a game and it moves your AI out of the way; you quit and the engines come back. It never kills a process it did not start. Anything holding VRAM without a lease shows up as a stowaway with its PID and memory, and keeps running. The rest: - `berth harbor`: a web UI that is one card's departures board, plus charts and 30 days of history - `berth gateway`: one OpenAI-compatible port; name a model and Berth starts the right engine for it - `berth pull`: downloads from Hugging Face and checks the sha256 before the model is used - per-card telemetry: memory, temperature, tokens per second, a token ledger, a per-model leaderboard Linux with an NVIDIA card today, Windows is experimental. Alpha, Apache-2.0. https://github.com/berth   submitted by   /u/Distinct-Pie2389 [link]   [comments]