Fast-swap available v0.3.0 (Berth) - Testing needed

Wait 5 sec.

Berth v0.3 is out, and I need testers with big RAM and more than one GPU v0.3 parks engines in system RAM instead of unloading them. A switch back to a parked engine skips the reload from disk. My workstation has 64 GB, and Strata alone pins 40 GB, so I can't measure parking at the sizes you run. I'm looking for: - 64, 96 or 128 GB of RAM with a 24 GB card. You'd park a vLLM or ComfyUI engine, switch away, switch back, and send me the times. - Two or more GPUs, any mix. Multi-GPU leases are the next release, and I want real topologies before I write them. - Windows with an NVIDIA card. One of you already runs it there. contrib/windows/check.ps1 compares Berth's per-process VRAM with Task Manager and writes a report. - AMD on Linux, for the release after that.   submitted by   /u/Distinct-Pie2389 [link]   [comments]