Hey everyone, I recently built a Radiance inference server for my company, and now want to start provisioning access to the rest of my team. My current plan: Tailscale as the only way to access the server via HTTPs. LiteLLM as a way to cofnfigure per-user keys with rate limits and usage logs. Hermes as the harness - each user would have their own container with access restrictions, but open access to the central skills repository. I'm wondering how everyone else has managed to do this successfully? Right now the biggest thing to figure out is how to get the harness (Hermes in this case) to work across the team without a huge headache of getting API tokens from things like Google, etc...   submitted by   /u/Anarchaotic [link]   [comments]