I've been wondering… small businesses usually have a few employees, each with their own work laptop with a decent amount of computing power. Could we pool the Ollama/Lemonade clients running on employees' work laptops together to share the inference workload? Of course, employees might shut down their laptops or take them home. But I think it's an interesting idea worth exploring. I'm thinking about running a small experiment with local businesses to see if this idea has any legs. I've put together a minimal prototype that connects PCs running Ollama or Lemonade through a shared API, using a custom load balancer. If anyone's interested in checking out the source code, here's the GitHub repo: https://github.com/JY-Quek/FreeLLM So, what do you think? Is this a terrible idea, an interesting experiment, or potentially another way to make AI more accessible to everyone? Feel free to poke holes in the idea. I'd rather hear about the problems now than discover them the expensive way later! 😂   submitted by   /u/JY_Q [link]   [comments]