I made a tiny site that let's you feel how fast a local LLM runs before buying the hardware. I made it for myself and a friend but thought it could be useful for others. Note that it works as an estimate and not perfectly as it will vary per user setup. repo: https://github.com/nicorobinreal/llmspeed   submitted by   /u/nypaavsalt [link]   [comments]