the pitch is a 125B model running on a gaming pc with a one click installer for windows and linux. went through the readme instead of the landing page and the actual floor is 12gb vram, 32gb ram and 80gb of free disk. thats a real floor, not a recommended spec. 24,397 stars and 2,467 forks since sept 24, which is a 10% fork ratio. c++ with an openai and anthropic compatible api on localhost and optional image input. what i haven't measured is tokens per second at the floor. the repo doesnt publish a number at 12gb either, so anybody telling you it runs fine on a 3060 is guessing the same as i am. if someone here has run it at the minimum id rather post your figure than my estimate.   submitted by   /u/virtualunc [link]   [comments]