I made a 400M model for NPC judgement calls in games (Apache-2.0, ~0.1s on a 3060 Ti)

Wait 5 sec.

The model is an encoder (Ettin-400M) fine-tuned to answer small game questions. You give it a scene, a question, and some options, and it returns probabilities or "not sure". The model was inspired by Jev. Stuff like: is the player threatening this guard, is that apology sincere, which memory fits what they just said, did my LLM's reply leak a secret or make something up. The idea is your local LLM writes the dialogue, and this handles the yes/no and pick-one calls next to it, cheaply. It works as a checker too: generate a few replies, keep the one that passes. - ~0.1s per check on a 3060 Ti, about 1s on CPU. Up to 5 questions on the same scene cost the same as 1 - 42 adapters for common questions (threat, apology, persuasion, Skyrim-style memory matching, NPC mood) - `pip install` runtime, local server, no network calls Weak spots: CPU is slow during long scenes, English-only, and the planning stuff is only tested on our own generated data. Haven't run public benchmarks yet, that's next. https://huggingface.co/holdoutlabs/gamedecider Feedback appreciated :)   submitted by   /u/NoahPersaud [link]   [comments]