I’m building Koda, an app that teaches kids how AI works. One thing I wanted to test was what a kid actually sees when the AI refuses a question, flags a draft answer, or can’t finish a safety check. Those paths are easy to miss if you mostly test questions that get normal answers. That led to Child AI Safety, an open-source TypeScript toolkit. The gateway checks the question, holds the draft answer while it’s reviewed alongside the original question, and checks permission again before showing the answer. The offline demo lets you see an approved answer, a refusal, a support response, and a simulated detector outage. So far, we’ve run 144 scripted cases across English, French, and Spanish and four age profiles. In a separate live pilot with synthetic prompts, 142 of 144 outcomes matched our draft labels. Both misses were benign English answers that got routed to support. That’s one of the things I want to get better at testing: ordinary questions that a filter handles too cautiously. Github: https://github.com/SamSquareAI/child-ai-safety   submitted by   /u/DiscussionHealthy802 [link]   [comments]