How Hindsight Stopped Me From Killing Production at 2 AM

Wait 5 sec.

Most AI incident agents fail because at 2 AM, they give generic advice like "restart the pods"—unaware that someone tried that 6 months ago and triggered a connection storm that took down the primary database. OnCall AI: a change-aware incident co-pilot that pairs LLMs with long-term memory using Hindsight to correlate alerts, recent git diffs, and past postmortems. The biggest architectural takeaway was retaining *negative memory*—explicitly indexing what actions failed so the agent outputs a strict "DO NOT DO THESE" list to stop engineers from repeating past mistakes. It also runs pre-deploy reflections on PR diffs to flag historical failure modes before changes ever hit production.   submitted by   /u/shreymatrix2451 [link]   [comments]