Monitoring and Incident Response: When the Agent Is the Incident

The eight ways agents fail in production — symptom, detection signal, first response — the alarm set that catches each one, and an incident process adapted from SRE for a system that keeps taking actions while you argue about it: declare early, contain first, then reconstruct what the model saw.

Content current as of 2026-09.

Lessons

1. The agent failure-mode catalogue
2. Monitoring that actually catches these
3. Declare early, contain first
4. Forensics: what ran, what it saw, what it did
5. Postmortems that feed the machine