AgentOps & Production

Versioning, rollout, incidents, isolation — running agents for real

• Release Validation Gates: What Stands Between a Change and Production — The automated gate an agent change has to clear — why it is statistical rather than boolean, the agent-specific checks no generic pipeline runs (tool contracts, permission diffs, trifecta legs, version-tuple pinning), where cloud posture and vulnerability scanners actually fit, and the limits of gating known-bad. (5 lessons, 45 min)
• Deploying and Versioning Agents: Ship It Like Software — Agents are software, so ship them like software: pick a deployment topology on purpose, treat prompt + toolset + model + parameters + framework as one atomic version, evaluate a model upgrade like a database migration, and make rollback possible before you need it. (5 lessons, 45 min)
• Rollout and Kill Switches: Controlled Exposure — How to put a new agent version in front of real users without betting the business on it — the shadow → canary → flag → full ladder, the four canary metrics that actually catch agent failures, and kill switches at a granularity you can afford to pull. (5 lessons, 40 min)
• Monitoring and Incident Response: When the Agent Is the Incident — The eight ways agents fail in production — symptom, detection signal, first response — the alarm set that catches each one, and an incident process adapted from SRE for a system that keeps taking actions while you argue about it: declare early, contain first, then reconstruct what the model saw. (5 lessons, 45 min)
• Reliability Plumbing: Timeouts, Retries, Idempotency, Breakers — The unglamorous machinery that keeps agents alive: nested timeouts at every layer, retries with judgment instead of reflex, idempotency keys so the model can ask twice and your runtime executes once, circuit breakers and backpressure for flaky tools and exhausted quotas, and deterministic fallbacks that degrade to less autonomy instead of improvising. (5 lessons, 45 min)
• Multi-Tenant Isolation: One Platform, Many Customers, Zero Bleed — Running one agent platform for many customers means every shared surface — context, memory, credentials, caches, traces, quotas — is a potential cross-tenant leak. The four bleed paths, the isolation boundary at each layer, what AgentCore and Foundry verifiably give you versus what stays your design, and how deletion requests reach agent memory. (5 lessons, 40 min)
• AgentOps Org Patterns: Maturity, Team Shapes, and Gates That Scale — The organizational layer of running agents — a four-tier maturity ladder you can diagnose honestly, the platform-vs-product split that decides what to centralize, the three review gates that scale with trigger-based reviews instead of calendar boards, who actually owns evals and carries the pager, and the first three things to stand up: traces, a golden set, a kill switch. (5 lessons, 40 min)
• Where Agents Meet the Law — A deliberately short bridge: why autonomous action is exactly what regulators are looking at, how the practices this course already taught you double as governance evidence, and when to stop and call the governance function. For the law itself, we point you at our sibling site. (3 lessons, 30 min)