Maintaining and Monitoring

Knowing the pipeline broke before the business tells you: CloudWatch metrics, logs and alarms for data services, the Glue and EMR observability surfaces, lineage and traceability, cost monitoring as an operational signal, and the troubleshooting order that finds a cause instead of a symptom.

Content current as of 2026-10.

Lessons

  1. Metrics, logs, and alarms that matter
  2. Observing Glue, EMR, and streams
  3. Lineage and traceability
  4. Cost monitoring as an operational signal
  5. A troubleshooting order

Sources