Testing & Troubleshooting

Evaluations, quality gates, diagnosis — 11% and the capstone

• Evaluating GenAI Systems — Evaluation as infrastructure: Bedrock Model Evaluations, LLM-as-a-judge and RAG evaluation, golden datasets and regression gates, A/B and canary validation, agent performance frameworks, and feedback loops that feed annotation. (3 lessons, 60 min)
• Troubleshooting GenAI — and Exam Readiness — The capstone: diagnosing context-window overflow, retrieval degradation and embedding drift, prompt regressions and API failures — then AIP question anatomy, the professional-level traps, and the final-week plan. (4 lessons, 55 min)