Efficiency & Optimization

Tokens, latency, caching, GenAI observability — 12%

• GenAI Cost Engineering — The token is the unit of spend: estimation and tracking, context-window optimization and prompt compression, tiered model usage, batching, provisioned-throughput planning, and semantic plus prompt caching. (3 lessons, 55 min)
• Performance and Monitoring for GenAI — Fast and observed: latency-optimized inference, parallelism and streaming, retrieval-index tuning, sampling-parameter effects, GenAI-aware auto scaling, and monitoring from token usage and hallucination rates to multi-agent coordination. (3 lessons, 60 min)