FM APIs, Streaming, and Application Wiring
The request path end to end: Converse and InvokeModel, async patterns with SQS, streaming over WebSockets and SSE, backoff and fallbacks, intelligent model routing, and the application layer from Amplify to prompt chaining.
Content current as of 2026-10.
Lessons
- Synchronous and asynchronous FM APIs
- Streaming responses to real users
- Resilient request paths and model routing
- The application layer: UIs, chaining, log analysis