Provisioning ML Infrastructure as Code

CloudFormation and the CDK for ML stacks, containers for ML workloads on ECR/ECS/EKS, endpoints inside VPCs, and programmatic deployment with the SDK, CLI, and Boto3.

Content current as of 2026-10.

Lessons

1. CloudFormation and the CDK
2. Containers for ML: ECR, ECS, EKS
3. Endpoints inside VPCs
4. SDK, CLI, and Boto3 deployments

Sources

• CloudFormation user guide — AWS::SageMaker::Endpoint
• AWS CDK v2 developer guide
• SageMaker AI developer guide — hosted endpoints in a VPC
• Amazon ECR user guide