ARCHITECT
FEATURED ANALYSIS
Run GPU batch inference on Amazon ECS Managed Instances with scale to zero
BY
Henrique Santana
SOURCE
Containers
DATE
READ
1 min read
Deploy a single CloudFormation stack that builds a GPU batch inference pipeline on Amazon ECS Managed Instances. It uses Amazon SQS for job buffering and Application Auto Scaling to scale to zero when idle, so you pay …
Deploy a single CloudFormation stack that builds a GPU batch inference pipeline on Amazon ECS Managed Instances. It uses Amazon SQS for job buffering and Application Auto Scaling to scale to zero when idle, so you pay only for active inference time.