Skip to content

deployment_strategy.md

Latest commit

 

History

History
22 lines (16 loc) · 756 Bytes

deployment_strategy.md

File metadata and controls

22 lines (16 loc) · 756 Bytes

AWS Deployment Strategy

Architecture

-Push the Docker image to Amazon ECR (container registry). Run the application on ECS Fargate which handles the containers (alternativily to EC2 instances) -Put an Application Load Balancer in front to distribute traffic and handle SSL -Store API keys in AWS Secrets Manager

Security Store API keys in Secrets Manager and use IAM roles for ECS tasks.

Deployment Steps

  1. Build Docker image locally
  2. Push image to ECR
  3. Create ECS task definition pointing to the ECR image
  4. Create ECS service that runs tasks behind the load balancer
  5. Configure auto-scaling based on CPU usage
  6. Set up monitoring
    • LangSmith: Great integration with LangChain
    • Options like Grafana as well