Share
Embed
Securing your Amazon ECS applications: Best practices
Talked at AWS re:Invent 2020.
Transcript
40 slides
-
© 2020, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Securing your Amazon ECS applications: Best practices Tori Hara Sr. Product Developer Advocate, Containers AWS C O N 2 1 2 -
© 2020, Amazon Web Services, Inc. or its affiliates. All
rights reserved. • Amazon Elastic Container Service (Amazon ECS) overview • Securing your Amazon ECS tasks • Operating your Amazon ECS tasks securely • Takeaways Agenda -
© 2020, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Amazon ECS overview -
What does ECS look like? Amazon ECS Amazon ECS users
API calls to run containers Bring your own Amazon EC2 instances (and/or AWS Fargate–managed servers) EC2 instance Amazon ECS container agent Container runtime API calls to run containers Container Run Amazon ECR, Docker Hub, … API calls to download container images Logs Amazon CloudWatch Logs, Fluentd, … API calls to send container logs Elastic Load Balancing -
Amazon ECS constructs: Task and service Amazon ECS task Defined
by a “task definition” A group of 1 or more containers The smallest deployable unit Configure networking, storage, parameters, IAM roles, and compute resources Similar to the docker run command on your local machine Amazon ECS service Defined by a “service definition” Enables you to run and maintain a required number of Amazon ECS tasks Automatically handles Amazon ECS task failures by replacing them with new Amazon ECS tasks Configure Amazon VPC networking, deployment type, optional load balancers, and service discovery -
Amazon ECS constructs: Cluster A logical grouping of Amazon ECS
tasks or services in a region Multiple clusters can be created Clusters / services / tasks work as IAM permission boundaries ECS cluster ECS services ECS tasks -
© 2020, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Securing your Amazon ECS tasks -
Step 1: Security groups ECS service sg-ALB sg-ECSTask sg-AuroraDB Allowed
type and port HTTPS: 443 HTTP: 80 MySQL/Aurora: 3306 Allowed source 0.0.0.0/0 (Public access) 10.0.0.0/16 (From within the VPC) 10.0.0.0/16 (From within the VPC) -
Step 1: Security groups ECS service sg-ALB sg-ECSTask sg-AuroraDB Allowed
type and port HTTPS: 443 HTTP: 80 MySQL/Aurora: 3306 Allowed source 0.0.0.0/0 (Public access) sg-ALB (Only from the ALB) sg-ECSTask (Only from the ECS tasks) -
Step 2: Secrets ECS service { ... snip ... "containerDefinitions":[{
"name":"my-web-app", "image":"my-web-app:v1", ... snip ... "environment": [{ "name": "DB_USER", "value": "myappdbuser" },{ "name": "DB_PASSWD", "value": "mysupersecretpasswd" },{ "name": "DB_HOST", "value": "my-db...rds.amazonaws.com" },{ "name": "DB_PORT", "value": "3306" }], ... snip ... }], ... snip ... } ECS task definition -
Step 2: Secrets ECS service { ... snip ... "containerDefinitions":[{
"name":"my-app", "image":"my-web-app:v1", ... snip ... "secrets": [{ "name": "DB_USER", "valueFrom": ”...secretsmanager:...:my-db-secret:username::" },{ "name": "DB_PASSWD", "valueFrom": ”...secretsmanager:...:my-db-secret:password::" }], "environment": [{ "name": "DB_HOST", "value": ”my-db...rds.amazonaws.com" },{ "name": "DB_PORT", "value": ”3306" }] ... snip ... } ECS task definition AWS Secrets Manager Secrets injected by ECS at task runtime -
Step 3: ECS task-level IAM roles ECS service { ...
snip ... "taskRoleArn": "", "executionRoleArn": "", "containerDefinitions":[{ ... snip ... }], ... snip ... } ECS task definition -
Step 3: EC2-level IAM role ECS service { "AttachedPolicies": [{
"PolicyName": "AmazonS3FullAccess", "PolicyArn": "arn:aws:iam::aws:policy/AmazonS3FullAccess" }, { "PolicyName": "AmazonSQSFullAccess", "PolicyArn": "arn:aws:iam::aws:policy/AmazonSQSFullAccess" }, { "PolicyName": "AmazonEC2ContainerServiceforEC2Role", "PolicyArn": "arn:aws:iam::aws:policy/service- role/AmazonEC2ContainerServiceforEC2Role" }] } EC2 instance IAM role’s policies IAM role -
Step 3: EC2-level IAM role All ECS tasks on the
same EC2 instance can use the EC2 instance role IAM role EC2 instance ECS task Another ECS task Really want to allow? ! ! -
Step 3: IAM roles for tasks { ... snip ...
"taskRoleArn": ”TaskRole-ARN-here", "executionRoleArn": "", "containerDefinitions":[{ ... snip ... }], ... snip ... } ECS task definition { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Action": ["s3:ListBucket"], "Resource": ["arn:aws:s3:::your-bucket"] },{ "Effect": "Allow", "Action": [ "s3:PutObject", "s3:GetObject", "s3:DeleteObject" ], "Resource": ["arn:aws:s3:::your-bucket/*"] }] } S3 write-only policy { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Action": "sqs:SendMessage", "Resource": "arn:aws:sqs:...:your-queue-name" }] } SQS write-only policy { "AttachedPolicies": [{ "PolicyName": "S3WriteOnlyPolicy", "PolicyArn": "S3WriteOnlyPolicy-ARN-here" },{ "PolicyName": "SQSWriteOnlyPolicy", "PolicyArn": "SQSWriteOnlyPolicy-ARN-here" }] } ECS task role -
Step 3: IAM roles for tasks 🚫 EC2 instance ECS
task Another ECS task Denied IAM role -
Step 3: “Task Execution Role”? IAM role for task (task
role) Task execution role EC2 instance Amazon ECS container agent Container runtime ECS task Amazon ECR registry Logs Amazon CloudWatch Logs AWS Secrets Manager EC2 instance Amazon ECS container agent Container runtime ECS task -
Step 4: Logs from apps Container runtime ECS task Logs
Amazon CloudWatch Logs -
Step 4: Logs from apps Container runtime ECS task stdout
stderr Amazon CloudWatch Logs { ... snip ... "containerDefinitions":[{ "name":"my-web-app", "image":"my-web-app:v1", ... snip ... "logConfiguration": { "logDriver": "awslogs", "options": { "awslogs-group": "/ecs/my-web-app", "awslogs-region": "us-west-2", "awslogs-stream-prefix": "ecs" }} }], ... snip ... } ECS task definition -
Step 4: Logs from apps Container runtime ECS task Logs
CloudWatch Logs Amazon Kinesis Data Firehose Lambda function Lambda function Amazon Elasticsearch Service Kibana For “hot data” S3 bucket Amazon Athena For “cold data” Elasticsearch subscription filter Custom subscription filter https://docs.aws.amazon.com/AmazonECS/latest/developerguide/using_firelens.html -
1. Immutable tags • Image tags can be overwritten by
push • Use immutable tags to use expected container images at any given time 2. Image scanning • “Scan on push” for automatic scanning • Scheduled rescanning is also recommended to handle CVEs after image creation; see also https://aws.amazon.com/blogs/containers/am azon-ecr-native-container-image-scanning/ Step 5: Enabling ECR features -
Securing your Amazon ECS app • ECR immutable tags and
image scanning • No privileged mode • Non–root user • Read-only file system • Security groups • Secrets • Task role and task execution role • Container logs https://docs.docker.com/develop/develop-images/dockerfile_best-practices/ -
© 2020, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Operating your Amazon ECS tasks securely -
1. Access-control for Amazon ECS resources 2. Auditing AWS API
calls 3. Validating AWS resources to keep everything compliant Operating your Amazon ECS tasks securely -
Step 6: Access control Amazon ECS ECS users API calls
{ "Version": "2012-10-17", "Statement": [{ "Sid": ”ReadOnlyAccess", "Effect": "Allow", "Action": [ "ecs:DescribeCluster” ], "Resource": "arn:aws:ecs:region:account-id:cluster/our-cluster" }] } IAM policy -
Step 6: Access control Amazon ECS ECS users API calls
{ "Version": "2012-10-17", "Statement": [{ "Sid": ”ReadOnlyClusterResources", "Effect": "Allow", "Action": [ "ecs:Describe*", "ecs:List*" ], "Condition": { "ArnEquals": { "ecs:cluster": "arn:aws:ecs:region:account-id:cluster/our-cluster" } }, "Resource": "*" }] } IAM policy -
Step 6: Access control Amazon ECS ECS users API calls
{ "Version": "2012-10-17", "Statement": [{ "Sid": "ECSFullAccessIfOwner", "Effect": "Allow", "Action": "ecs:*", "Resource": "*", "Condition": { "StringEquals": { "ecs:ResourceTag/Owner": "${aws:PrincipalTag/Team}" } } }] } only if resource ”Owner” tag and user “Team” tag values match IAM Policy -
• AWS CloudTrail allows you to keep track of AWS
API call events in your AWS account • Recorded events will have § eventTime § userIdentity § eventSource (represents an AWS service) § eventName (represents an API action name) § and more! Step 7: Audit AWS API calls Learn more: https://docs.aws.amazon.com/awscloudtrail/latest/userguide/ cloudtrail-event-reference-record-contents.html -
Step 7: Audit Amazon ECS API calls AWS CloudTrail S3
bucket Amazon Athena Ad hoc auditing Regular analysis and auditing -
Use AWS Config to validate your configurations to be compliant
• IAM resources can be automatically remediated • Amazon ECS is not officially supported by AWS Config yet • Write custom rules to validate Amazon ECS resources such as task definitions Step 8: Validate your resources For more examples, go to https://github.com/awslabs/aws-config-rules -
© 2020, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Steps to further secure workloads -
• Avoid manual operations, to process everything robustly and securely
• CI/CD pipelines help automate building, testing, and deployment Automate everything Source Build Test Deploy Monitor Related session CON210 – Developing CI/CD pipelines with Amazon ECS and AWS Fargate -
Security benefits of AWS Fargate Related sessions CON203 – Choosing
your container data plane on AWS CON216 – AWS Fargate: Are serverless containers right for you? AWS manages and patches hosts for you No privileged or SSH access Secure isolation boundaries -
© 2020, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Takeaways -
Secure your Amazon ECS applications • Harden Amazon ECS tasks
throughout their life cycles • Keep operations robust One step further • Automate everything as much as possible • Use AWS Fargate to harden your workloads with less effort Get started today • All Amazon ECS features covered today are available without installing any additional software Takeaways -
Thank you! © 2020, Amazon Web Services, Inc. or its
affiliates. All rights reserved. Tori Hara toricls