AWS Container Solutions Overview

AWS Container Solutions Overview

• 1. Slide30 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Halil BAHADIR Manager, Solution Architect – AWS AWS Containers Journey to Cloud Native Modern Applications
• 2. Slide43 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. OLD WORLD IT Employees at work Factories + supply chain Sales channels Marketing analytics
• 3. Slide37 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. NEW WORLD IT Employees at work Factories + supply chain IoT connected things Online marketing Continuous supply tracking Just in time production Online sales + delivery Social media Mobile employees
• 4. Slide108 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Personalization Customer tracking New channels direct to customer More things, more scale, rapid change New Needs
• 5. Slide109 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Pay as you go, afterwards Self service—no waiting Globally distributed by default Cross-zone/region availability models High utilization—turn idle resources off Immutable code deployments Cloud Native Principles
• 6. What are microservices? © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What are microservices? “A software architecture style in which complex applications are composed of small, independent processes communicating with each other using language-agnostic APIs. These services are small, highly decoupled and focus on doing a small task, facilitating a modular approach to system-building.” - Wikipedia https://en.wikipedia.org/wiki/Microservices
• 7. Monolithic vs. Microservices © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Monolithic vs. Microservices webserver .package Order UI Order Service Inventory Service Shipping Service OrderUI Inventory Service Order Service Shipping Service
• 8. Characteristics of Microservice Architectures © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Characteristics of Microservice Architectures Do one thing well Independent Decentralized Black box Polyglot You build it, you run it
• 9. Why Containers? © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why Containers? •Speed •Efficiency •Easier packaging •Less risky deployments •Better Development experience •Microservices Photo & Licence
• 10. Slide45 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Make AWS the BEST PLACE to run ANY containerized applications © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• 11. SERVICE LEVEL AGREEMENT © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SERVICE LEVEL AGREEMENT 99.99
• 12. AWS Container Services Landscape © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Container Services Landscape MANAGEMENT Deployment, Scheduling, Scaling & Management of containerized applications HOSTING Where the containers run Amazon Elastic Container Service Amazon Elastic Container Service for Kubernetes Amazon EC2 AWS Fargate IMAGE REGISTRY Container Image Repository Amazon Elastic Container Registry
• 13. We Give You The Power To Choose: © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. We Give You The Power To Choose: ECS EKS EC2 Fargate EC2 Fargate 1. Choose your orchestration tool 2. Choose your launch type
• 14. Slide112 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• 15. Amazon ECS - Cluster © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ECS - Cluster EC2 instances LOAD BALANCER Internet ecs agent TASK Container TASK Container ecs agent TASK Container TASK Container Agent Communication Service Amazon ECS API CLUSTER MANAGEMENT ENGINE KEY/VALUE STORE ecs agent TASK Container TASK Container LOAD BALANCER
• 16. Amazon ECS - Backplane © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ECS - Backplane EC2 instances LOAD BALANCER Internet ecs agent TASK Container TASK Container ecs agent TASK Container TASK Container Agent Communication Service Amazon ECS API CLUSTER MANAGEMENT ENGINE KEY/VALUE STORE ecs agent TASK Container TASK Container LOAD BALANCER
• 17. Amazon ECS - Task © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ECS - Task EC2 instances LOAD BALANCER Internet ecs agent TASK Container TASK Container ecs agent TASK Container TASK Container Agent Communication Service Amazon ECS API CLUSTER MANAGEMENT ENGINE KEY/VALUE STORE ecs agent TASK Container TASK Container LOAD BALANCER
• 18. Amazon ECS - Service © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ECS - Service EC2 instances LOAD BALANCER Internet ecs agent TASK Container TASK Container ecs agent TASK Container TASK Container Agent Communication Service Amazon ECS API CLUSTER MANAGEMENT ENGINE KEY/VALUE STORE ecs agent TASK Container TASK Container LOAD BALANCER
• 19. AWS CodePipeline for ECS © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS CodePipeline for ECS AWS CodeCommit AWS CodeBuild Amazon ECR AWS CodePipeline Amazon ECS Source Repository Build Deploy or or
• 20. Slide118 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Scheduling and Orchestration Cluster Manager Placement Engine
• 21. Slide133 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• 22. Slide119 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. But you still end up managing more than just containers ECS Agent Docker Agent OS EC2 Instance
• 23. Slide122 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. An API for containers
• 24. Slide125 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Your Containerized Applications MANAGED BY AWS No EC2 Instances to provision, scale or manage ELASTIC Scale up & down seamlessly. Pay only for what you use INTEGRATED with the AWS ecosystem: VPC Networking, Elastic Load Balancing, IAM Permissions, Cloudwatch and more. AWS FARGATE
• 25. ENABLE FOCUS ON APPLICATIONS © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ENABLE FOCUS ON APPLICATIONS
• 26. TASK PROVISIONING MODEL © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. TASK PROVISIONING MODEL No instances to manage Container native API Resource based pricing Simple, easy to use, powerful consumption model = NEW!
• 27. STORAGE © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. STORAGE Volume Storage – 4GB per Task – share data across Containers within a Task Container Filesystem space – 10GB per Task Ephemeral storage backed by EBS
• 28. AWS CodePipeline for Fargate © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS CodePipeline for Fargate AWS CodeCommit AWS CodeBuild Amazon ECR AWS CodePipeline Source Repository Build Deploy or or AWS Fargate
• 29. AWS Fargate Customers © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Fargate Customers ”We don't want to babysit any clusters. That has nothing to do with us” Shimon Tolts CTO, DATREE “We moved to Fargate because we need the ability to scale quickly up from baseline and get fine-grained network control, without having to manage our own infrastructure” Product Hunt
• 30. What is Kubernetes? © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Open source container management platform Helps you run containers at scale Gives you primitives for building modern applications What is Kubernetes?
• 31. COMMUNITY, CONTRIBUTION, CHOICE © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. COMMUNITY, CONTRIBUTION, CHOICE
• 32. Slide82 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 57% of Kubernetes workloads run on AWS today —CNCF survey
• 33. Slide140 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 3x Kubernetes masters for HA Kubernetes on AWS
• 34. Slide141 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. API server Cloud controller Controller manager Scheduler Add-ons KubeDNS Kubernetes master
• 35. Slide142 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Availability Zone 1 Availability Zone 2 Availability Zone 3 Etcd Master Etcd Master Etcd Master
• 36. Slide143 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Availability Zone 1 Etcd Master Etcd Master Availability Zone 2 Availability Zone 3 Etcd Master
• 37. Slide149 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. mycluster.eks.amazonaws.com Availability Zone 1 Availability Zone 2 Availability Zone 3 Kubectl
• 38. Slide150 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS is Kubernetes Certified
• 39. EKS Architecture © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS Architecture
• 40. Summary © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Summary •New customer expectations are rapidly driving new capabilities. •Containers, as part of a larger DevOps strategy, helps realize these goals. •AWS provides the best experience with the broadest offerings in the journey to modern Cloud Native Applications. Next Steps: •Immersion Day – Get you started •Topic Specific Deep Dive Workshops •Proof of Concept •Stay on top of the latest Containers news: •https://aws.amazon.com/containers/new/ •https://aws.amazon.com/new/#compute-services
• 41. THANK YOU © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. THANK YOU https://aws.amazon.com/containers
• 42. Slide95 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Introduction to Containers and Docker
• 43. Application environment components © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Application environment components Runtime Engine Code Dependencies Configuration
• 44. Different environments © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Different environments Local Laptop Staging / QA Production On-Prem
• 45. It worked on my machine, why not in prod? © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. It worked on my machine, why not in prod? Local Laptop Staging / QA Production On- Prem v6.0.0 v7.0.0 v4.0.0 v7.0.0
• 46. It worked on my machine, why not in prod? © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Local Laptop Staging / QA Production On-Prem It worked on my machine, why not in prod? v6.0.0 v7.0.0 v4.0.0 v7.0.0
• 47. Docker to the rescue © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Docker to the rescue Runtime Engine Code Dependencies
• 48. Docker container image © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Docker container image Read only image that is used as a template to launch a container. Start from base images that have your dependencies, add your custom code. Docker file for easy, reproducable builds. bootfs kernel Base image Image Image Writable Container add ngix add nodejs Ubuntu References parent image
• 49. Four environments, same container © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Four environments, same container Local Laptop Staging / QA Production On- Prem
• 50. Virtual machine versus Docker © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Virtual machine versus Docker Server (Host) Host OS Hypervisor Guest OS Guest OS Guest OS Bins/Libs Bins/Libs Bins/Libs App 1 App 2 App 3 VM App 2 Server (Host) Host OS Docker Bins/Libs Bins/Libs Bins/Libs App 1 App 2 App 3 Container
• 51. Container & Docker Benefits © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Container & Docker Benefits Portable application artifact that runs reliably everywhere Run different applications or application versions with different dependencies simultaneously Better resource utilization by running multiple lightweight containers per host
• 52. Reference Architectures (Informational) © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Reference Architectures (Informational) •Rebalancing Amazon ECS Tasks using AWS Lambda •NGINX Reverse Proxy on Amazon EC2 Container Service •Java Microservices Deployed on EC2 Container Service •Amazon ECS Reference Architecture: Batch Processing •Node.js Microservices Deployed on EC2 Container Service •Amazon EC2 Container Service - Reference Architecture: Service Discovery to containers using CloudWatch Events, Lambda and Route 53 private hosted zones •Service Discovery for AWS EC2 Container Service via DNS •Canary Blue/Green deployments on ECS •Blue/Green deployments on ECS •Blue/Green deployments using Fargate •ECS Reference Architecture: Continuous Deployment •Amazon ECS Scheduler Driver to integrate Apache Mesos with ECS
• 53. McDonald’s Home Delivery: Why Amazon ECS? © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. McDonald’s Home Delivery: Why Amazon ECS? Speed to market Scalability and reliability Security DevOps – CI / CD Monitoring
• 54. Product Hunt: AWS Fargate © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Entire website runs as microservices. Ruby & GraphQL backend with node.js frontend Needed ability to scale quickly, schedule multi-container workloads, network layer control All in on AWS—Moved entire infrastructure to AWS and Fargate in Jan 2018 Fargate scales quickly with traffic spikes, running multiple services in production Ship by Product Hunt Marketing toolkit for makers to ship products | http://producthunt.com/ship/in/aws-summit Product Hunt: AWS Fargate