UPLOAD

    12.9K

    [AWS Loft - Istanbul] How You Build On AWS?

    Published: September 21, 2019

    How do you build on AWS? Gun: 17.09.2019 Zaman: 13:00 Konusmaci: Halil BAHADIR

    Comments

    [AWS Loft - Istanbul] How You Build On AWS?

    • 1. Slide2 ‹#› © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Halil BAHADIR Manager, Solutions Architect AWS Turkey How You Build on AWS?
    • 2. Slide2774 Yelp Airbnb Netflix Capital One MLB NFL Adobe NASA JPL Samsung builds on
    • 3. Slide2686 The broadest and deepest platform for today’s builders Technical & Business Support Marketplace 7 SERVICES Analytics 11 SERVICES IoT 11 SERVICES Machine Learning 20 SERVICES Core Services 5 SERVICES Management Tools 8 SERVICES DevOps 11 SERVICES Blockchain 2 SERVICE Mobile Services 8 SERVICES App Services 5 SERVICES Infrastructure 7 SERVICES Enterprise Apps 9 SERVICES Migration 7 SERVICES Security & Compliance 19 SERVICES 9 SERVICES
    • 4. Slide3148 Sāo Paulo GovCloud (US-West) Montréal N. Virginia GovCloud (US-East) Ireland London Paris Stockholm Bahrain Cape Town Mumbai Ningxia Beijing Singapore Hong Kong Seoul Tokyo Sydney Frankfurt Oregon N. California Milan Ohio 1 4 6 7 3 2 5 AWS Global Infrastructure Jakarta Active Regions Announced Regions
    • 5. Slide3151 Security ENCRYPTION & KEY MANAGEMENT 116 encryption enabled services 54 services integrated with key management service Global compliance certifications CERTIFICATIONS 100% AWS services attested and GDPR ready THREAT DETECTION/APP SECURITY Threat detection Machine Learning- powered security Web application firewall DDOS protection Fine-grained access control Assessment & reporting Configuration compliance Resource & usage auditing
    • 6. Slide3149 Storage 2 storage classes Resize elastically across all volume types Automate EBS volume snapshots The most volume options BLOCK OBJECT 6 storage classes Best security, compliance, and audit capabilities Most object-level controls Unmatched durability, availability, and scalability Unique analytics capabilities FILE The most cloud native systems (3) 4 performance modes DATA TRANSFER 11 unique ways to get data into AWS
    • 7. Slide2638 How can we help customers move even faster to the AWS Cloud?
    • 8. Slide3152 AWS Direct Connect AWS Snowball AWS Snowball Edge AWS Snowmobile AWS Storage Gateway Amazon Kinesis Firehose Amazon Kinesis Data Streams Amazon Kinesis Video Streams Amazon S3 Transfer Acceleration AWS DataSync AWS Transfer for SFTP DATA TRANSFER & STORAGE
    • 9. Slide3153 DATABASE MIGRATION Migrate between on-prem and AWS Migrate between databases Automated schema conversion Data replication for zero downtime 130,000+ Databases Migrated
    • 10. Slide3154 Windows APP MIGRATION
    • 11. Slide3117 Source: IDC, Windows Server Operating Environment Market Update, Doc # US44217118, Aug 2018 Hundreds of thousands of customers running Windows on AWS
    • 12. Slide3155 What about ? HYBRID
    • 13. Slide3156 Connect your on-prem environments with AWS through network options and services Use your VMware software and tools to run workloads on AWS Run latency-sensitive workloads on premises in a way that seamlessly integrates with AWS Run compute on the edge in locations with limited or no connectivity VMware Cloud on AWS Snowball Edge Compute- Optimized AWS Direct Connect AWS Outposts HYBRID
    • 14. Slide3118 Momentum for VMware Cloud on AWS
    • 15. Slide3150 Databases AWS Migration Hub AWS Database Migration Service RELATIONAL Amazon Aurora MySQL Amazon Aurora PostgreSQL Amazon RDS for MySQL Amazon RDS for PostgreSQL Amazon RDS for MariaDB Amazon RDS for Oracle Amazon RDS for SQL Server PURPOSE-BUILT Key value: Amazon DynamoDB Document: Amazon DocumentDB In-memory: Amazon Elasticache Graph: Amazon Neptune Time-series: Amazon Timestream Ledger: Amazon QLDB MIGRATION SERVICES
    • 16. Moving to open source Moving to open source OPEN SOURCE ENGINES
    • 17. Slide3172 Amazon Aurora MySQL and PostgreSQL compatible 5X faster than standard MySQL and 3X PostgreSQL Highly available and durable 1/10th the cost of commercial grade databases Scaled-out distributed architecture
    • 18. Slide3254 Amazon Aurora remains the fastest-growing service in the history of AWS Tens of thousands of customers, 2X customer growth for last 3 years
    • 19. Slide3255 Amazon DynamoDB: reliable performance at any scale
    • 20. Slide3158 MONOLITH Does everything From monolith…
    • 21. Slide3159 MICROSERVICES Each do one thing …to microservices
    • 22. Slide3160 Containers Lambda Instances Instances, containers, and event-driven compute
    • 23. Slide3161 Broadest and deepest platform choice for instances Instances CAPABILITIES Choice of processor (AWS, Intel, AMD) Fast processors (up to 4.0 GHz) High memory footprint (up to 12 TiB) Instance storage (HDD and NVMe) Accelerated computing (GPUs and FPGA) Networking (up to 100 Gbps) Bare Metal Size (Nano to 32xlarge) .metal .metal .metal .metal .metal .metal .metal .metal .metal .metal .metal .metal .metal CATEGORIES General purpose Burstable Compute intensive Memory intensive Storage (High I/O) Dense storage GPU compute Graphics intensive Amazon Elastic Block Store (Amazon EBS) Elastic graphics Elastic inference OPTIONS 200+ instance types for virtually every workload and business need
    • 24. Slide3162 Amazon ECS Highly scalable, high performance container management system … { } Container-level networking Advanced task placement Deep integration with AWS platform ECS CLI Global footprint Powerful scheduling engines Auto scaling CloudWatch metrics Native integration with load balancers
    • 25. Slide3163 AWS Fargate No clusters to manage Seamless scaling Integrated with Amazon ECS Serverless containers 10s of millions of containers run for customers every week
    • 26. Slide3164 Amazon Elastic Container Service for Kubernetes (EKS) Platform for enterprises to run production- grade Kubernetes K Container-level networking Managed etcd and masters Deep integration with AWS platform Kubernetes APIs Integrated with Kubernetes community Timely upgrades Highly available masters 100% upstream Kubernetes
    • 27. Customers are doing amazing things in production with containers Customers are doing amazing things in production with containers
    • 28. Slide3165 AWS container services Amazon Elastic Container Service Amazon Elastic Container Service for Kubernetes Amazon EC2 AWS Fargate Amazon Elastic Container Registry Deployment, scheduling, scaling, and management of containerized applications ORCHESTRATION Where the containers run COMPUTE ENGINE Container image repository IMAGE REGISTRY
    • 29. Slide3166 Serverless Serverless application architectures on AWS DATA Amazon S3 Amazon CloudFront Amazon Aurora Serverless Amazon DynamoDB COMMUNICATIONS Amazon Kinesis Amazon SNS Amazon SQS IDENTITY Amazon Cognito Amazon Cognito Userpools MONITORING & AUDITING Amazon CloudWatch AWS CloudTrail AWS X-Ray COMPUTE AWS Lambda DEVELOPMENT & DEPLOYMENT AWS IAM AWS AppSync AWS CodeStar AWS CodeCommit AWS CodePipeline AWS CodeBuild SYSTEMS DEVELOPMENT Mobile AWS IoT NETWORK AWS ALB Amazon API Gateway COORDINATION AWS Step Functions
    • 30. Slide3257 Serverless customers
    • 31. Slide2825 Continuous security Protecting your customers and your business in a CI/CD world
    • 32. Slide2842 Security is everyone’s job
    • 33. Slide2969 PACE OF INNOVATION… MEETS PACE OF PROTECTION Security Automation AWS Trusted Advisor AWS Config Amazon Inspector Amazon CloudWatch AWS CloudTrail Amazon Macie Amazon GuardDuty AWS WAF and Shield
    • 34. Slide2838 Dance like no one is watching Encrypt like everyone is
    • 35. Slide3186 What about data at the edge?
    • 36. Slide3187 Sources: McKinsey & Co., Inc., Statista The source of data is increasing coming from billions of edge devices Source: Statista.com ONLINE BY: 2025 car lightbulb door lock factory coffee pot house bank bicycle camera cart windfarm police equipment plane utility medical equipment thermostat 75 billion CONNECTED DEVICES
    • 37. AWS has the most complete platform for IoT AWS has the most complete platform for IoT DATA SERVICES DEVICE SOFTWARE INTELLIGENCE AND OUTCOMES CONTROL SERVICES AWS IoT Device SDK Amazon FreeRTOS AWS IoT Device Tester AWS IoT Greengrass 2 AWS IoT Events AWS IoT Analytics AWS IoT SiteWise AWS IoT Device Management AWS IoT Things Graph AWS IoT Core AWS IoT Device Defender 1
    • 38. Slide3123 AWS IoT customers span all industries
    • 39. Slide3181 Cloud data lakes are the future
    • 40. Slide3025 v Amazon S3 THE MOST POPULAR CHOICE FOR DATA LAKES Unmatched durability, availability, and scalability Cross Region Replication Best security, compliance, and audit capabilities Business insights into your data Analyze data in S3 with the analytics service of your choice Most ways to bring data in
    • 41. Slide3182 AWS Lake Formation A secure service that allows you to build a secure data lake in days Enforce security policies across multiple services Gain and manage new insights Move, store, catalog, and clean your data faster with machine learning
    • 42. Slide3183 Broadest and deepest portfolio VISUALIZATION & ML ANALYTICS DATA LAKE DATA MOVEMENT Amazon QuickSight Amazon SageMaker Amazon Redshift Amazon EMR AWS Glue Amazon Athena Amazon Elasticsearch Service Amazon Kinesis Data Analytics Amazon S3 Amazon Lake Formation AWS Glue AWS Snowmobile AWS Snowball Amazon Kinesis Data Firehose Amazon Kinesis Data Streams Amazon Managed Streaming for Kafka AWS Direct Connect AWS Storage Gateway Amazon Kinesis Video Streams Amazon S3 Transfer Acceleration AWS Transfer for SFTP AWS Snowball Edge
    • 43. Slide3184 Amazon Redshift Petabyte-scale data warehousing for complex queries and fast performance Pull together data from different sources Highly structured Complex queries across very large databases 10x faster than it was two years ago
    • 44. Slide3185 Real-time streaming analytics Kinesis Video Streams Capture, process, and store video streams for analytics Kinesis Data Streams Build custom applications that analyze data streams Kinesis Data Firehose Load data streams into AWS data stores Kinesis Data Analytics Analyze data streams with SQL Managed Streaming for Kafka Fully managed and highly available Apache Kafka service
    • 45. Slide3190 Machine Learning at Amazon: A LONG HERITAGE Personalized recommendations Inventing new customer experiences Fulfillment automation/ inventory management Drones Voice driven interactions
    • 46. Slide3191 Put machine learning in the hands of every developer and data scientist
    • 47. Slide3258 More machine learning is happening on AWS than anywhere else
    • 48. Slide3192 AI Services REKOGNITION IMAGE POLLY TRANSCRIBE TRANSLATE COMPREHEND LEX REKOGNITION VIDEO FORECAST TEXTRACT PERSONALIZE VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services Amazon SageMaker Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting ML Frameworks + Infrastructure EC2 P3 & P3n EC2 C5 FPGAs Greengrass Elastic inference FRAMEWORKS INTERFACES INFRASTRUCTURE Inferentia EC2 G4 Deep learning containers
    • 49. Slide3193 Infrastructure and frameworks for Machine Learning Best price/performance for model training P3dn instances Scale model training performance across multiple instances P3dn.24xl 3X faster network throughput than any other provider 2X as much GPU memory than any other GPU instance from other major providers 100+ GB more system memory than the next largest instance available from other providers EC2 P3 & P3n INFRASTRUCTURE ML Frameworks + Infrastructure EC2 P3 & P3n EC2 C5 FPGAs Greengrass Elastic inference FRAMEWORKS INTERFACES INFRASTRUCTURE Inferentia EC2 G4 Deep learning containers AI Services REKOGNITION IMAGE POLLY TRANSCRIBE TRANSLATE COMPREHEND LEX REKOGNITION VIDEO FORECAST TEXTRACT PERSONALIZE VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services Amazon SageMaker Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting P3 P3dn
    • 50. Slide3194 Best price/performance for model training Infrastructure and frameworks for Machine Learning FRAMEWORKS INTERFACES ML Frameworks + Infrastructure EC2 P3 & P3n EC2 C5 FPGAs Greengrass Elastic inference FRAMEWORKS INTERFACES INFRASTRUCTURE Inferentia EC2 G4 Deep learning containers P3 P3dn AI Services REKOGNITION IMAGE POLLY TRANSCRIBE TRANSLATE COMPREHEND LEX REKOGNITION VIDEO FORECAST TEXTRACT PERSONALIZE VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services Amazon SageMaker Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting
    • 51.   85% of all TensorFlow workloads in the cloud runs on AWS Source: Nucleus Research, November 2018 AWS is the platform of choice to run TensorFlow
    • 52. Slide3196 Scaling TensorFlow 65% Scaling efficiency with 256 GPUs STOCK TENSORFLOW 90% Scaling efficiency With 256 GPUS AWS-OPTIMZED TENSORFLOW
    • 53. Slide3198 Add GPU acceleration to any Amazon EC2 instance for faster inference at much lower cost (up to 75% savings) Amazon Elastic Inference Custom high performance machine learning inference chip that will reduce the cost of inference by 10X AWS Inferentia Designed for machine learning, training, inference and video transcoding Amazon EC2 G4 Instances COMING LATE 2019 COMING SOON
    • 54. Slide3199 ML Frameworks + Infrastructure EC2 P3 & P3n EC2 C5 FPGAs Greengrass Elastic inference FRAMEWORKS INTERFACES INFRASTRUCTURE Inferentia EC2 G4 Deep learning containers AI Services REKOGNITION IMAGE POLLY TRANSCRIBE TRANSLATE COMPREHEND LEX REKOGNITION VIDEO FORECAST TEXTRACT PERSONALIZE VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services Amazon SageMaker Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting
    • 55. Slide3200 Built-in, high performance algorithms MORE THAN 150 ADDITIONAL ALGORITHMS AND MODELS IN AWS MARKETPLACE REDUCE DATA LABELING COSTS BY UP TO 70% Fully-managed reinforcement learning algorithms with SageMaker RL TRAIN MODELS WITHOUT LABELED TRAINING DATA BUILD FAST AND ACCURATE DATA LABELING WITH GROUND TRUTH Fast and accurate data labeling with Ground Truth Pre-built notebooks for common problems Bringing machine learning to all developers Amazon SageMaker
    • 56. Slide3201 SET UP AND MANAGE ENVIRONMENTS FOR TRAINING HYPERPARAMETER OPTIMIZATION AND SAGEMAKER NEO TRAIN Optimization One-click training Built-in, high performance algorithms MORE THAN 150 ADDITIONAL ALGORITHMS AND MODELS IN AWS MARKETPLACE REDUCE DATA LABELING COSTS BY UP TO 70% Fully-managed reinforcement learning algorithms with SageMaker RL TRAIN MODELS WITHOUT LABELED TRAINING DATA BUILD FAST AND ACCURATE DATA LABELING WITH GROUND TRUTH Fast and accurate data labeling with Ground Truth Pre-built notebooks for common problems Bringing machine learning to all developers Amazon SageMaker
    • 57. Slide3202 SET UP AND MANAGE ENVIRONMENTS FOR TRAINING HYPERPARAMETER OPTIMIZATION AND SAGEMAKER NEO TRAIN Optimization One-click training DEPLOY SCALE AND MANAGE THE PRODUCTION ENVIRONMENT DEPLOY MODEL IN PRODUCTION One-click deployment Fully managed with auto- scaling, health checks, automatic handling of node failure, and security checks Built-in, high performance algorithms MORE THAN 150 ADDITIONAL ALGORITHMS AND MODELS IN AWS MARKETPLACE REDUCE DATA LABELING COSTS BY UP TO 70% Fully-managed reinforcement learning algorithms with SageMaker RL TRAIN MODELS WITHOUT LABELED TRAINING DATA BUILD FAST AND ACCURATE DATA LABELING WITH GROUND TRUTH Fast and accurate data labeling with Ground Truth Pre-built notebooks for common problems Bringing machine learning to all developers Amazon SageMaker
    • 58. Slide3259 More than ten thousand customers using Amazon SageMaker
    • 59. Slide3203 ML Frameworks + Infrastructure EC2 P3 & P3n EC2 C5 FPGAs Greengrass Elastic inference FRAMEWORKS INTERFACES INFRASTRUCTURE Inferentia EC2 G4 Deep learning containers AI Services REKOGNITION IMAGE POLLY TRANSCRIBE TRANSLATE COMPREHEND LEX REKOGNITION VIDEO FORECAST TEXTRACT PERSONALIZE VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services Amazon SageMaker Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting
    • 60. Slide3204 Vision REKOGNITION IMAGE AND VIDEO TEXTRACT Deep learning based image and video analysis services Identify objects, people text, scenes, activities Automatically extract text and data from virtually any document Uses ML to go beyond simple OCR to also identify content in forms and tables DOG 99.3% BALL 83.0% GRASS 89.2%
    • 61. Slide3205 Speech & Language AMAZON POLLY 52 Voices across 25 languages Lip-Syncing & Text Highlighting Fine-grained Voice Control AMAZON TRANSCRIBE Support for 16KHz and 8KHz Streaming support AMAZON TRANSLATE 25 languages Neural machine translation High accuracy AMAZON COMPREHEND Sentiment, Entities, Key phrases, Languages, Topics AMAZON LEX Build conversational apps in minutes AMAZON COMPREHEND MEDICAL Sentiment, Entities, Key phrases, Languages, Topics
    • 62. Slide3206 Accurate time-series forecasting service, based on the same technology used at Amazon.com Amazon Forecast Real-time personalization and recommendation service, based on the same technology used at Amazon.com Amazon Personalize Forecasting & Recommendations
    • 63. Slide2767 ai.aws
    • 64. Slide3260 https://bit.ly/2kP696u Please Complete Your Session Survey!
    • 65. Slide1