Serverless BI using Amazon Quicksight - 23 September - 10:00

Published: October 13, 2019

AWS Loft Istanbul 2019 Serverless BI using Amazon Quicksight - 23 September - 10:00

Comments

Serverless BI using Amazon Quicksight - 23 September - 10:00

1. Slide1569
2. Slide1347 ‹#› © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless BI using Amazon Quicksight Automate & Scale Business Analytics (BA) for everyone through ML-Powered, Interactive Dashboards Hasan-Basri AKIRMAK, MSc., Exec-MBA Amazon Web Services
3. Slide1566 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Agenda •Amazon QuickSight Value Proposition •Demo •What’s New: ML Insights & more… •Customer References •Technical Overview
4. Why QuickSight © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Why QuickSight Scalable From 10 users to 10,000, QuickSight seamlessly grows with you with no need for additional servers or infrastructure. No Servers to Manage QuickSight is a fully managed cloud service. There is no infrastructure to maintain or upgrade and no upfront costs. Fully integrated QuickSight integrates with your other AWS services and data sources giving you everything you need to build an end-to-end cloud analytics solution. Pay For What You Use Instead of buying costly licenses for all of your users, QuickSight allows you to share dashboards and reports and only pay when users access them.
6. Slide6 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Create beautiful, interactive dashboards. •Add rich interactivity like filters, drill downs, zooming, and more •Blazing fast navigation •Accessible on any device •Data Refresh •Publish to everyone with a click
7. Connect to your data, wherever it is © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Connect to your data, wherever it is QuickSight allows you to connect to AWS data sources, Private VPC subnets, on-premise and hosted databases and third party business applications. On-premises Securely connect to on-premise databases and flat files like Excel and CSV In the cloud Connect to hosted database, big data formats, and secure VPCs Applications Connect directly to third party business applications •Salesforce •Square •Adobe Analytics •Jira •ServiceNow •Twitter •Github •Redshift •RDS •S3 •Athena •Aurora •Teradata •MySQL •Presto •Spark •SQL Server •Postgre SQL •MariaDB •Snowflake •IoT Analytics •Excel •CSV •Teradata •MySQL •SQL Server •PostgreSQL
10. Serverless data lake & analytics with AWS © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Serverless data lake & analytics with AWS Crawlers scan your data sets and populate the Glue Data Catalog The Glue Data Catalog serves as a central metadata repository Once catalogued in Glue, your data is immediately available for analytics QUICKSIGHT https://github.com/aws-samples/serverless-data-analytics 1 2 3 AMAZON REDSHIFT SPECTRUM AMAZON EMR AMAZON ATHENA AWS GLUE DATA CATALOG AWS GLUE CRAWLER AMAZON S3 1 2 3
11. Slide1563 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Source: https://aws.amazon.com/tr/blogs/big-data/visualize-over-200-years-of-global-climate-data-using-amazon-athena-and-amazon-quicksight/ Demo: Visualizing Climate Data Demo Instruction Data Set Visualization
12. Insights Delivered to Your Inbox © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Insights Delivered to Your Inbox QuickSight lets you send report snapshots directly to your users inbox. •Schedule email reports on a daily, weekly, or monthly basis •Sent to individual users or groups •Users can opt out of any report so they can focus on what’s important. • Uses Pay-per-Session Pricing
13. Built Enterprise Ready © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Built Enterprise Ready Secure and compliant • End-to-end encryption • HIPAA • SOC2 • PCI • ISO 27001 • Fed Ramp Global availability Enable collaboration across global teams, with local SPICE storage for optimized access. •N. Virginia •Oregon •Ohio •Dublin Built-in redundancy Native high-availability (Multi-AZ) and fault tolerance with transparent data replication and backups •Japan •Singapore •Sydney As a native AWS service, QuickSight comes out of the box with enterprise grade security and administrative tools.
14. Pricing © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Pricing
15. Enterprise Edition with Pay-per-Session Pricing © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Enterprise Edition with Pay-per-Session Pricing Create and publish interactive dashboards Secure access to dashboards anytime, anywhere $24/user/mo. paying month to month *session = 30 mins. From login $18 /user/month Billed annually Readers Authors For Deploying insights at scale, across your organization. $0.30 /session* up to a max of $5 /user/month
16. Reader Pricing Comparison (Annual Cost) © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Reader Pricing Comparison (Annual Cost) 1 Typical usage assumptions
17. Reader Pricing Scenarios © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Reader Pricing Scenarios $0.68 /user/month on avg. $0.45 /user/month on avg.
19. Machine Learning Insights © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Machine Learning Insights
20. Introducing ML Insights © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Introducing ML Insights Cutting edge ML tools that automatically discover powerful insights for your users. •ML powered Anomaly Detection •ML Powered Forecasting • Auto-generated natural language narratives and summaries.
21. ML-powered anomaly detection © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark ML-powered anomaly detection Challenges Hidden in aggregates Data blind spots Slow to react to business incidents Manual analysis doesn’t scale Not for BI Our solution Analyze millions of metrics Continuously run in background What happened AND why Alerts delivered via email No ML expertise needed
27. Anomaly Detection Pricing © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Anomaly Detection Pricing Available for Enterprise Edition Only
28. ML-powered forecasting © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark ML-powered forecasting Challenges Spreadsheet are complex to maintain Doesn’t learn, doesn’t scale How do you deal with outliers? Hard to deal with changes Simple things are hard to do BI forecasting as too basic Our solution Point and click forecasting Continuously learns from data Automatically excludes outliers Imputes missing values Detects seasonality and trend No ML or Excel needed
29. Slide1555 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Traditional BI forecasting QuickSight ML-powered forecasting Captures only seasonality Missing upward trend Confidence band influenced by bad data Captures seasonality and upward trends Automatically excludes bad data High confidence band
30. Natural Language Narratives © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Natural Language Narratives Challenges What is the data trying to say? Hours in front of dashboards Sifting through charts and tables Deciphering rows and columns of data Drilling in and slicing and dicing Time consuming, not scalable! Our solution Insights in plain language Embedded in your dashboard Fully customizable templates Easy to get started No coding necessary Looking beyond visualizations
33. Powered By QuickSight © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Powered By QuickSight Embedded Analytics
34. Embedding Dashboards In Your Application © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Embedding Dashboards In Your Application QuickSight allows you to seamlessly integrate interactive dashboards and analytics into your own applications • Enhance your applications with rich analytics and dashboards • Easy maintenance, no servers to manage • Fast! No Custom development or domain expertise needed •Leverage new features as we add them •Utilizes Pay-per-Session Pricing.
35. Embedded Dashboards – How it Works © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Embedded Dashboards – How it Works •Create a unified user experience by embedding QuickSight dashboards into custom applications and portals •Fully interactive filtering, drill down •Customize data for different customers and users using Row Level Security •Seamless authentication with your application using Federated Single Sign On •Centrally Manage multiple customers through a single account.
36. 4 steps to embed a dashboard © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 4 steps to embed a dashboard Under NDA. Do no distribute 1. End-user accesses application on web or mobile client 2. Application client requests page with embedded dashboard Application Server User identity store 3. Application server confirms end-user identity from identity store 4. Application Server uses Role Session Name to assume IAM role that allows access to dashboard 5. AWS IAM provides temporary credentials for the assumed role 6. Application server invokes GetDashboardEmbedUrl call to obtain signed dashboard URL for embedding specific dashboard in application page 7. Application server embeds signed dashboard URL in application using QuickSight JavaScript SDK 8. End-user sees application page load with embedded QuickSight dashboard E.g. IAM Role: QuickSightEmbed Role Session Name: tom.smith@example.com AWS STS QUICKSIGHT
38. Customers © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Customers
39. NFL © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark NFL «Using the business intelligence tool Amazon QuickSight, the NFL is able to gain greater insight internally while also opening a window for fans to engage with data. “It allows us to run extremely fast queries to ask questions and surface the answers on dashboards,” Swensson says. “We provide dashboards to our clubs, to our broadcasters, and to our editorial folks and fantasy football writers at NFL.com. Those dashboards, which used to take hours or days to build, can now be created in minutes and can also include any number of relevant filters. » https://partners.wsj.com/aws/how-machine-learning-and-analytics-are-transforming-the-nfl-analytics/
40. Customers © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark ” “ Customers Amazon QuickSight allows our analysts to create insightful dashboards quickly for our critical risk management programme. Enabling us to move from static spreadsheets to interactive data. However, rolling out these dashboards at scale to the field was going to be costly and complicated. We asked AWS for a better solution, and they listened. Readers in QuickSight, with usage-based pricing, will help us scale the dashboards to more end-users across the world and only pay for what we use” Anthony Deakin, Chief Advisor - Critical Risk Management Customer name: Rio Tinto Company description: Global top 3 mining co. Data source: RDS MySQL/SPICE Use case: 300+ users, expected 5000+ Previous tools: Spreadsheets and email reports Auth: Password-based, Cognito SSO integration in progress Use case: •Equip 1000s of mine worker and supervisors with interactive dashboards that provide safety audit information and allow them to make safe workplace decisions. •Equip corporate analysts and managers with powerful self-service analytics capability on governed datasets.
41. Customers © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark ” “ Customers “Timely access to relevant data is the key to success in our business. Amazon QuickSight has enabled our analysts to move from static graphs to fast, interactive dashboards automatically updated with the latest data. QuickSight’s native integration with Amazon Athena has allowed faster time to analysis and saved us effort involved in additional data curation. With the new QuickSight readers, we can extend interactive dashboards to the entire team, and Pay-per- Session pricing assures us we only pay when we use the product. The serverless nature of QuickSight aligns with our vision for the data platform, with no infrastructure management needed to scale deployments across the company! We look forward to enabling more use cases in QuickSight.” Jim Stamp, Head of Product – Data Engineering Customer name: Auto Trader Group plc. Company description: Automotive marketplace Data source: S3/Athena Use case: 50+ users and growing Previous tools: Spreadsheets and static graphs Auth: SAML-based SSO Use case: •Provide business dashboards to multiple teams from S3 data lake •Equip analysts with easy, self-service dashboard building capability. Eliminate need to manually curate, process and build spreadsheets, saving 10% of an analyst’s monthly efforts.
42. Customers © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark “ Customers “As we accelerate our AWS adoption journey, timely visibility to cost and usage information has become critical to cost awareness among our development teams. Amazon QuickSight's native integration with Athena makes it the ideal serverless analytics solution. With QuickSight readers, we can easily extend access to interactive dashboards across our teams and only pay for what we use. QuickSight dashboards allow us to easily provide a customized, interactive view for each team, and let team leads glance at trends and KPIs, quickly filter data or drill down to the details. The move from static email reports and ad-hoc analysis to always- available data in QuickSight has been great!” Anders Rahm-Nilzon, Cloud Manager Customer name: Volvo Group Connected Solutions Company description: Automotive Manufacturer Data source: S3/Athena Size: In deployment Previous tools: Spreadsheets for ad-hoc investigations, Auth: SAML-based SSO Use case: •Correlate data generated from IoT sensor software in their trucks with AWS Cost and Usage data (i.e. development team makes a change in IoT software to collect a new metric and see how much it affects their AWS usage). ”
43. Customers © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Customers The QuickSight Reader role is perfect for operational dashboards, as it allows secure, fast and cost-effective access to interactive data. As a cloud-based solution, QuickSight automatically scales to our needs. The combination of being able to connect to data from a private VPC, authenticate users via SAML, easily author dashboards with drill downs and rich visuals, and allow read-only access to a large audience - without any infrastructure management, and with usage-based pricing - makes it the obvious choice. We look forward to enabling more customers on our platform. Massimiliano Ponticelli, Product Manager. Customer name: Siemens PLM Software Company description: Industrial Software Data source: RDS/SPICE Size: Customer dependent Previous tools: Customer dependent (Tableau for previous on-premises soln.) Auth: SAML SSO from Cognito Use case: •Provide dashboards on operational metrics in Siemens Manufacturing Intelligence Cloud-Native solution •Allow analysts at customer sites to develop own dashboards and reports with self-service functionality “ ”
44. How QuickSight Works © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark How QuickSight Works
45. How QuickSight Works © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark How QuickSight Works QuickSight allows you to connect to your data sources, and create dashboards that can be securely shared across your organization.
46. SPICE © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark SPICE QuickSight is powered by SPICE, a super-fast in-memory calculation engine that delivers performance and scale, regardless of how many users are active. *"SPICE" – a Super-fast, Parallel, In-memory Calculation Engine. SPICE Your Data Source
47. Deploying QuickSight © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Deploying QuickSight
48. Securely connect to on-premises and VPC sources © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Securely connect to on-premises and VPC sources On-premises data center Virtual private cloud AMAZON QUICKSIGHT VPC VPC AWS DIRECT CONNECT VPC VPC subnet Security Group AMAZON REDSHIFT VPC subnet Security Group ELASTIC NETWORK INTERFACE Customer Gateway Virtual Private Gateway
49. Slide23 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Federated Single Sign- On (SSO) Allows users to sign in to their Identity Provider portals with existing credentials and then access QuickSight using SAML 2.0 Users Third-party Identity Provider Federated Access with SAML 2.0 User Directory
50. Slide24 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark User Management and AD Integration QuickSight Enterprise Edition can integrate with your Active Directory to dynamically manage users and groups
51. Slide25 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Secure Content Management As a hosted application, everything you create in QuickSight is always connected, and always under control. •Modify, delete, refresh, and manage user access to everything. •Named user access with security permissions •Track and manage all of your content, and easily see who has access to what
52. Data governance © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Data governance Create managed datasets that give power users and authors the flexibility to perform self- serve analytics on data that you control. Create datasets that: •Can be shared with any user •Automatically refresh •Have row level security •Users cannot modify •Dynamically update with changes
53. Row Level Security © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Row Level Security Row level security allows you to create dashboards and reports that display different data for different users. •Create a single dashboard for multiple users with different roles or data access •Centrally govern access at the dataset level •Works with email reports!
54. User Types / User Roles © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark User Types / User Roles Admin Manage Users Manage SPICE Capacity Manage VPC Connections Manage Account Settings Author Create Data Sets Create Analyses Create Dashboards Reader Consume Dashboards QS Admin Sometimes separate from Business Users, sometimes the same Usually has AWS Console access Business User Anyone Can be internal or external users (customers/partners3rd parties) Analyst Sometimes in IT, sometimes Business Users ‘Data Analyst’ ‘Data Engineer’ ‘BI Engineer’
55. Auditing & logging © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Auditing & logging Keep track of your account with AWS CloudTrail for governance, compliance, and auditing purposes Answer questions such as: •How many users have seen this dashboard? •Which dashboards has this user seen? •Who has created a new dataset? •When did they create the new dataset?
56. Roadmap © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Roadmap
58. Fun Summary © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Fun Summary
59. Slide62 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Try it free Today @ Quicksight.AWS As a native cloud service, QuickSight combines the speed, scalability, and security that our customers have come to depend on with the value and cost effectiveness you expect from AWS Pay-as-you-go Scalable, fast, easy No deployment time No server licensing or maintenance costs Native AWS service
60. Slide2 © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Business Intelligence & Machine Learning Data Movement Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams Data Lake Relational Databases Non-Relational Databases Analytics AWS database and analytics stack Broadest and deepest portfolio purpose-built for builders Aurora RDS DynamoDB (Key value/Document) ElastiCache (Redis, Memcached) DW | Big Data Processing | Ad hoc Redshift EMR Athena Real-time Kinesis Analytics Elasticsearch Service Glue (ETL & Data Catalog) Macie (Data Protection) S3/Glacier (Storage) Machine Learning QuickSight
61. Please help us improve. Complete the session survey! © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Please help us improve. Complete the session survey! Serverless BI using Amazon QuickSight 23rd of September 2019 10:00-11:00 @Istanbul https://bit.ly/2kZJWCR
63. Demo ‹#› AWS Pop-up Loft I Johannesburg © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Demo Visualize over 200 years of global climate data using Amazon Athena and Amazon QuickSight
64. REFERENCES ‹#› AWS Pop-up Loft I Johannesburg © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark REFERENCES Amazon QuickSight product demo videos https://aws.amazon.com/tr/quicksight/resources/product-videos/

AWS TR Marketing

Serverless BI using Amazon Quicksight - 23 September - 10:00

cinema8.com

Kişisel Bilgi Güvenliği

Presentation using Trigger

DEVOPS Fundamentels

Platform for security services

A Web Developer's Journey

Future Of C#

Serverless BI using Amazon Quicksight - 23 September - 10:00