Introduction to

Autonomous Data Warehouse

Nitin Bhagat
Associate Solution Engineer, IaaS
Cloud Solutions Hub, Bangalore

Updated Oct, 2019

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |

Autonomous Database Revolutionizes Data Management

• Transform from building and maintaining databases to using autonomous

services on modern cloud

• Innovate faster -- with lower costs

– Develop and optimize new applications faster
– Cut runtime costs up to 90% ORACLE
– Eliminate full-stack administration costs
AUTONOMOUS
DATABASE
• Ensure data safety
– Eliminate cyber-attack vulnerabilities
– Guarantee 99.995% uptime – including maintenance
Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 2
Journey to Autonomous Database
Oracle has invested thousands of engineer years automating and optimizing database

• Autonomous Health Framework 18c

• Automatic Diagnostic Framework
• Automatic Refresh of Clones
• Automatic Columnar Flash
• Automatic IM population
• Automatic Memory Management 12c • Automatic Application
• Automatic Segment Space Mgmt Continuity
• Automatic Statistics Gathering
• Automatic Storage Management
• Automatic Workload Repository
• Automatic Diagnostic Monitor
11g
• Automatic Query Rewrite • Automatic SQL Tuning
• Automatic Undo Management • Automatic Workload Capture/Replay
10g • Automatic SQL Plan Management
9i • Automatic Capture of SQL Monitor
• Automatic Data Optimization

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 3

 Journey to Autonomous Database
And thousands of engineer years automating and optimizing database infrastructure

• Exadata Cloud Service

• In-Memory Columnar in Flash 2018
• Smart Fusion Block Transfer
• Direct-to-wire Protocol
• JSON and XML offload
• Instant failure detection
• Network Resource Mgmt
• Prioritized File Recovery
• IO Priorities
• Data Mining Offload
• Offload Decryption
• Database Aware Flash Cache
• Storage Indexes
• Hybrid Columnar Data
• Smart Scan
• Infiniband Scale-Out

2008

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 4

Autonomous Completes the Journey
Brings Full Automation to Entire Database Lifecycle

ORACLE ORACLE
AUTONOMOUS CLOUD
DATABASE

Complete Complete Automated

Infrastructure Database Data Center Operations
Automation Automation and Machine Learning

World’s First Autonomous Database

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 5

One Autonomous Database - Optimized by Workload

ORACLE
AUTONOMOUS
DATABASE
Available March 2018 Available August 2018

Autonomous Autonomous
Data Warehouse (ADW) Transaction Processing (ATP)
Best for all Analytic Workloads: Best for TP and Mixed Workloads:
• Data Warehouse, Data Mart • Transactions, Batch, Reporting, IoT
• Data Lake, Machine Learning • Application Dev, Machine Learning

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 6

Autonomous Data Warehouse

• Easy
–Automated management
–Automated tuning: Simply load data and run
• Fast
–Based on Exadata technology
• Elastic
–Instant scaling of compute or storage with no downtime

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 7

Getting Started with Autonomous Data Warehouse
• Provisioning requires only 4 simple
questions:
– Database name?
– How many CPU’s?
– How many TB’s?
– Admin password?
• New service created in minutes
(regardless of size)
– Database is open and ready for connections

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |

Automatic or Autonomous ?
Automatic Autonomous
Examples:
No need to use the steering wheel or
• Cruise control
brake.
• Emergency stopping
Simply tell the car where you are going.
Autonomous Car • Warnings for lane changes

Examples:
• Automatic storage management All features automatically implemented
• Automatic workload repository Simply tell the database your goals
Autonomous Database • SQL Plan Management

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential
 Automated Management
• Oracle automates end-to-end
management of data warehouse
– Provisioning new database instances
– Growing/shrinking storage and/or
compute
– Patching and upgrades
– Backup and restore
• Full lifecycle managed using
Service Console or API’s

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 10
Automated Tuning
• “Load and go”
– Define tables, load data, run queries
• No tuning required
• No special database expertise required
• No need to worry about tablespaces, partitioning,
compression, in-memory, indexes, parallel
execution
– Fast performance out of the box with zero
tuning
– Simple web-based monitoring console
– Built-in resource-management plans

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential
Automated Reliability
• Fault-tolerant, highly-available Exadata infrastructure
–Triple-mirrored disks for disk failures
–Real Application Clusters for compute node failures
–And more …
• Automatic backups
–Point in time recovery to anytime in last 60 days
• Online patches
– Regular patches applied with zero database downtime

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential
Instant Elasticity: Pay for Exactly What you Use
• Size the DW to the exact number of OPCU’s and TB’s required
– Not constrained by fixed building blocks
• Scale the DW on demand
– Independently scale compute or storage
– Resizing occurs instantly, fully online
• Shut off idle compute save money
– Restart instantly

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential
Autonomous Data Warehouse:
Architecture
Developer Tools Autonomous
Data Warehouse Data Warehouse
Services
(EDWs, DW, departmental marts and sandboxes)
Service Management Built-in Access Tools

Oracle Exadata Cloud Service

SQL Developer
Oracle Database Cloud Service
Service Console Oracle ML
Express Cloud Service
Data Integration
Services
Oracle Data Integration
Platform Cloud
DW Database
3rd Party DI on
Oracle Cloud Compute

3rd Party DI
On-premises

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential
Easy Migration to Autonomous Data Warehouse
Migration of existing Oracle systems
• Data pump import using ADW-aware settings
– Ensures compatible data import
– Violating data structures will be ignored or converted
Migration of AWS Redshift systems
• End-to-end migration using migration workbench
– Convert and create data warehouse schema
– Unload Redshift data into S3
– Load data into ADW
Migration of other systems
• Migration workbench assistance or manual

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 15

Supported by a rich Data Warehouse Ecosystem
Oracle Autonomous Data Warehouse supports:

• Existing tools running on-premise or Oracle Cloud Services

in Oracle Cloud –Oracle Analytics Cloud
– Oracle BI and data-integration tools –Oracle Data Integration
– 3rd party BI tools Platform Cloud
– 3rd party data-integration tools –and others…
• Connectivity via SQL*Net

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential
Oracle Data Visualization Desktop

• Self-service data exploration for

business users
– Rich, interactive visualizations
• Included with ADW*
– Also available as cloud version within
Oracle Analytics Cloud

* May be be use with ADW at no added cost

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 17

OracleML: Built-in notebook

• Collaborative UI for data scientists

– Easy access to shared notebooks,
templates, permissions, scheduler, etc.
• Based on Apache Zeppelin
• Roadmap: Common UI for data
scientists across multiple services

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 18

Third Party Business Intelligence/Integration Platforms
Supporting new architecture

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 19
Key Use Cases for Autonomous Data Warehouse

Data Marts / Sandboxes for Data

Warehouses Data Scientists Lakes

Business Analytics Machine Learning Query Across

All Data

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted
Autonomous Data Warehouse for Data Lakes
• Query files in object store using ADW
– High-performance SQL over Oracle Object Store,
AWS S3, or Azure Blob Storage
– Scalable joins between ADW and data lakes
– Any supported Oracle-loader file format
• Parquet coming soon
– No data loading required

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential and Restricted
Autonomous Data Warehouse

• Easy
–Automated management
–Automated tuning: Simply load data and run
• Fast
–Based on Exadata technology
• Elastic
–Instant scaling of compute or storage with no downtime

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 22

 What does Autonomous Database mean for the DBA?
Challenge: There are more data management tasks
than humans to do the work

Less time on Administration More time on Innovation

• Less time on infrastructure • More time on database design
• Less time on patching, upgrades • More time on developing new apps
• Less time on ensuring availability • More time on data analytics
• Less time on tuning • More time on end-to-end architecture

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 23