Download as pdf or txt
Download as pdf or txt
You are on page 1of 21

Data Warehouse Solutions from SAP

Strategic Direction and Evolution

Data Warehousing Solutions from SAP


Overview
Solving complex and diverse challenges
Real-time analytics Big data Agility

Powering sophisticated information landscapes


High-performance operational analytics Enterprise data warehousing

Providing customer choice through complementary and inter-operable solutions


SAP HANA Appliance Sybase IQ SAP NetWeaver Business Warehouse Sybase Power Designer
2012 SAP AG. All rights reserved. 2

Definitions
Data Mart
Large Scale Query & Analysis Flexible Data Marts Simplified Maintenance

Logical/Distributed DW
ETL Governance Data Distribution

Centralized EDW
Data Lineage Data Consolidation Data Transformation Information Lifecycle Mgmt

Data Mart = Way to store and report on information Data Warehouse = Ability to Manage/Integrate/Harmonize/Govern Multiple Data marts Centralized EDW = Centralized Management/Orchestration of multiple data-marts in a single environment Logical EDW = Logical Management/Orchestration across a variety of data marts and environments

2012 SAP AG. All rights reserved.

What is a Data Mart?


A data mart is a repository of data gathered from operational data and other sources that is designed to serve a particular community of knowledge workers. The data may derive from a data warehouse or operational systems directly. The emphasis of a data mart is on meeting the specific demands of a particular group of knowledge users in terms of analysis, content, presentation, and ease-of-use. Users of a data mart can expect to have data presented in terms that are familiar. A data mart is a collection of subject areas organized for decision support based on the needs of a given department. There are two main categories of data marts - dependent and independent. A dependent data mart is one whose source is a data warehouse. An independent data mart is one whose source is the legacy applications environment. All dependent data marts are fed by the same source - the data warehouse. Main tasks of a data mart:

Providing information specific to the needs of a certain business user group or department Providing information ready for end-user consumption

Sourced: TechTarget
2012 SAP AG. All rights reserved. 4

Different Analytical Needs


Leverage Appropriate Data Marts to serve Business Needs
Logical / Centralized Enterprise Data Warehouse (as a management framework)

Architected Data Marts (Enterprise BI) : Consolidated and integral part of EDW supporting decision making on corporate data Centrally managed by IT, standardized data models on corporate information Long term requirements in terms of stability and consistency Typically time aggregated data Operational Data Marts (Operational Analytics):

Real Time Analytics

Operational Analytics

Enterprise BI

Ad-Hoc | SelfService BI

Query-able Archive

Real Time Data and timeliness centric Reporting on large volumes of granular, transactional data Supporting local business execution

Real Time Data Marts

Operational Data Marts

Architected Data Marts

Agile Data Marts

Near-Line Data Marts

Higher data volatility Agile Data Marts (Ad-hoc Analysis): Independently of the highly governed centralized corporate EDW layers

Streams | Feeds

DB Replication

ETL / ELT / Replication

ETL / ELT / Replication

Federated Queries

Maximum flexibility for LoBs in data modeling and integration of LoB specific data Support strategic decision making in LOBs Volatile and historical data with fluid data models Real-Time Data Marts ( Event Based Analytics) : Reporting on Events and Streams of Information Defining Rules and Alerts to trigger exception based analytics Tracking and logging Events via an audit trail and managing deviations from audit information Mobile consumption paradigm as key value Near-Line Data Mart ( Query-able Archive) : Reporting on Longer Term Trends Reporting on Rarely Used Information for Governance / Audit Purposes

Sensor | Mobile | Social

Transactional | System of Record

Transactional | Analytical | Systems of Record & Engagement

Archived Information

What is a Data Warehouse?


Bill Inmon: The Data Warehouse is a subject-oriented, integrated, time-variant, non-volatile collection of data used to support the strategic decision-making process for the enterprise. It is the central point of data integration for business intelligence and is the source of data for the data marts, delivering a common view of enterprise data. Ralph Kimballs: A data warehouse is a copy of transaction data specifically structured for query and analysis. It is the conglomerate of all data marts within the enterprise. Information is always stored in the dimensional model. TDWI: Data warehousing incorporates data stores and conceptual, logical, and physical models to support business goals and end-user information needs. A data warehouse (DW) is the foundation for a successful BI program. Main tasks of a Data Warehouse:

Integrating data from various data sources to common semantics given by the Data Warehouse data model Harmonizing data values Establishing a single version of truth as a source for data marts, delivering a common view of enterprise data Providing a single, comprehensive source of current and historical information

2012 SAP AG. All rights reserved.

Logical EDW versus Centralized EDW


Logical/Distributed DW
Data Visualization Data Visualization

Centralized EDW
Data Visualization Central EDW Logical Reporting Data (Cubes)

Data-Marts

Data-Marts

Central Data Hub

Harmonized Data Data-Marts Data-Marts

Data-Marts

Data-Marts

SAP Sources
(Structured+Unstructured)

Non-SAP Sources
(Structured+Unstructured)

SAP Sources
(Structured+Unstructured)

Non-SAP Sources
(Structured+Unstructured)

2012 SAP AG. All rights reserved.

Enterprise Data Warehousing Will Continue To Be a Strategic Investment


EDW Challenges and Drivers
Exponential Growth and Increasing Velocity of Data Increased Complexity of System and Information Landscapes Dynamic Business Requirements Greater and More Diverse Consumption Patterns Market Consolidation Across Industries Drives M&A Activity Focus on Internal and External Stakeholder Transparancy

2012 SAP AG. All rights reserved.

SAP NetWeaver Business Warehouse


An integrated Enterprise Data Warehouse management application
Including capabilities for
Pre-defined Entity Relationship Models based on SAP Business Suite Agile Data modeling with BW workspaces Non-materialized consumption of HANA data models in BW Layered Scalable Architecture (LSA) ETL process modeling Real time data acquisition Scheduling Administration lifecycle management High performance OLAP processing both SAP and non-SAP sources

BW LSA ++

HANA

2012 SAP AG. All rights reserved.

Sybase IQ
A proven enterprise-class columnar database
A petabyte-scale elastic-compute analytics-server that supports highly parallel query processing and data loading, and tunable workload management, Supports commodity hardware and patented data compression and indexing for very low Total Cost of Ownership (TCO) Capabilities include ability to scale out with near linear performance; native MapReduce / Hadoop integration; isolation of user communities for straightforward SLA management and security; best in class in-database analytics and predictive libraries; advanced text search; FIPS level security. An expanded eco-system for the support of third-party applications for information lifecycle management, business intelligence and data integration, predictive analytics and system/data administration. Administration Framework
IQ

Sybase IQ 15 Engine
Web Enabled Analytics Communications & Security Loading Engine Query Engine Text Search In-Database Analytics Column Indexing Sub-system Column Storage Processor Multiplex Grid Management Information Lifecycle Management

Storage Area Network

2012 SAP AG. All rights reserved.

10

SAP HANA
A platform for a new class of real-time analytics and applications
SAP Business Suite SAP Business Warehouse SAP Big Data Applications SAP Mobile Custom Apps

3rd Party BI Client

SAP Analytics

SAP NetWeaver (On Premise / Cloud)

Real-time analytics (OLAP)


SAP HANA
Information Composer & Modeling Studio Planning and Calculation Engine Real-time replication services Application Services (e.g. HTML 5 Server) Predictive Analysis & Business Function Libraries In-memory database

Real-time apps (OLTP)

Text Search

R & Hadoop integration

Data services

SAP Business Suite

Third-party systems

2012 SAP AG. All rights reserved.

11

SAP HANA + Sybase IQ


Strategic Direction
Managing all OLAP and OLTP applications with close to zero application-based data redundancy by switching operations seamlessly between hot blades to manage 100% up-time with zero-disruption from data loads and applying fixes and new developments allocating data across all available storage media by hot and cold data requirements and everything in between Integrate Optimize Synthesize

Next generation near-line SMART STORE solution for BW/SAP HANA


Customer Value Cost effectively store Petabyte-sized data sets

Extend Sybase IQ Hadoop and MapReduce capabilities into SAP HANA


Customer Value Integration of Hadoop data and MapReduce queries with SAP HANA for Breadth AND Depth Analysis

Extend SAP HANAs processing engine with Sybase IQ optimizer and indexing innovations
Customer Value Market leading internal and external predictive libraries Enterprise-wide information access supporting massive concurrent workloads
12

2012 SAP AG. All rights reserved.

The SAP Data Management Landscape


Data Mart Context
SAP Data Visualization
(SAP BusinessObjects BI)

EDW Context
Present
SAP Delivered Content for BizSuite

SAP Delivered Data-Mart Content


(RapidMarts + RDS)

Partner Delivered DataMart Content


(RapidMarts)

Custom Build Data-Mart Content

Custom Build EDW


(Sybase PowerDesigner + HANA Model Studio)

SAP Delivered EDW


(SAP BW)

Manage, Integrate & Harmonize Build Store & Process Ingest

Data-Marts
(Sybase PowerDesigner, HANA Model Studio, SAP BW)

Data Storage & Processing


(SAP HANA Platform + Sybase IQ)

SAP Enterprise Information Management


(SAP Data Services, Sybase RepServer, Sybase ESP, SLT, MDM, Information Steward)

SAP Sources
(Structured+Unstructured)

Non-SAP Sources
(Structured+Unstructured)

2012 SAP AG. All rights reserved.

13

SAP Enterprise Data Warehousing


Vision
SAP is evolving the Data Warehouse uniting SAP BW, Sybase IQ and SAP HANA on the SAP Real-Time Data Platform

SAP BW on HANA SAP HANA DB

SAP HANA Data Mart SAP HANA DB


SAP ETL/Replication

SAP BW on HANA + HANA Data Mart SAP HANA DB


SAP BW ETL

Sybase IQ EDW Sybase IQ


ETL/Replication

Sybase IQ
SAP ETL/Replication

Today

SAP BW ETL

Centralized EDW - In-Memory Packaged Data Warehouse framework Leverage Business Content for SAP (master data, transaction data, semantics) Consumption of SAP HANA Data Mart models

Custom Build Data marts HANA optimized for real-time use cases Instantaneous reporting on hot data Planned in the near future Consumption of BW models Sybase PowerDesigner

Centralized EDW (In-Memory with Temperate data) X-Consumption of BW and HANA data models NLS - Near-Line Storage Planned in the near future Keep Current Data In-Memory Keep Aged Data on Disk

Custom Build DW Massive Scale Petabyte scale storage and processing of data Sybase PowerDesigner Meta Data and data modeling

Future

SAP BW integrated with SAP Business Suite

Data Marts

Custom Build Enterprise Data Warehouses

SAP Real-Time Data Platform (HANA+IQ)


2012 SAP AG. All rights reserved. 14

Next generation SAP Real-time Data Platform


3rd Party BI Client SAP Business Suite SAP Business Warehouse SAP Big Data Applications SAP Analytics SAP Mobile Custom Apps

SAP NetWeaver (On Premise / Cloud)

SAP Real-time Data Platform


Open Developer APIs and Protocols
Common Modeling Sybase PowerDesigner
SAP Sybase SQLA SAP Sybase ASE

SAP HANA Platform


SAP Sybase ESP

SAP Sybase IQ

SAP Sybase Replication Server

SAP Data Services

SAP MDG, MDM

SAP Smart Data Services Platform

SAP innovation without customer disruption


2012 SAP AG. All rights reserved. 15

Common Landscape Management

HADOOP 3rd Party DB

MPP Scale-Out

SAPs Data Platform Supports Storing Both High Value Data As Well As High Volume Data
Choosing the Analytic Database
HANA for High Value or Hot Data
HANA

Sybase IQ for Higher Volume characteristics (price/performance of in-memory and disk) HANA+IQ for providing temperate data (tiering storage and processing)
IQ

Data Value
ASE

SAP BW or Custom Build Warehouses?


SAP is a company of choice: Buy or Build!
Hadoop

Data Volume

SAP BW is an integrated Enterprise Data Warehouse management application that SAP recommends due to its tight integration with the SAP application family (master data, harmonization, data movement, etc) For customers who want to define their own warehousing methodology, SAP will also optimize our tooling and platform for building custom warehouses
16

2012 SAP AG. All rights reserved.

SAP NetWeaver BW
Strategy Overview Key Themes and Capabilities
SAP NW BW 7.30 on HANA*
HANA specific features Performance boost for data loading, query response time and planning HANA-optimized InfoCubes and Data Store Objects (DSO) Simplified and faster data modeling/remodeling In-memory planning Support of native HANA models Simplified system landscape Platform independent highlights Graphical data flow modeling Semantic Partitioned Objects (SPO) Rapid prototyping of Ad Hoc Scenarios via BW Workspaces Tighter integration with SAP Data Services
* SAP will continue to support RDBMS platforms

Upcoming planned release


HANA-specific features SAP BW and SAP HANA Mixed Scenarios Not active data concept Support of Semantic Partitioned Objects (SPO) Enhanced Partitioning for write optimized DSOs Support for SAP BusinessObjects Explorer Platform independent highlights Enhanced Support of 3.x -> 7.x Dataflow Migration File Download of BW meta data DSO Planning

Future innovations
Additional Flexibility BW/Non-BW mixed EDW environments Managing the logical EDW Open Operational Data Store layer Big Data/Hadoop connector Lower TCO with simplified data modeling Uniform modeling concepts with eclipse based UIs Highly reduced number of InfoProvider types for easier data modeling Enhanced performance and scalability Further reduce data provisioning times HANA optimized transformations Data aging strategies Conversion tools

Today
GA since April 10th
2012 SAP AG. All rights reserved.

Planned Innovations
(Release SP 8 Q4 2012)

Future Direction
17

This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent.

Thi si

SAP Sybase IQ
Strategy Overview Key Themes and Capabilities
Analytics Server for EDW and Big Data Analytics
Shared-everything MPP with Virtual Data Marts and MapReduce APIs (Native + Hadoop Federation) Certified with SAP BusinessObjects BI platform and Data Services v3.x, v4.x

Analytics Server for EDW and XLDB Analytics


Next-gen column store for XLDB analytics w/ parallel + concurrent ingestion, intelligent scale out Near-line store/feed from/to BW and HANA MDX API support Optimizations/innovations w/ SAP BusinessObjects BI platform, Data Services & Predictive Analytics
SAP BusinessObjects Services: Load Table/Client Side Loads/ELT/Upsert SAP BusinessObjects Predictive Analytics: connectivity drivers

Autonomic Analytics Server for EDW and XLDB Analytics


Self adjusting XLDB Analytics platform including cloud APIs End-to-end co-innovations / differentiation with SAP HANA, SAP BusinessObjects BI platform, Data Services & Predictive Analytics
SAP BusinessObjects BI platform: Function Library support, SQL Code Optimizations SAP BusinessObjects Data Services: Multinode loads, insert.location SAP BusinessObjects Predictive Analytics: InDB Analytics

Today
(Release 15.4 Q4 2011)
2012 SAP AG. All rights reserved.

Planned Innovations

Future Direction
18

Thi si

SAP HANA
Strategy Overview Key Themes and Capabilities
Analytics Platform
SAP BW on SAP HANA Additional business functions and predictive algorithms SAP HANA Studio Modeler enhancements Enhanced enterprise fit and readiness Additional and enhanced data provisioning capabilities R integration Unstructured text search Enhanced security and authentication Hadoop Integration (DS 4.1) BPC on SAP HANA Predictive Analysis on SAP HANA Desktop visualization client for HANA (SAP Visual Intelligence)

Expanded existing Transactional Open Platform support


Business Suite on SAP HANA readiness Packaged Suite Analytics New applications on SAP HANA Enhanced developer support Third-party tool certification and support (BI - SQL, monitoring, backup and recovery, data center operations) Text analytics and file filtering Explorer support for BW on HANA Optimized Planning Enhancements Odata support Single sign-on with SAML Data-at-rest encryption Sybase Replication Server & ESP support

Real-Time Data Platform


New applications on SAP HANA and SAP HANA Cloud Additional Private Cloud deployment capabilities for SAP HANA Power Designer Interoperability HANA & SAP IQ Optimization and Integration Native integration with Hadoop Transformed SAP Business Suite processes leveraging merged OLTP & OLAP Additional third-party tool support (ETL, BI MDX, and more) Further optimization & integration between HANA and Sybase IQ & ASE Spatial support and integration

Today
(SPS4 Q2 2012)
2012 SAP AG. All rights reserved.

Planned Innovations

Future Direction
19

SAP Enables Choice


When to choose Centralized Enterprise Data Warehouse vs Custom Build?
Enterprise Data Warehousing - why Consolidate the data across the enterprise to get a consistent and agreed view on your data "Having data is a waste of time when you can't agree on an interpretation." Combine SAP and other sources together Standardized data models on corporate information Supporting decision making on all organizational levels EDWs require a Database plus an EDW tooling & capabilities SAP NetWeaver BW provides flexiblity and scalable EDW capabilities Highly integrated tools for modeling, monitoring and managing the EDW Open for SAP and non-SAP systems Agile data modeling using BW workspaces Runs on top of HANA and other RDBMS Easy consumption of HANA Data Mart scenarios via virtualized data access Sybase IQ/SAP HANA provide a real-time database platform to custom build an EDW Higher development and maintenance efforts than adopting a packaged approach with SAP BW on HANA (today, there are a variety of tools with lacking integration) SAP is building out a Real-Time Data Platform to Unify the Tooling to Build and Orchestrate Custom Data Warehouses
2012 SAP AG. All rights reserved. 20

Key Contacts: DW Solution Management


Sybase IQ Product Management

Scott Shepard scott.shepard@sap.com Daniel Rutschmann - daniel.rutschmann@sap.com Erich Schneider erich.schneider@sap.com Yuvaraj Athur Raghuvir - yuvaraj.athur.raghuvir@sap.com

Joydeep Das joydeep.das@sap.com

SAP BW Product Management


Lothar Henkes lothar.henkes@sap.com Brian Wood brian.wood@sap.com

DW Solution Marketing

Dan Kearnan dan.kearnan@sap.com Dan Lahl dan.lahl@sap.com

HANA Product Management


Michael Eacrett michael.eacrett@sap.com Ingo Brenckmann ingo.brenckmann@sap.com

You might also like