Download as pdf or txt
Download as pdf or txt
You are on page 1of 73

Analytics Innovation, Disruption,

And Transformation
SID 5978

Timo Elliott, SAP


2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

Analytics Innovation, Disruption


And Transformation
Timo Elliott, SAP, October, 2016

Agenda
Top Trends

Supporting Modern BI
Big Data Architectures
Organizing for Data
Conclusion

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

Top Trends

Technology Priorities for 2016 and beyond


Rank Technology

ANALYTICS

BI/Analytics

#1

Cloud

Mobile

Digitalization / Digital Marketing

Infrastructure & Data Center

ERP

Nine out of
eleven years
2006-2016

Security

Industry-Specific Applications

Customer Relationships

10

Networking, Voice, and Data Comms

Trend

Gartner: 2016
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

From The Back Office To The Business Models of Future

By 2020, information will be used to

reinvent,
digitalize, or
eliminate

of business processes and products


from a decade earlier.
@timoelliott
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

Live Business

BI Success

BI initiatives described as
successful dropped from
41% to 35% in 2015
Techtarget, 2015

2016 SAP
SE or an SAP affiliate company. All rights reserved.
Source:
TechTaget

Internal

BI is Dead!?

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

10

Are you a BI-nosaur?

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

11

Complaints
32% say Enterprise BI too
complex, complicated,
cumbersome to use

31% wait days or weeks for an


average BI request
Enterprise systems dont
have all the data needed ->45% from outside
Source: Forrester
2014 SAP AG. All rights reserved.

12

The Penetration of BI Remains Low

Close to 40% of organizations report


fewer than 10% of employees using BI
Techtarget, 2015
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

13

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

14

Supporting Modern BI

Data-Driven Approach
Push:
From IT
Data-Driven
Data to Insight
Technology-Centric

2016 SAP SE or an SAP affiliate company. All rights reserved.

A.S.P.I.R.E.

Internal

16

Value-Driven Approach
Pull:
From LOB
Outcome-Driven
Insight to Data
Use-Case-Centric

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

17

Combination Approach
Push:
From IT
Data-Driven
Data to Insight
Technology-Centric

Pull:
From LOB
Outcome-Driven
Insight to Data
Use-Case-Centric
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

18

Modern BI

Source: Gartner
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

19

Systems of Insight
Earlier-Generation BI Is No Longer
Enough
Earlier-generation BI cant keep up in the
age of the customer.
Agile BI and big data are the building
blocks of systems of insight

More

Agile BI

Systems of
insight

Earliergeneration
BI and
analytics

Big data

Business
agility

Less

Less

More

Amount and availability of data


Source: Forrester Research, Inc.
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

20

Pret A Manger

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

21

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

22

What Food to Make, When?

Knowledge

Hot Food
Continuous
Replenishment

Check Past Sales

Check Forecast

Check Must
Stock

Set 60%/70%
Fixed First
Production

All Other Food


Monitor for 2nd
and 3rd Variable
Productions

Run and Check


Range Tool
2014 SAP AG. All rights reserved.

23

What Food to Make, When?

Trading Patterns
Core Range

Weather

Special Events

2014 SAP AG. All rights reserved.

24

Choosing a New Store Location


Transactional,
Changeable Data

Slow and Steady Data

POS Data

Store Attributes
Internal
Data

Store Placement
Deliveries

Store Org Structure


Store Staff
Store Visibility, Signage

External
Data

POI Data
Competitor Store Attributes
GIS Competitor and Cannibalisation

Footfall

Events

Weather
Real Estate

Census, ONS Data


2014 SAP AG. All rights reserved.

25

$4.48 billion revenue


40K employees
> 8M patients/year

Mercy Health

Mercy one of US Most Wired for 12th


Year in a row!

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

27

Agile self-service with SAP HANA


and SAP Lumira. 9 years of data,
structured & unstructured

It is mind-blowing how versatile


and nimble our data warehouse
is on SAP HANA.

Invest in Self-Service Data Discovery Tools

Through 2020 spending


on self-service visual
discovery and data
preparation market will
grow 2.5x faster than
traditional IT-controlled
tools for similar
functionality
IDC, 2015

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

31

Invest in Self-Service Data Preparation

SAP Agile Data Preparation

I.e., Data Blending


combine, merge, cleanse data

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

32

Invest in Predictive Analytics


Model deployed using
In-Database-Apply

Customer Database
Hancock, John

38

4.2

Doe, Jane

45

9.4

Red, Simply

18

2.1

SQL

Business Users can get on-the-fly


scoring without even knowing they
are using predictive algorithms

SQL Dataset w/ Scoring

SAP BI (3.x/4.x)

Embedded into any application


BI Artifact
(or even just a dataset)

(Or any other application)


2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

33

SAP BusinessObjects Cloud

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

34

Big Data Architectures

Big Data Architectures = Digital Business


By 2018, 40% of enterprise architecture teams teams will be distinguished as leaders by their primary
focus on applying disruptive technologies to drive business innovation.
By 2018, 40% of enterprise architecture teams will be responsible for advancing the organization's
digital business strategy.
By 2018, the new economics of connections will drive organizations to increase investments in
connected physical assets and systems by 30%.
By 2018, 20% of enterprise architects will use business ecosystem modeling to identify and predict
business moments.
By 2017, 20% of EA will be responsible for identifying new business designs that leverage
business algorithms.
Source: Gartner, Predicts 2016: Five Key Trends Driving Enterprise Architecture Into the Future
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

36

You Need Both of These

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

37

A Common Question
We like SAP ERP (and HANA), we like
Hadoop, and your BI tools are a standard. But
we dont understand how its all going to fit
together. Help!

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

38

What is Hadoop?

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

39

Classic Hadoop Use Cases


Semi-structured data loading / processing
First web data, now IoT / documents / images, etc.

Offload traditional relational DW


Typically no reduction in existing DW, but new data increasingly tiered
Queryable alternative to tape backups
E.g. when upgrade to different ERP system, keep copy of all old data

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

40

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

41

Coca-Cola East Japan Architecture

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

42

Other Interesting Hadoop Use Cases


Fast scale up / down
Game apps company: big fan of Teradata, and found it cheaper to run than Hadoop, but when
individual games became a hit, they needed to be able to scale up (and down) fast
Avoid brittle ETL, push schema creation to the business
Large investment bank had dozens of different CRM setups, thousands of ETL jobs that kept
breaking kept traditional DW, but added data lake -- its all in there have fun!

Excel on steroids / exploration


Big, one-off decisions
We dont know what we dont know

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

43

Sandboxing / Data Extensions

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

44

Not Just a Data Store A Platform


Far more than a batch-driven data store
Many still have an out of date view Yarn / Spark etc
Data at Rest and Data in Motion
But still not for transactions any time soon
Still maturing, still a lot of work, but has proved enterprise value
In particular, overcame biggest security & auditing concerns Kerberos integration, encryption,
tokenization, Apache Ranger
Low capital costs to try things out (but dont underestimate time / training / expertise needed)
Considered the heart of digital transformation in some large organizations
...At least by the team implementing Hadoop! (but theres typically a large traditional IT
modernization effort going on at the same time)
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

45

Centrica (British Gas)

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

46

Zurich Insurance

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

47

Some Projects
Atlas open data
governance
Ranger policies and
security
Nifi data in motion
Flink streaming data
analytics
Zeppelin analytic
notebooks
Juypter, Kafka, Flume,
Sqoop, etc etc

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

48

Result of All This: Data Complexity For The Foreseeable Future

Data
Warehouse

Hadoop,
MongoDB,
Spark, etc

Big Data Architectures got complicated

Hybrid
Transaction/
Analytical
Processing

Data
Personal
Data / BI

Feeds

Where does data arrive?


When does it need to move?
Where does modeling happen?
What can users do themselves?
What governance is required?

What we would like consistent, seamless solution


2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

49

SAP HANA Vora


Whats Inside and What Does It Do?

Drill Downs on HDFS


Mashup API Enhancements
Compiled Queries
HANA-Spark Adapter
Unified Landscape
Open Programming

SAP HANA Vora is an in-memory query engine which leverages


and extends the Apache Spark execution framework to provide
enriched interactive analytics on Hadoop.

Make
Precision
Decisions

Democratize
Data
Access

Simplify
Big Data
Ownership

Any Hadoop Clusters


2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

50

SAP Big Data Platform Hadoop Inside


Vision
HANA Data Management Platform
Information Management | Text | Search | Graph | Geospatial | Predictive

SAP HANA
In-Memory

HANA native BigData


Dynamic Tiering
Smart Data Streaming
NoSQL | Graph | Geo |
TimeSeries

HADOOP
Vora

0.0sec

Infinite Storage
Raw Data

Instant Results
Smart Data Streaming

Administration | Monitoring | Operations | User Management | Security

2016 SAP SE or an SAP affiliate company. All rights reserved.

HANA & Hadoop

SDA Hive | Spark


MapReduce | HDFS
Admin & Monitoring
User Mgmt / Security

Hadoop Extension
Vora Engine
Integrated with HANA and
Hadoop

Internal

51

orc

parquet

1.1.72-4556

Fast Column Scans

Components

Compressed Columns

Cache Efficient
Algorithms

1.1.72-4556

engine
1.0.20

1.0.21
0.1.7
1.3.2

In Memory Storage

url

0.2.0 1.1.72-4556 0.7.0

series

Written From
Scratch

landscape
1.0.8
catalog
1.2.7

1.0.8
0.0.4

0.0.4

1.2.4

1.0.4 0.4.0 1.2.0-4588

semanticanalyzer

1.0.21
0.1.7

0.8-rc2
1.0.10

parser

0.1.6
dlog

hdfs

data-generator

1.2.3

discovery

1.3.0-rc2
1.3.2

1.3.2
1.3.0-rc3
runtime

0.2.0-rc3
aggregation

catalyst
1.3.2
txbroker

net

maprfs

zip

jdbc

Multi Platform

2016 SAP SE or an SAP affiliate company. All rights reserved.

Parallel Query
Processing

Code Generation
#FEA433

Internal

52

SAP HANA Vora Modeler

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

53

SQL/OLAP on Big Data

Hierarchical data storage of contextual data supports


structured analysis

Fast drill-down interaction aids in root-cause analysis

Familiar OLAP tool enables experienced business


analysts derive useful insights from contextual data

Support for HDFS, Parquet and ORC formats


Hadoop/NoSQL DATA

LLVM/Clang JIT compilation of query plans and


execution

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

54

SQL-on-Hadoop using Vora


A different context allows access to
SAP HANA data from Spark SQL

Creates an in-memory data object,


similar to a Spark dataframe
Load data from HDFS, temp table will be
distributed across Hadoop cluster

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

55

SAP Predictive Analytics 3.0


Native Spark Modeling

Standalone or included
in SAP HANA
Predictive Factory
Integration with cloud &
other apps
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

56

DW Directions
Planning and Definition
2015

Execution and Delivery


2016-2018
Analytics , BI Suite, Predictive

Analytics , BI Suite, Predictive

Power
Designer

DWH
Foundation
Business
Warehouse

Power
Designer

Hadoop
SAP HANA Vora

Market presence in Data Warehousing


with a clear roadmap

Optional Components

SAP HANA DW
Business
Warehouse

DW Modeling

DW ETL & DM

SAP HANA
Platform

HANA
EIM

SAP HANA Platform

Analytics , BI Suite, Predictive

SAP HANA DW

SAP HANA DW

Vision

DW Foundation

HANA EIM
Hadoop
SAP HANA Vora

Strong and simplified


offering with tight integration

SAP HANA
Platform

Hadoop
SAP HANA Vora

Convergence into one technology


stack addressing BW and SQL-based
DW needs
This is the current state of planning and may be changed by SAP at any time.

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

57

SAP HANA DW Future-proof data management platform

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

58

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

59

Looking Forward to the Future: Data Refineries


Nobody believes that a single big data warehouse is THE solution any more
But theyre not going away any time soon
Data warehouses are dead! Long live data warehousing!
Instead:
Enterprise Information Catalog transparency
Search for data: origin, owner, trust level, sensitivity, formats, how to order
Data Factories workflows, not just data
The collective know-how on getting, refining, displaying data
More info from Mike Ferguson, here:
http://www.slideshare.net/HadoopSummit/organising-the-data-lake-information-management-in-a-big-data-world

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

60

The Big Big Picture


Embrace Hadoop as if it were SAP technology

What SAP does best: business process (live!)

Vora
HANA

Hadoop

infrastructure

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

61

Organizing For Data

The BICC is Also Dead

When Gartner started to cover


BICC as a trend over 10 years
ago, it turned out to be one of the
biggest success factors for BI
programs
But: All good things must come
to an end.

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

63

So What Replaces BICCs? (According to Gartner)

Long live the ACE:


Analytic Community
of Excellence!

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

64

Executives

Finance

BICC
Operations

IT

Sales

Strategic
Planning
Mktg

Who Drives Business Intelligence?


2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

65

40% of users are using an equal amount


or more of homegrown applications

Embrace Shadow IT

2016 SAP SE or an SAP affiliate company. All rights reserved.

Dont fight back be a co-conspirator


Internal

66

Updating the Traditional BICC to Include Community

A Business Intelligence Competency Center (BICC)


is a cross-functional organizational team that has
defined tasks, responsibilities, roles, and skills
for supporting and promoting the effective use of
Business Intelligence* across an organization
* I.e., Analytics, Big Data, Data Science, etc.
2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

67

Its About Culture Change First and Foremost


New BICCs are about providing good governance and encouraging best
practice rather than providing reports and analytics

From Power to Empower


From Collection to Connection
From Control to Trust

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

68

Its All About the


Relationship!

2016 SAP SE or an SAP affiliate company. All rights reserved.

Internal

69

Conclusion

SAP Platform for Digital Transformation


CEC
Business Network
IoT

Applications

Extensions

IoT
Platform

Icon

Applications
(Micro-) Services

HANA Cloud Platform

S/4HANA

BOBJ

Identity Management

Suite

HANA

C4A

Analytics

Vora
Distributed Computing
Platform

Platform

any DB
2016 SAP SE or an SAP affiliate company. All rights reserved.

Hadoop
Internal

71

PRESENTATION MATERIALS
Presentation slides for all ASUG BI + Analytics
Conference sessions can be found at:

http://bit.ly/bia16slides
-orReceive a flash drive with all slide decks if you complete 8 or more
session evaluations in the mobile app.

TELL US WHAT YOU THINK

TAKE THE SESSION SURVEY:


Be sure to complete the session evaluation
on the ASUG BI + Analytics mobile app.
Download the app from iPhone App Store
or Google Play.

Thank You!
Timo Elliott
VP, Global innovation Evangelist

Timo.Elliott@sap.com
2016 SAP SE or an SAP affiliate company. All rights reserved.

@timoelliott
Internal

74

You might also like