Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 31

Real-Time Analytics

for Oracle Business


Intelligence with
Intel Technologies
Nikolai Potapov CMTS, Oracle Corporation
Cynthia Feng - Software Engineer, Intel Corporation
10/26/2015

Safe Harbor Statement


The following is intended to outline our general product direction. It is intended
for information purposes only, and may not be incorporated into any contract. It
is not a commitment to deliver any material, code, or functionality, and should
not be relied upon in making purchasing decisions. The development, release,
and timing of any features or functionality described for Oracles products
remains at the sole discretion of Oracle.

Agenda
1

BI Analytics and role of In-memory databases

Engineered Systems in Analytics

One In-memory Engineered System evolution

Summary

Technology Highlights
Oracle
Exalytics
In-memory MOLAP
database Essbase

Intel
NVM Express SSDs
Xeon
Vtune

Achievements
In-memory software
Scaling to all available Cores (*)
Lighting fast internal IO on NVM-e Flash SSDs
Dramatically improved remote IO by utilizing MMAP
Machine equally good for serial calculation as for massive scale
workloads by using Super-SKU CPU
Cloud ready

(*) in some multi-user workloads


5

Agenda
1

BI Analytics and role of In-memory databases


Data in era of IoT
Real-time Analytics needs Inmemory

Engineered Systems in Analytics

One In-memory Engineered System evolution

Summary

Data in era of IoT?


MORE DATA
IoT era is
coming:
9 bln internet
devices in
2012
50 bln by
2020
90%
data
created in
last 2 years
50X growth
by 2020

Analytics

BI

Need
meaningful
DATA insight

$300 bln
estimated
revenue for IoT
products and
* Gartner, press release
03/19/2014, Gartner
services
by
Says the Internet of Things Will Transform
the Data Center
2020
(*)

Possible
solutions:
In-Memory
software for
real-time
Analytics
Engineered
system designed
specifically for BI
Analytics
workloads

Real-time Analytics needs In-memory


https://en.wikipedia.org/wiki/List_of_inmemory_databases

ActiveSpaces Aerospike ALTIBASE HDB ALTIBASE XDB


Apache Geode BigMemory dashDB Datablitz
(formerly Dali) DB2 BLU DB2 for i Ehcache EXASolution
eXtremeDB FuelDB GemFire GemFire XD GPUdb
H2 (DBMS) Hazelcast InformixWarehouse Accelerator
InMemory.Net Kognitio Analytical Platform MemSQL
SQLite Microsoft COM+ IMDB Microsoft SQL Server
MonetDB Oracle RDBMS Oracle Coherence Oracle
Exalytics OrigoDB Polyhedra P*time Redis SafePeak
SAP HANA Scuba solidDB SQL CE SQLFire Tarantool
TimesTen TPF (Transaction Processing Facility) UnQLite
Embedded Database VoltDB WebDNA Xeround

Agenda
1

BI Analytics and role of In-memory databases

Engineered Systems in Analytics


iPhone for Enterprises

One In-memory Engineered System evolution

Summary

Engineered Systems in Analytics


Cut Complexity, Cut Costs, Get Extreme Performance.
Oracle's engineered systems simplify IT operations and lower your
costs with extreme performanceaccelerated deployments, highspeed processing, and lightning-fast analytics.

1
0

Agenda
1

BI Analytics and role of In-memory databases

Engineered Systems in Analytics

One In-memory Engineered System evolution


Exalytics
Xeon
NVM Express SSD
Super-SKU
Profiling
MMAP and background writing
Cloud ready

Summary

Exalytics X5-4
Hardware
Processor
4 Intel Xeon E7-8895 v3, 72 Cores total

Memory
Up to 3 TB DDR3

Storage
4.8TB PCIe Flash
7.2 TBs of raw disk capacity

Networking
QDR 40 Gbps InfiniBand
10 Gbps Ethernet

Software
BI Analytics platform
Oracle BI Foundation Suite
Oracle Enterprise Performance Management

In-Memory
OBIEE In-Memory Acceleration and advanced In-Memory data caching
capabilities
Essbase Hardware Specific Acceleration and In-Memory optimizations
In-Memory Data Caching
BI Publisher Accelerator

Exalytics evolution
+ 1TB RAM
+ 2.4 TB PCI
Flash
+ bigger disks

X2-4

1 TB RAM
4 Intel Xeon E7-4870
40 physical cores total
3.6 TBs of raw disk capacity
40 Gbps InfiniBand 2 ports
10 Gbps Ethernet 2 ports
1 Gbps Ethernet 4 ports

X3-4

2 TB RAM
4 Intel Xeon E7-4870
40 physical cores total
2.4TB PCI Flash
5.4 TBs of raw disk capacity
40 Gbps InfiniBand 2 ports
10 Gbps Ethernet 2 ports
1 Gbps Ethernet 4 ports

+ Super-SKU CPU
+ even bigger
disks
+ even more RAM

X4-4

2 TB DRAM
4 Intel Xeon E7-8895 v2
60 physical cores total
2.4TB PCI Flash
7.2 TBs of raw disk capacity
40 Gbps InfiniBand 2 ports
10 Gbps Ethernet- 4 ports

+ Super-SKU CPU
+ even bigger
Flash
+ even more RAM

X5-4

3 TB DRAM
4 Intel Xeon E7-8895 v3
72 physical cores total
4.8TB PCI Flash
7.2 TBs of raw disk capacity
40 Gbps InfiniBand 2 ports
10 Gbps Ethernet- 4 ports

Exalytics X5-4 vs. X4-4 vs. X2-4


Faster. Bigger
Capacity
Next Exalytics generation is
faster then previous one
Next Exalytics generation has
bigger capacity and can handle
more users than previous one

(*) MDX calculation workload


Cleaned up aggregates views
ServerThreads=number of physical Cores
Same Essbase 11.1.2.4.x release
1
4

Xeon generation to generation breakthrough


QuickPath Interconnect (QPI) provides fast
point-to-point processor connect
Improved processor technology:

J
C

Interconnect 2

J
C
J
C
J
C

J
C

4x Jordan
Creek
memory
expansion
per socket

Xeon

Xeon
X4
DMI2

PCIe*
3.0

Increased cache size

J
C

Increasing number of cores per socket

J
C

J
C

QPI
v1.1

J
C

Xeon

J
C

J
C
J
C

Xeon
QPI
v1.1

J
C

J
C

Increased memory capacity & bandwith

Next generation

X4 Intel Scalable
DMI2 Memory

J
C
J
C

Xeon E7 family 32nm -> 22nm

X4
DMI2

PCIe*
3.0

32 PCIe*
3.0 / skt

X4
DMI2

PCH

1
5

NVM
Oracle Flash Accelerator
F160
NVMe SSD Connects directly

8-25x

to PCIe with 32GB/s bandwith


v.s. 12GB/s with a traditional
SAS-3 SSD

Intel SSD based card boasts


sequential reads of 2500
MB/s and writes of 1500 MB/s
while the IOPS performance is
rated at 440K Read and 70K
write 4KRDM
Virtually no penalty for
random vs sequential access

BSO app dataload as-is improved 8X


by putting app files on Flash drive
As Flash drive handles even higher IO
further optimization became possible
and thus running BSO parallel load
gave 25X
1
6

Super-SKU CPU
Processor specifically engineered for Oracle products workloads

Solution:

Challenge:
The more Cores per Socket the
lower Turbo speed possible for that
CPU

Secret sauce - processor specifically


designed for Oracle products workloads
Clock speed adjusts automatically depending
on workloads

Super-SKU CPU
Intel Xeon E7-8895 v3

# of Turbo Active Cores


Max Turbo Frequency,
GHz

1-6

7-8

3.5

3.4

912
3.3

1314
3.2

15-18

3.0

Config A
(1 Socket x 18
Cores)

Config B
(3 Socket x 6
Cores)

%
Differenc Differenc
e in Sec
e

bc" test

693.11

596.05

97.06

16.28

Frequency

"dd" test

2.97 GHz
703.87

3.44 GHz
629.11

74.76

11.88

Frequency

2.97 GHz

3.44 GHz

"bc" based benchmark: echo '20^2^20' | time -f "%U User, %P CPU" /usr/bin/bc
> /dev/null
"dc" based benchmark: nohup dd count=1999999980 if=/dev/zero of=/dev/null
turbostat package to monitor CPU Cores frequency

16%

Vtune profiling. Study #1

50.00
40.00
30.00
20.00
10.00
0.00
10

20

30

40

50

60

1
9

Vtune profiling. Study #1

2
0

Vtune profiling. Study #1

2
1

Vtune profiling. Study #1

50%

2
2

Vtune profiling. Study #2


Essbase BSO committed mode

committed mode is used to ensure ACID (Atomicity, Consistency, Isolation, Durability)

Vtune profile showing bottleneck on single busy thread while other threads waiting for a
conditional variable which was signaled every three seconds
2
3

Vtune profiling. Study #2


Essbase BSO committed mode

880x

Removing bottleneck reduces single file loading time from 2940 minutes to 200
seconds

Improved concurrency from one single busy threads to more threads with balanced
Subject to
load

2
4

MMAP, background writing

MMAP

Memory-mapped files feature is another


step to make fully in-memory product by
abstracting IO level completely from
calculation engine. Its especially beneficial
for deployments involving slow storage
options such as remote storage connected
via NFS

30x

(*) in some cases Disk and remote storage performance became comparable to
RAM

Background DB writer

2
5

Cloud readiness
ACID hardening, committed mode.
Traditionally Essbase database was used by financial applications where
usage rules were often guaranteed by application logic and not proper
requests were not expected. Opening database to wider auditory makes ACID
hardening important task and committed mode is a good step in that direction

Remote storage improvements


Many cloud deployments are based on separation of compute (CPU, memory)
and storage. Therefore achieved remote storage improvements are crucial for
such deployments.

2
6

Agenda
1

BI Analytics and role of In-memory databases

Engineered Systems in Analytics

One In-memory Engineered System evolution

Summary

Summary
In-memory software makes real-time analytics possible with the aid from
advanced hardware technology including powerful CPU, lighting fast storage and
increased memory capacity
The close integration of Oracle Exalytics In-memory software and hardware and
software optimization through effective profiling tools like Intel Vtune ensures best
performance
Intel and Oracle collaboration working on improving Oracle Exalytics platform
proved to be very successful and contributed to overall improved experience of
Oracle BI customers
Need more info on Exalytics?
Check out https://www.oracle.com/engineered-systems/exalytics/index.html
Thank you!

Intel + Oracle* Collaboration = Win-Win for

Safe Harbor Statement


The following is intended to outline our general product direction. It is intended
for information purposes only, and may not be incorporated into any contract. It
is not a commitment to deliver any material, code, or functionality, and should
not be relied upon in making purchasing decisions. The development, release,
and timing of any features or functionality described for Oracles products
remains at the sole discretion of Oracle.

Other Technical Sessions


from Oracle PSR group
Title

Day Time

Room

Session
ID

CON9342

Extreme Scalability with Oracle Access Management suite

Oct 26 11:00am South-270

CON1085
0

Real-Time Analytics for Oracle Business Intelligence with


Intel Technologies

Oct 26 12:15pm South-309

CON1085
1

A Spoonful of Analytics for Cloud Performance


Optimization

Oct 26

4:00pm

South-262

Packing Them In: Co-operative Memory Management and


MultiTenancy in WebLogic
CON9291 Performance of Oracle PaaS services

Oct 27

4:00pm

South-274

Oct 28

3:00pm

South-274

CON9330

Oct 29

1:15pm

South-302

CON9327

OBIEE Performance and rpd optimization techniques

DONE

Q&A

You might also like