DMM202 – SAP BW 7.

40 Near-Line Storage for

SAP IQ – What's New?

Rainer Uhle
Product Management SAP EDW (BW / HANA), SAP SE
Dr. Peter Zimmerer
Chief Development Architect BW, SAP SE

Public
Abstract

SAP Business Warehouse Near-Line Storage (NLS) allows the implementation of sound data aging strategy
for transactional data. This session covers the latest NLS optimizations regarding NLS Query performance,
a better tool support during NLS implementation, and even more visibility of SAP BW NLS and SAP IQ-
related aspects in the DBA Cockpit.
Disclaimer

This presentation outlines our general product direction and should not be relied on in making a
purchase decision. This presentation is not subject to your license agreement or any other agreement
with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to
develop or release any functionality mentioned in this presentation. This presentation and SAP's
strategy and possible future developments are subject to change and may be changed by SAP at any
time for any reason without notice. This document is provided without a warranty of any kind, either
express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this
document, except if such damages were caused by SAP intentionally or grossly negligent.

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 3

Agenda

Introduction – SAP BW Near-line Storage (NLS) in times of SAP HANA

 What happened so far …

SAP BW NLS Implementation of HANA Smart Data Access (SDA)

 … a typical example

SAP BW NLS – Further Roadmap and Outlook

 The sails have been hoisted …

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 4

DMM202
SAP BW 7.40 Near-Line Storage for SAP IQ

Introduction – SAP BW Near-line Storage (NLS) in times of SAP HANA

Latest Positioning
NLS Basics
Implementation
Design-time objects
Run-time objects
Performance considerations
Customer Reference
 SAP BW on HANA – Smarter, simpler, more efficient
How Does BW running on RDBMS differ from BW running on HANA ?

Customer value of SAP BW powered by

SAP HANA
 Excellent query performance
for improved decision making
SAP NetWeaver BW SAP BW on HANA
 Performance boost for Data Load processes
for decreased data latency
Data Modeling Data Modeling
 Accelerated In-Memory planning capabilities

Orchestration
Orchestration

for faster planning scenarios

Process
Process

Planning Planning  Flexible combine EDW with HANA-native

data for real-time insights and decision making
OLAP OLAP  Data persistency layers are cut off and
reduced administration efforts
Data  Simplified data modeling and remodeling
Data Management
Management

Data intensive functions are pushed down

any NLS from BW to HANA
Push Down
Data Schema
RDBMS &
HANA as the Primary Database for BW and
Data
Foundation for new Applications
SAP
IQ-NLS
Traditional Stack HANA Stack

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 6

Differentiations: Multi Temperature Data Approach

• Data is read and/or written frequently

hot • In HANA DB, Full In-memory handling
• Accessibility: No restrictions, all features available

• Infrequent access HANA Dynamic Tiering (fka Extended Storage)

warm • In HANA DB, on disk, Main memory for caching and processing
• Accessibility: No restrictions, all features available

• Sporadic access BW-NLS Management for read-only data

cold • Not stored in HANA DB; stored in SAP IQ Near-line DB
• Accessibility: Restricted to BW-NLS capabilities, read-only

Providing lower TCO by optimized data volume management

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 7

Introducing SAP HANA dynamic tiering
Map data priorities to data management

Hot data All in one Hot Store

Warm data database Classical HANA tables
 Primary data image in memory
 DB algorithms optimized for in-memory data
SAP HANA Database  Persistence on disk to guarantee durability
Dynamic Tiering
Warm Store
Hot Store Warm Store
Extended Tables
Primary Image Cache /
in memory RAM Processing  Primary data image on disk
 Data processing using algorithms optimized for disk-
based data
Primary  Main memory used for caching and processing.
Durability Image on
disk

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 8

BW powered by HANA and Sybase IQ
Near-Line Storage (NLS) Architecture - Overview

An SAP - owned BW NLS implementation for

Architecture Sybase IQ offers a fully integrated solution for
BI Clients
combined primary & secondary database
NLS management:
SAP Netweaver BW 7.3x
Improvements for
combined • Primary Database (preferable SAP HANA)
Transient
MultiProvider
Provider
InfoCube/DSO
DB handling • active data, maximum performance,
coming soon!! transactional changes, high frequent
(SP09) SDK
Near-Line access, very short MTTR*

NLS-
• Secondary Database (always SAP IQ)
BW NLS4IQ
Partner
SAP Native • Slave (detouchable without breaking
OEM
SAP the whole system), non-active data,
HANA lower performance accepted, only bulk
loads at scheduled PITs*, entirely read-
only, low frequent access, longer MTTR
acceptable
SAP owned alternative to
existing NLS-Partner Solutions *) MTTR – Mean Time To Recover
PIT - Point in Time

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 9

Decision Matrix Extended Table vs. NLS on InfoProvider Types

Supported
InfoProvider Standard
Types per
InfoCube w/o DSO PSA
DSO
‚temperature‘

not not
HOT recommended recommended
HANA
currently not currently not
WARM supported supported

not supported
COLD Archive
by SAP (PBS)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 10

NLS Scenario – Design and Runtime Aspects

NLS - Interface Data Archiving

BW
DAP – Design Time Process (DAP)
InfoProvider • Define partitioning criteria
Younger … • Generate DAP
Mass NLS
Q1/2011
Maintenance Tool
Q4/2010 for DAP – Scheduling / Implementation
DAPs, Variants, Monitoring / Run-Time:
Q3/2010 • Describe partition
Process Chains
to be extracted
available
• Generate request
(SP08) • InfoProvider Q2/2010
Manage Menu Q1/2010
• Process Chain
• Archive / Extract (DAP menu,
Process Chain
DB DBMS • Restore (DAP menu)
Add. Features
• Query access to NLS
• DTP access to NLS
• Look up during Transforms

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 11

Example for 3(4)-fold Archiving Process on single Object

Data Relocation to NLS takes place in three phases

Copy Phase:
All data of a request is copied in individually committed packages to SAP IQ
• Data is pulled from BW database
• Data is transferred across the network and loaded into NLS using IQ client side
load
• After the last data package is loaded the final transaction commit id is retrieved
• IQ Backup Event is Triggered to capture all the data that was archived

Verification Phase:
Load Performance
Technical key of archived records is retrieved and verified for completeness
Improvements under
continous
Deletion Phase:
investigation … Throughput
Before data is deleted from primary database
(still potential for Up to
• Deletion proceeds only if the latest backup includes all the data from the copy
improvements)
phase 250 Mio.
• Data is deleted from the BW database and Archived Data in NLS becomes active rows/h
• IQ Backup Event is Triggered to capture the end state of the NLS database (100 GByte/h)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 12

Main Principle: Relocation - Cold NLS Data is write-protected …

BW NLS Implementation
Update
InfoProvider capabilities
Newer… coming soon!!
Q1/2011 NLS - Interface (‚Straggler
Q4/2010 Management‘)
Locked
Q3/2010 (SP12)
for Q3/2010
update Q2/2010
Q1/2010
Updates for archived
records in the period
Q1 to Q3 2010 can be
Source managed using DTP
RDBMS
Error Handling after
NLS reload

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 13

BW NLS in action - Runtime Experience
… read NLS as well

NLS ‚Latency
Factor‘
Further NLS Read around
Performance 20
Improvements
based on
HANA SDA
available
(SP08)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 14

SAP NetWeaver BW
Product Roadmap Focusing – BW NLS Implementation for Sybase IQ
Recent achievements Upcoming planned Future innovations
release
Implementation specifications
 Optimized performance for NLS read purposes
(HANA SDA with BW 7.4 SP05) …… …..
Supported Platforms Server/Client
 Sybase IQ 16.0 SP4
 Sybase IQ ODBC NLS client for BW AppServer
Windows on x64 64bit, Linux (x86_64 64bit),
AIX 64bit, HP-UX, Solaris, OS/400

Error DTP Handling in case of NLS caused lock

violations
 Support for Standard DSO with
BW 7.3 SP11 (resp. Note 1931784)

IQ Backup Automation
 Event trigger for incremental backup in IQ during data
relocation to NLS (BW 7.0 SP32)

BW NLS Downport to BW 7.0

 BW 7.0 SP32 (CW2/2014)
 BW 7.0 SP28 with note 1858550

Today Planned Innovations Future Direction

Q3 2014 (until Q4/ 2014 BW 7.4 SP08/09) (beyond BW 7.4 SP 9, from Q1 2015 on)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 17

DMM202
SAP BW 7.40 Near-Line Storage for SAP IQ

SAP BW NLS Implementation of HANA Smart Data Access (SDA)

HANA SDA improvements automatically boost NLS Query performance
NLS SDA Implementation details
 SAP HANA Smart Data Access and SAP BW NLS
Enhanced Business Flexibility by providing “the
logical EDW”
Query
Data Federation in diverse EDW landscapes
 Smart data access – read access to relational and non-relational
sources via ODBC
BW Virtualization Layer
Composite Provider, Open ODS View
 Supports data location agnostic development
 No special syntax to access heterogeneous data sources
 BW based Analytic Services on external data
 Implemented in BW on HANA for NLS in IQ
HANA Tables Virtual Tables Scenario
 Make other DWHs transparent to HANA
HANA Smart Data Access Layer
 Non-disruptive evolution from virtual table to persistent structure by
establishing ETL without major effort
 Consolidating / rationalizing the DWH landscape
 Consumption of HANA datamart scenarios from second HANA
Hadoop database
Oracle
 Optimization of NLS Queries with filters on Navigational
MSSQL IQ Attributes
Teradata SAP HANA ASE

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 19

HANA Smart Data Access for BW NLS with SAP IQ
BW7.40 SP08 (RTC Sept 2014)

Analytic Query
VirtualTable can be used in
BW HANA CalcView
NLS-Split • Initial version w/ HANA SP07
• Full plan optimizations w/ HANA SP08

HANA API API

BW Query execution can push OLAP
CalcScenario
calculations to HANA (Restricted
KeyFigures, Hierarchies, …)
Master
Facts (online) VIRTUAL_TABLE
data
Further improvement of NLS Query
performance due to optimized access

Facts (nearline)

SAP IQ
© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 20
Runtime Example from E-Procurement without NLS

62 ms runtime
without NLS
(please keep in mind)

Query Result:
Drill down
NavAttr Region

277 ms
drill down into
NavAttr Region
(please keep in mind)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 21

Runtime Example from E-Procurement with 40% NLS plus SDA

Less than 500

ms runtime
with 40% NLS
(factor 8 vs. w/o NLS)
669 ms
drill down into Identic network
NavAttr Region traffic for
(factor 2.5 vs. w/o NLS) NavAttr Region

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 22

Runtime Example from E-Procurement with 40% NLS w/o SDA

Much more
traffic and
runtime
w/o HANA SDA

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 23

Runtime Example against InfoCube with over 40 Mio. Records

Runtime
without
NLS

Runtime with
100% NLS

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 24

BW NLS data for External HANA Views
BW7.40 SP08 (RTC Sep 2014)

BI Client (native SQL)

Generated HANA Views for InfoProvider
HANA (new with BW7.4 SP05)
Generated HANA View for
HANA Views can (optionally) include NLS
BW InfoProvider
part as UNION between online and
optional nearline facts
CalcScenario
NLS part is available for external
Master consumption
Facts (online) VIRTUAL_TABLE
data
NLS part is always accessed

Facts (nearline)

SAP IQ
© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 25
Example from Flight Bookings with NLS using HANA CalcView&SQL

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 26

Eclipse based HANA Studio: BW CompositeProvider Settings

 NLS is only supported for new Eclipse

based CompositeProviders
Near-line Access with BW 7.40
Switched on
 In BW 7.30 and for old Composite
Providers in general there is no NLS
support!

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 27

DMM202
SAP BW 7.40 Near-Line Storage for SAP IQ

SAP BW NLS – Further Roadmap and Outlook

Closing the gaps to existing NLS solutions from our NLS Development Partners
SAP NetWeaver BW
Product Roadmap Focusing – BW NLS Implementation for Sybase IQ
Recent achievements Upcoming planned release Future innovations
BW NLS Enhancements
Implementation specifications
(HANA SP08/09 + BW SP08)
 Optimized performance for NLS read purposes
(HANA DA with BW 7.4 SP05)  Further improvement of NLS Query performance due to SDA
optimizations
(SDA Virtual Tables can be used in HANA CalcViews )
Supported Platforms Server/Client
 Generated HANA models of an InfoProvider support NLS
 Sybase IQ 16.0 SP3
 Sybase IQ ODBC NLS client for BW AppServer  Extended Pruning for time characteristics
Windows on x64 64bit, Linux (x86_64 64bit),  NLS support for BW Inventory Cubes
AIX 64bit, HP-UX, Solaris, OS/400
BW NLS Implementation Support
Error DTP Handling in case of NLS caused lock  Mass maintenance Support (BW 7.40 SP 8) for generating
violations DAPs, DAP Variants, Process Chains
 Support for Standard DSO with
BW 7.3 SP11 (resp. Note 1931784) Further improvements on Administration/Management
Aspects
IQ Backup Automation  DBA Cockpit Integration for Sybase IQ
 Event trigger for incremental backup in IQ during data (BW 7.40 SP 8 + downports up to NW 7.02)
relocation to NLS (BW 7.0 SP32) - General monitoring capabilities for attached Sybase IQ DBs
- Near-line-aware data volume statistics for BW InfoProvider
BW NLS Downport to BW 7.0  New Near-line connection Mode Options
 BW 7.0 SP32 (CW2/2014) - System Cloning with shared usage of NLS data
 BW 7.0 SP28 with note 1858550 - improve operations if near-line data is unavailable

Today Planned Innovations Future Direction

Q2 2014 (until Q4/ 2014 BW 7.4 SP08/09) (beyond BW 7.4 SP 9)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 29

NLS Pruning Optimizations

• Query processing on InfoProviders should be optimized in a way that meta data on existing NLS
partitions is leveraged in order to avoid unnecessary access to NLS partitions of this InfoProvider in
an early stage of query processing.

• Pruning not only based on primary time characteristic (PTC) but also on additional time
characteristics (OTC) which are consistent (e.g. 0CALDAY/0CALMONTH). A time shift index
provides PTC/OTC intervals in order to support pruning more effectively.

• The index information needs to be calculated for each new partition (i.e. archiving request) moved
to Near-line Storage at the time of relocation. The time shifts will be calculated on archiving request
level between the end of the request’s copy phase and the beginning of its deletion phase.

• Time shift Index based pruning has to be activated by maintaining the RSADMIN parameter
‘RSDA_TIMESHIFT_INDEX’
• ‚ACT‘ or ‚PRD‘ - Index maintenance + query pruning switched on
• ‚INA‘ - only index maintenance

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 30

Interval Pruning on Other Time Characteristics
Example with finer granularity
PTC SELECT MIN(OTC), MAX(OTC) … GROUP BY PTC

floor()

Example from Flight Booking scenario

 The time shift analysis for Booking Date and Flight
Date clearly shows the following
PTC Primaryinterdependencies
Time Characteristic
„PTC = OTC“ OTC Other Time Characteristic
 Flight Date is always ≥ Booking Date
 Flight Date is always ≤ToBooking
be storedDate + 6OTC:
for each months
• Lower adjustment in days
ceil()  Knowing about this time shift corridor allows a proper
• Upper adjustment in days
pruning for query selections based on the Flight Date,
when the NLS Partitioning criteria is Booking Date
OTC

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 31

NLS Support for Inventory Cubes – Solution Details

• SAP BW 7.4 SP08 + HANA SP08 + SAP IQ 16.0 + Remote Source (SDA) configured for NLS Connection

• The allowed characteristics for time slices in the Data Archiving Process shall be only the most refined common time
reference characteristic. Users can only enter relatively time conditions such as ‘Only Data Records Older than’ to ensure
that the resulting Archiving interval is consistently with an lower boundary equal ‘0’ without gaps. This ensures the best
query performance.

• Archiving of uncompressed data is not possible for Non-Cumulative Cubes.

• During the execution of a query the inventory-handling in the data-manager checks whether there is an adjoined near-line-
storage and if the time-interval, requested by the query has an overlap with the overall time slice partition in the near-line-
storage (Partition Pruning)

• If so a query with the same restriction as the ‘delta’-query of the standard

inventory-handling is sent to the archive, too.
BW on HANA
only!!
• The records, which are returned from the archive, are added to the deltas
read from the standard cube and then the further inventory-processing works as usual

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 32

Inventory InfoProvider - Theory
Near-line Online

goods receipt

goods issue

Calculated during query

runtime
Delta query

t1 t2 persistent

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 33

NLS Solution for Inventory InfoCubes
Fully supported with BW 7.4 SP08

Restrictions in the DAP (Design time)

 The only allowed time characteristics in the
Data Archiving Process is the most refined
common time reference characteristic (default value)
 Users can only enter relatively time conditions

Precondition for Archiving

 Data has to be compressed before archiving

Execution of inventory query

(with existing Near-line-Storage)
 Partition Pruning in data manager
BW on HANA
 Delta Query on near-line Storage
only!!

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 34

DAP Mass Maintenance

• Technical Content available for Query Selection statistics and Data Size Growth overview

• DAP Mass Maintenance can be found as Housekeeping Task for Data Aging in the Administration area

• The worklist of Data Archiving Processes can be filled using an example InfoProvider, InfoArea selection, and
Naming patterns

• Central input supported for properties regarding NLS Connection, Time Slice Characteristic, and Partition
Characteristic

• Central creation of DAP Variants based on existing DAP worklist, explicit Variant settings, and predefined
Variant patterns

• Central creation of ProcessChain based on existing DAP Variants

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 35

Technical Content for Selection and Data Size Growth Statistics

Preparation
Implementation Guide provides
Technical Content for
 Selection Statistics
 InfoProvider Maintainance

Selection Statistics
Content queries show
 Growth per InfoProvider
 Query statistics per InfoProvider and
periods
over time

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 36

Mass Maintenance of DAPs

Administration
Housekeeping tasks
 Data Aging

Worklist of data archiving

processes

Can be filled using

 Example InfoProvider
 InfoArea selection
 Naming patterns

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 37

DAP Worklist: Maintain Properties

Central Input for Properties

regarding
 NLS Connection
 Time slice Characteristic
 Partition Characteristic

Update Worklist of data archiving

processes

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 38

Mass Creation of DAP Variants

Central creation of DAP Variants

based on
 Existing DAP worklist
 Explicit Variant settings
 Predefined Variant patterns

Central mass generation of DAP

Variants

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 39

Data Aging Administration: DAP ProcessChain Generation

Central creation of ProcessChain

based on
 Existing DAP Variants

Maintenance and enhancement of

generated ProcessChain possible

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 40

NLS Support within DBA Cockpit

• The DBA Cockpit is a platform-independent tool for monitoring and administering your database. The
advantage of using the DBA Cockpit is that it has been specifically designed for the SAP system landscape,
and supports adapting databases for the workload of SAP systems. All important performance tuning,
monitoring, and administration tasks are available in a single transaction

• The dashboard shows a summary of different metrics. Dashboards are defined by a number of plugins, where
each plugin offers an overview of a certain aspect of IQ monitoring. You get information about properties of the
server, database, and connections.

• The dashboard displays when you switch from the System Landscape tab to the Database tab of the DBA
Cockpit.

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 41

Dashboard - Multiple Gadgets giving System Status Overview

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 42

InfoProvider
Details on Online and Near-line storage

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 43

Overview Screen – Transaction RSDANLCON

NLS
Improvements for
combined
DB handling
coming soon!!
(SP09)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 44

Near-line Connection – New property ‚Connection Mode‘ I

In order to improve operations of Near-line Storage if near-line data is unavailable, a new Connection
Mode property of a Near-line Connection has been introduced:

• ' ' Productive Mode

Recommended mode for normal (i.e. productive) operation. Query processing will terminate with an error
message due to the unavailability of the Near-line Storage unless a pruning mechanism could exclude Near-
line access in advance.

• 'E' Emergency Mode

This mode could be set in case of a temporarily unavailable Near-line Storage. In this mode queries via the
Data Manager will always return an empty result set from every Near-line Provider assigned to this Near-line
Connection accompanied with a warning message send to the frontend. All other operations like relocation of
data to or from Near-line Storage (e.g. Archive/Restore), data extraction from Near-line Storage (for ETL
processes within BW), or creation of new or alteration of existing Near-line Tables, will be terminated with an
error message without a call to the appropriate Near-line Interface Method. This mode might be used if the
Near-line Storage has gone down unintendedly or needs to be shut down intendedly due to maintenance
reasons.

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 45

Near-line Connection Modes in typical System Cloning Scenarios

… will be
System End of life of integrated into
Copy system Post Copy
Automation
(PCA)
BW old
Connetion Mode Connetion Mode ‚Read only‘
‚Productive‘

IQ NLS
Connetion Mode ‚Read only‘ Connetion Mode ‚Productive‘

BW new

Time

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 46

Near-line Connection – New property ‚Connection Mode‘ II

• 'R' Read-only Mode

This is the same as Productive Mode, with the exception that no operations are passed to the Near-line
Storage which would change its state with respect to the BW system. I.e. there are no DDL (creating,
altering, and dropping Near-line Tables) and DML (creating or altering Near-line Requests, or opening a
writer handle) commands allowed on the Near-line Interface level. If a BW process initiates such a command
it will receive an exception with an appropriate error message that this command is not allowed in this mode.
This mode could be used in case of a system migration, if the Near-line Storage shall be used from the
original system and the copied system as well. In this case this connection mode needs to be set in both
systems, of course.
• 'O' Off Mode
This mode shall be used if a Near-line Storage has been permanently detached from the BW System, but
active Data Archiving Processes (DAP) still persist within the BW System. All DDL and DML commands will
return an error in this mode with one exception: DROP_TABLE errors will be ignored to allow deletion of the
DAPs without the necessity to reattach the Near-line Storage back to the BW System. Every read access to
Near-line data will return an empty result set anticipating deletion of all Near-line Requests and their
associated data.

• …
© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 47
SAP NetWeaver BW
Product Roadmap Focusing – BW NLS Implementation for Sybase IQ
Recent achievements Upcoming planned release Future innovations
BW NLS Enhancements Data Management Aspects
Implementation specifications
(HANA SP08/09 + BW SP08)  Including BW/ IQ NLS in High Availability concept
 Optimized performance for NLS read purposes
(HANA DA with BW 7.4 SP05)  NLS support for BW Inventory Cubes  Migration from former NLS Partner solutions to
 Further improvement of NLS Query performance SAP IQ NLS
Supported Platforms Server/Client due to SDA optimizations  Sybase IQ Schema Copy
(SDA Virtual Tables can be used in  Supporting Sybase IQ Read-only DB spaces
 Sybase IQ 16.0 SP3
HANA CalcViews )
 Sybase IQ ODBC NLS client for BW AppServer  Supporting exceptional insert, updates, and deletes
 Generated HANA models of an InfoProvider to write-protected Near-line Partitions (BW SP12)
Windows on x64 64bit, Linux (x86_64 64bit),
support NLS
AIX 64bit, HP-UX, Solaris, OS/400
 Extended Pruning for time characteristics
Error DTP Handling in case of NLS caused lock New type of NLS Tables
violations BW NLS Implementation Support  Supporting Advanced DataStore Object (ADSO)
 Support for Standard DSO with  Mass maintenance Support (BW 7.40 SP 8) for
BW 7.3 SP11 (resp. Note 1931784) generating DAPs, DAP Variants, Process Chains
Cloud support for NLS
IQ Backup Automation Further improvements on Administration/  NLSaaS in the HEC
 Event trigger for incremental backup in IQ during data Management Aspects
relocation to NLS (BW 7.0 SP32)  DBA Cockpit Integration for Sybase IQ
(BW 7.40 SP 8 + downports up to NW 7.02)
- General monitoring capabilities for attached
BW NLS Downport to BW 7.0
Sybase IQ
 BW 7.0 SP32 (CW2/2014)
DBs
 BW 7.0 SP28 with note 1858550

Today Planned Innovations Future Direction

Q3 2014 (until Q4/ 2014 BW 7.4 SP08/09) (beyond BW 7.4 SP09)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 48

NLS Update Support by ‚Straggler‘ Management

• Data in Near-line Storage is organized in semantic, age-related partitions (typically time-slices)

• InfoProvider data in Near-line Storage will stay partition-wise read-only per default.

• Read-only restriction could be temporarily suspended for exceptional update operations (including INSERT,
UPDATE, and DELETE operations on logical row level)

• Update operations per table will happen in bulk mode with a frequency not essentially higher than 1/day (i.e.
update will be an exceptional case)

• Update operations can be mapped to classical Near-line Interface with backward compatible extensions (see
SAP Note 1025273 "Near-line interface: Technical documentation" for details about the Near-line
Interface).

• Analytic Query access, ETL processes , and Lookups on object level shall rely on a consistent data view
between online data and nearline data.

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 49

 Collect „Straggler“ into Delta Requests (pre/post activation)
Semantic key
(e.g. year) • Rows from nearline storage which shall be
Actual
Activation updated or deleted by an activation process
will be merged
Pre- Post- back into the activate table
prior to the actual activation
locked

Online Table
Activation
2012 O11 R12.11 N13.11

del • The optimized activation process operates on

ins+ the online part of the active table only (as it
would do without the existence of a nearline
locked

ins+
2011 O4 R5.4 N6.4 R8.4 N10.4 R14.4 N15.4 O16
ins- storage)

• Rows associated to nearlined data ranges

locked

2010 O1 R2.1 N3.1 R7.1 remaining

N9.1 within the active table after
activation are merged back into nearline
storage. Technical key
1 2 3 4 5 6 7 8 9 10 11 12 13 …
Technical partition
dbspace
© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 50
Automated ‘Straggler’ Management - Example

BW NLS Implementation
InfoProvider
Newer…
Q1/2011
Q4/2010 NLS – Relocation
Daily loads create
Locked
Q3/2010 (on a quarterly basis)
Error DTPs from for Q3/2010
time to time … update Q2/2010
Q1/2010
Weekly jobs

Source 1. Process Error DTPs

RDBMS
2. Start Activation with
‘Straggler’ management

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 51

Key Points to take home …

1. Near-line Storage helps to reduce TCO and gives seamless access to massive
amounts of aged resp. inactive data to reveal trends, patterns, correlations
2. With its columnar store and compression mechanisms, SAP IQ ideally complements
SAP HANA as NLS store
3. Finally NLS also supports any kind of inventory handling in BW and opens up a new
category of high volume InfoProviders for NLS based volume optimization
4. SAP HANAs Smart Data Access capabilities guarantee optimized performance for NLS
query access even in case of complex filter criteria.
5. The read-only restriction for NLS data can now be temporarily suspended for
exceptional update operations.
6. With the latest enhancements to their NLS solution SAP competes against all existing
NLS solutions of our certified NLS Development Partners.
SAP NLS is optimized for BW on HANA.

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 52

SAP BW Near-Line Storage RDS
Solution scope covered
The following diagram shows the scope and process flow of the solution:
 Install and configure SAP Sybase IQ
 Configure Near-Line storage
 Implement data aging strategy in SAP NetWeaver BW for historical data.

Update support
package to SAP BW
7.3x or higher
Archive historical
DAP … N
DAP 1 data to near-line
storage
Configure SAP NW BW Implementation of data
Install/configure to use SAP Sybase IQ aging strategy in SAP NW
SAP Sybase IQ as near-line storage BW for historical data
Delete already archived
data from online SAP
NetWeaver BW system

Process Repeatable result

DAP = Data archiving process

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 53

Services Scope Overview
Go live in as little as 12 weeks based on implementation options

Service Name: Rapid deployment of SAP NetWeaver BW Near-Line Storage

Implementation Duration: 12 Weeks*
Core Offerings
Implementation of SAP NetWeaver BW Near-Line Storage
 Identification of objects to be archived
 Installation and Configuration of SAP Sybase IQ database
 Installation of SAP Sybase IQ Client and configuration of
SAP NetWeaver BW to Near-Line Storage
 Create up to 10 DAPs (Data Archiving Processes)
 Create up to 2 Process Chains
 Adjust settings for up to 10 Queries and 2 multiproviders
Optional Task**
 Support Package Update

A special step-by-step guide describes each activity

during the deployment
* Based on scope
** Provided as option and impacts overall efforts of the service
© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 54
SAP BW NLS RDS Implementation Partners

• Former SAP BW NLS Development Partners also

offer implementation services for SAP BW Near-line
rapid-deployment solution

• Partner specific add-ons available on top

(e.g. NLS storage management, migration options)

• … have a look into SAP Store for more details under

store.sap.com

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 55

Thank you

Contact information:

Rainer Uhle, Dr. Peter Zimmerer

SAP EDW (BW / HANA), SAP SE

© 2014 SAP SE or an SAP affiliate company. All rights reserved.

Further Information

SAP Public Web

http://scn.sap.com/docs/DOC-54468
http://scn.sap.com/docs/DOC-7856

SAP Education and Certification Opportunities

www.sap.com/education

Watch SAP d-code Online

www.sapcode.com/online

Watch on YOUTUBE
http://www.youtube.com/watch?v=0V4cwZFTlYE

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 57

 UPCOMING:
openSAP SAP Business Warehouse
powered by SAP HANA course
 4 Weeks of videos, demonstrations and
explanation focused on SAP BW 7.4
powered by SAP HANA

 Free Participation &

Record of Achievement

 https://open.sap.com/courses/bwhana1/

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 59

Feedback
Please complete your session evaluation for
DMM202

Thanks for attending this SAP TechEd && d-code session.

©©2014
2014SAP
SAPSE
SEororananSAP
SAPaffiliate
affiliatecompany.
company.AllAllrights
rightsreserved.
reserved. Public 6060
© 2014 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an
SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE
(or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark
information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its
affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or
SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing
herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or
release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future
developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any
reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-looking
statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue
reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.

© 2014 SAP SE or an SAP affiliate company. All rights reserved. Public 61