Data Tiering Optimization for SAP BW/4HANA

Gordon Witzel
Product Management, SAP Data Warehousing
May, 2019
PUBLIC
Disclaimer

The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP.
Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service
or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or any related
document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms directions and
functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this
presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentation is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP
assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross
negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from
expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates,
and they should not be relied upon in making purchasing decisions.

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Agenda

Introduction and the evolution of SAP BW

Overview of Data Tiering Optimization

Conversion from NLS to DTO (cold store)

Roadmap

Demo

Data Tiering Optimization - What’s new?

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Introduction and the evolution of SAP BW
SAP Data Warehousing - Statement of direction

Establish SAP Data Warehousing as the leading data

warehousing platform in order to meet future demands:
SAP Data Warehousing
 Cloud-, on-premises and hybrid deployments

 Logical Data Warehouse for dynamically changing system

landscapes

 Integration of any data types and Big Data technologies

SAP Data Warehouse Cloud
 Scale out to high volumes and data lakes

 Industry data models for rapid implementation

SAP HANA

SAP SQL
SAP BW/4HANA
Data Warehousing

ON-PREMISES HYBRID CLOUD

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5

SAP Data Warehouse Cloud - Get started

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

 SAP BW/4HANA – The Evolution From SAP BW/4HANA 1.0 to 2.0

 The next generation data warehouse  Enhanced Data Tiering Optimization  Unified UI for all SAP BW/4HANA  SAP's vision for a modern
(DTO) options to reduce TCO Modeling Aspects (DTP and packaged data warehousing
 Builds on the innovations of SAP BW
Transformation Editor) solution
powered by SAP HANA  Enhanced Master Data Loads
 SAP BW/4HANA Web Cockpit as  Simplified in every aspect of data
 Leaves behind the legacy of SAP BW  Tight integration with SAP Data Hub
single entry point for administration warehousing
on any DB
 Analytical Engine Improvements and monitoring
 Data Tiering Optimization (DTO) to  Smart integration of all business
manage hot, warm and cold data tiers  New Storage Options for Data applications and modern data
Tiering Optimization (DTO) sources

2016 2017 2018 2019

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

SAP Business Warehouse - Today

16,000+
Total Number of SAP BW Customers

SAP BW 7.5 SAP BW 7.0 to 7.4

SAP HANA Other Database SAP HANA Other Database

1,500+ 2,000+ 3,500+ 9,000+

Prime Candidates for
Prime Candidates for Probably Remote or Probably In-place
Remote or Shell
In-place Conversion Shell Conversion Conversion
Conversion

Lots of interest and opportunities for data tiering projects!

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

Overview of Data Tiering Optimization
13 Years of BW Nearline Storage / 3 Years BW/4HANA / 2 Years DTO
Celebrating 1.000 customers in Feb 2018
1.151
March 2018
DTO Hadoop

May 2017
DTO released

March 2019
DTO Vora
Jul 2010 Aug 2016
Sybase acqu. BW/4 Launch

Mar 2008 Feb 2013

PBS CBW IQ SAP IQ NLS
Sep 2011 Jul 2016
Spring 2006 Hadoop NLS
BW on HANA
PBS CBW NLS 382
Spring 2006
1st NLS Customer

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 10

 Overview - Data Tiering Options for HANA Applications

BW on HANA Suite on HANA

Native HANA
BW/4HANA S/4HANA

In-Memory NVM NVM NVM

Extension Extension
Extension Node Node* Node
HANA
Database Data Aging
Paged Attributes/NSE

Extended Store Dynamic

Tiering

NLS,
SAP IQ DTO Archiving
External
Store Data Hub Tiering, NLS,
Hadoop DWF/DLM DTO Archiving

Datahub/Vora DTO

* requires HANA 2 SPS03

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 11
Overview - Concept

One concept for hot, warm and cold data based on HANA Technology
 Offered for Advanced DataStore Objects
 Based on HANA partitioning
 Introduces a temperature on partition level determining the Storage Tier
– Hot: Ordinary HANA indexserver nodes
– Warm: HANA extension nodes based on scale-out technology with relaxed core/memory and
memory/disk ratios
– Cold: External storage accessible via Smart Data Access (SDA) for query access (DQL) and
data manipulation (DML)

Easy and central definition and implementation

 Temperature Schema and Partitions defined in Advanced DataStore Object only
 No additional modeling of Data Archiving Processes

Displacement of data as simple and periodic housekeeping activity

 Single data tiering optimization job that periodically moves data to defined storages
 No process chain or process variant modeling
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 12
Overview – User Interface Perspective

Advanced DataStore Object Data Tiering Optimization Physical Storage

Meta Data Temperature Definition

Standard Tier
(HANA)

Via ABAP runtime or HANA DDO

NEW: Partition Temperature
Maintenance 
Plan
NEW: Temperature
Schema  Extension Tier
(HANA Extension Node)

Via ABAP SQL runtime using SDA

NEW: Data Tiering Actual

Optimization Job  External Tier
SAP IQ or Hadoop / Vora
Partitioning Characteristic
& Partition Ranges 
Changes to Partitioning Schema Changes to Temperature (only)
→ Remodeling (Transport!) → Data Tiering Optimization (Local Housekeeping)
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 13
Conversion from NLS to DTO (cold store)
SAP BW/4HANA Data Tiering Optimization (DTO) – Cold Store
Conversion approaches for obsolete objects using Nearline Storage (NLS)

SAP BW InfoCube / Classic DataStore

7.X Object with NLS

yes NLS Partner no

Solution

No conversion tooling planned

from SAP. Please check with InfoCube / Classic DataStore Object with SAP BW NLS
SAP BW your NLS Partner Solution.
7.5 1 2

ADSO with SAP BW ADSO with SAP BW

SAP BW/4HANA No conversion needed –
NLS Hadoop NLS IQ
1 see SAP Note 2404842
3
2 Available with the SAP
BW/4HANA Conversion Tools

Planned for a future version of

ADSO with SAP
3 SAP BW/4HANA BW/4HANA DTO

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 15

SAP BW/4HANA Roadmap
SAP BW/4HANA Roadmap – Planned Innovations

Planned Planned
for 2020 for 2021

 Data Tiering Optimization (DTO)  Data Tiering Optimization (DTO)

− Updates to cold data (external storage) − DTO automation – rules and statistics
− SAP HANA Native Storage Extension (NSE) support for based
warm data − Further cloud storage options for cold data
based on SAP Vora

Planned
for 2022

 Data Tiering Optimization (DTO)

− Machine Learning based automation

This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any
reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent.

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 17

Demo
SAP BW/4HANA 2.0

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 18

Data Tiering Optimization - What’s new?
Data Tiering Optimization (DTO)
New storage options and Performance Enhancements

 Support for cold storage in the

Hadoop File System (HDFS)
 Support for cold storage in SAP
HANA Vora (disk engine)*
 Support for multiple extension nodes
 No additional requirements to
Hadoop compared to classical NLS
(see note 2363218 for details) *
 Parallelization for data movement on
aDSO (adjustment run and/or
partition level)

*Validation with upcoming Vora release still pending (see note 2608405 for updates)

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 20

Data Tiering Optimization (DTO)
Enhanced Partition Split Capabilites

Equidistant Split for

 Date type
 Time Characteristics
o 0DATE
o 0CALDAY
o 0CALWEEK
o 0CALMONTH
o 0CALQUARTER
o 0CALYEAR
o 0FISCPER
o 0FISCYEAR

Equal Unit Split for

 Integer types
 Decimal types

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 21

Data Tiering Optimization (DTO)
Process Types

 Automated adjustment of DTO temperature

change – New Process Type "Adjust Data
Tiering” for Process Chains
 Housekeeping – deleting partitions from Cold
Store (new temperature type "delete")

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 22

Data Tiering Optimization (DTO) - Automation
API for Temperature Maintenance and Adjustment

Feature

 API‘s to implement customer specific automated

temperature adjustments for DTO

Typical use case

 Temperature adjustment by ABAP program using API

RSO_ADSO_DTO_API_SET_TEMPS embedded in
process chain with subsequent execution of the actual
temperature change via process chain type DTO
Adjustment

 For more extensive automation additional DTO API‘s are

available

o RSO_ADSO_DTO_API_GET_INFO
Reads the partition temperatures for a list of DataStore Objects
o RSO_ADSO_DTO_API_EXECUTE
Executes the DTO adjustment run immediately
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 23
Data Tiering Optimization (DTO) - Administration
Deletion support for Cold Store

Feature Unlock data range

 New data temperature Delete for data deletion from the cold Hot (partition)

store (as housekeeping task for “end of life” data)

Details
 Separation of „logical“ and „physical“ deletion
o Temperature “Delete” = partition in cold store is removed logically
from the cold store = data is flagged for deletion and will no longer get
considered during reporting
o Additional physical deletion is possible on object level using the
process type “Cleanup Archive” or as manual activity in the
Temperature Maintenance Warm Unlock data range
(partition)

Considerations
 Only transitions from Cold to Deleted are supported, no direct
transition from Hot/Warm to Deleted
o Deletion from Hot / Warm Store is independent from this feature and
can get achieved via request deletion (rollback of data loads) or
selective deletion (business deletion of specific data ranges in Hot /
Warm)
 Successful transition from Cold to Deleted can‘t get reverted
Cold Delete
 Unlocking of Cold or Deleted partitions can get achieved by Housekeeping
assigning the temperature Hot / Warm to the respective partition

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 24

Data Tiering Optimization (DTO) - Performance and Monitoring
Enhanced Data Volume Statistics

 Data volume information to monitor the size of SAP

BW/4HANA persistency objects including:
o Table size in SAP HANA and the cold store
o Raw size in SAP HANA and the cold store
o Number of records in SAP HANA and in the cold store
o Archiving rate (percentage share of archived data)

 Based on CDS technology for easier and simplified

operations
o Installation, loading and activation is NOT required
o Real-time access
o Analyze the entire volume of data in the system at the current point in
time

 Cube View Rv_C_HanaNlsDbStat based on CDS View

Rv_C_HanaNlsDbStatQuery*

*For more information please review the SAP BW/4HANA Help page(s)

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 25

Data Tiering Optimization (DTO) – Administration
SAP BW/4HANA Web Cockpit

New Features Overview SAP BW/4HANA Web Cockpit

 Simplified Search
 Personalization, Subscription & Notifications
 Enhanced Master Data Maintenance
 Data Volume & Data Selection Statistics
 Execute and Schedule Remodeling Requests
 Data Tiering Summary & Maintenance
(partition management)
 Data Protection Management (Worklist &
Notifications)
 Analysis Authorization Editor
 External SAP Hana View Management
 Enhanced Process Chain Maintenance (InfoArea)
 Direct File Upload to Data Store Objects

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 26

 SAP BW/4HANA

Home Page Community / Product Page Documentation Product Roadmap

https://sap.com/bw4hana https://sap.com/bw4hana10 https://help.sap.com/bw4hana10 https://sap.com/roadmaps

Get Started Watch

Free Learning @ openSAP, Free Trial Demos & Tutorials,
Get Help YouTube Channel,
FAQ, Q&A, Community Wiki, Support, Services, Availability SAP HANA Academy

Read & Learn More Share & Follow

SAP Blogs, Community Blogs, Learning Journey #BW4HANA,
Transition from SAP BW #TheFutureofDW
Blog, SAP Activate Roadmap, SAP Readiness Check
Training & Certification Related Solutions
https://training.sap.com/ SAP HANA, SAP Data Hub, SAP Analytics Cloud
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 27
SAP BW/4HANA Data Tiering Optimization (DTO)
Important Information - Set Up and Installation

General Information
 Blog SAP BW/4HANA Data Tiering Optimization
 SAP Note 2296290 - New Sizing Report for BW/4HANA

Warm Store with SAP HANA Extension Node

 SAP Note 2343647 How-To: Configuring SAP HANA for the BW Extension Node
 SAP Note 2453736 How-To: Configuring SAP HANA for SAP BW Extension Node in SAP HANA 2.0
 SAP Note 2644438 SAP HANA Extension Node – Master Release Note
 SAP HANA Extension Node – Technical Overview presentation

© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 28

Thank you.
Gordon Witzel
Product Management SAP Data Warehousing
SAP SE
[email protected]

Landing Page: http://sap.com/bw4hana

Community Page: http://sap.com/bw4hana10
Follow us

www.sap.com/contactsap

© 2019 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/copyright for additional trademark information and notices.