SAP Expert Lesson:

How to Replicate Data from

SAP to a Data Lake in a
Compliant and Secure
Manner

Karsten Haldenwang, SAP

November 06, 2024

INTERNAL – SAP and Customers Only

SAP Expert Lessons – Webinar Series

Streamlining Workforce Planning with SAP Analytics Cloud

Planning
Wednesday, October 30, 2024, 2:00 PM SGT

How to Replicate Data from SAP to a Data Lake in a Compliant and Secure Manner Data &
Wednesday, November 06, 2024, 2:00 PM SGT Analytics

Unlocking SAP Datasphere: Expert Insights on Leading Practices Data &

Wednesday, November 13, 2024, 2:00 PM SGT Analytics

Elevate Your Marketing Game: Planning for ROI with SAP Analytics Cloud
Planning
Wednesday, November 20, 2024, 2:00 PM SGT

SAP BW Modernization: Move to SAP Datasphere BW Bridge Data &

Wednesday, November 27, 2024, 2:00 PM SGT Analytics

INTERNAL – SAP and Customers Only 2

Overview of SAP Expert Lessons

Streamlining Workforce Planning with SAP Analytics Cloud

Planning
Wednesday, October 30, 2024, 2:00 PM SGT

How to Replicate Data from SAP to a Data Lake in a Compliant and Secure Manner Data &
Wednesday, November 06, 2024, 2:00 PM SGT Analytics

Unlocking SAP Datasphere: Expert Insights on Leading Practices Data &

Wednesday, November 13, 2024, 2:00 PM SGT Analytics

Elevate Your Marketing Game: Planning for ROI with SAP Analytics Cloud
Planning
Wednesday, November 20, 2024, 2:00 PM SGT

SAP BW Modernization: Move to SAP Datasphere BW Bridge Data &

Wednesday, November 27, 2024, 2:00 PM SGT Analytics

INTERNAL – SAP and Customers Only 3

Typical Scenarios for Open Integration with Third Party Solutions

Data Replication Out Data Federation In Data Consumption From

Move data from ECC or S/4 to Access non-SAP Data through Access SAP Datasphere from
Hyperscaler i.e.: SAP Datasphere i.e. 3rd Party Tools i.e.:
• AWS S3, • Big Query Data Virtually as • MS Power BI
Remote Table
• Azure Data Lake • Python Notebooks
• GCP Big Query

SAP Datasphere BI Tools AI Tools

SAP S/4HANA
Data Lake
SAP BW/4HANA SAP Datasphere
Data lake

INTERNAL – SAP and Customers Only 4

Open Integration

SAP Analytics Cloud

SAP Datasphere 3rd Party BI, ML & AI

Data builder
ODATA
Clients, tools, apps
Data access control
ODBC/JDBC
Facts
Remote table
Dimensions
Table Analytic Data Lake
Texts model
Intelligent
lookup Hierarchies

Replication Flow
Files (i.e. Parquet, CSV, JSON)

SAP S/4HANA

Public 5
Typical Scenarios for Open Integration with Third Party Solutions

Data Replication Out Data Federation In Data Consumption from

Move data from ECC or S/4 to Access non-SAP Data through Access SAP Datasphere from
Hyperscaler i.e.: SAP Datasphere i.e. 3rd Party Tools i.e.:
• AWS S3, • Big Query Data Virtually as • MS Power BI
Remote Table
• Azure Data Lake • Python Notebooks
• GCP Big Query

SAP Datasphere BI Tools AI Tools

SAP S/4HANA
Data Lake
SAP S/4HANA SAP Datasphere
Data Lake

INTERNAL – SAP and Customers Only 6

Quick Poll

• Question 1: What are your

SAP Source Systems?

• Question 2: What are your

Target Data Lake Systems?

INTERNAL – SAP and Customers Only 7

Considerations for Change Data Capture from S/4HANA and ECC
SAP Datasphere

SAP S/4HANA Data Lake

SAP Datasphere
Delta Queue
Local table
• Guaranteed E2E data delivery
CDS Views ODP ODQ • Automatic delta handling
• Minimize impact on S/4HANA
Replication Flow workload
• SLT License included
ABAP Tables SLT Server

Public 8
ODP is a SAP Internal Capability
Unpermitted Usage of ODP Data Replication APIs

The usage of the RFC modules outside of SAP

software is not supported by SAP.
This was previously documented via SAP Note
3255746. However, due to ongoing
unsupported use, there are several negative
consequences, such as missing support and
security concerns.
To mitigate these consequences, we SAP
advises customers and partners that usage of
the RFC modules is not permitted and the
ODP APIs are limited to use solely between
SAP systems.
SAP Note 3255746 has been updated to
reflect this advice.

Public 9
Considerations for Change Data Capture from S/4HANA and ECC
3rd Party

SAP S/4HANA 3rd Party ETL Tools Data Lake

Watermarking Watermarking
ETL Pipeline • DIY delta pointer (not all SAP
tables have change date fields)
• No “delete” records
oData
oData
SAP Datasphere • Not suitable for mass data
Delta Queue transfer
Local table
• Guaranteed E2E data delivery
CDS Views ODP ODQ • Automatic delta handling
• Minimize impact on S/4HANA
Replication Flow workload
• SLT License included
ABAP Tables SLT Server
• Requires SLT Enterprise
License
SLT SDK • Costly in SAP RISE
3rd Party Extension • Only table replication

Public 10
Considerations for Change Data Capture from SAP BW/4HANA
3rd Party

SAP BW/4HANA Data Lake

SAP Datasphere
Delta Queue

• Guaranteed E2E data delivery

BW Objects ODP ODQ • Automatic delta handling
• Minimize impact on S/4HANA
Replication Flow workload
• SLT License included

Public 11
Replication Flow
Easy SAP Data Replication to Data Lake

Replication flow

Replication flow
Mass data replication
1…N replications
Possibility to replicate parallelized data
from supported source systems into
supported target systems
Source system Outbound target

Integrated monitoring SAP S/4HANA SAP Datasphere

Overview of monitoring features within
SAP Business Suite SAP HANA
integrated monitoring application
SAP HANA SAP HANA data lake files

SAP BW + SAP BW/4HANA Amazon Simple Storage Service (S3)

Capture changes
SAP Datasphere Google Cloud Storage + Big Query
Support for initial data replications
together with delta† replications MS Azure SQL MS Azure Data Lake Storage Gen2

Apache Kafka

Public † Restrictions to delta capture apply: more information in the online documentation. 12
Detailed Overview of ABAP Integration
Support of ABAP Source Systems for Replication Flows

CDS Views*
SAP S/4HANA Cloud

SAP S/4HANA on Prem CDS Views*

>= 1909 with new TCI

SAP S/4HANA on Prem ODP

>= 2022

SAP S/4HANA on Prem ODP

>= 1909 & < 2022 with new TCI

SAP S/4HANA on Prem Tables Tables

>= 1610
Dedicated SLT**
Tables
SAP S/4HANA Foundation
with DMIS
DMIS 2018 SP06 & new TCI
DMIS 2020 SP03
Tables
SAP Datasphere
or higher SP level
Tables Tables
SAP Business Suite (>= 4.6C)
with DMIS
Replication Flow
SAP S/4HANA Foundation Tables
>= DMIS2020 SP03 or higher

SAP Business Suite (Netweaver = 7.52) Tables

>= DMIS 2018 SP06 & new TCI or higher

SAP Business Suite & SAP Business Warehouse (BW >= 7.4X & ODP 2) ODP
using DMIS 2011, DMIS 2018 or DMIS 2020 depending on NW Release

ODP
SAP System (BW < 7.4X & ODP 2)
SAP System (BW >= 7.4X & ODP 2) ODP
ODP using DMIS 2011, 2018 or 2020
SAP S/4HANA on Prem < 1909

* Extraction enabled CDS Views ** Considering SLT version dependency

Public 13
 Q& A

INTERNAL – SAP and Customers Only 14

Thank you.
Contact information:

Karsten Haldenwang
[email protected]

© 2024 SAP SE or an SAP affiliate company. All rights reserved. See Legal Notice on www.sap.com/legal-notice for use terms, disclaimers, disclosures, or restrictions related to this material.