Week 3: What Else You Should Know About

Unit 3: Further Data Integration Options and Open

SQL Schema
Further data integration options and open SQL schema
Your task

▪ In weeks 1 and 2 you learned about connectivity

options with SAP Datasphere, including uploading
flat files.
▪ In this unit, we will
– look at the other data integration options
– look at the capabilities of open SQL schema
– learn the basics about HDI container-based
development

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Further data integration options and open SQL schema
Different ways to connect data to SAP Datasphere

Built-In
SAP External
Connectors Datasphere Tooling

Data Open
Marketplace Connectors

BW Bridge

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Further data integration options and open SQL schema
Open for virtual access and persistence

Virtual Access Persistence Data Flow External Tools

Remote table federation Remote table replication Batch loads and Integrate with all data
Week 1 Unit 3/4 Week 1 Unit 4 transformations sources
▪ Leave data in the source ▪ Real-time replication
system and access or snapshots using single ▪ Combine structured and ▪ Allow external data
remotely in real time when entities semi-structured data while movement tools like SAP
needed defining ETL processes Data Services, SAP Data
Replication flow This Unit
Intelligence, Open
▪ No upfront data movement ▪ Advanced transformation
▪ Replication with multiple Connectors, SnapLogic,
capabilities leveraging
▪ Federation is supported entities and flexible targets Precog, Adverity, etc. to
Python 3
across various sources bring data into the system
View persistence Week 1 Unit 5
and hyperscalers ▪ Schedule in task chains using SQL interfaces
▪ Materialize view output Week 1 Unit 5 This Unit
results in a stable
persistence
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4
Further data integration options and open SQL schema
Built-in connectors and external tooling overview

SAP Databases & Hyperscaler & External

Applications Generic Connections Cloud Apps Tool Support

SAP S/4HANA SAP S/4HANA Cloud SAP HANA On-Prem & Cloud Google Cloud Storage Google BigQuery SAP Data Intelligence* SAP Data Services*

SAP ERP SAP ABAP Oracle Microsoft SQL Server Azure SQL Database Azure Blob Storage SAP HANA Smart Data Integration*

SAP BW/4HANA Model Transfer Generic JDBC Generic OData Azure Data Lake Store Gen1 SAP Landscape Transformation*

SAP BW SAP HANA Data Lake Generic SFTP Local CSV File Azure Data Lake Store Gen2 Adverity APOS* Datazeit*

SAP HANA, Data Lake Files Generic Cloud Data Integration Amazon S3 Amazon Athena Informatica* Precog Snaplogic*

SAP SuccessFactors SAP Fieldglass Amazon Redshift HDFS

SAP Marketing Cloud Open Connectors

SAP Help: Connection Overview Available Partner * No dedicated connection tile

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5
Further data integration options and open SQL schema
Open Connectors

Use the broad Open Connectors

connectivity available from SAP Business
Technology Platform directly within your
SAP Datasphere space
▪ REST interfaces to over 150 API providers
▪ Standardized authentication, content, error
handling, pagination, bulk and HTTP
structures
▪ Find out more on SAP Open Connectors
and the SAP Datasphere documentation

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Further data integration options and open SQL schema
Replication flow

Enhancement of data replication use cases through a cloud-based data replication tool
▪ Model data replication from a selected source to a selected target
▪ Focus on 1:1 replication with simple projections and filters
▪ Integrated user interface in Data Builder
▪ Integrated monitoring features in Data Integration Monitor
▪ Support initial load as well as delta load capabilities

Replication Flow

Replication Flow

1…N Tasks

Source System Target System

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Further data integration options and open SQL schema
Replication flow connectivity

Source Systems SAP S/4HANA SAP S/4HANA Cloud

▪ Realize data replication via DB triggers and
SAP Business Suite / SLT SAP BW & BW/4HANA
logging tables from SAP and non-SAP
sources SAP HANA Cloud SAP HANA On-Premise
▪ Leveraging initial load and initial + delta
MS Azure SQL
capabilities

Target Systems
SAP Datasphere
▪ Replicate data 1:1 with simple projections
and filters via a simplified user interface SAP HANA On-Premise
inside the Data Builder application
SAP HANA Cloud
▪ Monitoring of replication flows integrated in
flow monitoring inside the Data Integration SAP HANA Data Lake Files
Monitor

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

Further data integration options and open SQL schema
Federation and replication options

FEDERATED or REPLICATED REPLICATED REPLICATED

Remote Table Local Table Local Table Local Table

SDI SDA Replication Flow Data Flow

Cloud
dpAgent CC Direct Direct CC Direct
Connector

Remote Source Remote Source Remote Source Local Source

Characteristics
Source Entities ▪ Single source entity ▪ Multiple entities from one source ▪ Multiple sources to single target entity
Transformation ▪ Row filter, Only column filter ▪ Row filter, Projection ▪ Row filter, Full transformation
capabilities
Partitioning ▪ Partitioning ▪ No partitioning ▪ No partitioning
Replication Type ▪ Real-time replication, Snapshot ▪ Batch delta replication, Snapshot ▪ Pseudo Delta, Substitution parameter,
replication, Transparent switch replication, Replication only Replication only
between replication and federation
Others ▪ Resilient replication, Pick up
replication after interruption

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9

Further data integration options and open SQL schema
Open SQL schema for data integration via SQL API

▪ Create a database user in your space to get an

open SQL schema
▪ Provide SQL endpoint to dedicated database
schema
▪ Enabling external tools access to write data to an
open SQL schema of a space
▪ Connect via an external party data integration tool
such as SAP Data Services, SAP Data Intelligence,
or partner tooling certified to connect to SAP HANA
and SAP HANA Cloud incl. ODBC/JDBC
▪ Consume data models from your space in the open
SQL schema

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 10

Further data integration options and open SQL schema
Open SQL schema for data modeling via SQL API

▪ External tools can create artifacts in an SAP Datasphere

open SQL schema of a space External Tools
SAP Analytics Cloud 3rd Party Apps
▪ Connect via external party SQL client like SAP
SAP Tools
Database Explorer directly from Space Management
▪ Database Explorer MARKETING
▪ Usage of SAP HANA SQL capability (DDL & DML) ▪ Business FINANCE
Application Studio
– Create views, tables ▪ Data Services
Open SQL
Schema 1 SALES

– Define and execute stored procedures ▪ Data Intelligence …

Business Models
Open SQL
– Leverage data anonymization and data masking Schema n Data Flows & Models
Other Tools
– Automated Predictive Library (APL) and Predictive ▪ SQL Editor HDI
1
Analysis Library (PAL), if enabled in space ▪ Data Modeling
Container
…
– Use data science tooling like Jupyter Notebook ▪ Data Integration &
HDI Connections
ETL Tools
Container n
▪ Start SAP Database Explorer from Space ▪ Others…
SAP HANA Cloud
Management

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 11

Further data integration options and open SQL schema
Embedded machine learning and advanced analytics

▪ Data science enrichment in SAP Datasphere

without data extraction
SAP Datasphere
▪ Leveraging SAP HANA Cloud data science External Tools
capabilities SAP Analytics Cloud 3rd party Apps

− Exposing the data as SAP HANA data frame in SAP Tools

▪ Database Explorer MARKETING
Python
▪ Business FINANCE
− Remote use of SAP HANA Cloud machine Application Studio
SALES
▪ Data Services
learning, spatial, text, and graph functions in
▪ Data Intelligence Open SQL Schema
Business Models
Python or R
Data Flows & Models
▪ Use your existing Python or R environment to Other Tools
HDI-Container

trigger calculations in SAP Datasphere, to train ▪ SQL Editor Predictive Analysis

Library (PAL)
the ML model based on persisted and managed ▪ Data Modeling
▪ Data Integration Automated Predictive
data in the HDI container or open SQL schema, ▪ Data Science
Library (APL) Connections
and to store the ML prediction result in a table in Tools Python
Spatial, Text & Graph
(like Jupyter
the HDI container or open SQL schema Notebooks or
Databricks) and R
SAP HANA Cloud
▪ Ensure that the SAP HANA Cloud script server is
enabled on your tenant
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 12
Further data integration options and open SQL schema
SAP HANA Deployment Infrastructure

▪ Re-use existing models from your SAP Web IDE SAP Datasphere
or SAP Business Application Studio
SAP Analytics Cloud 3rd party Apps
development
▪ Deploy the SAP HANA Cloud Deployment
MARKETING
Infrastructure (HDI) containers in the underlying
FINANCE
SAP HANA Cloud database SALES

▪ Access HDI containers in the Data Builder and Business Models

create additional models with the possibility to SAP BPT Tools
HDI Data Flows & Models
combine both ▪ DB Explorer Container 1
▪
▪ Allow the space schema models and data sets
Business
Application Studio HDI
… n
to be consumed in your HDI containers Container

Connections

SAP HANA Cloud

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 13

Further data integration options and open SQL schema
What you have learned in this unit

▪ More data integration options offered by the solution

▪ What the open SQL schema is about and how you
can use it for
– data integration,
– data modeling, and
– to leverage the embedded machine learning
capabilities
▪ Basic usage of HDI containers

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 14

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2023 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.