Scribd
Upload
13 views

Slides

The document discusses data flows, task chains, and SQL views in SAP DataSphere. It covers how to use the Data Flow Editor to load and transform data from various sources. It also describes how to create task chains to orchestrate and schedule multiple tasks, and how to persist SQL views to materialize query results for improved performance.

Uploaded by

Sampathkumar Samadhi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
13 views

Slides

The document discusses data flows, task chains, and SQL views in SAP DataSphere. It covers how to use the Data Flow Editor to load and transform data from various sources. It also describes how to create task chains to orchestrate and schedule multiple tasks, and how to persist SQL views to materialize query results for improved performance.

Uploaded by

Sampathkumar Samadhi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 15

Week 1: Introduction and Data Modeling

Unit 5: Data Flows, Task Chains, and SQL Views


Data flows, task chains, and SQL views
Your task

▪ The story needs to be enhanced such that it also


shows the Top Sales Person per region
▪ This data is available in two remote tables that must
be brought into SAP Datasphere using data flows so
that all the data can be joined and stored in one local
table in the space
▪ To ensure that data loading is a systematic process,
you must start creating a sequence of loading tasks
in a task chain

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2


Data flows, task chains, and SQL views
Data flows

▪ Data integration from variety of data sources


▪ Easy-to-use data flow modeling experience for
ETL requirements
▪ Load and combine data from different data
sources, both SAP and non-SAP
▪ Use standard transformation capabilities and
scripting for advanced requirements
▪ Apply a generic filter-based delta or select only
specific columns to reduce the amount of data
that needs to be transferred
▪ Dynamic memory allocation and auto restart
option

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3


Data flows, task chains, and SQL views
Script operator in data flows

Standard Transformations Scripting


▪ Combine data sets with no-code operators for Projection, ▪ Advanced transformation requirements like
Aggregation, Join, Filter, Union, Add Table extraction of text
▪ Data source can be tables, ABAP CDS views, OData, ▪ Embedded scripting editor in data flow modeler
remote files (JSON/JSONL, CSV, ORC, EXCEL, or ▪ Support of standard Python 3 scripting language
PARQUET)
▪ Target mode: Append/Upsert, Truncate, Delete
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4
Data flows, task chains, and SQL views
Data flows

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5


Data flows, task chains, and SQL views
Task chains

▪ Group multiple tasks into a task chain and run


them once manually, or periodically through a
schedule
▪ Tasks chain scheduling may include execution of
– Remote table replication
– View persistency, and
– Data flow runs
▪ Serial processing
▪ Customizable email notification of success and/or
failure of entire task chains

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6


Data flows, task chains, and SQL views
Task chains execution

Execute task chains directly from the Run and/or schedule task chain execution
task chain modeling screen from the Data Integration Monitor like other
replication tasks

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7


Data flows, task chains, and SQL views
Task chains

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8


Data flows, task chains, and SQL views
SQL View Builder

▪ Create SQL views to query sources in powerful


SQL editor along with drag-and-drop support
▪ Two ways to compose the SQL view
– SQL: writing a standard SQL query using
Select statements and operators such as Join
and Union
– SQLScript: to produce a table function
▪ Subset of SQL syntax supported by
SAP HANA Cloud

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9


Data flows, task chains, and SQL views
View persistence

▪ Graphical and SQL views can be configured as


persisted views to materialize the output result
▪ Improve performance for views with heavy
transformations or slow remote sources
▪ Result set is persisted similar to remote table
snapshots or data flow target tables
▪ Store only required data instead of full 1:1 remote
table replication
▪ Monitoring, scheduling, and view analyzer access
via the Data Integration Monitor
▪ Supports partitioning and partition-wise refresh
▪ Can be used in task chains (optional)

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 10


Data flows, task chains, and SQL views
View persistence

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 11


Data flows, task chains, and SQL views
Associate Employees dimension to dataset

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 12


Data flows, task chains, and SQL views
What you have learned in this unit

▪ How to use the Data Flow Editor


▪ How to use the script operator for data flows
▪ How to use task chains
▪ How to persist a view

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 13


Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2023 SAP SE or an SAP affiliate company. All rights reserved.


No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.

You might also like