Sap BW and Etl: A Comprehensive Guide To SAP BW S ETL Capabilities

Download as pdf or txt
Download as pdf or txt
You are on page 1of 104

SAP BW and ETL:

A comprehensive guide to
SAP BW s ETL capabilities

SAP AG

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 2

The SAP BW Enterprise Datawarehouse


Provide each organizational unit or better each role with the needed reliable,
consolidated, integrated, actual and historical information
e.g.
at business unit level provide a:
local/ subsidary view
regional view
global view
at headquarter level
across business units
provide
regional view
global view

SAP AG 2002, Title of Presentation, Speaker Name 3

Overview Integration and Migration of Diverse


Data Sources
Heterogeneous system landscape with a longterm SAP BW focus
Portal
FE

BEx

DW

SAP BW

MW

DB

Oracle DW

R/3

Extraction

BW-ETL

Mi
gr
at
io
n

Ascential

mySAP

Oracle

SAP AG 2002, Title of Presentation, Speaker Name 4

BO

Integration

XI

ETL
ERP MDM

PlumTree CP

SAP EP

MS SQL

Vitria
Informatica
PS

JDE
Informix

MS AS

SAS

Siebel
NCR Teradata

The Corporate Information Factory (CIF)

Copyright 1999 by billinmon.com LLC, all rights reserved

SAP AG 2002, Title of Presentation, Speaker Name 5

Business Roles and Related Content are Key

BW

SAP AG 2002, Title of Presentation, Speaker Name 6

Open Data Warehouse Architecture

SAP AG 2002, Title of Presentation, Speaker Name 7

The ETL Part of SAP BW

DB connect for legacy


data
Open to ETL- tools
Close integration of
Ascential DataStage
Application level ETL
from SAP systems
Flat File Interface
Open for XML Standards
...

SAP AG 2002, Title of Presentation, Speaker Name 8

Agenda
BW Overview
BW Extraction from mySAP Components and
BW Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary

SAP AG 2002, Title of Presentation, Speaker Name 9

The key question is ...

What does
SAP BW
know
about
my
business?

Everything!!!
If you run

mySAP ERP
SAP AG 2002, Title of Presentation, Speaker Name 10

BW Business Content
The BW Business Content is an entire
business model that knows all relevant
Business Processes in mySAP Components

Terms
Entities
Relationships
Processes
Roles

SAP AG 2002, Title of Presentation, Speaker Name 11

BW Service-API
BW Service-API provides
a framework to enable first class data replication based on standard
data extractors that encapsulate the application knowhow
parallel processing
sophisticated delta handling

Just the model is not


enough!
generic data extraction with delta handling
Powerfull Extractors
online access via remote cube technology
have to
populate your model with data.

BW Service-API available as PlugIn for


R/3 Systems
BW itself and therefore also in APO
mySAP ERP Components
Industry Solutions

SAP AG 2002, Title of Presentation, Speaker Name 12

Types of Extractors in mySAP ERP Components


BW Extractors

Application Specific Extractors

FI

Generic Extractor

CRM

HR

APO

Customer
Tables

Logistics
Business Content DataSources
Build in Extractors
High coverage (Applications, Industries)
Transaction - and Master Data
Ready to run
Reduce implementation efforts and costs
Delta capable
SAP AG 2002, Title of Presentation, Speaker Name 13

Creation of own DataSources


Possibility to generate own
DataSources in Application
Generic extractor tool for customer
specific tables or applications
Delta capable

Example Logistics Extraction with Direct Delta


Data Flow Schematic for Logistics Extraction with Direct Delta
R/3
Document 1

BW

V1-Update

Document 2

V1

Document
Tables

Delta
Request

Document n V1

Motivation:
Guaranteed Serialization during
document extraction

Extraction Module
with V1 Update

Reading and processing of all


existing entries for a DataSource

Transfer
to BW

Delta Queue for SAP BW


BW (PSA,
ODS, Cube)

Time
SAP AG 2002, Title of Presentation, Speaker Name 14

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 15

The key question is ...

How does
SAP BW
communicate
its
datamodel
to the
world?

We are going
along with

XMI
standards!

SAP AG 2002, Title of Presentation, Speaker Name 16

Exporting BW Metadata
AllFusion Erwin Data Modeler

Do we sing the same song, when it comes to


Warehouse Metadata Interchange?

SAP AG 2002, Title of Presentation, Speaker Name 17

Output of an XML-Export for BW metadata


This is our XMI
format
for an
InfoObject
description

OMG's XML-based Metadata Interchange specification (XMI)


(OMG - Object Management Group)

SAP AG 2002, Title of Presentation, Speaker Name 18

Ascential DataStages
XML PlugIns can help
to handle SAPs
XMI formats when a mass
input of metadata is needed
for BW.

SAP AG 2002, Title of Presentation, Speaker Name 19

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 20

The key question is ...

What about
operational data
in xml formats?
Can BW handle it?

... our
SOAP RFC
Service
will help ...
SAP AG 2002, Title of Presentation, Speaker Name 21

Scenario for Integrating XML Data Sources


Push of document-type data in delta queue of corresponding
DataSource within the BW server
BW

InfoSource

External application
document-type
document-type
data
data
CRM

SOAP
SOAP
rfc
rfc
Service
Service
push
XML data

BW
DataSource

Delta

mass data

Delta queue
(non XML format)

SAP AG 2002, Title of Presentation, Speaker Name 22

DB/UDC
DB/UDC
Connect
Connect

DataSource

pull

Init
Full

SOAP Body for HTTP Post Request


Example for HTTP/SOAP body (DataSource Test)
<?xml version="1.0" ?>
<SOAP:Envelope xmlns:SOAP="http://schemas.xmlsoap.org/soap/envelope/">
<SOAP:Body>
<rfc:_-BIC_-QITEST_RFC xmlns:rfc="urn:sap-com:document:sap:rfc:functions">
<DATASOURCE>TEST</DATASOURCE>
<DATA>
<item>
<VENDOR>Smith</VENDOR>
<MATERIAL>soap</MATERIAL>
<DATUM>20010815</DATUM>
<UNIT>KG</UNIT>
<AMOUNT>1.25</AMOUNT>
</item>
<item>
<VENDOR>Fritz</VENDOR>
<MATERIAL>body lotion</MATERIAL>
<DATUM>20010816</DATUM>
<UNIT>ml</UNIT>
<AMOUNT>150</AMOUNT>
</item>
</DATA>
</rfc:_-BIC_-QITEST_RFC>
</SOAP:Body>
</SOAP:Envelope>

SAP AG 2002, Title of Presentation, Speaker Name 23

Data Flow: Generic Staging

BW Server

SOAP compliant
HTTP Service

Country
DE

City
Hamburg

XML parsing
Delta queue
Transformation

PSA

<Country>DE</Country>
<City>Hamburg</City>

External Application

SAP AG 2002, Title of Presentation, Speaker Name 24

ODS, InfoCubes,
Master Data

Pushing Data into the Queue via HTTP


<?xml version="1.0" ?>
<SOAP:Envelope xmlns:SOAP="http://schemas.xmlsoap.org/soap/envelope/">
<SOAP:Body>
Name of funktion unit to be processed
<rfc:_-BIC_-QIURGETXML_RFC xmlns:rfc="urn:sap-com:document:sap:rfc:functions">
<DATASOURCE>URGETXML</DATASOURCE>
<DATA>
<item>
<VENDOR>Otto</VENDOR>
<MATERIAL>Seife</MATERIAL>
<DATUM>20010104</DATUM>
<UNIT>KG</UNIT>
<AMOUNT>1234567</AMOUNT>
</item>
<item>
<VENDOR>Fritz</VENDOR>
<MATERIAL>Rasierwasser</MATERIAL>
<DATUM>20010213</DATUM>
<UNIT>ml</UNIT>
<AMOUNT>100</AMOUNT>
</item>
</DATA>
</rfc:_-BIC_-QIURGETXML_RFC>
</SOAP:Body>
</SOAP:Envelope>

http request for SOAP service

SAP AG 2002, Title of Presentation, Speaker Name 25

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
BW Data Base Connect

Universal Data Integration with BW 3.5


BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 26

The key question is ...

Does SAP BW
provide
connectivity
to
additional
databases?

Of course!
Our
DB Connect
will handle this.

SAP AG 2002, Title of Presentation, Speaker Name 27

DB Connect (BW3.0B) - Scenario

SAP BW
Foreign
Application

DB-Connect

MS SQL
DataBase

NT

ORACLE
DataBase
Unix
Purchasing

A purchasing application runs on a legacy system based on an ORACLE database.


To analyze the data from the purchasing application, the data needs to be
loaded into the BW System (possibly installed on a different database, e.g. MS SQL-Server).
DB-Connect can be used to connect the DBMS of of the purchasing application and extract
data from tables or views.
SAP AG 2002, Title of Presentation, Speaker Name 28

DBConnect as part of the Open Data Warehouse


Architecture

SAP AG 2002, Title of Presentation, Speaker Name 29

BW

DB Connect Architecture
SAP BW 3.0
Application Server

SAP DB
MultiConnect
DB Connect
Implementation

SAP DBSL for


ORA

SAP DBSL for


MSSQL

DB-Client for
ORA

DB-Client for
MSSQL

Oracle
Database Management System

SAP AG 2002, Title of Presentation, Speaker Name 30

SAP Basis 6.10 / 6.20

SAP DB-Interface

MSSQL
Database Management System

DB Connect - Architecture
SAP BW
External
Database Server
Database
Database
Catalog
Catalog

DataSource

Design
Time

List of Tables + Views


Field Details

InfoSource

Vie

a
wD

ta

RunTime
Data

Staging
Engine

Direct access to external RDBMS


Read metadata and prductive data
Access to DBMSs supported by
mySAP Technology
SAP AG 2002, Title of Presentation, Speaker Name 31

SAP AG 2002, Title of Presentation, Speaker Name 32

Taking over Metadata


via DB Connect

SAP AG 2002, Title of Presentation, Speaker Name 33

Based on the generated datasources for external DB views/tables


InfoSources in BW can be established as usual.
Dataflow is now possible!

SAP AG 2002, Title of Presentation, Speaker Name 34

DB Connect Supported Source DBMS


DB Connect enables data to be extracted from the following database
systems supported by mySAP technology
DB2 (OS390)
DB4 (AS400)
DB6 (UDB)
Informix
MS SQL Server 7.0 & MS SQL Server 2000
Oracle 8.1.7.3+
SAP DB

SAP AG 2002, Title of Presentation, Speaker Name 35

DB Connect - Prerequisites
SAP BW 3.0B
Table names and field names have to be in capital letters
Usage of views on top of tables is recommended
The SAP specific part of the database interface, the DBSL
(database shared library) for the source DBMS, has to be installed
on the application server. It can be downloaded from the SAP
Service Marketplace. It is licensed and delivered to customers
solely for use as part of the SAP BW.
The database specific DB-Client for the source DBMS has to be
installed on the application server. It has to be licensed by the
customer from the DB vendor and is delivered as part of the
database access license.

SAP AG 2002, Title of Presentation, Speaker Name 36

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 37

The key question is ...

If your DB Connect
only supports ODBC and
is that much restricted
to a small number of
DB platforms,
how do you solve
connectivity problems
to the rest of the
universe?

SAP AG 2002, Title of Presentation, Speaker Name 38

Universe is the right


cue here!
Universal Data
Integration is our most
recent approach in this
challenging area.

BI Java Integration
Key Objectives

SAP NetWeaver

Openness
Integration of diverse data sources

People Integration

Visualization of SAP BW and non SAP


BW data via the SAP BW Business
Explorer BI Suite and SAP Enterprise
Portal

Portal

Collaboration

Information Integration
Business
Intelligence

Life Cycle Management

Composite Application Framework

Multi-Channel Access

Knowledge
Management

Master Data Management

Process Integration
Integration
Broker

Business Process
Management

ABAP

SAP AG 2002, Title of Presentation, Speaker Name 39

WebSphere

Connectivity: JCA
Portability and Synergies with other J2EE
standards

Model Driven
Model, Code, Documentation in synch
Code generation based on JMI templates

andOS
OS Abstraction
Abstraction
DBDBand

.NET

Metadata (Models, Access API):CWM, JMI

Architecture and Development Process

Application Platform
J2EE

Standards Based

Overview Java Industry Momentum

BC
D
J
177 vers
Dri ble
ila
ava

SAP AG 2002, Title of Presentation, Speaker Name 40

ADABAS, Clipper, DB2,


dBase, FoxPro, IBM AS/400,
Informix, Ingres,
InterBase, LDAP,
MS Access, News Server,
OS/390, Paradox,
Redbrick, SAS,
Sybase, Teradata,
Text (CSV, Tab separated etc.),
TinySQL, VSAM, XML.

SAP NetWeaver - A Broader View of Data Acquisition


SAP BW

BAPI

DB
Connect

File

http/
SOAP

UDC

SAP XI
A

Universal Data Connector


Integrates data for analysis and enables a complete business view
Persistent and transient data handling possible
Java based Adaptors for different drivers, providers, and protocols available
JDBC
OLE DB for OLAP
XML for Analysis
SAP AG 2002, Title of Presentation, Speaker Name 41

Overview - BI Java Connectors

Connectors for diverse data sources


Relational
BI JDBC Connector
JDBC is the standard Java API for RDBMS
Connectivity to over 170 JDBC drivers, supporting data sources such as: Teradata,
Oracle, MS SQL Server, MS Access, DB2, Excel, text files (CSV)

BI SAP Query Connector


Connectivity to SAP operational applications
Ad-Hoc and Operational Reporting for mySAP components

OLAP
BI ODBO Connector
Established industry-standard OLAP API for the Windows platform
Connectivity to MS Analysis Services, SAS

BI XMLA Connector
Web services-based, platform independent access to OLAP providers
Connectivity to MS Analysis Services, Hyperion, MicroStrategy, BW 3.x,
Business Objects

SAP AG 2002, Title of Presentation, Speaker Name 42

Overview Universal Data Integration with BW 3.5


SAP Web Application
Server

Enterprise
Portal

BI Java SDK
(BW 3.5)

2. BI Java SDK:
Java API, Examples
Documentation

Business
Explorer

BW OLAP
BW Staging
UD Connect
(BW 3.5)

mySAP

BW
R/3

SAP AG 2002, Title of Presentation, Speaker Name 43

Connectors:
- JDBC, XMLA,ODBO
- SAP Query

1. SAP BW Implementation

Any Non-SAP Source:


Teradata, XLS, MSAS,

Overview Universal Data Integration


SAP Web Application
Server

Enterprise
Portal

Business
Explorer

Universal Data Integration


BI Java SDK
(BW 3.5)

BI GUI Machine
PlugIn (tbd.)

3. BI Java SDK:
Java API, Examples
Documentation
2. Rapid BI Application
Development Tool for the
Enterprise Portal

BEx Adapter
(BW 4.0)

BW OLAP
1. SAP BW Implementation

BW Staging
UD Connect
(BW 3.5)

mySAP

BW
R/3

SAP AG 2002, Title of Presentation, Speaker Name 44

Connectors:
- JDBC, XMLA,ODBO
- SAP Query

Any Non-SAP Source:


Teradata, XLS, MSAS,

BW 3.5

UDC - Architecture

InfoSource
Generic DataSource
with
Rules
FM

J2EE Server 6.40

DB

WAS 6.40

BI Java Integration ...

Universal Data Connector


JDBC Connector

XMLA Connector

ODBO Connector

SAP Query Connector

JDBC Driver

http-URL, port

ODBO Prov.

SAP RFC, API, BAPI

RDBMS

SAP AG 2002, Title of Presentation, Speaker Name 45

MS AS, SAS, Hyperion

BW

R/3

UDC - Integration Scenario with JDBC Back End

SAP WAS 6.40

SAP BW 3.5

SAP Enterprise Portal 6.0


Web Application
Query
RemoteCube
InfoSource
Generic DataSource
with
Rules
FM
Connect information to specific
source systems:
URL, IP-Address
DB User, Authorities
DB Schema

J2EE Server 6.40

UD Connect
JDBC Connector
JDBC Driver

SAP AG 2002, Title of Presentation, Speaker Name 46

File
Syst.

DB

Supporting JDBC

Installation of drivers (JDBC,


ODBO) or XMLA components
Provided by the vendor
Purchased by the customer

UDC - Integration Scenario with JDBC Front End

SAP WAS 6.40

SAP BW 3.5

SAP Enterprise Portal 6.0


Web Application
Query
RemoteCube
InfoSource
Generic DataSource
with
Rules
FM

Query definition based on Remote


Cube Handling
Remote Cube can be part of an
MultiProvider
Transactional data is not
persistently stored in SAP BW

J2EE Server 6.40

BI Java Connectors
JDBC Connector
JDBC Driver

SAP AG 2002, Title of Presentation, Speaker Name 47

File
Syst.

DB

Supporting JDBC

UDC - Integration Scenario with JDBC -

SAP WAS 6.40

SAP BW 3.5

SAP Enterprise Portal 6.0


Web Application
Query
RemoteCube
InfoSource
Generic DataSource
Rules
with
FM

Modeling Steps in SAP BW


Selection of table or view from
remote DB
Typesave Field Mapping
Transformation in both directions
is possible

J2EE Server 6.40

BI Java Connectors
JDBC Connector
JDBC Driver

SAP AG 2002, Title of Presentation, Speaker Name 48

File
Syst.

DB

Supporting JDBC

SAP WAS 6.40

SAP BW 3.5

UDC Master Data Handling

Master Data
EDW Layer
InfoPackage
InfoSource
Generic DataSource
with
Rules
FM

Master data can be extracted and


persistently stored in SAP BW via
the same channel
This is recommended for
performance reasons and
navigational aspects in the Query

J2EE Server 6.40


BI Java Integration ...

BI Java Connectors
JDBC Connector
JDBC Driver

SAP AG 2002, Title of Presentation, Speaker Name 49

File
Syst.

DB

Supporting JDBC

UDC Details DataSource Wizard


BW InfoSource

Connect Info
Fields of table
ITEM
in ext. DB
Man. Mapping

Autom. Mapping
Generate DS

SAP AG 2002, Title of Presentation, Speaker Name 50

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 51

The key question is ...

... and when it


comes to
extraction from
non SAP
applications?

SAP AG 2002, Title of Presentation, Speaker Name 52

... dont

worry,
Ascential Tools
will help!

SAP - Ascential Partnership

Ascential DataStage is SAPs preferred data integration


technology.
SAP signed Reseller Agreement with Ascential
SAP resells DataStage and DataStage Load PACK for
SAP BW.
SAP and Ascential working together in:
Sales & Marketing
Developement
Engineering
Support

SAP AG 2002, Title of Presentation, Speaker Name 53

SAP / Ascential Partnership: Scenarios


Ascential enhances the SAP BW ETL capabilities
Ascential Application Extract PACKs (Packaged application
Connectivity Kits) provide the SAP BW with connectivity to
foreign applications like Oracle, Siebel and Peoplesoft
Database Platforms that cannot be reached via DB Connect or
UD Connect can be connected via DataStage PlugIns very
easily.
In complex flat file scenarios thousands of flat files with
dynamic naming conventions collected via FTP Servers can
easily be consolidated and merged into single files or DB
Tables with very high performance guarantee

SAP AG 2002, Title of Presentation, Speaker Name 54

API

R/2

Non
Non SAP
SAP

Legacy Systems

D
UD
B//U
D
DB

le
tt FFiile
a
l
a
l
F
/ F
eecctt /
n
n
n
C
Coon

SAP
BW

Business

API

^^
RDBMS
(DB2)

VSAM

BW Load Pack
BW Load Pack
Native

ADABAS

File
E-Business Applications

SS IIEEBBEELL

Oracle

PeopleSoft

SAP AG 2002, Title of Presentation, Speaker Name 55

Dat
DataSt
aStage
age ETL
ETL Com
Compon
ponent
entss

PlugIns

XML
Comp.Flat Pack
FTP
Appl. Spec.
Extr.Pack
Application
PACKs
Application
PACKs

Testing

Service

Development

BW
BW Service
Service API
API for
for SAP
SAP

Productive

SAPs Data Aquisition Strategy

BW Load Job with typical sources

SAP AG 2002, Title of Presentation, Speaker Name 56

DataStage BW Load PACK 3.0

Uses standard SAP Business APIs


Metadata Browser allows you to browse and select SAP
BW Source System, InfoSource and Transfer Structure
metadata
Validates meta data match
Selects data according to the BW selection criteria
Pull & Push mechanism for SAP BW load provided
(streaming)

SAP AG 2002, Title of Presentation, Speaker Name 57

InfoSource description from


DataStages BW Load PACK
Point of view

BAPI-Interface
for
Metadata

SAP AG 2002, Title of Presentation, Speaker Name 58

SAP BW Business Content for Oracle FI

Oracle
Oracle FI
FI
Predifined
DataStage Jobs

Access via
Application

RDBMS

BAPI

Business
Content

BW Load Pack

Oracle Appl.
PACK

SAP BW

RDBMS

A new class of Business


Content !!!

SAP AG 2002, Title of Presentation, Speaker Name 59

One Example for Ascentials Application Packs

Oracle Application PACK (Oracle Release 11i)


Direct Access Stage:
Add Business View functionality accesses the underlying datamodel via

the Business Object level (using Panels and Panel Groups)


Add Table View functionality accesses the underlying datamodel directly
via DDIC information from Oracle (list of tablenames)
Using the metadata description for tables, views and fields as defined in the
Oracle Application
Delta capabilities are given
Automatic search for effective Date fields within Oracle (Type: Timestamp).
Automatic creation of a delta-file with the date of the last job run.

Hierarchy Stage
Supports all in BW needed hierachy data needed in BW.

SAP AG 2002, Title of Presentation, Speaker Name 60

DS Jobs A part of SAP BW Business Content

SAP AG 2002, Title of Presentation, Speaker Name 61

Selecting a Table out of Oracle FI datamodel

SAP AG 2002, Title of Presentation, Speaker Name 62

Selecting Columns

SAP AG 2002, Title of Presentation, Speaker Name 63

Generated SQL Statement including delta handling

SAP AG 2002, Title of Presentation, Speaker Name 64

Oracle BW integration
Business Content for
Oracle Financials,
Oracle Projects and
Oracle Human Resources
Standard BW Content (BW 3.0B +)
DataSources
InfoCubes (e.g. Flexible General Ledger, Profitability Analysis,
Project Accounting)
Web Cockpits (with drill down and navigation, graphical representation,
period comparison)
Extraction Tools
Predefined ASCL Extraction Jobs developed in Cooperation with
Ascential for BW 3.1C

SAP AG 2002, Title of Presentation, Speaker Name 65

BW Web Cockpits based on Oracle Financials


Personalizable (e.g. My Cost Centers)
One-Click Drilldown from Overview to Detail
Switch between table and chart
Automatic selection of predefined time
frames

Web-Cockpits for General Ledger: Costs, Statistical Keyfigures, Profitability


Projects: Status, Employees, Resource Consumption
SAP AG 2002, Title of Presentation, Speaker Name 66

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
BW Data Base Connect
Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 67

The key question is ...

How to get
operational data
out of
SAP BW?
In this case
our
BW Open Hub Service
will help!

SAP AG 2002, Title of Presentation, Speaker Name 68

Open Data Warehouse Architecture

SAP AG 2002, Title of Presentation, Speaker Name 69

Open Hub Platform Skills


Open BW as a source for 3rd party target systems
Main BW data objects are supported for extraction
Delta tracking for each target system
Scheduling and central monitoring

SAP BW can serve as an enterprise information hub


and feed data to downstream systems

SAP AG 2002, Title of Presentation, Speaker Name 70

Open Hub Service - Details

Controlled distribution
of consistent data
Target: file or DB table
Central monitoring
Select filter criteria and
columns
Scheduling
Full or delta mode
(Data + Metadata)

ODS Objects

SAP AG 2002, Title of Presentation, Speaker Name 71

Functional Details
Asynchronous data transfer for mass data
Metaobject InfoSpoke describes
Data sources: IC, ODS-Object, Master Data
Full and Delta (Delta for InfoCubes and ODS objects )
Logical Target system, e.g. Data Mart US
Distribution targets: File, BW Table
Format: CSV
Selection criteria
Selected columns
Transformation via BAdI (optional)
Scheduling
Integrated in process chains (process type InfoSpoke)
Monitoring by application log

SAP AG 2002, Title of Presentation, Speaker Name 72

InfoSpoke Open Hub metaobject

SAP AG 2002, Title of Presentation, Speaker Name 73

InfoSpoke Open Hub destination

SAP AG 2002, Title of Presentation, Speaker Name 74

InfoSpoke extract structure

SAP AG 2002, Title of Presentation, Speaker Name 75

InfoSpoke selection criteria

SAP AG 2002, Title of Presentation, Speaker Name 76

InfoSpoke monitoring

SAP AG 2002, Title of Presentation, Speaker Name 77

InfoSpoke Metadata Information

SAP AG 2002, Title of Presentation, Speaker Name 78

InfoSpoke metadata information on files


Meta Data Description File
(S_DEST01.TXT)

Data File
(DEST01.CSV)

SAP AG 2002, Title of Presentation, Speaker Name 79

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 80

The key question is ...

Our company has lots of legacy


data which do not comply with the
requested format for InfoObjects.
Some transformation must be done
to upload this data to BW.
Do you have a tool which supports us
with this task in a most convenient way.

SAP AG 2002, Title of Presentation, Speaker Name 81

In this case
our
Transformation
Library and the
Formular Editor
will help!

Transformation
Requirements for transformation
Simple and complex mathematical calculations
String operations (like concatenation)
Date conversions
Conditions
..
And: simple implementation without any knowledge in
programming languages

SAP AG 2002, Title of Presentation, Speaker Name 82

Easy Transformation - Transformation Library


Transformation library
More than 70 predelivered functions
Predefined string operations, date conversions, logical and
mathematical functions
Enhancements via BADI (Business Add-In) possible
ABAP coding avoided in about 50% of analyzed customer
routines
No need to convert existing routines
Formula Builder as intuitive and easy-to-use User Interface
to Transformation library

SAP AG 2002, Title of Presentation, Speaker Name 83

Two layers where we transform data in SAP BW

ODS
Object

Master Data

Texts

Update rules

InfoSource

Transfer rules

Transferstructure

SAP AG 2002, Title of Presentation, Speaker Name 84

Transferstructure

Formula Builder The User Interface

Syntax Help

Fast and
Convenient
Search

Select Category,
e.g. String
Functions

Communication
/ Transfer
Structure
Fields or
System Fields

SAP AG 2002, Title of Presentation, Speaker Name 85

Transformation
Library

Formula Builder - Example

Converts data format MM/YYYY/DD into SAP format

SAP AG 2002, Title of Presentation, Speaker Name 86

Formula Builder - Example

If filled
If not

SAP AG 2002, Title of Presentation, Speaker Name 87

1:1-mapping of calendar day


calculates first day of delivered week

Formula Builder - Help

SAP AG 2002, Title of Presentation, Speaker Name 88

Formula Builder - Help

F1

SAP AG 2002, Title of Presentation, Speaker Name 89

Process Chains organize multiple Load steps

SAP AG 2002, Title of Presentation, Speaker Name 90

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 91

The key question is ...

As ETL is a more conservative and


Batch oriented way to move data into
a SAP BW target - what about a more
message oriented, transactional based
way to feed SAP BW in the sense of
EAI?

SAP AG 2002, Title of Presentation, Speaker Name 92

Excellent question,
the more mySAP ERP
Solutions will use
SAP XI to communicate
with their partner
components, the more
SAP XI will be involved
into SAP BW Load concepts

Real-time Data Acquisition


Actual Data, available in time

e
t
a
d
p
u

real-time analytics

monthly

right-time analytics

weekly

daily

Data Latency

SAP AG 2002, Title of Presentation, Speaker Name 93

near-real-time analytics

hourly

Real-time

SAP BW and SAP XI


SAP BW

Open Hub

SAP XI

http/
SOAP

SAP XI
A

C
D

F
E

Extraction, Transformation, Load (ETL)


Transform and integrate data for
consolidated analysis needs in order to
get a comprehensive overview of your
entire business
Session-oriented (scheduled)
Massdata oriented

SAP AG 2002, Title of Presentation, Speaker Name 94

Process Integration (EAI)


Processing single messaged
Event driven
Transaction oriented
Highly efficient transactional data
interchange

SAP XI -

Decoupling of Integrated Applications


Integration Directory
Routing Rules
Mappings

SAP
R/3 3.1i

Collaboration Profiles

Integration
Server
SAP R/3
Enterprise

Party
App

Channel
Determination
Marketplace

Receiver
Determination
SAP
Adapter

3rd

Message Handling between two


Applications
Logical decoupling of Sender
and Receiver
Technical decoupling of the
systems from logical
distribution
Decoupling the interfaces of
sender and receiver

3rd Party
Adapter

Mapping
Local
Integration Engine

SAP Application
(SAP Web AS 6.20)
SAP AG 2002, Title of Presentation, Speaker Name 95

Firewall

Business
Partner
Business
Partner

Business
Partner

SAP XI as a source for real-time data


SAP BW

SAP XI
Integration
Repository

Integration
Directory

Staging

Operational Data Store

Integration Server

Persistent Staging Area

Daemon based
InfoPackage
Pull ~ 1/min
Regular InfoPackage
Pull ~ 1/h

Delta
Queue

Real-time
Update

mySAP ERP Source Systems


SAP AG 2002, Title of Presentation, Speaker Name 96

Adapters

Delta
Queue

XI
Proxy
External
Application

Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data

BW Data Base Connect


Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 97

The end of a day ...


What a
Product!

Puuh
Im afraid thats
enough for for today!
I am really impressed.
SAP AG 2002, Title of Presentation, Speaker Name 98

What a
Woman ...

What else can


I show to you?

Open Data Warehouse Architecture

SAP AG 2002, Title of Presentation, Speaker Name 99

Additional Resources
1st Resource Our Help Portal under help.sap.com
2nd Resource Our SDN
3rd Resource
Etc.
Karen
Karencould
couldyou
youplease
pleasecomplete
complete
this
with
your
standard
US
this with your standard USinternet
internet
addresses
addresses

SAP AG 2002, Title of Presentation, Speaker Name 100

7 Key Points to Take Home

Wow! - SAP BW is an ETL Tool as well!


Nearly any DB platform can be reached
Complexe Load Scenarious graphically
maintainable
Powerfull Formular Editors available
XMI Standards for Meta Data available
Crossing the Boundaries from ETL to EAI
SAP BW - the best thing that can happen
to me
SAP AG 2002, Title of Presentation, Speaker Name 101

Your Turn!

Q&A

How to Contact Me:


Speaker Name
Email address
SAP AG 2002, Title of Presentation, Speaker Name 102

Copyright 2002 SAP AG. All Rights Reserved


No part of this publication may be reproduced or transmitted in any form or for any purpose without the express
permission of SAP AG. The information contained herein may be changed without prior notice.
Some software products marketed by SAP AG and its distributors contain proprietary software components of other
software vendors.
Microsoft, WINDOWS, NT, EXCEL, Word, PowerPoint and SQL Server are registered trademarks of
Microsoft Corporation.
IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390,
OS/400, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli,
Informix and Informix Dynamic ServerTM are trademarks of IBM Corporation in USA and/or other countries.
ORACLE is a registered trademark of ORACLE Corporation.
UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Citrix, the Citrix logo, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, MultiWin and
other Citrix product names referenced herein are trademarks of Citrix Systems, Inc.
HTML, DHTML, XML, XHTML are trademarks or registered trademarks of W3C, World Wide Web Consortium,
Massachusetts Institute of Technology.
JAVA is a registered trademark of Sun Microsystems, Inc.
JAVASCRIPT is a registered trademark of Sun Microsystems, Inc., used under license for technology invented
and implemented by Netscape.
MarketSet and Enterprise Buyer are jointly owned trademarks of SAP AG and Commerce One.
SAP, SAP Logo, R/2, R/3, mySAP, mySAP.com and other SAP products and services mentioned herein as well as
their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other
countries all over the world. All other product and service names mentioned are trademarks of their respective
companies.

SAP AG 2002, Title of Presentation, Speaker Name 103

Copyright 2002 SAP AG. Alle Rechte vorbehalten


Weitergabe und Vervielfltigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher
Form auch immer, ohne die ausdrckliche schriftliche Genehmigung durch SAP AG nicht gestattet. In dieser
Publikation enthaltene Informationen knnen ohne vorherige Ankndigung gendert werden.
Die von SAP AG oder deren Vertriebsfirmen angebotenen Softwareprodukte knnen Softwarekomponenten auch
anderer Softwarehersteller enthalten.
Microsoft, WINDOWS, NT, EXCEL, Word, PowerPoint und SQL Server sind eingetragene Marken der
Microsoft Corporation.
IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390,
OS/400, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix
und Informix Dynamic ServerTM sind Marken der IBM Corporation in den USA und/oder anderen Lndern.
ORACLE ist eine eingetragene Marke der ORACLE Corporation.
UNIX, X/Open, OSF/1 und Motif sind eingetragene Marken der Open Group.
Citrix, das Citrix-Logo, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, MultiWin und
andere hier erwhnte Namen von Citrix-Produkten sind Marken von Citrix Systems, Inc.
HTML, DHTML, XML, XHTML sind Marken oder eingetragene Marken des W3C, World Wide Web Consortium,
Massachusetts Institute of Technology.
JAVA ist eine eingetragene Marke der Sun Microsystems, Inc.
JAVASCRIPT ist eine eingetragene Marke der Sun Microsystems, Inc., verwendet unter der Lizenz der von
Netscape entwickelten und implementierten Technologie.
MarketSet und Enterprise Buyer sind gemeinsame Marken von SAP AG und Commerce One.
SAP, SAP Logo, R/2, R/3, mySAP, mySAP.com und weitere im Text erwhnte SAP-Produkte und -Dienst-leistungen
sowie die entsprechenden Logos sind Marken oder eingetragene Marken der SAP AG in Deutschland und anderen
Lndern weltweit. Alle anderen Namen von Produkten und Dienstleistungen sind Marken der jeweiligen Firmen.

SAP AG 2002, Title of Presentation, Speaker Name 104

You might also like