Sap BW and Etl: A Comprehensive Guide To SAP BW S ETL Capabilities
Sap BW and Etl: A Comprehensive Guide To SAP BW S ETL Capabilities
Sap BW and Etl: A Comprehensive Guide To SAP BW S ETL Capabilities
A comprehensive guide to
SAP BW s ETL capabilities
SAP AG
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
BEx
DW
SAP BW
MW
DB
Oracle DW
R/3
Extraction
BW-ETL
Mi
gr
at
io
n
Ascential
mySAP
Oracle
BO
Integration
XI
ETL
ERP MDM
PlumTree CP
SAP EP
MS SQL
Vitria
Informatica
PS
JDE
Informix
MS AS
SAS
Siebel
NCR Teradata
BW
Agenda
BW Overview
BW Extraction from mySAP Components and
BW Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
What does
SAP BW
know
about
my
business?
Everything!!!
If you run
mySAP ERP
SAP AG 2002, Title of Presentation, Speaker Name 10
BW Business Content
The BW Business Content is an entire
business model that knows all relevant
Business Processes in mySAP Components
Terms
Entities
Relationships
Processes
Roles
BW Service-API
BW Service-API provides
a framework to enable first class data replication based on standard
data extractors that encapsulate the application knowhow
parallel processing
sophisticated delta handling
FI
Generic Extractor
CRM
HR
APO
Customer
Tables
Logistics
Business Content DataSources
Build in Extractors
High coverage (Applications, Industries)
Transaction - and Master Data
Ready to run
Reduce implementation efforts and costs
Delta capable
SAP AG 2002, Title of Presentation, Speaker Name 13
BW
V1-Update
Document 2
V1
Document
Tables
Delta
Request
Document n V1
Motivation:
Guaranteed Serialization during
document extraction
Extraction Module
with V1 Update
Transfer
to BW
Time
SAP AG 2002, Title of Presentation, Speaker Name 14
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
How does
SAP BW
communicate
its
datamodel
to the
world?
We are going
along with
XMI
standards!
Exporting BW Metadata
AllFusion Erwin Data Modeler
Ascential DataStages
XML PlugIns can help
to handle SAPs
XMI formats when a mass
input of metadata is needed
for BW.
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
What about
operational data
in xml formats?
Can BW handle it?
... our
SOAP RFC
Service
will help ...
SAP AG 2002, Title of Presentation, Speaker Name 21
InfoSource
External application
document-type
document-type
data
data
CRM
SOAP
SOAP
rfc
rfc
Service
Service
push
XML data
BW
DataSource
Delta
mass data
Delta queue
(non XML format)
DB/UDC
DB/UDC
Connect
Connect
DataSource
pull
Init
Full
BW Server
SOAP compliant
HTTP Service
Country
DE
City
Hamburg
XML parsing
Delta queue
Transformation
PSA
<Country>DE</Country>
<City>Hamburg</City>
External Application
ODS, InfoCubes,
Master Data
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
BW Data Base Connect
Does SAP BW
provide
connectivity
to
additional
databases?
Of course!
Our
DB Connect
will handle this.
SAP BW
Foreign
Application
DB-Connect
MS SQL
DataBase
NT
ORACLE
DataBase
Unix
Purchasing
BW
DB Connect Architecture
SAP BW 3.0
Application Server
SAP DB
MultiConnect
DB Connect
Implementation
DB-Client for
ORA
DB-Client for
MSSQL
Oracle
Database Management System
SAP DB-Interface
MSSQL
Database Management System
DB Connect - Architecture
SAP BW
External
Database Server
Database
Database
Catalog
Catalog
DataSource
Design
Time
InfoSource
Vie
a
wD
ta
RunTime
Data
Staging
Engine
DB Connect - Prerequisites
SAP BW 3.0B
Table names and field names have to be in capital letters
Usage of views on top of tables is recommended
The SAP specific part of the database interface, the DBSL
(database shared library) for the source DBMS, has to be installed
on the application server. It can be downloaded from the SAP
Service Marketplace. It is licensed and delivered to customers
solely for use as part of the SAP BW.
The database specific DB-Client for the source DBMS has to be
installed on the application server. It has to be licensed by the
customer from the DB vendor and is delivered as part of the
database access license.
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
If your DB Connect
only supports ODBC and
is that much restricted
to a small number of
DB platforms,
how do you solve
connectivity problems
to the rest of the
universe?
BI Java Integration
Key Objectives
SAP NetWeaver
Openness
Integration of diverse data sources
People Integration
Portal
Collaboration
Information Integration
Business
Intelligence
Multi-Channel Access
Knowledge
Management
Process Integration
Integration
Broker
Business Process
Management
ABAP
WebSphere
Connectivity: JCA
Portability and Synergies with other J2EE
standards
Model Driven
Model, Code, Documentation in synch
Code generation based on JMI templates
andOS
OS Abstraction
Abstraction
DBDBand
.NET
Application Platform
J2EE
Standards Based
BC
D
J
177 vers
Dri ble
ila
ava
BAPI
DB
Connect
File
http/
SOAP
UDC
SAP XI
A
OLAP
BI ODBO Connector
Established industry-standard OLAP API for the Windows platform
Connectivity to MS Analysis Services, SAS
BI XMLA Connector
Web services-based, platform independent access to OLAP providers
Connectivity to MS Analysis Services, Hyperion, MicroStrategy, BW 3.x,
Business Objects
Enterprise
Portal
BI Java SDK
(BW 3.5)
2. BI Java SDK:
Java API, Examples
Documentation
Business
Explorer
BW OLAP
BW Staging
UD Connect
(BW 3.5)
mySAP
BW
R/3
Connectors:
- JDBC, XMLA,ODBO
- SAP Query
1. SAP BW Implementation
Enterprise
Portal
Business
Explorer
BI GUI Machine
PlugIn (tbd.)
3. BI Java SDK:
Java API, Examples
Documentation
2. Rapid BI Application
Development Tool for the
Enterprise Portal
BEx Adapter
(BW 4.0)
BW OLAP
1. SAP BW Implementation
BW Staging
UD Connect
(BW 3.5)
mySAP
BW
R/3
Connectors:
- JDBC, XMLA,ODBO
- SAP Query
BW 3.5
UDC - Architecture
InfoSource
Generic DataSource
with
Rules
FM
DB
WAS 6.40
XMLA Connector
ODBO Connector
JDBC Driver
http-URL, port
ODBO Prov.
RDBMS
BW
R/3
SAP BW 3.5
UD Connect
JDBC Connector
JDBC Driver
File
Syst.
DB
Supporting JDBC
SAP BW 3.5
BI Java Connectors
JDBC Connector
JDBC Driver
File
Syst.
DB
Supporting JDBC
SAP BW 3.5
BI Java Connectors
JDBC Connector
JDBC Driver
File
Syst.
DB
Supporting JDBC
SAP BW 3.5
Master Data
EDW Layer
InfoPackage
InfoSource
Generic DataSource
with
Rules
FM
BI Java Connectors
JDBC Connector
JDBC Driver
File
Syst.
DB
Supporting JDBC
Connect Info
Fields of table
ITEM
in ext. DB
Man. Mapping
Autom. Mapping
Generate DS
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
... dont
worry,
Ascential Tools
will help!
API
R/2
Non
Non SAP
SAP
Legacy Systems
D
UD
B//U
D
DB
le
tt FFiile
a
l
a
l
F
/ F
eecctt /
n
n
n
C
Coon
SAP
BW
Business
API
^^
RDBMS
(DB2)
VSAM
BW Load Pack
BW Load Pack
Native
ADABAS
File
E-Business Applications
SS IIEEBBEELL
Oracle
PeopleSoft
Dat
DataSt
aStage
age ETL
ETL Com
Compon
ponent
entss
PlugIns
XML
Comp.Flat Pack
FTP
Appl. Spec.
Extr.Pack
Application
PACKs
Application
PACKs
Testing
Service
Development
BW
BW Service
Service API
API for
for SAP
SAP
Productive
BAPI-Interface
for
Metadata
Oracle
Oracle FI
FI
Predifined
DataStage Jobs
Access via
Application
RDBMS
BAPI
Business
Content
BW Load Pack
Oracle Appl.
PACK
SAP BW
RDBMS
Hierarchy Stage
Supports all in BW needed hierachy data needed in BW.
Selecting Columns
Oracle BW integration
Business Content for
Oracle Financials,
Oracle Projects and
Oracle Human Resources
Standard BW Content (BW 3.0B +)
DataSources
InfoCubes (e.g. Flexible General Ledger, Profitability Analysis,
Project Accounting)
Web Cockpits (with drill down and navigation, graphical representation,
period comparison)
Extraction Tools
Predefined ASCL Extraction Jobs developed in Cooperation with
Ascential for BW 3.1C
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
BW Data Base Connect
Universal Data Integration with BW 3.5
BW and Ascential DataStage ETL
BW Open Hub Service
Transformation and Load
Realtime Data Acquisition
Summary
SAP AG 2002, Title of Presentation, Speaker Name 67
How to get
operational data
out of
SAP BW?
In this case
our
BW Open Hub Service
will help!
Controlled distribution
of consistent data
Target: file or DB table
Central monitoring
Select filter criteria and
columns
Scheduling
Full or delta mode
(Data + Metadata)
ODS Objects
Functional Details
Asynchronous data transfer for mass data
Metaobject InfoSpoke describes
Data sources: IC, ODS-Object, Master Data
Full and Delta (Delta for InfoCubes and ODS objects )
Logical Target system, e.g. Data Mart US
Distribution targets: File, BW Table
Format: CSV
Selection criteria
Selected columns
Transformation via BAdI (optional)
Scheduling
Integrated in process chains (process type InfoSpoke)
Monitoring by application log
InfoSpoke monitoring
Data File
(DEST01.CSV)
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
In this case
our
Transformation
Library and the
Formular Editor
will help!
Transformation
Requirements for transformation
Simple and complex mathematical calculations
String operations (like concatenation)
Date conversions
Conditions
..
And: simple implementation without any knowledge in
programming languages
ODS
Object
Master Data
Texts
Update rules
InfoSource
Transfer rules
Transferstructure
Transferstructure
Syntax Help
Fast and
Convenient
Search
Select Category,
e.g. String
Functions
Communication
/ Transfer
Structure
Fields or
System Fields
Transformation
Library
If filled
If not
F1
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
Excellent question,
the more mySAP ERP
Solutions will use
SAP XI to communicate
with their partner
components, the more
SAP XI will be involved
into SAP BW Load concepts
e
t
a
d
p
u
real-time analytics
monthly
right-time analytics
weekly
daily
Data Latency
near-real-time analytics
hourly
Real-time
Open Hub
SAP XI
http/
SOAP
SAP XI
A
C
D
F
E
SAP XI -
SAP
R/3 3.1i
Collaboration Profiles
Integration
Server
SAP R/3
Enterprise
Party
App
Channel
Determination
Marketplace
Receiver
Determination
SAP
Adapter
3rd
3rd Party
Adapter
Mapping
Local
Integration Engine
SAP Application
(SAP Web AS 6.20)
SAP AG 2002, Title of Presentation, Speaker Name 95
Firewall
Business
Partner
Business
Partner
Business
Partner
SAP XI
Integration
Repository
Integration
Directory
Staging
Integration Server
Daemon based
InfoPackage
Pull ~ 1/min
Regular InfoPackage
Pull ~ 1/h
Delta
Queue
Real-time
Update
Adapters
Delta
Queue
XI
Proxy
External
Application
Agenda
BW Overview
BW Extraction from mySAP Components
and Business Content
Dealing with XML Formats
XML Metadata Interface
XML Interface for operational Data
Puuh
Im afraid thats
enough for for today!
I am really impressed.
SAP AG 2002, Title of Presentation, Speaker Name 98
What a
Woman ...
Additional Resources
1st Resource Our Help Portal under help.sap.com
2nd Resource Our SDN
3rd Resource
Etc.
Karen
Karencould
couldyou
youplease
pleasecomplete
complete
this
with
your
standard
US
this with your standard USinternet
internet
addresses
addresses
Your Turn!
Q&A