Performance Tuning Massive SAP BW Systems - Tips & Tricks

Jay Narayanan
OfficeMax BW Technical Team Lead

SAP Systems at OfficeMax

Decentralized Warehouse Management Systems
Las Vegas Hazelton, Pennsylvania McCalla, Alabama

WM3 WM1

WM3 WM2

WM3
Vendor Shipments Deliveries due Master Data
WA MT OR ID WY NV UT CO NM N E K S OK TX ND SD ME VT NH NY MA CT RI NJ PA IA IN OH DE IL WV MD VA MO KY NC TN SC AR MS AL GA WI MI LA FL

Deliveries made Inv Adjustments Shaker Heights, Ohio

Retail and Core Business

MN

Retail WM3
Order Status Inventories

CA AZ

Customers Orders

Sales, Inventory Purchasing, etc.

Sales Analysis (infospoke)

Shaker Heights, Ohio

Campaign Analysis

Shaker Heights, Ohio

WM3 CRM
Market Basket (data mining) Customer Analysis

BW/SEM WM3
Financial Simulation (transactional cube)

Customer Call Center

(Cleveland, Dallas)

Business Intelligence and Modeling 2

Agenda
BW Technical Overview Modeling

Extraction

Changerun

Queries

Compression & Aggregates Rollup

SEM BPS Functions

BW Technology Platform

Solaris 2.8 SUN E10K

48-CPU / 48GB

1 App Server SUN V880

8-CPU / 32GB

SAP Portal 6.0 Crystal Enterprise 8.5 IGS

NT Servers
8-CPU

BW 3.1C (SP15) SEM 3.2B (sp12) Oracle 9.2

Hitachi 9960
(6TB/Monthly Growth 25GB)

Windows XP SAP GUI 6.20

Application Areas & InfoProviders

Cubes
SALES INVENTORY PURCHASING FINANCE HR CRM SEM STAFFWORKS BW STATISTICS Others 12 12 2 6 1 1 6 3 6 5 4
5

Aggregates
40 76 4 4 2 3

ODS
5

Performance Statistics for Loads

Data Process Records Runtime Streams

Sales

Cube Load ODS Rollup Compression

1.8m 1.8 m 1.8 m

30 mins 1.5 hours (actv) 15 minutes 20 mins

24 24 8 1

Inventory Snapshot Purchasing Master Data (27 info objects) Master Data Alignment

Cube Load Rollup Cube & ODS Full/Delta Load

27 m 27 m 1.4 m 140 K

2 hours 1.5 hours 2 hrs 40 mins

75 1 24 10

Change run

20000

3 hours

8 6

BW Users - Yearly
700 600 500 400 300
195 680

504

Users
149

200 100 0 Year2004 Year2003 Year2002

Year 2001
7

BW Users - Daily
250
226 222

200
178

150 100 50

141

150 121 117 96 91 98 99

106 92

Users

57

52

0 8/16/2004

8/23/2004
2

8/30/2004

Agenda
BW Technical Overview Modeling

Extraction

Changerun

Queries

Compression & Aggregates Rollup

SEM BPS Functions

Modeling Performance aspects - 1 Line Item Dimensions

InfoCube with no Line Item Dimension

Master Data Sid Table

Dimension Table

Fact Table

Dimension Table

Master data Sid table

InfoCube with Line Item Dimension

Master Data Sid table

Database View

Fact Table

Dimension Table

Master data Sid table

10

Modeling Performance Aspects - 2

Line Item Dimensions & Cardinality

11

Modeling Performance Aspects - 3

Logical Partitioning Yearly cubes
Parallel queries run on basic infocubes Change run can be run parallel

Year 2004 Cube

Year 2003 Cube

Year 2002 Cube 12

Modeling Performance aspects - 4

Run Program SAP_INFOCUBE_DESIGNS for existing Infocubes

Compression ratio

13

Modeling Performance Aspects - 5

Physical Partitioning Aggregates Navigational attributes Database partitions and secondary Indexes on ODS. Dimensions with more than one Characteristic

14

Agenda
BW Technical Overview Modeling

Extraction

Changerun

Queries

Compression & Aggregates Rollup

SEM BPS Functions

15

Data Load Performance

Data Load from Source System Configuring ROIDOCPRMS table Transaction SBIW General Settings->Maintain Control Parameters for Data Transfer Refer OSS Note : 417307 Infosource specific values can be maintained in Scheduler TSV_TNEW_PAGE_ALLOC_FAILED if Packet Size is Huge Reorg ARFCSDATA & ARFCSSTATE tables Flat File load Performance Maintain the parameters thru transaction RSCUSTV6 Load from application server not from Client reduces network load.

16

Data Load Performance Number Range Buffering - 1

When loading large quantities of data into an InfoCube, the number range buffer should be increased for the dimensions that are likely to have a high number of values Use Function module RSD_CUBE_GET to Identify the object name of the dimension.

17

Data Load Performance Number range buffering - 2

Use Transaction SNRO ->EDIT-> Setup Buffering->Main memory Never set buffering for package dimension

set the values between 500 and 1000.

18

Data Load Performance Load Balancing - 1

Use transaction SMLG and create logon group

BW system

Logon group for Load balancing

19

Data Load Performance Load balancing - 2

Change RFC settings in the source system Use transaction SM59

Source system

20

Data Load Performance

Drop Unused Partitions Use program SAP_DROP_EMPTY_FPARTITIONS

Avoid Long execution times for Index rebuild

21

Data Load Performance

Drop and recreate source twin Structures Program LMCSWTOP set flag FLG_DCT = X Drop and Recreate Bitmap indexes on F table Use Parallel Processing ODS loads & activation parallel Check Update / Transfer rules Index on source tables for full loads with selection Define PSA Part. size using transaction RSCUSTV6 Minimum no. of records in a PSA partition Use program SAP_PSA_PARTITION_COMPRESS for existing PSA tables Compress Cubes and aggregates regularly

22

Agenda
BW Technical Overview Modeling

Extraction

Changerun

Queries

Compression & Aggregates Rollup

SEM BPS Functions

23

Change run performance - 1

How Change run works on aggregates

Inserts new records positively and old records negatively

24

Change run Performance - 2

Function module RSCDS_CONDENSE_CUBE

Aggregate name

Enter X for aggregate

Value of cnsid_to of table rsddaggrdir

25

Change run Performance Threshold & Block size

Transaction RSCUSTV8

If the Changes more than 20% Aggregates are rebuilt

Choose the block size depending on the Temporary table space available

26

Change run Performance - Setting Change run Parallel -1

Create an RFC server group using transaction RZ12

27

Change run Performance - Setting Change run Parallel -2

After the RFC server group is defined use report SAP_RSADMIN_MAINTAIN to create the object entries CR_RFCGROUP in the table RSADMIN OSS Note 534630 Parallel Processing of Change run Parallel Processing of Change run Increases memory consumption

Maximum no. of work processes

RFC Server Group

28

Change run Performance Monitoring - 1

Use Table RSDDSTATAGGR to find the run times

29

Change run Performance Monitoring - 2

Program RSDDS_CHANGERUN_MONITOR

30

Agenda
BW Technical Overview Modeling

Extraction

Changerun

Queries

Compression & Aggregates Rollup

SEM BPS Functions

31

Query Performance - 1
Cause of Query Performance issues Database Database parameters may not be set properly(OSS note :180605) Database Statistics is not setup properly Degenerated Indexes Check if database partitioning is used Possibility of building an aggregate ORACLE_PARALLEL_DEGREE value in RSADMIN OLAP BW Basis parameters (OSS Note : 192658) Buffers, I/O, CPU, memory on the database server are exhausted Check the Read mode of queries / cubes Check the no. of available dialog processes Usage of restricted / Calculated keyfigures in the query Frontend Check the amount of data being transferred
32

Query Performance - 2
Build Aggregates

OLAP Cache Pre Calculated Value Sets Pre Calculated Web Templates Logical Partitioning - Multi Providers Physical Partitioning Look for degenerated Indexes Compress Infocubes regularly

33

Query Performance OLAP Cache

OLAP Cache Settings using transaction RSCUSTV14

34

Query Performance Pre Calculated Web Templates

Maintain the settings in Reporting Agent

35

Query Performance Pre-Calculated Valuesets

36

Query performance Tuning Techniques - 1

Switch on Statistics

37

Query Performance Tuning Techniques - 2

ST03N Expert mode

38

Query Performance Tuning Techniques - 3

Run Transaction SM66 Identify the process id Run transaction ST04 and find the process in Oracle session Get the execution Plan

Partition start and Stop

39

Query Performance Tuning Techniques - 4

Switch on/off aggregates

40

Query Performance Tuning Techniques - 5

Read mode (Table RSRREPDIR) Tables RSDDSTAT / RSDDSTATAGGR Cache Monitor(RSRCACHE) Function Module RSDDCVER_RFC_BW_STATISTICS BW Stats Cubes RSRT RSRTRACE

41

Agenda
BW Technical Overview Modeling

Extraction

Changerun

Queries

Compression & Aggregates Rollup

SEM BPS Functions

42

Aggregate Rollup & Compression Performance

Aggregates Rollup

Compress Cubes & aggregates regularly Rebuild Indexes on Etable of aggregates Build statistics on Aggregate tables Include partitioning Characterstic in the aggregates Do not build stats on the F table of the cube Make sure P index exists on the Etable of Cube & aggregates Aggregates Ftable size

Compression Performance

43

Aggregate Rollup & Compression Performance

Aggregates Rollup

Compress Cubes & aggregates regularly Rebuild Indexes on E table of aggregates Build statistics on Cubes & Aggregates Include partitioning Characteristic in the aggregates Do not build stats on the F table of the cube if the table is huge

Compression Performance
Make sure P index exists on the E table of Cube & aggregates Aggregates F table size

44

Agenda
BW Technical Overview Modeling

Extraction

Changerun

Queries

Compression & Aggregates Rollup

SEM BPS Functions

45

SEM BPS Performance - 1

Activate Statistics Transaction BPS_STAT0

Activate Stats

46

SEM BPS Performance - 2

Database Parameter Settings ( OSS Note : 358921) Executing Specialized functions faster than General functions (eg:- Copy function instead of writing formula to copy) Program UPC_BW_SELECTION_DEBUG can be used to do the analysis of read access in SEM-BPS Save the results after ending a planning session before starting another transaction since the memory is released only after the save or exiting the session. Compress the Infocubes Build aggregate if possible Code Formula functions effectively avoiding multiple loops 47

Summary
Check Oracle Parameter & Basis Parameter Settings Deploy Parallel Processing wherever possible Look for degenerated Indexes Use transactions ST03N / ST04 / ST02 ROIDOCPRMS table settings for Load Performance Make use of Load balancing Use OLAP Cache Use Pre-Calculated Value sets and Web Templates

48

Questions?

Q&A
49

Feedback
Please complete your session evaluation. Be courteous deposit your trash, and do not take the handouts for the following session.

Thank You !
50

SAP Developer Network

Look for SAP TechEd 04 presentations and videos on the SAP Developer Network. Coming in December. http://www.sdn.sap.com/

51

Copyright 2004 SAP AG. All Rights Reserved No part of this publication may be reproduced or transmitted in any form or for any purpose

without the express permission of SAP AG. The information contained herein may be changed without prior notice.
Some

software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Windows, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, and Informix are trademarks or registered trademarks of IBM Corporation in the United States and/or other countries. is a registered trademark of Oracle Corporation. X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Microsoft, IBM,

Oracle UNIX, Citrix,

ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc. XML, XHTML and W3C are trademarks or registered trademarks of W3C, World Wide Web Consortium, Massachusetts Institute of Technology. is a registered trademark of Sun Microsystems, Inc. is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. is a trademark of MySQL AB, Sweden. R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver and other SAP products and 52 services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world All other

HTML, Java

JavaScript MaxDB SAP,