Scribd
Upload
122 views23 pages

Data Migration With Informatica: Todd Funasaki Director - Data Integration Solutions

This document discusses Informatica's approach to data migration and the challenges involved. It begins with an overview of common data migration scenarios and why data migration is required. It then discusses challenges such as undocumented business rules, poor quality source data, and difficulty validating migrated data. The document outlines Informatica's end-to-end data integration platform for data migration, including capabilities for profiling, data quality management, transformation, validation, and iterative development. It provides examples of CRM and SAP migrations completed with Informatica. Finally, it discusses data synchronization between systems using Informatica for complex transformations and bulk data movement.

Uploaded by

ramme
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
122 views23 pages

Data Migration With Informatica: Todd Funasaki Director - Data Integration Solutions

This document discusses Informatica's approach to data migration and the challenges involved. It begins with an overview of common data migration scenarios and why data migration is required. It then discusses challenges such as undocumented business rules, poor quality source data, and difficulty validating migrated data. The document outlines Informatica's end-to-end data integration platform for data migration, including capabilities for profiling, data quality management, transformation, validation, and iterative development. It provides examples of CRM and SAP migrations completed with Informatica. Finally, it discusses data synchronization between systems using Informatica for complex transformations and bulk data movement.

Uploaded by

ramme
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 23

Data Migration with Informatica

Todd Funasaki Director Data Integration Solutions

Agenda
Application Data Migrations Common challenges Informatica approach and benefits Examples Q&A

Enterprise Data Integration:


Many Information Sources and IT Initiatives
Data Integration for the Enterprise
Applications

Fragmented Information Sources

Strategic Value of Information

Unstructured Data Databases

Legacy Migration

Consolidation

Single View of Customer, Product, Supplier

XML Messages

Synchronization

Master Data Management

More Efficient, Global Operations

Mainframe

Data Warehouse
Flat files

Improved Decision Making & Compliance

Data Migration : A Common Requirement


Application Implementation Application Upgrade Application Instance Consolidation M&A Integration Legacy Retirement Outsourcing From legacy into new application From previous to new version From multiple instances to fewer instances From acquired systems From legacy into new systems From company to outsourcer

Data Migration Required


4

Implementation versus Migration


Implementation is about Business Process
Partner responsible for implementation Configure application to support new business processes New processes more expansive than the old improved operations

Data Migration is about Data Readiness


Customer responsible for migrating the data Not just about moving the data Data must fit new, expanded processes = multiple sources Data readiness impacts implementation & operations

Data Migration Misconceptions


It Is Easy Existing Data Will Fit The New System Existing Data Is Of Good Quality We Understand Our Existing Data We Understand Our Business Processes We Have Good Documentation This is a one-time effort
6

Top 5 Data Migration Challenges


Business rules are just not documented in 20 year old systems. and 8 months after, the auditor asked me to prove the migration was correct

1. Its only at system test that real data is needed. 2. 3. 4. 5.

Building Migration Expertise Identifying Source Data Loading a Continuously-Moving Target Meeting Data Validation Thresholds Revisiting After Initial Migration You wont get promoted but you may get fired.

Weve been running our business for so long who imagined we wouldnt have the data?

..can extract data in 2 hours, but takes 8 hours to validate the data.

Migration Platform must reflect Project Challenges


Extract/ Transform Analyze Extract/ Transform Validate

Analyze

Validate

Load

Informatica

Validate

Load

Extract/ Transform

Analyze

End-to-end data integration platform for faster, fewer iterations


Analyze Extract/ Transform

Load

Validate

Agenda
Application Data Migrations Common challenges Informatica approach and benefits Examples Q&A

Informaticas Platform for Data Migration


Reusability / Team Productivity

XML, Messaging, and Web Services

2. Analyze/ Profile

3. Manage Data Quality

4.Transfor m

5. Validate/ Load

XML, Messaging, and Web Services

Packaged Applications

6. Iterate

Packaged Applications

Relational, Flat Files, Unstructured Data

1. Access source systems/data

7. Target/data

Relational, Flat Files, Unstructured Data

8. Bi-Directional Integration
Mainframe and Midrange

9. Audit / Lineage

Mainframe and Midrange

Informatica Data Integration Platform


10

Informaticas Platform for Data Migration


Reusability / Team Productivity

XML, Messaging, and Web Services

2. Analyze/ Profile

3. Manage Data Quality

4.Transfor m

5. Validate/ Load

XML, Messaging, and Web Services

Packaged Applications

6. Iterate

Packaged Applications

Relational, Flat Files, Unstructured Data

1. Access source systems/data

7. Target/data

Relational, Flat Files, Unstructured Data

8. Bi-Directional Integration
Mainframe and Midrange

9. Audit / Lineage

Mainframe and Midrange

Informatica Data Integration Platform


11

Complete: Universal Access


Deliver data to systems, processes and organizations
Systems
IBM MQSeries TIBCO webMethods SAP NetWeaver XI SAP NetWeaver SAP IDOC SAP BCI SAP DMI SAP BW Oracle DB2 UDB DB2/400 SQL Server Sybase ADABAS Datacom DB2 IDMS IMS Flat Files FTP Encrypted Stream XML.. Web Services XML JMS ODBC Peoplesoft Oracle Apps Siebel SAS Informix Teradata ODBC Flat Files Web Logs VSAM C-ISAM Complex Files Tape Formats Oracle SQL Server Industry Formats Unstructured

XML, Messaging, and Web Services

Packaged Applications

Relational and Flat Files

Using Informaticas flexible integration architecture, we are able to connect to over 1,000 data sources worldwide, including multiple instances of Oracle ERP, SAP R/3, J.D. Edwards, custom, mainframe, web, CICS, & object-oriented applications.

Mainframe and Midrange

and many more.


12

CRM Migration - Global Insurance Company


Native Data Access to Heterogeneous Data Sources
1: Profile and Extract Claims data natively off the DB2/400

Flatfiles not required

3: Convert and prepare data for Siebel and natively target


Migration Staging Area

4: Populate Siebel Analytics with CRM data

2: Validate Data Quality based on rules between Legacy and Siebel AS/400 DB2

Siebel CRM
PowerCenter (OEM)

Siebel Analytics

Informatica

13

Informaticas Platform for Data Migration


Reusability / Team Productivity

XML, Messaging, and Web Services

2. Analyze/ Profile

3. Manage Data Quality

4.Transfor m

5. Validate/ Load

XML, Messaging, and Web Services

Packaged Applications

6. Iterate

Packaged Applications

Relational, Flat Files, Unstructured Data

1. Access source systems/data

7. Target/data

Relational, Flat Files, Unstructured Data

8. Bi-Directional Integration
Mainframe and Midrange

9. Audit / Lineage

Mainframe and Midrange

Informatica Data Integration Platform


14

Six Dimensions of Data Quality


Completeness What data is missing or unusable?

Conformity

What data is stored in a non-standard format?

Consistency

What data values give conflicting information?

Accuracy

What data is incorrect or out of date?

Duplicates

What data records or attributes are repeated?

Integrity

What data is missing or not referenced?

15

Data Quality in Data Migration Projects


Global CPG Manufacturer
Informatica PowerCenter
Source Apps
Access Cleanse Integrate Deliver

ERP

3 6

Data Quality
Quality Check
Implement business rules 2
4

Data Experts / Owners take appropriate actions Reports

Data Experts / Owners review reports

Define business rules for:


Correctness Completeness Standardization Duplicates

16

Real Time Data Quality


Managing and Sustaining at the Point of Entry

Informatica Data Quality Web Services SAP Point of Entry


SAP Application and Screens DQ Adaptor/BAdi PowerCenter Web Services Data Quality

SOAP

17

SAP Point of Entry Example

User types in a new record (name and address)

18

SAP Point of Entry - Matching


Record is matched against all records in the SAP database

User decides whether to create a new record or edit an existing record


19

SAP Point of Entry Address Validation

User types in an address. Address is validated against the local postal format and is enriched and reformatted as appropriate

20

Informaticas Platform for Data Migration


Reusability / Team Productivity

XML, Messaging, and Web Services

2. Analyze/ Profile

3. Manage Data Quality

4.Transfor m

5. Validate/ Load

XML, Messaging, and Web Services

Packaged Applications

6. Iterate

Packaged Applications

Relational, Flat Files, Unstructured Data

1. Access source systems/data

7. Target/data

Relational, Flat Files, Unstructured Data

8. Bi-Directional Integration
Mainframe and Midrange

9. Audit / Lineage

Mainframe and Midrange

Informatica Data Integration Platform


21

Data Synchronization with Informatica


Complex Transformation and Bulk Data Movement

1.

New EDI Order Wave Entered

(VMI) Vendor Managed Inventory

2. Trigger message sent to JMS

3. JMS message sourced by INFA;INFA then extracts batch order data from VMI and converts to IDOC format

Informatica
6. Conversion of IDOC back to VMI Order format with 7. Roundtrip of Orders completed; INFA VMI Order routed back via database write

4. Order data written into SAP with INFA via ALE/IDOC 5. Updated Orders in SAP sent back to VMI from SAP via IDOC

SAP

22

Thank You

23

You might also like