10 Sep, 2024

CDI Implementation Strategy, Deployment

and Best Practices
• Bala Kaleeswaran, Solution Architect, IPS
• Pavan Kumar Soma Prabhu, Principal Services Solutions Architect, IPS
• Giri Chintarlapalli, Sr Principal Consultant, IPS

© Informatica. Proprietary and Confidential.

Housekeeping Tips

• Today’s Webinar is scheduled for 1 hour

• The session will include a webcast and then your questions will be answered live at the end of the presentation

• All dial-in participants will be muted to enable the speakers to present without interruption

• Questions can be submitted to “All Panelists" via the Q&A option and we will respond at the end of the presentation

• The webinar is being recorded and will be available on our Success Portal - where you can download the slide deck
for the presentation. The link to the recording will be emailed as well.

• Please take time to complete the post-webinar survey and provide your feedback and suggestions for upcoming
topics.

© Informatica. Proprietary and Confidential. 2

 Feature Rich Success Portal

Bootstrap trial and Enriched Customer Product Informatica Tailored training

POC Customers Onboarding Learning Paths Concierge and content
experience and Weekly recommendations
Expert Sessions

© Informatica. Proprietary and Confidential. 3

 More Information

Success Portal Communities & Documentatio University

https://success.informatica.com Support
https://network.informatica.com n
https://docs.informatica.com https://www.informatica.com/in/ser
vices-and-training/informatica-
university.html

© Informatica. Proprietary and Confidential. 4

Safe Harbor

The information being provided today is for informational purposes only. The
development, release, and timing of any Informatica product or functionality
described today remain at the sole discretion of Informatica and should not be
relied upon in making a purchasing decision.
Statements made today are based on currently available information, which is
subject to change. Such statements should not be relied upon as a
representation, warranty or commitment to deliver specific products or
functionality in the future.

© Informatica. Proprietary and Confidential. 5

SQL ELT
Need for ELT
• Faster Data Ingestion
Cloud Ecosystem Compute
• Raw data retention Cloud Ecosystem Compute
• Large amounts of data, processing

TRANSFOR
M
Cloud Data Lake & DW

Connectors
Mass Ingestio

Solution
• Choice of SQL ELT experience

LOAD
Cloud Data Lake & DW
• Cost and performance optimized

EXTRACT
Connectors
Benefits Mass Ingestion
EXTRACT

✓ Simple and Intuitive GUI

✓ Native CDW compute
✓ Ecosystem context aware
✓ Additional functions specific to CDW

© Informatica. Proprietary and Confidential. 6

Demo – Data Flow

Ingest/Replicate Analyze & Act

Real-time dashboard
TOTALSALES
Informatica
Cloud Data
INVENTORYSALES Ingestion &
Replication
Amazon S3

ELT
Capture and Synchronize Optimize & Control

© Informatica. Proprietary and Confidential. 7

Supported Sources (August 2024)

© Informatica. Proprietary and Confidential. 8

Rules and Guidelines - Subset
General Guidelines Target Operations

• Input parameters • Values in Warehouse and Role

• Precision matching • Upsert considerations

Data Types Expression Validations

• No Time and TIMESTAMPTZ data types. • Function with an expression that returns the
String data type and the output port is Integer
• No array
• Ensure that the string argument for the Date
or Time function is valid

Functions
• Dateadd function - DATEADD('Year',
<Value>, <Field name>)
• TO_NUMBER(TO_BOOLEAN(bool_field))

© Informatica. Proprietary and Confidential. 9

Enterprise Cloud Data Management Solution for AWS
Informatica’s Intelligent Data Management Cloud
Machine Learning Artificial Intelligence

Data Governance, Data Policy Data Data

Catalog, & Marketplace Discovery Definition Lineage Marketplace

API & APP Integration MDM & 360 Applications

Plugins Processes Guides Model Match Merge

Mass Advanced Pushdown Data Quality

Data Sources Ingestion Optimization

Data Lake Data

Application Profile Verify Dictionary Warehouse
Ingestion
Data Integration
Stage Enrich Curate
File
Ingestion S3
Redshift Data
Synch Mapping Taskflow
Consumers
Database Advanced Pushdown
Ingestion Administration Monitor Optimization

Stream
Ingestion Secure SAML Connectors Jobs Elasticity Logs
Agent

© Informatica. Proprietary and Confidential. 10

Lakehouse Management – Ingestion & Integration

Ingestion Challenges How Cloud Data Ingestion helps

Speed Ingestion job in minutes
Complexity Single, unified Cloud native
Scalability Ingest terabytes of any data
Flexibility Track, capture & update changed data

Data Integration Challenges Cloud Data Integration to the rescue!

Flexibility & Security Flexible and Secure
Scalable/ Varying patterns Pattern aware and Scalable
Adapt Intelligent and Adaptive
Performance Optimized performance for Data
Processing

© Informatica. Proprietary and Confidential. 11

© Informatica. Proprietary and Confidential. 12
IDMC – CI/CD integration

© Informatica. Proprietary and Confidential.

CI/CD Integration Solutions

Asset IDMC Rest API Assurance service Version control

management utility integration
– CLI

© Informatica. Proprietary and Confidential. 14

CI/CD Process flow – CLI and Rest API

© Informatica. Proprietary and Confidential. 15

CI/CD Process flow – Source control integration

Orchestration: Jenkins, Bamboo,

Source control workflow actions

© Informatica. Proprietary and Confidential. 16

CI/CD Process – Source code Integration – Pull request based

© Informatica. Proprietary and Confidential. 17

Pre-requisites

Enable Enable source control Enable source control

GitRepoConnect user profile
service

© Informatica. Proprietary and Confidential. 18

Demonstration
• Asset deployment utility
• Orchestration through bash script
• Recommendation: Orchestration with Jenkins, Bamboo
• Source code integration – Github – Automatic merge
• Orchestration with python
• Recommendations: Use source control workflows, Jenkins, Bamboo

© Informatica. Proprietary and Confidential. 19

IDMC – Best practice

© Informatica. Proprietary and Confidential.

CDI Implementation Guidelines and
Best Practices

Pavan Kumar Soma Prabhu

Principal Services Solutions Architect , IPS

© Informatica. Proprietary and Confidential.

Agenda
• Migration from OnPrem to Cloud
• Mapping Guidelines
• Naming Conventions
• Performance Tuning
• Testing Mechanisms
• Secure Agent Sizing Guidelines
• Error Handling
• CI/CD
• Job Monitoring

22 © Informatica. Proprietary and Confidential. 22

Migration from OnPrem to Cloud
• Architecture
• Core Services → Micro Services
• Service:
• Integration Service → Data Integration Server micro service
• Server
• On Prem Server → On Prem/Cloud Hosted Secure Agent
• Repository DB → Informatica cloud hosted metadata repository
Note: Lesser network hops if cloud hosted is suggested
• Assets
• PC Mappings → IDMC CDI Mappings
• PC Sessions → IDMC CDI Mapping Tasks
• PC Workflows → IDMC CDI Taskflows
• PC Job Execution Script → IDMC Scripts
• PC Parameter Files → IDMC Parameter Files

• Informatica provides Cloud Data Integration for PowerCenter service, for easier asset migration
23
from PowerCenter to IDMC-CDI © Informatica. Proprietary and Confidential. 23
Mapping Guidelines

• Understand Requirements
• Data Mapping and Quality
• Optimize transformations and Performance
• Error Handling and Security
• Testing and Deployment

24 © Informatica. Proprietary and Confidential. 24

Naming Conventions
• Descriptive names
• Avoid special characters
• Follow Informatica Naming Conventions
• Prefix or Suffix for clarity
• Consistency across assets and objects
• Avoid reserved words
• Use business naming standards

IDMC Naming Standards reference: https://knowledge.informatica.com/s/article/DOC-15669

25 © Informatica. Proprietary and Confidential. 25

Performance Tuning

• Optimize Source and Target

• Transformation optimization
• Mapping Design optimization
• Mapping task and taskflow optimization
• Secure Agent HA and optimizations

26 © Informatica. Proprietary and Confidential. 26

Testing Mechanisms

Unit System User

Testing Integration Acceptance
Testing Testing

Regression Performance
Smoke Testing
Testing
Testing

27 © Informatica. Proprietary and Confidential. 27

Secure Agent Sizing Guidelines
• Type of Workload
• Data Volume
• Concurrency
• Performance requirements

Informatica Sizing
Details
Sales/IPS

28 © Informatica. Proprietary and Confidential. 28

Error Handling

• Mapping • Mapping Tasks

• ERROR() • Stop on Errors

• ABORT() • Override Tracing

Types • On Stored Procedure Error

• On Pre/Post-Session
• Taskflows Command Task Error
• On Error • Error Log Type
• On Warning • Error Log File Directory
• Fail taskflow on completion • Error Log File Name
Non-
Fatal
• Custom Error Handling • Log Row Data

Fatal • Log Source Row Data

• Data Column Delimiter

29 © Informatica. Proprietary and Confidential. 29

CI/CD
• What is CICD:
Continuous Integration and Continuous Deployment is a set of practices and tools
designed to improve the development, deployment, and delivery process of software
applications
• Source Control Repositories Supported:

Repository Self-hosted Cloud-hosted

Atlassian Bitbucket

GitHub

GitLab N/A

Microsoft Azure DevOps N/A

Generic Repo N/A

Note: Please refer to source control for latest support

© Informatica. Proprietary and Confidential. 30
CI/CD (Contd..)
• When you enable source control for the organization, select an empty repository.
• Use different organizations for development, testing, staging, and production
DEV
ORG
Version Control
UAT
ORG

PROD
ORG

• Configure development organizations with read/write access to the source control repository, and
configure non-development organizations with read-only access to the source control repository

© Informatica. Proprietary and Confidential. 31

CI/CD (Contd..)
• Enabling project level repositories can help in parallel development and collaboration across teams
in the organization

• Do not share source control credentials among multiple Informatica Intelligent Cloud Services users
• Create connections and runtime environments before you pull assets from the repository
• Ensure that reusable assets such as mappings and components are present in the repository
before you use them

© Informatica. Proprietary and Confidential. 32

CI/CD (Contd..)
• When you rename or move an asset, check out the asset's first-level dependent assets and include
them in the same check-in
• Enter comments when you check in assets, preferably release numbers with changes to the assets
as part the release.

• When you check in multiple assets at one time, limit the number of assets to 1000 or fewer

© Informatica. Proprietary and Confidential. 33

Job Monitoring
• Features:
• Real-Time Monitoring
Data
Integration Administrator • Alerts and Notifications
• Detailed Job Logs
• Performance Metrics
• Historical Data and Trends
Monitor
Operational
Insights

Infa REST API

• Benefits:
• Enhanced Reliability
• Improved Troubleshooting
• Optimized Performance

34 © Informatica. Proprietary and Confidential. 34

 Thank You

35 © Informatica. Proprietary and Confidential. 35

© Informatica. Proprietary and Confidential.