0% found this document useful (0 votes)
124 views22 pages

Module 4 - Cloud Mapping Designer

The document discusses cloud mapping designer in IBM Cloud Integration. It defines mappings as assets that define data flow from source to target. Mappings can be created for data integration or elastic workloads. Features like copying transformations, data preview, customizing preview, and specifying data flow run order are covered. Field rules define how data enters transformations and options for selection criteria. Mapping tasks allow processing data based on mapping logic and can be scheduled. Schema change handling options are discussed to handle changes to data schemas.

Uploaded by

ajaybhosal
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
124 views22 pages

Module 4 - Cloud Mapping Designer

The document discusses cloud mapping designer in IBM Cloud Integration. It defines mappings as assets that define data flow from source to target. Mappings can be created for data integration or elastic workloads. Features like copying transformations, data preview, customizing preview, and specifying data flow run order are covered. Field rules define how data enters transformations and options for selection criteria. Mapping tasks allow processing data based on mapping logic and can be scheduled. Schema change handling options are discussed to handle changes to data schemas.

Uploaded by

ajaybhosal
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 22

Cloud Mapping Designer

Ajay Bhosal

Scalolearn Services Pvt. Ltd.


Agenda
• Discuss Cloud Mapping Designer
• Define mappings
• Explain field rules
• Describe Mapping Tasks
• Discuss Schema Handling

Scalolearn Services Pvt. Ltd.


Mapping Lifecycle
A mapping lifecycle has the following stages:
1. Design a Mapping
•Must contain at least one source and one target.
•Optionally create parameters for connections, objects and transformations.

2. Run and Test the mapping


• Verify that the mapping works.

• Enter values for parameters.

3. Create Mapping Tasks


• Run on schedule or as part of task flow.
• Enter values for parameters.
Scalolearn Services Pvt. Ltd.
IICS Mappings

Scalolearn Services Pvt. Ltd.


Mapping
Prerequisites
A mapping is an asset that defines the flow of data from the source to the target.
In IICS, you can create the following types of mappings:
 Data Integration Mapping or Mapping
• Used to deploy small to medium data integration solutions that are processed directly by a
Secure Agent group using the infrastructure that you provide, or by the Hosted Agent.

 Elastic Mapping
• Used to deploy large data integration solutions.
• When you run an elastic mapping, the mapping is pushed to an elastic cluster to achieve
faster processing for broad data sets.
• The infrastructure of the elastic cluster is automatically optimized based on the number and
size of elastic jobs.
Scalolearn Services Pvt. Ltd.
Mapping Features
Prerequisites
When you create a mapping, you can perform the following actions on the mapping:
1. Copying Transformations
• You can use the Cloud Mapping Designer to copy transformations between mappings or
mapplets.
• To copy one or more transformations, you must select the transformation(s) and click the
Copy icon.

Scalolearn Services Pvt. Ltd.


Mapping Features
Prerequisites
2. Mapping Data Preview
• Mapping Data Preview allows users to preview the data for individual transformations to test
the mapping logic.
• You can preview data for a transformation on the Preview panel of that transformation.
• The preview results are stored on the Secure Agent machine in the following location:
<Secure Agent installation directory>/apps/Data_Integration_Server/data/cache/preview

Scalolearn Services Pvt. Ltd.


Mapping Features
Prerequisites
Data preview is not supported for the following transformations:
 Web Services transformation
 Sequence Generator transformation
 Target transformation
 Data Masking transformation
 Hierarchy Builder transformation
 Velocity transformation

Scalolearn Services Pvt. Ltd.


Mapping Features
Prerequisites
3. Customizing Preview Results
• When you run the data preview for a mapping transformation, you can select which columns to
display or reorder the columns in the Preview panel of the mapping designer.
• You can customize the mapping preview from the Settings option in the Preview panel.

Scalolearn Services Pvt. Ltd.


Mapping Features
Prerequisites
4. Data Flow Run Order
• When you create a mapping with multiple data flows, you can specify the data flow run order
• You can specify the data flow run order when you want Data Integration to load the targets in
the mapping in a particular order.

Scalolearn Services Pvt. Ltd.


Demo:
Create a Simple Mapping

Scalolearn Services Pvt. Ltd.


Field Rules

Scalolearn Services Pvt. Ltd.


Field Rules Overview
Prerequisites
• Field rules define how data enters a transformation from the upstream
transformation.
• When there are no field rules defined in the mapping, then by default, all fields
are included.
• You can define field rules for all the transformations, except the Source
transformation.
• If you define multiple field rules, then the rules are evaluated in the specified
order.

Scalolearn Services Pvt. Ltd.


Renaming Fields
Prerequisites
When renaming fields in IICS, consider the following points:
• Renaming fields avoids naming conflicts
• Rename fields individually or in bulk
• Field naming conflicts propagate throughout the data flow
• Rename fields before the transformation where the error occurred
• Can use a prefix, suffix, or pattern to rename fields in bulk

Scalolearn Services Pvt. Ltd.


Field Rules – Selection Criteria
Prerequisites
When you configure a field rule, you must specify the following field selection criteria to
determine which incoming fields apply to the field rule.

Criteria Definition
All Fields • Includes or excludes all fields
• Can rename all fields in bulk

Named Fields • Includes or excludes specific fields


• Can create parameters to represent fields
• Can rename fields individually or in bulk
Fields by Data Types • Includes or excludes fields of a selected
data type
• Can rename fields in bulk
Fields by Text or Pattern • Includes or excludes fields based on a
prefix, suffix, or pattern
• Can rename fields in bulk

Scalolearn Services Pvt. Ltd.


Mapping Task

Scalolearn Services Pvt. Ltd.


Mapping Task Overview
Prerequisites
• A mapping task allows you to process data based on the data flow logic
defined in a mapping.
• When you create a Mapping Task, you must select a mapping to use in the
task. Optionally, you can also define the following:
1. Parameters that associate with the mapping
2. Schedule to run the task
3. Pre and post-processing commands for the task.

Scalolearn Services Pvt. Ltd.


Schema Change Handling
Prerequisites
• Schema Change Handling defines how Data Integration handles changes made
to data object schemas.
• A schema change includes one or more of the following changes to the data
object:
 Fields are added.
 Fields are deleted.
 Fields are renamed.
 Field data type, precision, or scale is updated.

Scalolearn Services Pvt. Ltd.


Schema Change Handling Options
Prerequisites
 Asynchronous
• This is the default option.
• Data Integration refreshes the schema when you edit the mapping or mapping task, and
when IICS version is upgraded.

 Dynamic
• Data Integration refreshes the schema every time the task runs.
• Applicable for source, target, and lookup objects of certain connector types.

Points to Remember:
• You can see if a connector supports dynamic schema change handling using the help section for that connector.
• You cannot enable dynamic schema change handling for hierarchical data.

Scalolearn Services Pvt. Ltd.


Demo:
Creating a Mapping Task

Scalolearn Services Pvt. Ltd.


Scalolearn Services Pvt. Ltd.
Thank You

Scalolearn Services Pvt. Ltd.

You might also like