Scribd
Upload
42 views21 pages

Transformer - Aggregator - Funnel

The document describes three types of stages in data transformation: 1. Transformer stages handle and modify extracted data in two types - parallel and basic. Properties include creating/deleting columns and defining output derivations. 2. Aggregator stages group and compute aggregates on input data. Properties include grouping keys, aggregation type and output columns. 3. Funnel stages copy multiple input sets into a single output set. Properties include sorting keys and funnel type (continuous, sort, sequence).

Uploaded by

Ashwini Padhy
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
42 views21 pages

Transformer - Aggregator - Funnel

The document describes three types of stages in data transformation: 1. Transformer stages handle and modify extracted data in two types - parallel and basic. Properties include creating/deleting columns and defining output derivations. 2. Aggregator stages group and compute aggregates on input data. Properties include grouping keys, aggregation type and output columns. 3. Funnel stages copy multiple input sets into a single output set. Properties include sorting keys and funnel type (continuous, sort, sequence).

Uploaded by

Ashwini Padhy
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 21

Transformer Aggregator Funnel

1. Transformer Stage

The Transformer stage is used to handle extracted data,perform conversion if required. This is an active stage. There are two types of transformer.Parallel and Basic.

Transformer stage Editor

Transformer Stage -Properties


Create new columns on a link. Delete columns from a link. Move columns within a link. Edit column meta data. Define output column derivations. Specify before-stage and after-stage subroutines.(Basic Transformer only) Define link constraints (uses same method as server jobs)

Specify the order in which the links are processed.


Define local stage variables.

Transformer stage

Transformer stage

Input

Transformer stage

output

Transformer stage Ex

2. Aggregator Stage
Aggregator stage classifies data rows from a single input link into groups and computes totals or other aggregate functions for each group.
This stage is an active stage.

Aggregator stage Editor

Aggregator stage Properties


Grouping Keys
Group

Aggregation
Aggregation type Column for Calculation Count Output Column Summary Column for Recalculation

Options
Method Allow Null Output

Aggregator stage Input

Aggregator stage - Output

Aggregator stage Ex

3. Funnel Stage
The Funnel stage copies multiple input data sets to a single output data set.
This is also an active stage. Used to combine separate data sets into a large output dataset.

Funnel stage Editor

Funnel stage Properties


Sorting Keys
_ Key
Sort Order Nulls Position Character Set Case Sensitive

Options
Funnel Type
Continuous Sort Sequence

Funnel stage Input

Funnel stage Input

Funnel stage - Ex

Thank You

You might also like