Scribd
Upload
59 views2 pages

3 1 Union - All, Merge, TFN Types

The document discusses different SSIS transformations for combining datasets, including the Union All and Merge transformations. It also covers SSIS package events that occur during execution like validation, execution, cleanup, and errors. Debugging techniques for SSIS packages using breakpoints and data viewers are described.

Uploaded by

parashuram n
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
59 views2 pages

3 1 Union - All, Merge, TFN Types

The document discusses different SSIS transformations for combining datasets, including the Union All and Merge transformations. It also covers SSIS package events that occur during execution like validation, execution, cleanup, and errors. Debugging techniques for SSIS packages using breakpoints and data viewers are described.

Uploaded by

parashuram n
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

3.

1 - COMBINING DATA : UNION ALL TRANSFORMATION


UNION ALL: TO COMBINE MULTIPLE DATASET (INPUTS) AT A TIME.

STEP 1: LAUNCH SSDT > FILE > NEW > PROJECT > SSIS > TEMPLATE #1 > PACKAGES FOLDER > NEW
PACKAGE > DATA FLOW TASK >> SOURCE ASSISTANT > SELECT EXCEL SOURCE > OK. RIGHT
CLICK SOURCE > EDIT > SELECT REQUIRED EXCEL SHEET.
STEP 2: DRAG n DROP UNION ALL TRANSFORMATION.
CONNECT THIS FROM ABOVE SOURCES
STEP 3: DESTINATION ASSISTANT >> EDIT >> SELECT DESTINATION CONNECTION > OK
DATA PIPELINE FROM UNION ALL TRANSFORMATION TO DESTINATION
RIGHT CLICK DESTINATION > EDIT >> CREATE NEW SHEET > OK. EXECUTE.

3.2 - COMBINING DATA : MERGE TRANSFORMATION


MERGE : USED TO COMBINE TWO SORTED DATASETS (INPUTS) AT A TIME. OUTPUT IS A SORTED
ORDER BASED ON THE GIVEN SORT KEY VALUE.
CASE 1
STEP 1: LAUNCH SSDT > FILE > NEW > PROJECT > SSIS > TEMPLATE #1 > PACKAGES FOLDER > NEW
PACKAGE > DATA FLOW TASK >> SOURCE ASSISTANT > SELECT EXCEL SOURCE > OK. RIGHT
CLICK SOURCE > EDIT > SELECT REQUIRED EXCEL SHEET.
STEP 2: DRAG n DROP SORT TRANSFORMATION > CONNECT SOURCE 1 TO SORT TRANSFORMATION.
RIGHT CLICK SORT > EDIT > SELECT KEY COLUMN, PASSTHRU COLUMNS > OK.
STEP 3: DRAG n DROP SORT TRANSFORMATION > CONNECT FROM SOURCE2 TO SORT.
RIGHT CLICK SORT > EDIT > SELECT KEY COLUMN, PASSTHRU COLUMNS > OK.
STEP 4: DRAG n DROP MERGE TRANSFORMATION. CONNECT FROM SORTS TO MERGE.
STEP 5: DESTINATION ASSISTANT >> EDIT >> SELECT DESTINATION CONNECTION > OK
DATA PIPELINE FROM MERGE TRANSFORMATION TO DESTINATION.
RIGHT CLICK DESTINATION > EDIT >> CREATE NEW SHEET > OK. EXECUTE PACKAGE
CASE 2:
STEP 1: COPY PASTE ABOVE PACKAGE. REMOVE SORT TRANSFORMATIONS.
STEP 2: DOUBLE CLICK EACH SOURCE > ADVANCED EDITOR > INPUT / OUTPUT PROPERTIES > SOURCE
OUTPUT : IsSorted TRUE
OUTPUT COLUMNS : SELECT REQURIED COLUMN >> Sortkey Position : 1
MERGE TRANSFORMATION. CONNECT THIS FROM ABOVE SOURCES
DATA PIPELINE FROM MERGE TRANSFORMATION TO DESTINATION. EXECUTE PACKAGE

3.3 - SSIS TRANSFORMATION TYPES


1. ROW TRANSFORMATIONS :THESE TRANSFORMATIONS ARE APPLIED ON INDIVIDUAL ROWS.
TRANSFORMATION NEEDS A BUFFER, REUSED BY OTHER TRANSFORMATIONS. EX: UNION ALL

2. PARTIALLY BLOCKING TRANSFORMATIONS: THE TRANSFORMATIONS ARE APPLIED FOR FEW


ROWS FROM THE INPUT. EACH TRANSFORMATION NEEDS A BUFFER (MEMORY SPACE) THAT
CAN BE REUSED BY OTHER TRANSFORMATIONS. EX: MERGE

3. FULLY BLOCKING TRANSFORMATIONS: THE TRANSFORMATIONS ARE APPLIED ON ALL ROWS FROM
THE INPUT. EACH TRANSFORMATION NEEDS A BUFFER (MEMORY SPACE) THAT CANNOT
REUSED BY OTHER TRANSFORMATIONS. AVOID USING THESE TFNs. EX: SORT, AGGREGATE
3.4 - SSIS PACKAGE EVENTS
WHENEVER WE EXECUTE PACKAGE, A SET OF PREDEFINED EVENTS ARE AUTO CONFIGURED .

EVENT TYPE EVENT PURPOSE


VALIDATION PRE VALIDATION CHECKS FOR SYNTAX OF THE TASKS IN THE PACKAGE
VALIDATION COMPILES, GENERATE PIPELINE EXECUTION PLAN
POST VALIDATION LOOKUP FOR AVAILABLE RESOURCES [CPU, MEMORY]
EXECUTION PRE EXECUTION RESERVES PACKAGE EXECUTION RESOURCES
PROGRESS ACTUAL PACKAGE EXECUTION USING DTS RUNTIME
POST EXECUTION RELEASE LOCKS ON PACKAGE RESOURCES
CLEANUP CLEANUP RELEASE SSIS BUFFER (MEMORY) SPACE
OTHERS WARNING REPORTS PACKAGE EXECUTION WARNINGS, IF ANY
INFORMATION REPORTS PACKAGE EXECUTION STATUS [MSG, VALUE..]
VARIABLE CHANGE REPORTS CHANGES TO VARIABLES, IF ANY
ERROR REPORTS ERRORS DURING PACKAGE EXECUTIONS

ABOVE EVENTS CAN BE AUDITTED FROM :


1. SSIS PACKAGE EXECUTION "PROGRESS" TAB
2. DEBUGGING CONTROLS
a. CONTROL FLOW : BREAKPOINT
b. DATA FLOW : DATA VIEWERS
2. WRITE TO AN SSIS AUDIT FILE OR SSIS AUDIT TABLE [SYSSSISLOG]

DEBUGGING IS A MECHANISM TO AUDIT ABOVE PACKAGE EVENTS AND TO CONTROL PACKAGE


EXECUTION BASED ON OCCURENCE OF THE ABOVE EVENTS.

TYPES OF DEBUGGING SSIS PACKAGES:


1. CONTROL FLOW DEBUGGING USING "BREAK POINTS"
RIGHT CLICK PACKAGE or TASK > EDIT BREAK POINTS > ENABLE "BREAK POINT"
TWO LEVELS OF IMPLEMENATION FOR BREAKPINTS:
1. PACKAGE LEVEL 2. TASK LEVEL

2. DATA FLOW DEBUGGING USING "DATA VIEWERS"


RIGHT CLICK ANY DATA PIPELINE > ENABLE DATA VIEWER

HOW TO PERFORM PACKAGE AUDITS USING AUDIT TABLES AND AUDIT FILES?
FROM SSIS PACKAGE DESIGNER >> MENU ITEM >> SSIS >> PACKAGE LOGGING
THIS PROMPTS FOR A PACKAGE CONNECTION. ENABLE PACKAGE FOR LOGGING > ENABLE
PACKAGE CONNECTION > NEW CONNECTION >SPECIFY REQUIRED SQL SERVER NAME,
DATABASE NAME. ONE AUDIT TABLE IS AUTO CREATED : "sysssislog" TABLE
NOTE: BY DEFAULT, ONLY PACKAGE START AND PACKAGE END EVENTS ARE AUTO AUDITED.
TO AUDIT ALL EVENTS : SSIS LOGGING SCREEN > EVENTS TAB > SELECT ALL EVENTS

WHERE TO FIND THE ERRORS?


ON PACAKGE EXECUTION > GO TO PROGRESS TAB [LAST TAB] > WE SEE THE ERRORS. RIGHT
CLICK ERROR > COPY > PASTE TO ANY TEXT EDITOR.

You might also like