SSIS INTERVIEW QUESTIONS

Q1. Define SSIS?

SQL Server Integration Services — commonly known as SSIS is the new platform that was introduced
in SQL Server 2005, for data transformation and data integration solutions. This replaced the DTS in
SQL Server 2000.
Q2. Name a few SSIS components?
Integration Services Projects
Integration Services Packages
Control Flow Elements
Data Flow Elements
Integration Services Connections
Integration Services Variables
Integration Services Event Handlers
Integration Services Log Providers
Q3. What is a project and Package in SSIS?
Project is a container for developing packages. Package is nothing but an object. It implements the
functionality of ETL — Extract, Transform and Load — data.
Q4. What are the 4 elements (tabs) that you see on a default package designer in BIDS?
Control Flow, Data Flow, event Handler and package explorer. (Parameters – 2012 & above versions
for SQL Server Data Tools)
Q5. What is a Control flow and Data Flow elements in SSIS?
Control Flow:
Control flow element is one that performs any function or provides structure or control the flow of
the elements. There must be at least one control flow element in the SSIS package. In SSIS a
workflow is called a control-flow. A control-flow links together our modular data-flows as a series of
operations in order to achieve a desired result.
A control flow consists of one or more tasks and containers that execute when the package runs. To
control order or define the conditions for running the next task or container in the package control
flow
Data Flow:
All ETL tasks related to data are done by data flow elements. It is not necessary to have a data flow
element in the SSIS package. A data flow consists of the sources and destinations that extract and
load data, the transformations that modify and extend data, and the paths that link sources,
transformations, and destinations. Before you can add a data flow to a package, the package control
flow must include a Data Flow task. The Data Flow task is the executable within the SSIS package
that creates, orders, and runs the data flow. A separate instance of the data flow engine is opened
for each Data Flow task in a package.
Q6. What are the 3 different types of control flow elements in SSIS?
Structures provided by Containers
Functionality provided by Tasks
Precedence constraints that connect the executables, containers, and tasks into an ordered control
flow.
Q7. What are the 3 data flow components in SSIS?
Source
Transformation
Destination
Q8. What are connections and connection managers in SSIS?
Connection as its name suggests is a component to connect to any source or destination from SSIS —
like a sql server or flat file or lot of other options that SSIS provides. Connection manager is a logical
representation of a connection.
Q9. What is the use of Check Points in SSIS?
SSIS provides a Checkpoint capability which allows a package to restart at the point of failure.
Q10. What are the command line tools to execute SQL Server Integration Services packages?
DTSEXECUI – When this command line tool is run a user interface is loaded in order to configure
each of the applicable parameters to execute an SSIS package.
DTEXEC – This is a pure command line tool where all of the needed switches must be passed into the
command for successful execution of the SSIS package.
Q11. Can you explain the SQL Server Integration Services functionality in Management Studio?
You have the ability to do the following:
Login to the SQL Server Integration Services instance
View the SSIS log
View the packages that are currently running on that instance
Browse the packages stored in MSDB or the file system
Import or export packages
Delete packages
Run packages
Q12. Can you name some of the core SSIS components in the Business Intelligence Development
Studio you work with on a regular basis when building an SSIS package?
Connection Managers
Control Flow
Data Flow
Event Handlers
Variables window
Toolbox window
Output window
Logging
Package Configurations
Q13. Name Transformations available in SSIS?
DATACONVERSION: Converts columns data types from one to another type. It stands for Explicit
Column Conversion.
DATAMININGQUERY: Used to perform data mining query against analysis services and manage
Predictions Graphs and Controls.
DERIVEDCOLUMN: Create a new (computed) column from given expressions.
EXPORTCOLUMN: Used to export a Image specific column from the database to a flat file.
FUZZYGROUPING: Used for data cleansing by finding rows that are likely duplicates.
FUZZYLOOKUP: Used for Pattern Matching and Ranking based on fuzzy logic.
AGGREGATE: It applies aggregate functions to Record Sets to produce new output records from
aggregated values.
AUDIT: Adds Package and Task level Metadata: such as Machine Name, Execution Instance, Package
Name, Package ID, etc..
CHARACTERMAP: Performs SQL Server column level string operations such as changing data from
lower case to upper case.
MULTICAST: Sends a copy of supplied Data Source onto multiple Destinations.
CONDITIONALSPLIT: Separates available input into separate output pipelines based on Boolean
Expressions configured for each output.
COPYCOLUMN: Add a copy of column to the output we can later transform the copy keeping the
original for auditing.
IMPORTCOLUMN: Reads image specific column from database onto a flat file.
LOOKUP: Performs the lookup (searching) of a given reference object set to a data source. It is used
for exact matches only.
MERGE: Merges two sorted data sets into a single data set into a single data flow.
MERGEJOIN: Merges two data sets into a single dataset using a join junction.
ROWCOUNT: Stores the resulting row count from the data flow / transformation into a variable.
ROWSAMPLING: Captures sample data by using a row count of the total rows in dataflow specified
by rows or percentage.
UNIONALL: Merge multiple data sets into a single dataset.
PIVOT: Used for Normalization of data sources to reduce anomalies by converting rows into columns
UNPIVOT: Used for de-normalizing the data structure by converts columns into rows in case of
building Data Warehouses.
Q14. What is a breakpoint in SSIS?
A breakpoint is a stopping point in the code. The breakpoint can give the Developer\DBA an
opportunity to review the status of the data, variables and the overall status of the SSIS package.
Breakpoints are setup in BIDS. In BIDS, navigate to the control flow interface. Right click on the
object where you want to set the breakpoint and select the ‘Edit Breakpoints…’ option.
Q15. Can you name 5 or more of the native SSIS connection managers?
OLEDB connection – Used to connect to any data source requiring an OLEDB connection (i.e., SQL
Server)
Flat file connection – Used to make a connection to a single file in the File System. Required for
reading information from a File System flat file
ADO.Net connection – Uses the .Net Provider to make a connection to SQL Server 2005 or other
connection exposed through managed code (like C#) in a custom task
Analysis Services connection – Used to make a connection to an Analysis Services database or
project. Required for the Analysis Services DDL Task and Analysis Services Processing Task
File connection – Used to reference a file or folder. The options are to either use or create a file or
folder
Excel
FTP
HTTP
MSMQ
SMO
SMTP
SQL Mobile
WMI        
Q16. How do you eliminate quotes from being uploaded from a flat file to SQL Server? 
In the SSIS package on the Flat File Connection Manager Editor, enter quotes into the Text qualifier
field then preview the data to ensure the quotes are not included.
Q17. Can you name 5 or more of the main SSIS tool box widgets and their functionality?
ActiveX Script Task
Analysis Service Processing Task
Analysis Services Execute DDL Task
Backup Database Task
Bulk Insert Task
CDC Control Task
Transfer error message
Q18. Can you explain one approach to deploy an SSIS package?
One option is to build a deployment manifest file in BIDS, then copy the directory to the applicable
SQL Server then work through the steps of the package installation wizard
A second option is using the dtutil utility to copy, paste, rename, delete an SSIS Package
A third option is to login to SQL Server Integration Services via SQL Server Management Studio then
navigate to the ‘Stored Packages’ folder then right click on the one of the children folders or an SSIS
package to access the ‘Import Packages…’ or ‘Export Packages…’option.
A fourth option in BIDS is to navigate to File | Save Copy of Package and complete the interface.
Q19. Can you explain how to setup a checkpoint file in SSIS?
 The following items need to be configured on the properties tab for SSIS package:
CheckpointFileName – Specify the full path to the Checkpoint file that the package uses to save the
value of package variables and log completed tasks. Rather than using a hard-coded path, it’s a good
idea to use an expression that concatenates a path defined in a package variable and the package
name.
CheckpointUsage – Determines if/how checkpoints are used. Choose from these options: Never
(default), If Exists, or Always. Never indicates that you are not using Checkpoints. “If Exists” is the
typical setting and implements the restart at the point of failure behavior. If a Checkpoint file is
found it is used to restore package variable values and restart at the point of failure. If a Checkpoint
file is not found the package starts execution with the first task. The Always choice raises an error if
the Checkpoint file does not exist.
SaveCheckpoints – Choose from these options: True or False (default). You must select True to
implement the Checkpoint behavior.
Q20. Would you recommend using “Check Points” in SSIS?
As per my experience I could say “NO” as there are compatibility issues with various options hence
using checkpoints may give unpredictable results. Checkpoints doesn’t work properly when a SSIS
package contains
Complex logic
Iterations/Loops
Transactions Enabled
“Object” type variables
Parallel execution
Checkpoints works fine when the package is having straightforward control flow with a single thread.
 
Q21. Can you explain different options for dynamic configurations in SSIS?
Use an XML file
Use custom variables
Use a database per environment with the variables
Use a centralized database with all variables
Q22. How do you upgrade an SSIS Package?
Depending on the complexity of the package, one or two techniques are typically used:
Recode the package based on the functionality in SQL Server DTS.
Use the Migrate DTS 2000 Package wizard in BIDS and then recode any portion of the package that is
not accurate
Q23. Can you name five of the Perfmon counters for SSIS and the value they provide?
SQLServer: SSIS Service
SSIS Package Instances – Total number of simultaneous SSIS Packages running
SQLServer: SSIS Pipeline
BLOB bytes read – Total bytes read from binary large objects during the monitoring period.
BLOB bytes written – Total bytes written to binary large objects during the monitoring period.
BLOB files in use – Number of binary large objects files used during the data flow task during the
monitoring period.
Buffer memory: The amount of physical or virtual memory used by the data flow task during the
monitoring period.
Buffers in use – The number of buffers in use during the data flow task during the monitoring period.
Buffers spooled – The number of buffers written to disk during the data flow task during the
monitoring period.
Flat buffer memory – The total number of blocks of memory in use by the data flow task during the
monitoring period.
Flat buffers in use – The number of blocks of memory in use by the data flow task at a point in time.
Private buffer memory – The total amount of physical or virtual memory used by data
transformation tasks in the data flow engine during the monitoring period.
Private buffers in use – The number of blocks of memory in use by the transformations in the data
flow task at a point in time.
Rows read – Total number of input rows in use by the data flow task at a point in time.
Rows written – Total number of output rows in use by the data flow task at a point in time.
Q24. How do you handle errors in ssis?
When a data flow component applies a transformation to column data, extracts data from sources,
or loads data into destinations, errors can occur. Errors frequently occur because of unexpected data
values.
Errors typically fall into one the following categories:
Data conversion errors: occurs if a conversion results in loss of significant digits, the loss of
insignificant digits, and the truncation of strings. Data conversion errors also occur if the requested
conversion is not supported.
Expression evaluation errors: occurs if expressions that are evaluated at run time perform invalid
operations or become syntactically incorrect because of missing or incorrect data values.
Lookup errors: occurs if a lookup operation fails to locate a match in the lookup table.
Many data flow components support error outputs, which let you control how the component
handles row-level errors in both incoming and outgoing data. You specify how the component
behaves when truncation or an error occurs by setting options on individual columns in the input or
output.
Q25. How do you do Logging in SSIS?
SSIS includes logging features that write log entries when run-time events occur and can also write
custom messages.
The Integration Services log providers can write log entries to text files, SQL Server Profiler, SQL
Server, Windows Event Log, or XML files.
Logs are associated with packages and are configured at the package level. Each task or container in
a package can log information to any package log. The tasks and containers in a package can be
enabled for logging even if the package itself is not.
To enable logging in a package:
In Business Intelligence Development Studio, open the Integration Services project that contains the
package you want.
On the SSIS menu, click Logging.
Select a log provider in the Provider type list, and then click Add.
 
Q26. Demonstrate how you would suggest using configuration files in packages.  Would you
consider it a best practice to create a configuration file for each connection manager or one for the
entire package?
There should be a single configuration file for each connection manager in your packages that stores
their connection string information.  So if you have 6 connection managers then you have 6 config
files.  You can use the same config file across all your packages that use the same connections.
If you have a single config file that stores all your connection managers then all your packages must
have contain the connection managers that are stored in that config file.  This means you may have
to put connection managers in your package that you don’t even need.
 
Q27. Demonstrate how checkpoints work in a package.
When checkpoints are enabled on a package if the package fails it will save the point at which the
package fails.  This way you can correct the problem then rerun from the point that it failed instead
of rerunning the entire package.  The obvious benefit to this is if you load a million record file just
before the package fails you don’t have to load it again.
Q28. Demonstrate how transactions work in a package.
If transactions are enabled on your package and tasks then when the package fails it will rollback
everything that occurred during the package. First make sure MSDTC (Microsoft Distributed
Transaction Coordinator) is enabled in the Control Panel -> Administrative Tools -> Component
Services. Transactions must be enabled not only on the package level but also on each task you want
included as part of the transaction. To have the entire package in a transaction set Transaction
Option at the package level to Required and each task to Supported.
Q29. If you have a package that runs fine in Business Intelligence Development Studio (BIDS) but
fails when running from a SQL Agent Job what would be your first guess on what the problem is?
The account that runs SQL Agent Jobs likely doesn’t have the needed permissions for one of the
connections in your package. Either elevate the account permissions or create a proxy account.
To create a proxy account you need to first create new credentials with the appropriate permissions.
Next assign those credentials to a proxy account. When you run the job now you will select Run As
the newly created proxy account.
 
Q30. What techniques would you consider to add auditing to your packages?  You’re required to
log when a package fails and how many rows were extracted and loaded in your sources and
destinations.
I like to create a database that is designated for package auditing. Track row counts coming from a
source and which actually make it to a destination. Row counts and package execution should be all
in one location and then optionally report off that database.
There are also third party tools that can accomplish this for you (Pragmatic Works BI xPress).
 
Q31. Demonstrate or whiteboard techniques you would use to for CDC (Change Data Capture)? 
Tell how you would write a package that loads data but first detects if the data already exists,
exists but has changes, or is brand new data for a destination.
For small amounts of data I may use the Slowly Changing Dimension. More often than not the data is
too large to use in such a slow transform.
I prefer to do a lookup on the key of the target table and rows that don’t match are obviously new
rows that can be inserted. If they do match it’s possible they are updates or duplicates. Determine
this by using a conditional split comparing rows from the target to incoming rows. Send updates to a
staging table that can then be updated in an Execute SQL Task.
Explain that putting updates in a staging table instead of updating using the OLE DB Command is
much better for performance because the Execute SQL Task performs a bulk operation.
Q32. Explain what breakpoints are and how you would use them.
Breakpoints put pauses in your package. It’s a great tool for debugging a package because you can
place a breakpoint on a task and it will pause the package based on execution events.
A reason in which I have used breakpoints is when I have a looping container and I want to see how
my variables are changed by the loop. I would place a watch window on the package and type the
variable name in. Set a break point on the container the stop after each iteration of the loop.
Q33. What are the main components involved in SSIS?
SSIS is not improved version of DTS
SSIS is completely redesigned and build from ground up using .NET code.
SSIS is mainly divided into two parts.
Data Transformation Pipeline (DTP) – Data Flow
Data Transformation Runtime (DTR) – Control Flow
In SQL SERVER 7 / 2000 the data flow is stronger than control flow but in SSIS both are in the same
level
Q34. What is the work of DTP Engine?
DTP consists of DTP Engine and DTP Object model
DTP uses Data Adapters to connect source and destination
DTP engine uses DTP Object Model which is nothing but an API.
SSIS comes with adapters for SQL Server databases, XML, flat files, and other OLE DB–compliant data
sources
The job of the data adapters is to make connections to the data’s source and destination endpoints
The job of the transformations is to move and optionally manipulate the data as it’s moved between
the source and destination endpoints.
Q35. How the DTR works in SSIS?
The DTR consists of the DTR engine and the DTR components.
DTR components are objects that enable you to govern the execution of SSIS packages.
The primary DTR components are packages, containers, and tasks.
DTR engine stores package layout; runs packages; and provides debugging, logging, and event
handling services.
The DTR is accessed using the DTR object framework. The DTR run-time object framework is the API
that supports the Integration Services Import/Export Wizard and the Integration Services Designer in
addition to the command-line dtexec tool.
Q36. Can you explain the SSIS Architecture?
Runtime engine
The Integration Services runtime saves the layout of packages, runs packages, and provides support
for logging, breakpoints, configuration, connections, and transactions.
API or object model
The Integration Services object model includes managed application programming interfaces (API)
for creating custom components for use in packages, or custom applications that create, load, run,
and manage packages. Developer can write custom applications or custom tasks or transformations
by using any common language runtime (CLR) compliant language.
Integration Services service: It is a Windows service, monitors running SSIS packages and manages
the storage of packages.
Data flow: It contains a data flow engine that manages the data flow components. There are 3 types
of
Data Flow components – Source components (which extracts the data from a system),
Transformation components (performs transformations, modifications onto the extracted data) and
Load components (which simply performs the data loading tasks into the destination systems).
Besides the available data flow components, we can write our own custom data flow components to
accomplish any custom requirements.
Q37. Difference between Union–all and Merge Join?
Merge transformation can accept only two inputs whereas Union all can take more than two inputs
Data has to be sorted before Merge Transformation whereas Union all doesn’t have any condition
like that.
Q38. What is difference between Multicast and Conditional Split?
The Multicast transformation distributes its input to one or more outputs. This transformation is
similar to the Conditional Split transformation. Both transformations direct an input to multiple
outputs. The difference between the two is that the Multicast transformation directs every row to
every output, and the Conditional Split directs a row to a single output
Q39. What is the difference between DTS and SSIS?
Well, nothing except both the Microsoft SQL Server Products.
Even though both are the ETL tools, we can differentiate if you are asked observations.
S.no DTS SSIS

1 Data Transformation Services Sql Server Integration Services

2 Using Activex Script Using Scripting Language

3 No Deployment wizard Deployment wizard

 Limited Set of Transformation
4 available Huge of Transformations available

Completely supporting end to end process

5 Not Supporting BI Functionality of BI

6 Single Tasks at a time Multi Tasks run parallel

7 It is Un managed script Managed by CLR

SSIS can thru Business Intelligence

DTS can develop thru Enterprise Development Studio (BIDS, nothing but
8 manager new version of VS IDE)

We can deploy only at local It can be deployed using multiple server

9 server using BIDS

10 Designer contains Single Pane SSIS designer contains 4 design panes:

  a) Control Flow

  b) Data Flow

  c) Event Handlers &

  d) Package Explorer.

11 No Event Hander Event Handler Available

Solution Explorer is available, with

packages, connections and Data Source
12 No Solution Explorer Views (DSV)

Connection and other values are It can be controlled dynamically using

13 static, not controlled at runtime. configuration
Q40. What is the difference between Fuzzy Lookup and Fuzzy Grouping?
The Fuzzy Grouping task performs the same operations as the Fuzzy Lookup task but instead of
evaluating input records against an outside reference table, the input set becomes the reference.
Input records are therefore evaluated against other records in the input set and evaluated for
similarity and assigned to a group.
Q41. What’s the difference between Control Flow and Data Flow?
Control Flow:
Process Oriented
Doesn’t manage or pass data between components.
It functions as a task coordinator
In control flow tasks requires completion (Success,failure or completion)
Synchronous in nature, this means, task requires completion before moving to next task. If the tasks
are not connected with each other but still they are synchronous in nature.
Tasks can be executed both parallel and serially
Three types of control flow elements in SSIS 2005
Containers: Provides structures in the packages
Tasks: Provides functionality in the packages
Precedence Constraints: Connects containers, executables and tasks into an ordered control flow.
It is possible to include nested containers as SSIS Architecture supports nesting of the containers.
Control flow can include multiple levels of nested containers.
Data Flow:
Streaming in nature
Information oriented
Passes data between other components
Transformations work together to manage and process data. This means first set of data from the
source may be in the final destination step while at the same time other set of data is still flowing. All
the transformations are doing work at the same time.
Three types of Data Flow components
Sources: Extracts data from the various sources (Database, Text Files etc)
Transformations: Cleans, modify, merge and summarizes the data
Destination: Loads data into destinations like database, files or in memory datasets
Q42. What is difference between For Loop and For Each Loop?
A for loop will execute the tasks a specified number of times, in other words 10 times, or 25 times,
and the number of times is specified in the definition of the container. You can use a variable to
specify what that count is.
A for each loop will execute once for each item in the collection of items that it is looking at. A good
example would be if users are putting an Excel file into a directory for import into the DB. You cannot
tell ahead of time how many will be in the directory, because a user might be late, or there might be
more than one file from a given user. When you define the ForEach container, you would tell it to
execute for each *.xls in the directory and it will then loop through, importing each one individually,
regardless of how many files are actually there.
Q43. What is the difference between “OLEDB command” transformation and “OLEDB” destination
in dataflow?
The OLE DB Command is a pretty simple transformation that’s available within a Data Flow that can
run a SQL statement that can insert, update, or delete records to, in, or from a desired table.  It’s
good to keep in mind that this transformation initiates a row-by-row operation, so you may
experience some performance limitations when dealing with large amounts of data.
OLEDB destination can use Fast Load options hence perform bulk uploads.
Q44. What is the Difference between merge and Merge Join Transformation?
Merge Transformation:
The data from 2 input paths are merged into one
Work as UNION ALL
Metadata for all columns needs to be same
Use when merging of data from 2 data source
Merge Join Transformation:
The data from 2 inputs are merged based on some common key.
Work as JOIN (LEFT, RIGHT OR FULL)
Key columns metadata needs to be same.
Use when data from 2 tables having foreign key relationship needs to present based on common key
Q45. What is the difference between “ActiveX Script” and “Script Task”?
We could say “Script Task” is the latest version for the deprecated feature “ActiveX Script”. Both are
used to implement extended functionality in SSIS.
ActiveX script supports VBScript and JScript where as “Script Task supports “VB.Net and C#.Net”.
“Script Task” is preferable as “ActiveX Script” has been removed in MSSQL 2012.
Script Task is supported with integrated help, IntelliSense, debugging and can reference external
Dotnet assembles.
Q46. What is the difference between “Script Task” and “Script Component”?
Both are used to extend the native functionality of SSIS.
“Script Task” is to enhance the functionality for control flow where as “Script Component” is to
enhance the functionality for Data flow.
“Script Task” can handle the execution of parts of the package where as “Script Component” can
handle the data flow and transformations by processing row by row.
Q47. What is the difference between “Execute SQL Task” and “Execute T-SQL statement” Task?
The Execute T-SQL Statement task takes less memory, parse time, and CPU time than the Execute
SQL task, but is not as flexible.
If you need to run parameterized queries, save the query results to variables, or use property
expressions, you should use the Execute SQL task instead of the Execute T-SQL Statement task
Execute T-SQL Statement task supports only the Transact-SQL version of the SQL language
Execute SQL task supports many connection types but the Execute T-SQL Statement task supports
only ADO.NET
Q48. What is the difference between “Data Conversion” and “Derived Column” transformations?
Data Conversion transformation is used to convert the datatype of a column. Same operation can be
done using “Derived Column “transformation using typecast but derived column can also be used to
add / create a new column by manipulating the existing column based on expressions.
We have to choose “Data Conversion” when the requirement is only intended to change the
datatype. In other words “Data Conversion” is introduced just for developer convenience as it’s a
direct method where as in “Derived Column” we have to use an expression to change the datatype
of a column.
From 2008 in “Derived Column” transformation, datatype and length information is read only, when
we create a new column or created from existing, data type would be assigned based on the
expression outcome and the datatype is a read-only column.
To change the datatype we have to use “Data Conversion” transformation.
 
Q49. What is the difference between “Copy Column” and “Derived Column”?
Both transformations can add new columns.
Copy column can add new columns only through existing columns but coming to Derived column it
can add new columns without any help from existing columns.
Derived Column can assign different transformations and data types to the new columns whereas
Copy Column cannot.
Derived Column supports error output whereas Copy Column cannot.
Q50. What is the difference between UNIONALL and MERGE transformations?
The Merge transformation combines two sorted datasets into a single dataset. The rows from each
dataset are inserted into the output based on values in their key columns.
The Merge transformation is similar to the Union All transformations. Use the Union All
transformation instead of the Merge transformation in the following situations:
The transformation inputs are not sorted.
The combined output does not need to be sorted.
The transformation has more than two inputs.
 
Q51. What is the difference between for loop and for each loop container?
The “For Loop Container” executes specified number of times like 10 times, 20 times until the
specified condition is met.
The “Foreach Loop Container” runs over an iterator. This iterator can be files from a folder,
records from ADO, data from a variable etc.
Q52. How to pass property value at Run time? How do you implement Package Configuration?
A property value like connection string for a Connection Manager can be passed to the pkg using
package configurations. Package Configuration provides different options like XML File, Environment
Variables, SQL Server Table, Registry Value or Parent package variable.
Q53. How would you deploy a SSIS Package on production?
Using Deployment Manifest
Create deployment utility by setting its property as true.
It will be created in the bin folder of the solution as soon as package is build.
Copy all the files in the utility and use manifest file to deploy it on the Prod.
Using import/Export and scheduling a job
Q54. What are the new features added in SQL Server 2008 SSIS?
Improved Parallelism of Execution Trees
.NET language for Scripting
New ADO.NET Source and Destination Component
Improved Lookup Transformation
New Data Profiling Task
New Connections Project Wizard
DT_DBTIME2, DT_DBTIMESTAMP2, and DT_DBTIMESTAMPOFFSET data types
Improved Parallelism of Execution Trees: The biggest performance improvement in the SSIS 2008 is
incorporation of parallelism in the processing of execution tree. In SSIS 2005, each execution tree
used a single thread whereas in SSIS 2008, the Data flow engine is redesigned to utilize multiple
threads and take advantage of dynamic scheduling to execute multiple components in parallel,
including components within the same execution tree
.NET language for Scripting: SSIS 2008 is incorporated with new Visual Studio Tool for
Application(VSTA) scripting engine. Advantage of VSTA is it enables user to use any .NET language for
scripting.
New ADO.NET Source and Destination Component: SSIS 2008 gets a new Source and Destination
Component for ADO.NET Record sets.
Improved Lookup Transformation: In SSIS 2008, the Lookup Transformation has faster cache loading
and lookup operations. It has new caching options, including the ability for the reference dataset to
use a cache file (.caw) accessed by the Cache Connection Manager. In addition same cache can be
shared between multiple Lookup Transformations.
New Data Profiling Task: SSIS 2008 has a new debugging aid Data Profiling Task that can help user
analyze the data flows occurring in the package. The Data Profiling Task can help users to discover
the coerce of these errors by giving better visibility into the data flow.
New Connections Project Wizard: One of the main usability enhancements to SSIS 2008 is the new
Connections Project Wizard. The Connections Project Wizard guides user through the steps required
to create source and destinations.
DT_DBTIME2, DT_DBTIMESTAMP2, and DT_DBTIMESTAMPOFFSET data types – facilitate data type
mapping to equivalent T-SQL date/time data types introduced in SQL Server 2008. Their primary
purpose is to provide support for more accurate time measurements.
Q55. What are Synchronies and Asynchronous transformations in SSIS?
Synchronizes Transformations:
A synchronous transformation processes incoming rows and passes them on in the data flow one
row at a time. Output is synchronous with input, it occurs at the same time. Therefore, to process a
given row, the transformation does not need information about other rows in the data set. When a
transform can modify the row in place so as to not change the physical layout of the result set, it is
said to be a synchronous transformation. The output of a synchronous component uses the same
buffer as the input and does not require data to be copied to a new buffer to complete the
transformation. Reuse of the input buffer is possible because the output of a synchronous
component usually contains the same number of records as the input;
An example of a synchronous transformation is the Data Conversion transformation. For each
incoming row, it converts the value in the specified column and sends the row on its way. Each
discrete conversion operation is independent of all the other rows in the data set.
Asynchronous Transformations:
The output buffer or output rows are not in sync with the input buffer; output rows use a new
buffer. In these situations, it’s not possible to reuse the input buffer because an asynchronous
component can have more, the same or less output records than input records.
The component has to acquire multiple buffers of data before it can perform its processing. An
example is the Sort transformation, where the component has to process the complete set of rows
in a single operation.
The component has to combine rows from multiple inputs. An example is the Merge transformation,
where the component has to examine multiple rows from each input and then merge them in sorted
order.
There is no one-to-one correspondence between input rows and output rows. An example is the
Aggregate transformation, where the component has to add a row to the output to hold the
computed aggregate values.
Asynchronous components can further be divided into the two types described below:
Partially Blocking Transformation – the output set may differ in terms of quantity from the input set.
Thus new buffers need to be created to accommodate the newly created set.
Blocking Transformation – a transformation that must hold one or more buffers while it waits on one
or more buffers, before it can pass that buffer down the pipeline. All input records must read and
processed before creating any output records. For example, a sort transformation must see all rows
before sorting and block any data buffers from being passed down the pipeline until the output is
generated.
Q56. Any Idea About execution tree?
At run time, the data flow engine breaks down Data Flow task operations into execution trees. These
execution trees specify how buffers and threads are allocated in the package. Each tree creates a
new buffer and may execute on a different thread.
Execution trees are enormously valuable in understanding buffer usage. They can be displayed for
packages by turning on package logging for the Data Flow task
Q57. Where are SSIS package stored in the SQL Server?
SQL Server 2000: MSDB..sysdtspackages
SQL Server 2005: MSDB..sysdtspackages90
SQL Server 2008: MSDB..sysssispackages
 Stores the actual content and the following tables do the supporting roles.
Sysdtscategories
sysdtslog90
sysdtspackagefolders90
sysdtspackagelog
sysdtssteplog
sysdtstasklog
2008:
sysssispackagefolders
sysssislog
Q58. How to achieve parallelism in SSIS?
Parallelism is achieved using MaxConcurrentExecutable property of the package. Its default is -1 and
is calculated as number of processors + 2.
Q59. Differences between dtexec.exe and dtexecui.exe
Both dtexec.exe and dtexecui.exe execute SSIS packages in the same manner. The difference is that
dtexecui provided a graphical user interface to construct the command line arguments for dtexec.
The command string that is generated with dtexecui can be used as command line arguments to
dtexec.
Q60. Demonstrate or whiteboard how you would suggest using configuration files in packages. 
Would you consider it a best practice to create a configuration file for each connection manager or
one for the entire package?
There should be a single configuration file for each connection manager in your packages that stores
their connection string information.  So if you have 6 connection managers then you have 6 config
files.  You can use the same config file across all your packages that use the same connections.
If you have a single config file that stores all your connection managers then all your packages must
have contain the connection managers that are stored in that config file.  This means you may have
to put connection managers in your package that you don’t even need.
Q61. Demonstrate or whiteboard using a loop in a package so each file in a directory with the .txt
extension is loaded into a table.  Before demonstrating this tell which task/container accomplishes
this and which enumerator will be used. 
This would require a Foreach Loop using the Foreach File Enumerator.  Inside the Foreach Loop
Editor you need to set a variable to store the directory of the files that will be looped through.  Next
select the connection manager used to load the files and add an expression to the connection string
property that uses the variable created in the Foreach Loop.
Q62. What techniques would you consider to add notification to your packages?  You’re required
to send emails to essential staff members immediately after a package fails.
This could either be set in the SQL Agent when the package runs or actually inside the package you
could add a Send Mail Task in the Event Handlers to notify when a package fails.
There are also third party tools that can accomplish this for you (Pragmatic Works BI xPress).
Q63. Have you used SSIS Framework?
This is common term in SSIS world which just means that you have templates that are set up to
perform routine tasks like logging, error handling etc. Yes answer would usually indicate experienced
person, no answer is still fine if your project is not very mission critical.
Q64. How many difference source and destinations have you used?
It is very common to get all kinds of sources so the more the person worked with the better for you.
Common ones are SQL Server, CSV/TXT, Flat Files, Excel, Access, Oracle, MySQL but also Salesforce,
web data scrapping.
Q65. What configuration options have you used?
This is an important one. Configuration should always be dynamic and usually is done using XML
and/or Environment Variable and SQL Table with all configurations.
Q66. How do you apply business rules in SSIS (Transformations….Specific calculations but
also cleansing)?
Some people use SSIS only to extract data and then go with stored procedures only….they are
usually missing the point of the power of SSIS. Which allow creating “a flow” and on each step
applies certain rules this greatly simplifies the ETL process.
Q67. Give example of handling data quality issues?
Data Quality is almost always a problem and SSIS handles it very well. Examples include importing
customers from different sources where customer name can be duplicates. For instance you can
have as company name: SQL Server Business Intelligence but also SQL Server BI or SQL Server BI LTD
or SQL Server BI Limited or inteligence (with one l). There are different ways to handle it. Robust and
time consuming is to create a table with or possible scenarios and update it after each update. You
can also use fuzzy grouping which is usually easy to implement and will make usually very good
decisions but it is not 100% accurate so this approach has to be justified.
Other typical quality issues are nulls (missing values), outliers (dates like 2999 or types like 50000
instead of 5000 especially important if someone is adjusting the value to get bigger bonus), incorrect
addresses and these are either corrected during ETL, ignored, re-directed for further manual updates
or it fails the packages which for big processes is usually not practiced.
Q68. When to use Stored Procedures?
This one is very important but also tricky. ALL SSIS developers have SQL Server background and that
is sometime not very good if they use SQL not SSIS approach.
Let’s start with when you typically use SPs. This is for preparing tables (truncate), audit tasks (usually
part of SSIS framework), getting configuration values for loops and a few other general tasks.
During ETL extract you usually type simple SQL because it comes from other sources and usually over
complication is not a good choice (make it dynamic) because any changes usually affect the package
which has to be updated as well.
During Transformation phase (business rules, cleaning, core work) you should use Transformation
tasks not Stored procedures! There are loads of tasks that make the package much easier to develop
but also a very important reason is readability which is very important for other people who need to
change the package and obviously it reduces risks of making errors. Performance is usually very good
with SSIS as it is memory/flow based approach. So when to use Stored Procedures for
transformations? If you don’t have strong SSIS developers or you have performance reasons to do it.
In some cases SPs can be much faster (usually it only applies to very very large datasets). Most
important is have reasons which approach is better for the situation.
Q69. What is your approach for ETL with data warehouses (how many packages you developer
during typical load etc)?
This is rather generic question. A typical approach (for me) when building ETL is to. Have a package
to extract data per source with extract specific transformations (lookups, business rules, cleaning)
and loads data into staging table. Then a package do a simple merge from staging to data warehouse
(Stored Procedure) or a package that takes data from staging and performs extra work before
loading to data warehouse. I prefer the first one and due to this approach I occasionally consider
having extract stage (as well as stage phase) which gives me more flexibility with transformation (per
source) and makes it simpler to follow (not everything in one go). So to summarize you usually have
package per source and one package per data warehouse table destination. There are might be
other approach valid as well so ask for reasons.
Q70. What is XMLify component?
It is 3rd party free component used rather frequently to output errors into XML field which saves
development time.
Q71. What command line tools do you use with SSIS?
dtutil (deployment), dtexec (execution), dtexecui (generation of execution code)
Q72. What is data cleansing?
Used mainly in databases, the term refers to identifying incomplete, incorrect, inaccurate, irrelevant,
etc. parts of the data and then replacing, modifying, or deleting this dirty data.
Q73. Any Idea what is ETI?
Yes! ETI (Error Tolerant Index) is a technique used in Fuzzy Lookup / Fuzzy Grouping for data
cleansing operation. The ETI is a decomposition of the field values contained within a reference table
of values into smaller tokens is nothing but a match index.
For example, instead of searching for a street address that contains the value “112 Sunny Vail Ln.”,
smaller components of the reference value might be used, such as “sunn”, “nyva”, and “112”.
These individual words are called Tokens, and all tokens in a index are divided using some special
character and search with the reference table.

Q74. What is Fuzzy Lookup? Can you demonstrate it?

Fuzzy lookup transformation is data cleaning task that helps to clean the incoming data with the
reference table with the actual value. This transformation tries to find the exact or similar value as a
result. The result data set is also depends on the fuzzy matching configuration in the fuzzy lookup
transformation task. Fuzzy lookup task will be more helpful when you have data typo issues in the
source data.
Fuzzy Lookup transformation creates temporary objects, such as tables and indexes in the SQL
Server TempDB. So, make sure that the SSIS user account has sufficient access to the database
engine to create and maintain this temporary table. Fuzzy lookup transformation has 3 features.
Defining maximum number of matches to return to output – It starts with 1 and that is
the recommended.
Token delimiters – It has a set of predefined delimiters and we can also add our’s
Similarity score – It is the fuzzy algorithm input to match the score with the input row and reference
row. This value is between 0 and 1. higher the value is the accurate the result. It is usually 0.60 is the
best value for similarity score.
Q75. What shape would you use to concatenate two input fields into a single output field?
Pivot transformation
Q76. What is the Multicast Shape used for?
The Multicast transformation distributes its input to one or more outputs. This transformation is
similar to the Conditional Split transformation. Both transformations direct an input to multiple
outputs. The difference between the two is that the Multicast transformation directs every row to
every output, and the Conditional Split directs a row to a single output
Q77. What types of things can I pass between packages in SSIS?
We can pass Variables primarily between packages. Within a variable we can pass them as any type
that is available. So if you were to create an object variable, although memory consuming, we could
potentially pass a table that is in memory. Granted, in SQL Server 2012 (Denali) this is much, much
easier now with parameters. Actually, this was almost a relief in a way. Configuring packages to
consume parent variables was a time consuming and in some cases, confusing situation when many
variables were in the process.
Q78. How to accomplish incremental loads? (Load the destination table with new records and
update the existing records from source (if any updated records are available)
There are few methods available:
You can use Lookup Transformation where you compare source and destination data based on some
id/code and get the new and updated records, and then use Conditional Split to select the new and
updated rows before loading the table. However, I don’t recommend this approach, especially when
destination table is very huge and volume of delta is very high.
Use Execute SQL Task and with Staging table
Find the Maximum ID & Last ModifiedDate from destination and store in package variables. (Control
Flow)
Pull the new and updated records from source and load to a staging table (A dataload table created
in destination database) using above variables.(Data Flow)
Insert and Update the records using Execute SQL Task (Control Flow)
Use the feature CDC (Change Data Capture) from SQL Server 2008
Use Conditional split to split data for Inserts. Updates and Deletes
For inserts redirect to a OLEDB Destination
For Updates and Deletes redirect using a OLEDB Command transformation
Q79. How can you enable the CDC for a table?
To enable CDC to a table first the feature should be enabled to the corresponding database. Both
can be done using the below procs.
Exec sys.sp_cdc_enable_db_change_data_capture
sys.sp_cdc_enable_table_change_data_capture
Q80. How can you debug Dataflow?
Microsoft Integration Services and the SSIS Designer include features and tools that you can use to
troubleshoot the data flows in an Integration Services package.
SSIS Designer provides data viewers.
SSIS Designer and Integration Services transformations provide row counts.
SSIS Designer provides progress reporting at run time.
Redirect to specified points using error output
Q81. How to debug control flow?
Integration Services supports breakpoints on containers and tasks.
SSIS Designer provides progress reporting at run time.
Business Intelligence Development Studio provides debug windows.
Q82. What can you tell me about Ralph Kimball?
Ralph Kimball is an author on the topic of data warehousing and BI.  He has been regarded as one of
the original architects of data warehousing.  Kimball has always had the firm belief that data
warehouses should fast and understandable.  Oh, and he developed this whole methodology of
dimensional modeling.  There is that.  (It’s also probably a good idea to know the basic idea and
structure of dimensional modeling)
Q83. Are you familiar with Package Configurations?
Yes. Recently I was working on a project where we used the SQL Server Table package configuration
to store values for the package parameters. That allowed me to build a GUI for the users to update
the package variables each month with new values.
Q84. Have you ever used the XML package configuration?
Yes. In fact, that is the method we use for storing the connection string used by the sql server table
package configuration for the project I just mentioned. We have a dev/production environment, so
using an xml file with the connection string (and pointing to that XML file from an environment
variable) makes it easy to switch between the two servers.
Q85. How to quickly load data into sql server table?
Fast Load option: This option is not set by default so most developers know this answer as otherwise
the load is very slow.
Q86. What are the fast load options available in SSIS?
The OLE DB Destination provides more than one way to load data in the destination (5 types of Data
Access Mode).  Use Fast Load option while loading data into the destination.
Data Access Mode – It allows to define the method to upload data into the destination. The fast load
option will use BULK INSERT statement instead of INSERT statement. If the fast load option is not
selected then by default INSERT is used.
Keep Identity – If selected, the identity values of source are preserved and the same are uploaded
into the destination table. Else destination table will create its own identity values if there is any
column of identity type.
Keep Nulls – If selected, the null values of the source are preserved and are uploaded into the
destination table. Else if any column has default constraint defined at destination table and NULL
value is coming from the source for that column then in that case, default value will be inserted into
the destination table.
Table Lock – If selected, the TABLOCK is acquired on the table during data upload. It is the
recommended option if table is not being used by any other application at the time of data upload as
it removes the overhead of lock escalation.
Check Constraints – Check constraints will always check for any constraint for the data that is coming
through pipeline. It is preferable to uncheck this option if constraint checking is not required. This
will reduce the overhead for the pipeline engine.
Rows per batch – RowsPerBatch is the number of rows you would want in One Buffer. SSIS
automatically sets this property based on the RowSize and MaxBufferRows property. The number of
rows coming from the pipeline per batch can be defined by user. The default value is -1 if it is kept
blank. You can specify the no. of rows as a positive integer (N) so that the records will come as small
segments or batches, each segment containing N no. of rows.
Maximum insert commit size – You can specify the batch size that the OLE DB destination tries to
commit during fast load operations; it actually splits up chunks of data as they are inserted into your
destination. If you provide a value for this property, the destination commits rows in batches that
are the smaller from either (a) the Maximum insert commit size, or (b) the remaining rows in the
buffer that is currently being processed.
Network limitations:  You can transfer data as fast as your network supports. But use them
efficiently; you can customize SSIS to use the maximum bandwidth of your network. You can set
the Packet Size property of the connection manager to an integer value that suits you. The max
value that you can insert is 32767.
Q87. What are the lookup cache modes available and how to use them?
In 2008 we have three different cache modes for lookup transformations.
Full Cache – Default
Partial Cache
No Cache
Full Cache:
The database is queried once during the pre-execute phase of the data flow. The entire reference set
is pulled into memory. This approach uses the most memory, and adds additional startup time for
your data flow. Lookup will not swap memory out to disk, so your data flow will fail if you run out of
memory.
When to use Full cache mode
When you’re accessing a large portion of your reference set
When you have a small reference table
When your database is remote or under heavy load, and you want to reduce the number of queries
sent to the server
Partial Cache:
In this mode, the lookup cache starts off empty at the beginning of the data flow. When a new row
comes in, the lookup transform checks its cache for the matching values. If no match is found, it
queries the database. If the match is found at the database, the values are cached so they can be
used the next time a matching row comes in.
In 2008 there is a new Miss Cache feature that allows you to allocate a certain percentage of your
cache to remembering rows that had no match in the database. This is useful in a lot of situations, as
it prevents the transform from querying the database multiple times for values that don’t exist
When to use this cache mode
When you’re processing a small number of rows and it’s not worth the time to charge the full cache
When you have a large reference table
When your data flow is adding new rows to your reference table
No Cache:
As the name implies, in this mode the lookup transform doesn’t maintain a lookup cache (actually,
not quite true – we keep the last match around, as the memory has already been allocated). In most
situations, this means that you’ll be hitting the database for every row.
When to use this cache mode
When you’re processing a small number of rows
When you have non-repeating lookup indexes
When your reference table is changing (inserts, updates, deletes)
When you have severe memory limitations
Q88. What are the different types of Transformations in SSIS?
Non-Blocking – No blocking
Partial Blocking – The downstream transformations wait for certain periods, it follows start then stop
and start over technique
Full Blocking: The downstream has to be waiting till the data has been released from the upstream
transformation.
Non-blocking transformations
Audit, Cache Transform, Character Map, Conditional Split, Copy Column, Data Conversion, Derived
Column, Export Column, Import Column, Lookup, Multicast, OLE DB Command, Percentage
Sampling, Script Component, Slowly Changing Dimension
Partial blocking transformations: Data Mining, Merge, Merge Join, Pivot, Unpivot, Term Lookup
Fully Blocking Transformations: Aggregate, Fuzzy grouping, Fuzzy lookup, Row Sampling, Sort, Term
Extraction
If you clearly observe Sort is a fully blocking transformation, so it’s better to sort your data using the
SQL command in OLE DB Source instead of using sort transformation. Merge transform requires Sort
but not Union All, so use Union All wherever possible.
Q89. Consider a scenario where I am using “Sort” transformation and my requirement is to after
sort operation completed I have to remove all duplicate records. Duplicate records are defined
based on sort values for example I am sorting result set based on three columns, when these 3
columns are having same values those rows are considered as duplicates. Now my question is
which transformation we have to use to ignore all these duplicate records?
We need not use any specific transformation to remove duplicate records based on sort columns.
There is a feature available at “Sort” transformation itself. We can find an option “Remove duplicate
sort values” at the bottom left corner of SORT transformation editor. Just check that box.
 
Q90. How to avoid the sort transformation in SSIS?
Input datasets are to be in sorted order while dealing with the “Merge” or “Merge Join”
transformations. To avoid the sort transformation, we can directly use a “Query” with order by
clause at data source. But remember we can do that when data source is OLEDB or Excel. When it
comes to flat file we don’t have a choice but choose the best way to implement sort transformation.
For example if there is an aggregate required then apply aggregate before applying the sort
transformation. If possible load flat file data into stage tables, apply sort at database level and load
them at destination. So that we should have two data flows one is to load data from flat files to
stage tables and other is to loading data into destination from stage tables hence we can use
parallelism property.
 
Q91. How an SSIS package or a data flow knows that the input dataset / source dataset is in sorted
order?
If the source dataset is in sorted order or we are using a query with order by at source we have to
explicitly mention this information at “OLEDB” source.
There are two properties that we need to change at OLEDB source.
1. Open OLEDB source advanced editor
2. Go to tab “Input and Output Properties”
3. Select “OLEDB source OUTPUT”
4. In the properties select the value “True” for the property “IsSorted”
5. Expand Output Column list and select the column name and set “SortKeyPosition” value to one.
6. Repeat the step 5 for all columns in order by clause by giving appropriate priority
Q92. What data providers supported for OLEDB connection manager for cache option when
lookup transformation?
SQL Server
Oracle
DB2
Q93. From your customer side one of the architect asked you the below information. “I just
wanted to know how many number of execution trees are being created for SSIS package which
loads data on daily basis.”   How do we know this information?
We actually use custom log events to capture this information.
The log entry “PipelineExecutionTrees” helps us know about the execution trees created at run time.
It includes lots of info for example number of rows stored in a buffer while executing a
transformation etc.
Q94. Do you know when an execution tree created and when it ends in a dataflow? Simply what is
the scope of an execution tree?
The work to be done in the data flow task is divided into multiple chunks, which are called execution
units, by the dataflow pipeline engine.  Each represents a group of transformations. The individual
execution unit is called an execution tree, which can be executed by separate thread along with
other execution trees in a parallel manner. The memory structure is also called a data buffer, which
gets created by the data flow pipeline engine and has the scope of each individual execution tree. An
execution tree normally starts at either the source or an asynchronous transformation and ends at
the first asynchronous transformation or a destination. During execution of the execution tree, the
source reads the data, then stores the data to a buffer, executes the transformation in the buffer
and passes the buffer to the next execution tree in the path by passing the pointers to the buffers.

Q95. While running SSIS package, after 15 min of execution it went to hung state. How you
troubleshoot?
There are three common reasons that hold / hung the SSIS execution.
Resource Bottleneck: Memory / CPU / IO / Network
Blocking / Deadlock: Blocking happens at database level or In accessing a file or reading writing
variables from script task.
Poor Performance query: If SSIS stops at Execute SQL Task look for query using inside the task and
tune it.
Looking through above aspects one can identify the issue, based on that we can provide the
resolution. If everything looks good but still SSIS is in hung state then check the latest service pack is
applied if that’s also passed collect the hung dump file using ADPlus and contact Microsoft support
center.
Q96. SSIS 2008 uses all available RAM, and after package completes Memory is not released?
This is not actually a problem. You have allowed SQL Server to use x amount of memory, so it does.
SQL Server takes that memory as required, up to the limit set, but it does not release it. It can
respond to request from OS, again read up on the fine details, but by default once it has got hold of
some memory it will keep it even if it is not using it currently. The simple reason is that finding and
taking hold of memory is quite expensive to do, so once it has it, it keeps it and then any subsequent
operations that need memory will have it available much faster. This makes perfect sense when you
remember that SQL Server is a service application and more often than not runs on a dedicated
machine.
Q97. What is the property “RunInOptimized”? How to set this property?
If this property is set to true then the SSIS engine ignore the unused/unmapped columns. Means it
does not allocate memory to store data for those columns. At the compilation phase itself SSIS
engine identifies what are the columns from source are using across the package, if it finds any
columns are neither using nor mapping to destination, it simply ignores all those columns.
We can set this property at two levels “Project Level” and “Package Level”.
Project Level: From project properties → debugging → Run-in*****. By default “FALSE”
Package Level: Can find in DataFlow properties. By default “TRUE”
Q98. Does using “RowCount” transformation affect the package performance?
Rowcount component is a synchronous component and it doesn’t actually do anything particularly
resource intensive means the performance degradation of your package should be negligible.
We do use this component to capture the number of inserts, deletes and updates from each data-
flow and then using “OnPost Execute” event this information would be written to a SQL Server table.
 
Q99. A SSIS 2008 package has been crashed due to low memory. How to resolve low memory
issues with SSIS package?
1. Add more memory to the physical machine
2. Run SSIS package on a computer that is not running an instance of SQL Server
3. When SSIS and SQL instance on the same machine, balance the memory allocated to SQL Server
instance using “MAX Server Memory” option.
4. Run SSIS package components in series instead of parallel
 
Q100. How to identify the SSIS processes?
SSIS run-time processes include the DTExec.exe process and the DTSHost.exe process.
 Q101. How to enable containers continue to run even a task failed inside the container? Suppose
you have an application, where we need to loop through some log table based on the IDs & load
data into the destination. Now, in this scenario there might be the situation where some of the
tasks in foreach loop container may fail. But your requirement is even though the inner tasks fail
we should process the other sources which are available with us.
We can do this by updating the propagation property of a task / container to “False”. It means that
the loop or sequence container ignores the failure of an internal task.
Assume we have designed a foreach loop container with a dataflow task. As per our requirement
DFT is loading 100 files into database if DFT is failed to load 47th file it should skip the error and
should continue to load from 48th file.
Steps to accomplish this are:
Select the Data Flow Task and go to event handler
Enable the On Error Event handler.
In the Event Handler tab, click on the “Show System Variables”.
Now select the “Propogate” property & change its value to “False”.
This will ensure that the parent control i.e. For Each loop will not know about the error in the child
task.
If incase the foreach loop container is having more than one task, instead of setting the property to
all these tasks, add all these tasks to sequence container and change the “Propagate” property of
sequence container.
Q102. What is ForceExecution property in SSIS component properties?
ForceExecution is a property of Control flow elements in SSIS. If it is enabled to any of the element
then ssis engine follows the execution result as per the given parameters. In other words to control
the execution result of any control flow element we can use this property.
ForceExecutionValue: True or False
ForcedExecutionType: <Data type>
ForcedExecutionValue: <Value>, we usually gives as 1 to make suite its true.
 
Q103. How to improve the performance of a SSIS package?
1- Utilize parallelism: It is easy to utilize parallelism in SSIS. All you need to do is to recognize which
Data Flow Tasks (DFTs) could be started at the same time and set the control flow constraints of your
package in the way that they all can run simultaneously.
 2- Synchronous vs. Asynchronous components: A synchronous transformation of SSIS takes a buffer,
processes the buffer, and passes the result through without waiting for the next buffer to come in.
On the other hand, an asynchronous transformation needs to process all its input data to be able to
give out any output. This can cause serious performance issues when the size of the input data to
the asynchronies transformation is too big to fit into memory and needs to be transferred to HDD at
multiple stages.
 3- Execution tree: An execution tree starts where a buffer starts and ends where the same buffer
ends. These execution trees specify how buffers and threads are allocated in the package. Each tree
creates a new buffer and may execute on a different thread. When a new buffer is created such as
when a partially blocking or blocking transformation is added to the pipeline, additional memory is
required to handle the data transformation; however, it is important to note that each new tree may
also give you an additional worker thread.
 4-OLE DB Command transformation: OLE DB Command is a row-by-row transformation, meaning
that it runs the command in it on each one of its input rows. This make sit to be damn too slow when
the number of the rows goes up. The solution for boosting performance is to stage data into a
temporary table and use Execute SQL Task outside that DFT.
 5-SQL Server Destination vs. OLE DB Destination: There is multiple reason why to use OLE DB
Destination and not use SQL Server Destination:
OLE DB Destination is mostly faster,
OLE DB Destination is a lot clearer when it fails (The error message is more helpful),
SQL Server Destination works only when SSIS is installed on the destination server.
6- Change Data Capture (CDC): Try to reduce the amount of data to be transferred to the maximum
level you can, and do it as close to the source as you can. A Modified On column on the source
table(s) helps a lot in this case.
 7- Slowly Changing Dimension (SCD) transformation: There is only one advice about SSIS’s Slowly
Changing Dimension transformation, and that is get rid of it! The reasons are:
It doesn’t use any cached data, and goes to the data source every single time it is called,
It uses many OLE DB Command transformations,
Fast Data Load is off by default on its OLE DB Destination.
 8. Choose the best way in designing Data flow between SQL and SSIS: Remember SSIS is good at
Row by Row operations where AS SQL is not. So depends on the situation design data flow using DFT
components instead of executing a query using “Execute SQL Task”.
 9. Use queries for selecting data rather than selecting a table and checking off the columns you
want. This will reduce the initial record set before SSIS gets it rather than ignoring the fields
 10. Carefully deal with your connections. By default, your connection manager will connect to the
database as many times as it wants to. You can set the RetainSameConnection property so it will
only connect once. This can allow you to manage transactions using an ExecuteSQL task and BEGIN
TRAN / COMMIT TRAN statements avoiding the overhead of DTC.
 11. While running the package with in BIDS ensure you set the package to run in optimized mode.
 12. While loading data into destination tables it’s helpful to use the “Fast Load option”.
13. Wherever possible Consider aggregating and (un)pivoting in SQL Server instead doing it in SSIS
package – SQL Server outperforms Integration Services in these tasks;
 14. Avoid manipulating large datasets using T-SQL statements. All T-SQL statements cause changed
data to write out to the transaction log even if you use Simple Recovery Model.
 15. For large datasets, do data sorts at the source if possible.
 16. Use the SQL Server Destination if you know your package is going to run on the destination
server, since it offers roughly 15% performance increase over OLE DB because it shares memory with
SQL Server.
 17. Increase the network packet size to 32767 on your database connection managers. This allows
large volumes of data to move faster from the source servers.
 18. If using Lookup transforms, experiment with cache sizes – between using a Cache connection or
Full Cache mode for smaller lookup datasets, and Partial / No Cache for larger datasets. This can free
up much needed RAM.
 19. Make sure “Lock Options” is using while loading very large datasets as bulk insert happens when
it satisfies the below conditions.
a) Destination table is empty
b) Destination database recovery model is either simple or bulk insert
c) When table lock option specified
20. Experiment with the DefaultBufferSize and DefaulBufferMaxRows properties. You’ll need to
monitor your package’s “Buffers Spooled” performance counter using Perfmon.exe, and adjust the
buffer sizes upwards until you see buffers being spooled (paged to disk), then back off a little.
 21. Do all set based, aggregations and sort operations at source or destination using T-SQL.
 22. If possible always use “NOLOCK” at source and “LOCK” at destination.
 23. While loading to data warehouses try to disable the indexes while loading.
Q104. Can you explain the settings “Rows Per Batch” and “Maximum Insert Commit Size”?
These options are available at “OLEDB destination” in DFT.
Rows per batch – The default value for this setting is -1 which specifies all incoming rows will be
treated as a single batch. You can change this default behaviour and break all incoming rows into
multiple batches. The allowed value is only positive integer which specifies the maximum number of
rows in a batch.
Maximum insert commit size – The default value for this setting is ‘2147483647’ (largest value for 4
byte integer type) which specifies all incoming rows will be committed once on successful
completion. You can specify a positive value for this setting to indicate that commit will be done for
those number of records. You might be wondering, changing the default value for this setting will
put overhead on the dataflow engine to commit several times. Yes that is true, but at the same time
it will release the pressure on the transaction log and tempdb to grow tremendously specifically
during high volume data transfers.
 
Q105. Can you explain the DFT properties “DefaultBufferMaxRows” and “DefaultBufferMaxSize”?
The data flow task in SSIS (SQL Server Integration Services) sends data in series of buffers. How much
data does one buffer hold? This is bounded by DefaultBufferMaxRows and DefaultBufferMaxSize,
two Data Flow properties. They have default values of 10,000 and 10,485,760 (10 MB), respectively.
That means, one buffer will contain either 10,000 rows or 10 MB of data, whichever is less.
You can adjust these two properties based on your scenario. Setting them to a higher value can
boost performance, but only as long as all buffers fit in memory. In other words, no swapping please!
 
Q106. How can we connect to Oracle, DB2 and MySQL from SSIS?
Oracle:
Native OLEDB\Microsoft OLEDB Provider for Oracle
Native .Net providers\ or
.Net providers for OLEDB\
 
MySQL:
.Net Providers \ MySQL Data Provider Or
.Net Providers \ ODBC
 
DB2:
Native OLEDB\Microsoft OLEDB Provider for DB2
Native .Net providers\ ,
.Net providers\ ODBC OR
.Net providers for OLEDB\
 
Q107. Can’t we do FastLoad using “ADODotNet Destination”?
Yes, there is an option called “Use Bulk insert when possible” that needs to be tick at the time of
mapping.
 Q108. How to check whether SSIS transformations are using memory or spilling to Disk due to
huge      loads and asynchronous transformations?
A great way to check if your packages are staying within memory is to review the SSIS performance
counter Buffers spooled, which has an initial value of 0; above 0 is an indication that the engine has
started swapping to disk.
 
Q109. How to find how much of total memory allocated to SSIS and SQL Server?
Below are the performance counters which can help us in finding memory details.
Process / Private Bytes (DTEXEC.exe): The amount of memory currently in use by Integration
Services.
Process / Working Set (DTEXEC.exe): The total amount of allocated memory by Integration Services.
SQL Server: Memory Manager / Total Server Memory: The total amount of memory allocated by SQL
Server. Because SQL Server has another way to allocate memory using the AWE API, this counter is
the best indicator of total memory used by SQL Server.
Memory / Page Reads / sec: Represents to total memory pressure on the system. If this consistently
goes above 500, the system is under memory pressure.

Q110. See there is a scenario: We have a package which has to be open using BIDS / SSDT and has
to be modified different elements. But from the location where the SSIS has to be open and
modified is not having permissions to access the databases hence all connection managers and
other location constraints will fail in validation phase and it takes lot of time to validate all of
these connections. Do you have any idea how to control this validation phase?
Below are the different methods to switch off the package validation.
Work OffLine: There is a option called Work Offline. It doesn’t try to locate/validate packages. Once
the package is ready then we have to uncheck the option Work Offline from SSI menu.
Delay Validation: Set the values to “True” to skip the validation while opening the package. It only
applies for executables / control flow elements including package.
ValidateExternalMetadata: Property is set to be “True” for disabling the validation for dataflow
components.
Q111. What are the SSIS package protection levels?
There are 6 different types of protection levels.
Do not save sensitive – (When exporting using DTUTIL specify for protection- 0)
Encrypt sensitive with user key – 1
Encrypt sensitive with password – 2
Encrypt all with password -3
Encrypt all with user key – 4
Rely on server storage
Do not save sensitive: makes the sensitive data unavailable to other users. If a different user opens
the package, the sensitive information is replaced with blanks and the user must provide the
sensitive information.
Encrypt sensitive with user key: Uses a key that is based on the current user profile to encrypt only
the values of sensitive properties in the package. Only the same user who uses the same profile can
load the package. If a different user opens the package, the sensitive information is replaced with
blanks and the current user must provide new values for the sensitive data. If the user attempts to
execute the package, package execution fails.
Encrypt sensitive with password: Uses a password to encrypt only the values of sensitive properties
in the package. To open the package in SSIS Designer, the user must provide the package password.
If the password is not provided, the package opens without the sensitive data and the current user
must provide new values for sensitive data. If the user tries to execute the package without
providing the password, package execution fails.
Encrypt all with password: Uses a password to encrypt the whole package. The user must provide
the package password. Without the password the user cannot access or run the package.
Encrypt all with user key: Uses a key that is based on the current user profile to encrypt the whole
package. Only the user who created or exported the package can open the package in SSIS Designer
or run the package by using the dtexec command prompt utility
Rely on server storage: Protects the whole package using SQL Server database roles. This option is
supported only when a package is saved to the SQL Server msdb database.
When it is time to deploy the packages, you have to change the protection level to one that does not
depend on the developer’s user key. Therefore you typically have to select
EncryptSensitiveWithPassword, or EncryptAllWithPassword. Encrypt the packages by assigning a
temporary strong password that is also known to the operations team in the production
environment.
Q112. What are the phases of execution of a package when running with DTEXEC?
Command sourcing phase: The command prompt reads the list of options and arguments
Package load phase: The package specified by the /SQL, /FILE, or /DTS option is loaded.
Configuration phase: Options are processed in this order:
Options that set package flags, variables, and properties.
Options that verify the package version and build.
Options that configure the run-time behavior of the utility, such as reporting.
Validation and execution phase: The package is run, or validated without running if
the /VALIDATE option is specified.
Q113. What are the exit codes from DTEXEC?
0: The package executed successfully.
1: The package failed.
3: The package was canceled by the user.
4: The utility was unable to locate the requested package.
5: The utility was unable to load the requested package.
6: The utility encountered an internal error of syntactic or semantic errors in the command line.
Q114. Can you demonstrate the DTEXEC?
Execute a package located on file system:
DECLARE @returncode int
EXEC @returncode = xp_cmdshell ‘dtexec /f “C:\UpsertData.dtsx”‘
To execute an SSIS package saved to SQL Server using Windows Authentication:
dtexec /sq pkgOne /ser productionServer
 
To execute an SSIS package saved to the File System folder in the SSIS Package Store:
dtexec /dts “\File System\MyPackage”
To validate a package that uses Windows Authentication and is saved in SQL Server without
executing the package:
dtexec /sq pkgOne /ser productionServer /va
To execute an SSIS package that is saved in the file system, and specify logging options:
dtexec /f “c:\pkgOne.dtsx” /l “DTS.LogProviderTextFile;c:\log.txt”
To execute an SSIS package that is saved in the file system and configured externally:
dtexec /f “c:\pkgOne.dtsx” /conf “c:\pkgOneConfig.cfg
Q115. Process to upgrade DTS TO SSIS?
1.       Choosing a DTS to SSIS Migration Strategy (Reactive/Proactive)
2.       Capturing SSUA DTS Package Alerts (all categories of notifications)
3.       Building a dev/test environment
4.       Migrating the packages using the selected DTS to SSIS Migration Strategy
5.       Testing/Correcting the resulting SSIS 2008 Packages in the dev/test environment
6.       Deploying and reconfirming the resulting SSIS 2008 Packages work in production as expected
7.       Removing the old DTS Packages from production w/optional SQL Server Agent Jobs
Q116. Does all components are converted automatically from DTS TO SSIS?
Not all components can be upgraded. ActiveX transforms, for instance, present a challenge for the
upgrade wizard, and may not be able to be migrated.
Delete and recreate ODBC connections after package migration
Reconfigure transaction settings after package migration
Replace functionality of ActiveX script attached to package steps after package migration. Use Script
task
After migration, convert the Execute DTS 2000 Task that encapsulates the Analysis Services task to
an Integration Services Analysis Services Processing task.
After migration, re-create the functionality of the Dynamic Properties task by using Integration
Services features such as variables, property expressions, and package configurations.
Q117. Why is the need for data conversion transformations?
This transformation converts the datatype of input columns to different datatype and then route the
data to output columns. This transformation can be used to:
Change the datatype
If datatype is string then for setting the column length
If datatype is numeric then for setting decimal precision.
This data conversion transformation is very useful where you want to merge the data from different
source into one. This transformation can remove the abnormality of the data. Example à The
Company’s offices are located at different part of world. Each office has separate attendance
tracking system in place. Some offices stores data in Access database, some in Oracle and some in
SQL Server. Now you want to take data from all the offices and merged into one system. Since the
datatypes in all these databases vary, it would be difficult to perform merge directly. Using this
transformation, we can normalize them into single datatype and perform merge
Q118. Explain why variables called the most powerful component of SSIS.
Variable allows us to dynamically control the package at runtime. Example: You have some custom
code or script that determines the query parameter’s value. Now, we cannot have fixed value for
query parameter. In such scenarios, we can use variables and refer the variable to query parameter.
We can use variables for like:
Updating the properties at runtime,
Populating the query parameter value at runtime,
Used in script task,
Error handling logic
With various looping logic.
 
Q119. What are the for each loop enumerators available in SSIS?
Below are the lists of various types of enumerators provided by SSIS Foreach Loop Container:
Foreach File Enumerator: It enumerates files in a folder. The plus point here is it can traverse
through subfolders also.
Foreach Item Enumerator: It enumerates items in a collection. Like enumerating rows and columns
in an Excel sheet.
Foreach ADO Enumerator: Useful for enumerating rows in tables.
Foreach ADO.NET Schema Rowset Enumerator: To enumerate through schema information about a
data source. For example, to get list of tables in a database.
Foreach From Variable Enumerator: Used to enumerate through the object contained in a variable.
(if the object is enumerable)
Foreach NodeList Enumerator: Used to enumerate the result set of an XML Path Language (XPath)
expression.
Foreach SMO Enumerator: It enumerates through SQL Server Management Objects (SMO) objects.
Q120. We have a situation that needs to be push data into DB2 database from SQL Server. What
connection manager you use to connect to DB2 running on AS/400?
Primary method to connect to DB2 is “Microsoft OLE DB Provider for DB2”. There is one more
method using ADO.NET data providers \ ODBC Data provider.
OLEDB is always faster than ODBC, but there might be issues with OLEDB to DB2 while dealing with
parameters in queries.
Q121. What is “ActiveX Script” task? Does it available in SQL Server 2012?
The ActiveX Script task provides a way to continue to use custom code that was developed using
ActiveX script. ActiveX script task supports writing scripts using VBScript and Jscript and other
languages installed in the local computer.
This task is to just support’s the backward compatibility with the deprecated component DTS
packages
Now in SQL Server 2012 the “ActiveX Script” has to be upgraded to “Script Task”.
“Script task” supports VB.Net and C#.Net
Q122. What is the use of either “Script task” or “ActiveX Script”?
Implementing customized business logics in SSIS packages. Example using the script task we can
access table values, applies logic and those values can be added to SSIS variables.
Performing complex computations for example modifying date formats using date functions
To access data from sources for which no support from built-in connections, for example a script can
use Active Directory Service Interface (ADSI) to access usernames from AD.
To create a package specific performance counters for example a script can create a performance
counter that can be updated when a complex task or poorly performed task executes.
Q123. What is “Script Component”?
Script component is like a “Script Task” but it is designed for “Data Flow”. It can be useful in below
scenarios.
Apply multiple transformations to data instead of using multiple transformations in the data flow.
For example, a script can add the values in two columns and then calculate the average of the sum.
Use custom formulas and functions for example, validate passport numbers.
Validate incoming column data and skip unmatched records
Script Component support for inputs and outputs
If used as a source: Supports multiple outputs
If used as a transformation: Supports one input and multiple outputs
If used as a destination: Supports one input
Q124. Can we call a web service from SSIS? If Yes how?
Yes! We can call a web service using “Web Service” task. We have to provide HTTP connection
manager and WebServiceDescriptionLanguage (WSDL) file. The output can be stored either in a
variable or on file system (In XML, TXT etc)
Q125. What is the use of derived column in SSIS?
Derived column transformation can process existing column data and apply some functionality.
For example to change the case of a string for a column: can replace the actual column by applying
the expression UPPER (COLUMN) or LOWER (COLUMN).
Can also useful when need to calculate sum values example: Add a new column “Gross Value” by
applying the expression (Column1+Column2)
Applying arithmetic operations like “Round” and calculating date and time differences etc.
In addition with this, it can deal with “NULL” values. When NULL values needs to be populated with
blanks
If incase we can’t perform any of these kind of operations with derived column we have another
option called “Script Transform”
Q126. Which config file we should use for storing SSIS package configurations?
There are different ways to do this. But it’s all depends on requirement and environment. I couldn’t
see any problem which is resolved in one config type and can’t be resolved in other config option.
If you are using a file system deployment, it probably makes more sense to use XML configuration
files.
If you are using a SQL Server deployment, it probably makes more sense to use SQL Server
configurations.
If your ETL solution is managed by the application owner or server administrator, it probably makes
more sense to use XML configuration files.
If your ETL solution is managed by the database administrator, it probably makes more sense to use
SQL Server configurations.
If project team members and/or administrators have past experience and success with a given
configuration type, it probably makes sense to use that type unless there is some compelling project-
specific reason to do otherwise.
Q127. What are the possible issues in handling SSIS packages?
Mostly Data Conversion errors due to datatype mismatches – Truncation of strings, loosing some
decimal points etc
Expression Evolution errors on run time: Unable to evaluate expressions at run time due to wrong
comparisons  etc
Package Validation Errors: When we configure a variable to locate a file on file system which is
actually creates on run time the package files debugging as initially the file is not located at the
specified path. To avoid these issues set the property “DelayValidation” to “True”
Package Configuration Issues: Always make sure that we are using the right package at the right
environment. It always depends on package configuration. Package will be used on dev, test and
prod environments with different config values. If wrong config values are passed to a SSIS package
which may leads to loss of data or data corruption.
To avoid these issues two things we have to consider
1. Use a centralized database to store all SSIS package config values
2. Use different account (either domain or sql) for different environments
3. Tight the security by assigning only required permissions to the SSIS user accounts.
So that even though a dev package runs with the prod credentials it fails to connect to the instance.
When a Variable is using another Variable:
See we usually give a variable as a source for “Execute SQL Task”. But for the variable value is setting
by evaluating an expression which is using another variable.
For example we have created a variable called “FileName” and it’s been using in Execute SQL Task.
But a filename should be evaluated as “B2B_Reports_”+User: BatchID. Here BatchID is another
variable.
By default it fails to evaluate this expression and to fix this we have to change the variable property
“EvaluateAsExpression” to “True”
Running SSIS packages on 64 bit and dealing with Excel files:
Typically excel files are not provided with 64 bit drivers (Excel 2010 has 64 bit but not before).
So to deal with excel files from SSIS which is running on 64 bit is bit difficult task.
There is an option in SSIS which allows SSIS package to support 32 bit execution on 64 bit
environment.
From project properties on debugging page an option called “Run64BitRunTime”. By default it’s set
to be true for SSIS running on 64 bit. We have to modify this to false to handle with 32-bit support
activities. Below are more reasons to use this option
From SSIS where it’s running on 64 bit:
We can’t call a ExecuteDTS package task as it doesn’t support 64 bit
It may raise errors while using Script Task or Script Component. Might be using Dotnet assembles or
COM objects for which there might be no 64 bit support available or drivers are not installed.
Case Sensitive issues:
One of the popular data transformations is a Lookup. It compares column values from two tables.
Unlike T-SQL SSIS is a case sensitive comparison so we have to be careful in handling with these
transformations and tasks.
Q128. What are event handlers in SSIS?
Event handlers allow MSBI developers to monitor and audit SSIS packages. Event handlers can be
associated with SSIS components and executables. Any component that can be added to the control
flow is called as “Executable” plus the package itself. Child components is considered to be child
executable and parent is known as parent executable.
Q129. What are the different types of event handlers?
OnPreValidate, OnPostValidate, OnProgress, OnPreExecute, OnPostExecute, OnError, OnWarning,
OnInformation, OnQueryCancel, OnTaskFailed, OnVariableValueChanged, OnExecStatusChanged
Q130. What are the general cases that event handlers can be helpful in?
Cleanup stage tables after a bulk load completed
Send an email when a specific component failed
Load lookup tables after a task completed
Retrieve system / resource information before starting a task.
Q131. How to implement event handlers in SSIS?
Create log tables (As per the requirement) on centralized logging database
On BIDS / SSDT add event handler
Add control flow elements. Most of the times “Execute SQL Task”
Store the required information (RowCounts – Messages – Time durations – System / resource
information).
We can use expressions and variables to capture this information.
Q132. What is container hierarchy in attaching event handlers?
Container hierarchy plays a vital role in implementing “Event Handlers” in SSIS. If an event handler is
attached to a “Package” (a package itself it’s a container), then, the event handler applies to all
associated components of that package. We need not attach the event handlers to all of them
separately. But if we want to switch off the event handlers to any of the specific component in a
container simply change the property “Disable Event Handlers” to “TRUE”.
Q133. How to implement SCD (Slowly changing dimension) type 2 using SSIS?
Type 2 means we have to keep historical data.
Assume that we have a table called “Employee_Stage” at Stage Server and “Employee_Archieved” at
Archive Server.
Now we have to read data from stage and insert into archive instance.
We have to implement SCD type 2, means we have to keep the changed records information. For
example for an employee a column “Designation” has been changed then a new row has to be
inserted into archive.
While inserting there are three columns that helps us in identifying the old and current records for a
given employee.
StartDate – startdate for the given designation
EndDate – enddate for the given designation
IsCurrent – Bit column: 1 – Current; 0 – History
Let’s start designing SSIS package:
As usual create a SSIS project
Create two connection managers. 1. Staging, 2 – Archive
Drag and drop a dataflow task at control flow
Open data flow task and add a OLEDB source and map it with stage connection manager
Drag and drop “SCD transformation” to data flow task.
Double click and configure SCD as below.
Map “Archive” connection manager and choose the “Business Key” in the archive table.
Business key is nothing but a column which can be used to compare / lookup with stage table. Here I
have given “EmpID” as a Business Key.
We have to mention “Change Type” for SCD columns.
There are three change types available as below
‘Fixed attribute’, ‘Changing attribute’ and ‘Historical Attribute’.
I do choose “Historical Attribute” for the column Designation. Based on this a new record will be
inserted into archive if the column value is changed in stage table.
Now give the historical attribute options. There are two options available to identify current and
historical records. Based on a single column, “Based on two date values”
Here I choose the first option and give “1” to current and “0” to expiration
Don’t select “Inferred member support” as this is not useful in this scenario.
Click finish, it’ll automatically creates some transformations and destination that includes “derived
Column” to add flag values to “IsCurrent” column, OLEDB Command to update the “IsCurrent”
column and OLEDB destination to insert new records into archive table.
Note 1: To implement SCD type – 1 (Means overwrite the values) have to follow the same steps
above. Instead of choosing “Hierarchical Attribute” choose “Changing Attribute”.
Note 2: “Fixed Attribute” can be useful at situations where to apply a domain rule for example the
column “NationalNumber” has to be fixed. If the column is forced to overwritten then there would
be an error or it would be redirected but it never allow to be changed.
Q134. Can we use a temp table in data flow that is created in control flow?
Yes we can use. Assume we are executing a stored procedure from “Execute SQL Task”. That stored
procedure creates a global temp table on database and the same temp table has to be used in
dataflow while creating OLEDB source, we can give a query like “SELECT * FROM ##TempTable”.
To use a temp table in SSIS from the same connection some of the properties has to be set as below.
From the properties of OLEDB connection manager change the value to “TRUE” for the property
“RetainSameConnection”.
For OLEDB source in dataflow make sure the property “ValidateExternalMetadata” to “False” as it
fails to locate the temp table at complaining phase.
Q135. Have you ever create templates in SSIS?
Yes! I have created templates for SSIS new package designs.
See in environments where SSIS packages are being utilized often, creating templates are very useful
and saves the development time.
To create a SSIS package template, create a SSIS package with all default required, environment
settings, connection managers and essential data flows and save the package to disk.
Copy the package file (.dtsx file) to the location
2012:
C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\IDE\PrivateAssemblies\ProjectItems\
DataTransformationProject\DataTransformationItems
Might be different based on OS / 32-bit / 64 bit / SQL Server Version etc.
Once the package is copied then create a new SSIS project, right click on project name → Add
Item → from there you can see the template. Select and add it to the project.
Q136. Which is the best method for storing package configurations?
Storing package configurations depends on requirement and operations team. Mean it’s ways
depends on type of config values would be storing and the team which controls the configuration.
There are two famous methods, XML and SQL Server. I do suggest “SQL Server”. Because at the first
we have to consider the aspect “Security”, “SQL Server” is the best place to store package
Configurations from the security prospective.
Best Approach:
1. Store all package configurations in SQL Server
2. Store SQL Server (Where config table exists) into a XML file
3. Stored XML file location in an environment variable
So that for every deployment, we just need to change the table values and environment variable
value.
See for example we are using the same package for all development, test and stage server every
time we need to execute that package we need not have different packages instead we just need
different configuration files by pointing the proper config file using XML and then choosing proper
XML by using environment variable.
 
Q137. Can we validate data in SSIS package?
Yes we can validate data in SSIS using Data Flow Transformations.
But I do suggest do validation at database side. For example instead of applying validation rules at
package level, use a stored procedure at source to apply / check all validations and then from that
select the data which can be directly loaded to destination.
If incase source is not a database instead if it is a flat file, then get all data from flat file and stage it
on SQL Server and apply all validations and load that data to destination table.
By doing this there might be overhead at database but operation would be faster as validations can
be applied or all rows in bulk set operation where as in SSIS the same validation has to be applied as
row by row. And if any modifications required at validations, we can simply modify the stored
procedure and need not touch the SSIS package.
Data Profiler can be used to validate data.
Q138. How to store redirects error information in SQL Server?
We can use an OLEDB destination to “SQL Server” log table and error precedence arrow can be
mapped to this destination.
But to get more error description we have to use a script component between them. To capture the
exact error message use below code at script component:
Public override void Input0_ProcessInputRow (Input0Buffer Row)
{
Row.ErrorDescription = this.ComponentMetaData.GetErrorDescription(Row.ErrorCode);
}
Q139. Give some simple expressions those are used in SSIS?
We usually use “Derived Column” to validate data and we use “Data Conversion” to convert
datatype of a column.
Remove Leading and Trailing Spaces: TRIM(<Column Name>)
http://www.sqlservercentral.com/Forums/Topic733263-148-1.aspx
Check NULL existence:
This example returns “Unknown last name” if the value in the LastName column is null, otherwise it
returns the value in Last Name.
ISNULL(Last Name)? “Unknown last name”:LastName
This example always returns TRUE if the DaysToManufacture column is null, regardless of the value
of the variable AddDays.
ISNULL(DaysToManufacture + @AddDays)
Q140. What is character Map transformation used for?
This transformation is used for applying formations to the column data that includes changing
characters from lower to upper case, upper to lower case, half width, full width, Byte reversal etc.
See when we are using lookup on columns from source and destinations as we know that
SSIS.Lookup is a case sensitive not like T-SQL. So beofore comparing two columns we can design data
flow to pas those two columns through “CharecterMAP” and can convert data into a common
format either “Lower” or “Upper” case.
Q141. What are import and export column transformations?
Import Column Transformation – The Import Column transformation reads data from files and adds
the data to columns in a data flow. Using this transformation, a package can add text and images
stored in separate files to a data flow. *
Export Column Transformation – The Export Column transformation reads data in a data flow and
inserts the data into a file. *
Q142. How matching happens inside the lookup transformation?
Lookup transformation tries to perform an equi-join between transformation input and reference
dataset. By default unmatched row is considered as an error however we can configure lookup to
redirect such rows as “no match output” (from 2008 and above).
If the reference data set is having multiple matches it returns only the first match. In-case the
reference set is a cache then it raises a warning or error in case of multiple matches.
 
Q143. What are all the inputs and outputs of a lookup transformation?
Input: Dataset from data source
Match Output: All matched rows
No Match Output: All not matched rows. If unmatched rows are not configured to redirect to error
output then such rows are redirected to no match output
Error Output: Rows failed to compare or unmatched rows
 
Q144. How to transfer logins using SSIS?
It can be done using Transfer SQL Server Login. But there are limitations.
Transferring windows authentication logins to cross domain: Drop and recreate logins
Transferring SQL Logins: Need to change the password as a random password is chosen while
moving from source to destination.
Best way to move logins is using scripts: Logins, users, role mapping scripts.
Q145. How to troubleshoot connection error regarding?
“DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER”?
1. Incorrect Provider for the connection:
A) Lack of 64-bit provider: Remember on target server if the package is running on 32-bit, make sure
that the execution option “Use 32-Bit runtime” is being selected while creating the job to execute
the SSIS package.
B) Lack of client binary installed: Make sure client binaries installed on target server.
2. Incorrect connection parameters settings:
A) Typo in password
B) Password is not stored in configuration
3. Failed to decrypt the sensitive information: It usually happens when a SSIS package is executing
from SQL Server agent job. If the package is saved with the option “SaveSensitiveWithUserKey” and
the sql agent service account different from package creator.
4. Oracle Data Provider Limitation:
Another common scenario happens when you use Microsoft OLE DB Provider for Oracle or Microsoft
ODBC Driver for Oracle to connect to Oracle9i or later version database. Recommended is Oracle
OLE DB Provider for the Oracle 9i or later versions
Q146. What are the logs available to check if a SSIS package fails?
1. Windows Event Log & Job History: When SSIS package scheduled from a SQL Job
2. Logs from SSIS Logging Audit: When a log provider configured for package
3. Logs from SSIS Event Handler: When event handler designed to capture the log
4. Logs from the SSIS components: When custom logging configured using Script task
5. Logs from underlying data sources: Check the error log at data source example SQL Server, Oracle
etc.