COMP 494: Simulation and Modelling

• Dr.Pheobe N Fedha
• Introduce Modelling, simulation

• Develop appreciation for the need for

simulation

• Applications

• The modelling cycle

 Basics of modeling and simulation
• Man has the ability to define what is
likely to happen in the future and to
chose among alternatives.

• To reduce the level of disparity between

outcome and reality, we can use a
decision analysis and support tools to
enable evaluate, compare and optimise
among alternatives.
• Simulation model: is a computer model that
imitates real life situation.

• A simulation model involves generation of

artificial history of a system and drawing
inferences from it.

• This way you are able to see how the outputs

vary as a function of the varying inputs.
When you run a simulation;
• You allow random variables to take on various
values and you keep track of any resulting output
variables of interest.

• Like mathematical models it explicitly incorporates

uncertainty in one or more complex input
variables.

• The model takes the form of assumptions

concerning the operations of a system. i.e.
mathematical, logical, symbolical relationships
between the entities.
• Simulation of a system is the operation of a
model in terms of time or space, which helps
analyze the performance of an existing or a
proposed system.

• Perform experiments to understand the

behavior of system and evaluating new
strategies. By observing
– events, processes, properties and behavior
of system with a computer model.
• In Simulation we can use mathematical
model to determine the response of the
system in different situations in a
Computer system.

• Simulation can be viewed as a numerical

technique for solving complicated
probability models, ordinary differential
equation and partial differential
equation.
• Through experimentation and
observation, scientists develop theories
that are then tested with additional
experimentation.

• Scientists and engineers translate

mathematical expressions into computer
codes that allow imitate the operation of
the system over time.
• The cause and effect relationships
associated with those discoveries are
represented by;

• mathematical expressions to
approximate the behavior of the system
under study.

• Simulation provides insight into the

processes associated with the model.
• Scientific visualization is concerned with data
extraction to determine which data values
are important and which are not.

• Data manipulation convert the data to other

forms or to different units to enhance
display. i.e.
– A two dimension graph
– A three dimension image

• Visual representation helps identify

important features of the model output
 A simulation
• A simulation is the imitation of the
operation of facility, or real world
process over time.
–know intricacies

–know measures of performance

 Simulation
• According to Shannon : "Simulation is the process
of designing a model of a real system and
conducting experiments with this model for the
purpose of understanding the behavior (with the
limits imposed by a criterion or set of criteria) for
the operation of the system".

• This can assist in the design, creation, and

evaluation of complex systems.
• Designers, program managers, analysts,
and engineers use computer simulation and
modeling to understand and evaluate ‘what
if’ case scenarios.

It is useful when;
• Changes to the actual system are difficult to
implement,

• involve high costs, or are impractical

e.g. weather forecasting, flight simulators
and car crash modeling.
• The model takes a set of assumptions /
approximations concerning the operation of
the system i.e.
– Mathematical relationships
– Logical relationships(Process)
– Symbolic relationships

• If the model structure is simple one can use

mathematical models to answer questions of
interest.
 Through system simulation:
• We can Perform experiments to understand
the behavior of a system and evaluate new
strategies.
– Live
– Virtual
– Constructive

This can be done by observing events,

processes, properties and behavior of system
with a computer model.
 Formal Definition(s)
• Simulation is a technique for studying
real-world dynamical systems by
imitating their behavior using a
mathematical model of the system
implemented on a digital computer.
• In DIP we can translate mathematical expressions
into computer codes to imitate the operation of
the system over time.
f(x,y)=r(x,y)*i(x.y) = analytical solutions
img= imread('apple.jpg');

18
 IN MATLAB
• Simulink is an interactive environment
for modeling, simulating, and analyzing
dynamic, multidomain systems.

• Simulink lets you build block diagrams,

simulate the system’s behavior,
evaluate its performance, and refine
the design.
• Simulink integrates seamlessly
with MATLAB, providing you
with immediate access to an
extensive range of analysis and
design tools.

• These benefits make Simulink

the tool of choice for control
system design, DSP design,
communications system design,
and other simulation
• No universal models exist that can
accurately simulate any business
process.

• Depending on the industry or the

nature of the task, the process may
change over time or contain many
unique unknowns which require
simulation.
Simulation vs Actual System
 The nature of simulation
• Most complex systems require models that
are complex to be valid. uncertainty is ever-
present arising from the model itself,
theoretical flaws, design flaws, and logical
errors.

• These must be studied via simulation i.e.

evaluate the model numerically and collect
data to estimate model characteristics.
 Example consider:
• If Egerton University would like to expand
its existing affiliated colleges. The question
would be whether;

• To build and see if it works or

• Simulate the current scenario and expand its

operations to help investigate many other
issues along the way quickly and cheaply.
• Modeling is the process of representing a
model its construction and its workability.

• Modeling is creating a model which

represents a physical system including its
properties.

• The model should be similar to a real system,

to help the analyst predict the effect of
changes to the system.
• A computer model: is a simulation of a
situation in the real world or an imagery
which has parameters that the user can
alter

• Modeling and simulation: Is a discipline

for developing a level of understanding
of the interaction of the part of a
system and the system as a whole.
To measure and estimate performance,
improve operations and prepare for failures
• Drug screening is another example of how
computer modeling can shorten the time for
discovery.

• The drug screening pipeline requires a model of a

target protein or macromolecular structure that is
associated with a specific disease mechanism.

• A list of potential candidate compounds is then

tested to see which have the highest affinity to
bind to that protein, potentially inhibiting the
medical problem (COVID 19).
• Another example is when we want to decide
on a travel route that gets us to several
shopping locations faster or with the fewest
traffic headaches.

• To do this, we analyze information from

previous trips to make an informed decision
about where there may be heavy traffic,
construction, or other impediments to our
trip
 Formal Definition(s)
• A model describes the mathematical
relationship between inputs and outputs.

• A model is a pattern, plan, representation

or description designed to show the main
object, workings of an object ,system or
concept.

• A model is a mathematical representation

of a system
• Models allow simulating and analyzing the
system. They are never exact

• Modeling depends on your goal

– A single system may have many models
– Always understand the purpose of the model
– Large libraries of standard model templates exist
The main goals of modelling is ;
• Conceptual analysis
• Detailed analysis
 A Simulation model allows;

• An entire distribution of results not simply a single

bottom line result.

• Each different set of values for the uncertain

quantities are to be considered a scenario.

• Companies generate multiple scenarios each leading

to a particular output.

• At the end you see a whole list of distribution

outputs not a single best guess. i.e the average
GETTING ANSWERS FROM MODELS
 The simulation model allows;

• Determine how sensitive a system is to

changes in operating conditions.

• It enables managers to answer what if

questions without actually changing or
building a physical system.
• A spreadsheet simulation is similar to
other modelling applications. Where you
start with input variables and relate to
appropriate excel formulas to produce
output variables of interest.

• The main difference is simulation uses

random numbers to drive the whole
process. These random numbers are
generated with special functions.
 Use Simulation to
• Study internals of a complex system e.g.
biological system

• Optimise an existing design e.g. routing

algorithms, assembly line

• Examine effect of environmental changes e.g.

weather forecasting

• When it is impossible to observe/influence/build

 Use Simulation to
• Know if the system is dangerous or destructive e.g.
atom bomb, atomic reactor, missile launching

• Study importance of variables

• Verify analytic solutions (theories)

• Test new designs or policies

• To inspect system internals that might not

 Use Simulation to
• Get insights into system behavior. By
allowing one to ask what if questions about
how the system change
under different circumstances of model and
its underlying mathematical structure.

• Adjust system parameters in the simulation

model, allow assessment of sensitivity i.e.
scale of impact on the overall system
behavior.
 Use Simulation to;
• Verify analysis of a complex system, or as a
teaching tool to provide insight into
analytical techniques

• To instruct, or avoid tying up or damaging an

expensive, actual system (e.g., a flight
simulation vs. use of multimillion dollar
aircraft)
 Advantages of Modelling and Simulation
• They are cheaper, safer.

• Faster or slower

• More configurable and controllable

• They are less expensive. E.g. practical simulators are

used to train pilots.

• Direct Experimentation can be disruptive

Advantages of Modeling and Simulation:
• Easy to understand: Allows to understand how the
system really operates without working on real-time
systems.

• Easy to test: Allows to make changes into the

system and their effect on the output without
working on real-time systems.

• Easy to upgrade: Allows to determine the system

requirements by applying different configurations
 Advantages of Simulations
• It is used to verify analytical solutions

• They are easier to control than the real world coun

terparts.

• Animation shows the operations so that a plan

can be visualised.

• Designed for training: Learning without the cost

and disruption i.e. on the job training
 Advantages of Simulations
• Time scale can be altered as needed i.e. time
compression or expansion

• It allows comparisons of alternative designs or

operating policies

• When mathematical analysis methods are not

available, simulation may be the only investigation
tool

• When mathematical analysis methods are available

but are so complex simulation may provide a solution
 Advantages of Simulations
• Models help us frame our thinking about objec
ts in the real world.

• Simulated system imitate the operation of

actual system over time .

• Conclusions about actual system

characteristics can be inferred i.e. the actual
system (real system) is compared with
simulation
 Advantages of Simulations
• Artificial history of system can be generated
and observed

• Helps study experimentation with internal

interactions of a complex system or a
subsystem within a complex system.
– Internal (perhaps unobservable) behavior of
system can be studied
 Advantages of Simulations
• Informational, organizational and
environmental changes can be simulated and
the effect observed

• By varying inputs and observing the

resulting output valuable insights may be
obtained into which variables are most
important and how variables interact.
 Advantages of Simulations
• The knowledge gained can be of great
value in suggesting areas of
improvement in the system under
investigation

• Used to experiment with new designs or

policies prior to implementation so as to
prepare for what may happen.
 Advantages of Simulations
• Easy to identifying constraints: Allows to perform
bottleneck analysis that causes delay in the work
process, information, etc.

• Easy to diagnose problems: Certain systems are so

complex that it is not easy to understand their
interaction at a time.

• Modelling & Simulation. New policies, operations,

and procedures can be explored without affecting
the real system.
• It provides a way to study complex, real world systems
that cannot be accurately described by a mathematical
model that can be evaluated analytically.

• Allows estimation of an existing system under some

projected set of operating conditions.

• Allows comparisons of alternate proposed system

designs to see which one best meets a specified
requirement.

• Allows study a system with a long time frame in

compressed time, or alternatively study detailed
working of a system in expanded time.
 Disadvantages:
• Manpower and time-consuming

• Each stochastic simulation provides only

estimates of solution, only solves one
parameter at a time, can take a large amount
of development and/or computer time.

• Don’t use computer simulation if common-

sense or analytical solution is available, or if
resources are insufficient, or if simulation
 Disadvantages:
• Provides only individual, not general solutions

• Mistakes may be made in the programming or

rules of the simulation or model.

• The cost of a simulation or running several

different simulations model can be high.

• Simulation results are difficult to translate. It

requires experts to understand and Time to
make sense of the results.
 Disadvantages:

• Designing a model is an art which requires domain

knowledge, training and experience.

• Operations are performed on the system using

random number, hence difficult to predict the result.

• Simulation requires manpower and it is a time-

consuming process.

• Simulation process is expensive.

 Pitfalls to the successful completion of
a simulation study
 Failureto have a well-defined set of objectives at
the beginning of the simulation study

 Inappropriate level of model detail

 Failure to communicate with management

throughout the course of the simulation study

 Misunderstanding of simulation by management

 Treating a simulation study as if it were primarily

an exercise in computer programming 56
 Pitfalls to the successful completion of
a simulation study
 Using the wrong performance measure

 Failure to collect good system data

 Inappropriate simulation software

 Failure to have people with a knowledge of simulation methodology

and statistics on the modeling team

 Obliviously using simulation software products whose complex

statement may not be well documented and may not implement
the desired modeling logic

57
 Don’t use simulation is
• If t is easy to perform direct experiments

• If system behavior is too complex

• If no data is available about the system not even

estimates.

• The large volume of numbers produced by a

simulation study often creates a tendency to
place greater confidence in a study results than
 Application Areas
• It is used to study the internal structure of a
complex system such as the biological
system.

• It is used while optimizing the system design

such as routing algorithm, assembly line, etc.

• It is used to test new designs and policies. It

is used to verify analytic solutions.
•
APPLICATION AREAS
Designing and analyzing manufacturing systems
• Evaluating military weapons systems or their logistics
requirements
• Determining hardware requirements or protocols for
communications networks
• Determining hardware and software requirements for a
computer system
• Designing and transportation systems such as airports,
freeways, ports, and subways
• Evaluating designs for service organizations such as call
centers, fast-food restaurants, hospitals, and post offices
• Reengineering of business processes
• Determining ordering policies for an inventory system
• Analyzing financial or economic systems 60
 Application Areas
• Military applications,

• training & support,

• designing semiconductors,

• telecommunications,

• civil engineering designs & presentations,

• E-business models.
 PITFALLS IN SIMULATION?
• Simulation can be a time consuming and
complex exercise, from modeling
through output analysisthat require
experts.
• Unclear objective.
• Using simulation when an analytic
solution is appropriate.
• Invalid model.
 PITFALLS IN SIMULATION?
• Simulation model too complex or too simple
•
• Erroneous assumptions.

• Undocumented assumptions. Its important

that assumptions made at each stage of the
simulation modeling and analysis exercise be
documented thoroughly.
 PITFALLS IN SIMULATION?
• Using the wrong input probability
distribution.

• Replacing a distribution (stochastic) by its

mean (deterministic).

• Using the wrong performance measure.

•
• Bugs in the simulation program.
 PITFALLS IN SIMULATION?
• Using standard statistical formulas that
assume independence in simulation
output analysis.

• Initial bias in output data.

• Making one simulation run for a

configuration.
next
• A model, is a simplification of a real system for the
purpose of studying

• It must contain sufficient details to permit valid conclusions to

be drawn about the real system.

• It is a process of representing a system with a specific tool to

study its behavior.

• A model is a pattern, plan, representation or

description designed to show the main object,
workings of an object ,system or concept. Models give
us something to;
 Think about
 MODEL
• A model is a miniature (abstract) representation
of something OR

• A representation of an object, a system or an idea

in some form other than that of the entity itself.

• A mathematical model is a representation of the

behavior of real objects phenomena in
mathematical language. E.g. Algebraic,
differential, integral equations , algorithms,
formulae and theorems.
 Formal Definition(s)
• Object is an entity which exists in the real world
that enable study the behavior of a model. Or
flow units that is translated with time.

• Conceptual/Base Model is a hypothetical explanation

of object properties and its behavior, which is valid
across the model (Here you choose what to model, and
what not to model). It is highly abstract where we hide
complexities at an initial stage.

• It shows key concepts of an explanation theory

and the hypothesized relationship between them.
 Conceptual modeling
Is the process of developing an abstract model or
graphic representation using real world concepts or
ideas.

Various assumptions are made on how the system

functions, they illustrate the dominant processes on
a system and how they are linked.

The processes may include known change in the

system or may encompass the consequence of
change in the factors themselves.
 Conceptual models
• Conceptual models help stakeholders better
understand a situation and are used as a
starting point in participatory or
collaborative modeling.

• Stakeholder groups establish a common

language that encourages innovative
planning, evaluation, and collaborative
decision-making.
• Scientists need to decide whether to build
the model that contains as much detail as
possible. (Closest to the real system and so the
most accurate).
• The problem is
– We have limited knowledge of the real
system and limited time,
– The real system rarely exists at the time of
modeling (it is a proposed world) and a
decision needs to be made given the time
frame.
• To develop a simplified model, we
need to determine the level of
abstraction at which to work.
• Develop the hypothesis
• Identify concepts to study
• Interpret research results
 CONCEPTUAL DATA MODEL?
It is a pictorial representation of
entities and its relattionships
• Only entities are visible
• Easily understood
• Highly abstract
• There is abstract relationship
• No software is required to define the
conceptual data model.
The hardest part building the appropriate
conceptual model and assembling data
 A conceptual data model
• A conceptual data model identifies the highest level of
relationships between different entities. Features of
conceptual data model include
• Important entities and relationships
• No attribute is specified
• No primary keys
• Data model: It is a pictorial
representation of tables it represents
the relationship between tables and it is
easily understood.

• In software development, conceptual

modeling is used as a form of data
modeling to represent abstract
business entities and their relationships.
 Conceptual Dictionary Def
• Conceptual of, relating to, concerned
with, concepts, abstract.

• It concerns with the definitions or

relations of concepts rather than facts.

• Concept is an idea of what something is

or how it works; a mental image.
 Developing ConceptulaModel
• It consist of the following
components:
–system entities,
–input variables
–Functional relationships.
–Performance measures,
 QNS
• If mental how do we document and
communicate?

• If entity/object, relationship, identifier,

domains is this logical

• If we were to add foreign key is this an ER or

relational
• Conceptual modeling: (Robinson 2008a)‘…
Is a non-software specific description of the
computer simulation model (that will be, or
has been developed), describing the
objectives, inputs, outputs, content,
assumptions and simplifications of the
model.’

• It consists of concepts used to help people

know, understand, or simulate a subject the
model represents.
A conceptual model, when implemented properly will ,
• Enhances an individual's understanding of the
representative system

• Facilitate efficient communication of system

details between stakeholders

• Provide a point of reference for system designers

to extract system specifications

• Document the system for future reference and

provide a means for collaboration
To model answer these questions;
–What content will the conceptual
model represent?

–How will the conceptual model be

presented?

–Who will be using or participating

in the conceptual model?
• How will the conceptual model describe
the system?

• What is the focus of observation?

• Will the conceptual model be efficient or

effective in describing the system?
 Logical Dictionary def;
Logical;
• Of or according to the rules of logic or
formal argument; characterized by or
capable of clear, sound reasoning.

• Synonyms: natural, reasonable, sensible,

 Logical data model
• A model of some user domain complete
and understandable in the detail needed
to represent that domain, built
according to and consistent with some
formal modelling scheme with a well
defined scope.

• i.e. It must be understandable: defined,

documented and communicated.
LOGICAL MODEL REQUIRES
 Logical model
• It describes the data in much more detail form
compared to conceptual data model without
any dependency on how it will be in the
physical data model.

• The Components include;

– Primary and foreign key
– Relationships between entities
– Entity attributes
– Tables
 Characteristics of Logical Model
• User friendly attribute names
• More detailed than conceptual model
• More effort is required than the conceptual
model
• Database-agnostic (capacity of software to
function with any vendor's database
management system (DBMS)).
• One can use data modelling tools e.g, ERWin,
Powerdesigner.
 Logical Model
• Like the conceptual model the logical model
defines what to store but not how to store.

• It is platform-independent representation
of the entities and their relationships.

• It is adapted to the type of data storage that

is used (relational database) e.g. MySQL,
Oracle etc.
 Logical model
• It does not handle physical storage
like views or indexes.

• This stage of data modeling provides

organizations with insight pertaining to
the limitations of their current
technologies.
 Physical model ( Tables, columns, data Types etc)
Physical model should have sufficient
details to implement.

It is a stored representation of logical

model.

It deals with how data is encoded and

stored.
 Physical model ( Tables, columns, data Types etc)
It is implemented in some data system
dealing with storage, processing
performance, volumetric (time and
space), partitioning and distribution.
 Physical Model
• Specifies everything related to how the data
is defined in the logical model and stored

• It is enterprise wide and more detailed.

• It is adapted to specific DBMS to be used

• Objects such as Index, Indices, constraints,

triggers, security, keys, indexes, views are
dealt with
Physical Model
• They are used to define the implementation of
logical data models employing a particular
database management system (DBMS).

• They are built with the current or expected (as

is/to be) - technological capabilities.

• Database developers and analysts work with

physical data models to enact the ideas and
processes refined by conceptual and logical
models.
 DEFINITIONS
• A system is a collection of entities that
act and interact together under some
definite conditions, that exist in the real
world. OR

• System: any set of interrelated

components acting together to achieve a
common objective.
• A University system consists of professors,
students and employees these objects act
together to achieve the objective of teaching
& learning process.

• A system consists of input elements that

cause changes in the systems variables.
– The inputs are the experimental factors
that are altered in order to try and achieve
the modeling objectives.
• Output Response Systems (process) define the
relationship between the inputs and output
– The outputs are the statistics that inform us as
to whether the modeling objectives was
achieved.
– Example: The time required to clear all students
from the University system after four years and
if not, why it is not being achieved.

• Knowing the objectives, inputs and outputs

of the model informs the content of the
model.
• In a health setup; the model must be
able to receive the inputs (e.g. it must
model the consultation rooms) and it
must provide the outputs (e.g. it must
model the flow of patients until all have
exited the system).

• The model content can be thought of in

terms of the model scope (what to
model) and the level of detail (how to
model it).
• The state of a system is a collection of
variables and their values needed to describe
the system at any particular time.

• State variables define the state of the system

e,g length of the queue.

• A variable is a mathematical quantity that

defines one key aspect of a system. A variable
may be: Endogenous, Exogenous.

• An endogenous variable (dependent) these are

influenced by one or more independent 105
• Endogenous(dependent variables): If the value
changes it is because there are changes to its
relationships with other variables in the same
model.

• The amount of crop yields is dependent on many

other variables, such as the weather, soil fertility,
water availability, pests, and diseases.

• Supply and demand factors depend on change in

income, changes in consumer preference, growth
in the economy, availability of alternative goods
and services.
• An exogenous variable is a variable that
depends on external factors outside of
the model, so it is not impacted by
variables within the model.
• E.G. rainfall is exogenous to the process
of farming and crop output.

• Assumptions are made either when

there are uncertainties or beliefs about
the real world being modeled.
 Modelling Concepts
• Creating, testing, and applying
mathematical models require an
iterative process.

• It starts with an initial set of

simplifying assumptions , testing,
alteration, and application of the
model
To create a model;
• make assumptions / approximations,
both logical and mathematical, about
how the real system works

• Distill from the mass of details about the

real system, those aspects that are
essential in studying the system

• Use mathematical methods to answer

questions of interest 109
Modelling Process
 Steps in a Simulation Project
1. Problem formulation Phase 1
Problem Definition
2. Set objectives and overall project plan

4. Data Collection
Phase 2
3. Model conceptualization
Model Building
5. Model Translation

No Phase 3
6. Verified
Yes Experimentation
No No
7. Validated
Yes
8. Experimental Design
Phase 4
Implementation
9. Model runs and analysis

Yes No 11. Documentation, reporting

10. More runs
and 112
implementation
 Steps to develop a simulation model.

Problem formulation: Clearly state the problem.

• Step 1: Examine the problem. Understand
the problem and choose its classification
accordingly, such as deterministic or
stochastic.

– Identify the problem with an existing

system or set of requirements of a
proposed system.
• Prepare a problem statement.
Step 2: Setting of objectives and overall
project plan:
• Analyze the problem and define the
objectives of the model.
– This include a review of the literature to
uncover previous research on the topic,
experimental or field-measured data
showing various states of the system and
the measured outcomes, mathematical
representations of the system derived from
theories, and previous modeling efforts
• Several questions must be addressed while
considering the model objectives:

• What are the outcomes that we expect the

model to predict?

• Are we interested in every possible outcome

or is there a subset of conditions that would
satisfy our model objectives? E.g average,
sum etc.
• What level of accuracy is required for
the predicted outcomes?
– This will impact the nature of
simplifying assumptions,

–input data, and

–computing algorithms that are

required to build the model.
Step 3: Model conceptualization i.e. establish a
reasonable model.
• Design the conceptual model while taking care of
the existing system factors and limitations.
• Choose input variables and create entities
for the simulation process.
– Consider decision variables and uncontrollable
variables.
• Decision variables are controlled by the
programmer, these are variables that change
or affect the solution
• Uncontrollable variables are the random variables.
• Step 4: Collect data:
– Collect data as per the system behavior
and future requirements.

– Analyze the system features, its

assumptions and necessary actions to be
taken to make the model successful.

– Determine the variable names, functions,

its units, relationships, and their
applications as used in the model.
Data collection
• Collect the data necessary to run the simulation (such as
arrival rate, arrival process, service discipline, service
rate etc.).

• Collect and start processing the system data,

observing its performance and result.
– Create constraints on the decision variables by assigning
it to the simulation process.

• Provide recommendations after completing the

conceptual process related to the model. It includes
investment, resources, algorithms, techniques, etc.
Step 5: Model translation convert the model into a programming language.

• Develop the model using network

diagrams and verify it using various
verifications techniques.
.
 Verification
• The process of determining whether a
simulation computer program works as
intended and that data accurately represent
the developer’s conceptual description and
specifications.

• Compare the model’s implementation with

the developer's conceptual description and
specifications. (debugging).
 Verification
• Answers the question is the system built
right?
• Has the model and simulation been built
so that they fully satisfy the developer’s
intent (as indicated in specifications)?
• Verification (efficiency)
– Is the model correctly built /
programmed?
– Is it doing what it is intended to do?
 VERIFICATION
• It includes inspection by QA engineers to
confirm that product or service meets the
specified specifications.

• Also known as qualification and must pass

before validation.

• Is done through inspection against drawings,

document reviews, visual checks through
actual site visits and alternative calculations
VALIDATION
Validate the model by comparing its
performance under various conditions with the
real system.
Step 6: Validation

• Collect data from the real-life system to input

into the simulation

• Answer the question are we building the

right system/product.

• This include dynamic testing or simulations

of product or service to confirm that they
meet product applications or purpose.
 Validation;
• Confirms product or service performance in
actual working or usage conditions.

• Is done through human based testing or

computer based simulations by testing or
simulation teams.

• Is initiated only after product or service

passes verification
Validation - an Iterative Calibration Process
 Validation
• Validation is the process of comparing
two results i.e. compare the
representation of a conceptual model to
the real system.

• The process of determining whether the

conceptual model is an accurate
representation of the actual system from
the perspective of the intended uses of
the model.
 Validation
• Did I build the right thing? Will the
model or simulation be able to
adequately support its intended use?
Validation (effectiveness)
–Is the right model built?

–Does the model adequately

describe the reality you want to
model?

–Does the involved decision makers

trust the model? 132
Validation and verification
 KEY DIFFERENCE

• Verification process includes checking of

documents, design, code and program whereas
Validation process includes testing of the actual
product.

• Verification does not involve code execution while

Validation involves code execution.

• Verification checks whether the software confirms

a specification whereas Validation checks whether
the software meets the requirements and
expectations.
 KEY DIFFERENCE

• Verification finds the bugs early in the

development cycle whereas Validation finds
the bugs that verification can not catch.

• In software testing, Verification process

targets on software architecture, design,
database, etc. while Validation process
targets the actual software product.
 KEY DIFFERENCE

• Verification is done by the QA team

while Validation is done by the
involvement of testing team with QA
team.

• Verification process comes before

validation whereas Validation process
comes after verification.
 Can a product pass verification and fail in
validation
• When product application or usage condition
are not factored out while finalising product
or service requirements.

• Wrong assumptions about real working

conditions while finalising product or service
requirements.
Step 7: Experimental design:

• Select an appropriate experimental design as

per requirement.
– Choose an appropriate simulation software
to run the model.
•Determine how many runs? For how long?
•What kind of input variations?
•Production runs and analysis: Actual running
the simulation, collect and analyze the output.
•Repetition: Repeat the experiments if necessary.
Step 8: Document and report:
Create a document of the model for future
use, which include objectives,
assumptions, input variables and
performance in detail.
–Develop a flowchart showing the
progress of the simulation process.

–Document and report the results.

 Summary steps in a Simulation Study

Problem formulation: Clearly state the

problem.
Setting of objectives and overall project plan:
How we should approach the problem.
Model conceptualization: Establish a
reasonable model.
Data collection: Collect the data necessary to run
the simulation (such as arrival rate, arrival
process, service discipline, service rate etc.).
Model translation: Convert the model into a
programming language.
 Steps in a Simulation Study

Verification: Verify the model by

checking if the program works properly.
Use common sense.

Validation: Check if the system

accurately represent the real system.

Experimental design: How many runs?

For how long? What kind of input
variations?
 Steps in a Simulation Study

Production runs and analysis: Actual

running the simulation, collect and
analyze the output.
Repetition: Repeat the experiments if
necessary.
Document and report: Document and
report the results.
 Building a Simulation Model
• General Principles
– The system is broken down into suitable
components or entities
– The entities are modeled separately and are
then connected to a model describing the
overall system
• The basic principles apply to all types of
simulation models
– Static or Dynamic
– Deterministic or Stochastic
– Discrete or continuous
144
• One may go through several
iterations before the model provides
sufficiently accurate results.

• This can be validated against

available experimental or field data
to provide a quantitative assessment
of model accuracy.
• Judgment of whether a model is
giving reasonable results is
sometimes as much an art as a
science.

• Confidence in that judgment is a

function of the experience of the
modeler and the breadth and depth of
the previous research about the system
under study.
 Techniques for Validation
• White box testing methods, classes, details
of implementation. This includes unit and
integration testing.

• White box testing deals with the internal

structure/design/ implementation of
the item being tested and details
are known to the tester.

• Implementation and impact of the

code are tested.
 Black box testing:
• Internal structure/design/implementation
of the item being tested is not known to
the tester.

• Only the external design and structure

are tested. Test based on input output (not
concerned with internal details)
– while designing the model discuss with the system
experts
– The model must interact with the client throughout
the process.
– The output must be supervised by system experts.
NEXT