Applying Probabilistic Risk Management in Design and Construction Projects
Applying Probabilistic Risk Management in Design and Construction Projects
Construction
Industry Implementation Resource 280-2
Institute® Version 1.2
CII Member Companies
Abbott AMEC
Air Products and Chemicals AZCO
Ameren Corporation Alstom Power
American Transmission Company Audubon Engineering Company
Anheuser-Busch InBev BIS Industrial Services
Aramco Services Company Baker Concrete Construction
ArcelorMittal Barton Malow Company
Architect of the Capitol Bechtel Group
BP America Bentley Systems
Barrick Gold Corporation Black & Veatch
Bristol-Myers Squibb Company Burns & McDonnell
CITGO Petroleum Corporation CB&I
Cameco Corporation CCC Group
Cargill CDI Engineering Solutions
Chevron CH2M HILL
ConocoPhillips CSA Group
DTE Energy Coreworx
The Dow Chemical Company Day & Zimmermann
DuPont Dresser-Rand Company
Eastman Chemical Company eProject Management, LLC
Ecopetrol Emerson Process Management
Eskom Holdings Faithful+Gould
ExxonMobil Corporation Flad & Associates
General Electric Company Fluor Corporation
General Motors Corporation Foster Wheeler USA Corporation
GlaxoSmithKline GS Engineering & Construction Corporation
Global Infrastructure Partners Gross Mechanical Contractors
Huntsman Corporation Hargrove Engineers + Constructors
International Paper Hatch
Irving Oil Limited Hilti Corporation
Kaiser Permanente IHI E&C International Corporation
Koch Industries IHS
Eli Lilly and Company Industrial Contractors Skanska
Linde North America JMJ Associates
LyondellBasell JV Driver Projects
Marathon Petroleum Corporation Jacobs
National Aeronautics & Space Administration KBR
NOVA Chemicals Corporation Kiewit Corporation
Occidental Petroleum Corporation Kvaerner North American Construction
Ontario Power Generation Lauren Engineers & Constructors
Petroleo Brasileiro S/A - Petrobras Matrix Service Company
Petroleos Mexicanos McCarthy Building Companies
Petroliam Nasional Berhad McDermott International
Phillips 66 Midwest Steel
Praxair Parsons
The Procter & Gamble Company Pathfinder
Reliance Industries Limited (RIL) Quality Execution
SABIC - Saudi Basic Industries Corporation The Robins & Morton Group
Sasol Technology S&B Engineers and Constructors
Shell Global Solutions US SAIC Constructors
Smithsonian Institution SKEC USA
Southern Company SNC-Lavalin
Statoil ASA The Shaw Group
SunCoke Energy Siemens Energy
TNK-BP Technip
Teck Resources Limited Tenova
Tennessee Valley Authority TOYO-SETAL Engenharia
TransCanada Corporation URS Corporation
U.S. Army Corps of Engineers Victaulic Company
U.S. Department of Commerce/NIST/ Walbridge
Engineering Laboratory Wanzek Construction
U.S. Department of Defense/ Wilhelm Construction
Tricare Management Activity Wood Group Mustang
U.S. Department of Energy WorleyParsons
U.S. Department of Health & Human Services Yates Construction
U.S. Department of State Zachry Holdings
U.S. Department of Veterans Affairs Zurich
Vale
Applying Probabilistic Risk Management in
Design and Construction Projects
March 2013
© 2013 Construction Industry Institute™
CII members may reproduce and distribute this work internally in any medium at no cost to internal recipients. CII members
are permitted to revise and adapt this work for their internal use, provided an informational copy is furnished to CII.
Available to non-members by purchase; however, no copies may be made or distributed and no modifications may be
made without prior written permission from CII. Contact CII at http://construction-institute.org/catalog.htm to purchase
copies. Volume discounts may be available.
All CII members, current students, and faculty at a college or university are eligible to purchase CII products at member
prices. Faculty and students at a college or university may reproduce and distribute this work without modification for
educational use.
1. Introduction 1
2. Example Project Using Risk Management Levels 5
3. Risk Register Tool: Selecting the Appropriate File 13
4. Interpreting the Results 21
5. Conclusion 31
Glossary 33
References 37
1. Introduction
CII Research Team (RT) 280 developed this comprehensive guide to probabilistic
risk analysis, first to help organizations determine whether the probabilistic approach
is appropriate for their projects, and, if appropriate, to help them implement it. The
guide takes the user through the typical steps of adopting probabilistic risk analysis,
from identifying risks to interpreting a probability distribution. In addition to this process
description, the guide also provides an overview of the interactive risk register tool
developed by the research team. Along with this overview and instructions, it offers
an example of a construction project that uses the tool.
In the course of conducting the case studies that were a part of the RT 280
research process, the team interviewed project managers who used probabilistic
methods for risk management. These interviewees consistently reported that, among
the biggest advantages of using this type of risk analysis, is its ability to give them
more certainty in their capacity to successfully execute a project by a set completion
date. They reported that probabilistic controls enable them to anticipate, plan for, and
mitigate extra costs and delays. After analyzing the data from the case studies, the
team determined that the key advantages of using probabilistic over deterministic risk
analysis include the following:
1
1. Introduction
Additional information and details on the case study analysis can be found in Research
Summary 280-1, Probabilistic Risk Management in Design and Construction Projects,
and Research Report 280-11, Methods for Dealing with Uncertainty: Applying
Probabilistic Controls in Design and Construction.
0.14
Level 3: Probabilistic Risk Analysis is the act
0.12
of analyzing risk through probability distribution
0.10
0.08
2
1. Introduction
Because these three levels provided a clear framework for evaluating and
categorizing the case study data, formulating them helped the research team assess
the similarities and differences among the organizations studied; using the framework,
the team was better able to understand how each organization implements project risk
management and probabilistic approaches. The three-tiered framework also made it
easier to define, compare, and understand the benefits and barriers the organizations
experienced at each level.
3
2. Example Project Using Risk Management Levels
To facilitate the implementation of the research, the team developed the three
separate risk registers included with this guide. These registers correlate to the three
levels of risk analysis: Level 1 – Risk Identification; Level 2 – Deterministic Risk Analysis;
and Level 3 – Probabilistic Risk Analysis. This section explains how to use the risk
register for each level and how to interpret the sample outputs of an actual bridge
construction project.
Project Context
The project will upgrade the existing unlimited-access, two-lane US 555 into a
limited-access, four-lane highway. This improvement will include reconstruction of
the existing roadway section. The city anticipates that, where possible, US 555 will
be widened to the north of the existing facility, since right-of-way is more readily
available to the north. If, as assumed, the roadway embankment is supported by
retaining walls, widening the road to the north will affect a 10- to 15-foot-wide strip
of existing Class III wetlands along the eastern half of the upgrade. This widening
will also require construction near a historic building to the south and the crossing of
Wandering Creek, which is home to protected salmon and other animal species. The
project will also involve upgrading the existing unlimited-access, two-lane SH 111 into
a limited-access, four-lane highway. This change will include the reconstruction of the
existing roadway section. Finally, the project will convert the at-grade intersection of
US 555 and SH 111 into a grade-separated interchange.
5
2. Example Project Using Risk Management Levels
6
2. Example Project Using Risk Management Levels
At an early stage in the design, the city conducted a facilitated risk identification
workshop to identify, categorize, and document the risks for the project. The project
team gathered preliminary data for the workshop, including the project scope
description, cost estimate, and construction schedule. The team members were
certain to include all the assumptions about scope, schedule, and cost estimate, as
well as any allowances and contingencies that were made as they were developed.
While the city had hired outside consultants to lead their risk workshops in the past,
this workshop was facilitated by an internal team member who was knowledgeable in
risk management and had risk elicitation training. The facilitator brought a series of risk
checklists maintained by the city to ensure that the team did not miss any commonly
encountered risks. However, these were only used after the team had completed its
brainstorming about project risks.
Key project team members attended the workshop, including the project manager,
design manager, construction manager, and safety officer. People from outside
the project team also attended, including internal discipline leads, a few mangers
with experience from other projects, and a few external consultants, including an
environmental consultant. The workshop facilitator began by asking the team members
to express their key issues and concerns with the project (i.e., what was keeping them
up at night). After a few hours of structured brainstorming and discussion, which
included an examination of the design/estimating and scheduling assumptions, the
team ended up with a categorized list of approximately 50 risks. Figure 4 presents
some of the risks identified in this session. In addition to identifying and describing
the risk, the project team also determined the project phase at which the risk could
occur and the category of its impact (i.e., cost or schedule).
At this point in the project life cycle (design), if the city only wanted to identify
the risks and did not want or need to conduct a more robust analysis, the city would
most likely use its historic contingency average of 10 percent and manage the risks
identified in this Level 1 risk identification workshop. Accordingly, the team would have
budgeted approximately $24 million.
7
2. Example Project Using Risk Management Levels
8
Drop Manual
Manual Manual Manual Drop Down Drop Down
Down (MM/DD/YY)
Delay in request for The city may not meet its RFP development schedule,
5 Active 09/15/12 Procurement Schedule
proposal resulting in a project delay.
The city felt that the risk identification workshop did not provide enough information
for this project, due to the uncertainty and intuitively high costs associated with the
identified risks. In addition, city staff felt that the identified risks should be prioritized.
Thus, the city decided to progress to Level 2, deterministic risk analysis. Using the
same facilitator and team from the risk identification workshop, the city first defined
the meaning of “impact” and “probability” for this specific project. The facilitator and
the workshop team completed the Level 2 risk register input sheet. (See Figure 5.)
Category of Impact
Cost
Value Mean Value
Description
L H (Dollars)
VL Insignificant Cost lncrease 0% 0% $0
L Minimal Cost lncrease 0% 5% $450,000
M Significant Cost lncrease 5% 10% $1,350,000
H Very Significant Cost Increase 10% 20% $2,700,000
VH Critical Cost Increase 20% 40% $5,400,000
Schedule
Value Mean Value
Description
L H (Days) (Dollars)
VL Impact recoverable without affecting critical path 0% 0% 0.0 $0
L Impact recoverable affecting critical path 0% 5% 27.4 $547,500
M Critical path affected 5% 10% 82.1 $1,642,500
H Restructuring of project required 10% 20% 164.3 $3,285,000
VH Major restructuring of project required 20% 40% 328.5 $6,570,000
9
2. Example Project Using Risk Management Levels
The facilitator elicited qualitative assessments for the likelihood and consequences
of each major risk on the project. This was done using historic data when available,
but, most frequently, the facilitator built team consensus to assign the ratings. The
frequency and probability ratings for each risk were used to calculate the overall risk
ratings and mean values for the project. Figure 6 illustrates the completed deterministic
sheet of the risk register tool.
Since the deterministic risk ranking sheet highlights in red the critical risks that
deserve the most attention, it allowed the city to determine where to focus its mitigation
efforts. And, because the ranking sheet also provides risk mean values, the city was able
to determine that it would need approximately $3 million of contingency by summing
these values. The facilitator explained that this sum should only be used as a point of
reference, since overlapping risks can create a contingency value that is unreasonably
high. Conversely, eliminating risks can create a contingency value that is too low. To
increase their confidence and help assess a reasonable contingency value, the city
team members referenced their historic values for contingency on similar projects.
Overall, by conducting the Level 1 and the Level 2 methods, the city increased the
project’s contingency and budgeted approximately $25 million for the project.
10
LEVEL 2 – DETERMINISTIC
Pre-Mitigated Risk Ranking
Change in pavement
High $2,700,000 High 60% $1,620,000 High
section and/or type
Additional wetland
Medium $1,350,000 Very Low 5% $67,500 Low
mitigation
After careful review of the Level 2 outputs, the city felt that a probabilistic approach
to risk management was warranted. Although Level 2 would be sufficient for many
of the city’s smaller projects, this project was larger and more complex than usual.
Thus, the feeling was that a probabilistic risk analysis (Level 3) would provide more
confidence that adequate funds were being allotted for contingency and that the
project’s completion date could be achieved. To conduct the analysis, the facilitator
from the first two workshops once again worked with key project leaders—many of
whom had participated in the previous workshops. In the workshop, the analysis used
three-point estimates for each risk (i.e., worst case, best case, and most likely); the
mean value from the Level 2 analysis served as a point of reference for the “most likely”
value. The facilitator used historic data whenever possible, but in most cases, the best
case, worst case, and most likely values were estimated by team consensus. After the
workshop, the facilitator used the values for best case, most likely, and worst case
columns on the probabilistic risk register sheet and ran a Monte Carlo simulation to
calculate the range and confidence for the project’s cost and schedule. (See Figure 7.)
Based on the Monte Carlo analysis, the project team determined that they had
80-percent confidence that the project would not exceed $26 million and would not
take more than 3.8 years.
12
LEVEL 3 – PROBABILISTIC
Category of Cost (Dollars) Schedule (Days)
Brief Risk Description
Impact Best Case Most Likely Worst Case Best Case Most Likely Worst Case
After conducting the three levels of risk analysis, the team needed to ensure that
the risks were properly managed. Using the allocation and risk mitigation tab in the
risk register tool, the team identified appropriate response strategies for each risk,
assigned a responsible individual to each one, estimated the cost of mitigation, and
determined potential trigger events for all of them. If the team wanted to re-rank the
risks and calculate a new contingency based on the mitigation strategies employed, they
could re-calculate post-mitigated risk values for Levels 1 and 2 using the risk register
for post-mitigation scenarios. The summary tab of the risk register tool populates a
complete risk register on the basis of the previous sheets; this can be used by the
project team to manage and control risks throughout the project’s lifecycle. To monitor
risk exposure and mitigation efforts, retire risks, and identify and quantify new risks,
the team has planned regular status reviews of the project risks. The team also plans
to run an updated Monte Carlo analysis at critical decision points throughout the
project’s life cycle.
By going through all three levels of risk management, the city was able to estimate
the cost and duration of the project more accurately and confidently. Due to the project’s
attributes, including the large project cost and tight schedule, the team decided to
employ all three levels, rather than only implementing the first two. By doing so, the
project’s deterministic and probabilistic cost contingencies were each adjusted by $1
million. Further, the probabilistic analysis also provided the city with a range of potential
outcomes and determined the project cost and schedule at an 80-percent confidence
level. Arriving at such a high level of confidence would not have been possible had
the team stopped at the deterministic level. Again, for many of the city’s smaller
projects with less risk and uncertainty, simply completing Levels 1 or 2 would likely be
sufficient. In contrast, Level 3 has particular value for the more complex projects that
inherently involve greater risk and uncertainty. Because more information is gained as
the analysis progresses through the levels, each provides additional benefits; these
benefits need to be weighed against the additional resources required to successfully
complete each level.
14
3. Risk Register Tool: Selecting the Appropriate File
The purpose of the risk register tool is to help project personnel create project
risk registers. The tool consists of three separate Microsoft Excel®-based risk register
files, one for each corresponding level of risk management: Level 1, Identification;
Level 2, Deterministic Analysis; and Level 3, Probabilistic Analysis. Each risk register
file is independent; the user should select the file that best satisfies the project’s risk
management needs. Use the information in this section to help select the appropriate
risk register file.
Each file contains additional instructions on its particular use. Figure 8 outlines
the risk management process. For a comprehensive overview of each level, including
key considerations of the benefits, results, requirements, and limitations of each level,
please refer to IR 280-3, What’s the Risk? This handy two-page resource will help you
select the level of risk analysis that best suits the project in question. After determining
the appropriate risk management level, open the corresponding risk register file.
15
3. Risk Register Tool: Selecting the Appropriate File
16
No
Level 2 – Deterministic Analysis
Analyze risks through single-point estimates
Is this Select
of potential impacts.
enough? Yes
deterministic
risk register.
No
Level 1 – Identification
Start Identify risks and opportunities, and
progress to other levels if warranted. Is this Select
enough? Yes
identification
risk register.
After selecting the appropriate risk register, open the corresponding risk register
file. Specific instructions for each level are provided below and in the file.
This file provides a template for a Level 1 – Risk Identification risk register. Use this
template if the highest level of risk management for a project is risk identification. While
the risk register for this level will provide a complete Level 1 risk register, the template
can be modified for user-added preferences or additional information. Please review
the tool instructions before proceeding to the subsequent sheets.
The Level 1 risk register tool consists of individual input sheets titled “Level 1 –
Identification” and “Allocation & Risk Mitigation.” In order to populate the file’s last
sheet—the risk register summary sheet—the user must complete these input sheets
as fully as possible. (See Figure 9 for an overview of the Level 1 sheets.) Data should
be entered from left to right.
Level 1 – Identification
Risk Register Sheet Overview
Below is a list of each sheet and the purpose it serves in creating the final risk register.
This is the final sheet of the Level 1 risk register. The entire
Summary sheet is auto-populated on the basis of the data entered
on the previous sheets.
17
3. Risk Register Tool: Selecting the Appropriate File
Data can be entered in each cell in one of four ways: 1) manually (user manually
enters information); 2) using the drop down list (user selects from a pre-populated list
of choices); 3) automatically (user does not enter data in these cells; information is
populated on the basis of data previously entered); and 4) automatically, with manual
override (data are auto-populated, however, users can override that information
with their own values after unprotecting the sheet). Columns are marked according
to the input method used, and each cell displays a message that further explains the
specific information that should be entered.
The Level 2 file provides a template for a deterministic risk analysis risk register.
Use this file if the highest level of risk management for a project is deterministic risk
analysis. This risk register will provide a complete Level 2 risk analysis, but it can be
modified for user-added preferences or additional information. Please review this file’s
instruction sheet before proceeding to the subsequent sheets.
The risk register tool consists of four individual input sheets: 1) Input Sheet;
2) Level 1 – Identification; 3) Level 2 – Deterministic; and 4) Allocation & Risk Mitigation.
In order to populate the file’s last sheet—the risk register summary sheet—the user
must complete these input sheets as fully as possible. (See Figure 10 for an overview
of the Level 2 sheets.) Data should be entered from left to right.
Data can be entered in each cell in one of four ways: 1) manually (user manually
enters information); 2) using the drop down list (user selects from a pre-populated list
of choices); 3) automatically (user does not enter data in these cells; information is
populated on the basis of data previously entered); and 4) automatically, with manual
override (data are auto-populated, however, users can override that information
with their own values after unprotecting the sheet). Columns are marked according
to the input method used, and each cell displays a message that further explains the
specific information that should be entered.
18
3. Risk Register Tool: Selecting the Appropriate File
Level 2 – Deterministic
Risk Register Sheet Overview
Below is a list of each sheet and the purpose it serves in creating the final risk register.
This is the final sheet of the Level 2 risk register. The entire
Summary sheet is auto-populated on the basis of the data entered
on the previous sheets.
19
3. Risk Register Tool: Selecting the Appropriate File
The Level 3 file provides a template for a probabilistic risk analysis risk register.
Use this file if the highest level of risk management for a project is probabilistic risk
analysis. The risk register will provide a complete Level 3 risk analysis and provide
input values for probabilistic modeling software (e.g. Crystal Ball, @Risk, and Primavera
Risk Management, among others). It can be modified for user-added preferences or
additional information. Please review the file’s instruction sheet before proceeding to
the subsequent sheets.
The risk register tool consists of five individual input sheets: 1) Input Sheet;
2) Level 1 – Identification; 3) Level 2 – Deterministic; 4) Level 3 – Probabilistic; and
4) Allocation & Risk Mitigation sheets. In order to populate the file’s last sheet—the
risk register summary sheet—the user must complete these input sheets as fully as
possible. (Level 3 values are not populated in the complete risk register). Data should
be entered from left to right. (See Figure 11 for an overview of the Level 3 sheets.)
Data can be entered in each cell in one of four ways: 1) manually (user manually
enters information); 2) using the drop down list (user selects from a pre-populated list
of choices); 3) automatically (user does not enter data in these cells; information is
populated on the basis of data previously entered); and 4) automatically, with manual
override (data are auto-populated, however, users can override that information
with their own values after unprotecting the sheet). Columns are marked according
to the input method used, and each cell displays a message that further explains the
specific information that should be entered.
20
3. Risk Register Tool: Selecting the Appropriate File
Level 3 – Probabilistic
Risk Register Sheet Overview
Below is a list of each sheet and the purpose it serves in creating the final risk register.
This is the final sheet in the Level 3 risk register. The entire
Summary sheet is auto-populated on the basis of the data entered
on the previous sheets.
21
4. Interpreting the Results
The Monte Carlo simulation is the most commonly used probabilistic approach in
construction and, notably, it was the only probabilistic method used by the case study
participants. A Monte Carlo simulation begins with a deterministic project cost and/or
schedule estimate (i.e., the base estimate) and adds multiple iterations of cost/time
estimates for uncertainty and risk (i.e., the risk estimate). The result is a total estimate
for cost and schedule, presented as a range. The uncertainty can be modeled as
inputs for probability distributions for “known” items (e.g., ranges of units, costs, and
durations) and for “unknown” items (i.e., risks events). Using a computational algorithm,
the Monte Carlo simulation runs hundreds or thousands of simulations, each time using
a different set of values from the cost and duration risk model inputs.
Historic data can generate or inform probabilistic input; however, the uniqueness
of projects often requires expert opinion to adjust and determine the input values for
probabilistic analysis. With proper training and facilitation, experts can provide credible
and defensible probabilistic input values. Group participation with consensus building
helps to increase the accuracy of these input values.
23
4. Interpreting the Results
A risk workshop is a commonly used approach for gathering input for a Monte
Carlo model: a team of subject matter experts (SMEs) reviews the risk profile of the
project and uses its insight and expertise to 1) identify potential risk events (Level 1)
and 2) quantify the most likely impact if a risk were to occur (Level 2). For Level 3
analyses, these workshops include the level of uncertainty of each risk. For instance,
in the triangular distribution, the SMEs would determine inputs for the minimum,
most likely, and maximum values. Although a formal risk workshop is not required to
gather the input values, a workshop provides additional benefits—including knowledge
transfer— that enhance team understanding and alignment regarding potential project
risks. Workshops also help reduce the potential bias of individual participants, though
facilitators need to avoid the potential for group think. If a project is not large or complex
enough to warrant the level of effort required by a full workshop, experienced project
management personnel can develop a reasonable risk-based estimate with individual
input from project team members.
The following factors have a significant effect on the quality and success of a
probabilistic risk analysis approach:
The most advantageous probabilistic analyses are those that require a probability
distribution for schedule and costs risks as an input. When defining an input probability
value, it is important to consider both the central tendency and its range or dispersion.
The central tendency can be described as the typical expected value: in deterministic
24
4. Interpreting the Results
approaches, this is the single-point, expected value. The range is the difference between
the least and greatest values of all the values in a data set. It measures the distance
from the lowest expected value to the highest expected value. Generally accepted
practices include the use of high (maximum), low (minimum), and expected value
(most likely) to make the three-point estimates that are then applied to a triangular
probability distribution. Figure 12 illustrates probability distributions that are common
to probabilistic analysis using Monte Carlo simulation techniques.
Probability
Continuous Distribution:
Triangular Discrete Distributions
Probability
Probability
All four distributions have a single high point (the mode), and a mean value that may
or may not equal the mode. It is notable that some of the distributions are symmetrical
around the average or expected value, while others are not. The most appropriate
probability distributions to use as the bases of Monte Carlo simulations are the ones
25
4. Interpreting the Results
that most closely reflect the distribution of actual or expected data. Historical data on
unit prices, activity durations, and quantity variations should be used when available, but
are often difficult to obtain. In cases in which there are not enough data to completely
define probability distributions, risk managers must rely on a subjective assessment
of the needed input variables. Elicitation of these subjective assessments in a risk
workshop can increase accuracy and add credibility to the analysis.
Project teams should consider the types of outputs that a probabilistic analysis
produces when selecting their risk analysis methods or tools. Generally speaking,
techniques that require increased rigor, demand stricter assumptions, or need more
input data produce more informative and helpful results. Figures 13–16 illustrate several
standard outputs related to cost and time that are unique to probabilistic simulations.
Because these outputs provide richer information regarding cost and schedule, they
support more effective decision-making than do deterministic outputs. These figures
illustrate the output of the Level 3 analysis for the highway overpass described in
Section 4.
The probability mass function graphics in Figures 13 and 14 (i.e., histograms) depict
the results of a Monte Carlo simulation defining the probability distribution of cost and
time based on input assumptions. This type of information is useful for understanding
the expected cost/duration (i.e., mean cost/mean duration) and the range/dispersion
(i.e., standard deviation) of the projected costs and durations. Using this information,
project teams can formulate specific predictions of possible outcomes and use them
for decision-making. In this case, the range of project cost is $14 to $31 million, and
schedule duration range is between 2.5 to 4.25 years.
26
4. Interpreting the Results
0.020
80% Confidence
Probability
0.015 = $26
0.010
0.005
0.000
15 20 25 30
80% 20%
0.015
0.010
0.005
0.000
3.0 3.5 4.0
80% 20%
27
4. Interpreting the Results
Monte Carlo simulations also provide key insights into the probability of specific
outcomes. The cumulative probability functions shown in Figures 15 and 16 provide
the same information shown in Figures 13 and 14, but in a cumulative fashion. The
cumulative functions provide a quick reference to the mean (50-percent probability)
and a confidence level in the estimate or schedule. In this example, an 80-percent
confidence level is shown. This result indicates that a decision maker should be
80-percent confident that the project will not exceed $26 million or 3.8 years. In other
words, the project would not exceed these values eight out 10 times. The accuracy of
these models is, of course, predicated on the accuracy of the inputs and the accuracy
of the model itself.
28
4. Interpreting the Results
Cumulative Probability
0.80
Mean = $22.5
0.60
0.40
0.20
0.00
15 20 25 30
80% 20%
80% Confidence
= 3.8 Years
1.00
Cumulative Probability
0.80
Mean = 3.6 Years
0.60
0.40
0.20
0.00
3.0 3.5 4.0
80% 20%
Year Completion
29
4. Interpreting the Results
What risks have the greatest impact and where should I focus mitigation
efforts?
Sensitivity analysis is a primary modeling output that can be used in the valuation
of the impacts of individual risks. These are calculations that are extremely useful to
risk management and risk mitigation support. Figure 17 provides a sensitivity analysis
in the form of a “tornado diagram.” Tornado diagrams are valuable in that they depict
the sensitivity or influence of individual risks on the overall variability of the risk model.
By graphically showing the correlation between variations in model inputs and the
distribution of the outcomes, tornado diagrams highlight the greatest contributors
to the overall risk. The length of the bars on a tornado diagram corresponds to the
influence of the items on the overall risk (in this case, risk to schedule duration).
Historic Site
Ground improvement
required in interchange
Embankment delays
30
4. Interpreting the Results
Probabilistic risk-based methods are powerful tools for contingency estimation. The
amount of contingency on a project can be defined in a variety of terms, depending
upon the modeler’s preference. As shown in Figures 13 and 15, a contingency can
be defined by the $3.5 million difference between the mean value and the 80-percent
confidence level value. Simulation-based methods allow for the development of a
contingency drawdown curve, such as the one shown in Figure 18. The contingency
can be reduced as risks are realized. If a risk is realized, the contingency will be spent.
If the risk is not realized, the contingency can be returned to the funding source.
Whether spent or returned, the contingency will no longer be needed after the point
in time at which the project risk event is expected to occur. As seen in Figure 17, the
historic site approval/rejection is the risk with the greatest impact on the project cost.
The correlation to this is shown in Figure 18, as a reduction in contingency at the point
in time when the historic site designation is approved or rejected.
Historic site
approval
3
RFP delay
resolved
2
1 Contingency
0
0 1 2 3 4
Time (Years)
31
4. Interpreting the Results
32
5. Conclusion
RT 280 has shown that the use of probabilistic approaches for risk management
is valuable and effective. Employing probabilistic risk management enables project
teams to determine the likelihood of finishing a project per cost and schedule targets.
It also illuminates the risks that have the greatest potential impact to project cost and
schedule durations. Accordingly, the results of probabilistic analysis help project teams
make better decisions and optimize resources by focusing on the most important
risks to mitigate. Using probabilistic methods, team members are empowered to
work proactively rather than react to risk events. These benefits are driving many
organizations in the construction industry to implement probabilistic approaches on
their capital projects.
Clear benefits exist at each of the three risk management levels defined by the
research: identification, deterministic analysis, and probabilistic analysis. While risk
managers gain more information and confidence as the analysis progresses through
the levels, these benefits must be weighed against the additional resources required
to successfully complete each level. Probabilistic risk management is not appropriate
for every design and construction project, due to this cost/benefit tradeoff. This
research describes the benefits, results, requirements, and limitations of each level
to help organizations and projects teams effectively select the appropriate level of
risk management.
Project teams that have risk management at status meetings also benefit through
enhanced communication and team alignment. For effective implementation, project
teams should conduct probabilistic risk analyses on a regular basis, e.g., monthly or
quarterly, or whenever a significant change is identified.
33
5. Conclusion
The RT 280 risk register tools will help project teams with risk management in the
following ways:
This guidance will also help teams interpret the outputs from the simulations to
aid decision making.
34
Glossary
Base Estimate: The most likely project estimate, exclusive of project contingency,
for known costs for all known design, engineering, cooperative agreements, right-
of-way, environmental, utilities, pre-construction, and construction work.
Estimate Basis: A documentation of the project type and scope for each cost
estimate, including estimates for items such as available drawings (i.e., defining
percent engineering and design completion), project design parameters, project
complexity, unique project location characteristics, and disciplines required to
prepare the cost estimate.
Total Cost Estimate: The sum of the base cost estimate and contingency.
Cost Control: The process of controlling deviations from the estimated project costs
and monitoring the risks and contingencies associated with change. Two principles
apply: 1) there must be a basis for comparison (e.g., the baseline cost estimate); and
2) only future costs can be controlled.
35
Glossary
Cost Management: The process for managing the cost estimate through reviews
and approvals, communicating estimates, monitoring scope and project conditions,
evaluating the impact of changes, and making estimate adjustments as appropriate.
Scope Creep: The result of incremental minor scope changes that cumulatively
change the scope, cost, and schedule of a project.
Monte Carlo Simulation: Risk simulations that sample probability distribution for
each variable to produce hundreds or thousands of possible outcomes; the results
can be analyzed to get probabilities of different outcomes.
Qualitative Risk Analysis: A process for prioritizing the effects of risks and
conditions on project objectives. It involves assessing the probability and impact
of project risk(s) and using methods such as the probability and impact matrix to
classify risks as high, moderate, and low for prioritized risk response planning.
36
Glossary
Risk Acceptance: This risk planning technique indicates that the project team has
decided not to change the project plan to deal with a risk, or is unable to identify
any other suitable response strategy.
Risk Assessment: The component of risk management that bridges risk identification
and risk analysis in support of risk allocation. It involves quantitative or qualitative
analysis that assesses the impact and probability of a risk.
Risk Avoidance: This risk planning technique involves changing the project plan to
eliminate the risk or to protect the project objectives from its impact.
Risk Event: A discrete occurrence that may affect the project, for better or worse.
Risk Identification: The determination of which risks might affect the project and
the documentation of their characteristics.
Risk Management: All of the steps associated with managing risks: risk
identification, risk assessment, risk analysis (i.e., qualitative or quantitative), risk
planning, risk allocation, and risk monitoring control.
Risk Management Plan: A document detailing how risk response options and
the overall risk processes will be carried out during the project. This plan is the
output of risk planning.
37
Glossary
Risk Mitigation: This risk planning technique seeks to reduce the probability and/
or impact of a risk to a level below an acceptable threshold.
Risk Monitoring and Control: The capture, analysis, and reporting of project
performance, usually as compared to the risk management plan.
Risk Transference: This risk planning technique seeks to shift the impact of a risk
to a third party together with ownership of the response. (See also, Risk Allocation.)
Sensitivity: When the outcome is dependent on more than one risk source, the
sensitivity to any specific one of those risks is the degree to which that specific
risk (i.e., event or condition) affects the outcome or value.
38
References
Wideman, R.M. (1992). Project and Program Risk Management: A Guide to Managing
Project Risks. Newton Square, PA.
39
Research Team 280, Methods for Dealing with Uncertainty:
Applying Probabilistic Controls in Design and Construction
Jeffery Bormann, Zachry
Chris Curow, Southern Company
* Karen Furlani, CH2M HILL
Daniel Hogan, U.S. Department of State
* Amy Javernick-Will, University of Colorado
† Douglas Kaiser, Exxcel Project Management
Kathleen Marwitz, Abbott
* Keith Molenaar, University of Colorado
Scott Penrod, Walbridge
* Craig Relyea, Eli Lilly and Company
Brendan Robinson, Architect of the Capitol
Marie Robinson, Jacobs
Ralph Rodriguez, Kaiser Permanente
* Christopher Senesi, University of Colorado
Michael Shirey, Tennessee Valley Authority
* Principal Authors
† CII wishes to thank the Project Management Institute for generously sponsoring the
participation of this team member and for providing a significant amount of data for
this study.