Review of Asset Hierarchy Criticality
Review of Asset Hierarchy Criticality
Report
Review of Asset Hierarchy
Criticality Assessment and
Risk Analysis Practices
Performing Organization: Rutgers University
January 2014
Sponsor:
Metropolitan Transportation Authority (MTA)
University Transportation Research Center - Region 2 Project No(s):
UTRC/RF Grant No: 76499-00-01
The Region 2 University Transportation Research Center (UTRC) is one of ten original University
Transportation Centers established in 1987 by the U.S. Congress. These Centers were established
Project Date: January 2014
with the recognition that transportation plays a key role in the nation's economy and the quality
of life of its citizens. University faculty members provide a critical link in resolving our national
and regional transportation problems while training the professionals who address our transpor- Project Title: Benchmarking for Asset Hierarchy, Criticality
tation systems and their customers on a daily basis. Assessment and Risk Analysis at the MTA and other
Transportation Companies
The UTRC was established in order to support research, education and the transfer of technology
in the �ield of transportation. The theme of the Center is "Planning and Managing Regional Project’s Website:
Transportation Systems in a Changing World." Presently, under the direction of Dr. Camille Kamga,
the UTRC represents USDOT Region II, including New York, New Jersey, Puerto Rico and the U.S.
http://www.utrc2.org/research/projects/benchmarking-
Virgin Islands. Functioning as a consortium of twelve major Universities throughout the region, for-asset-hierarchy
UTRC is located at the CUNY Institute for Transportation Systems at The City College of New York,
the lead institution of the consortium. The Center, through its consortium, an Agency-Industry
Council and its Director and Staff, supports research, education, and technology transfer under its Principal Investigator(s):
theme. UTRC’s three main goals are: Mohsen A. Jafari, Ph.D.
Professor
Research
Center for Advanced Infrastructure and Transportation
The research program objectives are (1) to develop a theme based transportation research (CAIT)
program that is responsive to the needs of regional transportation organizations and stakehold- Rutgers University
ers, and (2) to conduct that program in cooperation with the partners. The program includes both Piscataway, NJ 08854
studies that are identi�ied with research partners of projects targeted to the theme, and targeted, Tel: (848) 445-0579
short-term projects. The program develops competitive proposals, which are evaluated to insure Email: [email protected]
the mostresponsive UTRC team conducts the work. The research program is responsive to the
UTRC theme: “Planning and Managing Regional Transportation Systems in a Changing World.” The
complex transportation system of transit and infrastructure, and the rapidly changing environ-
ment impacts the nation’s largest city and metropolitan area. The New York/New Jersey Performing Organization(s):
Metropolitan has over 19 million people, 600,000 businesses and 9 million workers. The Region’s Rutgers University
intermodal and multimodal systems must serve all customers and stakeholders within the region
Sponsor(s):)
and globally.Under the current grant, the new research projects and the ongoing research projects
concentrate the program efforts on the categories of Transportation Systems Performance and
Information Infrastructure to provide needed services to the New Jersey Department of Transpor- Metropolitan Transportation Authority (MTA)
tation, New York City Department of Transportation, New York Metropolitan Transportation
Council , New York State Department of Transportation, and the New York State Energy and
Research Development Authorityand others, all while enhancing the center’s theme.
The modern professional must combine the technical skills of engineering and planning with
knowledge of economics, environmental science, management, �inance, and law as well as
negotiation skills, psychology and sociology. And, she/he must be computer literate, wired to the
web, and knowledgeable about advances in information technology. UTRC’s education and
training efforts provide a multidisciplinary program of course work and experiential learning to
train students and provide advanced training or retraining of practitioners to plan and manage
regional transportation systems. UTRC must meet the need to educate the undergraduate and
graduate student with a foundation of transportation fundamentals that allows for solving
complex problems in a world much more dynamic than even a decade ago. Simultaneously, the
demand for continuing education is growing – either because of professional license requirements
or because the workplace demands it – and provides the opportunity to combine State of Practice
education with tailored ways of delivering content.
Technology Transfer
UTRC’s Technology Transfer Program goes beyond what might be considered “traditional”
technology transfer activities. Its main objectives are (1) to increase the awareness and level of To request a hard copy of our �inal reports, please send us an
information concerning transportation issues facing Region 2; (2) to improve the knowledge base email at [email protected]
and approach to problem solving of the region’s transportation workforce, from those operating
the systems to those at the most senior level of managing the system; and by doing so, to improve
the overall professional capability of the transportation workforce; (3) to stimulate discussion and Mailing Address:
debate concerning the integration of new technologies into our culture, our work and our
transportation systems; (4) to provide the more traditional but extremely important job of University Transportation Reserch Center
disseminating research and project reports, studies, analysis and use of tools to the education, The City College of New York
research and practicing community both nationally and internationally; and (5) to provide Marshak Hall, Suite 910
unbiased information and testimony to decision-makers concerning regional transportation 160 Convent Avenue
issues consistent with the UTRC theme.
New York, NY 10031
Tel: 212-650-8051
Fax: 212-650-8374
Web: www.utrc2.org
Board of Directors UTRC Consortium Universities
The UTRC Board of Directors consists of one or two members from each The following universities/colleges are members of the UTRC consor-
Consortium school (each school receives two votes regardless of the tium.
number of representatives on the board). The Center Director is an
ex-of icio member of the Board and The Center management team City University of New York (CUNY)
serves as staff to the Board. Clarkson University (Clarkson)
City University of New York Columbia University (Columbia)
Dr. Hongmian Gong - Geography/Hunter College Cornell University (Cornell)
Dr. Neville A. Parker - Civil Engineering/CCNY Hofstra University (Hofstra)
Manhattan College (MC)
Clarkson University New Jersey Institute of Technology (NJIT)
Dr. Kerop D. Janoyan - Civil Engineering New York Institute of Technology (NYIT)
New York University (NYU)
Columbia University
Dr. Raimondo Betti - Civil Engineering
Rensselaer Polytechnic Institute (RPI)
Dr. Elliott Sclar - Urban and Regional Planning Rochester Institute of Technology (RIT)
Rowan University (Rowan)
Cornell University State University of New York (SUNY)
Dr. Huaizhu (Oliver) Gao - Civil Engineering Stevens Institute of Technology (Stevens)
Syracuse University (SU)
Hofstra University The College of New Jersey (TCNJ)
Dr. Jean-Paul Rodrigue - Global Studies and Geography
University of Puerto Rico - Mayagüez (UPRM)
Manhattan College
Dr. Anirban De - Civil & Environmental Engineering
UTRC Key Staff
Dr. Matthew Volovski - Civil & Environmental Engineering
New Jersey Institute of Technology Dr. Camille Kamga: Director, Assistant Professor of Civil Engineering
Dr. Steven I-Jy Chien - Civil Engineering
Dr. Joyoung Lee - Civil & Environmental Engineering Dr. Robert E. Paaswell: Director Emeritus of UTRC and Distinguished
Professor of Civil Engineering, The City College of New York
New York University
Dr. Mitchell L. Moss - Urban Policy and Planning Herbert Levinson: UTRC Icon Mentor, Transportation Consultant and
Dr. Rae Zimmerman - Planning and Public Administration
Professor Emeritus of Transportation
Polytechnic Institute of NYU
Dr. Kaan Ozbay - Civil Engineering Dr. Ellen Thorson: Senior Research Fellow, University Transportation
Dr. John C. Falcocchio - Civil Engineering Research Center
Dr. Elena Prassas - Civil Engineering
Penny Eickemeyer: Associate Director for Research, UTRC
Rensselaer Polytechnic Institute
Dr. José Holguín-Veras - Civil Engineering Dr. Alison Conway: Associate Director for Education
Dr. William "Al" Wallace - Systems Engineering
Rochester Institute of Technology Nadia Aslam: Assistant Director for Technology Transfer
Dr. James Winebrake - Science, Technology and Society/Public Policy
Dr. J. Scott Hawker - Software Engineering Nathalie Martinez: Research Associate/Budget Analyst
Syracuse University
Dr. Riyad S. Aboutaha - Civil Engineering
Dr. O. Sam Salem - Construction Engineering and Management
16. Abstract
The MTA NYC Transit (NYCT) has begun an enterprise-wide Asset Management Improvement Program (AMIP). In
2012, NYCT developed an executive-level concept of operations that defined a new asset management
framework following a systems engineering approach. NYCT has recognized the need for a fully developed asset
hierarchy to enable the evaluation of performance and cost at different levels within the agency. To that end, NYCT
has initiated this project as one of the initial steps in better understanding the state of the art in asset
management.
This report presents methodologies used for asset registration, asset hierarchy, and criticality and risk assessment,
gathered from an extensive literature review and interviews with industry experts. The interviews included
companies from the water, oil and gas, and rail industry in the US and UK; however, their names need to remain
confidential. In addition, a review of asset management standards is included as an appendix to this document.
19. Security Classif (of this report) 20. Security Classif. (of this page) 21. No of Pages 22. Price
38
Unclassified Unclassified
The contents of this report reflect the views of the authors, who are responsible for
the facts and the accuracy of the information presented herein. The contents do not
necessarily reflect the official views or policies of the UTRC or the Federal
Highway Administration. This report does not constitute a standard, specification
or regulation. This document is disseminated under the sponsorship of the
Department of Transportation, University Transportation Centers Program, in the
interest of information exchange. The U.S. Government assumes no liability for
the contents or use thereof.
January 2014
Commissioned by:
Authored by:
1
Contents
1
The MTA NYC Transit (NYCT) has begun an enterprise-wide Asset Management Improvement
Program (AMIP). In 2012, NYCT developed an executive-level concept of operations that
defined a new asset management framework following a systems engineering approach.
NYCT has recognized the need for a fully developed asset hierarchy to enable the evaluation
of performance and cost at different levels within the agency. To that end, NYCT has initiated
this project as one of the initial steps in better understanding the state of the art in asset
management.
This report presents methodologies used for asset registration, asset hierarchy, and criticality
and risk assessment, gathered from an extensive literature review and interviews with
industry experts. The interviews included companies from the water, oil and gas, and rail
industry in the US and UK; however, their names need to remain confidential. In addition, a
review of asset management standards is included as an appendix to this document.
2
The term “asset management” first appeared in the banking industry to describe an
investment practice that builds wealth through investments in different types of financial
assets. The principles of asset management are well established in car manufacturing, mining
and petrochemical industries. In 1999, the US Department of Transportation defined asset
management as a business process and decision-making framework that draws from
economics and engineering theory and practice to manage a broad range of assets during an
extended time horizon. The approach incorporates the economic assessment of tradeoffs
between alternative investment options at both the project level and the network or system
level, and uses this information to help agencies make cost-effective investment decisions [1].
Asset management is no longer considered a cost but a value-generating practice that spans
over all levels within an organization and links the organization’s mission and long-term
investment strategies with the short and medium-term tactical and operational objectives.
Organization-wide, systemic and systematic approaches to value-based asset management
along with high quality asset information are necessary to guarantee success of asset
management projects.
To build and sustain a value-based asset management one must institute business practices
and the supporting technology on the basis of flexible asset hierarchy and information
quality. Asset hierarchy flexibility is essential for value-based asset management since value
recognition is not a one-time shot but rather an evolutionary process requiring machine
learning and intelligent tools to grow and to optimize. Flexibility on asset hierarchy granularity
is also a fundamental characterization of a value-based asset management system. While it is
easy to breakdown assets according to their functions, ownerships and community
memberships, it is less obvious to structure them according to technology advances and
exogenous market factors. A robust and flexible asset hierarchy must be able to adapt to new
hardware and software technology. Moreover, in a dynamic business environment assets
generate value as members of community of assets under dynamically changing functional
hierarchies and operational conditions. The functional and operational importance of assets
partially changes due to their criticality factors. In a value-based asset management
environment asset criticality assessment is an ongoing process that provides a criticality
ranking list of systems, assets and components, identifying conceivable failure mechanisms
underlying the failure rates, likelihood of impact from the failure, and ultimately, identifying
the consequences of these failures. Asset criticality can shape and reshape the interaction
3
between assets, thus significantly impacting asset hierarchy. Therefore, asset hierarchy must
be adaptable to these interactions and changing dependencies.
Project Organization
This report presents a review of asset management practices with particular focus on asset
hierarchy and asset criticality in asset intensive industries.
Section 2 begins with a summary of the ten-step asset management methodology proposed
by the US Environmental Protection Agency (EPA) as it can be used as a general model for any
organization’s asset management methodology. Two of the ten steps are particularly
discussed in this report: 1) Step 1 refers to the development of an asset register, and 2) Step 6
focuses in determining business risk exposure and criticality. These two steps are discussed in
detail in section 3 and 4, respectively.
Section 3 starts with a discussion on asset hierarchy and asset hierarchy models. Then it
presents the three-phase asset hierarchy development framework developed by the Water
Environment Research Foundation (WERF), followed by a four-step asset register
development process.
Section 4 discusses risk assessment and criticality analysis. The risk assessment subsection
includes steps to estimate risk, quantitative and qualitative methods to assess risk, graphical
tools and types for risks. The criticality analysis subsection presents the steps to conduct the
analysis which includes asset identification, criteria definition, and scoring.
4
Project Approach
The Project Team conducted a comprehensive literature review and organized interviews
with experts from several domestic and international organizations. Two major types of
sources of information have been used for literature review purposes. The first type consists
of existing standards, guidelines, and regulatory compliances regarding asset management
and enterprise risk management. The second type includes white papers, technical reports,
scientific articles, and academic theses and research. This report particularly focuses on
practical methodologies and frameworks used in industry. The interviews included domestic
and international organizations from the aviation, water, transit, and oil and gas sector.
However, name of companies and detailed information cannot be disclosed.
The study is a collaboration between the Center for Advanced Infrastructure and
Transportation (CAIT) at Rutgers University and the Institute for Manufacturing (IFM)
Distributed Information and Automation Laboratory at Cambridge University – UK. CAIT has
partnered with EAM Group to accomplish this effort.
5
This section reviews asset management methodologies used by environmental protection,
highways and transportation, and power distribution organizations.
7
Step 2: Asset Performance and Failure Modes
This step involves evaluating the performance of the assets and identifying major failure
modes. Asset functionality, level of service, availability, maintainability, sustainability and
reliability are common factors to be considered during the evaluation of asset performance.
The above calculation is based on direct lifecycle cost and economic cost which are two major
cost perspectives. Please note that capital cost is a variation of economic costs such as
financial cost and triple bottom line.
8
are used for evaluating risk exposure associated with the physical failure of assets. In the
simplest terms risk is calculated as follows:
Risk exposure = Probability of failure × Consequence of the failure
9
These ten steps constitute a useful guide especially for the development of the first asset
management plan. As the asset management planning activity becomes embedded in the
agency planning processes, the update of the asset management plans focuses on re-running
the investment analysis using updated data rather than a full establishment of the state of the
assets data and information and constraints, and therefore, involves far fewer resources and
time to execute.
In the transportation asset management guide, AASHTO defines a business model, a decision
support system, and an asset management approach, all linked to the five core questions
presented in the EPA methodology. Figure 2 presents AASHTO’s asset management model.
Asset Inventory
Condition Assessment
and Performance Modeling
Performance Monitoring
Program Implementation
10
Virginia Department of Transportation Asset Management Methodology
The Virginia Department of Transportation (VDOT) adopted the AASHTO’s transportation
asset management model and further developed a needs-based budgeting process that
systematically identifies maintenance needs based on asset inventory and condition data. The
process guides the allocation of available resources across maintenance activities and
districts, and helps develop the annual budget request. The needs-based budgeting process
includes the following five steps:
1. Inventory and condition data collection
Annual collection of pavement condition data on 100 percent of interstate and
primary and approximately 20 percent of secondary pavements.
Biennial collection of bridge condition data on all national bridge inventory
structures.
Statewide random sampling for selected traffic and drainage assets every two
years.
2. Set goals and apply business rules
Implementation of decision logic for what maintenance treatments should be
applied based on asset characteristics and condition to restore serviceability and
minimize life cycle costs.
Business rules also include deterioration / life cycle and cost models.
3. Conduct needs analysis
Estimate the current maintenance backlog (total needs) and the cost to maintain
assets at their current condition level.
4. Develop budget requests and resource allocation strategies
Address the identified needs and move towards greater balance in the backlog of
maintenance needs across districts over time.
5. Track and evaluate accomplishments
Provide accountability for expenditures.
Build better information over time on asset age, detailed inventory characteristics,
and resource use.
11
3. Identify and evaluate component measures. When failure data is available, it is
possible to estimate the failure rate which is related to the condition of the item. If
failure data is limited, a risk measure can be established through expert engineering
judgment and laboratory testing.
4. Format an overall condition measure.
5. Model the degradation process of the condition. Different models have been used in
practice to model the deterioration, including regression and Markov models.
6. Evaluate different asset management policies. Effects of asset management actions
can be deterministic (i.e., always return the item to its best condition or improve an
item’s condition rating by a fixed amount), or stochastic (i.e. maintenance may not
always be carried out to the same standard). The most suitable, efficient, and cost-
effective asset management strategy will be chosen.
The focus of the following sections will be to address the first and sixth steps of the EPA
model which refer to the creation of a systematic approach for asset registry and inventory,
and the development of a framework for risk definition and classification.
12
Developing a well-organized and comprehensive asset hierarchy is a significant step in
building an effective asset management program since it helps define overall priorities.
Creating an asset hierarchy process is a major step of a higher-level process called Asset
Register Development Process. This section defines asset hierarchy and introduces two asset
hierarchy models, presents an asset hierarchy development framework, and defines an asset
register development process.
Asset Hierarchy
An asset hierarchy is a systematic framework and comprehensive listing of all assets in a
logical, clear, holistic and nested order that facilitates locating asset records and the rolling up
of data from lower levels to higher or vice versa [8]. It provides a suitable framework for the
business to structure data in an information system and facilitates the classification of assets
and its relevant information [9, 10]. It also allows companies to track all their assets, through
implementing a diagram that projects the relationships between physical locations,
functionality, operations, and asset types. These relationships facilitate the process of data
collection, monitoring, grouping, as well as identifying the critical assets [11]. An effective
asset hierarchy enables companies to build a well-organized data management structure that
can be used in prioritizing maintenance and renewal activities [12-14].
At the strategic management level, an asset hierarchy provides the means to identify and plan
for replacement or renewal of major systems, organize assets in classes and with similar use
and risk, and enable long term financial planning. At the operation and maintenance level, an
asset hierarchy provides a tool for process analysis, supporting better decision-making,
improving efficiencies and effectiveness of assets, and maintenance and operations staff [15].
Beyond putting assets in different categories, an asset hierarchy is about demonstrating the
relationships and the interaction between assets [16].
13
“Child Asset”. Figure 3 shows a typical asset system hierarchy diagram based on the family
tree structure.
What follows is a review of two asset hierarchy models. The first one was proposed by the
Water Environment Research Foundation (WERF), the second is part of the ISO 14224
standard.
The report also suggests creating further levels, if more details are required to show the
relationships between components. An alternative method for such three-level asset
hierarchy is the nine-level hierarchy introduced in ISO 14224.
14
Figure 4 – ISO 14224 framework for asset hierarchy
This hierarchy performs efficiently when the company provides a clear definition of each level
or decreases number of levels to match the company’s available assets and equipment.
Different organizations customize the ISO 14224 framework based on their own
characteristics or functionalities. The hierarchy can be built based on spatial/geographical
relationship between assets, business unit operations, and responsibilities, facility types or a
combination of these characteristics. ISO 14224 provides a best practice for oil and
petrochemical companies, any deviation from this framework is possible but needs to be
specified.
ISO 14224 directly focuses on Level 6 for the collection, recording and monitoring of reliability
and maintenance data. It also provides a supplementary reliability and maintenance
parameters in relation to each lower level of the taxonomy. Although the table was created
for the petrochemical and oil industries, it can be a good example for other industries
including the MTA.
15
Asset Hierarchy Development Framework
The Water Environment Research Foundation designed a three-step framework for planning a
well-constructed asset hierarchy and register [5]. The process is part of an intuitive and user-
friendly set of online guidelines, templates, and decision support tools called SIMPLE
(Sustainable Infrastructure Management Program Learning Environment). SIMPLE facilitates
the development of consistent total asset management and provides effective
implementation guidelines for organizations to continuously measure their improvements in
asset management. Figure 5 presents the three-step framework to implement the asset
hierarchy. Further details can be found in [8].
16
1. Start with a simple hierarchy model or an existing hierarchy from a
vulnerability assessment, asset ledger, or GIS breakdown.
2. Compare to maps or as-built drawings of your assets.
3. Remove any assets that are not applicable.
4. If more than one level 1 asset exists, use separate steps for each asset.
5. Add any unique or system-specific assets. Modify the asset descriptions, if
appropriate, to match specific conditions.
6. Develop a final asset inventory but design it in such a way that additions and
subtractions can be made.
Figure 6 – Recommendations for development of an asset hierarchy and asset register [17]
The WERF report also provides a list of information that must be collected at each level of the
asset hierarchy. The information includes specifications such as asset name, definition,
components, performance indicator, and relationship diagram [18]. In addition, the report
suggests two formats for asset hierarchy, both illustrated in Figure 7. For each format, the
report provides a list of potential assets / components that should be added to the hierarchy.
Level 1 asset
- Level 2 asset
Level 3 asset
Level 3 asset
- Level 2 asset
Level 3 asset
Level 3 asset
Attributes for each asset should be collected in a way that supports management and
operation functions. There are several categories of attributes data that could be collected
regarding each asset. Identification, physical description, location, risk analysis, asset groups,
performance etc. are different categories of attributes.
17
Asset Register Development Process
Asset registers are defined as “listings of information relating to various aspects of an asset
portfolio, in a way that allows data to be cross-referenced and retrieved as required” [19].
The asset register development process consists of four specific steps as shown in Figure 8.
1
- Multi-Attribute Decision Making (MADM) techniques— a subset of MCDA approach—can be implemented to
address the problems of ranking and selection. In particular, when ranking and prioritizing should be conducted
with multiple decision makers such as process owners, managers and asset management analysts. For further
information see [18, 19, 20, 21]
18
hardware structure and methods they plan to use. They also need to identify how to establish
an asset management database system and reporting for different operational levels and
management levels [19]. In this step it is also necessary to identify which technologies are the
most appropriate regarding the organization’s functionalities, constraints, and objectives. To
do so, it is necessary to evaluate different data collection systems including: Geographical
Information System (GIS), Global Positioning System (GPS), data loggers, compact disk
technologies, etc. Then the operational requirements of data collection are defined and the
data sources are determined. As-constructed drawings, work orders, and reports including
maintenance reports, condition audit and monitoring reports, call reports etc. are the main
sources of data [5].
Unified Segmented
Umbrella
Composite Autonomous
Integrated
Management
Operations
20
Risk is a function of the probability of an incident and its likely consequences. Risks
assessments are conducted to identify assets that are most likely to cause great impact to the
business should an incident occur. Common types of risk include: health, safety, financial,
performance, public image, and environmental risks. These types of risks are highly correlated
to the criteria that affect criticality. Asset criticality is a structured methodology that identifies
the assets whose failures have the highest potential impact on business goals [23]. It can be
used to determine maintenance strategies, investment strategies, and growth plans, to help
organizations prioritize expenditures on assets that are critical according to predefined
business criteria. This section presents steps, criteria and methodologies for assessing risk and
criticality.
Risk Assessment
Several approaches have been implemented by different organizations to calculate risk. Such
approaches often include the same two key elements: likelihood of failure and consequence
of failure, which can be estimated using either qualitative or quantitative methods.
Risk Elements
Risk is most commonly calculated as a function of two elements: frequency or likelihood of
failure (fr) and business consequences (Bc).
Risk = Fr × Bc
21
Alternatively, organizations may include additional elements into the equation (e.g.
vulnerability, threat, impact, etc.) to provide a more accurate measure of risk depending on
the organization’s functionalities, types of failures or losses, business goals and policies. For
instance, a generalized form of risk calculation is as follows:
Risk = Fr x Vu x Im x Bc
Where:
Fr represents frequency of asset loss or service interruption due to failure, fault,
planned or unplanned stoppages, rare events such as natural disasters, human
induced events, etc.
Vu denotes vulnerability, which indicates the degree of susceptibility a system has to
any form of harm, as well as its overall level of protection. Vulnerability can also be
defined as a combination of the attractiveness of a system or asset as a target and the
level of deterrence and / or defense provided by the existing countermeasures [25].
Im indicates impact caused by asset loss or service interruption. It is a function of
capacity, reliability or efficiency loss. For instance, capacity loss accounts for impact
amount and duration. It allows comparing different impacts. For example: 50%
capacity loss with duration measured in minutes, or 10% capacity loss with duration
measured in days.
Bc represents business consequences. This is measured in short-term and long-term
scales. The impact and business consequences are not necessarily proportional.
Depending on the type of impact, the short-term and long-term business
consequences could range from negligible to very severe.
Quantitative Methods
In the quantitative methods used to assess risk, the risk elements are calculated by directly
using quantitative measures usually gathered from historical data [26, 27]. For example,
frequency can be calculated by using historical records of failures categorized by type and
severity. Net present values of loss, total profit loss, total replacement and repair costs,
number of defective products, etc. are examples of quantitative business consequences. The
advantage of using quantitative measures is that these are tangible and make sense to
managers. The quantitative measures are usually universal regardless of types of assets and
functionality, and are often connected to business performance indicators. The main
disadvantage of using quantitative methods is that the data required to calculate risk does
not necessarily exist. Even if it exists, it may not be properly gathered and recorded. In
addition, in some cases, the consequence of an event cannot be easily quantified using
historical data.
22
Qualitative Methods
When using a quantitative approach to calculate risk is unsuitable, it is necessary to apply a
qualitative method. In these methods, engineers, technical staffs, managers and other key
stakeholders, define the elements needed to estimate risk (i.e. failure frequency,
vulnerability, impact, business consequences), and develop tables to quantify these elements
based on their expertise, the organization’s background, asset criticality criteria, etc. The
values assigned to these elements are then used to obtain the risk value.
23
Table 2 – Consequences [33]
Score Description
Failure is of such minor nature that asset will probably function
1-2
with a minor problem.
Failure will result in slight deterioration of part or asset
3-5
performance.
6-7 Failure will result in deterioration of part or asset performance.
Failure will result in high degree of customer dissatisfaction and
8-9
cause non-functionality of asset.
Failure will cause non-system operation or non-compliance with
10
government regulations.
Types of Risks
Risks are broadly classified in four types:
Health and Safety (H&S) Risks
Major asset failures could result in injuries needing first aid treatment, hospital treatment,
restricted ability to work, loss of limb, and in the worst case scenario, fatalities. To assess H&S
risks, companies investigate the possible H&S consequences of asset failure and classify them
into different categories and increasing order of seriousness. For example, in the O&G
industry, health and safety risks are classified into four categories, ranging from minor injuries
at the lower end of the scale to fatalities at the higher end of the scale. In the UK, the Railway
Safety and Standards Board (RSSB) collects safety records for the rail network and provides
guidance on safety risks [29]. Inspection and maintenance standards put in place by the
companies ensure that safety risks are minimized, if not eliminated.
24
Performance and Financial Risks
Asset failure and underperformance could lead to financial consequences. Fundamental to
the rail sector is the ability of the infrastructure to provide the capability to run trains
considering key performance factors such as specified line speeds and schedules. In the UK,
contractual arrangements put in place impose penalties on infrastructure management
companies for delays resulting from asset failures. In addition to the financial risks due to loss
of function or performance, there is a direct cost related to maintenance and repairs. These
involve costs of personnel, equipment, replacement assets or components, logistics, etc.
However, in practice, the direct cost of maintenance often pales in comparison with the costs
incurred due to loss of production – in the case of O&G industry – or penalties – in the case of
rail in the UK. It is to be noted that in the UK rail sector, performance risks and maintenance
costs are also part of the criticality criteria.
Environmental Risks
This type of risk involves environmental damage caused by asset failures. This is of major
concern in the O&G sector, with risks ranging from environmental damage limited to the site,
to widespread damage requiring extended cleanup, government fines, resulting media
coverage, and damage to reputation [30]. The environmental risks in the rail sector are
considered to be minimal, and do not play a huge part in criticality assessment. However, as
regulations tighten up due to global concerns of climate change, these are expected to play a
more important role in the transportation sector.
25
Graphical Tools
Risk Matrix
A risk matrix is a two-dimensional table used to define various levels of risk of an asset. One
dimension represents frequency or likelihood of failure, and the other dimension represents
consequences. The matrix can be used as a visual tool for both qualitative and quantitative
risk assessment. When quantitative measures are used, the axis can have continuous values.
Figure 10 shows an example of a criticality matrix used by an O&G company. Tables 4 and 5
provide details regarding the rows and columns of the matrix.
The lower Arabic numbers show the higher risk values. In this example A1, B1, C1, A2 and B2
represent the highest risk.
Table 4 – Probability of Failure
26
Table 5 – Level of consequences
Based on the information received by the team during interviews with an organization from
the O&G sector, the most critical assets typically account for less than 1% of the total
available assets. Based on a review of industry practices, no evidence was found on an
approach that gives different weightings to each individual risk. On the contrary, each risk is
treated equally, and the consequences are classified in a normalized scale, which allows
different risks to be compared to each other as shown in Table 5. If an asset ranks as “very
critical” in one risk type, and less critical in another risk category, the final risk score is “very
critical”.
Risk Graph
Another visual tool for quantitative and qualitative risk assessment is risk graphs. Figure 11
shows an example from the water industry used for qualitative purposes. Different zones are
highlighted with different colors showing different levels of risk. The small red dots represent
different assets, thus allowing the organization to compare multiple assets/infrastructures
using a single table. It shows that any asset with a risk value greater than 50 (any
multiplication of frequency and consequence that results in a risk value > 50) is located in
Zone 1 (orange zone) which represents most intolerable risk. Zones can be defined by
organizations based on their policies and strategies. More advanced plots and maps have also
been used particularly when the geographical positions of the assets are important (e.g. train
stations and oil/water pipe networks).
27
Figure 11 – A general risk graph [5]
Both, risk matrices and risk graphs help agencies understand risk and impact and allow them
to prioritize security operations so that the most important infrastructure assets are
protected and disastrous situations are prevented – or their consequences mitigated.
In order to inform decision-making and to facilitate the preparation of a business case, all the
companies reviewed use a conversion factor for converting non-financial risks into monetary
figures (e.g., average hourly salary is used to convert Lost Customer Hours to GBP). In the rail
sector, the practice is similar. However, there is often a single risk that dominates due to the
fact that sufficient risk control measures are put in place to mitigate other risks. For example,
safety risks, on the other hand are considered negligible as inspection and maintenance
standards specified either by regulatory bodies or by the companies take a risk adverse
perspective to safety, and safety related incidents are avoided at all costs.
Criticality Analysis
The important steps required to determine criticality include: asset identification, criteria
definition, and scoring.
Asset Identification
This step consists on developing a method to identify existing assets. To do this, the best
alternative is to establish an asset hierarchy, assign assets into specific asset categories, and
28
collect all the required information regarding each asset. This will enable ranking of assets
within specific categories.
In the rail industry, an initial prioritization is performed to identify those assets that have
historically attracted high expenditure. These high priority assets are decomposed down to
the component level, and each component is assigned a criticality score.
Criteria Definition
The criteria that affect asset criticality vary from one organization to another. These will
significantly depend on the types of assets as well as the organization’s policies. Criteria
normally used across different types of industries include [34-36]:
Reliability – asset damage, malfunction, depreciation, degradation, life cycle, etc.
Cost Factor – loss of income, repair costs, and other costs related to the assets.
Efficiency – loss of service, loss of production, etc.
Brand – loss of image
Compliance – regulations and law enforcements, failure to meet statutory
requirements.
Safety – loss of life or injury
Security – asset location
Environmental Impact / Sustainability – effect of environment on asset deterioration.
29
Route Criticality can be assessed based on the costs per incident compared to the national
average.
Scoring
A common practice is setting an arbitrary scale (i.e. 1 to 10) for scoring the assets against
each decision criterion. Lower scores indicate lower criticality. The scoring guide and
definition of asset state for each score should be developed by experts and technical staff.
The total criticality score can be calculated either by using the average of all scores, or the
weighted average provided that the relative importance of each criterion has been
predetermined. Scores and final results should be collected in tables for later reference.
The organizations examined from the Oil and Gas (O&G) sector use a three-point scale
criticality scoring. The scores indicate asset failure is Very Critical, Critical, or Not Critical in
relation to the defined criterion. Similarly, in the rail industry, the scores used are High,
Medium or Low.
30
This project focused on collecting best industry practices from different types of industries in
the US and UK. The ten-step asset management process proposed by the US Environmental
Protection Agency (EPA) provides a platform for developing initial asset management plans,
and systematically improving asset management practices. As the asset management
planning activities become embedded in the agency’s planning processes, the amount of
effort put into updating asset management plans should decrease since it would mostly entail
updating the plans based on most recent data.
This report focused only on the first and sixth step of the ten-step process. The first step
indicates the development of an asset registry that follows a hierarchical structure is essential
to link asset performance to planning functions. The Water Environment Research Foundation
(WERF) provides an asset hierarchy development model that can be generalized to transit
organizations. The WERF model lays out the steps to define the asset hierarchy, identify data
attributes, define data collection procedures, load asset information, and implement the
asset register.
For the development of the asset hierarchy, the project team identified the ISO 14224 model
developed for the oil and gas industry as the recommended hierarchy model for NYCT. The
ISO 14224 standard has been used in many private and public organizations across different
types of industries around the world. It presents a well-organized taxonomy to classify assets
considering user, location and asset structure. It proposes a reliability and maintenance based
asset hierarchy that aligns performance of asset parts at the bottom of the hierarchy with
performance outputs at the top of the organization.
The sixth step in the ten-step EPA process focuses on determining business risks and
criticality. There is a wide variety of criteria used to assess risk and criticality, however, the
most common criteria includes: reliability, costs, efficiency, brand, compliance, safety,
security, and environmental impact. There are two types of methods to assess risk. The
quantitative methods are mostly based on estimation of risk using historical data as well as
statistical tools. The qualitative methods rely on expert knowledge.
31
AASHTO Transportation Asset Management Guide – analyzed the DOT business processes and
strategic approach to managing transportation infrastructure assets.
Asset – Hardware, software, procedure etc. used to provide a valued function.
Asset Management as defined by PAS 55 – systematic and coordinated activities and practices
through which an organization optimally and sustainably manages its assets and asset
systems, their associated performance, risks, and expenditures over their lifecycles for the
purposes of achieving its organizational strategic plan.
Asset Management Plan – document that identifies the short- and long-term service delivery
requirements of the portfolio of assets belonging to an organization. It provides a framework
for managing an asset, or group of assets, from within the asset portfolio.
Asset Management Policy – sets the framework for the management of airport infrastructure
and assets. Most policies include
Organizational context and importance of asset management,
Overall vision and goals of the organization and supporting asset management vision
and goals,
Executive and key position roles and responsibilities, and
Audit and review procedures.
Asset Management Framework – system of processes, procedures, practices, support
systems, organizational roles and responsibilities, and policies used to enable sound
management decisions for the optimal management of physical assets.
Asset Management Strategy – strategy for asset management covering the development and
implementation of plans and programs for asset creation, operation, maintenance,
rehabilitation/ replacement, disposal, and performance monitoring to ensure that the desired
levels of service and other operational objectives are achieved at optimum cost.
Asset Performance – measurement of the achievement of predetermined outputs arising
from the existence and operation of assets using a range of performance targets that
measure the individual and collective contribution an asset makes toward service delivery
and/or business outputs.
Asset Registry – a record of asset information considered worthy of separate identification
including inventory, historical, financial, condition, construction, technical, and financial
information about each.
Attributes – a data item related to an asset.
32
Business Risk Exposure – a metric to expresses risk. Business Risk Exposure is determined as
the product of the probability of failure and the consequence of failure.
Critical Assets – assets for which the financial, business, or service-level consequences of
failure are sufficiently severe to justify proactive inspection and rehabilitation. Critical assets
have a lower threshold for action than non-critical assets.
Condition Assessment – technical assessment of an asset based on a physical inspection, for
the purpose of determining its condition and remaining useful life relative to a defined
standard.
Decision Support Tools – used by asset managers to determine the best alternative among a
set of feasible alternatives. The alternatives may be potential solutions to a range of
questions related to strategic planning, airport development, outsourcing, and asset renewal
or replacement.
Effectiveness – Relates to how well outcomes meet objectives. It concerns the immediate
characteristics of an entity’s outputs, and the degree to which an asset contributes to
achieving specified outcomes. Entities should ensure that an asset is suitable to the nature of
their business and supports the delivery of budget funded entity outcomes.
Efficiency – Relates to the productivity of Commonwealth resources used to conduct an
activity in order to achieve the maximum value for those resources.
Functionality – Functionality is ‘fitness for purpose’. It describes how well a current asset
matches the activities that it supports.
Infrastructure Management – the discipline of managing infrastructure assets that underpin
an economy, such as roads, water supply, wastewater, storm water, power supply, flood
management, recreational and other assets.
Inventories – Inventories are assets:
• Held for sale in the ordinary course of business;
• In the process of production for such sale; or
• In the form of materials or supplies to be consumed in the production process or in the
rendering of services.
Lifecycle Costing – sum of all recurring and onetime costs over the full lifespan or a specified
period of an asset under consideration.
Priority – Dynamic assessment of activity importance. Priority varies for each task to be
carried out on equipment regardless of the criticality of that equipment.
Risk Management – Risk is part of the environment in which entities operate. Risk
management involves the systematic identification, analysis, treatment and allocation of
33
risks. The extent of risk management required will vary depending on the potential impact of
the risks.
Useful Life – Useful life is the period over which an asset is expected to be available for use by
an entity, or the number of production or similar units expected to be obtained from the
asset by an entity. The useful life of an asset may be different to the period of its physical life.
34
[1] US Department Of Transportation (1999) “Asset Management Primer”, FHWA, Dec
1999, http://www.fhwa.dot.gov/infrastructure/asstmgmt/amprimer.pdf, 6/26/2013
[2] The US Environmental Protection Agency (2012) “Advanced Asset Management Training
Workshops” available at http://www.epa.gov/OWM/assetmanage/assets_training.htm,
7/1/2013
[3] Remenyte-Prescott R. and Andrews J., Nottingham Transportation Engineering Centre,
University of Nottingham, UK, (2011) “Review of Infrastructure Asset Management
Methods for Networked Systems”, Proceedings of the 19th AR2TS Advances in Risk and
Reliability Technology Symposium, [Swan's Nest Hotel, Stratford-upon-Avon], available
at: http://www.nottingham.ac.uk/engineering/conference/ar2ts/documents/17.pdf
6/25/2013
[4] Grotheer, Wayne. (2007) “Developing an Asset Management Framework”
Transportation Research Board Conference. Port of Seattle. Transportation Research
Board, Washington.
[5] EPA Asset Training Management Material, “Fundamental of Asset Management—
Develop Asset Registry” available at http://simple.werf.org/Books/Contents/Interactive-
Training/EPA-Asset-Management-Training-Material
[6] ACRP (2012), “Report 69, Asset and infrastructure management for airports—Primer
Guidebook”, Sponsored by the Federal Aviation Administration, WASHINGTON, D.C.
2012
[7] Virginia Department of Transportation, (2006), “Asset Management Methodology”,
http://www.virginiadot.org/projects/resources/Asset_Mgmt_Methodology_Final_Repor
t_-_VDOT_website.pdf, 6/28/2013
[8] Water Environment Research Foundation, What is the Asset Hierarchy Tool? Sustainable
Infrastructure Management Program Learning Environment (SIMPLE), available at
http://simple.werf.org/simple/media/AHT/index.html 6/20/2013
[9] Water Environment Research Foundation “Sustainable Infrastructure Management
Program Learning Environment’s Asset Hierarchy Tools” available at
http://simple.werf.org/Pages/Restricted-Access
[10] Hopper, R., Armitage, R., Gallagher, A., Osorio, T., (2009). CIRIA C667 - Whole-life
infrastructure asset management: good practice guide for civil infrastructure. United
Kingdom: CIRIA Publishing.
[11] The Awwa Research Foundation (2008), “Asset Management Research Needs Roadmap
– 4002- Report # 91216 available at:
http://www.waterrf.org/Pages/Projects.aspx?PID=4002 , 6/18/2013
[12] Cromwell, J., Nestel, G., Albani R., Paralez L., Deb A., Grablutz F., (2001) “Financial and
Economic Optimization of Water Main Replacement Programs. Denver, Co.: AWWaRF
and AWWA.
[13] Matichich, M., Allen J. and Allen R., (2006) “Asset Management Planning and Reporting
Options for Water Utilities. Jour. AWWA, 98(1): 80-87.
35
[14] WERF (Water Environment Research Foundation (2002) “Research Priorities for
Successful Asset Management” A Workshop. Alexandria, Va: WERF
[15] Boshoff L., Childs R., Roberts L., (2009), “Guidelines For Infrastructure Asset
Management In Local Government”, Provincial and local government of South Africa
[16] Keith Paterson (2011), “Infrastructure Asset Management Systems” Civil Engineering
Management, Limerick Institute of Technology
[17] Jeffrey L. Oxenford, David M. Hughes, Eugenio Giraldo, Jerry K. Snyder, Arun K. Deb,
Stewart Burn, David Main, Jane Olivier, James S. Wailes, and Brian Naess, (2012) “Key
Asset Data for Drinking Water and Wastewater Utilities” [Project #4187].
[18] Anderson D., Keleher P., Smith P., (2006) “Towards an Assessment Tool for the Strategic
Management of Asset Criticality” Engineering Asset Management, pp 1232-1242
[19] New South Wales Treasury. (2004). Total Asset Management: Asset Information
Guideline. Australia: New South Wales Treasury.
[20] Association of Local Government Engineering (2006) “International Infrastructure
management manual”, Thames, New Zealand [18] Gwo-Hshiung, T., Tzeng, G.H.,
Huang, J.J. (2011) “Multiple Attribute Decision Making: Methods and Applications“A
Chapman & Hall book, CRC Press
[21] Pudney S. (2010), “Asset Renewal Decision Modeling with Application to the Water
Utility Industry” Ph.D. thesis, submitted to School of Engineering Systems, Queensland
University of Technology
[22] Water Infrastructure: Comprehensive Asset Management Has Potential to Help Utilities
Better Identify Needs and Plan Future Investments (2013). US Government
Accountability Office
[23] Equipment Criticality Analysis. Available at
http://www.slideshare.net/rickysmithcmrp/chapter-54-equipment-criticality-analysis
[24] Healy J. A. (2006) “Criticality in Asset Management”, Engineering Asset Management, pp
822-836
[25] Nancy A. Renfroe, PSP and Joseph L. Smith, PSP, “Threat/Vulnerability Assessments and
Risk Analysis”, available from: http://www.wbdg.org/resources/riskanalysis.php
7/17/2013
[26] Ozbas B., (2013). “Safety Risk Analysis of Maritime Transportation: A Review”, Re-
submitted for Publication in the Transportation Research Record: Journal of the
Transportation Research Board.
[27] Ozbas B.,, Altıok T., Or İ., , Ulusçu Ö. S., (2008), Risk Analysis of the Transit Vessel Traffic
In the Strait of Istanbul, A technical report, Center for Advanced Infrastructure and
Transportation (CAIT)’s Laboratory for Port Security at Rutgers University.
[28] Merriam-Webster. (2003) Merriam-Webster's Collegiate Dictionary (11th, ed.).
Springfield, MA: Merriam-Webster
[29] http://www.rssb.co.uk/SPR/Pages/SAFETYRISKMODEL.aspx
[30] http://www.bbc.co.uk/news/special_reports/oil_disaster/
[31] Network Rail Track asset policy – part 4, update document, March 2010
[32] Stamatis, D. H. (2003), “Failure Mode and Effect Analysis: FMEA from Theory to
Execution”, ASQ Quality Press.
36
[33] Villacourt, M., (1992), “Failure Mode and Effects Analysis (FMEA): A Guide for
Continuous Improvement for the Semiconductor Equipment Industry”, a report by
International SEMANTECH available at
http://www.sematech.org/docubase/document/0963beng.pdf 7/1/2013
[34] Jay P., “Joined Up Asset Management – Managing Priorities,” 71st Annual International
Conference of Doble Clients, viewed 30 May 2006
[35] Xie An-Shi; Huang Li-huang; Chen Zhong-de, (2007) "Research on multi-attribute auction
based on rough set in non-performing asset disposal," Grey Systems and Intelligent
Services, 2007. GSIS 2007. IEEE International Conference on, vol., no., pp.910,914, 18-20
Nov.
[36] Zongzhi Li, Kumares C. Sinha (2004) “Methodology for Multicriteria Decision Making in
Highway Asset Management” Journal of the Transportation Research Board. 1885- 1-
pp. 79-87
[37] Standards Association of Australia (2006), Dependability management - Part 3-14:
Application guide - Maintenance and maintenance support, (IEC 60300-3-14 (2004-07),
Standards Australia, North Sydney, Page 15
[38] Kelly A (1989), Maintenance and its management, Conference Communication
[39] Kelly A, Maintenance Strategy - Business-Centered Maintenance, Butterworth
Heinemann, Oxford, 1997
[40] Moteff J Parfomak P, CRS Report for Congress, Critical Infrastructure and Key Assets:
Definition and Identification, Congressional Research Service, The Library of Congress,
2004
[41] Practices for Protecting Information Resources Assets. Identifying Critical Assets and
Conducting a Risk Analysis and Assessment, State of Texas Department of Information
Resources, viewed 6/26/2013
http://www2.dir.state.tx.us/SiteCollectionDocuments/Security/Policies%20and%20Stan
dards/practices-pt1.pdf
[42] http://www.rssb.co.uk
[43] Schwarzenbach, J., Ouertani, M.Z., Parlikad, A.K. (2010), “The impact of behaviors on
asset information quality,” International conference on product lifecycle management.
[44] Kemmerer, S.J. (1999) STEP: The Grand Experience. NIST Special Publication 939 Date
Accessed: 01 March, 2007; Available from:
http://www.mel.nist.gov/msidlibrary/doc/stepbook.pdf.
[45] Krechmer, K. (2005). Open Standards Requirements. In Proceedings of the 38th Annual
Hawaii International Conference on System Sciences. Hawaii. Available in:
http://www.csrstds.com/openstds.pdf
[46] Tassey, G. (2000) Standardization in technology-based markets. Research Policy, Vol. 29,
No. 4, Pg: 587-602(16) Available from:
http://www.ingentaconnect.com/content/els/00487333/2000/00000029/00000004/art
00091
[47] Merriam-Webster. (2003) Merriam-Webster's Collegiate Dictionary (11th, ed.).
Springfield, MA: Merriam-Webster
[48] Koronios A, Nastasie D, Chanana V & Haider A. (2007) Integration through standards: An
overview of international standards relevant to the integration of engineering asset
37
management. World Congress on Engineering Asset Management, Harrogate, UK. pp.
1066-1088.
[49] Mathew, Avin D. and Ma, Lin and Hargreaves, Douglas J. (2008) A conceptual data
modeling methodology for asset management data warehousing. In Gao, Jinji and Lee,
Jay and Ni, Jun and Ma, Lin and Mathew, Joseph, Eds. Proceedings World Congress for
Engineering Asset Management, pages pp. 1086-1095, Beijing, China.
[50] Garfinkel S, Weise D & Strassmann S. (1994) The UNIX-HATERS Handbook. San Mateo,
CA: IDG Books.
[51] Bengtsson, M. (2003). Standardization Issues In Conditioned Based Maintenance.in
Condition Monitoring and Diagnostic Engineering Management - Proceedings of the
16th International Congress. Växjö University, Sweden: Växjö University Press.
38
University Transportation Research Center - Region 2
Funded by the U.S. Department of Transportation