A Systematic and Integral Hazards Analysis Technique Applied To The
A Systematic and Integral Hazards Analysis Technique Applied To The
a r t i c l e i n f o a b s t r a c t
Article history: Traditional approaches to process safety are not enough. Accidents keep occurring every day across the
Received 26 February 2016 globe. Technology advances make systems more complex and their behaviour more non linear and
Received in revised form unpredictable. This trend will increase in the coming years mainly due to the new industrial paradigm
21 June 2016
that will change production processes to fully digital. In this context this paper analyses the current
Accepted 23 June 2016
Available online 25 June 2016
status and methodologies and introduces the need to change to systems theory based approach for
process safety. An overview of different system theory based techniques is presented. A more in deep
explanation is given about the STAMP-STPA methodology. Finally, STPA is applied to a case study of the
Keywords:
Hazard analysis
process industry pointing out the needs, advantages and drawbacks of the approach.
Systems theory © 2016 Elsevier Ltd. All rights reserved.
Process industry
STAMP
STPA
http://dx.doi.org/10.1016/j.jlp.2016.06.016
0950-4230/© 2016 Elsevier Ltd. All rights reserved.
722 M. Rodríguez, I. Díaz / Journal of Loss Prevention in the Process Industries 43 (2016) 721e729
Table 1
Top 3 common failures across all the incidents (Bullemer and Laberge (2010)).
3. Systems theory as the foundation for systems safety Fig. 2. Ten principles for systems thinking to improve system performance and safety
from Shorrock et al. (2014).
3.1. Generalities
Initially formulated by Bertalanffy (1968), general systems the- system behaviour difficult to understand and it cannot be reduced
ory is seen as a general framework for universal, abstract systems to the behaviour of components. Systems thinking and resilience
modelling. Systems conception has evolved from the Cartesian engineering provide approaches to help anticipate and understand
paradigm (structure-function), the statistic-mechanics paradigm system behaviour, to help ensure that things go right.
(evolution-function), the structuralist (evolution-structure-func-
tion) and cybernetic paradigms (homeostasis, goals) into the global 3.2. Systems theory for safety
systemic paradigm represented by the General Systems Theory that
collects and merges somehow the last two paradigms. It dates from Systems theory was proposed for accident analysis research in
the 1930s and 1940s and was a response to the limitations of the the 1980’s (e.g. Leplat, 1984), but its application for safety purposes
classic analysis techniques in coping with the increasingly complex boosted with the work of some researchers as Hollnagel, 2004;
systems being built (Checkland, 1981). Systems theory is nowadays Leveson, 2004; or Rasmussen, 1997. All agreed in that the linear
widely used as the basis for systems engineering and process sys- cause-effect explanation of existing models represented a theo-
tems engineering (Stephanopoulos and Reklaitis (2011)). retical limitation Underwood and Waterson (2012). System safety
A system can be described as “a set of elements or parts that is uses systems theory and systems engineering approaches to pre-
coherently organized and interconnected in a pattern or structure that vent foreseeable accidents and to minimize the result of unforeseen
produces a characteristic set of behaviours, often classified as its ones. Losses in general, not just human death or injury, are
‘function’ or ‘purpose’” (Meadows and Wright (2009)). considered. Such losses may include destruction of property, loss of
A systems viewpoint means seeing the system as a purposeful mission, and environmental harm.
whole e as holistic, and not simply as a collection of parts. We try to According to Leveson (2003) there are several systems safety
“optimise (or at least satisfies) the interactions involved with the principles:
integration of human, technical, information, social, political, eco-
nomic and organizational components” (Wilson (2014)). System safety emphasizes building in safety, not adding it on to
To understand and improve the way that organisations work, we a completed design.
must think in systems. This means considering the interactions System safety deals with systems as a whole rather than with
between the parts of the system (human, social, technical, infor- subsystems or components.
mation, political, economic and organizational) in light of system System safety takes a larger view of hazards than just failures.
goals (Shorrock et al. (2014)). In this paper they proposed 10 System safety emphasizes analysis rather than past experience
principles to encourage a systems thinking approach to improve and standards.
systems performance and safety. These principles are summarised System safety emphasizes qualitative rather than quantitative
in Fig. 2. approaches.
One important principle related to safety is emergence. In Recognition of trade offs and conflicts: Nothing is absolutely
complex systems, outcomes are often emergent and not simply a safe, and safety is not the only, and is rarely the primary, goal in
result of the performance of individual system components. Woods building systems.
et al. (2010) describe emergence as follows: “Emergence means System safety is more than just system engineering.
that simple entities, because of their interaction, cross adaptation
and cumulative change, can produce far more complex behaviours As a conclusion, safety appears as an emergent property that
as a collective and produce effects across scale.” Emergence makes arises at the system level when components are operating together
724 M. Rodríguez, I. Díaz / Journal of Loss Prevention in the Process Industries 43 (2016) 721e729
(it is a system property not a component property). status needs to transfer up the hierarchy to inform the decisions
and actions occurring at the higher levels (Cassano-Piche et al.
3.3. Systems theory based methodologies for safety (2009) and Waterson and Jenkins (2011)).
Accimap is based on this framework and it is used to graphically
A brief description of two of the most used (besides STAMP) represent the system wide failures, decisions and actions involved
systems theory based methodologies, FRAM and Accimap, is given in accidents. Accimap analyses typically focus on failures across the
in this section. following six organizational levels: government policy and budg-
FRAM: Functional Resonance Accident Method. eting; regulatory bodies and associations; local area government
The Functional Resonance Analysis Method or FRAM (Hollnagel planning and budgeting (including company management) tech-
(2004), (2012)) was developed to act as an accident analysis and as nical and operational management; physical processes and actor
a risk assessment tool. It provides a way to describe outcomes using activities; and equipment and surroundings. Accimaps are dia-
the idea of resonance arising from the variability of everyday per- grams developed to support vertical integration across the control
formance. To arrive at a description of functional variability and levels of a socio-technical system.
resonance, and to lead to recommendations for damping unwanted
variability, a FRAM analysis consists of four steps: 4. STAMP and STPA
Identify and describe essential system functions, and charac- 4.1. Definitions
terise each function using the six basic characteristics (aspects):
Input, Output, Precondition, Resource, Control, and Time. System-Theoretic Accident Model and Processes (STAMP) was
Check the completeness/consistency of the model. published by prof. Nancy Leveson in Leveson (2002) and Leveson
Characterise the potential variability of the functions in the (2004) to capture more types of accident causal factors including
FRAM model. social and organizational structures, new kinds of human error,
Define the functional resonance based on dependencies/cou- design and requirements flaws, and dysfunctional interactions
plings among functions and the potential for functional among non-failed components. STAMP is based on systems theory
variability. and control theory. Complex systems are viewed as hierarchical
structures with multiple levels; each level controls lower levels by
The FRAM is based on the four basic principles described below: imposing constraints on the level beneath it. Therefore STAMP
treats safety as a control problem in which accidents arise from
1. The Principle of Equivalence of Successes and Failures: Failure is complex dynamic processes that may operate concurrently and
normally explained as a breakdown or malfunctioning of a interact to create unsafe situations. Safety is an emergent property
system and/or its components. FRAM e and Resilience Engi- and accidents can be prevented by identifying and enforcing con-
neering e acknowledges that things go right and wrong in straints on component interactions. These constraints are imposed
basically the same way. on the operational state of a chemical plant as a system, so process
2. The Principle of Approximate Adjustments: Many socio- safety is a problem that must be addressed within the scope of an
technical systems are intractable. The conditions of work operating plant seen as a system (Leveson and Stephanopoulos
therefore never completely match what has been specified or (2014)). At each level of the system structure, control loops
prescribed. Individuals, groups, and organisations normally (Fig. 3) exist.
adjust their performance to meet existing conditions (resources, The main advantage of Leveson approach is that its general
demands, opportunities, conflicts, interruptions) such adjust- control loop structure can be applied to all the levels of the socio-
ments will invariably be approximate rather than exact. technical organization levels as depicted in Fig. 4. From STAMP
3. The Principle of Emergence: the variability from multiple general theory, two different techniques have been developed
functions may combine in unexpected ways, leading to conse- trying to improve, on one hand, existing hazard analysis and, on the
quences that are disproportionally large, hence produce a non- other hand, existing accident analysis. These two approaches are
linear effect. Both failures and normal performance are emer- STPA (System Theoretic Process Analysis) and CAST (Causal Anal-
gent rather than resultant phenomena, because neither can be ysis based on STAMP).
attributed to or explained only by referring to the (mal)func- STPA is a hazard analysis technique that embodies the STAMP
tions of specific components or parts. accident causality model. As such, it is based on control and system
4. The Principle of Functional Resonance: The variability of a theory rather than the reliability theory underlying most existing
number of functions may every now and then resonate. The hazard analysis techniques. STPA is a new hazard analysis tech-
consequences may spread through tight couplings rather than nique with the same goals as any other hazard analysis technique,
via identifiable and enumerable cause-effect links. Functional that is, to identify scenarios leading to hazards and thus to losses so
resonance is the detectable signal that emerges from the unin- they can be eliminated or controlled. STPA does not generate a
tended interaction of the normal variabilities of many signals. probability number related to the hazard. The only way to generate
such a probability of an accident for complex systems is to omit
important causal factors that are not stochastic or for which
3.3.1. Accimap probabilistic information does not exist (particularly new designs
Rasmussen’s risk management framework (Rasmussen (1997)) for which historical information is not available). In contrast to the
describes the various system levels (e.g. government, regulators, traditional hazard analysis techniques, however, STPA is more
company, company management, staff, and work) involved in powerful in terms of identifying more causal factors and hazardous
production and safety management and considers safety an scenarios, particularly those related to software, system design, and
emergent property arising from the interactions between actors at human behaviour. Because STPA is a top-down, system engineering
each of these levels. For systems to function safely decisions made approach to system safety, it can be used early in the system
at high levels should promulgate down and be reflected in the development process to generate high-level safety requirements
decisions and actions occurring at lower levels of the system. and constraints. Because it works on the hierarchical safety control
Conversely, information at the lower levels regarding the system’s structure, it can be used both on technical design and on
M. Rodríguez, I. Díaz / Journal of Loss Prevention in the Process Industries 43 (2016) 721e729 725
organizational design (Leveson and Thomas (2013)). Fig. 3 allows for a systematic analysis of what factors can go
wrong. The generic loop (applied identified control structure in
4.2. The STPA process step 2) is used mainly in step 3 and part in step 4.
The STPA applying procedure has four steps that are necessary
to complete the process. The steps are (detailed in Leveson
(2011a,b), Leveson and Thomas (2013)): 4.3. Why using STAMP-STPA?
1. Identify Hazards and Accidents. The first step consists in The first reason to use STAMP-STPA comes from defining safety
defining what accidents will be taken into consideration and as a control problem (vs. a failure problem). Enforcing safety con-
identifying the hazards associated to those accidents, under- straints on system behaviour allows to detect and control migration
standing hazard as ”a system state or set of conditions that of the system to states of higher risk which finally is the main cause
together with a particular set of worst-case environmental of most accidents. Other reasons for using STAMP methodology:
conditions, will lead to an accident (loss)“ Leveson (2011a,b).
This step is completed matching the hazards to safety con- It applies to very complex socio-technical systems.
straints (requirements). For example, if the hazard is a toxic It includes software, human and new technology.
release in a chemical plant the safety constraint is that toxic It is based on systems theory and systems engineering.
chemicals must never be released from the plant. It expands the traditional model of accident causation- not just a
2. Draw the functional control structure. This step generates the chain of directly related failure events.
document to perform the STPA process (steps 3 and 4). It con-
tains the whole socio-technical structure of the system under When comparing STPA features with HAZOP-SIL we can find
analysis and the relationships between the different elements. what STPA does (and HAZOP-SIL doesn’t):
3. Identify potentially unsafe control actions. Unsafe control ac-
tions (UCAs) are actions that leads to a hazard. The four types of Include socio-technical analysis
unsafe control action are: Include systemic factors
a. A control action required for safety is not provided. Include all the hierarchy (from regulations to the final process):
b. An unsafe control action is provided that leads to a hazard. safety culture
c. A potentially safe control action provided too late, too early, Fill the design operation gap: avoid higher risk states
or out of sequence.
d. A safe control action is stopped too soon or applied too long And what STPA does not do (vs. traditional safety methods as
(for a continuous or non-discrete control action). HAZOP-SIL):
4. Identify the causes of the unsafe control actions. This step
identifies new safety constraints to be added. In this phase the Put the blame on you (many times an accident investigation
information provided allows the engineers to change the design stops when a human error is found)
to eliminate or mitigate the causes of the hazards. This is the Consider only reliability and probability
most important step of the analysis but also de most difficult Work only in the design stage (or after changes in the plant)
one. Doesn’t follow chains of events
726 M. Rodríguez, I. Díaz / Journal of Loss Prevention in the Process Industries 43 (2016) 721e729
5. STPA for the process industry: a case study needed and have to be taken into account to enforce system safety.
Process plants are, usually, continuous plants and the control is
5.1. STPA for the process industry: adaptation achieved using conventional PID controllers that send the control
action to the final element, typically a control valve. The operation
STAMP has been applied to different industries (nuclear, avia- of the valve is also continuous, and as it is not an On/Off controller
tion, etc.), and it has been proposed as a promising methodology for (the valve is not just open/closed) the Provided/Not Provided UCAs
the process industry, Pasman et al. (2013) and De Rademaekeret al. are not sufficient to describe the control action status. They have to
(2014), although there are not published works on how it should be be extended to include if the control action is more or less than it
applied in this industry. should be. So the UCAs for this system are Provided (we consider
In this paper a new approach is suggested to apply STPA to the that provided means provided correctly, in the expected amount),
chemical and oil&gas industries. The application is focused on the More and Less (both of them constitute the Not Provided type).
lowest level of the control architecture, that is related to the More or Less are directly related to the final value (after the control
equipment and process control loops. Upper control levels (human action) of the manipulated variable. In most of the cases the Less
operators, alarms, maintenance, supervision, etc.) are not type effect includes the None effect on the process although there
addressed and are the subject of a future paper. are some specific situations where None has to be specified besides
The main change to be done in the application of STPA to the the Less type. This could be considered as a third type of the Not
process industry lies in step 3. The four unsafe control action types Provided control action. For example, if pressure is controlled in a
described in the previous section are enough for different domains vessel (hazard: high pressure) manipulating the exit stream, a More
but for chemical systems two extra unsafe control actions types are control action is safe but a Less control action is unsafe as it means
M. Rodríguez, I. Díaz / Journal of Loss Prevention in the Process Industries 43 (2016) 721e729 727
that gas is accumulating in the vessel. The reason to distinguish 5.3. STPA analysis
between more and less instead of leaving Not provided is because
in some cases More can lead to a hazard and Less can lead to a The first step is to identify the accidents that can happen in the
different one in the same equipment. plant. In this case one of them is explosion. After that hazards
Nowadays, STPA tables are individually generated for each UCA leading to that accident are identified, in this example, the hazards
studying hazards for different scenarios (a scenario is a UCA along taken into account are high temperature and high pressure in the
with a context, which is the set of not controlled variables). In the vaporizer as shown in Table 2. Safety constraints are derived to
approach proposed herein, all UCAs are studied at the same time in avoid the hazardous scenarios (also shown in table).
the same table. Scenarios (context variables) are also discretized in If three UCAs (Provided, LESS, MORE) are applied to each control
“Desired”, “None”, “Less” and “More” (following the same UCA action, it would result (according to Equation (1)) in 34 ¼ 81 rows in
discretization criteria). For real systems, the size of the STPA tables the STPA table. However, some cases are not applicable and can be
is huge (although less than using different tables for every UCA). initially discarded in order to reduce the table size. For example, for
The STPA Table Size (STS) can be calculated by (1): the interlock actions only ’Provided’ and ’Not Provided’ (LESS) will
be taken into account according to interlock logic implementation.
Number The number of cases to be studied are 3 3 3 2 ¼ 54. Besides,
controlled all cases in which interlock control action is not provided are,
Y
variables Number of UCAs themselves, unsafe. For all those cases hazard H1 is present.
STS ¼ i¼1
considered for i Therefore, they are eliminated from the STPA so the number of
(1) cases to be studied is reduced to 3 3 3 ¼ 27.
Number
context From tha HAZOP presented in the BSI Standards (2001) it is
Y suggested a low flow alarm in the liquid oil stream as one of the
variables Number of states
j¼1 main recommendations. As it can be seen in Table 3, it can also be
considered for j
deduced from the STPA analysis (rows 19 to 27) that a lower liquid
As it can be seen, the number of rows to evaluate in STPA tables flowrate is related with hazard H1 (increased temperature). The
can be very large. Therefore, some solutions are under development table can be used to propose recommendations to avoid the haz-
in order to automate the analysis. One of them is the A-STPA open ards. Starting in the row with the hazard one can follow the table
tool created by Asim Abdulkhaleq at the Institute of Software and seethe closest safety state. By closest we mean with less vari-
Technology, Stuttgart (Abdulkhaleq and Wagner (2014)). ables different from the hazardous state. For example, it is provided
that one solution for scenario 20 (which means less flow of liquid
oil than expected and more natural gas than expected) would be 21
5.2. Description with no flow through PRV. It means, to close the PRV or, easier, close
the valve associated to TC1 (ID 25).
In order to provide a comparison with traditional HAZOP For the scenarios studied STPA is a superset of HAZOP resulting
studies, let consider the following example of a HAZOP application: in a deeper study of the system with extra information given, but
the oil vaporizer. This is documented in the BSI Standards (2001) HAZOP provides other type of information related with other key
and showed in Fig. 5.
Table 2
Accidents, hazards and safety constraints identified.
Explosion H1: Temperature too high Temp. must never violate a maximum value
H2: Pressure too high Pressure must never violate a maximum value
Table 3
STPA hazards analysis table of the oil vaporizer.
words applied that are not taken into account in this work. For How to filter relevant contexts to hazards to avoid unnecessary
example, when applying ’Other than’ to the liquid oil stream, an scenarios?
evaluation of the influence on vaporizer behaviour of other type of
material different from oil (i.e water) is studied. A way to introduce
this kind of situations in a STPA study could be by defining a new 6. Conclusions
hazard associated with the new situation (’water is present’), add
the control structure associated (if exists) and then analyse new In this paper the current status of process safety has been
UCAs together with the exiting ones. analysed and the need for a new approach has been justified.
Process safety cannot rely on (only) reliability and other technol-
ogies that consider the whole system and the systemic interactions
5.4. Open questions have to be incorporated to the industrial practice. Existing meth-
odologies based on systems theory are promising and in this work
STPA is a promising method that can substitute or more likely we have focused on the application of STAMP-STPA to the process
complement traditional approaches but it still is a young meth- industry.
odology and more work has to be done, specially regarding its STPA has been applied to the lowest level of a chemical process.
application to the process industry. Following are some open The case study shows how STPA could replace or at least comple-
questions that need to be addressed by this technique: ment HAZOP as the hazard analysis technique for chemical and oil
& gas industries. Although the differences between both tech-
Guarantee that there is at least one control action for every niques are not very important in the lowest level, the great
hazard identified. A new explicit step could be added to address advantage of using STPA lies in its systemic nature and its appli-
this. cation to the whole socio-technical hierarchy. Another advantage of
A chemical plant has thousands of variables and controllers: STPA is that it can give a potential recommendation to eliminate
how to define the system limits (the corresponding nodes in hazards using the same analysis (the closest ewith less changes in
HAZOP) for the analysis? variables- safe scenario shown in the table).
How many states must be considered for the process variables Another conclusion is that it is more difficult to apply to the
(discretize)? process industry than to other domains. In fact, a problem found is
How many variables have to be considered (pressure, flow the great size of the resulting tables. It is needed to develop a tool in
composition, temperature, etc.)? order to simplify the analysis. It can be done by applying functional
Can STPA cope with hazards like pipe leaks, dust accumulation, modelling as a way to automatize the analysis of some (or all) cases.
static electricity, HTHA cracking, alarm problems, etc? We are working on applying a functional modelling technique
M. Rodríguez, I. Díaz / Journal of Loss Prevention in the Process Industries 43 (2016) 721e729 729
called D-higraphs Rodriguez and Sanz (2009) for this purpose. and approach to process safety. AIChE J. 60 (1), 2e14. http://dx.doi.org/10.1002/
aic.14278. ISSN 1547-5905. http://dx.doi.org/10.1002/aic.14278. URL.
Mannan, S., 2004. Lees’ Loss Prevention in the Process Industries: Hazard Identi-
References fication, Assessment and Control. Elsevier Science & Technology Books. ISBN
9780750675550.
Abdulkhaleq, A., Wagner, S., 2014. A-stpa: open tool support for system-theoretic Mannan, S., Prem, K., Ng, D., 2010. Challenges and needs for process safety in the
process analysis. In: MIT (Ed.), STAMP Workshop 2014. new millennium. In: 13th International Symposium Loss Prevention and Safety
Bertalanffy, L., 1968. General Systems Theory. George Braziller, New York. Promotion in the Process Industries, 1. Technologisch Instituut vzw, Antwerpen,
BSI Standards, 2001. Hazard and operability studies (HAZOP studies). Application BE, pp. 8e13.
Guide. Technical Report. British Standard. Meadows, D., Wright, 2009. Thinking in Systems: a Primer. Routledge.
Bullemer, P., Laberge, J., Nov. 2010. Common operations failure modes in the process Nimmo, I., 1995. Abnormal situation management. Process Control Eng. 49 (5).
industries. J. Loss Prev. Process Industries 23 (6), 928e935. Pasman, H., 1998. 50 years of improvement to safety. In: NRIFD (Ed.), Proc. Int.
Cassano-Piche, A., Vicente, K., Jamieson, G., 2009. A test of Rasmussen’s risk man- Workshop on Safety in the Transport, Storage and Use of Hazardous Materials,
agement framework in the food safety domain:BSE in the UK. Theor. Issues Tokio, Japan.
Ergonomics Sci. 10, 283e304. Pasman, H.J., Knegterning, B., Rogers, W.J., 2013. A holistic approach to control
Center for Chemical Process Safety, 1999. Guideline for Hazard Evaluation Pro- process safety risks: possible ways forward. Reliab. Eng. Syst. Saf. 117, 21e29.
cedures. Technical Report. AIChE, New York, NY. Rasmussen, J., 1997. Risk management in a dynamic society: a modelling problem.
Checkland, P., 1981. Systems Thinking, Systems Practice. Wiley, New York. Saf. Sci. 27 (2e3), 183e213.
De Rademaeker, E., Suter, G., Pasman, H.J., Fabiano, B., Mar. 2014. A review of the Rodriguez, M., Sanz, R., 2009. Model. using Higr. Integrating approach 26, 871e876.
past, present and future of the european loss prevention and safety promotion Shorrock, S., Leonhardt, J., Licu, T., Peters, C., 2014. Systems thinking for safety: ten
in the process industries. Process Saf. Environ. Prot. 92 (4), 280e291. http:// principles. A White Paper. Eurocontrol.
dx.doi.org/10.1016/j.psep.2014.03.007. ISSN 09575820. Soken, N., Bullemer, P., Ramanathan, P., Reinhart, B., 1995. Human-computer
Dunjo, J., Fthenakis, V., Vílchez, J. a., Arnaldos, J., Jan. 2010. Hazard and operability interaction requirements for managing abnormal situations in chemical process
(HAZOP) analysis. A literature review. J. Hazard. Mater. 173 (1e3), 19e32. http:// industries. In: Proceedings of the ASME Symposium on Computers in Engi-
dx.doi.org/10.1016/j.jhazmat.2009.08.076. ISSN 1873-3336. neering, Houston, TX.
Hollnagel, E., 2004. Barriers and Ac cident Prevention. Ashgate Publishing Limited, Stephanopoulos, G., Reklaitis, G.V., 2011. “Process systems engi- neering: from
Aldershot. solvay to modern bio- and nanotechnol- ogy. A history of development, Suc-
Hollnagel, E., 2012. FRAM- the Functional Resonance Analysis Method: Modelling cesses and prospects for the future”. Chem. Eng. Sci. 66, 4272e4306.
Complex Socio-technical Systems. Ashgate, Farnham, UK. Underwood, P., Waterson, P., 2012. In: Stanton, Neville (Ed.), A Critical Review of the
Leplat, J., 1984. J. Occupational accident research and systems approach. J. Occup. STAMP, FRAM and Accimap Systemic Accident Analysis Models in Book: Ad-
Accid. 6 (1e3), 77e89. vances in Human Aspects of Road and Rail Transportation. CRC Press,
Leveson, N., 2002. A systems model of accidents. Int. Syst. Saf. Soc. Unionv. U. S. A. pp. 385e394. Chapter: 39.
Leveson, N., 2003. White paper on approaches to safety engineering. Technical Venkatasubramanian, V., 2011. Systemic failures : challenges and opportunities in
Paper. MIT. risk management in complex systems. AIChE J. 57 (1), 2e9. http://dx.doi.org/
Leveson, N., 2004. A new accident model for engineering safer systems. Saf. Sci. 42 10.1002/aic.
(4), 237e270. Waterson, P., Jenkins, D., 2011. Lessons learnt from using AcciMaps and the risk
Leveson, N., 2011a. Applying systems thinking to analyze and learn from events. Saf. management framework to analyse large-scale sys- temic failures. In:
Sci. 49, 55e64. Anderson, M. (Ed.), Contemporary Ergonomics and Human Factors.
Leveson, N., 2011b. Engineering a safer world. Systems Thinking Applied to Safety. Wilson, J., 2014. Fundamentals of systems ergonomics/human factors. Appl. Ergon.
The MIT Press. ISBN 9780262016629. 41 (1), 5e13.
Levenson, N., Thomas, J., 2013. An STPA primer. Technical Report. Massachusetts Woods, D., Dekker, S., Cook, R., Johannsen, L., Sarter, N., 2010. Behind Human Error.
Institute of Technology, Boston. Ashgate.
Leveson, N., Stephanopoulos, G., 2014. A system-theoretic, control-inspired view