Systems Thinking in Practice - Applications of The Event Analysis of Systemic Teamwork Method (PDFDrive)
Systems Thinking in Practice - Applications of The Event Analysis of Systemic Teamwork Method (PDFDrive)
in Practice
Applications of the Event Analysis
of Systemic Teamwork Method
Transportation Human Factors: Aerospace,
Aviation, Maritime, Rail, and Road Series
Series Editor
Professor Neville A Stanton
University of Southampton, UK
Automobile Automation
Distributed Cognition on the Road
Victoria A. Banks, Neville A. Stanton
Eco-Driving
From Strategies to Interfaces
Rich C. McIlroy, Neville A. Stanton
Neville A. Stanton
Paul M. Salmon
Guy H. Walker
CRC Press
Taylor & Francis Group
6000 Broken Sound Parkway NW, Suite 300
Boca Raton, FL 33487-2742
This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have
been made to publish reliable data and information, but the author and publisher cannot assume responsibility
for the validity of all materials or the consequences of their use. The authors and publishers have attempted to
trace the copyright holders of all material reproduced in this publication and apologize to copyright holders if
permission to publish in this form has not been obtained. If any copyright material has not been acknowledged
please write and let us know so we may rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmit-
ted, or utilized in any form by any electronic, mechanical, or other means, now known or hereafter invented,
including photocopying, microfilming, and recording, or in any information storage or retrieval system, with-
out written permission from the publishers.
For permission to photocopy or use material electronically from this work, please access www.copyright.com
(http://www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive,
Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization that provides licenses and registration
for a variety of users. For organizations that have been granted a photocopy license by the CCC, a separate
system of payment has been arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used
only for identification and explanation without intent to infringe.
Distributed Cognition..................................................................... 19
Distributed Situation Awareness....................................................20
Beyond Ethnography...................................................................... 21
The Air Traffic Control Work Setting................................................. 23
Charts and Standard Routes........................................................... 23
Flight Data Strip............................................................................. 23
Flight Data Strip Bay...................................................................... 23
Radar Display................................................................................. 23
Aircraft Call Signs.........................................................................24
Communications.............................................................................24
Distributed Cognition Methodology: The Importance of Methods........ 24
Descriptive vs. Formative Methods................................................24
Method Integration.........................................................................25
Air Traffic Control Scenarios..............................................................25
Applying the Method......................................................................26
Representing Distributed Cognition...............................................26
Task Networks................................................................................26
Social Networks.............................................................................. 27
Propositional Networks..................................................................28
Application to Air Traffic Control......................................................28
Analysis of Agents in the Distributed Cognition System...............28
Facilitating Technology.................................................................. 31
Control Architecture....................................................................... 31
Systemic Situational Awareness..................................................... 33
Temporal Aspects of Command and Control in Air Traffic
Control............................................................................................ 35
Conclusions......................................................................................... 35
Acknowledgements............................................................................. 36
References........................................................................................... 36
Methodology................................................................................. 213
Data Inputs............................................................................... 213
EAST Network Development.................................................. 213
Network Analysis.................................................................... 214
Results............................................................................................... 216
Task Network................................................................................ 216
Social Network............................................................................. 216
Information Network.................................................................... 216
Control Network........................................................................... 219
Discussion..................................................................................... 219
Implications for Railway Level Crossing Safety
Management................................................................................. 223
Conclusion......................................................................................... 223
References.........................................................................................224
xiii
xiv Preface
led by Victoria Banks. We are grateful for the contributions and insights from our
co-authors and the progress that has been made with the method since its original
conception.
The EAST development journey is not at the end yet. There have been recent
developments that have extending the use of EAST. EAST, as a systems method, has
fared well, as systems approaches are very much in favour in the Ergonomics and
Human Factors world. We have had some successes linking EAST to other systems
methods, such as Systems Theoretic Accident Model and Process |(STAMP) and
Cognitive Work Analysis (CWA). We have also used EAST in formative ways to pre-
dict system network resilience. The journey does not end here, however, and we are
sure that we and others will continue to develop and extend the approach and apply
it to even more domains of application.
Neville A. Stanton
Professor of Human Factors Engineering
University of Southampton
Sorensen, L. J. and Stanton, N. A. (2016). Keeping it together: The role of transactional situ-
ation awareness in team performance. International Journal of Industrial Ergonomics,
53, 267–273.
Salmon, P. M., Lenné, M. G., Walker, G. H., Stanton, N. A. and Filtness, A. (2014). Using the
Event Analysis of Systemic Teamwork (EAST) to explore conflicts between different
road user groups when making right hand turns at urban intersections, Ergonomics,
57(11), 1628–1642.
Salmon, P., Lenné, M., Walker, G. H., Stanton, N. A. and Filtness, A. (2014). Exploring
schema-driven differences in situation awareness across road users: An on-road
study of driver, cyclist and motorcyclist situation awareness. Ergonomics, 57(2),
191–209.
Stanton, N. A. (2014). Representing distributed cognition in complex systems: How a subma-
rine returns to periscope depth. Ergonomics, 57(3), 403–418.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Gibson, H., Salmon, P. M. and Jenkins,
D. P. (2010). From ethnography to the EAST method: A tractable approach for repre-
senting distributed cognition in air traffic control. Ergonomics, 53(2), 184–197.
Walker, G. H., Stanton, N. A., Salmon, P. M., Jenkins, D., Stewart, R. and Wells, L. (2009).
Using an integrated methods approach to analyse the emergent properties of military
command and control. Applied Ergonomics, 40(4) 636–647.
Stanton, N. A., Salmon, P. M., Walker, G. H., and Jenkins, D. P. (2009). Genotype and pheno-
type schema and their role in distributed situation awareness in collaborative systems.
Theoretical Issues in Ergonomics Science, 10(1), 43–68.
Stanton, N. A., Salmon, P. M., Walker, G. H., and Jenkins, D. P. (2009). Genotype and phe-
notype schemata as models of situation awareness in dynamic command and control
teams. International Journal of Industrial Ergonomics, 39(3), 480–489.
Salmon, P. M., Stanton, N. A., Walker, G. H., Jenkins, D. P., Baber, C., and McMaster, R.
(2008). Representing situation awareness in collaborative systems: A case study in the
energy distribution domain. Ergonomics, 51(3), 367–384.
Stewart, R., Stanton, N. A., Harris, D., Baber, C., Salmon, P., Mock, M., Tatlock, K., Wells, L.
and Kay, A. (2008). Distributed situation awareness in an Airborne Warning and
Control System: Application of novel ergonomics methodology. Cognition, Technology
and Work, 10(3), 221–229.
Salmon, P. M., Stanton, N. A., Walker, G. H., Jenkins, D. P., Baber, C., and McMaster, R.
(2008). Representing situation awareness in collaborative systems: A case study in the
energy distribution domain. Ergonomics, 51(3), 367–384.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. and Green, D. (2006). Event
Analysis of Systemic Teamwork (EAST): A novel integration of ergonomics methods
to analyse C4i activity. Ergonomics, 49(12–13), 1345–1369.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P., Stewart, R. and
Walker, G. (2006). Command and control in emergency services operations: A social
network analysis. Ergonomics, 49(12–13), 1204–1225.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon, P.,
Hoyle. G., Walker, G., Young. M. S. et al. (2006). Distributed situation awareness in
dynamic systems: Theoretical development and application of an ergonomics method-
ology. Ergonomics, 49(12–13), 1288–1311.
Stanton, N. A., Baber, C. and Harris, D. (2008). Modelling Command and Control: Event
Analysis of Systemic Teamwork. Ashgate: Aldershot.
Stanton, N. A., Salmon, P. M., Rafferty, L. A., Walker, G. H., Baber, C. and Jenkins, D.
(2013). Human Factors Methods: A Practical Guide for Engineering and Design (sec-
ond edition). Ashgate: Aldershot.
Authors
Professor Neville Stanton, PhD, DSc, is a chartered psychologist, chartered ergon-
omist and chartered engineer. He holds the Chair in Human Factors Engineering in
the Faculty of Engineering and the Environment at the University of Southampton
in the United Kingdom. He earned degrees in Psychology, Applied Psychology and
Human Factors and has worked at the Universities of Aston, Brunel, Cornell and
MIT. His research interests include modelling, predicting, analysing and evaluating
human performance in systems as well as designing the interfaces and interaction
between humans and technology. Professor Stanton has worked on the design of
automobiles, aircraft, ships and control rooms over the past 30 years on a variety
of automation projects. He has published 40 books and over 300 journal papers on
Ergonomics and Human Factors. In 1998, he was awarded the Institution of Electrical
Engineers Divisional Premium Award for research into System Safety. The Institute
of Ergonomics and Human Factors awarded him the Otto Edholm Medal in 2001, the
President’s Medal in 2008 and the Sir Frederic Bartlett Medal in 2012 for his contri-
butions to basic and applied ergonomics research. The Royal Aeronautical Society
awarded him and his colleagues the Hodgson Prize and Bronze Medal in 2006 for
research on design-induced, flight-deck error published in The Aeronautical Journal.
The University of Southampton awarded him a Doctor of Science in 2014 for his sus-
tained contribution to the development and validation of Human Factors methods.
Professor Paul Salmon holds a Chair in Human Factors and is creator and director
of the Centre for Human Factors and Sociotechnical Systems at the University of
the Sunshine Coast. He currently holds a prestigious Australian Research Council
Future Fellowship and has almost 15 years’ experience in applied Human Factors
research in a number of areas, including defence, transportation safety, sports and
outdoor recreation and disaster management. Professor Salmon currently leads
major research programmes in the areas of road and rail safety, identity theft and
cybersecurity and led outdoor recreation accidents. He has co-authored 14 books,
over 180 peer-reviewed journal articles and numerous conference articles and book
chapters. He has received various accolades for his contributions to research and
practice, including the Australian Human Factors and Ergonomics Societies 2016
Cumming Memorial medal, the UK Ergonomics Society’s Presidents Medal, the
Royal Aeronautical Society’s Hodgson Prize for best research and paper and the
University of the Sunshine Coast’s Vice Chancellor and President’s Medal for
Research Excellence. Professor Salmon’s current research interests relate to extend-
ing Human Factors and Sociotechnical Systems theory and methods to support the
optimisation of systems in many areas. Specific areas of focus include accident pre-
diction and analysis, systems thinking in transportation safety, the development of
systemic accident countermeasures, human factors in elite sports and cybersecurity.
Professor Guy Walker works within the Institute for Infrastructure and Environment
at Heriot-Watt University in Edinburgh. He lectures on Human Factors and is the
xvii
xviii Authors
xix
xx Board Members and Affiliations
In this book, we describe a series of studies that apply the systems thinking approach
using the Event Analysis of Systemic Teamwork (EAST) method. Systems thinking
is a contemporary approach that has currency within the discipline of human fac-
tors. It aims to understand and improve safety and performance in complex socio-
technical systems. Human factors issues are increasingly being examined through
the systems thinking lens (Karsh et al. 2014; Salmon et al. 2017; Walker et al.
2017). In line with this, since the turn of the century, a range of Human Factors
methods have either been developed or have experienced a resurgence in popular-
ity. These include systems analysis frameworks, such as Cognitive Work Analysis
(CWA) (Vicente 1999) and EAST (Stanton et al. 2008); accident analysis methods,
such as AcciMap (Svendung and Rasmussen 2002), the Systems Theoretic Accident
Model and Processes (STAMP) (Leveson 2004), and the Functional Resonance
Analysis Method (FRAM) (Hollnagel 2012); and systems design methods, such as
the MacroErgonomic Analysis and Design method (MEAD) (Kleiner 2006) and the
Cognitive Work Analysis Design Toolkit (Read et al. 2016).
The aim of this book is to demonstrate how one of these methods, EAST, can be
used to provide in-depth analyses of performance and safety in complex sociotechni-
cal systems (STS). The systems thinking approach involves taking the overall system
as the unit of analysis, looking beyond individuals and considering the interactions
between humans and between humans and artefacts within a system. This view also
encompasses factors within the broader organisational, social or political system in
which behaviour takes place. Taking this perspective, behaviours emerge not from
the decisions or actions of individuals but from interactions between humans and
artefacts across the wider system. At the most basic level when examining STS, the
descriptive constructs of interest can be distilled down to simply
3
4 Systems Thinking in Practice
DOMAIN OF APPLICATION
EAST is a generic approach that was developed originally for the analysis of
teamwork in sociotechnical systems, but it has since been used to provide analy-
ses at the micro (Salmon et al. 2014a), meso (Stanton 2014) and macro (Stanton
and Harvey 2017) levels of sociotechnical systems. As such, it can be used in any
domain in which social and technical elements are working together in pursuit
of a common goal. The case study presented in this chapter, used to demonstrate
EAST, is based on an application within the area of land use planning and in
urban design (Stevens et al., 2018).
The data transcription process allows the analyst to gain a deeper and more
accurate understanding of the scenario under investigation. It also allows any dis-
crepancies between the initial HTA scenario description and the actual activity
observed to be resolved. Typically, activities in complex sociotechnical systems
do not run entirely according to protocol, and certain tasks may have been per-
formed during the scenario that were not described in the initial HTA description.
The analyst should compare the scenario transcript to the initial HTA and add any
changes as required.
Constructing the task network involves identifying high-level tasks and the rela-
tionships between them and creating a network to represent this. Some general rules
around the construction of EAST networks are presented in Table 1.1.
TABLE 1.1
Analysis Rules Regarding the Relationships Between Nodes Within EAST
Networks
Once the EAST networks are complete, it is pertinent to validate the outputs using
appropriate SMEs and recordings of the scenario under analysis. Any problems iden-
tified should be corrected at this point.
within the networks. Three popular network analysis metrics have previously been
used to interrogate EAST networks:
ADVANTAGES
• The analysis produced is extremely comprehensive and activities are anal-
ysed from various perspectives.
• The analysis is both qualitative (networks) and quantitative in nature (net-
work analysis metrics).
• Composite networks enable analysts to explore the relationships between
tasks, agents and information.
• The use of network analysis metrics enables analysts to identify key tasks,
agents and information.
• The framework can be used both retrospectively and predictively to fore-
cast system behaviour (e.g. Stanton and Harvey 2017).
• The framework approach allows methods to be chosen based on analysis
requirements.
10 Systems Thinking in Practice
• EAST has been applied in a wide range of different domains for various
purposes. The approach is generic and can be used to evaluate activities in
any domain.
• Various Human Factor (HF) concepts can be examined, including distrib-
uted situation awareness, distributed cognition, decision making, teamwork
and communications.
• It uses structured and valid HF methods and has a sound theoretical
underpinning.
DISADVANTAGES
• When undertaken in full, the EAST framework is a very time-consuming
approach.
• The use of various methods ensures that the framework incurs a high train-
ing time.
• In order to conduct an EAST analysis properly, a high level of access to the
domain, task and SMEs is required.
• Some parts of the analysis can become overly time-consuming and labori-
ous to complete.
• Some of the outputs can be large, unwieldy and difficult to present in
reports, papers and presentations.
• Reliability and validity have not yet been formally tested.
RELATED METHODS
EAST uses HTA, social network analysis and information networks. Various
methods can be used to collect the data required to construct task, social and
information networks, including concurrent verbal protocol analysis, the CDM
(Klein et al. 1986), observation, documentation review and content and thematic
analysis.
FLOWCHART
A flowchart showing the main phases of EAST is shown below, separated into the
three phases of data collection, data analysis and representation methods (Figure 1.2).
The Event Analysis of Systemic Teamwork (EAST) Method 11
FIGURE 1.2 Flowchart showing phases and associated methods for EAST.
TOOLS NEEDED
Normally, video and audio recording devices are used to record the activities under
analysis. A drawing software package such as Microsoft Visio is also typically used
to reproduce the networks. The HTA tool or other task analysis tools can be used to
support development of the task network. The AGNA social network analysis soft-
ware tool is typically used to quantitatively analyse the networks, and the Leximaner
thematic analysis tool can be used to construct information networks directly from
verbal or communications transcripts (e.g. Salmon et al. 2014b).
EXAMPLE
In the following example, EAST was used to examine a generic land use and urban
planning site analysis process (Stevens et al., 2018). Task, social and information
networks were constructed to describe the key tasks, agents and information used
during site analysis. Initially, a task network was constructed based on a HTA of a
generic site analysis process.
As shown in Figure 1.3, 11 key interrelated tasks were identified. The task
network is a dense one with many interdependencies between tasks, suggesting
that the tasks required are tightly coupled. In particular, the tasks of analysing
the neighbourhood and determining circulation patterns are the most connected
within the task network, suggesting that they are central to the overall site analy-
sis process.
A social network diagram was constructed based on identifying which agents
are required to communicate with each other during the site analysis process (see
12 Systems Thinking in Practice
Figure 1.4). The social network demonstrates that there are 19 distinct agents involved
in the site analysis process. This reliance on multiple actors to assemble the required
information for the site analyses is central the work within LUP & UD disciplines.
In contrast to the well-connected task network, however, there are few connections
between the agents within the social network, suggesting that the network of agents
involved in site analysis are loosely coupled.
The social network suggests that, while many actors are necessary for the assem-
bly of the required information, they are most often working independently, while
a central organisational agent coordinates their responses. This central agent is the
urban planner and designer, with the social network diagram revealing that the most
connected agents within the site analysis process are urban planners and designers,
with connections to all other agents involved in the process. Indeed, urban planners
and designers are the only agent in the social network to have connections with more
than four other agents. This indicates that urban planners and designers are the key
agents within the site analysis process, with the local council being the next most
connected. The structure of the social network diagram suggests that there may some
simplistic interventions that could improve the site analysis process. Logical inter-
ventions would be to attempt to increase the connectivity of the network through
incorporating a requirement for further communication between agents and to reduce
the load placed on urban planners and designers.
The Event Analysis of Systemic Teamwork (EAST) Method 13
FIGURE 1.4 Social network of the agents in the site analysis process.
An information network showing the information required during the site analy-
sis process was constructed based on the HTA (see Figure 1.5). According to the
information network, multiple sources of information are required to complete the
site analysis process, ranging from information on locations, topography, views,
drainage, climate and utilities to traffic, urban form, sensory elements and commer-
cial, retail, residential and community functions.
Examining the connectedness of different nodes within the network suggests
that there are various critical pieces of information required, including locations,
commercial functions, neighbourhood context, road hierarchy, residential functions,
retail functions, pathways and travel times.
To demonstrate the composite network function of EAST, the task and social net-
works were combined to show which agents are involved in the 11 key site analysis
tasks. The task by agent network is presented in Figure 1.6.
14 Systems Thinking in Practice
The composite task and social network shows the allocation of tasks across dif-
ferent agents. Again, the critical role of the urban planners and designers is high-
lighted, as they are the only agent that is constant across all 11 site analysis tasks.
In addition, the network demonstrates the key requirement for multi-stakeholder
input across the tasks. For example, tasks such as ‘Identify human and cultural ele-
ments’ and ‘Identify natural physical features’ have eight and seven agents involved,
respectively. When this is considered with the social network, which shows that
there are few agents communicating with one another through the site analysis pro-
cess, it suggests that the process could be made more efficient through the addition
of mechanisms designed to enhance communications and interactions between all
of the stakeholders involved. The remainder of this book will show applications of
EAST to a variety of domains as well as some developments and extensions to the
approach.
The Event Analysis of Systemic Teamwork (EAST) Method 15
FIGURE 1.6 Combined task, social and information network showing site analysis tasks by
agent.
REFERENCES
Driskell, J. E. and Mullen, B. (2004). Social network analysis. In: N. A. Stanton, A. Hedge E.
Salas, H. Hendrick and K. Brookhuis (Eds.), (2005). Handbook of Human Factors and
Ergonomics Methods (pp. 58.1–58.6). Taylor & Francis: London.
Hollnagel, E. (2012). FRAM: The Functional Resonance Analysis Method: Modelling
Complex Socio-Technical Systems. Ashgate: Aldershot.
Houghton, R. J., Baber, C., Cowton, M., Walker, G. H. and Stanton, N. A. (2008). WESTT
(Workload, Error, Situational Awareness, Time and Teamwork): An analytical pro-
totyping system for command and control. Cognition, Technology and Work, 10 (3),
199–207.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P., Stewart, R. and Walker,
G. (2006). Command and control in emergency services operations: A social network
analysis. Ergonomics, 49 (12–13), 1204–1225.
Karsh, B. T., Waterson, P. and Holden, R. J. (2014). Crossing levels in systems ergonomics:
A framework to support ‘mesoergonomic’ inquiry. Applied Ergonomics, 45 (1), 45–54.
Klein, G. A., Calderwood, R., and MacGregor, D. (1989). Critical decision method for elicit-
ing knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19 (3), 462–472.
Kleiner, B.M. (2006). Macroergonomics: Analysis and design of work systems. Applied
Ergonomics, 37 (1), 81–89.
Leveson, N. (2004). A new accident model for engineering safer systems. Safety Science, 42
(4), 237–270.
Read, G. J. M., Salmon, P. M. and Lenné, M. G. (2016). When paradigms collide at the road–
rail interface: Evaluation of a sociotechnical systems theory design toolkit for cognitive
work analysis. Ergonomics, 59 (9), 1135–1157.
Salmon, P. M., Lenné, M. G., Walker, G. H., Stanton, N. A. and Filtness, A. (2014a). Using the
Event Analysis of Systemic Teamwork (EAST) to explore conflicts between different
road user groups when making right hand turns at urban intersections. Ergonomics, 57
(11), 1628–1642.
16 Systems Thinking in Practice
Salmon, P. M., Lenné, M. G., Walker, G. H., Stanton, N. A. and Filtness, A. (2014b). Exploring
schema-driven differences in situation awareness across road users: An on-road study
of driver, cyclist and motorcyclist situation awareness. Ergonomics, 57 (2), 191–209.
Salmon, P. M., Walker, G. H., Read, G. J., Goode, N. and Stanton, N. A. (2017). Fitting meth-
ods to paradigms: Are ergonomics methods fit for systems thinking? Ergonomics, 60
(2) 194–205.
Stanton, N. A. (2006). Hierarchical task analysis: Developments, applications and extensions.
Applied Ergonomics, 37, 55–79.
Stanton, N. A. (2014). Representing distributed cognition in complex systems: How a subma-
rine returns to periscope depth. Ergonomics, 57 (3), 403–418.
Stanton, N. A., Baber, C. and Harris, D. (2008). Modelling Command and Control: Event
Analysis of Systemic Teamwork. Ashgate: Aldershot.
Stanton, N. A. and Harvey, C. (2017). Beyond human error taxonomies in assessment of risk
in sociotechnical systems: A new paradigm with the EAST ‘broken-links’ approach.
Ergonomics, 60 (2), 221–233.
Stanton, N. A., Salmon, P. M., Rafferty, L. A., Walker, G. H., Baber, C. and Jenkins, D.
(2013). Human Factors Methods: A Practical Guide for Engineering and Design (sec-
ond edition). Ashgate: Aldershot.
Stanton, N. A., Salmon, P. M., Walker, G. H., Baber, C. and Jenkins, D. (2005). Human
Factors Methods: A Practical Guide for Engineering and Design (first edition).
Ashgate: Aldershot.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon, P.,
et al. (2006). Distributed situation awareness in dynamic systems: Theoretical devel-
opment and application of an ergonomics methodology. Ergonomics, 49 (12–13),
1288–1311.
Stevens, N., Salmon P. M., Walker, G. H. and Stanton N. A. (2018). Human Factors in Land
Use Planning and Urban Design: Methods, Practical Guidance, and Applications.
CRC Press: Boca Raton, FL.
Stewart, R., Stanton, N. A., Harris, D., Baber, C., Salmon, P., Mock, M., Tatlock, K., Wells,
L. and Kay, A. (2008). Distributed situation awareness in an airborne warning and
control system: Application of novel ergonomics methodology. Cognition, Technology
and Work, 10 (3), 221–229.
Svendung, I. and Rasmussen, J. (2002). Graphic representation of accident scenarios: Mapping
system structure and the causation of accidents. Safety Science, 40 (5), 397–417.
Vicente, K. (1999). Cognitive Work Analysis: Towards Safe, Productive and Healthy Work.
Lawrence Erlbaum Associates: Mahwah, NJ.
Walker, G. H., Salmon, P. M., Bedinger, M. and Stanton, N. A. (2017). Quantum ergonomics:
Shifting the paradigm of the systems agenda. Ergonomics, 60 (2), 157–166.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Gibson, H., Salmon, P. M. and Jenkins, D. P.
(2010). From ethnography to the EAST method: A tractable approach for representing
distributed cognition in air traffic control. Ergonomics, 53 (2), 184–197.
Walker, G. H., Stanton, N. A. and Salmon, P. M. (2011). Cognitive compatibility of motorcy-
clists and car drivers. Accident Analysis & Prevention, 43 (3), 878–888.
Section II
Applications of EAST
2 EAST in Air Traffic
Control
With Chris Baber, Linda Wells,
Huw Gibson and Daniel P. Jenkins
INTRODUCTION
Command and Control
In command and control scenarios, there is a common goal (comprising interact-
ing sub-goals), there are multiple individuals who need to communicate and coor-
dinate with each other in order to attain these goals and, increasingly, there are
ever more complex ways of facilitating this process with technology. Command
and control, at the most generic level, can be viewed as a form of management
infrastructure for planning and organisation (Harris and White 1987). It involves
the exercise of authority and direction by properly designated individual(s) over
assigned resources, as well as planning, directing, coordinating and controlling how
those resources are deployed (Builder et al. 1999). ‘Command’ can be viewed as
the definition of overall system objectives or goals, whereas ‘control’ is the manage-
ment of process and activities that lead to the achievement of these objectives (or
compensate for changes in the environment that hinder their achievement). Many
contemporary sociotechnical systems involve authority, planning, directing and
coordinating and can be considered as forms of command and control. Air Traffic
Control (ATC) is one example.
Distributed Cognition
From a distributed cognition perspective (e.g. Hutchins 1995a), the task of ATC can
be viewed as a form of ‘“computation” to maintain separation between aircraft in a
region of airspace’ (Fields et al. 1998, p. 86). It is further argued that the computa-
tions do not reside solely in the heads of individual controllers; instead, they are dis-
tributed across the entire ATC system, comprising numerous controllers, teams and
technical artefacts. The essence of distributed cognition is on ‘how [these computa-
tions] transcend the boundaries of the individual actor’ (Rogers 1997, p. 1; Hutchins
1995a; Hollan et al. 2000).
The language of representational states is used to describe the visible and external
manifestations of various ‘environmental contributions’ to the total system (Rogers
and Ellis 1994; Fields et al. 1998). Representational states subsume the full range of
19
20 Systems Thinking in Practice
observable interactions between people and artefacts, as well as the resulting states
(and state changes) that arise from the various ‘computations to maintain separation
between aircraft’. For example, an observable interaction might be a controller issu-
ing an instruction to an aircraft. The resulting state might be a corresponding change
in the aircraft’s representation on the radar display.
In command and control situations, these computations and representational
states interact. A change in representational state leads to further computations, fur-
ther representational states and further computations. But whilst these simple low-
level mechanisms can be multiplied in simple ways to form the total ATC system,
the high-level function, the system’s aggregate behaviour, can be highly complex
and adaptive (Chalmers 1990). Phenomena ‘wherein complex, interesting high-
level function is produced as a result of combining simple low-level mechanisms in
simple ways’ are referred to as ‘emergence’ (Chalmers 1990, p. 2). A key emergent
property of ATC is the so-called ‘picture’ or, in ergonomics parlance, situational
awareness (SA).
‘not’ overlapping between two or more people, but which fits together like a jigsaw;
Salmon et al. 2008). The fundamental problem stems from a tacit assumption that
the ‘situation’ can be defined as a single, objective, external reality and that the goal
of the people operating within the situation is to respond to all features appropriately.
This is problematic on three counts:
1. There are many aspects of command and control scenarios that require the
individual to make judgements and interpretations (so the assumption of the
‘objective reality’ of a situation is not always valid).
2. There are multiple sub-goals and multiple views of the situation (so the idea
of a single reality is not valid either).
3. Different agents within the system use different representational states to
inform and support their work, so the notion that there can be a single view
of the situation (as opposed to several interlocking views) is also not easily
supported.
One way to resolve the mismatch between mainstream thinking in SA and distrib-
uted cognition of the sort encountered in complex systems, such as ATC, is to con-
sider one of the relatively invariant properties of it: information. According to Bell
and Lyon (2000): ‘all aspects of momentary SA are eventually reducible to some
form of [. . .] information in working memory’ (p. 42). Information, in the SA sense,
refers to what, in distributed cognition language, are called representational states.
The question to ask is whether ‘working memory’ is the only place where such
states can be represented. Distributed cognition would suggest not. It suggests that
non-human artefacts can create, manage and share such states (to some extent at
least), meaning that the technical aspects of a sociotechnical system will be con-
tributing to the exchange of representational states too. The totality of this will be a
form of systems level awareness that is not traceable to any one individual and is not
consistent with a distributed cognition view of the world, nor resides exclusively in
the minds of humans. Thus, not only is the individual-level ATC ‘picture’ emergent,
so too is the systems level ‘picture’.
Another consideration is that representational states can be promulgated around
the system with very little in the way of overt communication. One of the great
strengths of expert operators is their ability to chunk information, to abstract and
pattern match, to develop a high level of awareness from relatively little information
in the world (e.g. Chase and Simon 1973). The update of a representational state for
one agent might lead to partial updating of that used by another. For example, as an
aeroplane moves across a sector, its route is plotted on the ATC displays and its posi-
tion updated dynamically; if there is no definable risk, then the updating happens
automatically and without the need for intervention.
Beyond Ethnography
Whilst there is much to say in favour of blending some of the ideas connected
with SA and distributed cognition, there are several problematic issues when it
comes to actually applying either approach. It should be clear by now that purely
22 Systems Thinking in Practice
individualistic approaches to analysis may not capture all the required information
about complex command and control scenarios. It is also the case that the tradi-
tional experimental approach may lack predictive efficiency in the face of significant
numbers of emergent behaviours. Distributed cognition, focusing as it does ‘on the
material and social means of the construction of action and meaning’ (Hollan et al.
2000, p. 178), employs ethnography to understand how information is used to sup-
port decision making, how it is represented and how it is manifest in the physical
and social world (e.g. Rogers and Ellis 1994; Hutchins and Klausen 1996; Hutchins
and Holder 2000; Hutchins and Holder 2001). Ethnography is a form of naturalistic,
qualitative description based on observation. True ethnography places a requirement
to live as a member of the ‘tribe’ for an extended period (possibly weeks or months)
and to undertake the tasks and rituals of the tribe. The understanding gained from
this participatory observation normally forms the basis of a report written from a
first-person perspective as a participant observer. In the field of distributed cogni-
tion, ethnographic methods are deployed. The problems with ethnography in terms
of applying it in practice are as follows:
These issues limit the practical value of distributed cognition in command and
control settings and serve as a barrier to employing what is potentially a useful
and enlightened approach to the analysis of complex systems. A response to this
problem, however, appears to lie in the fundamentals of the distributed cognition
approach itself. By characterising complex systems using the language and meta-
phors of cognitive science, many of the phenomena of interest, such as communica-
tions, shared awareness and other determinates of decision superiority, are rendered
physically and observably manifest. That is to say, they no longer reside just in the
heads of individual actors; they become manifest in the way that information is repre-
sented, modified, communicated and shared. The purpose of this chapter is to deploy
the Event Analysis for Systemic Teamwork (EAST) method as a way of capturing
these phenomena, to show that there are ways to leverage the favourable theoretical
perspective of distributed cognition that are also appropriate and relevant to systems
designers.
EAST in Air Traffic Control 23
Underlying these activities are several key non-human artefacts. Like their human
counterparts, they contain, represent and modify information and are part of a sys-
tem that a distributed cognition perspective is able to model. Fields et al. (1998) pro-
vide a cogent summary of the key informational artefacts contained within the ATC
work domain. These are as listed below.
Radar Display
‘The radar screen provides controllers with a snapshot of the current horizontal [. . .]
locations of aircraft’ annotated with individual aircraft call signs and height (Fields
et al. 1998, p. 88).
24 Systems Thinking in Practice
Communications
These represent, in a practical sense, the ‘mediation of control’. Fields et al. (1998)
argue that communications can also be seen as a ‘system of representations’ (p. 4).
Of critical importance is that communications ‘are also situated in the network of
artefacts and information, and are [only] made comprehensible by reference to a
larger context of shared representations’ (p. 88).
Method Integration
The following formal methodologies combine to form EAST: hierarchical task
analysis (HTA) (Annett); coordination demand analysis; communications usage
diagram; social network analysis (SNA) (Driskell and Mullen 2005); propositional
networks; and an enhanced form of operation sequence diagram. A multiple method
approach has a number of compelling advantages. Not only does the integration
of existing methods bring reassurance in terms of a validation history, but it also
enables the same data to be analysed from multiple perspectives. Also, with over
200 existing methodologies to choose from (Stanton et al. 2005) there seemed little
pragmatic need to develop yet more. Of course, multiple interconnected methods
require greater effort to analyse, but a companion to EAST, called workload, error,
situation awareness, tasks and time, is designed to help. This is a software tool that
greatly streamlines and simplifies the application of the method and it was used in
the current analysis (Houghton et al. 2006).
EAST is structured as follows. The HTA provides input into the analysis of
teamworking (CDA), communications usage (CUD) and the linkage (via communica-
tions) between agents (SNA). Data for the HTA are gathered from live observation
of the scenario. The output of all these methods (HTA, CDA, CUD and SNA) is
given a summary visual form by using an enhanced Operation Sequence Diagram
(OSD). Interview data, in the form of the critical decision method (CDM) (Klein and
Armstrong 2005), are used to create a network of linked ‘information objects’ or
representational states. This representation is called a propositional network and is
rather similar in concept to semantic networks. It is important to note at this point that
the purpose of this chapter is not to introduce the methodological intricacies of the
EAST method (the reader is referred to Chapter 1 for further detail) but to show the
effect of method integration in terms of enabling a distributed cognition perspective
upon ATC.
• Scenario 1: To bring aircraft inbound from a major air route into a hold-
ing stack and then pass them onto an aerodrome controller (the holding
scenario)
26 Systems Thinking in Practice
• Scenario 2: To deal with aircraft that have left the holding stack and are
en route to airfield(s) but have yet to enter the final approach phase (the
approach scenario)
• Scenario 3: To deal with over-flying aircraft in such a way as to avoid
conflict with the holding stack and other en-route aircraft (the over-flight
scenario)
• Scenario 4: To deal with departing aircraft in such a way as to avoid conflict
with the holding stack (the departure scenario)
Task Networks
HTA is a means of describing a system in terms of a structured hierarchy of goals
and sub-goals with feedback loops (Annett 2005). Its appropriateness in this instance
EAST in Air Traffic Control 27
can be put down to two key points. First, it is inherently flexible, and the approach
can be used to describe any system. Second, it can be used for many ends, from per-
son specification and training requirements to error prediction, team performance
assessment and system design. Key to its present application is its ability to model
the temporal relations between tasks and the external conditions upon which task
activity is cued. The task network, specifically, is a way of representing the detailed
task analysis in terms of the interaction of higher-level goals. This technique allows
complex task analyses to be easily compared according to differences in overall task
structure and type. The task analysis/network forms the foundation for developing
insightful social and propositional networks.
Social Networks
SNA is particularly compatible with the distributed cognition perspective because
it ‘focuses on the relationships among actors embedded in their social context’
(Driskell and Mullen 2005, p. 58). Furthermore, it can represent the technologi-
cal mediation of communication and networks in which some of the nodes are
non-human. A social network is a way to represent individuals or teams who are
linked by communications to each other and to subject that network to mathematical
analysis using Graph Theory (Driskell and Mullen 2005). Two mathematical indices
are used in the present analysis, namely centrality (i.e. a numeric ranking allowing
key agents in the network to be identified) and density (the interconnectivity of the
network as a whole). The metrics reveal certain important characteristics of the net-
works to be revealed, in turn allowing comparisons between them.
28 Systems Thinking in Practice
Propositional Networks
Propositional networks offer a novel and effective means of visualising represen-
tational states as held/experienced by the individuals at work within the system.
The data used to construct them are based on the outputs of the CDM, in which
a content analysis of the interview transcripts permits representational states to
be extracted and causal links between them defined. Representational states take
the form of specific knowledge objects within these networks, which, in turn, are
analogous to propositions, that is, entity or phenomena about which an individual
requires information in order to act effectively. The propositional network offers
four perspectives.
These individual network-based outputs not only meet the need to go beyond
reductionism (and focus on interconnections as well as parts) but they can also be
linked to provide several different perspectives on the scenario.
FIGURE 2.2 Social network diagram illustrating agents in the air traffic control (ATC)
work domain linked by communication (emphasis denotes non-human agent).
of the network as a whole. Key agents can be defined as having high status and high
connectedness. The analysis indicates that the controller (as one might expect) has
high status and centrality in the network, but the metric also reveals that the most
significant agent is in fact non-human; the ATC technical system (which is the tech-
nical infrastructure and assemblage of ground aids, communications systems, radar
displays, etc.). A great deal of information is received, stored, displayed or otherwise
transformed by this (non-human) agent. This is a similar finding to that of Houghton
et al.’s (2006) analysis of police control rooms (in which the central logging com-
puter was also the most central agent).
In addition to the distribution between collaborating human and non-human
agents, cognition is also distributed in a geographical sense, between, for example,
aircraft in flight within the sector, controller(s) based at the control centre and con-
trollers based at airfield(s). Table 2.2 presents the number of times communication
links cross these geographical boundaries.
Geographical dispersion is further illustrated in geographical regions. The type of
communications media is physically constrained in cases where links between nodes
30 Systems Thinking in Practice
TABLE 2.1
Results of Social Network Centrality for
Individual Agents (in Descending Order)
Agent Centrality
ATC System 16.8
Controller 14.0
Heathrow Director 12.3
Desk Coordinator 12.3
Welin Controller 11.6
Adjacent Controller 11.3
Flight Strip Computer (Heathrow) 10.5
Senior Watch Assistant 10.2
FMS 1 10.0
FMS 2 10.0
FMS 3 10.0
FMS 4 10.0
Flight Strip Computer (West Drayton) 10.0
Group Supervisor 10.0
Deputy Watch Manager 10.0
Watch Manager 10.0
Flight Strip Assistant 9.5
Pilot 2 9.3
Pilot 3 9.3
Pilot 4 9.3
Pilot 1 9.1
cross from one shaded region to the other. For example, verbal communications are not
physically possible between controllers on the ground and pilots in flight without some
sort of facilitation by technical means (such as radio). There remain a host of other local
conditions that may also require some form of technological mediation. For example,
individual controllers have to remain at their workstations during their shift in order to
communicate with controllers who are not immediately adjacent, the telephone is used
and/or the agent acting in the role of desk coordinator may have to facilitate.
TABLE 2.2
Number of Communications Links That Exist
between Geographically Disperse Locations
Facilitating Technology
Figure 2.4 shows how ATC operations are facilitated by seven types of communica-
tion media.
Face-to-face communication comprises verbal communications. Face-to-face
communication also contains a visual component. Controllers will point and demon-
strate visually to aid in understanding instructions. Telephone and radio technology
facilitates voice communication. Radio also facilitates the dissemination of data,
as do data network facilities. Written communication is dominated by the flight
data-strip aspect of the task, although machine interfaces (e.g. the radar display)
also contain written information as well as visual representations. Table 2.3 provides
a summary by crossing communications modality with communications media to
provide a technology/modality matrix.
ATC is a highly evolved and proceduralised work domain, and the prominent role
of implicit communications is also noted. The CDM interview gives access to some of
these unobservable artefacts of interaction, one of which is a system of passing aircraft
between sectors that does not rely on explicit verbal exchanges. The system works by
putting aircraft into a particular position in the new sector at a pre-agreed height, speed
and heading. As soon as the controller sees an aircraft in this position, he/she knows it
is being passed onto them, and they can take control of it. A wider awareness is gained
via open channel radio communications and instructions to aircraft overheard from
other controllers. Several contextual factors, such as the high tempo of operations and
the proceduralised nature of the task, enable this level of shared understanding and
this form of communication to take place. From a distributed cognition perspective, it
can be seen how a comparatively lengthy verbal exchange is often replaced with a far
simpler visio-spatial task (facilitated by external technological artefacts such as the
radar display and flight data strips; Hutchins and Klausen 1996). These are captured
in the social networks. In other words, the presence of a link does not necessarily have
to connote just an overt form of communication but also implicit ones.
Control Architecture
Although Figures 2.2 through 2.4 are visually complex, it is possible to discern cer-
tain features of the social network. It can be noted that there is a diverging hierarchy
TABLE 2.3
Communications Modality/Technology Matrix
Technology
Modality Phone Radio Network Strips MMI In-Person
Verbal
Written
Data
Visual/Other
32 Systems Thinking in Practice
FIGURE 2.3 Geographical dispersion of human and non-human agents in the air traffic
control (ATC) work domain.
from the Watch Manager level downwards. This hierarchy splits into the Group
Supervisor level (and downwards towards individual controllers) and the Senior
Watch Assistant level (and downwards towards Flight Strip Assistants). According
to Dekker (2002), this so-called ‘split architecture’ ‘provides some of the benefits
of centralised planning with tactical adjustments to new information from subordi-
nate units’ (p. 5). At this level of ‘air traffic management’, the inherent complexity
appears to justify a degree of hierarchical sub-division so that aspects of complexity
can be spread across agents. The possible trade-off in situations where the state of
the world is changing rapidly (a fast tempo), and where decisions need to be enacted
quickly, is that any delay in the dissemination of information through a hierarchy
becomes critical (Dekker 2002).
At the tactical or ‘air traffic control’ level, in cases where one agent requires some
form of assistance, or to avoid the degradation of aircraft separation, the controller
can interact sideways through the structure to an adjacent controller so that issues can
be resolved and task load shared or re-distributed quickly. This pattern of communi-
cations is known as peer to peer or a negotiation architecture. In these instances, each
agent is more or less independently responsible for a defined area (Dekker 2002) and
is able to react promptly to rapid changes in the environment.
EAST in Air Traffic Control 33
FIGURE 2.4 Social network overlain with the media that facilitates communication.
FIGURE 2.5 Knowledge network representing the entire knowledge base for the air traffic
control (ATC) work domain. Knowledge that is active during task enactment represents situ-
ational awareness at the systems level.
TABLE 2.4
Summary of Key Knowledge Objects (KO) that are Active
During Different Phases of Air Traffic Control Process
Note: The table demonstrates changes in systems level state of situational awareness.
EAST in Air Traffic Control 35
task (which occurs at different points in time), not only does the type of information
change, but also, by implication, so does the structure of it. This information can be
used to explore and understand the information needs of controllers and, moreover,
how one might go about supporting them.
CONCLUSIONS
The purpose of this chapter has been to show how the EAST method puts ergonomic
analyses in touch with the distributed cognition perspective, rendering the output
much more tractable than comparable ethnographic techniques. Although this chap-
ter is necessarily couched at a summary level of analysis, the key characteristics
of the ATC work domain are identified in Table 2.5. Within the table is a checklist
TABLE 2.5
Key Characteristics of the Air Traffic Control Work Domain and the
Network Approach in which Detailed Systems Level Insights Reside
used to sign-post where the system designer will find detailed insights into the type,
nature and structure of these distributed cognition artefacts.
This chapter has focused on a systems level description of the ATC scenario and
serves to illustrate that this description can be achieved with the EAST method in live
settings. The strength of this descriptive level of analysis can be summarised as follows:
ACKNOWLEDGEMENTS
This work from the Human Factors Integration Defence Technology Centre (HFI
DTC) was part-funded by the Human Sciences Domain of the UK Ministry of
Defence Scientific Research Programme.
REFERENCES
Annett, J. (2005). Hierarchical task analysis. In: N. A. Stanton, A. Hedge, K. Brookhuis, E.
Salas and H. Hendrick (Eds.), Handbook of Human Factors and Ergonomics Methods
(pp. 33.1–33.7). CRC: London.
Bell, H. H. and Lyon, D. R. (2000). Using observer ratings to assess situation awareness. In:
M. R. Endsley (Ed.), Situation Awareness Analysis and Measurement (pp. 129–146).
Lawrence Erlbaum Associates: Mahwah, NJ.
Builder, C. H., Bankes, S. C. and Nordin, R. (1999). Command Concepts: A Theory Derived
from the Practice of Command and Control. Rand: Santa Monica, CA.
Chalmers, D. J. (1990). Thoughts on emergence. Available at: http://consc.net/notes/emer-
gence.html (Accessed April 2005).
EAST in Air Traffic Control 37
Perla, P. P., Markowitz, M., Nofi, A., Weuve, C., Loughran, J. and Stahl, M. (2000). Gaming
and shared situation awareness. Available at: http://www.thoughtlink.com/publication-
sGamingSSA00Abstract.htm/[Accessed April 2005].
Perry, M. (2003). Distributed cognition. In: J. M. Carroll (Ed.), HCI Models, Theories and
Frameworks (pp. 93–224). Morgan-Kaufmann: San Francisco, CA.
Rogers, Y. (1997). A Brief Introduction to Distributed Cognition. Interact Lab, University of
Sussex: Brighton, UK.
Rogers, Y. and Ellis, J. (1994). Distributed cognition: An alternative framework for analys-
ing and explaining collaborative working. Journal of Information Technology, 9 (2),
119–128.
Salas, E., Prince, C. and Baker, D. P. (1995). Situation awareness in team performance –
implications for measurement and training. Human Factors, 37, 123–136.
Salmon, P. M., Stanton, N. A., Walker, G. H. and Jenkins, D. P. et al. (2008). What really is
going on? Review of situation awareness models for individuals and teams. Theoretical
Issues in Ergonomics Science, 9 (4), 297–323.
Sandom, C. (2001). Situation awareness. In: J. Noyes and M. Bransby (Eds.), People in
Control: Human Factors in Control Room Design (pp. 51–68). Institution of Electrical
Engineers: London, UK.
Stanton, N. A., Salmon, P., Walker, G. H., Baber, C. and Jenkins, D. (2005). Human Factors
Methods: A Practical Guide for Engineering and Design. Ashgate: Aldershot.
Walker, G. H., Stanton, N. A., Gibson, H., Baber, C., Young, M. and Green, D. (2006).
Analysing the role of communications technology in C4i scenarios: A distributed
cognition approach. Journal of Intelligent Systems Special Issue: Information and
Communication Technology, 15 (1–4), 299–328.
3 EAST in Military
Command and Control
With Rebecca Stewart, Daniel P. Jenkins,
Linda Wells and Chris Baber
INTRODUCTION
Event Analysis for Systemic Teamwork (EAST) is a macroergonomic method for
extracting large-scale systems level data on the emergent properties of command
and control scenarios (e.g. Kleiner 2006). The method is based on a number of
observations: firstly, ‘effective team performance is not an automatic occurrence’
(Salas et al. 1995, p. 55); secondly, increased complexity in military operations gives
them the appearance of ‘different components and layers of subsystems with mul-
tiple non-linear interconnections that are difficult to recognise, manage and predict’
(Marashi and Davis 2005; Johnson 2005, p. 1); and thirdly, the interaction of compo-
nents and subsystems (teamworking + complexity) creates non-linear emergent prop-
erties at the level of the entire system. In other words, sociotechnical systems like
this can be more (or indeed, much less) than the sum of their ‘socio’ and ‘technical’
parts. The challenge is to find ways to exploit complexity and non-linearity in order
to ‘obtain a disproportionate leverage from a given action’ (Smith 2006, p. 40). Thus,
focusing on the interrelations between command and control’s component parts is
perhaps as important as the parts in isolation. So, by shifting the unit of analysis
from ‘technical’ to ‘human’ and shifting it again from ‘individuals’ to that of the
‘system’, and by deploying network-based methodologies as a form of non-linear
modelling, the data that EAST provides ultimately speak to this goal.
Area Evaluation (BAE), which deals with the potential effects of the physical envi-
ronment on military operations; and Threat Evaluation, which involves assessing
the enemy’s capabilities and tactics. Question 2 is concerned with Mission Analysis
and the scrutiny of orders that have been received. Questions 4 to 7, in equally
broad terms, can be subsumed under the heading ‘Course of Action Development’.
Figure 3.1 shows how the seven phases of the Combat Estimate relate to each other
functionally and temporally. The diagram is a ‘task network’ based on the high-level
goals of a comprehensive Hierarchical Task Analysis (HTA) of the scenario. The
links between goals are specified by the HTA’s top level ‘Goal 0’.
Data Collection
Data for the EAST analysis were gathered by live observation of Command and Staff
Training (CAST) exercises at the British Army’s Land Warfare Centre in Warminster.
FIGURE 3.1 Task network for the observed military command and control scenario.
EAST in Military Command and Control 41
The exercises took place in a battlegroup command post set up on-site as it would be
deployed in the field. The command post was set to work within a scenario which, in
broad terms, required effects to be delivered to a large-scale enemy force passing in
one direction through the battlegroup’s area of operations. Enemy and friendly units
were simulated by a team of remotely located operators who provided a form of aug-
mented reality, supplying friendly radio traffic (simulating units that would ordinar-
ily be located in the field) and updating digital data pertaining to enemy movements,
reactions and counter-actions. A team of analysts and subject matter experts moni-
tored and transcribed video and audio feeds from the battlegroup headquarters. Key
personnel active in the scenario were further interviewed at key points in the scenario
using the Critical Decision Method (Klein and Armstrong 2005).
acknowledge that complex sociotechnical systems require more than one approach
(EAST is comprised of seven individual methodologies, CWA is comprised of five
‘phases’), and both acknowledge that these perspectives are as interlinked as the
complex sociotechnical phenomenon under analysis (i.e. they are both systemic in
nature). This is a core principle of sociotechnical design (Clegg 2000).
Method Integration
The following formal methodologies combine to form EAST: Hierarchical Task
Analysis (HTA) (Annett 2005), Coordination Demand Analysis (CDA) Burke 2005),
Communications Usage Diagram (CUD) Watts and Monk 2000), Social Network
Analysis (SNA) Driskall and Mullen 2005), Propositional Networks (PN) (e.g. Ogden
1987) and an enhanced form of Operation Sequence Diagram (OSD) (Kirwan and
Ainsworth 1992). A multiple method approach has a number of compelling advan-
tages. Not only does the integration of existing methods bring reassurance in terms
of a validation history but it also enables the same data to be analysed from multiple
perspectives. With over 200 existing methodologies to choose from (Stanton et al.
2005a) there seemed little pragmatic need to develop yet more, hence the approach
adopted, which was to integrate existing methods. The trade off, of course, is time.
Multiple interconnected methods require greater effort to analyse, but in some sense,
this is an artefact of the problem domain being analysed. Good news in this respect
comes in the form of a companion to EAST called WESTT. This is a software tool
that greatly streamlines and simplifies the application of the method and was used in
the current analysis (Houghton et al. 2007).
The HTA provides input into the analysis of teamworking (CDA), communica-
tions usage (CUD) and the linkage (via communications) between agents (SNA).
Data for the HTA are gathered from live observation and activity sampling as
mentioned above. The output of all these methods (HTA, CDA, CUD and SNA) is
given a summary visual form by using an enhanced Operation Sequence Diagram
(OSD). Interview data, in the form of the Critical Decision Method (CDM: Klein
and Armstrong 2005), are used to create the final part of EAST, a network of linked
‘information objects’ (or Propositional Networks; PN). This is a systemic, network-
based approach to the concept of Situation Awareness (SA). The debates surrounding
the concept of SA require more in-depth discussion in relation to EAST.
Situational Awareness
One of the key emergent properties from command and control scenarios, and one
of the major determinants of decision superiority, is the concept of situation aware-
ness (SA) Endsley 1995; Stanton et al. 2009; Salmon et al. 2008a). At an individual
level, SA is about simply ‘knowing what is going on’ (Endsley 1995). At a systems
level, SA enables decisions to be made in real time, and for sociotechnical systems
like military command planning to be orientated towards and ‘tightly coupled to
the dynamics of the environment’ (Moray 2004, p. 4). A distributed cognition per-
spective applied to command and control scenarios requires a shift from traditional
notions of SA that focus on the individual (e.g. Smith and Hancock 1995; Adams
EAST in Military Command and Control 43
et al. 1995; Bedny and Meister 1999; Endsley 1995). Whilst these approaches may
be appropriate for tasks that are performed by individuals in isolation, few complex
command and control tasks are performed entirely independently of others. The idea
of co-dependence in SA, of course, finds expression in several approaches to ‘team
SA’ (e.g. Perla et al. 2000; Salas et al. 1995). Broadly speaking, these approaches to
SA tacitly assume that the ‘situation’ can be defined as a single, objective, external
reality, and that the goal of the people operating within the situation is to respond to
all features appropriately. These approaches are problematic on three counts: first,
there are many aspects of command and control scenarios that require the individual
to make judgements and interpretations (so the assumption of the ‘objective reality’
of a situation is not always valid); second, there are multiple sub-goals and, there-
fore, multiple views of the situation (so the idea of a single reality is also not always
valid either); and third, as mentioned above, different agents within the system use
different pieces of information to inform and support their work, so the notion that
there can be a single view of the situation (as opposed to several overlapping views)
is not easily supported. Distributed cognition provides a way of coping with these
conceptual issues and of providing a systems level view of SA (Stanton et al. 2009).
This view rests on three key factors.
The concept of SA, therefore, looks rather different when considered from a
‘distributed’ as opposed to an individual perspective. It is still about the dynamic
orientation of a system to its operational context, but the units of analysis centre
around information as opposed to individuals (and the psychological processes by
which the state of SA is achieved). Information is held, exchanged, represented and
44 Systems Thinking in Practice
Theoretical Basis
The combination of observation and interview, analysis and representational meth-
ods forms EAST. A more detailed description of how the specific method outputs are
derived is provided in the next section (as well as in Walker et al. 2006a). A summary
of EAST, and how its component methods relate to each other functionally, is shown
below in Figure 3.2.
EAST is a human-centred approach but one whose component methods are all
anchored to a common systems perspective. This is manifest in a number of under-
pinning ideas, principal among which is distributed cognition. Under this per-
spective, the ‘computations’ that comprise military command and control are not
the exclusive province of individuals (Rogers 1997; Hollan et al. 2000; Hutchins
1995); instead, they are distributed across the entire command and control system,
comprised of numerous individuals, teams and technical artefacts. The essence
of distributed cognition is on ‘how [these computations] transcend the boundaries
of the individual actor’, and to this end, the common language of representational
states is used. Representational states are visible and external manifestations of
various ‘environmental contributions’ to the total system (Fields et al. 1998; Rogers
and Ellis 1994). They subsume the full range of observable interactions between
people and artefacts, as well as the resulting states (and state changes) that arise.
In essence, the focus of the EAST method is on describing artefacts that relate to
FINDINGS
Coordination Demand Analysis (CDA)
According to Salas, Bowers and Cannon-Bowers (1995), ‘the military is growing
increasingly dependent on the ability of individuals to coalesce quickly into effective
EAST in Military Command and Control 45
teams’ (p. 55). Therefore, it might be assumed that command and control scenarios
will be dominated by teamwork activities, but this supposition can be checked in
more detail. The Coordination Demand Analysis (CDA) procedure allows for the
identification of teamwork skills needed for smooth coordination among team mem-
bers. Individual tasks from the HTA were categorised into task or teamwork tracks
(e.g. Salas et al. 1995; Morgan et al. 1986). The teamwork tasks were then scored
against the CDA taxonomy of communication, situational awareness, decision mak-
ing, mission analysis, leadership, adaptability and assertiveness (Burke 2005). Each
CDA taxonomy item was scored from 1 to 3, where 1 is low coordination and 3 is
high coordination. From these individual scores, a ‘total coordination’ figure can be
derived, which is based on the mean of the component scores. In this scenario, the
scoring was derived from a focus group comprised of the analyst team and subject
matter experts. Each item was briefly discussed and its final score based on consen-
sus among the group. Overall, the mean total coordination score for the military
scenario is 1.2 (out of a maximum score of three). This score is broadly comparable
to civilian command and control domains like air traffic control (e.g. Walker et al.
2006a), railway signalling and safety operations (e.g. Walker et al. 2006b) and bulk
energy distribution (e.g. Salmon et al. 2008b). The mean coordination score was also
46 Systems Thinking in Practice
calculated for the seven main stages of the HTA (these represent the phases in the
military scenario), and the results are shown in Table 3.1.
The supposition that command and control activities have a prominent teamworking
component is well justified, as would be expected, yet different phases of the planning
process require different types and amounts of teamwork; the CDA provides a window
onto this. The scores for the individual coordination dimensions vary across the full
range of permissible values. It can be noted that communications and SA score consis-
tently highly, whereas decision making scores relatively low. This and other facets of
the teamworking profile could arise because the decision-making components of the
scenario are constrained by hierarchical patterns of interaction, pre-specified forms of
interaction and/or unitary decision rights (NATO 2006). This pattern differs from the
civilian examples mentioned above where the EAST method has been applied. Here,
the decision-making and planning phases tend to occur concurrently and continuously
(as opposed to a relatively discrete stage), and decision making scores more highly.
Mean SA 2 2 2.2 2 2
Mean DM 1.5 1.8 1 2
Mean MA 1 2 2.1 1 1
Mean Leadership 1.25 1.3 1.6 2 3
Mean Adaptability 2 2 3 2
Mean Assertiveness 1.8 1 2
Total Coordination 1.7 1.8 2.0 0 1.7 2.1
47
48 Systems Thinking in Practice
medium and a recommended technology, if there is one. The CUD method, there-
fore, is a structured way to represent communications within a scenario based on
task flow (and thus the HTA). For the purposes of this chapter, the method output has
been synthesised into a list of advantages and disadvantages (Table 3.2) followed by
a critique of communications usage.
Verbal Communications
A compelling advantage of verbal communications is the level of immediacy and
redundancy it provides. Carvalho (2006) states that, ‘operators use verbal exchanges
to produce continuous, redundant and recursive interactions to successfully construct
and maintain individual and mutual awareness’ (p. 51). There remains, however, the
possibility of psychological issues such as ‘group-think’ and bias in using this form
of communication in this context, although there are techniques available to help
overcome this (Janis 1982a, 1982b). It can be noted that verbal communications also
dominate in civilian command and control scenarios.
(Driskell and Mullen 2005). Social networks focus ‘on the relationships among
actors embedded in their social context’ (Driskell and Mullen 2005, p. 58). NEC
concepts embody a form of information commodification; thus, social networks can
be used to represent the technological mediation of communication and networks
where some of the nodes are non-human. The resulting network can then be subject
to mathematical analysis using Graph Theory in order to simplify it and express
its key features in a standardised form using a numeric index (Driskell and Mullen
2005). Two mathematical indices are used, namely centrality (i.e. a numeric ranking
allowing key agents in the network to be identified) and density (the interconnectiv-
ity of the network as a whole). Both of these metrics can be understood in relation
to other contextual factors to enable judgements to be made about what aspects of
the network configuration constrain or enhance performance. The metrics, being
emergent properties of the networks as well as a means to simplify them, permit easy
comparison between alternate domains.
The social network for military command and control defines seven key actors,
some of which have been grouped into sub-systems for simplicity (as illustrated
in Figure 3.3). The actors or nodes include the Higher Command Formation, the
Commander and Chief of Staff (COS) at the command headquarters, the ‘Principal’
Planning Staff (which subsumes individual roles such as G2 Intelligence and
EngGeo), other command staff (responsible for more general tasks and information
FIGURE 3.3 Social network for military command and control scenario (icons represent
the communications media that facilitates the linkage).
52 Systems Thinking in Practice
management), personnel in the field and the collection of graphics and planning
aids derived from the Combat Estimate process (an informational node that is
non-human).
Activity Stereotypes
The social network is dynamic and adaptive, with different nodes and links becom-
ing active under different activity stereotypes (revealed by detailed analysis of the
HTA). The activity stereotypes are as follows:
FIGURE 3.4 Social networks illustrating the characteristics of a number of network arche-
types detected in the analysis (to be read in conjunction with Figure 3.3).
EAST in Military Command and Control 53
TABLE 3.3
Technology/Facilitation/Modality Matrix
Technology/Facilitation
Modality Radio Planning Aids In-Person Voice
Verbal
Visual
Written
TABLE 3.4
Network Metrics Illustrating Centrality (Key
Agents in the Scenario) and Density (Network
Connectivity) for the Social Network as a Whole
Agent Agent Centrality Network Density
Higher Formation 0.89 0.31
Commander 1.11
COS 1.11
Other Command Staff 0.67
Principal Staff 1.33
Field Personnel 0.22
Planning Materials 0.67
differently in NEC paradigms. These links define the structure of the network and
also its function.
Table 3.5 presents the results of this analysis, showing how the properties of
the network change to reflect the stereotypical ways in which it is configured. The
change in network density for each activity stereotype is also indicative of a high
degree of reconfigurability. This appears to be a relatively unique feature of mili-
tary command and control. In civilian examples, the network density figures do not
change as dramatically as the task progresses through its distinct phases. The reason
is due to the complexity inherent in the operational context. Both civilian examples
operate within a relatively stable and placid environment in contrast to the turbulent
and complex military one.
Orders
Commander 0.33 0.67 0.33
COS 0.11 0.67 0.33
Other Command Staff 0.11 0.33 0.33
Principal Staff 0.11 0.67 0.33
Field Personnel
Planning Materials 0.33 0.67
55
56 Systems Thinking in Practice
FIGURE 3.5 Sections through complete OSD chart for military scenario showing (left to
right) semi-autonomous working, briefing and reviewing.
vertical flow of information, with the Commander producing it and other agents
receiving it. In the second phase (more Reviewing activities), the operations (and
agents) become closely interconnected, with decision-making components dominat-
ing (shown by the diamond symbol[s]). In the third and final phase (more Semi-
Autonomous working), the pattern of operations once again assumes a vertical/
hierarchical disposition. At the highest level, then, the command and control process
seems to assume a pattern of information retrieval, closely knit decision-making pro-
cesses and then dispersion and action.
method. From the PN, it is possible to identify the structure and temporal nature of
distributed SA (explained in full in Stanton et al. 2009) and the information under-
pinning decision making.
The summary table (Table 3.6) uses simple Graph Theory metrics (as used in
the social networks above) to summarise the visually complex network(s) into a
more tractable form. Based on an analysis of centrality, so-called ‘core informa-
tion objects’ can be defined for each phase in the scenario (a CDM interview was
carried out in relation to each phase, as was a separate PN). The table crosses each
phase of the Combat Estimate planning technique with the list of core information
objects. Shading denotes specifically what information objects are active in what
phase. These core information objects also feed back up to the CUD method ear-
lier. Their prescription enables an analysis of what information objects are shared
between what agents, and, therefore, require some form of communications technol-
ogy to mediate the sharing. In the CUD method, the appropriateness of this match
forms one aspect of the basis by which communications technology is, and can be,
critiqued (see Walker et al. 2006a for an in-depth treatment of how this specific
approach can be realised).
Eighteen key information objects can be identified. As the Combat Estimate plan-
ning process progresses through its distinct phases, it can clearly be seen that the
activation of these key objects changes. This is further indicative of changes in the
type and structure of the propositional network and in the type of situational aware-
ness possessed by individuals and the system as whole. This information can be
58 Systems Thinking in Practice
TABLE 3.6
Summary of Key Information Objects Active within Each Scenario
Note: Shading indicates what information is specifically active during what stage of the com-
bat estimate.
used to assess the extent to which the system is orientated towards the dynamics of
its situation as well as to identify information requirements for different tasks and
scenarios.
CONCLUSIONS
The principles of Human Factors Integration (HFI) encompass ‘a balanced develop-
ment of both the technical and human aspects of equipment provision. It provides a
process that ensures the application of scientific knowledge about human character-
istics through the specification, design and evaluation of systems’ (MoD 2000, p. 6).
The EAST method is couched firmly within this context. It is, at bottom, a way of
capturing and describing the human view of complex sociotechnical systems – not
what should or might happen when they are set to work but what actually does hap-
pen. Being based on the integration of seven existing ergonomics methodologies, the
outputs are structured, systematic and standardised. The validation history that is
EAST in Military Command and Control 59
associated with each of them brings the promise of repeatability and compatibility
across situations and even domains.
The aim of the present analysis has been to demonstrate the applicability of the
method within military contexts, which represent a particularly challenging and
complex command and control environment. The analysis has been couched at a
fairly coarse-grained level of analysis, anchored as it has been to the discrete phases
of the Combat Estimate planning process. As much (or as little) resolution can be
extracted depending on the questions being asked and analysis effort that actors are
willing to expend. For the purposes of presenting EAST’s human view of military
command and control, and how those insights map across to other domains, the pres-
ent level of analysis seems appropriate.
What does this application of the EAST method tell us? It tells us about the struc-
tural and temporal nature of the goals and tasks that have to be performed and how
they are interlinked and interdependent. The structure of the task network (like any
system) defines its function. In the case of the military, it is noted not just that there
is a defined ‘planning phase’ but also that it is relatively sequential and recursive
in nature. In the civilian domains that have been observed previously, planning, at
least at strategic and operational levels, tends to occur concurrently with the task –
‘on the fly’, so to speak. That said, in civilian domains, the sociotechnical system’s
combined experience (of which it is an evolutionary expression) and its generally
placid environment enables rule-based optimum means to ends to be learnt and rapid
decision making to take place.
It can be noted that the function of the social networks also changes; they are
reconfigurable (and readily reconfigured) to suit the task phase, often in ways that
are not anticipated beforehand. This is, therefore, an emergent property of the inter-
action between the task and social networks. The links in the social network are
informational, and the content of this information is represented by the PN, a rep-
resentation that captures systems level information and, we argue, SA. SA is once
again an emergent property of both the task and social networks. In particular, the
way in which the social network is configured dictates the informational constraints
placed on it by the facilitating communications technology. Overall, it is clear that
cognition is distributed between socio and technical agents in the scenario. This,
combined with the fact that the socio elements (the people) will adapt the technical
elements to suit their needs and preferences, contributes to a degree of self-organisa-
tion and emergence that is apparent through analysis with EAST.
EAST’s three main network representations, illustrated in Figure 3.7, are an
analytical response to complexity and emergence but from a uniquely human per-
spective. A key point is that EAST acknowledges the sociotechnical principle of
equifinality: that the same people and the same technology may reach the same
goal by entirely different means and from entirely different initial conditions. This
is not a conceptual inconvenience but actually one of the very promises of NEC.
The inviolable fact that humans will adapt to the techno-organisational properties
of a given system is what permits desirable emergent properties to ‘emerge’, like
systems level ‘shared awareness’, tempo, agility and self-synchronisation. EAST
seems to offer a way to capture and describe this in a way that deterministic (i.e.
linear) methods may not.
60 Systems Thinking in Practice
FIGURE 3.7 Summary of EAST’s three network-based perspectives and the insights into
emergent properties that they provide.
Driven off the higher-level network representations are a number of more explicit
methods that relate more directly to requirements capture. In the CUD, for example,
task and social networks combine to inform a structured assessment of communica-
tions technology. This analysis is further informed by the notions of distributed SA
that are embodied in EAST. In other words, it becomes possible to assess what pur-
pose a communication exchange is designed to serve, what information it is designed
to convey and, moreover, what would be the best means of facilitating that exchange.
In addition to this, the CDA method highlights certain important aspects of team-
working at different phases of the planning process. This sort of information is useful
in the design of digital command planning systems. For example, there would be lit-
tle point in providing ‘decision support’ for a planning phase that is actually revealed
as requiring more ‘mission analysis’. The benefits of the interlinked EAST method
are that changes in any of the three underlying network representations (task, social
and propositional networks) are reflected in each other and in the supporting methods
like CUD and CDA. The disadvantage of the EAST method, at least at face value, is
the amount of time it takes to perform such an analysis. The reader is referred to a
companion software tool called WESTT that greatly simplifies and streamlines the
application of EAST, automating many functions, notably the production of the vari-
ous task, social and knowledge networks (Houghton et al. 2007).
In conclusion, EAST is offered as a means to describe the dynamic, emergent
behaviour of complex sociotechnical systems from a human perspective. It appears
consistent with wider trends in Ergonomics towards method integration and systems
views, and it is eminently compatible with similar approaches like CWA. The aim of
the present high-level analysis has been to illuminate some of these wider issues and
EAST in Military Command and Control 61
ACKNOWLEDGEMENTS
This work from the Human Factors Integration Defence Technology Centre (HFI
DTC) was part-funded by the Human Sciences Domain of the UK Ministry of
Defence Scientific Research Programme.
The assistance of LtCol Allan Ellis is gratefully acknowledged as is the assis-
tance of the staff at the Land Warfare Centre and CAST in Warminster, in particular
Majors Forster and Sharkey.
Information on the Combat Estimate draws heavily on material used during the
experimental team’s observation of the Combat Estimate training noted above. In
particular, two presentations, the first entitled ‘Command and Staff Trainer (South) 1
WFR MiniCAST 2/3 Aug 05’ and the second ‘Wargaming: Mastering Your Enemy’
(based on the Army Field Manual Vol I (Combined Arms Operations) Part 2 (July
98) and 3(UK) Div Wargaming Aide Memoire), are used with permission.
REFERENCES
Adams, M. J., Tenney, Y. J. and Pew, R. W. (1995). Situation awareness and the cognitive
management of complex systems. Human Factors, 37, 85–104.
Annett, J. (2005). Hierarchical task analysis. In: N. A. Stanton, A. Hedge, K. Brookhuis, E.
Salas and H. Hendrick (Eds.), Handbook of Human Factors and Ergonomics Methods
(pp. 33.1–33.7). CRC: London, UK.
Bar Yam, Y. (1997). Dynamics of Complex Systems. Perseus: Jackson, TN.
Bedny, G. and Meister, D. (1999). Theory of activity and situation awareness. International
Journal of Cognitive Ergonomics, 3 (1), 63–72.
Bell, H. H. and Lyon, D. R. (2000). Using observer ratings to assess situation awareness.
In: M. R. Endsley (Ed.), Situation Awareness Analysis and Measurement 129–146).
Lawrence Erlbaum Associates: Mahwah, NJ.
Builder, C. H., Bankes, S. C. and Nordin, R. (1999). Command Concepts: A Theory Derived
from the Practice of Command and Control. Rand: Santa Monica, CA.
Burke, S. C. (2005). Team task analysis. In: N. A. Stanton A. Hedge, K. Brookhuis, E. Salas
and H. Hendrick (Eds.), Handbook of Human Factors and Ergonomics Methods (pp.
56.1–56.8). CRC: London, UK.
Carvalho, P. V. R. d. (2006). Ergonomic field studies in a nuclear power plant control room.
Progress in Nuclear Energy, 48, 51–69.
Clegg, C. W. (2000). Sociotechnical principles for system design. Applied Ergonomics, 31,
463–477.
DoD (1999). Realizing the Potential of C4I: Fundamental Challenges. National Academy
Press: Washington, DC.
Driskell, J. E. and Mullen, B. (2005). Social network analysis. In: N. A. Stanton, A. Hedge,
K. Brookhuis, E. Salas and H. Hendrick (Eds.), Handbook of Human Factors and
Ergonomics Methods (pp. 58.1–58.6). CRC: London, UK.
Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human
Factors, 37 (1), 32–64.
62 Systems Thinking in Practice
Fields, R., Wright, P., Marti, P. and Palmonari, M. (1998). Air traffic control as a distrib-
uted cognitive system: A case study of external representations. In: T. R. G. Green,
L. Bannon, C. P. Warren and J. Buckley (Eds.), ECCE9: Proceedings of the Ninth
European Conference on Cognitive Ergonomics (pp. 85–90). EACE: Limerick, Ireland.
Harris, C. J. and White, I. (1987). Advances in Command, Control & Communication
Systems. Peregrinus: London, UK.
Hollan, J., Hutchins, E. and Kirsh, D. (2000). Distributed cognition: Toward a new foundation
for human–computer interaction research. ACM Transactions on Human Computer
Interaction, 7, 174–196.
Hollnagel, E. (1993). Human Reliability Analysis: Context and Control. Academic Press:
London, UK.
Houghton, R. J., Baber, C., Cowton, M., Walker, G. H and Stanton, N. (2007). WESTT
(Workload, error, situational awareness, time and teamwork): An analytical prototyp-
ing system for command and control. Cognition Technology and Work, 10 (3), 199–207.
Hutchins, E. (1995). Cognition in the Wild. MIT Press: Cambridge, MA.
Janis, I. L. (1982a). Groupthink. Houghton Mifflin: Boston, MA.
Janis, I. L. (1982b). Counteracting the adverse effects of concurrence-seeking in policy plan-
ning groups: Theory and research perspectives. In: H. Brandstatter, J. H. Davis and G.
Stocker-Kreichgauer (Eds.), Group Decision Making. Academic Press: London, UK.
Jones, C. (1993). Toward a Science of Command, Control, and Communications. American
Institute of Aeronautics and Astronautics: Washington, D.C.
Johnson, C. W. (2005). What Are Emergent Properties and How Do They Affect the
Engineering of Complex Systems? University of Glasgow, Department of Computing
Science: Glasgow, UK.
Kirwan, B. and Ainsworth, L. K. (1992). A Guide to Task Analysis. Taylor and Francis:
London, UK.
Klein, G. and Armstrong, A. A. (2005). Critical decision method. In: N. A. Stanton, A.
Hedge, K. Brookhuis, E. Salas and H. Hendrick (Eds.), Handbook of Human Factors
and Ergonomics Methods (pp. 35.1–35.8). CRC: London, UK.
Kleiner, B. M. (2006). Macroergonomics: Analysis and design of work systems. Applied
Ergonomics, 37, 81–89.
Marashi, E. and Davis, J. P. (2005). A systems approach to resolving complex issues in a
design process. Workshop on Complexity in Design and Engineering, 10–12 March,
Glasgow, Scotland, pp. 140–149.
MoD (2000). Human Factors Integration: An Introductory Guide. HMSO: London, UK.
MoD (2005a). Network Enabled Capability (JSP 777). HM Stationery Office: London, UK.
MoD (2005b). The BG PSO Combat Estimate. MoD: Warminster, UK.
Moray, N. (2004). Où sont les neiges d’antan? In: D. A. Vincenzi, M. Mouloua, and P. A.
Hancock (Eds.), Human Performance, Situation Awareness and Automation: Current
Research and Trends. Lawrence Erlbaum Associates: Mahwah, NJ.
Morgan, G. (1986). Images of Organisation. Sage: London, UK.
NATO (2006). SAS-050 conceptual model version 1.0. Available at: https://pdfs.semantic-
scholar.org/0937/20a588962d1a80a31360e869515b3f76de02.pdf.
Ogden, G. C. (1987). Concept, knowledge and thought. Annual Review of Psychology, 38,
203–227.
Perla, P., Markowitz, M., Nofi, A., Weuve, C., Loughran, J. and Stahl, M. (2000). Gaming and
shared situation awareness. Available at: http://www.thoughtlink.com/publications/
GamingSSA00Abstract.html.
Rasmussen, J., Petjerson, A. M. and Goodstein, L. P. (1994). Cognitive Systems Engineering.
Wiley: New York, NY.
Rogers, Y. (1997). A Brief Introduction to Distributed Cognition. Interact Lab, University of
Sussex: Brighton, UK.
EAST in Military Command and Control 63
Rogers, Y. and Ellis, J. (1994). Distributed cognition: An alternative framework for analys-
ing and explaining collaborative working. Journal of Information Technology, 9 (2),
119–128.
Salas, E., Bowers, C. A. and Cannon-Bowers, J. A. (1995). Military team research: Ten years
of progress. Military Psychology, 7, 55–75.
Salmon, P. M., Stanton, N. A., Walker, G. H., Baber, C., Jenkins, D. P., McMaster, R. and
Young, M. S. (2008a). What really is going on? Review of situation awareness models
for individuals and teams. Theoretical Issues in Ergonomics Science, 9 (4), 297–323.
Salmon, P. M., Stanton, N. A., Walker, G. H., Jenkins, D. P., Baber, C. and McMaster, R. M.
(2008b). Representing situation awareness in collaborative systems: A case study in the
energy distribution domain. Ergonomics, 51 (3), 367–384.
Smith, E. A. (2006). Complexity, Networking, & Effects-Based Approaches to Operations.
CCRP Publication Series.
Smith, K. and Hancock, P. A. (1995). Situation awareness is adaptive, externally directed
consciousness. Human Factors, 37 (1), 137–148.
Stanton, N. A., Salmon, P., Walker, G. H., Baber, C. and Jenkins, D. (2005a). Human Factors
Methods: A Practical Guide for Engineering and Design. Ashgate: Aldershot, UK.
Stanton, N. A., Hedge, A., Brookhuis, K., Salas, E. and Hendrick, H. (2005b). Handbook of
Human Factors and Ergonomics Methods. CRC: Boca Raton, FL.
Stanton, N. A., Salmon, P. M., Walker, G. H. and Jenkins, D. P. (2009). Genotype and
phenotype schemata and their role in distributed situation awareness in collabora-
tive systems. Theoretical Issues in Ergonomics Science, 10 (1), 43–68.
Vicente, K. J. (1999). Cognitive Work Analysis: Toward Safe, Productive, and Healthy
Computer-Based Work. Lawrence Erlbaum Associates: Mahwah, NJ.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. M. and Green, D. (2006a).
Event analysis of systemic teamwork (EAST): A novel integration of ergonomics meth-
ods to analyse C4i activity. Ergonomics, 49, 1345–1369.
Walker, G. H., Stanton, N. A., Gibson, H., Baber, C., Young, M. and Green, D. (2006b).
Analysing the role of communications technology in C4i scenarios: A distributed
cognition approach. Journal of Intelligent Systems. Special Issue: Information and
Communication Technology, 15 (1–4), 299–328.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Gibson, H., Salmon, P. M. and Jenkins,
D. P. (2010). From ethnography to the EAST method: A tractable approach for rep-
resenting distributed cognition in air traffic control. Ergonomics: Special Issue on
Aviation Safety, 53 (4), 184–197.
Watts, L. A. and Monk, A. F. (2000). Reasoning about tasks, activities and technology to
support collaboration. In: J. Annett and N. Stanton (Eds.), Task Analysis (pp. 55–78).
Taylor and Francis: London, UK.
Wilson, J. R. and Corlett, E. N. (Eds.) (1995). Evaluation of Human Work: Practical
Ergonomics Methodology. Taylor and Francis: London, UK.
4 EAST in Energy
Distribution Operations
With Daniel P. Jenkins, Chris Baber
and Richard McMaster
INTRODUCTION
The Event Analysis of Systemic Teamwork (EAST) analysis presented in this
chapter focuses on command and control activities in the energy distribution
domain. Command and control scenarios are characterised by multiple individu-
als and teams working together in pursuit of a common goal (comprising mul-
tiple interacting sub-goals). High levels of communication and coordination are
required, and the onus is often placed on technologies to facilitate this. Various
sub-constructs are also evident within command and control, including planning,
directing, coordinating and control of resources, situation awareness and so on.
When examining command and control, the descriptive constructs of interest can
be distilled down to simply
More than likely, none of the Human Factors methods described in this book
can independently cover all of these constructs. Using an integrated suite of meth-
ods, however, allows scenarios to be analysed exhaustively from the perspectives
described, but more importantly, it allows the effects of constructs on other con-
structs to be considered, for example, how communications influence the way in
which tasks are performed and in turn how the way in which the tasks are being
performed influences the knowledge/decisions/processes being used. There are also
further advantages associated with methods integration, because not only does the
integration of existing methods bring reassurance in terms of a validation history, but
it also enables the same data to be analysed from multiple perspectives. These mul-
tiple perspectives, as well as being inherent in the scenario that is being described
65
66 Systems Thinking in Practice
and measured, also provide a form of internal validity. Assuming that the separate
methods integrate on a theoretical level, then their application to the same data set
offers a form of ‘analysis triangulation’.
EAST (Stanton et al. 2005) provides one such framework of methods that allows
collaborative performance to be comprehensively described and evaluated. Since its
conception, the framework has been applied in many domains, including land and
naval warfare (Stanton et al. 2006), aviation (Stewart et al. 2008), air traffic control
(Walker et al. 2010), railway maintenance (Walker et al. 2006) and the emergency
services (Houghton et al. 2006). EAST is underpinned by the notion that complex
collaborative systems can be meaningfully understood through a network of net-
works approach (see Figure 4.1). Specifically, three networks are considered: task,
social and knowledge networks. Task networks describe the goals and subsequent
tasks being performed within the system. Social networks analyse the organisation
of the system (i.e. communications structure) and the communications taking place
between the actors working in the team. Finally, knowledge networks describe the
information and knowledge (distributed situation awareness) that the different actors
use and share during task performance.
The process begins with the conduct of an observational study (Chapter 2) of the
scenario under analysis. Hierarchical Task Analysis (HTA) (Chapter 3) is then used
to describe the goals, sub-goals and operations involved during the scenario. The
resultant task network identifies the actors involved, what tasks are being performed,
the temporal structure of tasks and the interrelations between tasks. The HTA output
is then used to construct an Operation Sequence Diagram (OSD) (Chapter 3) of the
task, detailing all activities and interactions between actors involved. The social net-
work is embodied by Social Network Analysis (SNA) (Chapter 8), which considers
the associations between agents during the scenario. It is important to note here that
agents may be human or technological, and so SNA caters too for human–machine
interactions. The Critical Decision Method (CDM) (Chapter 4) focuses on the
decision-making processes used during task performance and the information and
TASK
NETWORK
KNOWLEDGE SOCIAL
NETWORK NETWORK
Distribution and
communication of
information underpinning
knowledge
Define
scenario(s)
Activity Critical
sampling/ Decision
observation Method
Hierarchical Social
Task Network
Analysis Analysis
Representational
methods
Operation Social Comms Coordination
Propositional
Task network sequence network Usage Demands
diagram networks Diagram Analysis
diagrams
The analysis presented in this chapter concerns two scenarios undertaken on a major
UK electrical distribution network. The distribution grid in question consists of 341
geographically dispersed substations in England and Wales, which are used to dis-
tribute electricity to consumers. Power stations (and feeds from continental Europe)
energise the grid, which uses an interconnected network of 400,000 volt (400 Kv),
275 Kv (the super grid network) and 132 Kv overhead lines and towers or cables run-
ning in tunnels to carry electricity from source to substations. The substations are
68 Systems Thinking in Practice
lines. The COCR operator communicated with the other agents via landline tele-
phone and mobile phone. The COCR operator also had access to substation dia-
grams, work logs and databases and the internet. The structure of personnel for
Scenario 1 is presented in Figure 4.4. The structure of personnel for Scenario 2 is
presented in Figure 4.5.
METHODOLOGY
Design
The study was an observational study that involved direct observation of the activi-
ties undertaken during the scenarios analysed. Three researchers acted as observers,
with one located in the field at the substation involved and two located at the central
control room.
Participants
This study involved 11 participants who work for the energy distribution organisa-
tion in question. Scenario 1 involved the following four participants: a CC operator, a
COCR operator and a SAP and AP. Scenario 2 involved the following seven partici-
pants: a CC operator, a COCR operator and a SAP, AP and Competent Person (CP)
at one substation, and SAP at another substation and an overhead line party contact.
Due to access restrictions and the nature of the study (observation during real work
activities), it was not possible to collect demographic data for the participants involved.
70 Systems Thinking in Practice
Central
Command Centre
CC
Operator
Central
COCR
Operator
Operations
Control Room
SAP AP
Substation
Materials
The observers used pen and paper, video and audio recording equipment to collect
data during the observations. All observational and verbal transcripts were tran-
scribed using Microsoft Word. A set of pre-defined interview probes were used for
the CDM interviews, along with a CDM pro-forma to record participants’ responses.
A Dictaphone was also used to record the CDM interviews. Various other software
programs were used to support the analysis presented, including the Agna network
analysis and WESTT software packages and Microsoft Visio.
EAST in Energy Distribution Operations 71
CC Central
Operator Command
Central
Operations
COCR Control Room
Operator OLP
Contact
Overhead Lines
SAP#1 SAP#2
Substation#2
AP#1 CP#1
Substation#1
Procedure
The analyses were based on data collected during live observational study of the two
scenarios. In each scenario, two observers were located at the COCR observing the
COCR operator, and one observer was located in the field with the SAPs/APs at the
substation involved. The analysts located at the COCR observed all of the COCR
operator’s activities and were able to discuss the activities being undertaken and
to query different aspects of the scenarios as they unfolded. The analyst located at
the substations observed the SAP/APs undertaking the work required and was also
able to discuss aspects of the scenario with them. Observational transcripts were
constructed, and audio recordings were used to record the communications between
those involved. The data recorded via observational transcripts included a descrip-
tion of the activity (specific task steps, e.g. ‘issue instructions to SAP at substation’)
performed by each of the agents involved, transcripts of the communications that
72 Systems Thinking in Practice
occurred between agents during the scenarios, the technology used to mediate these
communications, the artefacts used to aid task performance (e.g. tools, computers,
instructions, substation diagrams), time and additional notes relating to the tasks
being performed (e.g. why the task was being performed, what the outcomes were).
CDM interviews were conducted with the key agents involved (the COCR opera-
tor and the SAPs) upon completion of the scenario. This involved decomposing the
scenario into a series of key decision points and administering CDM probes in order
to interrogate the decision-making processes used at each point. For validation pur-
poses, a subject matter expert from the energy distribution company reviewed the
data collected and the subsequent analysis outputs.
RESULTS
Task Networks
HTAs were constructed for each scenario based on standard operating procedures
and direct observation of the scenarios. The HTAs describe each scenario in terms of
a structured hierarchy of goals and sub-goals, along with feedback loops. One useful
way of summarising large and complex HTA outputs is through the construction of
a task network, which provides a summary of the main higher-level goals and tasks
involved and the interaction between them. Task networks for each scenario are pre-
sented in Figure 4.6.
Social Networks
Social network analysis is used to examine individuals or teams who are linked to
each other by communications and to subject that network to mathematical analysis
using Graph Theory (Driskell and Mullen 2004). Social networks were constructed
for each scenario based on the observed communications between agents during task
performance. The structure of each network was then analysed using three network
analysis metrics: density, sociometric status and centrality. Network density represents
the level of interconnectivity of the network in terms of communications links between
agents. Density is expressed as a value between 0 and 1, with 0 representing a network
with no connections between agents and 1 representing a network in which every agent
is connected to every other agent (Kakimoto et al. 2006; cited in Walker et al. 2011).
Sociometric status provides a measure of how ‘busy’ each agent is relative to the total
number of agents within the network under analysis (Houghton et al. 2006). Centrality
is also a metric of the standing of each agent within a network (Houghton et al. 2006),
but here this standing is in terms of its ‘distance’ from all other agents in the network.
A central agent is one that is close to all other agents in the network, and a message
conveyed from that agent to an arbitrarily selected other agent in the network would, on
average, arrive via the least number of relaying hops (Houghton et al. 2006). The social
network analysis for Scenarios 1 and 2 are presented in Figure 4.7.
The social network analysis outputs allow identification of the key communi-
cations ‘hubs’ within each network, as well as a comparison of the communica-
tions network apparent in each scenario. Key agents, specifically those that act as
EAST in Energy Distribution Operations 73
Scenario 1 Scenario 2
FIGURE 4.6 Task models for Scenarios 1 and 2; shading denotes which agents undertake
activities related to each goal.
Information Networks
Information networks were constructed for each scenario phase (as defined by the
task networks) using the observational transcripts, CDM interview responses and the
HTA of the tasks performed. The information network for Scenario 1 is presented
in Figure 4.8. Within Figure 4.8, each node represents a concept, and the directional
arrows show the relationships between the concepts (e.g. substation ‘has’ location,
display ‘shows’ circuit). The information networks were interrogated to identify the
usage and ownership of concepts by each agent involved as well as the key concepts
74 Systems Thinking in Practice
Scenario 1
CC
Operator Agent Density Centrality S. Status
1
COCR
Operator
2
8
1
3
SAP/AP
Scenario 2
Agent Density Centrality S. Status
CC COCR Operator 4.72 6.4
Operator SAP
substation CC Operator 2.6 1.2
3
1 SAP/AP Sub 1 3.25 2.4
4 0.2
4 SAP/AP Sub 2 2.73 2
2
SAP/AP Sub 3 2.73 1.2
1
COCR Overhead line 2,73 0.4
Operator Overhead party
1 line party
8
1
2
2 8
SAP/AP SAP/AP
substation substation
1 2
Analysis (CDA) (Burke 2004) and Communications Usage Diagram (CUD) (Watts
and Monk 2000). In the present study, the task, social and knowledge network analy-
ses were supplemented by OSD, CDA and CUD analyses. The purpose of these
additional analyses was to examine levels of workload and teamwork during the
scenarios and also to evaluate the technologies used to mediate communications.
CUD (Watts and Monk 2000) is used within the EAST framework to describe
the communications between agents and evaluate the technologies used to mediate
80
70
60
50
40
30
20
10
0
COCR Operator CC Operator Senior Authorised
Authorised Person
Person
100
90
80
70
60
50
40
30
20
10
0
COCR CC Operator Senior Authorised Overhead
Operator Authorised Person line party
Person
TABLE 4.1
Information Element Usage by Agents throughout
Each Phase of Scenario 2
Switching
Confirmation Equipment Confirmation
Operations
System State
Locations Locations 275Kv CVTs
Certificate
Switching Work
Reconfiguration Switching Log
Instructions Instructions
Switching
Time Job Cards Cabinet
Phone
Time Earthing
these communications. For the present study, those bottom-level task steps from the
HTAs involving communications between agents were examined. An extract from
the CUD analysis from Scenario 1 is presented in Figure 4.12.
CDA (Burke 2004) is used to derive a rating of the level of coordination exhibited
between team members during collaborative scenarios. Again, using the HTA as its
primary input, teamwork tasks were first identified, following which coordination
between team members on each teamwork task step was rated using a taxonomy
of key teamwork behaviours. An extract of the CDA for Scenario 1 is presented in
Table 4.2.
For Scenario 1, the CDA analysis revealed that 64% of the bottom-level HTA
tasks were teamwork tasks. The mean level of coordination across all teamwork
tasks was 1.57, which represents a medium level of coordination.
SUMMARY
The aim of this chapter was to demonstrate an integrated framework of Human
Factors methods for analysing performance in complex sociotechnical systems.
Although only a summary of the outputs derived were presented, the utility of tak-
ing a framework approach to the analysis of performance in complex sociotechnical
systems is demonstrated. In this case, EAST enables description and examination of
78
Scenario 1
SAP/AP at Comms Analysis of comms
Time COCR Operator CC Operator REC Operator
substation media media
Contact COCR to agree
08:56 SSC in order to release
part of circuit for
substation to control by
COCR + Clear and stable sound
Contact SAP/AP at + Two way comms
+ Allows concurrent viewing
09:08 substation to discuss
outage at Supergrid of site diagrams/desktop
transformer computer screens
+ Confidentiality maintained
Contact SAP/AP at
- Data is not recorded;
substation for information may be lost
09:37 preliminary
discussions about
forthcoming work
Contact SAP at
substation to
confirm isolation
10:13 requirements
TABLE 4.3
Elements of Command and Control Examined Through EAST
Social
Network Propositional
HTA Analysis Networks CDM CUD CDA OSD
Tasks
Communications
Teamwork
Situation Awareness
Decision Making
Technologies
Workload
the task and social and knowledge networks underpinning complex sociotechnical
system performance, along with a deeper analysis of various specific constructs.
For example, in both scenarios, the methods with the EAST framework supported
examination of the following elements of command and control.
Table 4.3 demonstrates how, when taken individually, the outputs offer insight
into various components of command and control (e.g. situation awareness, team-
work, communications); for example, the propositional networks alone can be used
to make judgements on the levels of situation awareness attained throughout the
scenarios and also to determine what knowledge underpins situation awareness dur-
ing energy distributed maintenance scenarios. Integration of the outputs, however,
provides a much deeper insight. For example, viewing the task, social and knowledge
networks together enables judgement to be made on how the procedures used and
the organisation of the social network supported situation awareness during opera-
tions. In the case of the task networks, the standard operating procedures engendered
high levels of closed loop communication between the agents involved throughout
the scenario, including issuing of work instructions, regular updates on work prog-
ress and reporting of completed operations. In the case of the social networks, in
both scenarios, each of the agents involved had one or more ways of communicating
with all other agents (e.g. landline telephone, mobile phone and emails). Further, the
hierarchical structure of the network meant that the COCR operator, effectively as
network commander, would regularly contact (or be contacted by) agents in the field
in order to gather or provide work progress updates, a process that served to update
situation awareness throughout the activities. Combining the analysis outputs thus
allows examination of not only how situation awareness was developed and main-
tained and what it comprised but also why efficient levels of situation awareness were
achieved.
The EAST framework lends itself to in-depth evaluations of complex sociotechni-
cal system performance, examination of specific constructs within complex socio-
technical systems (e.g. situation awareness, decision making, teamwork), and also
EAST in Energy Distribution Operations 81
system, training, procedure and technology design. Whilst not providing direct rec-
ommendations, the analyses produced are often highly useful in pinpointing specific
issues limiting performance or generating system redesign recommendations.
REFERENCES
Burke, S. C. (2004). Team task analysis. In: N. A. Stanton, A. Hedge, K. Brookhuis, E. Salas
and H. Hendrick (Eds.), Handbook of Human Factors and Ergonomics Methods (pp.
56.1–56.8). CRC Press: Boca Raton, FL.
Driskell, J. E. and Mullen, B. (2004). Social network analysis. In: N. A. Stanton, A. Hedge,
K. Brookhuis, E. Salas and H. Hendrick (Eds.), Handbook of Human Factors and
Ergonomics Methods (pp. 58.1–58.6). CRC Press: Boca Raton, FL.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P. M., Stewart, R. and
Walker, G. H. (2006). Command and control in emergency services operations: A
social network analysis. Ergonomics, 49, 1204–1225.
Stanton, N. A., Baber, C. and Harris, D. (2008). Modelling Command and Control: Event
Analysis of Systemic Teamwork. Ashgate: Aldershot, UK.
Stanton, N. A., Salmon, P. M., Baber, C., Walker, G. H. and Jenkins, D. (2005). Human
Factors Methods: A Practical Guide for Engineering and Design. Ashgate: Aldershot,
UK.
Stanton, N. A., Salmon, P. M., Rafferty, L. A., Walker, G. H., Baber, C. and Jenkins, D.
(2013). Human Factors Methods: A Practical Guide for Engineering and Design (sec-
ond edition). Ashgate: Aldershot, UK.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon, P.
M. et al. (2006). Distributed situation awareness in dynamic systems: Theoretical devel-
opment and application of an ergonomics methodology. Ergonomics, 49, 1288–1311.
Stewart, R., Stanton, N. A., Harris, D., Baber, C., Salmon, P. M., Mock, M., Tatlock, K.,
Wells, L. and Kay, A. (2008). Distributed situation awareness in an airborne warn-
ing and control system: Application of novel ergonomics methodology. Cognition
Technology and Work, 10 (3), 221–229.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. M. and Green, D. (2006).
Event analysis of systemic teamwork (EAST): A novel integration of ergonomics meth-
ods to analyse C4i activity. Ergonomics, 49, 1345–1369.
Walker, G. H., Stanton, N. A. and Salmon, P. M. (2011). Cognitive compatibility of motorcy-
clists and car drivers. Accident Analysis & Prevention, 43 (3), 878–888.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Jenkins, D. P. and Salmon, P. M. (2010).
From ethnography to the EAST method: A tractable approach for representing distrib-
uted cognition in air traffic control. Ergonomics, 53 (2), 184–197.
Watts, L. A. and Monk, A. F. (2000). Reasoning about tasks, activities and technology to
support collaboration. In: J. Annett and N. Stanton (Eds.), Task Analysis (pp. 55–78).
Taylor and Francis: London, UK.
5 EAST in a Submarine
Control Room
83
84 Systems Thinking in Practice
Specifically, three networks are considered: task, social and information networks.
Task networks describe the relationships between tasks and their sequence and
interdependences. Social networks analyse the organisation of the system (i.e. com-
munications structure) and the communications taking place between the actors
working in the team. Finally, information networks describe the information that
the different actors use and communicate during task performance (i.e. distributed
situation awareness). Each of these approaches have been presented independently
in other papers, such as Farrington-Darby et al.’ s (2006) presentation of task dia-
grams in a study of railway controllers (an example of a task network); Furniss and
Blandford’ s (2006) presentation of communication channels in emergency medi-
cal dispatch teams (an example of a social network); and Sanderson et al.’ s (1989)
analysis of verbal protocols for a process control task (an example of an information
network). What EAST does is bring these three networks together into the same
analysis framework.
The EAST framework lends itself to in-depth evaluations of complex system per-
formance, examination of specific constructs within complex sociotechnical systems
(e.g. situation awareness, decision making, teamwork) and also system, training, pro-
cedure and technology design. Whilst not providing direct recommendations, the
analyses produced are often highly useful in identifying specific issues limiting per-
formance or highlighting areas where system re-design could be beneficial.
This chapter presents a new shortened form of EAST that focuses on the analysis
of collaborative performance (Stanton et al. 2008). This version of EAST does not
rely upon the previously defined constituent methods of Hierarchical Task Analysis,
Critical Decision Methods, Coordination Demand Analysis, Communications Usage
Diagram and Operation Sequence Diagram. Rather, the task, social and information
networks are developed directly from the raw data. It also extends the quantitative and
qualitative network analysis methods to show how network statistics may be applied
to all three networks and how the different networks’ perspectives may be integrated.
Since its conception, the framework has been applied in many domains, including
naval warfare (Stanton et al. 2006), aviation (Stewart et al. 2008), air traffic control
(Walker et al. 2010a), emergency services (Houghton et al. 2006), energy distribution
(Salmon et al. 2008) and railway maintenance (Walker et al. 2006). The approach is
gaining momentum as well as showing its domain independence.
TABLE 5.1
Systems Characteristics of EAST
focus, context, interactions, holism, emergence and embedding. Any method that
lays claim to be a Systems Ergonomics, such as EAST, should embody these charac-
teristics. Table 5.1 indicates how EAST encapsulates these properties.
As the contents of Table 5.1 attest, EAST passes the ‘ systems’ test. By conceiv-
ing of systems as sets of interacting networks (i.e. task, social and information net-
works), it has the distinct advantage of enabling network analysis and classification
of network archetypes. This means that the systems analysis methods can be framed
in terms of quantitative and qualitative assessments. Networks do not differentiate
between different types of node (e.g. artefacts and/or people) so that from a model-
ling perspective they are not constrained by existing structures of people and arte-
facts; rather, they are related to the tasks associated with a scenario. It is also possible
to model the temporal aspects of networks by identifying critical moments in the
sequence of activity. To do this, the scenario is divided into task phases allowing
active and non-active elements to be specified and represented.
Hutchins 1995). The purpose was to understand how information flowed around
the system in order to determine what requirements might be included in the next
generation of tactical systems.
The data were collected over a series of observations in a control room and sound
room layout in the Talisman Command Team Trainer. There is a strong communica-
tion link between the Officer of the Watch (OOW), Chief Petty Officer for Tactical
Systems (CHOPS[TS]: sometimes called the OpsO or Operations Officer) and the
Sound Room Controller (SRC, sometimes called the Sonar Controller or CHOPS[S]).
The layout of the control room and sound room is fixed by the equipment layout but has
been optimised over the decades to the current design. The photograph in Figure 5.2
shows a view into the control room with the periscope on the right-hand side.
All of the internal communications were recorded by plugging into the system
and recording on a laptop computer using Audacity (version 1.3.14 software). The
ambient communications were recorded using an external Yoga BM-26D boundary
microphone.
The purpose of this chapter was to see if the networks could be analysed quantita-
tively using Social Network Analysis (SNA) metrics. SNA offers a means of analysing
the network as a whole as well as the behaviour of individual nodes and their inter-
actions. As such, SNA is potentially a very powerful tool for Systems Ergonomics.
Whilst it has traditionally been applied to the analysis of social networks (as implied
by the name of the method) Driskell and Mullen 2005; Houghton et al. 2006), there
is no reason why it cannot be applied to other networks, such as task and information
networks. This is a new application for the method but a potentially useful one. The
method can also be applied to the design of anticipated networks, so that more effec-
tive task, social and information networks can be designed into new systems, which
FIGURE 5.2 View into the control room with periscope on right-hand side.
88 Systems Thinking in Practice
is another new avenue of research for Systems Ergonomics that would enable network
resilience to be explored in a practical manner. The first step in a SNA involves defin-
ing the network that is to be analysed. Once the overall network type is specified,
the tasks, agents or information should be specified. Once the type of network under
analysis has been defined, the scenario(s) within which they will be analysed should
be defined. For the purposes of this chapter, the scenario for return to periscope depth
(RTPD) was considered. Once the network and scenario(s) under analysis are defined
clearly, the data collection phase can begin. There are a number of metrics associated
with the analysis of social networks, depending upon the type of evaluation that is
being performed. The size of the network determines the number of possible relations,
and the number of possible relations grows exponentially with the size of the network.
This defines the network’s complexity. An explanation of the metrics analysed using
AGNA (version 2.1.1 – a software program for computing the SNA metrics) are pro-
vided below. The first set of metrics analyse the individual nodes:
• Emission and reception degree are the number of ties emanating from, and
going to, each agent in the network.
• Eccentricity is defined by the largest number of hops an agent has to make
to get from one side of the network to another.
• The sociometric status of each agent refers to the number of communica-
tions received and emitted, relative to the number of nodes in the network.
• Agent centrality is calculated in order to determine the central or key
agent(s) within the network. There are a number of different centrality cal-
culations that can be made. For example, agent centrality can be calculated
using Bavelas-Leavitt’ s index.
• Closeness is the inverse of the sum of the shortest distances between each
individual and every other person in the network. It reflects the ability to
access information through the ‘ grapevine’ of network members.
• Farness is the index of centrality for each node in the network, computed as
the sum of each node to all other nodes in the network by the shortest path.
• Betweenness is defined by the presence of an agent between two other agents,
which may be able to exert power through its role as an information broker.
The first step in the analysis was to calculate the statistics for each of the nodes in
the network, of which a range can be produced to represent the metrics of distance
EAST in a Submarine Control Room 89
and analysis) were then computed using AGNA. Whilst using SNA to analyse task
structures is somewhat new to ergonomics, it can give us some insights into the use
of metrics. Obviously, the task ‘ detect close contacts’ is critical in RTPD, which is
reflected in most of the metrics. Some of the other tasks are less obvious. The two
tasks of ‘ clear stern arcs’ and ‘ range all contacts’ score quite low on Sociometric
Status but quite high on Centrality and Betweenness. The higher the value means the
higher each task is scored on that metric.
The network density was 0.14 (i.e. a low distribution network) and cohesion was
0.02 (i.e. a very low level of reciprocal links – suggesting very strict dependences
in the task network, as shown in the task network diagram) with a diameter of 9
(i.e. nine hops from one side of the network to the other). The network can also be
described as weighted (i.e. non-uniform) and asymmetric (i.e. unbalanced).
TABLE 5.2
Analysis of Task Network
Final Warner Establish
OOW Detect OOW report Conduct Conduct Return to clearances look at
Task Network Safe outstations Clear Range all close report to from standard silent periscope at periscope periscope Conduct
EAST in a Submarine Control Room
Analysis depth briefing stern arcs Ballasting contacts contacts Captain outstations routine routine depth depth depth mission
Reception 2 1 2 2 1 7 1 2 1 1 2 1 2 1
Emission 1 3 2 1 3 1 1 3 2 2 3 2 2 0
Eccentricity 8 7 6 7 5 9 6 6 7 7 7 8 9 0
Sociometric 0.2 0.3 0.3 0.2 0.3 0.6 0.2 0.4 0.2 0.2 0.4 0.2 0.3 0.1
Status
Centrality (B-L) 7.7 7.8 7.9 6.9 7.7 7.5 6.5 7.3 6.4 6.4 6.3 5.7 5.8 10.4
Closeness 0.2 0.3 0.3 0.2 0.4 0.2 0.3 0.3 0.3 0.3 0.3 0.2 0.2 0
Farness 58 46 41 53 36 67 46 39 46 46 49 56 63 0
Betweenness 67 68 70 0 70 65 0 59 17 17 31 0 12 0
91
92 Systems Thinking in Practice
TABLE 5.3
Association Matrix for the RTPD Scenario
Sound Ships
From/To Captain OOW OpsO Control SMCS WEO Control Warner WECDIS
Captain 2 1 1 1 2 1 1 1
OOW 9 9 4 4 4 21 4 4
OpsO 3 3 38 5 3 3 8 3
Sound 0 0 28 0 0 0 0 0
Control
SMCS 0 0 0 0 0 0 0 0
WEO 2 0 0 0 0 0 0 0
Ships 0 31 0 0 0 0 0 0
Control
Warner 0 0 4 0 0 0 0 0
WECDIS 0 1 0 0 0 0 0 0
EAST in a Submarine Control Room 93
(i.e. a medium distributed network – which is likely to have good resilience against
failure of the network) and cohesion was 0.2 (i.e. a low level of reciprocal links) with
a diameter of 2 (i.e. two hops from one side of the network to the other) and 29 edges
(i.e. when an in-link to an agent had a corresponding out-link to another agent) for a
network of nine nodes. The network can be described as weighted (i.e. non-uniform)
and asymmetric (i.e. unbalanced). As a baseline study, this characterised the network
for returning the submarine to periscope depth.
TABLE 5.4
Social Network Metrics for the Network for the RTPD Scenario
Social Network Analysis Captain OOW OpsO Sound SMCS WEO Ship Cont Warner WECDIS
Reception 14 37 37 43 10 9 25 13 8
Emission 10 54 66 28 0 2 31 4 1
Eccentricity 1 1 1 2 0 2 2 2 2
Sociometric Status 3 11 12 9 1 1 7 2 1
Centrality(B-L) 5.2 5.5 5.5 3.8 7.6 3.8 3.8 3.8 3.8
Closeness 1 1 1 0.5 0 0.5 0.5 0.5 0.5
Farness 8 8 8 15 0 15 15 15 15
Betweenness 7 14 14 0 0 0 0 0 0
Systems Thinking in Practice
EAST in a Submarine Control Room 95
FIGURE 5.5 Information network for returning the submarine to periscope depth.
Systems Thinking in Practice
EAST in a Submarine Control Room 97
information is used and parsed between people performing tasks. First, the combined
task and social networks are presented, wherein the people are mapped onto the task
network. Next, the information and social networks are presented, wherein the people
are mapped onto the information network. Finally, the three networks are integrated,
wherein the information network is coded by the people and tasks.
TABLE 5.5
Analysis of Simplified Information Network
Information
Network Analysis Periscope Trim Depth Manoeuvre Course Steer Report Contacts Classification Merchant Picture Tracks Cuts
Reception 1 1 3 2 3 1 3 3 3 1 3 3 1
Emission 1 1 3 2 3 1 3 4 2 1 3 3 1
Eccentricity 7 7 6 5 4 5 4 5 6 7 5 6 7
Sociometric Status 0.2 0.2 0.5 0.3 0.5 0.2 0.5 0.6 0.4 0.2 0.5 0.5 0.2
Centrality (B-L) 4.9 4.9 6.2 7.5 8.8 6.4 9.1 8.2 6.7 5.2 8.0 6.8 5.3
Closeness 0.2 0.2 0.3 0.3 0.4 0.3 0.4 0.4 0.3 0.2 0.4 0.3 0.2
Farness 52 52 41 34 29 40 28 30 39 50 32 37 48
Betweenness 0 0 42 54 78 0 72 42 23 0 22 23 0
Systems Thinking in Practice
EAST in a Submarine Control Room 99
sweep is to search for close in contacts and the second sweep for contacts at greater
distance. Any contacts on a potential collision course would lead the OOW to order
the submarine back to a safe depth. If the submarine is safe at periscope depth, then
the mission intentions can be carried out, in which all of the specialist roles will be
performing their respective tasks.
(both social and technological). These changes need to be tracked if the phenomena
are to be properly understood. As Figure 5.8 shows, the sound room and control
room really do function as a distributed cognition system, with ownership of infor-
mation flowing around the network. No one individual owns all of the information;
rather, the system works as a functional unit.
The colour coding by the social agents reveals clusters of information that fea-
ture around the main information nodes identified in the Section 5 on ‘ information
networks’ (i.e. cuts, tracks, picture, merchant, classification, contacts, reports, steer,
course, manoeuvre, depth, trim and periscope). These are presented in Table 5.6.
The relationships between the key concepts and the roles in Table 5.6 show the
information exchanges that occur in the course of the submarine returning to peri-
scope depth. These information exchanges are called transactions , as the informa-
tion flows both ways. In a simple exchange, this may be a request, followed by an
information transfer and ending with a confirmation (as revealed in the communica-
tion analyses). The transaction informs both the person requested and the requestor.
TABLE 5.6
Analysis of Concepts by Social Agents
and technical aspects of the system. EAST accepts that systems are intertwined and
analyses the system as a whole rather than on the basis of its constituent parts. The
research has shown that the network models are able to characterise the domain
in different, but complementary, ways. The seven outputs, namely the individual
task networks, social and information networks (and associated metrics), and the
combined networks (i.e. task and social network, information and social network,
information and task network, and task, social and information network) offer a
graphical representation of distributed cognition (e.g. the sound and control room)
from different perspectives. The different perspectives offered by the representations
are an attempt to characterise the activities between the sound and control rooms in
returning the submarine to periscope depth.
This chapter extends the work of Walker et al. (2010a) by applying metrics to all
three task, social and information networks to provide insights into the structural
integrity and the relative contribution of each of the nodes. It has also been shown
that it is possible to construct the networks directly from the observational data.
Walker et al. (2010a) demonstrated the benefits of the network representations over
the traditional ethnographic narratives and pictures (Hutchins 1995), which has been
reinforced in the current chapter. It has been shown that the network models offer a
useful way of considering distributed cognition in systems to reveal the interdepen-
dences between tasks, agents and information. There are some similarities between
the approach taken by EAST and that of Actor Network Theory (ANT) (Engestrom
2000), but EAST represents the networks separately as well as together. Both EAST
and ANT have, at their core, a conceptual triangulation between objects, actors and
events. Both use networks of relationships to graphically display their analysis. Also,
EAST goes further than ANT to apply statistical analysis to the networks as well
as identify network archetypes. Nevertheless, there are important similarities in the
EAST in a Submarine Control Room
approach and representation. Arguably, ANT relies more heavily upon the skill of the
analyst to identify themes in the networks, whereas the use of verbal protocol data and
SNA metrics by EAST has reduced this subjectivity. The use of social network sta-
tistics may be one way of examining the potential resilience of networks (Hollnagel
et al. 2006) – which may be particularly useful as metrics of distributed cognition. This
is a new concept and methodology, so further studies are required to test its efficacy.
The representations in this chapter revealed the clustering of tasks, social agents
and information. These clusters show how the constituent parts of the networks have
been bound together, either by chance or design. As the system has developed over
a century of submarine operations, it reflects a high state of evolution, but that does
not mean that the system cannot be improved upon. The representations afford both
quantitative and qualitative structural analysis. The quantitative analyses have been
presented at some length and offer insights into the potential integrity and resilience
of the system. As a method for Resilience Engineering, EAST can be used to assess
the potential weaknesses and points of failure in socio-technical structures. The
qualitative analyses enable the network structures to be classified into archetypes
(e.g. chain, circle, tree, star, mesh, small world and fully connected) (Stanton et al.
2008; Stanton et al. 2012). In these terms, the task network appears to be a hybrid of
a chain and circle archetype, the social network appears to be a hybrid of a star and
circle archetype and the information network appears to be a small world archetype.
This analysis is somewhat speculative at this point, and further research is needed to
understand the relationship between the metrics for network resilience and the arche-
types of network structure. There are some early indications that the small world
networks offer the greatest resilience and efficiency (Stanton et al. 2012).
EAST described the control room in terms of task, social and information net-
works as well as exploring the relationships between those networks. The individual
networks were used to describe the respective relationships between the tasks (such
as the task dependencies and sequences), between social agents (such as sociometric
status of agents based on communications) and information (such as the interdepen-
dences between the concepts discussed). The combined task and social networks
showed which roles were performing the tasks in series and parallel. The combined
information and social networks showed which roles were communicating the infor-
mation concepts. The three integrated networks described how information was used
and communicated by people working together in the pursuit of tasks. Any new
conceptualisation of the command system will need to consider the likely changes
on these sociotechnical networked structures.
EAST was able to characterise the activities in the control room of the Trafalgar
class submarine. Thus, it is capable of being applied to a complex sociotechnical
‘ system of systems’ to present ‘ networks of networks’ . EAST offered complemen-
tary descriptions of the requirements for the RTPD task using the current command
system. The networks show multiple perspectives on the activities in the system,
which is a necessary requirement for sociotechnical analysis. Further analysis
should attempt to characterise future command systems so that the multiple per-
spectives can be compared and ‘ so-what’ questions can be asked as ideas for design
of the social and technical aspects of the system co-evolve (Clegg 2000; Walker
et al. 2010b; Stanton et al. 2012). EAST has the potential to map the task, social
106 Systems Thinking in Practice
ACKNOWLEDGEMENTS
The author would like to thank Kevin Bessell of BAE Systems for his assistance with
recording and transcribing the verbal communication data.
This work from the Human Factors Integration Defence Technology Centre (HFI
DTC) was part-funded by the Human Capability Domain of the UK Ministry of
Defence.
REFERENCES
Clegg, C. W. (2000). Sociotechnical principle for system design. Applied Ergonomics , 31,
463– 477.
Driskell, J. E. and Mullen, B. (2005). Social network analysis. In: N. A. Stanton, A. Hedge,
K. Brookhuis, E. Salas and H. Hendrick (Eds.), Handbook of Human Factors and
Ergonomics Methods . Taylor & Francis: London, UK.
Engestrom, Y. (2000). Activity theory as a framework for analyzing and redesigning work.
Ergonomics , 43 (7), 960– 974.
Farrington-Darby, T., Wilson, J. R., Norris, B. J. and Clarke, T. (2006). A naturalistic study
of railway controllers. Ergonomics , 49 (12– 13), 1370– 1394.
Furniss, D. and Blandford, A. (2006). Understanding emergency medical dispatch in terms of
distributed cognition: A case study. Ergonomics , 49 (12– 13), 1174– 1203.
Griffin, T. G. C., Young, M. S. and Stanton, N. A. (2010). Investigating accident causation
through information network modelling. Ergonomics , 53 (2), 198– 210.
Hollnagel, E., Woods, D. D. and Leveson, N. (2006). Resilience Engineering: Concepts and
Precepts . Ashgate: Aldershot, UK.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P. M., Stewart, R. and
Walker, G. H. (2006). Command and control in emergency services operations: A
social network analysis. Ergonomics 49 (12– 13), 1204– 1225.
Hutchins, E. (1995). Cognition in the Wild . MIT Press: Cambridge, MA.
Jenkins, D. P., Salmon, P. M., Stanton, N. A., Walker, G. H. and Rafferty, L. A. (2011). What
could they have been thinking? How sociotechnical system design influences cogni-
tion: A case study of the Stockwell shooting. Ergonomics , 54 (2), 103– 119.
McIlroy, R. C. and Stanton, N. A. (2011). Specifying the requirements for requirements speci-
fication: The case for work domain and worker competencies analyses. Theoretical
Issues in Ergonomics Science , 13 (4), 450– 471.
Patrick, J., James, N. and Ahmed, A. (2006). Human processes of control: Tracing the goals
and strategies of control room teams. Ergonomics , 49 (12– 13), 1395– 1414.
EAST in a Submarine Control Room 107
Plant, K. L. and Stanton, N. A. (2012). Why did the pilots shut down the wrong engine?
Explaining errors in context using Schema Theory and the Perceptual Cycle Model.
Safety Science , 50 (2), 300– 315.
Salmon, P. M., Stanton, N. A., Walker, G. H., Jenkins, D. P., Baber, C. and McMaster, R.
(2008). Representing situation awareness in collaborative systems: A case study in the
energy distribution domain. Ergonomics , 51 (3), 367– 384.
Sanderson, P., Verhage, A. G. and Flud, R. B. (1989). State-space and verbal protocol methods
for studying the human operator in process control. Ergonomics , 32 (11), 1343– 1372.
Stanton, N. A., Baber, C. and Harris, D. (2008). Modelling Command and Control: Event
Analysis of Systemic Teamwork . Ashgate: Aldershot, UK.
Stanton, N. A., Salmon, P. M., Walker, G. H., Baber, C. and Jenkins, D. P. (2005). Human
Factors Methods: A Practical Guide for Engineering and Design . Ashgate: Aldershot,
UK.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon,
P. M. et al. (2006). Distributed situation awareness in dynamic systems: Theoretical
development and application of an ergonomics methodology. Ergonomics 49 (12– 13),
1288– 1311.
Stanton, N. A., Walker, G. H. and Sorensen, L. J. (2012). It’ s a small world after all:
Contrasting hierarchical and edge networks in a simulated intelligence analysis task.
Ergonomics , 55 (3), 265– 281.
Stewart, R., Stanton, N. A., Harris, D., Baber, C., Salmon, P. M., Mock, M., Tatlock, K. and
Wells, L. (2008). Distributed situational awareness in an airborne warning and control
aircraft: Application of a novel ergonomics methodology. Cognition, Technology and
Work , 10 (3), 221– 229.
Vicente, K. J. (1999). Cognitive Work Analysis: Toward Safe, Productive, and Healthy
Computer-Based Work . Lawrence Erlbaum Associates: Mahwah, NJ.
Von Bertalanffy, L. (1950). The theory of open systems in physics and biology. Science , 111,
23– 29.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. M. and Green, D. (2006).
Event analysis of systemic teamwork (EAST): A novel integration of ergonomics meth-
ods to analyse C4i activity. Ergonomics , 49 (12– 13), 1345– 1369.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Gibson, H., Salmon, P. M. and Jenkins, D. P.
(2010a). From ethnography to the EAST method: A tractable approach for representing
distributed cognition in air traffic control. Ergonomics , 53 (2) 184– 197.
Walker, G. H., Stanton, N. A., Salmon, P. M., Jenkins, D. P. and Rafferty, L. A. (2010b).
Translating concepts of complexity to the field of ergonomics. Ergonomics , 53 (10),
1175– 1186.
Waterson, P. (2009). A systems ergonomics analysis of the Maidstone and Tunbridge Wells
infection outbreaks. Ergonomics , 52 (10), 1196– 1205.
Wilson, J. R. (2012). Fundamentals of systems ergonomics. Work , 41, 3861– 3868.
6 EAST in Railway
Maintenance
With Huw Gibson and Chris Baber
In order to extract data from complex and diverse scenarios, a methodology called
Event Analysis for Systemic Teamwork (EAST) was developed. With over 90 exist-
ing ergonomics methodologies already available, the approach taken was to inte-
grate the following: a Hierarchical Task Analysis (Annett et al. 1971), a Coordination
Demand Analysis (CDA_ (Burke 2005), a Communications Usage Diagram (CUD)
(Watts and Monk 2000), a Social Network Analysis (Scott 1991; Driskall and
Mullen 2005) and the Critical Decision Method (Klein et al. 1989). The outputs of
these methods provide two summary representations in the form of an enhanced
Operation Sequence Diagram and Propositional Network. These offer multiple and
overlapping perspectives on key descriptive constructs, including who the agents are
in a scenario, when tasks occur, where agents are located, how agents collaborate
and communicate and what information is used and knowledge shared. The appli-
cation of these methods to live data drawn from the UK rail industry demonstrates
how alternate scenarios can be compared on key metrics, how multiple perspectives
on the same data can be taken and what further detailed insights can be extracted.
Applied across a number of scenarios in different civil and military domains, the
ultimate aim of EAST is to provide data to develop generic models of C4i (com-
mand, control, communications, computers and intelligence) activity, and to improve
the design of systems aimed at enhancing this management infrastructure.
INTRODUCTION
C4i is the management infrastructure for any large, complex and dynamic resource
system (Harris and White 1987). An underlying mechanism for organisation and
planning is needed where there are multiple individuals, or teams of individuals,
who need to communicate and coordinate in order to achieve an efficient outcome
to a common goal. Although the notion of command and control is one that might
popularly be thought of as occurring in the military domain, examples of underlying
organisational and planning infrastructures also abound in the civil domain.
C4i embodies people, teams, technology, knowledge and information. It is a
multi-faceted endeavour that can be viewed from a variety of different and concur-
rent perspectives. This is can be challenging not just for those engaged in sustaining
effective performance within a C4i scenario, but also for those engaged in analys-
ing such a scenario. The multiple and concurrent perspectives include the micro-
level descriptions of tasks, actors, and individual cognition, through the meso-level
109
110 Systems Thinking in Practice
The aim of this chapter is to present an analysis methodology that feeds into the
development of generic models and theories of C4i. In order to do this, the method
seeks to make sense of the informational chaos identified above by the structured and
systematic extraction of data from C4i scenarios. The ultimate aim of this extrac-
tion and modelling process is for the Defence Technology Centre for Human Factors
Integration (DTC HFI) to generate the level of understanding required to deploy
novel forms of technology in ways that contribute optimally towards the effective-
ness of achieving the goals of C4i scenarios. So, in summary, the context of the
proposed descriptive methodology generates the following specific requirements to:
This chapter describes the development and application of the EAST methodol-
ogy, which was designed to meet these requirements. EAST was developed specifi-
cally to analyse C4i in any domain (DTC HFI 2003).
There are over 90 different methods available to the ergonomist covering virtu-
ally all aspects of system design and description, including the constructs above
EAST in Railway Maintenance 111
(Stanton et al. 2005). It would seem evident based on this that a high degree of
circumspection is required before embarking on the development of yet more. This
is especially so given the multi-faceted, and therefore multi-measurement, approach
that would be required to analyse C4i scenarios. In other words, the task of develop-
ing and then subsequently validating the range of methods needed to access all the
required perspectives on C4i is formidable. Instead, an approach based on method
integration is proposed. This has a number of compelling advantages, because not
only does the integration of existing methods bring reassurance in terms of a vali-
dation history, but it also enables the same data to be analysed from multiple per-
spectives. These multiple perspectives, as well as being inherent in the object that
is being described and measured (C4i scenarios), also provides a form of inter-
nal validity. Assuming that the separate methods integrate on a theoretical level,
then their application to the same data set offers a form of ‘analysis triangulation’.
Therefore, the internal structure of the EAST methodology can be broken down into
three layers comprised of associated methods already established in the literature:
TABLE 6.1
CDM Probes
Source: O’Hare et al., Task Analysis, Taylor and Francis, London, UK, 2000, 170–190.
system design. The multiple perspectives available from HTA fit well with the multi-
ple perspectives available from C4i scenarios. HTA has additional pragmatic benefits
because it already underpins a number of subsequent analysis methodologies such as
CDA (Burke 2005) and CUD (Watts and Monk 2000), making it an ideal candidate
for method integration. Task analysts applying HTA are also required to understand
both the ways in which people adapt to their environment and the ways that they adapt
their environment to themselves. Thus, HTA has the further benefit of capturing and
114 Systems Thinking in Practice
specifying the contextual conditions and precursors within C4i scenarios. These are
represented within detailed task descriptions and as ‘plans’ within the hierarchy.
In its application within EAST, the definition of the HTA proceeds with ref-
erence both to what has been observed and to what may have been previously
defined through any pre-existing task analyses. It is possible to meaningfully
integrate these information sources on goal structure to produce a task analysis
that accurately describes what has been observed, is consistent with what has
already been pre-defined and also covers key decision points covered in the CDM
interview.
TABLE 6.2
Coordination Demand Dimensions
Summary of Methods
Whilst the methods above are tried and tested, the integration of them into EAST
represents a new approach. Each method provides insight into the main descrip-
tive constructs identified above. The HTA identifies the actors in the scenario, the
temporal structure of tasks, where tasks (and associated actors) are taking place and
what tasks are being performed. The HTA is one of the main foundation methods
within EAST and drives the CDA analysis, which provides structured insight into
the general question of how teamworking tasks are performed and what teamwork-
ing skills they require. The CUD is also founded on data from the HTA; it provides
insight into who the actors are, the flow of tasks (i.e. when), where actors are located
geographically, what items are being communicated and how (i.e. the communica-
tions technology used). The SNA extends the analysis of communications by consid-
ering the ‘links’ between actors rather than task flow. These two perspectives on ‘the
who’ are complementary. Table 6.3 is a methods matrix that relates the component
methods to the descriptive constructs identified above. The overlap between methods
and the constructs they access is explained by the multiple perspectives provided on
issues such as ‘who’ and ‘what’. For example, the HTA deals with ‘what’ tasks, the
TABLE 6.3
Methods Matrix Mapping Descriptive C4i
Constructs onto Component Methods of EAST
CDA deals with ‘what’ teamworking skills, and the CUD deals with ‘what’ com-
munications technology is used. Each is a different but complementary perspective
on the same descriptive construct and a different but complementary perspective on
the same data derived from observation and interview, that is, analysis triangulation.
thus representing the structure of knowledge at key decision points in the scenario.
The outputs of EAST provide an integrated picture of multiple perspectives; that is, the
component methods are compatible with each other to the extent that they can be sum-
marised within a common representation (e.g. the OSD), but the individual methods,
and combinations of them, are also capable of generating insights at the core of C4i.
PROCEDURE
The high-level procedure for applying EAST can be summarised in Table 6.4 below
as involving nine key steps. Obviously, within these overall headings, a degree of
flexibility can be adopted to suit the particular domain or circumstances.
Background
Under normal conditions, a signaller has the key responsibility for controlling train
movements and maintaining safety for an area of railway line. This control occurs
remote from the line at a control centre (a signal box or signalling centre). These can
be located many miles from where activity could be taking place.
During maintenance, another person takes responsibility for an area of the line
(sometimes referred to as a possession) and/or for preventing trains passing over
the possession (measures referred to as protection). These individuals are normally
termed the person in charge of possession (PICOP) or controller of site safety
120
TABLE 6.4
High-Level Procedure for EAST
The activity samples are collated to produce full EAST analysis. of C4i scenario
EAST in Railway Maintenance 121
oncoming trains at the limits of the possession (these take the form of explosive
charges called detonators, which emit a loud noise to alert drivers who may have just
run over them). Additional complexity comes in the form of a number of engineering
work sites within the possession, each of which has an engineering supervisor (ES)
and COSS responsible for setting up and managing each one. The ES will also use
‘competent personnel’ to place marker boards as a form of additional protection at
the ends of the individual worksites.
The following is an extract from the verbal transcripts and shows a typical com-
munication occurring between the signaller (S) and PICOP:
PICOP ‘the blocks [protective measures] now been put out mate on the down
main slow and the up main slow …’ [referring to different lines]
S ‘… right …’
PICOP ‘… and its clear of 15 64 b points and 15 12 b points.’
S ‘It’s all yours, at, er, what we on, 9:53 then.’
PICOP ‘oh, 9:53, cheers mate.’
S ‘… ok …’
PICOP ‘Can I take your name please, I forgot to write it down earlier’
S ‘… [provides name].’
PICOP ‘[name] thanks a lot mate …’
S ‘ok …’
PICOP ‘… bye.’
It is interesting to note the data collection transcripts that highlight that some of
the required and critical steps may be implied (e.g. the PICOP’s closure of communi-
cation is by saying ‘bye’, which is implied by the signaller to mean that there are no
remaining issues or ambiguity and that points 15 64b, and 15 12b are indeed clear)
and that the sequencing of communications is more flexible than the procedures may
suggest (e.g. the PICOP may only enquire in more detail as to the name of the signal-
ler at the stage when it is needed for the completion of documentation, rather than at
the beginning of a call). However, at the level illustrated above, any informality or
flexibility occurs within the confines of a well-defined procedure.
CDA
Based on Figure 6.4, the supposition that C4 is dominated by coordination tasks
appears to be justified. In the three scenarios under analysis, the tasks that fall into
100%
75%
% Total tasks
50%
25%
0%
Emergency Possession Hand back
Team 71.79 67.57 66.04
Task 28.21 32.43 33.96
Team Task
3.00
2.00
1.00
0.00
n
tio
s
es
ing
sis
ica
ip
en
ak
ity
sh
aly
un
s
ar
es
n
m
bil
er
m
an
tio
aw
en
ion
ta
ad
m
ina
ion
ap
Co
tiv
ion
Le
cis
rd
Ad
er
iss
at
De
oo
s
tu
As
lc
Si
ta
to
n
ea
M
FIGURE 6.5 Results of CDA analysis showing profile of results on each of the coordination
dimensions.
the ‘teamwork’ track, and that require coordination, form between 66% and 72% of
total tasks undertaken.
Figure 6.5 extracts the teamwork tasks for further analysis. The analysis proceeds
according to seven coordination dimensions and one summary total coordination
score (based on the mean of the individual scores). This analysis reveals a broadly
similar pattern of coordination activity within the scenarios; certainly the total coor-
dination figures are comparable, falling within the mid-point of the rating scale. Of
more interest is the pattern of results across the seven individual dimensions, where a
distinctive footprint emerges. Communication, situational awareness (SA) and deci-
sion making are prominent dimensions, and there is also a smaller ‘blip’ for the lead-
ership dimension. Leadership can be taken as a further indication perhaps of some
decision-making activity. It can be further noted that the larger (and more complex)
the scenario, the larger the leadership ‘blip’ is. Therefore, in summary, not only are
the majority of total tasks dominated by coordination activities, but those activities
are also dominated by communications and the creation and maintenance of SA.
CUD
General observations from the CUD analysis are that the communications are entirely
verbal. Given the nature of the scenario, verbal and telephone communications
126 Systems Thinking in Practice
Of course, any new approaches would require fuller risk justification and assess-
ment within the wider task context before application. The key point is that the CUD
method provides a systematic way of presenting the existing situation and consid-
ering alternatives to it based on data. Figure 6.6 summarises the communications
technology in use within the scenarios.
SNA
Social Network Analysis is used in the EAST method to represent and summarise
the communication/information links between agents in the scenario. Figure 6.6
presents a graphical representation of the networks derived from each of the sce-
narios and is also annotated with communications information drawn from the CUD
analysis.
A range of mathematical metrics (derived from Graph Theory) can be applied.
The results show that the PICOP, signaller and ESs have the highest levels of socio-
metric status and centrality. These metrics indicate that they are key agents in the
scenarios. The notion of centrality is also borne out when considering ‘betweenness’;
that is, the PICOP and ES fall between pairs of other positions in the network the
most frequently.
Having identified the key agents, it is also possible to view the network as a whole
under the concept of network density. Density is the degree of interconnectivity
between agents or the number of network links used compared to those that are
FIGURE 6.6 Graphical representation of social networks overlain with comms media
drawn from CUD analysis.
EAST in Railway Maintenance 127
TABLE 6.5
Comparison of Network Density between Scenarios
theoretically available (the maximum being a case where all agents are linked to
each other). In Table 6.5, it can be seen that the emergency possession scenario has
the densest pattern of connectivity, with the remaining two scenarios being broadly
comparable.
Although the metrics allow comparison between networks, intelligent inter-
pretation is required. For example, a network with every agent connected to each
other would permit easy dissemination of information, but it might also be ineffi-
cient. Similarly, having one central node may have advantages for coordination but
offers the potential for an information bottleneck. Houghton et al. (2006) discuss
the implications of several prototypical networks and their comparison to live sce-
nario networks. The main point is that the interpretation and then subsequent com-
parison of networks has to take into account a range of contextual factors. For the
time being, the networks derived from the scenarios above appear to be relatively
well matched to the procedures being undertaken, with a mix of central agents and
interconnectivity.
Representational Methods
Scenario Process Charts (OSD)
Figure 6.7 presents a sample of an enhanced OSD from scenario 1 (the planned
maintenance activities), and highlights how the preceding methods are integrated
with it.
The operations loading is presented in Table 6.6, showing the PICOP, signaller
and CP as the most heavily loaded individuals in the network in terms of tasks. The
operations loading table provides a further level of summarisation in being able to
capture, in a relatively compact manner, the process-based aspects of what is often
a large OSD.
TABLE 6.6
Task Loading Table
Operations
Agent Operation Receive Decide Transport Total
PICOP 54 30 1 85
Signaller 17 16 1 34
Eng. Supervisor 13 17 1 31
Competent Person 1 17 20 1 38
EAST in Railway Maintenance 129
Summary
The summary and individual outputs derived from EAST have been presented. It should
be evident that the data generated from an EAST analysis are extensive, so in Figure 6.9,
an attempt is made to convey an impression of what the total EAST representation looks
like. It is from this representation that a C4i scenario can be surveyed relatively quickly
according to the key constructs of who, when, where, how and what. In turn, areas and
themes that require further detailed insights can be extracted and examined.
CONCLUSIONS
Further Insights
The individual outputs available from EAST present a number of distinct but overlap-
ping perspectives on the railway maintenance scenarios. This structured collection
of data is required for the subsequent generic modelling and C4i theory develop-
ment that is the main purpose of, but is separate from, the EAST method. However,
along with contributing to theoretical data, a number of more practical themes can
be drawn from each EAST analysis. The main practical themes related to this EAST
analysis of railway data have been identified as follows:
1. The HTA and OSD highlight the sequential nature of the tasks involved.
There is relatively limited decision making, and therefore the complexity
comes from a requirement on the personnel involved to time and precisely
sequence their actions.
130 Systems Thinking in Practice
FIGURE 6.10 Plan for detailed analysis of communications and SA within railway scenarios
Wider Context
In conclusion, the application of the EAST methodology to live railway data illus-
trates the design and descriptive capability of the method. The method summarises
the task structure, network structure and operational context into a form that enables
ready comparisons on key metrics to be drawn between scenarios and for individual
practical themes and insights to be analysed further. The method is also scalable,
and its application by the DTC HFI to a host of military and civil domains is provid-
ing the data necessary to provide input into the development of generic models and
theories of C4i.
ACKNOWLEDGEMENTS
The assistance of the Rail Safety and Standards Board is gratefully acknowledged,
and the data presented here are used with their kind permission.
This work from the Human Factors Integration Defence Technology Centre
(HFI DTC) was part-funded by the Human Sciences Domain of the UK Ministry of
Defence Scientific Research Programme.
REFERENCES
Anderson, J. R. (1980). Cognitive Psychology and its Implications. Freeman: San Francisco,
CA.
Annett, J. (2003). Hierarchical task analysis. In D. Diaper and N. A. Stanton (Eds.), Handbook
of Task Analysis in Human–Computer Interaction (pp. 67–82). Lawrence Erlbaum
Associates: Mahwah, NJ.
Annett, J. (2005). Hierarchical task analysis. In N. A. Stanton et al. (Eds.), Handbook of
Human Factors and Ergonomics Methods (pp. 33.1–33.7). CRC: London, UK.
Annett, J., Duncan, K. D., Stammers, R. B. and Gray, M. (1971). Task Analysis. Her Majesty’s
Stationery Office: London, UK.
Annett, J. and Stanton, N. A. (2000). Task Analysis. Taylor and Francis: London.
Baber, C. (2004). Personal communication.
132 Systems Thinking in Practice
Bell, H. H. and Lyon, D. R. (2000). Using observer ratings to assess situation awareness. In
M. R. Endsley (Ed.), Situation Awareness Analysis and Measurement (pp. 129–146).
Lawrence Erlbaum Associates : Mahwah, NJ.
Burke, S. C. (2005). Team task analysis. In N. A. Stanton et al. (Eds.), Handbook of Human
Factors and Ergonomics Methods (pp. 56.1–56.8). CRC: London, UK.
Collins, A. M. and Loftus, E. F. (1975). A spreading-activation theory of semantic processing.
Psychological Review, 82, 407–428.
Defence Technology Centre for Human Factors Integration (2003). Methodology for DTC
HFI WP1 Field Trials (Report: Draft 2.1.). Baber, C. & Stanton, N. A: London, UK.
Diaper, D. and Stanton, N. A. (2004). Handbook of Task Analysis in Human–Computer
Interaction. Lawrence Erlbaum Associates: Mahwah, NJ.
Driskell, J. E. and Mullen, B. (2005). Social network analysis. In N. A. Stanton et al.
(Eds.), Handbook of Human Factors and Ergonomics Methods (pp. 58.1–58.6). CRC:
London, UK.
Drury, C. G. (1990). Methods for direct observation of performance. In J. R. Wilson and E.
N. Corlett (Eds.), Evaluation of Human Work – A Practical Ergonomics Methodology
(pp. 45–68). Taylor and Francis: London, UK.
Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human
Factors, 37(1), 32–64.
Harris, C. J. and White, I. (1987). Advances in Command, Control & Communication
Systems. Peregrinus: London, UK.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P., Stewart, R. and
Walker, G. (2006). Command and control in emergency services operations: A social
network analysis. Ergonomics, 49 (12–13), 1204–1225.
Kieras, D. E. (2003). GOMS models and task analysis. In D. Diaper and N. A. Stanton (Eds.),
Handbook of Task Analysis in Human–Computer Interaction (pp. 83–116). Lawrence
Erlbaum Associates: Mahwah, NJ.
Kirwan, B. and Ainsworth, L. K. (1992). A Guide to Task Analysis. Taylor and Francis:
London, UK.
Klein, G. and Armstrong, A. A. (2005). Critical decision method. In N. A. Stanton et al.
(Eds.), Handbook of Human Factors and Ergonomics Methods (pp. 35.1–35.8). CRC:
London, UK.
Klein, G. A., Calderwood, R. and MacGregor, D. (1989). Critical decision method for eliciting
knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19(3), 462–472.
Ogden, G. C. (1987). Concept, knowledge and thought. Annual Review of Psychology, 38,
203–227.
O’Hare, D., Wiggins, M., Williams, A. and Wong, W. (2000). Cognitive task analysis for deci-
sion centred design and training. In J. Annett and N. A. Stanton (Eds.), Task Analysis
(pp. 170–190). Taylor and Francis: London, UK.
Quillian, R. (1969). The teachable language comprehender: A simulation program and theory
of language. Communications of the ACM, 12459–12476.
Rail Safety and Standards Board. (2003). Master Rule Book. Newark: Willsons.
Scott, J. (1991). Social Network Analysis: A Handbook. Sage: London, UK.
Smalley, J. (2003). Cognitive factors in the analysis, design, and assessment of command
and control systems. In E. Hollnagel (Ed.), Handbook of Cognitive Task Design (pp.
223–253). Lawrence Erlbaum Associates: Mahwah, NJ.
Stanton, N. A. (2004). The psychology of task analysis today. In D. Diaper and N. A. Stanton
(Eds.), Handbook of Task Analysis in Human–Computer Interaction (pp. 567–584).
Lawrence Erlbaum Associates: Mahwah, NJ.
Stanton, N. A., Baber, C. and Young, M. S. (2005). Observation. In N. A. Stanton et al.
(Eds.), Handbook of Human Factors and Ergonomics Methods (pp. 28.1–28.7). CRC:
London, UK.
EAST in Railway Maintenance 133
Stanton, N., Hedge, A., Brookhuis, K., Salas, E., and Hendrick, H. (2005). Handbook of
Human Factors and Ergonomics Methods. CRC: London, UK.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon,
P., Hoyle, G., Walker, G., Young, M. S., Linsell, M., Dymott, R. and Green, D. (2006).
Distributed situation awareness in dynamic systems: Theoretical development and
application of an ergonomics methodology. Ergonomics, 49(12–13), 1288–1311.
Watts, L. A., and Monk, A. F. (2000). Reasoning about tasks, activities and technology to
support collaboration. In J. Annett and N. Stanton (Eds.), Task Analysis (pp. 55–78).
Taylor and Francis: London, UK.
7 EAST at Road
Intersections
With Michael G. Lenné and J. Ashleigh Filtness
STATEMENT OF RELEVANCE
Intersection safety currently represents a key road safety issue worldwide. In line
with recent calls for a systems approach to road safety, this chapter presents a novel
application of a framework of ergonomics methods for studying intersection ‘system’
performance. The findings support development of interventions that consider all
road users as opposed to one group in isolation.
INTRODUCTION
Road transport–related trauma continues to be one of the leading causes of death
and disability throughout the world (World Health Organisation 2009). Although
significant reductions in injuries and fatalities have been made over the last four
decades in most motorised countries (Elvik 2010), a number of complex intractable
issues remain. One of these is collisions between different types of road users at
intersections. In Australia, for example, the majority of urban crashes and a substan-
tial proportion of rural crashes occur at intersections (McLean et al. 2010). Safety at
intersections, therefore, represents a key road safety issue.
The prevalent approach to understanding and preventing collisions at intersec-
tions has tended to be road user centric and component driven, focusing on specific
road user types (e.g. drivers) and/or fixing a component of the problem (e.g. making
motorcycles more conspicuous; Gershen and Shinar 2013). The fundamental limita-
tion of this reductionist approach is that there is a focus on only a component of the
problem (e.g. rider conspicuity). In recent times, researchers have made a strong case
for the ‘systems’ approach when considering road user behaviour and safety (e.g.
Larsson et al. 2010; Salmon et al. 2012). The systems approach has important impli-
cations for how safety outcomes are achieved. Are they achieved through focusing
on one component of the system in isolation (a reductionist approach) or can they,
instead, be achieved by looking at the wider interacting system of human and techni-
cal elements (a systems approach)? In other words, does safety arise from ‘adding’
together interventions performed on individual elements of the system, such as the
road environment and intersection infrastructure, training, road rules and regula-
tions, environmental conditions and individual road users, or does it multiply or
‘emerge’ from these interactions? If it does, then a focus on individual elements will
135
136 Systems Thinking in Practice
fail to capture important road safety interventions that could have disproportionately
large effects.
Unsurprisingly, the systems approach has long been discussed in the context of
road traffic crashes (e.g. Wagenaar and Reason 1990), but despite this, very few
studies go beyond a focus on just one component of the system. Previous studies of
road user behaviour at intersections have largely been road user centric, focusing
on individual road user factors such as driving errors (e.g. Gstalter and Fastenmeier
2010; Sanding 2009) and pedestrian behaviours (e.g. King et al. 2009). Moreover,
the majority of road safety research focusing on vulnerable road users, such as
cyclists and motorcyclists, has been undertaken from the perspective of drivers (e.g.
Hole and Tyrrell 1995; Schepers and Brinker 2011) or engineering (e.g. Highways
Agency 2012). The consequence is that other factors influencing behaviour are left
untouched and so diminish the effectiveness of the reductionist intervention (Salmon
et al. 2012). For this reason, the reductionist, component driven approach to road
safety has been criticised for failing to take into account the inherent complexity in
transportation systems (e.g. Larsson et al. 2010; Salmon et al. 2012). This article is a
response to this criticism.
This article argues that the long-standing problem of collisions between distinct
road users at intersections cannot be solved through a reductionist approach that
does not consider the overall sociotechnical intersection system. That is, consid-
eration of individual road user behaviours in isolation, whilst yielding important
information, will not necessarily lead to appropriate interventions that support the
behaviour of all road users. This creates a challenging methodological problem.
Existing approaches for studying road user behaviour, such as simulation (e.g. de
Winter et al. 2009), microsimulation (e.g. Bell et al. 2012) and questionnaires (e.g.
Reason et al. 1990) typically focus on one component only (e.g. ‘driving’ simula-
tors, ‘driver’ behaviour questionnaire). To go beyond mere lip service to the ‘sys-
tems approach’ requires new approaches that embed individual road users within a
wider joint cognitive system.
The analysis presented in this chapter moves towards systems analyses in road
transport by considering the intersection ‘system’, comprising different road users
(e.g. drivers, riders, cyclists and pedestrians), vehicles and the road environment.
Using data derived from a recent on-road study, the Event Analysis of Systemic
Teamwork framework (EAST) (Stanton et al. 2013; Walker et al. 2006, 2010) was
used to evaluate behaviour at three major signalised intersections. The aims were to
examine the differences in behaviour of different road users within the intersection
system, to identify the factors underpinning conflicts between distinct road users at
intersections and to inform the development of new more holistic intersection inter-
ventions that are appropriate for all road users.
The data were derived from an on-road study that covered a pre-defined 15km
urban route in the south-east suburbs of Melbourne, Australia. The analysis focused
on three major signalised intersections located along the route (see Figure 7.1). Each
intersection required a right-hand turn in order to pass through the intersection and
remain on the study route.
FIGURE 7.1 The three intersections studied (white arrow denotes route though intersection).
138 Systems Thinking in Practice
METHODOLOGY
Design
The work reported in this chapter is based around an on-road study investigating
the influence of road design on the behaviour of different types of road user. The
study used a semi-naturalistic paradigm whereby participants drove an instrumented
vehicle around a pre-defined urban route. Drivers drove an instrumented test vehicle,
whilst motorcyclists and cyclists completed the route using their own motorcycle or
bicycle, which was equipped with video and audio recording equipment. Pedestrians
negotiated the three intersections on foot whilst wearing video recording glasses
and a microphone connected to a Dictaphone. All participants provided concurrent
verbal (think aloud) protocols as they negotiated the route.
Participants
Seventy-eight participants (52 male, 26 female) aged 21−64 years (mean = 35.81, SD
= 13.03) took part in the study. The sample comprised 20 car drivers, 18 motorcy-
clists, 20 cyclists and 20 pedestrians. An overview of the participants in each group
is presented in Table 7.1.
All participants were recruited through a weekly on-line university newsletter
and were compensated for their time. Prior to commencing the study, ethics approval
was formally granted by the Monash Human Ethics Committee.
Materials
A demographic questionnaire was completed using pen and paper. A desktop driving
simulator was used to provide verbal protocol training. A 15 km urban route, located
in the south-eastern suburbs of Melbourne, was used for the on-road study component.
Drivers drove the route in a 2004 Holden Calais sedan equipped to collect various vehi-
cle, driving scene and driver-related data. A Dictaphone was used to record participant’s
TABLE 7.1
Participant Demographics
verbal protocols. Each motorcyclist participant’s motorcycle was fitted with an Oregon
Scientific ATC9K portable camera, which, depending on the motorcycle model, was
fixed either to the handlebars or front headlight assembly. The ATC9K camera records
the visual scene, speed and distance travelled. A microphone was fitted inside each
motorcyclist participant’s helmet and attached to the Dictaphone to record their verbal
protocols. For cyclist participants, the ATC9K portable camera was fitted to their hel-
met and they wore Imging HD video cycling glasses. Pedestrians negotiated the inter-
sections on foot whilst wearing Imging HD video sunglasses and a microphone linked
to a Dictaphone. Motorcyclist, cyclist and pedestrian participants also carried a Garmin
GPS unit to record aspects such as speed, distance travelled, route taken and so on.
All verbal protocols were transcribed using Microsoft Word. During data analysis, the
Leximancer TM content analysis software was used to construct knowledge networks.
Procedure
Individual participants negotiated the intersections on separate occasions. In order
to control for traffic conditions, all trials took place at the same pre-defined times on
weekdays (10 am or 2 pm Monday to Friday). Participants first completed an informed
consent form and demographic questionnaire and were then briefed on the research
and its aims (expressed generally as a study of driver behaviour). Following this,
they were given training in providing verbal protocols, which included instruction
from an experimenter followed by a desktop driving simulator task where they were
asked to complete the drive whilst providing a verbal protocol. The experimenter
monitored the drive and provided feedback to the participant regarding the quality
of their verbal protocol. Participants were then shown the study route and were given
time to memorise it. When comfortable with the verbal protocol technique and route,
participants were taken to their vehicle and asked to prepare themselves for the test.
They were then given a demonstration of the video and audio recording equipment,
which was also set to record at this point. Following this, the experimenter instructed
the participant to begin the study route. For the drivers, an experimenter was located
in the vehicle and provided route directions if necessary. For the motorcyclists and
cyclists, an experimenter followed behind (in a car for the motorcyclists, on a bicycle
for the cyclists), ready to intervene if the participants strayed off route. Pedestrians
were taken by car to the first intersection and instructed to negotiate the intersection
and walk to a set point following the intersection. Once the participant reached this
point, they were picked up by the experimenter and driven to the next intersection.
This process was repeated until all three intersections had been negotiated.
Participants’ verbal protocols were transcribed verbatim using Microsoft Word.
For data reduction purposes, extracts of each verbal transcript for each intersection
were taken from the overall transcripts. The extracts were taken based on the video
data and pre-defined points in the road environment (e.g. beginning and end of inter-
section). The three network representations were constructed as follows:
Each form of network was analysed using selected network metrics that have pre-
viously been used in EAST analyses. Although predominately used for the analyses
of social networks, Stanton (2014) demonstrated the utility of applying selected net-
work analysis metrics to the task, social and situation awareness networks generated
through EAST analyses. In the present study, the following network analysis metrics
were applied to each network:
nodes with sociometric status values greater than the mean sociometric sta-
tus value plus one standard deviation are taken to be ‘key’ (i.e. most con-
nected) nodes within each network.
RESULTS
Task Networks
The ‘negotiate intersection’ task networks provide a summary of the main goals and
tasks involved in negotiating signalised intersections for each road user group. The
task networks for each road user group are presented in Figures 7.2 through 7.5.
The task networks highlight the differences, in terms of goals and tasks per-
formed, between the four road user groups when negotiating intersections. As shown
in Figures 7.2 through 7.5, when negotiating intersections, the goals and subsequent
tasks are markedly different across the four road user groups studied. The only task
common across the four road user groups is that of ‘maintaining situation aware-
ness’, and this task in itself entails maintaining awareness of different aspects of
the intersection depending on road user type (e.g. cyclists and motorcyclists require
awareness of debris on the road, whereas drivers do not).
One key issue highlighted by the task networks is the differences in the level of
flexibility afforded to each road user by the intersections studied. Cyclists have a sig-
nificant level of flexibility in that they can proceed through the intersection in a vari-
ety of different ways. Depending on traffic conditions and perceived level of risk, they
can either turn right on the road within the flow of traffic, turn right via the pedestrian
crossings and along the footpath or turn right using a ‘hook’ turn, whereby they pro-
ceed straight on through the intersection, join the traffic queue to the left-hand side
Approach intersection
Check intersection
and traffic and
Maintain Filter to Take place in
determine
situation front of traffic queue Maintain
route through
awareness traffic queue (in appropriate Make self safe
intersection
Operate (e.g. other (in appropriate lane) visible to position on
(e.g. right/ lane)
bicycle traffic, own other road road and
left lane, hook turn,
position, Get onto users avoid surface
service lane, use
lights, road footpath obstacles
pedestrian crossings)
surface) and
cross using
pedestrian
Stop and wait for green light crossings
and then wait for a green light and proceed straight through the intersection (achiev-
ing the originally desired right-hand turn). This flexibility is also not restricted to a
certain point within the intersection; cyclists can change their route through at any
point prior to the intersection and even when passing through the intersection. For
pedestrians, a degree of flexibility is extant through the ability to either cross via the
pedestrian crossing or the road itself. Motorcyclists’ behaviour is more restricted;
however, they still have some flexibility in that they can choose to use the stay in the
normal traffic queue or to filter up between the traffic to the front of the queue. Of the
four road user groups, drivers are the most restricted in terms of behaviour since they
can only select one of two turning lanes and progress through the intersection.
Other important differences across the task networks are present. These include
the task of filtering up through the traffic queue undertaken by both cyclists and
motorcyclists in pursuit of the goal to get to the front of the traffic queue, the
Maintain
situation
Walk/stop/ Wait for green man
awareness
stand
(e.g. traffic,
lights)
TABLE 7.2
Task Network Analysis
Social Networks
The social networks depict each road user group’s interaction with the intersections
studied. For example, the social networks for each road user group at Intersection 1
are presented in Figure 7.6. This shows the total number of interactions with differ-
ent parts of the intersection for each road user group. The thickness of the arrows
represents the frequency of interactions, with the thicker arrows representing a
higher frequency across each road user group.
The social network analyses highlight the fact that intersections are characteristic
of joint cognitive, or distributed cognition, systems. The networks show a high inter-
action between human and non-human agents and also the key role of non-human
agents within the right turn at intersection task. For each form of road user, the
turn right task involves multiple non-human agents, such as the traffic lights, road
and road markings, other vehicles and road signage. The importance of this finding
is that compatibility between human and non-human agents is known to be a key
element of efficient distributed cognition system performance (Salmon et al. 2008;
Stanton et al. 2006; Walker et al. 2010).
Density was calculated for each network, and the sociometric status metric was
used to identify the most connected nodes within each network (outside of the road
users themselves). These network analysis results are presented in Table 7.3.
Table 7.3 demonstrates that the pedestrians were the most connected in terms of
their interactions with the intersection environments. They interacted with the great-
est number of intersection components (e.g. lights, button, traffic), had the highest
number of interactions and achieved the highest sociometric status values across all
three intersections. The drivers, on the other hand, were the least connected of the
four groups, with smaller networks, the lowest number of interactions and the small-
est sociometric status values across the three intersections.
EAST at Road Intersections 145
On- Traffic
coming lights
traffic On- Traffic
coming
traffic lights
Ped Road
26 name
44 crossing (straight
ahead) 21
Traffic
Traffic Lane Parked cars
Speed 2 82 (service
1 lane)
limit 11 Service
4 Road 9 signage Traffic lane
5 lights 2
surface Road 17
2 surface
Traffic 1 Green/ P.
Traffic
lights in Red man Traffic Highway
7 front 9 in
6 front 9
Left turn 11 Ped
arrow crossing Turning
1
4 21 traffic
Pedes- 2
trians Driver 1
Camera
6 Footpath
4
Cyclist
Pedes- 2
6 trians
14
Traffic
behind Traffic
behind
Traffic
On- Traffic
coming lights
traffic
Lights
Traffic 15 Footpath
Parked
180
56 cars 133
Traffic 12 Speed 11
lights 1 limit Bin Road
Road signage
3 surface 2
3
P. Driveway 29 Crossing
Traffic Highway
9 in 8 10
6 front 1
Service
Ped lane
Pedestrian Button
crossing 12 15
2 17
1
Police
Cars
4 P.
Signage 1
(driveway) Highway
Rider 1 Camera
1 4 1 Horizon
10 1 Island Camera
Pedes- Cyclist
trians 10 19 2
1
Peds 2 Gardener
Road
2
Traffic surface
behind Shops
Caryard
The social networks also reveal important differences in how the different road
user groups interact with intersection systems. Again, differences across the four
road user groups are apparent. The networks show that the drivers also interacted
less with certain parts of the intersection than did the other road users. For example,
across the three intersections, the most frequent interaction for drivers was observing
the oncoming traffic, traffic lights ahead and the traffic in front. Although cyclists
and motorcyclists had frequent interactions with these parts of the intersections, they
tended to have more interactions with these components, and other interactions were
also prominent, such as checking for traffic behind and observing the traffic gener-
ally (i.e. travelling across the intersection). The low number of driver interactions
focusing on the traffic generally, the traffic behind and adjacent traffic is a concern,
particularly when coupled with the task network finding that the other road user
groups may be unpredictable in and around the intersection.
The other road user groups also had interactions not found in the driver group.
Unsurprisingly, pedestrians had various interactions related to the activity of inter-
acting with the pedestrian crossing infrastructure, such as pressing the ‘button’.
146 Systems Thinking in Practice
TABLE 7.3
Summary of Social Network Analysis for Each Intersection
Number Sociometric
Road User of Number of Status of Nodes with Highest
Group Nodes Interactions Density Road User Sociometric Status Values
Intersection 1
Drivers 12 116 0.083 11.09 Lights, Oncoming traffic,
Traffic (In front), Lane,
Pedestrians, Traffic
(Behind)
Cyclists 13 204 0.08 17.17 Lights, Oncoming traffic,
Traffic (In front), Service
lane, Traffic (Behind)
Motorcyclists 14 208 0.07 11.31 Lights, Traffic (In front),
Oncoming traffic, Traffic
(General), Traffic (Behind),
Pedestrians, Parked cars,
Road, Camera, Cyclist
Pedestrians 20 423 0.05 22.78 Traffic, Lights, Road,
Pedestrians, Service lane
Intersection 2
Drivers 10 127 0.1 14.11 Lights, Traffic (In front),
Traffic (General), Traffic
(Behind), Sign
Cyclists 20 208 0.05 10.95 Lights, Traffic (General),
Service lane, Traffic (In
front), Road
Motorcyclists 13 116 0.08 9.66 Lights, Traffic (In front),
Road, Traffic (General),
Traffic (Behind)
Pedestrians 28 388 0.036 14.37 Traffic (General), Lights,
Road, Intersection, Button
Intersection 3
Drivers 14 152 0.071 11.69 Lights, Traffic (General),
Traffic (In front),
Intersection, Lane
Cyclists 20 243 0.05 12.78 Lights, Traffic (General),
Traffic (Behind), Lane,
Traffic (In front)
Motorcyclists 18 113 0.053 6.28 Lights, Traffic (General),
Lane, Road, Intersection
Pedestrians 30 767 0.033 26.44 Traffic (General), Lights,
Road, Pedestrians,
Intersection
EAST at Road Intersections 147
Interestingly, cyclists also had a number of interactions with the footpath and pedes-
trian crossing infrastructure, which reflects the decision by selected cycling par-
ticipants to cross the intersection using the footpath and pedestrian crossing. Other
notable interactions specific to road user groups were motorcyclists and cyclists
checking the ‘road surface’ for debris and oil, cyclists and motorcyclists monitoring
traffic adjacent to them, motorcyclists checking the traffic lights facing other traffic
(to work out when other traffic would be stopping and going) and cyclists monitoring
pedestrian behaviours in and around the intersection.
Checking
Orange
Lane
Service
Busy
Moment
Hand
Round Middle
Fairly
Car
Road
Looking Walking
I’ll
Check Able
Turning
Intersec on
Walk
Looks
Cross
Princes Safe
highway
Cars
Coming Stopping Proceed
Truck Sure
Traffic
Red
Front
Change Light Arrow
Man
Crossing Lights
Pedestrian
Slowly Wait
Amber
Behind
Straight
Oncoming
Wai ng
Stay Ahead
People
FIGURE 7.7 Intersection 1 situation awareness network showing driver, cyclist, motorcy-
clist and pedestrian situation awareness networks mapped onto each other.
concepts now include distinct areas around the car, such as ‘front’ and ‘behind’, and
also the ‘lanes’. The cyclists’ key concepts also include ‘ahead’ and ‘behind’, ‘wait’
and ‘crossing’. The motorcyclists’ key concepts relate to the lights (i.e. green) and
the ‘lane’ within which to progress through the intersection. Finally, the pedestrians
have a larger set of key concepts at Intersection 3, with key concepts covering the
EAST at Road Intersections 149
TABLE 7.4
Summary of Situation Awareness Network Analysis for Each Intersection
Mean
Road User Number of Sociometric
Group Concepts Density Status Key Concepts
Intersection 1
Drivers 26 0.075 0.151 Green, Oncoming, Traffic
Cyclists 28 0.061 0.122 Coming, Cars, Intersection, Red, Traffic
Motorcyclists 28 0.066 0.132 Lane, Traffic, Cars, Arrow
Pedestrians 29 0.069 0.138 Green, Red
Intersection 2
Drivers 27 0.074 0.148 Lights, Light, Lane
Cyclists 29 0.069 0.138 Cars, Green, Road, Take, Service, Lane,
Turning
Motorcyclists 28 0.071 0.143 Looking, Behind, Green, Cars, Turning,
Lane
Pedestrians 31 0.064 0.129 Lights, Light, Green, Turning, Coming,
Road, Crossing
Intersection 3
Drivers 27 0.074 0.148 Front, Red, Dandenong road, Making,
Behind, Lanes
Cyclists 28 0.071 0.143 Turning, Stay, Behind, Ahead, Wait, Lane,
Lights, Crossing
Motorcyclists 26 0.075 0.151 Green, Lane
Pedestrians 34 0.055 0.110 Road, Cars, Coming, Cross, Wait, Traffic,
Lights, Green, Red, Light,
‘road’, the traffic and its behaviour (e.g. ‘cars’, ‘traffic’, ‘coming’) and the lights and
their status.
The differences in the situation awareness networks were explored further by
examining the ‘common’ concepts (i.e. those found in all road user groups’ situation
awareness networks) along with the concepts unique to each road user group at each
intersection (See Figure 7.8). Figure 7.8 shows that the concepts common across all
four road user groups at the three intersections were mainly related to the cars, traf-
fic, the road, the lights and their status (e.g. green), the intersection and the act of
turning. This reflects a high focus of all road users on cars, the traffic lights and the
intersection environment itself.
Important differences in situation awareness concepts are shown in Figure 7.8.
At Intersections 1 and 2, the cyclist networks include the concepts ‘service’, ‘stay’
and ‘route’, all of which reflect the key decision that they face regarding whether
or not to use the service lane on approach to the intersection and then cross via
the footpath and pedestrian crossing, or to stay on the road and go through the
intersection with the normal traffic flow. Moreover, prior to the intersection,
150 Systems Thinking in Practice
Intersection 1
Common across all road Unique to Unique to Unique to
Unique to pedestrians
user groups drivers cyclists motorcyclists
Walk/ Check/
Car(s) Road Safe Service Stopping
Walking Checking
Cross/
Intersection Traffic Slowly Moment Man
Crossing
Wait/
Coming Stay Round Able Straight
Waiting
Intersection 2
Common across all road Unique to Unique to Unique to
Unique to pedestrians
user groups drivers cyclists motorcyclists
Lane/
Car(s) Pull Service Hand Turned Anyway
Lanes
Route
Intersection 3
Common across all road Unique to Unique to Unique to
Unique to pedestrians
user groups drivers cyclists motorcyclists
Change/ Walk/
Car(s) Coming Hook I’ll Middle
Changing Walking
Check/
Light(s) Green Right hand Doing Hand Able
Checking
Look/
Turning Making Gear Button
Looking
Route Assume
Stopping
FIGURE 7.8 Common and unique concepts across road user groups at each intersection.
the cyclists also decide whether they will leave the road and get back into the
service lane once they have passed through the intersection. At Intersection 3,
the cyclists’ network included the ‘hook’ concept, which refers to their decision
regarding whether or not to use a hook turn in order to turn right at the intersec-
tion. Again, this reflects a key decision whereby cyclists try to work out whether
it is safe enough to pass through the intersection on the road within the flow of
traffic or whether they need to perform a hook turn to avoid conflict with other
traffic also turning right.
EAST at Road Intersections 151
For the motorcyclists, the unique concepts relate primarily to the selection of the
left or right-hand lane to negotiate the intersection (e.g. ‘hand’, ‘left hand’, ‘merg-
ing’), the motorcycle itself (e.g. ‘bike’, ‘gear’) and the ‘line’ that they should take
through the intersection. The ‘stopping’ concept refers not only to motorcyclists’
own braking behaviour but also to them checking that other traffic approaching from
behind is stopping when the traffic lights are on red. For the pedestrians, the unique
concepts were primarily related to the physical acts of walking (e.g. ‘walk/walking’)
and crossing the road (e.g. ‘cross/crossing’) and also the crossing infrastructure (e.g.
‘button’, ‘green man’). Interestingly, only the pedestrian networks included the con-
cepts ‘check/checking’ and ‘look/looking’, which indicate that the other road users
placed less emphasis on checking other traffic and the road environment when nego-
tiating the intersections.
DISCUSSION
The aim of this article was to demonstrate how systems analysis methods such EAST
can be used to better understand the complex behaviour of intersection systems. In
doing so, we wished to examine the differences in behaviour across distinct road
users and to identify factors that potentially create conflicts between them. The study
aimed to demonstrate that the EAST method provides a means to reduce complex-
ity, identify specific issues limiting performance and highlight areas where system
redesign could be beneficial.
Reducing Complexity
The analysis demonstrates that, even when faced with the same intersection and right-
hand turn task, the goals and tasks, interactions and knowledge used by distinct road
users is different. This might not be particularly ground-breaking; however, identi-
fying a structured methodology and associated metrics that are capable of revealing
these differences using on-road, real-world data is a substantive contribution to the
current state of the art. Further, the framework moves towards the much-heralded use
of systems analysis techniques rather than reductionist, individual road user techniques
for road transport analyses. Notably, although a systems approach has been called for
by many (e.g. Larsson et al. 2010), to date there has been a dearth of appropriate meth-
ods proposed for supporting systems analyses in road transport (Salmon et al. 2012).
The EAST analysis also confirms the notion that road transport environments
represent joint cognitive systems in which cognition is distributed across both human
and non-human agents and is achieved through coordination between agents. This
not only confirms the requirement for systems analysis techniques in road transport
applications but also highlights the pressing need for studies of distributed cognition
in the road transport context. In addition, this suggests that a distributed situation
awareness approach (e.g. Salmon et al. 2008) in which the distribution of awareness
across the intersection system is focused on, rather than the awareness of one road
user group alone (e.g. drivers in motorcycle conspicuity studies), is required. Given
the rapid advances in the capability of in-vehicle and roadside technologies and
their likely increased role in road systems (e.g. intelligent infrastructure, car-to-car
152 Systems Thinking in Practice
Performance Limitations
If tasks, interactions and knowledge are different across road users, and inter-
sections are joint cognitive systems, then the key to intersection safety is ensur-
ing that the differences are compatible and that road user activities and cognition
connect together. This raises two lines of inquiry for the present study findings.
First, do the differences revealed by EAST create conflicts between road users,
or are they compatible? And second, does intersection system design (e.g. road
environment design, training, road rules and regulations) support these differences
in a way that ensures compatibility between distinct road users? It is in synthesis-
ing the tripartite EAST perspective to answer these questions that the framework
becomes most powerful. Unfortunately, examination of the networks produced
indicates a level of disharmony that suggests compatibility is under threat in some
instances; in some circumstances, intersections may behave more like disjoint cog-
nitive systems. For example, the networks demonstrate that the limited latitude for
behaviour for drivers at intersections is in fact in conflict with the highly flexible
and thus unpredictable behaviour of cyclists, motorcyclists and pedestrians. Here,
flexibility, an often-sought-for characteristic in complex sociotechnical systems,
coupled with poor intersection design, is creating collisions between distinct road
users at intersections.
In the case of cyclists, for example, the combined networks clearly demon-
strate their high level of flexibility since they can proceed through the intersec-
tion in multiple ways (i.e. hook turn, in normal flow of traffic, filtering, on the
footpath and via pedestrian crossings). The networks also show that the result of
this is that cyclists’ behaviour and situation awareness are focused on working out
which way through is appropriate, and that their behaviour is generally unpre-
dictable since their chosen route through can change on a moment-by-moment
basis. Examination of the driver social and situation awareness networks, however,
shows that they may not be expecting cyclists, and indeed motorcyclists, to make
major manoeuvres in close proximity to the intersection. Consequently, they do
not behave or think in a manner that is compatible with other cyclists and motor-
cyclists. The driver situation awareness networks embodied a high focus on cars,
the traffic lights and the act of turning right and an absence of ‘check/checking’,
‘look/looking’, and left- or right-‘hand’ side concepts. The driver social networks
showed a limited interaction in which the oncoming traffic, traffic lights and traf-
fic directly in front of the vehicle represent the majority of their interaction with
the intersection system. Drivers also had only limited interactions with the areas
adjacent to and behind their own vehicle.
This ‘flexibility problem’, as we will call it, is likely brought about by the fact
that it represents flexibility not designed into the system per se but flexibility
derived from emergence. For example, cyclists’ range of possible behaviours at
intersections is brought about by the lack of support for, and high risk associated
with, turning right in the normal flow of traffic. Working within the constraints of
EAST at Road Intersections 153
intersection systems, cyclists and motorcyclists have come up with new ways of
taking a safer path through the intersection. The design of the three intersections
is therefore both creating this flexibility and then limiting compatibility between
the cyclist and the driver. There is currently no signage warning drivers of the pres-
ence of cyclists or motorcyclists or the likelihood that they will be manoeuvring
in and around the intersection. Also, where present, the cycling lanes preceding
the intersections end a significant distance before the intersection itself, and there
are no dedicated cycle or motorcycle lanes proceeding through the intersections.
In addition, the road rules prohibit cyclists from cycling on footpaths and motor-
cyclists from filtering up the traffic queue. The effect of this is that drivers and
pedestrians have limited experience of the prohibited behaviours and often may
not be expecting them.
System Redesign
One of the aims of the analysis presented was to identify opportunities to create
interventions designed to support safer interactions between distinct road users at
intersections. The findings suggest that there are various avenues that can be pur-
sued; however, the key is that all road users and non-human agents be considered,
as opposed to one group in isolation. Intersection design should strive to create joint
cognitive intersection systems.
To solve the flexibility problem, it would appear that the key is not only to ensure
that different road users have some degree of flexibility, but also to ensure that the
way in which the intersection is designed supports this flexibility and ensures that
the resulting behaviours are compatible. For example, it is appropriate to maintain
the level of flexibility for cyclists; however, other measures should be taken to sup-
port it. For example, avenues for making other road users (pedestrians, drivers) more
expectant of cyclists and their range of behaviours will be fruitful. The use of cross-
mode training has previously been raised as a way of developing anticipatory schema
that support perception of other distinct road users (e.g. Magazzu et al. 2006; Walker
et al. 2011). Cross-mode training incorporating both cyclist and motorcyclist training
for drivers is likely to increase their expectancy levels regarding cyclist and motor-
cyclist behaviours at intersections. There is also a clear role for road design, with
dedicated cycling lanes (on the road and on the footpath) and signage warning drivers
of the presence of cyclists and the likelihood that they will make major manoeuvres
in close proximity to the intersection.
As an exploratory study, this research did have some limitations. First, road
users negotiated the same intersections under similar traffic conditions but not at the
same time as one another (i.e. they were not negotiating the intersections together
at the same time). Analysis of intersection system performance when road users
are interacting together at the same intersection at the same time would provide
more valid data on the potential conflicts between them. Second, the social networks
were based on verbal protocols describing interactions rather than eye-tracking data
showing actual interactions with objects in the road environment. Future studies in
which eye-tracking data are used to construct the social networks are planned by
these authors.
154 Systems Thinking in Practice
CONCLUSION
It is concluded that systems analysis methods, such as EAST, provide a useful avenue
for understanding and eradicating road safety issues. From the analysis presented,
it is concluded that there was a significant level of disharmony in the intersections
studied. Although intersections are characteristic of joint cognitive systems, the
intersections studied often behaved like disjointed cognitive systems. Differences
were found in the way in which components (or road users) act, think and interact
with the environment; however, it appears that intersections are designed from the
viewpoint that all road users need to act and think in the same manner. Moreover, the
analysis suggests that the way in which the intersections are currently designed may
be restricting compatibility between different road user groups. It is argued that a
failure to consider the overall intersection system during intersection design, includ-
ing distinct road users’ physical and cognitive behaviours and their differences, is
facilitating the problem of intersection collisions. Moreover, a failure to consider
these differences in future will render intersection collisions an intractable problem.
Only a systems-based approach will be able to make substantive and sustainable
inroads into accident reduction.
REFERENCES
Bell, M. C., Galatioto, F., Giuffrè, T. and Tesoriere, G. (2012). Novel application of red-light
runner proneness theory within traffic microsimulation to an actual signal junction.
Accident Analysis and Prevention, 46, 26–36.
Cornelissen, M., Salmon, P. M., McClure, R. and Stanton, N. A. (2013). Using Cognitive
Work Analysis and the Strategies Analysis Diagram to understand variability in road
user behaviour at intersections. Ergonomics, 56 (5), 764–780.
de Winter, J. C. F., de Groot, S., Mulder, M., Wieringa, P. A., Dankelman, J. and Mulder, J. A.
(2009). Relationships between driving simulator performance and driving test results.
Ergonomics, 52 (2), 137–153.
Elvik, R. (2010). Why some road safety problems are more difficult to solve than others.
Accident Analysis and Prevention, 42, 1089–1096.
Farrington-Darby, T., Wilson, J. R., Norris, B. J. and Clarke, T. (2006). A naturalistic study
of railway controllers. Ergonomics, 49, 1370–1394.
Furniss, D. and Blandford, A. (2006). Understanding emergency medical dispatch in terms of
distributed cognition: A case study. Ergonomics 49 (12–13), 1174–1203.
Gershon, P. and Shinar, D. (2013). Increasing motorcycles’ attention and search conspicu-
ity by using Alternating-Blinking Lights System (ABLS). Accident Analysis and
Prevention, 50, 801–810.
Gstalter, H. and Fastenmeier, W. (2010). Reliability of drivers in urban intersections. Accident
Analysis and Prevention, 42 (1), 225–234.
Highways Agency (2012). Design Manual for Roads and Bridges. Highways Agency: London,
UK.
Hole, G. J. and Tyrrell, L. (1995). The influence of perceptual ‘set’ on the detection of motor-
cyclists using daytime headlights. Ergonomics, 38 (7), 1326–1341.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P. M., Stewart, R. and
Walker, G. H. (2006). Command and control in emergency services operations: A
social network analysis. Ergonomics, 49, 1204–1225.
EAST at Road Intersections 155
King, M. J., Soole, D. and Ghafourian, A. (2009). Illegal pedestrian crossing at signalised
intersections: Incidence and relative risk. Accident Analysis & Prevention, 41 (3),
485–490.
Larsson, P., Dekker, S. W. A. and Tingvall, C. (2010). The need for a systems theory approach
to road safety. Safety Science, 48 (9), 1167–1174.
Magazzu, D., Comelli, M., and Marinoni, A. (2006). “Are Car Drivers Holding A Motorcycle
License Less Responsible for Motorcycle–Car Crash Occurrence? A Non-Parametric
Approach.” Accident Analysis & Prevention 38 (2): 365–370.
McLean, J., Croft, P., Elazar, N. and Roper, P. (2010). Safe Intersection Approach Treatments
and Safer Speeds Through Intersections: Final Report, Phase 1, AP–R363/10.
Austroads: Sydney, Australia.
Reason, J., Manstead, A., Stradling, S., Baxter, J. and Campbell, K. (1990). Errors and viola-
tions on the roads: a real distinction?. Ergonomics, 33, 1315–1332.
Salmon, P. M., McClure, R. and Stanton, N. A. (2012). Road transport in drift? Applying con-
temporary systems thinking to road safety. Safety Science, 50 (9), 1829–1838.
Salmon, P. M. Young, K. L. and Cornelissen, M. (2013). Compatible cognition amongst road
users: The compatibility of driver, motorcyclist, and cyclist situation awareness. Safety
Science, 56, 6–17.
Salmon, P. M., Stanton, N. A., Walker, G. H., Jenkins, D. P., Baber, C. and McMaster, R.
(2008). Representing situation awareness in collaborative systems: A case study in the
energy distribution domain. Ergonomics, 51 (3), 367–384.
Sandin, J. (2009). An analysis of common patterns in aggregated causation charts from inter-
section crashes. Accident Analysis & Prevention, 41 (3), 624–632.
Sanderson, P., Verhage, A. G. and Flud, R. B. (1989). State-space and verbal protocol methods
for studying the human operator in process control. Ergonomics, 32 (11), 1343–1372.
Scheper, P. A. and den Brinker, B. B. (2011). What do cyclists need to see to avoid single-
bicycle crashes? Ergonomics, 54 (4), 315–327.
Stanton, N. A. (2014). Representing distributed cognition in complex systems: How a subma-
rine returns to periscope depth. Ergonomics, 57:3, 403–418.
Stanton, N. A., Salmon, P. M., Rafferty, L., Walker, G., Baber, C., and Jenkins, D. P. (2013).
Human Factors Methods: A Practical Guide for Engineering and Design. Second
Edition. Ashgate: Aldershot, UK.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon,
et al. (2006). Distributed situation awareness in dynamic systems: theoretical develop-
ment and application of an ergonomics methodology. Ergonomics, Vol. 49, pp. 221–229.
Stewart, R. J., Stanton, N. A., Harris, D., Baber, C., Salmon, P. M., Mock, M., Tatlock, K.,
Wells, L., and Kay, A. (2008). Distributed situational awareness in an airborne warn-
ing and control aircraft: Application of a novel ergonomics methodology. Cognition,
Technology and Work, 10 (3), 221–229.
Wagenaar, W. A. and Reason, J. T. (1990). Types and tokens in road accident causation.
Ergonomics, 33 (10–11), 1365–1375.
Walker, G. H., Stanton, N. A. and Salmon, P. M. (2011). Cognitive compatibility of motorcy-
clists and car drivers. Accident Analysis & Prevention, 43 (3), 878–888.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. M., and Green, D. (2006).
Event analysis of systemic teamwork (EAST): A novel integration of ergonomics meth-
ods to analyse C4i activity. Ergonomics, 49, 1345–1369.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Jenkins, D. P. and Salmon, P. M. (2010).
From Ethnography to the EAST method: A tractable approach for representing distrib-
uted cognition in air traffic control. Ergonomics, 53 (2), 184–197.
World Health Organisation (2009). Global status report on road safety: Time for action.
World Health Organization: Geneva, Switzerland. Available at: www.who.int/
violence_injury_prevention/road_safety_status/2009.
8 EAST in Elite Women’s
Cycling Teams
With Clare Dallat and Amanda Clacy
INTRODUCTION
Situation awareness remains one the most ubiquitous of all ergonomics concepts,
with applications in an ever-expanding list of domains (Stanton et al. 2015). One area
in particular that has been receiving increasing attention is elite sport, with recent
studies considering situation awareness among Australian Rules Football umpires
(Neville et al. 2016), handball teams (De Keukelaere et al. 2013) and elite ham-
mer-throwing and rowing athletes and coaches (Macquet and Stanton 2013). Whilst
applications have included testing of theory and methods, the primary function has
been to inform the development of coaching strategies and interventions designed to
optimize performance (e.g. Macquet and Stanton 2014).
Despite exhibiting many features that are characteristic of the domains in which
ergonomics practitioners work, elite cycling has not yet been studied from this per-
spective. One interesting feature is the critical role that situation awareness appar-
ently plays at the individual rider level, at the cycling team level and at the overall
cycling system level. To date, however, the focus of research in elite cycling has
largely been on the development of quantitative models to describe the behaviour of
cycling pelotons (e.g. Trenchard 2015; Trenchard et al. 2014). What rider, team and
system situation awareness comprises, and how it can be optimised, remained unex-
plored. Such knowledge could potentially provide teams with a performance edge.
Much has been written about the contention surrounding situation awareness and
the appropriate theoretical and methodological approach to adopt in ergonomics
studies (see Salmon et al. 2008 and Stanton et al. 2017). In a recent review of situation
awareness models and their utility for studying and optimising elite sport systems,
Neville and Salmon (2016) identified Stanton et al.’s Distributed Situation Awareness
(DSA) model as highly suitable for sporting applications. Prior to this, Salmon et al.
(2010) had noted that the Event Analysis of Systemic Teamwork (EAST) framework
offers a powerful framework for understanding elite sports systems. Salmon et al.
(2010) concluded from test applications that the EAST framework was highly suited
to describing and analysing sports system performance and to supporting the devel-
opment of interventions designed to improve sports performance.
This chapter brings together both of these arguments, presenting an EAST analy-
sis of DSA and teamwork in an elite women’s cycling team during two road race
stages. The study was exploratory in nature and aimed to describe and understand
DSA and teamwork to assist the team in optimising performance in future events.
157
158 Systems Thinking in Practice
A secondary aim of the analysis was to further examine the utility of applying both
DSA and EAST in elite sports. In presenting this study here, the intention is to
encourage further applications of EAST in the sporting context.
Elite Women’s Cycling
The analysis presented in this chapter focuses on two elite women’s road races under-
taken as part of the 2016 Australian Subaru National Road Series (NRS). NRS road
races typically range in length from 50 kilometres (km) to 130 km and involve teams
of four to five riders. Each team has a so-called ‘protected’ or ‘general classification’
(selected based on overall NRS points standing), with the remaining riders acting in
a ‘domestique’* or support capacity.
The team’s goal is to ensure that their protected rider finishes each stage of the
race in the best position and time possible. Accordingly, the domestiques employ
various tactics to assist their protected rider, such as allowing the protected rider
to ride behind them (‘on their wheel’) to reduce their physical workload or ‘leading
them out’ to initiate a sprint finish.
The riders from each team form a peloton of cyclists that negotiate the race route
together. The peloton has been formally defined as ‘a group of cyclists that are coupled
together through the mutual energy benefits of drafting, whereby cyclists follow oth-
ers in zones of reduced air resistance’ (Trenchard et al. 2014, p. 92). Throughout the
race, riders may attempt to ‘attack’ and break away from the peloton, and other teams’
domestiques may attempt to chase them down and bring them back to the peloton or
let them go until a later point in the race. Alternatively, the peloton may stay together,
resulting in a ‘bunch sprint’ finish. Throughout the race, slower riders drop out of the
peloton and often work together to attempt to re-join the peloton. Likewise, domes-
tiques who have fulfilled their role of putting the protected rider in a position to finish
the race often drop out of the peloton due to fatigue. An additional feature of the NRS
women’s road races are shorter sprint and Queen of the Mountain (QOM) sub-sections,
whereby bonus points are offered for the top three cyclists within each sub-race.
A convoy of vehicles comprising the Commissaires; race officials, medical sup-
port, neutral spares, the media and team support vehicles follows behind the peloton.
The Commissaires controls the race and following convoy, communicating with the
cyclists via loudspeaker and the vehicles in the convoy via UHF radio or in person by
driving alongside them. A medical support vehicle follows behind the Commissaires
to provide assistance in the event of a crash or injury. Each team then has their own
specific support vehicle, typically containing a Director Sportif (DS), a mechanic
(in some cases this may be the DS), spare parts (e.g. wheels), bicycle tools and food
and drink for the riders. Each support vehicle is permitted to provide mechanical or
nutritional support to team riders and can offer tactical guidance and encouragement
through verbal exchanges. The positioning of the support vehicles in the peloton
convoy is based on the order of riders in the race (e.g. the team with a rider in first
place is given the first support vehicle spot within the convoy).
Together the peloton and convoy form a complex, highly dynamic system compris-
ing multiple human (riders, DS, mechanic) and non-human agents (bicycles, vehicles,
METHODS
Participants
The participants were members of an elite women’s Australian NRS cycling team.
For the present analysis, the sample included five riders, one DS and one mechanic.
160 Systems Thinking in Practice
Due to the naturalistic nature of the study, it was not possible to gather complete
participant demographic data; however, all were experienced in elite cycling and had
raced throughout the 2016 NRS season. The study was granted ethics approval by
the University of the Sunshine Coast’s Human Ethics Committee.
Materials
The research team observed the race from within the cycling team’s support vehicle.
Go ProTM cameras were used to record the races, and a Dictaphone was used to record
the verbal communications occurring within the team support car. Dictaphones were
also used to record team race planning meetings, the post-race Critical Decision
Method (CDM) (Klein et al. 1989) interviews and post-race team debriefs. The inter-
viewers used a pro-forma containing the CDM interview probes. The interview tran-
scripts were transcribed using Microsoft WordTM. For data representation, the task
and social networks were created using Microsoft VisioTM.
Procedure
The research team provided the cycling team with an overview of the study, its aims
and the data collection methodology prior to the first race of each event. The research
team travelled to each race with the cycling team and observed the warm up and pre-
race discussions and planning activities. The Go Pro cameras and Dictaphone were
placed within the support vehicle and set to record shortly before the start of each race.
Once the races began, the research team observed the peloton from the support vehicle
and made hand-written notes regarding the team’s performance, tactics and the inter-
actions between the DS, the Commissaire and riders. During low workload periods of
the race, the researchers were also able to discuss the team’s performance with the DS,
including tactics, planned activities and factors influencing rider performance.
Following the race, the research team attended the riders’ post-race debrief and
planning session for the next race, recording both using a Dictaphone.
At the conclusion of the planning and debrief sessions, the research team con-
ducted one-on-one CDM interviews with each rider regarding the earlier race. The
interviewers used a set of CDM probes adapted for the cycling race context and
recorded each interview using a Dictaphone. Following the interview, each rider was
asked to complete a social network analysis questionnaire to show who and what
they interacted with during the race. This involved presenting them with a social
network diagram showing all agents (riders, other riders, DS, Commissaire, cycling
computer) and asking them to rate their level of communication with each during the
race on a scale of low (<10 communications), medium (between 10 and 20 commu-
nications) and high (>20 communications).
The video and audio footage were transcribed verbatim using Microsoft Word.
The three EAST network representations were constructed as follows:
1. Task network. The task network was built based on the research team’s
observations, a review of the video data and the interview transcripts. A
draft version of the task network was reviewed and refined by the cycling
team during the Battle on the Border event.
EAST in Elite Women’s Cycling Teams 161
RESULTS
Task Network
The task network is presented in Figure 8.1. Within Figure 8.1, the circular nodes
represent distinct tasks undertaken immediately prior to and during the road races.
The linkages between the nodes represent relationships between tasks; for example,
the ‘attack’ and ‘support protected rider’ tasks are closely linked, since the attacks
are made by domestique riders in order to either help the protected rider break away
from the peloton or to tire out opposing team riders.
The coloured rings around each node represent the agents in the cycling system
who undertake each task. For example, the ‘attack’ task is undertaken by the rid-
ers only, whereas the ‘monitor other riders’ task is undertaken by the riders, the
Commissaire and the DS.
Two features of the task network should be noted. First, there are a range of
tasks involved, including both individual tasks that are unique to specific agents and
shared tasks that are common across agents. For example, the task of communicat-
ing with other riders is undertaken by team riders within the peloton (e.g. asking for
assistance to initiate a break), by the DS in the support vehicle (e.g. communicating
tactics with team riders) and by the Commissaire (e.g. informing other riders in the
peloton and the DSs in the support vehicles of the time gap between a breakaway
rider and the peloton). Second, the relationships between each task can be used to
identify those tasks that are integral to team success. In this case, the task network
indicates that the tasks of ‘race planning and tactics’, ‘establish and maintain appro-
priate position in the peloton’, ‘monitor other riders’, ‘communicate with other rid-
ers’ and ‘monitor speed, cadence, power and distance’ are integral to team success
as they are the most connected to other tasks in the network. It is notable that these
tasks are also highly interrelated.
162 Systems Thinking in Practice
Warm up
Start race
Race planning
and tactics
Maintain
appropriate Monitor
position in speed/
convoy cadence/
distance etc
Provide Establish/
Control convoy maintain
mechanical/
appropriate
nutritional
position in
support peloton
Monitor other
Communicate Bring back the riders
with break
commissaire Request
mechanical/
nutritional
support
Communicate Communicate
Update riders Sprint finish
with team with other
mates riders
Organise lead
out
FIGURE 8.1 Generic task network for women’s cycling road racing.
Social Network
The social network for the Battle on the Border stage 1 road race is presented in
Figure 8.2. Within Figure 8.2, the circular nodes represent agents (e.g. riders, sup-
port vehicle, bicycle computers), and the arrows between them represent the extent to
which the agents communicated with one another during the race.
The social network shows the structure of communications throughout the road race.
In this case, the protected rider and domestique rider 2 are the most connected in terms of
incoming and outgoing communications. In addition, both the protected rider and domes-
tique rider 2 have a greater frequency of communications with other agents, both having
five connections that were rated as ‘high’ on the frequency of communications scale.
FIGURE 8.2 Social network for Battle on the Border road race stage 1.
position in the peloton, as well as the position of their teammates, and relating this
information to tactics and energy levels. The network also shows a focus on the
protected riders from other teams in terms of what they were doing and their posi-
tion in the peloton throughout the race. The constant monitoring of own and other
riders’ energy levels was reported by all riders as important throughout the race and
is shown through the nodes related to the ‘energy’ node. Nodes related to the team’s
race plan were also prominent. Finally, it is interesting to see safety-related nodes
in the network, including the nodes ‘crashes’, ‘weather’, ‘conditions’ and ‘pot holes’.
CONCLUSION
What Does the Analysis Tell Us About DSA and
Teamwork in Elite Women’s Cycling Teams?
The analysis highlights the high requirement for teamwork during elite women’s rac-
ing. Salas et al.’s (2005) ‘Big Five’ model of teamwork identifies five key teamwork
164 Systems Thinking in Practice
Points
To go
Level
Computer QOM
Sprint
Distances
Energy
Descent Conser-
vation
Speed Main
Handle group
Chase
bars
Power
Use
Time Peloton
gap Win Breaks
Other
groups
Tactics Crashes
Attacks Front
Protected
rider
Goals
Plan Course
Protect
Own Position
Support team
vehicle Behind
Riders Weather
Conditions
Form
Skill Experience
GC level
riders Bike
Pot holes
Other
Tyres
Fatigue teams
Training
Working
Contenders together
Brakes
FIGURE 8.3 Situation awareness network for Battle on the Border road race stage 1.
TABLE 8.1
Examples of ‘Big Five’ Teamwork Behaviours
What Are the Implications for Future EAST Applications in Elite Sport?
The analysis presented provides some evidence of the utility of applying EAST in the
elite sports context. EAST provided new perspectives on elite cycling, outlining the
key tasks, interactions and information required during elite women’s cycling road
races. Further applications of the EAST framework are encouraged, both in cycling
and in other forms of elite team sports such as football, rugby league and union,
Australian Rules football, American football, Formula 1 racing and baseball. In
addition, formal comparisons between EAST and other existing analysis approaches
are recommended.
REFERENCES
De Keukelaere, C., Kermarrec, G., Bossard, C., Pasco, D. and De Loor, P. (2013). Formes,
contenus et évolution du partage au sein d’une équipe de sport de haut niveau. Le travail
humain, 76 (3), 227–255.
Klein, G. A., Calderwood, R., and MacGregor, D. (1989). Critical decision method for elicit-
ing knowledge. IEEE Transactions on Systems, Man and Cybernetics, 19 (3), 462–472.
Macquet, A. C. and Stanton, N. A. (2014). Do the coach and athlete have the same ‘Picture’
of the situation? Distributed situation awareness in an elite sport context. Applied
Ergonomics, 45 (3), 724–733.
Neville, T. and Salmon, P. M. (2016). Never blame the umpire? A review of situation awareness
models and methods for examining the performance of officials in sport. Ergonomics,
59 (7), 962–975.
Neville, T., Salmon, P. M., Read, G. J. M. and Kollinitas, A. (2016). Play on or call a foul?
Testing and extending DSA theory through sports officiating. TIES, 17 (1), 80–103.
Salas, E., Sims, D. E. and Burke, C. S. (2005). Is there a ‘Big Five’ in teamwork? Small Group
Research, 36 (5), 555–599.
EAST in Elite Women’s Cycling Teams 167
Salmon, P. M., Stanton, N. A., Gibbon, A. C., Jenkins, D. P. and Walker, G. H. (2010). Human
Factors Methods and Sports Science: A Practical Guide. Taylor & Francis: Boca
Raton, FL.
Salmon, P. M, Stanton, N. A., Walker, G. H., Baber, C., Jenkins, D. P. and McMaster, R.
(2008). What really is going on? Review of situation awareness models for individuals
and teams. Theoretical Issues in Ergonomics Science, 9 (4), 297–323.
Stanton, N. A., Salmon, P. M., Rafferty, L., Walker, G. H., Jenkins, D. P. and Baber, C. (2013).
Human Factors Methods: A Practical Guide for Engineering and Design. 2nd Edition,
Ashgate: Aldershot, UK.
Stanton, N. A., Salmon, P. M., Walker, G. H. (2015). Let the reader decide. A paradigm shift
for situation awareness in socio-technical systems. Journal of Cognitive Engineering
and Decision making, 9:1, 45–50.
Stanton, N. A., Salmon, P. M., Walker, G. H., Salas, E., Hancock, P. (2017). State-of-the-
science: Situation Awareness Models. Ergonomics. 60(4): 449–466.
Trenchard, H. (2015). The peloton superorganism and protocooperative behavior. Applied
Mathematics and Computation, 270, 179–192.
Trenchard, H., Richardson, A., Ratamero, E. and Perc, M. (2014). Collective behavior and the
identification of phases in bicycle pelotons. Physica A: Statistical Mechanics and its
Applications, 405, 92–103.
9 EAST in Automated
Driving Systems
With Victoria A. Banks
INTRODUCTION
There have been rapid developments in automotive automation over the past decade
whereby partial and fully automated vehicles are reaching a point where widespread
deployment is feasible (National Highway Traffic Safety Administration; NHTSA
2016). It is expected that by the end of 2016, NHTSA will publish best-practice
guidelines on establishing principles of safe operation for vehicles operating at Level
4 ‘full’ automation. Fully autonomous cars promise to deliver abundant socioeco-
nomic advantages (Casner et al. 2016), including improvements to traffic flow and
mobility and significant improvements to road safety. With 90% of accidents being
attributable to driver error (Smiley and Brookhuis 1987; Stanton and Salmon 2009),
vehicle manufacturers may have good reason to remove drivers from active con-
trol. There are, of course, other benefits of ‘driverless’ vehicles, one being to give
vehicle occupants time to engage in other tasks not related to driving (Fagnant and
Kockelman 2015). This is seen as one of the main drivers for market implementation
to improve comfort and convenience. According to the Department for Transport
(2015), UK drivers spend, on average, 235 hours a year behind the wheel. This
equates to approximately six working weeks where the driver has no spare capacity
to engage in other tasks. The advent of fully automated vehicles could therefore com-
pletely transform our experience of driving and provide the driver with additional
productive time (making the journey similar to taking public transport – without the
drawbacks).
The human factors issues pertaining to vehicle automation have been speculated
about since the 1970s (Sheridan 1970). Simply removing the driver from the control-
feedback loop and eliminating their responsibility over safe vehicle operation does
not, however, render human factors completely redundant. Instead, vehicles oper-
ating at increased levels of autonomy with ‘self-driving’ capabilities open up new
avenues of investigation. Some of these avenues are explored within this chapter.
169
170 Systems Thinking in Practice
practice, the role and responsibilities of the driver are alluded to, but not explicitly
described, in automation taxonomies. The Society for Automotive Engineers (SAE
2015), NHTSA (2013) and BASt Expert Group (Gasser 2014) have all developed
their own versions of automated driving taxonomies. These are often used inter-
changeably within the literature, which can lead to confusion about what the driver
can and cannot do under different levels of automation within the driving system.
SAE went some way in trying to standardise these descriptions (SAE J3016). Even
so, in any instance whereby a take-over request is issued or indeed possible, the
driver is expected to be able to regain control of the vehicle and resume their tradi-
tional driving role. As long as the driver remains in the control-feedback loop, which
would be the case for any system whereby control transitions may be made between
the automated system and driver, an acknowledgement of their role and how they
can be supported back into their traditional driving role remains an important area
of investigation (Eriksson and Stanton 2017). Thus, we cannot assume that at higher
levels of automation, the driver or human element will no longer be required. This is
because any potential for a take-over request to be issued implies that (1) the vehicle
does not offer full ‘self-driving’ functionality and (2) the driver should be able to
regain control of the vehicle as may be required by the situation and/or operational
limits of the system.
We also cannot overlook the fact that individuals may even want to resume con-
trol from the vehicle at some point. Thus, increasing levels of autonomy in driving
do not eliminate all of the human factors issues that are typically associated with
lower levels, for example, Levels 2 and 3. We already know from the literature
that automation within the driving task can lead to decreased situation awareness
(Stanton and Young 2005; Stanton et al. 2011), erratic changes to driver workload
(Stanton et al. 1997; Young and Stanton 2002, 2004; de Winter et al. 2014, 2016),
skill degradation (Stanton and Marsden 1996) and issues relating to trust (Walker
et al. 2016), overreliance and complacency (Stanton 2015). It seems likely that
some, if not all, of these will remain enduring challenges for systems designers as
long as the driver remains within the control-feedback loop to some extent. This
means that strategies for transferring control back to the driver after prolonged
periods of autonomous driving must be carefully designed to ensure that they have
appropriateness levels of situation awareness and are deemed capable of regaining
control of the vehicle. The entire spectrum of driver responsibilities and workload
should be considered in delivering an effective ‘hand-over’ between the driver and
autonomous vehicle.
With this in mind, it is becoming increasingly important to acknowledge the role
of the driver within an automated driving system. There are many lessons that can
be taken from the field of aviation, as we increasingly see the role of the driver
becoming analogous to the role of a pilot (Stanton and Marsden 1996). In aviation,
Hutchins (1995) described two roles in which the pilot can serve; Pilot Flying (PF)
and Pilot Not Flying (PNF). Whilst the PF is responsible for overall control of the
plane, the PNF is responsible for communicating with Air Traffic Control and air-
craft systems as well as completing all of the checklists that are required during each
phase of flight. Thus, the burden of responsibility simply changes rather than being
reduced. In recognition of the changing responsibilities of the PNF, the Federal
EAST in Automated Driving Systems 171
Aviation Administration (FAA 2003) altered the terminology of PNF to that of Pilot
Monitor (PM). In the same way, a Driver Driving (DD) would be responsible for
overall control of the vehicle and represents the traditional role of the driver, whilst a
Driver Monitor (DM) would assume a similar role to that of PM. The latter role is to
monitor the behaviour of the vehicle and automated sub-systems to ensure that safe
and normal driving practice is maintained. However, the introduction of automa-
tion into the driving task does not necessarily mean that the driver will assume the
role of DM. We already know that the perception of increased reliability can leave
drivers vulnerable to becoming complacent and over-reliant on automated function-
ality (Parasuraman et al. 1993; Lee and See 2004). Without active vehicle control,
a DM, for example, could become vulnerable to the onset of boredom or fatigue
(e.g. Molloy and Parasuraman 1996; Stanton et al. 1997; Young and Stanton 2002).
Thus, DMs may unintentionally drift in and out of the Driver Not Driving (DND)
role. This becomes particularly problematic in instances whereby the automated sys-
tems are not able to adequately resolve a scenario without human intervention. If
the driver should be in the role of DM (i.e. during partial automation) but is in fact
behaving in a manner more akin to the role of DND, active control of the vehicle may
be transferred to a DND (rather than a DM who is prepared to resume the role of DD)
who may fail to respond appropriately due to a sudden increase in driver workload,
reduced situation awareness (Dozza 2012) or startle (Sarter et al. 1997) (Figure 9.1).
We therefore need to better understand the impact that automation implementation
has upon the role of the driver. One way to do this is to adopt the theoretical under-
pinnings of Distributed Cognition (DCOG), which acknowledges that both human
and non-human agents can work together in pursuit of a common goal (Hutchins
1995). In driving, this essentially reflects the relationship between the human driver
and automated sub-systems that become increasingly capable of performing the tra-
ditional roles of the driver (Banks et al. 2014). The DCOG paradigm provides the
necessary foundations and methods to explore how the role of the driver changes
within the complex sociotechnical systems in which they are involved (Walker et al.
2010; Walker et al. 2015).
METHOD
This chapter explores the changing role of the driver within automated driving sys-
tems using the Event Analysis of Systemic Teamwork (EAST) Stanton et al. 2006,
2013; Walker et al. 2006, 2010) framework. EAST is a descriptive method and
172 Systems Thinking in Practice
proposes that the performance of a system can be described using three interlinked
network representations: task, social and information (Walker et al. 2006, 2010).
Whilst it was originally developed for understanding command and control activi-
ties, it has since been applied to transportation domains including aviation (Walker
et al. 2010; Stanton and Harvey 2017), rail (Walker et al. 2006), driving (Banks
and Stanton 2016) and maritime transport (Stanton et al. 2006; Stanton 2014; Baber
et al. 2013).
Task networks are used to provide a summary of system goals (Salmon et al. 2014)
and offer a description of the sequences and interdependencies that exist between
individual sub-tasks that must be completed to attain these goals. Social networks
are used to analyse the structure of the system in terms of the communications that
take place between different system ‘agents’. Finally, information networks show the
information that is used and communicated by system agents during a task (Walker
et al. 2010). They therefore detail aspects of communication that underpin the com-
pletion of a task and the relationships between informational nodes. This chapter
uses the representations afforded by EAST to explore the differences between the
DD and DM roles using network metrics. These networks can then be subjected to
quantitative analysis using the Applied Graphic and Network Analyses (AGNA) tool
(AGNA version 2.1; Benta 2005). AGNA is a platform-independent freeware appli-
cation that can be used to analyse social networks. Nodes within the network can be
analysed individually to assess agent centrality/prominence or as a whole. In driving
research, network metrics can be used to identify key agents, key tasks and key infor-
mational elements required to complete the task. The following metrics have been
chosen due to their previous application to the driving task (see Banks and Stanton
2016; Salmon et al. 2009; Walker et al. 2011).
Density represents the level of interconnectivity between system agents. It is
expressed as a value between 0 and 1, where 0 represents a network that has no con-
nections between system agents and 1 indicates that the network is fully connected
(Kakimoto et al. 2006). It is calculated using the formula
Network density = 2e /n ( n − 1)
where:
e is the number of links in the network
n is the number of information elements within the network (Walker et al. 2012)
Diameter is used to analyse the connections and pathways between different sys-
tem agents within the network (Walker et al. 2011). Denser networks (i.e. the route
through the network is shorter and more direct) have smaller values. It is calculated
using the following formula:
Diameter = max uy d ( ni , n j )
Cohesion represents the number of reciprocal connections divided by the total num-
ber of possible connections (Stanton 2014).
EAST in Automated Driving Systems 173
∑
1 g
Sociometric Status =
( g − 1) j =1
( x ji , xij )
where:
g is the total number of nodes in the network
i and j are individual nodes and are the edge values from node i to node j
(Salmon et al. 2012)
RESULTS
Task Networks
The driving task itself is said to be made up of approximately 2500 subtasks (see
Hierarchical Task Analysis of Driving, HTAoD; Walker et al. 2015). These are
divided into pre-drive, basic, operational, tactical, strategic and post-drive tasks.
Whilst a DD would be involved in all of these tasks, the implementation of auto-
mation into the driving task would see the role of the human operator reduced. For
this reason, the analysis focuses upon some of the basic, and strategic sub-tasks of
driving, as it is in these categories that the changing role of the driver is most vis-
ible. Table 9.1 shows the terminologies, taken directly from the HTAoD (Walker
et al. 2015) and categorised into task type, that were chosen to construct the task
networks presented in this chapter. Notably, both networks should be considered as
continuous processes that are performed as long as the vehicle is in operation. Figure
9.2a reflects the linkages between these sub-tasks of driving from the perspective
of a DD. A DD would be physically be responsible for completing all of the basic
sub-tasks of driving as well as being solely responsible for completing the strategic
sub-tasks. However, as automation is introduced into the driving task, the task net-
work evolves. Figure 9.2b represents the task network from the perspective of a DM.
Whilst the tasks within the network remain largely the same, the emphasis upon
TABLE 9.1
Basic and Strategic Sub-Tasks of Driving
(a)
(b)
FIGURE 9.2 Task networks for (a) the role of DD and (b) the role of DM.
EAST in Automated Driving Systems 175
TABLE 9.2
Description of DD and DM Task Networks
DD DM
Number of nodes 9 10
Number of edges 144 160
Social Networks
In order to further our understanding of how the role of the driver affects network
dynamism, high-level social networks were constructed. The authors identified five
system agents relating to the DD network (Figure 9.3a), whilst eight system agents
were identified for a DM social network (Figure 9.3b). The three additional agents
within the DM network represent nodes associated with automated functionality.
Banks and Stanton (2016) identified the Longitudinal and Lateral Controllers as sep-
arate system agents, given their differing capabilities. The same viewpoint has been
taken in the social network representation shown in Figure 9.3b.
Taken at face value, it is clear that the social network associated with the role of
DM is more complex than that of DD. This is likely to be attributed to the increased
communication and coordination that is required within the system network to main-
tain the goal of safe and normal driving practice following automation implementa-
tion. Thus, the transition between DD and DM appears to bring with it a change in
overall system dynamism.
176 Systems Thinking in Practice
(a) (b)
FIGURE 9.3 Social network diagrams for (a) the role of DD and (b) the role of DM.
TABLE 9.3
Basic Description of the DD and DM Social Networks
DD DM
Number of nodes 5 8
Number of edges 10 37
Network density 0.50 0.70
Network diameter 2.00 2.00
Network cohesion 0.30 0.54
EAST in Automated Driving Systems 177
TABLE 9.4
Sociometric Status for the Roles of DD and DM
Node DD DM
Driver 1.75 a 1.57a
Vehicle 1.00 1.00
Vehicle displays 0.75 1.00
Road users 0.75 1.14
Road environment 0.75 1.29
Automated system – 2.00a
Longitudinal controller – 1.14
Lateral controller – 1.00
Mean 1.00 1.32
a Key system agents based upon the rule that any value above the
mean sociometric status value reflects dominance (From Salmon,
P. M. et al., Distributed Situation Awareness: Advances in Theory,
Measurement and Application to Teamwork, Ashgate, Aldershot,
UK, 2009.)
agent in a system whereby full responsibility of the driving task lies with the human
operator. In an automated system where the driver adopts the role of DM, both the
DM and automated system become the most prominent system agents (see Table 9.4).
Notably, the automated system ranks highest in sociometric status, which is unsurpris-
ing given its role within the system of vehicle operation. Even so, this representation
demonstrates that as long as the driver adheres to their responsibilities of monitoring
system behaviour, they maintain a central role within the control-feedback loop.
Of course, ensuring that drivers actually adhere to their changing responsibili-
ties is important, because if a driver transitions to a DND, problems may arise. It is
difficult to predict and understand the behaviour of a DND because they could be
engaged in any task of their choosing. For example, let’s assume that a DM becomes
engaged in a non-driving-related secondary task that keeps their eyes averted from
the road environment for approximately 26 seconds (Eriksson and Stanton 2017).
This essentially would signal the breaking of links between the driver, vehicle dis-
plays, road users and road environment within Figure 9.3b. A ‘broken-links’ analysis
can be used to demonstrate how momentary lapses in efficient monitoring could
impact upon overall network dynamism. This approach essentially represents com-
munication breakdowns between system agents (Stanton and Harvey 2017) simi-
lar to that of removing nodes from the network altogether (e.g. Baber et al. 2013).
‘Broken links’ have typically been used by EAST analysts to analyse accidents post
event to explore vulnerabilities within the system (e.g. Griffin et al. 2010; Rafferty
et al. 2012). In this instance, reciprocal relationships occurring between the DM and
other social agents, shown in Figure 9.3b, are rescinded. The consequences of this
are clearly shown in the results of a social network analysis (see Tables 9.5 and
9.6). As is to be expected, network density and cohesion is rapidly reduced. The
178 Systems Thinking in Practice
TABLE 9.5
Results of a ‘Broken-Links’ Analysis Whereby Links Are
Broken Between the DM, Vehicle Displays, Road Users and
Environment
TABLE 9.6
Sociometric Status in a ‘Broken Links’ Network
prominence of the driver within this network also reduces rapidly (see Table 9.6).
This places further pressure on systems designers to ensure that their systems are
safe, reliable and failsafe, especially given the prominence of the automated system
and vehicle under these circumstances. Providing that remaining system agents have
the information required to function effectively and are able to use this information
to perform appropriately in any given context, safety should be maintained (Salmon
et al. 2012) even if the DM transitions to a DND for short periods. There is evidence
that individual agents are able to compensate for each other, enabling the system to
maintain safe operation (Stanton et al. 2006; Stanton 2016). For example, if a driver
fails to respond to system warnings, some autonomous systems can bring the vehi-
cle to a ‘safe stop’ without any human input. Similarly, an Autonomous Emergency
Brake system operates in the background and will only activate if activation thresh-
olds are met. However, this is only possible if system agents have all of the informa-
tion required. This implicates the ‘information network’.
EAST in Automated Driving Systems 179
Information Networks
According to Walker et al. (2010), information networks show the information
that is used by and communicated by agents during a task. Their work specifi-
cally explored systemic situation awareness of air traffic control using observa-
tional notes, interview and live audio feeds. The following information networks
were created by analysing driver verbalisations collected as part of another study
by Banks and Stanton (2015), which utilised the Critical Decision Method (Klein
and Armstrong 2005) to elicit information relating to driver decision making. In
total, 48 verbal transcripts were analysed to construct the DD and DM informa-
tion networks. The DD information network was constructed using evidence from
verbal transcripts collected during manual driving (i.e. no automation), whilst the
DM information network was constructed using evidence from verbal transcripts
collected during a drive in which the basic and strategic sub-tasks of driving
(Table 9.1) were automated.
Each ‘informational node’ within the transcripts was identified and paired with
its closest relation (i.e. nodes from the same sentence). This strategy was used
to build up a network of information concepts relating to the driving task. The
network representations were presented to subject matter experts for verification.
Figure 9.4 presents a schematic overview of the DD information network, includ-
ing 42 nodes and 46 connections. Sociometric status was calculated to identify key
concepts. The results indicate that for a DD, the following information nodes were
most prominent:
Approaching
Traffic priority
Capacity Exiting Positive
Cyclists Roadworks instruction Warnings
Pedestrians Location
Junctions
Signage
Direction
Lane position Information
Motorcyclists Junction type
Traffic
Traffic type Infrastructure management Speed limits
systems
Traffic Lane markings
Public transport Road type Traffic lights
Vehicle Speed
or services
Impact on
others Colour
Route Traffic
behaviour Time
demands
Other
Risk assesment Location of
Hazard type hazard
Previous
Location Environmental
experience conditions Weather
Severity
Visibility
The informational nodes coming off these key nodes within Figure 9.4 provide greater
detail pertaining to specific situations and contexts within driving (Stanton 2013).
In contrast, the DM information network, presented in Figure 9.5, includes 53
nodes and 61 connections. Sociometric status was once again calculated and revealed
that in addition to the key nodes outlined above for a DD, a DM must also consider
the following:
Thus, despite the intention of autonomous driving features being to reduce the burden
of responsibility placed upon the driver, it actually increases the amount of information
that a driver must consider in order to maintain safe driving practice. In order to further
understand how this additional information requirement impacts upon network dyna-
mism, the information networks as presented in Figures 9.4 and 9.5 were further anal-
ysed using the AGNA software tool. The results of this analysis are shown in Table 9.7.
Approaching
Traffic priority
Capacity Exiting Positive
Cyclists Roadworks instruction Warnings
Pedestrians Location
Junctions
Signage
Direction
Lane position Information
Motorcyclists Junction type
Traffic
Traffic type Infrastructure management Speed limits
systems
Traffic Lane markings
Public transport Roadtype Traffic lights
Vehicles Speed
or services
Impact on
others Colour
Route Traffic
behaviour Time demands
Other
Risk assesment Location of
System hazard
controlled Hazard type
System limits response
Previous
Automated Location Environmental
experience Weather
driving features conditions
Severity
Haptic
Auditory
FIGURE 9.5 Schematic overview of the DM information network (grey boxes indicate
‘new’ nodes within the information network as a result of automation implementation).
EAST in Automated Driving Systems 181
TABLE 9.7
Information Network Metrics for the
Roles of DD and DM
Metric DD DM
Number of nodes 42 53
Number of edges 84 112
Network density 0.05 0.04
Network diameter 6.00 7.00
Network cohesion 0.04 0.03
DISCUSSION
This chapter shows how the application of EAST, and the representations afforded it,
can be used to analyse the changing role of the driver. The application of quantitative
network metrics to analyse these networks enables us to see how the changing role of
the driver impacts upon overall system structure. Importantly, these representations
are intended to provide a foundation to the discussion surrounding the role of the
driver within automated driving systems. The findings do go a long way to explain
why the empirical research shows high levels of mental workload with driving auto-
mation that requires constant monitoring (Stanton et al. 1997; Young and Stanton
2004; de Winter et al. 2014). It is a paradox that this level of automation actually
results in more, rather than less, work for the driver (Stanton 2015).
From a theoretical modelling perspective, the DND role is particularly problem-
atic. Driver disengagement from the primary driving task is a serious concern. The
literature is cluttered with instances whereby engagement in secondary tasks can
lead to performance decrements (Eriksson and Stanton 2017). For example, Merat
et al. (2014) found that if an automated system disengaged at the point where the
driver’s attention was diverted away from the road centre, resumption of manual con-
trol was erratic for up to 40 seconds after the transfer of control. The main concern
for the DND role is that it is not possible to construct a task, social or information
network for the DND role. This is because drivers are free to participate in any task
of their choosing. This makes it difficult to predict and understand the behaviour of a
DND. A ‘broken-links’ analysis, however, points to a dramatic shift in system struc-
ture when a DM transitions to a DND role. Whilst some may argue that the DM role
becomes redundant at higher levels of autonomy (e.g. Gasser 2014), the authors cau-
tion that this is not strictly the case. The Department for Transport’s report (2015),
for example, recognizes that some Level 4 systems may still offer a full set of con-
trols that enable manual driving. This means that at some point, the DND could be
required to regain control of the vehicle, whether this be due to a ‘forced’ transfer of
control due to some form of mechanical failure (e.g. sensor failure), through choice
(e.g. the driver may want to abort or change the destination of travel or they may sim-
ply want to be in control) or simply because autonomous driving features only oper-
ate in some driving modes at Level 4. For this reason, the DND will need to adopt
182 Systems Thinking in Practice
the role of DM during the exchange of control between them and the autonomous
vehicle. The success of this transition of control will, however, be based upon a num-
ber of interacting psychological constructs including situation awareness, workload,
trust and skill (Stanton and Young 2000; Heikoop et al. 2016). If vehicle manufactur-
ers are to handle this transition effectively, a greater understanding of how drivers
appraise and make use of higher-level autonomy is needed (Richards and Stedmon
2016). Thus, whilst less emphasis is placed upon the driver as the level of automation
increases, vehicle manufacturers still need to think about ways in which the driver
can be supported if and when they choose to regain control of the vehicle, especially
during early versions of highly automated driving systems. This is because the DD,
DM and DND are closely related and likely to be adopted interchangeably through-
out the duration of a drive, especially during the intermediate phases of automation.
Whilst the DND role represents the aspiration of many OEMs, there are no such
systems that exist on the market today that allow this to happen. If a driver does find
themselves in the role of DND, they should be supported back into the role of DM to
ensure that the overall goal of the system network can be appropriately maintained.
For contemporary vehicle automation systems, the role of DND could be seen as
a form of automation misuse (Parasuraman and Riley 1997) given the functional
limits of automated architecture. Much more research is needed to further popu-
late these network representations for the varying role of the driver to validate the
networks proposed in this chapter. The hypothetical representations presented in
this chapter do, however, provide an avenue for discussion as they represent how an
‘ideal’ network may function. Realistically, however, the authors acknowledge that
prolonged exposure to high levels of automation (and driver inactivity) could result in
issues surrounding boredom or fatigue (e.g. Stanton et al. 1997; Young and Stanton
2002). Strategies to support the role and maintenance of the DM role are therefore
important avenues for further research. We already know from the literature that the
level and type of automation can have a direct effect on driver engagement (Stanton
et al. 1997; Merat et al. 2014), changes to driver workload (Stanton et al. 1997; Young
and Stanton 2002; de Winter et al. 2014), situation awareness (Stanton et al. 2011;
Dozza 2012) and decision making (Banks and Stanton 2015).
CONCLUSIONS
The qualitative models of DD and DM support and explain the findings from empir-
ical studies on driver workload changes with automated systems. The increase in
workload associated with monitoring automated systems may be explained by the
fact that there are simply more tasks to undertake. These qualitative insights are
supplemented with the quantitative network statistics, showing the importance
of the role change when driving with an automated system (i.e. from the human
driver to the computer driver). Modelling future systems is an important step for
Ergonomics as a discipline, as it allows us to anticipate the likely behaviour of
future technologies and the role for humans. In this way, we can compare alter-
native designs to identify which are likely to have the better outcomes. Future
research should seek to extend and validate the models presented in this chap-
ter using empirical data generated from observational studies exploring driver
EAST in Automated Driving Systems 183
ACKNOWLEDGEMENTS
Professor Neville A. Stanton was funded by the European Marie Curie International
Training Network project on the Human Factors of Automated Driving
(PITN-GA-2013-605817) and the EPSRC/JLR TASCC project (Human Interaction:
Designing Autonomy in Vehicles – HI:DAVe – Grant number: EP/N011899/1).
REFERENCES
Baber, C., Stanton, N. A., Atkinson, J., McMaster, R. and Houghton, R. J. (2013). Using
social network analysis and agent-based modelling to explore information flow using
common operational pictures for maritime search and rescue operations. Ergonomics,
56 (6), 889–905.
Banks, V. A. and Stanton, N. A. (2015). Contrasting models of driver behaviour in emer-
gencies using retrospective verbalisations and network analysis. Ergonomics, 58 (8),
1337–1346.
Banks, V.A. and Stanton, N.A. (2016). Driver-centred vehicle automation: Using network
analysis for agent-based modelling of the driver in highly automated driving systems.
Ergonomics, DOI:10.1080/00140139.2016.1146344.
Banks, V. A., Stanton, N. A. and Harvey, C. (2014). Sub-systems on the road to vehicle auto-
mation: Hands and feet free but not ‘mind’ free driving. Safety Science, 62, 505–514.
Benta, M. (2005) Studying communication networks with AGNA 2.1. Cognition Brain
Behaviour, 9, 567–574.
Casner, S. M., Hutchins, E. L. and Norman, D. (2016). The challenges of partially automated
driving. Communications of the ACM, 59 (5), 70–77.
Department for Transport. (2015). The pathway to driverless cars: Summary report and action
plan. Available at: https://www.gov.uk/government/uploads/system/uploads/attach-
ment_data/file/401562/pathway-driverless-cars-summary.pdf [Accessed 19.09.2016].
de Winter, J. C. F., Happee, R., Martens, M. H. and Stanton, N. A. (2014). Effects of adaptive
cruise control and highly automated driving on workload and situation awareness: A
review of the empirical evidence. Transportation Research Part F: Traffic Psychology
and Behaviour, 27, 196–217.
de Winter, J. C. F., Stanton, N. A., Price, J. S. and Mistry, H. (2016). The effects of driving
with different levels of unreliable automation on self-reported workload and secondary
task performance. International Journal of Vehicle Design, 70 (4), 297–324.
Dozza, M. (2012). What factors influence drivers’ response time for evasive maneuvers in real
traffic? Accident Analysis & Prevention, 58, 299–308.
Endsley, M. R. and Kaber, D. B. (1999). Level of automation effects on performance, situa-
tion awareness and workload in a dynamic control task. Ergonomics, 42 (3), 462–492.
Eriksson, A. and Stanton, N. A. (2017). Take-over time in highly automated vehicles:
Transitions to and from manual control. Human Factors, DOI:10.1177/001872081
6685832.
Fagnant, D. J. and Kockelman, K. (2015). Preparing a nation for autonomous vehicles:
Opportunities, barriers and policy recommendations for capitalising on self-driven
vehicles. Transportation Research Part A, 77, 167–181.
184 Systems Thinking in Practice
Federal Aviation Administration. (2003). Standard operating procedures for flight deck crew
members. AC No: 120-71A, 27.2.03.
Gasser, T. (2014). Vehicle automation: Definitions, legal aspects, research needs. UNECE
Workshop: German Federal Highway Research Institute: Towards a new transportation
culture: Technology innovations for safe, efficient and sustainable mobility. Brussels,
17–18 November 2014.
Heikoop, D. D., de Winter, J. C. F., van Arem, B. and Stanton, N. A. (2016). Psychological
constructs in driving automation: A consensus model and critical comment on con-
struct proliferation. Theoretical Issues in Ergonomics Science, 17 (3), 284–303.
Hutchins, E. (1995). How a cockpit remembers its speed. Cognitive Science, 19 (3), 265–288.
Kaber, D. B. and Endsley, M. R. (2004). The effects of level of automation and adaptive auto-
mation on human performance, situation awareness and workload in a dynamic control
task. Theoretical Issues in Ergonomics Science, 5 (2), 113–153.
Kakimoto, T., Kamei, Y., Ohira, M. and Matsumoto, K. (2006). Social network analysis on
communications for knowledge collaboration in OSS communities. In: Proceedings of
The 2nd International Workshop on Supporting Knowledge Collaboration in Software
Development (KCSD’06), pp. 35–41 Tokyo, Japan.
Leavitt, H. J. (1951). Some effects of certain communication patterns on group performance.
Journal of Abnormal and Social Psychology, 46, 38–50.
Lee, J. D. and See, K. A. (2004). Trust in automation: Designing for appropriate reliance.
Human Factors, 46, 50–80.
Merat, N., Jamson, A. H., Lai, F. C., Daly, M. and Carsten, O. M. (2014). Transition to
manual: Driver behaviour when resuming control from a highly automated vehicle.
Transportation Research Part F: Traffic Psychology and Behaviour, 27 (B), 274–282.
National Highway Traffic Safety Administration. (2013). Preliminary Statement of Policy
Concerning Automated Vehicles System. Washington, DC.
National Highway Traffic Safety Administration. (2016). Update to ‘Preliminary Statement
of Policy Concerning Automated Vehicles System’. Available at: http://www.nhtsa.gov/
Research/Crash+Avoidance/Automated+Vehicles [Accessed 19.09.2016].
Nowakowski, C., Shladover, S. E. and Tan, H. S. (2015). Heavy vehicle automation: Human
factors lessons learned. Procedia Manufacturing, 3, 2945–2952.
Parasuraman, R., Molloy, R. and Singh, I. L. (1993). Performance consequences of automa-
tion-induced ‘complacency’. The International Journal of Aviation Psychology, 3, 1–23.
Parasuraman, R. and Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse.
Human Factors: The Journal of the Human Factors and Ergonomics Society, 39 (2),
230–253.
Richards, D. and Stedmon, A. (2016). To delegate or not to delegate: A review of control
frameworks for autonomous cars. Applied Ergonomics, 53 (B), 383–388.
Salmon, P. M., Stanton, N. A. and Young, K. L. (2012). Situation awareness on the road:
Review, theoretical and methodological issues, and future directions. Theoretical
Issues in Ergonomics Science, 13 (4), 472–492.
Salmon, P. M., Stanton, N. A., Walker, G. H. and Jenkins, D. P. (2009). Distributed Situation
Awareness: Advances in Theory, Measurement and Application to Teamwork. Ashgate:
Aldershot, UK.
Salmon, P. M., Walker, G. H. and Stanton, N. A. (2016). Pilot error versus sociotechnical sys-
tems failure: A distributed situation awareness analysis of Air France 447. Theoretical
Issues in Ergonomics Science, 17 (1), 64–79.
Sarter, N. B., Woods, D. D. and Billings, C. E. (1997). Automation surprises. Handbook of
Human Factors and Ergonomics, 2, 1926–1943.
Sheridan, T. B. (1970). Big brother as driver: New demands and problems for the man at the
wheel. Human Factors: The Journal of the Human Factors and Ergonomics Society,
12, 95–101.
EAST in Automated Driving Systems 185
Smiley, A. and Brookhuis, K. A. (1987). Alcohol, drugs and traffic safety. In: J.A. Rothengatter
and R. A. de Bruin (Eds.), Road Users and Traffic Safety (pp. 83–105).Van Gorcum:
Assen, The Netherlands.
Smith, B. W. (2013). SAE levels of driving automation. Available at: http://cyberlaw.stanford.
edu.loda [Accessed 11.04.2016].
Society for Automotive Engineers (2015). Taxonomy and definitions for terms related to on-
road motor vehicle automated driving systems. Available at: http://standards.sae.org/
j3016_201401/. [Accessed 12.10.2015].
Stanton, N. A. (2014). Representing distributed cognition in complex systems: How a subma-
rine returns to periscope depth. Ergonomics, 57 (3), 403–418.
Stanton, N. A. (2015). Responses to autonomous vehicles. Ingenia, 62, 9.
Stanton, N. A. (2016). Distributed situation awareness. Theoretical Issues in Ergonomics
Science, 17 (1), 1–7.
Stanton, N. A., Dunoyer, A. and Leatherland, A. (2011). Detection of new in-path targets by
drivers using stop and go adaptive cruise control. Applied Ergonomics, 42 (4), 592–601.
Stanton, N. A. and Marsden, P. (1996). From fly-by-wire to drive-by-wire: Safety implications
of automation in vehicles. Safety Science, 24 (1), 35–49.
Stanton, N. A. and Harvey, C. (2017). Beyond human error taxonomies in assessment of risk
in sociotechnical systems: A new paradigm with the EAST ‘broken-links’ approach.
Ergonomics, 60 (2) 221–233.
Stanton, N. A. and Salmon, P. M. (2009). Human error taxonomies applied to driving: A
generic driver error taxonomy and its implications for intelligent transport systems.
Safety Science, 47 (2), 227–237.
Stanton, N. A., Salmon, P. M, Rafferty, L., Walker, G. H., Baber, C. and Jenkins, D. P. (2013).
Human Factors Methods: A Practical Guide for Engineering and Design. Ashgate:
Aldershot, UK.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon,
P., Hoyle, G., Walker, G., Young, M. S., Linsell, M., Dymott, R. and Green, D. (2006).
Distributed situation awareness in dynamic systems: Theoretical development and
application of an ergonomics methodology. Ergonomics, 49 (12–13), 1288–1311.
Stanton, N. A. and Young, M. (2000). A proposed psychological model of driving automation.
Theoretical Issues in Ergonomics Science, 1 (4), 315–331.
Stanton, N. A. and Young, M. (2005). Driver behaviour with adaptive cruise control.
Ergonomics, 48, 1294–1313.
Stanton, N. A., Young, M. and McCaulder, B. (1997). Drive-by-wire: The case of mental
workload and the ability of the driver to reclaim control. Safety Science, 27 (2–3),
149–159.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. and Green, D. (2006). Event
analysis of systematic teamwork (EAST): A novel integration of ergonomic methods to
analyse C4i activity. Ergonomics, 49 (12–13), 1345–1369.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Gibson, H., Salmon, P. and Jenkins, D.
(2010). From ethnography to the EAST method: A tractable approach for representing
distributed cognition in Air Traffic Control. Ergonomics, 53 (2), 184–197.
Walker, G. H., Stanton, N. A. and Salmon, P. M. (2011). Cognitive compatibility of motorcy-
clists and car drivers. Accident Analysis & Prevention, 43, 878–888.
Walker, G. H., Stanton, N. A. and Salmon, P. M. (2015). Human Factors in Automotive
Engineering and Technology. Ashgate: Aldershot, UK.
Walker, G. H., Stanton, N. A. and Salmon, P. M. (2016). Trust in vehicle technology.
International Journal of Vehicle Design, 70 (2), 157–182.
Walker, G. H., Stanton, N. A., Salmon, P. M., Jenkins, D. P., Monnan, S. and Handy, S. (2012).
Communications and cohesion: a comparison between two command and control para-
digms, Theoretical Issues in Ergonomics Science, 13(5), 508–527.
186 Systems Thinking in Practice
Walker, G. H., Stanton, N. A., Salmon, P. M., Jenkins, D. P. and Rafferty, L. A. (2010).
Translating concepts of complexity to the field of ergonomics. Ergonomics, 53 (10),
1175–1186.
Young, M. S. and Stanton, N. A. (2002). Malleable attentional resources theory: A new expla-
nation for the effects of mental underload on performance. Human Factors, 44 (3),
365–375.
Young, M. S. and Stanton, N. A. (2004). Taking the load off: Investigations of how adaptive
cruise control affects mental workload. Ergonomics, 47 (8), 1014–1035.
10 EAST in Future Road
Transportation Systems
With Victoria A. Banks, Gary
Burnett and Setia Hermawati
INTRODUCTION
Over the past two decades, there have been major developments in the integration of
wireless and autonomous technologies in the road transportation network (Talebpour
and Mahmassani 2016). Automated vehicles in particular are quickly becoming an
engineering reality (Stanton 2015), and whilst much research has primarily focused
upon driver–automation interaction (e.g. Banks et al. 2014; Zeeb et al. 2015; Louw
and Merat 2017), many issues remain. Some of these issues relate to how automation
can be regulated, legislated and standardised, but more importantly, we do not fully
understand how automation will impact overall road system behaviour. For example,
Atkins Mobility (2016) speculate that if automation brings about improvements to
road safety, we may see a future wherein crash barriers are no longer necessary
and roadway signs become redundant as information can be shared using Vehicle-
to-Vehicle (V2V) and Vehicle-to-Infrastructure (V2I) communication streams and
other location services (e.g. Global Positioning Systems [GPS]). V2V and V2I are
made possible through both the use of Dedicated Short Range Communication
(DSRC) sensors and wireless network architectures such as 5G. In vehicles, DSRC
represents on-board sensor units whilst external roadside units represent the means
to achieve V2I communication. This wireless connectivity would enable intra-vehi-
cle communication as well as real-time communication with traffic management
systems. Essentially, camera and radar-based technologies enable the vehicle to ‘see’
(e.g. vision systems that process video data and fuse with microwave radar data),
whilst technologies such as DSRC enable the car to ‘talk’ (i.e. transmit data to other
vehicles and infrastructure) and ‘listen’ (i.e. receive data from other vehicles and
infrastructure).
The concept of Connected and Autonomous Vehicles (CAV) is not new, with
research and innovation dating back to the early 1990s (De La Fortelle 2005). The
Science and Technology Select Committee (2017) cite numerous benefits associated
with CAV, including increased accessibility and mobility and improvements to road
safety and congestion. KPMG (2015) hypothesise that by 2030, all new vehicles sold
within the United Kingdom will be ‘fully connected’. It is clear, then, that future
transportation systems will be reliant upon the exchange of information between both
human and non-human entities to ensure effective system functioning. This type of
187
188 Systems Thinking in Practice
METHOD
DCOG in complex sociotechnical systems can be further explored and understood
using the Event Analysis of Systemic Teamwork framework (EAST) Stanton et al.
2008). EAST is a descriptive method that proposes that a system can be described
using three interlinked network representations: task, social and information (Walker
et al. 2006, 2010). Task networks provide analysts with a means to show the processes
EAST in Future Road Transportation Systems 189
involved in attaining network goals (Salmon et al. 2014). They can provide a descrip-
tion of the sequences and interdependencies that exist between individual sub-tasks
that must be completed to attain these goals. Social networks are used to analyse
the structure of the system in terms of the communications that take place between
different system ‘agents’. Finally, information networks show the information that
is used by, and communicated by, system agents during a task (Stanton et al. 2008).
Information networks detail aspects of communication that underpin the completion
of a task as well as the relationships that exist between these different informational
nodes. EAST has been used to focus upon specific tasks within varied domains,
including aviation (Sorensen et al. 2011), rail (Walker et al. 2006), driving (Banks
and Stanton 2016) and maritime transport, (Stanton et al. 2006, 2017a, 2017b; Stanton
2014; Baber et al. 2013), providing meso-level representations of DCOG (Grote et al.
2014). However, this chapter goes further by using the representations afforded by
EAST (Stanton et al. 2008) to explore DCOG at a macro level (Grote et al. 2014).
EAST makes it possible to provide an overview of how different agents and agencies
within the road transportation network can function simultaneously within a shared
space (i.e. the road network). The networks can then be subjected to quantitative
analysis using the Applied Graphic and Network Analysis (AGNA) tool (AGNA,
version 2.1; Benta 2005). AGNA is a platform-independent freeware application that
can be used to analyse task, social and information networks. Nodes within each
network can either be analysed individually to assess agent centrality/prominence
or as a whole to give an overall impression of system complexity. Network metrics
can be used to identify key agents, tasks and informational elements within system
operation. Within driving research, the following network metrics have been applied
to analyse EAST representations:
Density represents the level of interconnectivity between system agents. It is
expressed as a value between 0 and 1, where 0 represents a network that has no con-
nections and 1 indicates that the network is fully connected (Kakimoto et al. 2006).
It is calculated using the formula
where:
e is the total number of links within the network
n is the number of nodes within the network (Walker et al. 2012)
Diameter is used to analyse the connections and pathways that exist between
nodes within the network (Walker et al. 2011). Denser networks (i.e. the route
through the network is shorter and more direct) have smaller values. It is calculated
using the formula
Diameter = max uy d ( ni , n j )
where d(ni,nj) is the ‘largest number of [agents] which must be traversed in order to
travel from one [agent] to another when paths which backtrack, detour, or loop are
190 Systems Thinking in Practice
excluded from consideration’ (i.e. maxuy,) (Weisstein 2008; Harary 1994). Cohesion
represents the number of reciprocal connections divided by the total number of pos-
sible connections (Stanton 2014).
Finally, sociometric status provides an indication of agent prominence (Houghton
et al. 2006; Salmon et al. 2014). Key agents (i.e. those most prominent within the
network) have higher sociometric values (Salmon et al. 2012). It is calculated using
the formula
∑
1 g
Sociometric Status = ( x ji , xij )
( g − 1) j =1
where:
g is the total number of nodes in the network
i and j are individual nodes
xji are the number of communications between node j and node i
xij are the number of communications between node i and node j (Salmon et al.
2012; Houghton et al. 2006)
RESULTS
Identification of System Agents
For the purposes of this analysis, a total of 21 system agents were identified from
previous work conducted by Price (2016) and Banks and Stanton (2016). Their work
specifically sought to identify system agents involved in Traffic Management opera-
tions (e.g. Price 2016) and within automated driving environments (e.g. Banks and
Stanton 2016). The 21 agents broadly span three operational categories: RE, TMC
and EA (see Table 10.1 for complete list and descriptions). These agents represent the
main human and non-human entities that can be found within the road transportation
network.
Task Networks
On the basis of the list presented in Table 10.1, it is possible to consider the types of
tasks in which these system agents engage and how they may be related. This makes
it possible to construct a high-level task network for the entire road transportation
system involving all 21 agents. Walker et al. (2006) suggest that task networks can
show how sub-tasks may relate to other sub-tasks based upon their functional or
temporal properties.
The task network for the road transportation system, shown in Figure 10.1,
should be viewed as a continuous process to reflect the notion that the system always
remains active (i.e. 24 hours a day, 7 days a week). This network representation does
not consider any CAV or intelligent functionality. The task network portrays the rela-
tionships that exist between tasks in a non-sequential manner. Whilst not exhaustive,
this representation includes some of the main tasks (n=19) associated with RE, TMC
and EA agents (and the interconnections that may exist between them).
EAST in Future Road Transportation Systems 191
TABLE 10.1
System Agents Involved in the Road Transportation System
Operational
Category Subcategory Agent Description
Road Environment Drivers (DD / Host Driver The categories of individuals
(RE) – this DM)* Host Passenger occupying vehicles
category Other Drivers Role of driver dependent upon
represents all Other Passengers level of automation (DD, DM)
agents that are Vehicles (Connected Host Vehicle The categories of traffic using
present within and Autonomous Other Vehicles (or potentially using) the road
the road Vehicles; CAV) Services/Goods network
environment Vehicles Addition of intelligent sensors
Emergency Vehicles enable CAV function
External Roadside Traffic Monitoring E.g. CCTV cameras and
Equipment (ERE) Equipment induction loops
Traffic Management E.g. traffic lights and Variable
Equipment Message Signs (VMSs)
Vulnerable Road Users E.g. cyclists and pedestrians
(VRU)
Traffic Management Centre (TMC) – this TMC Operator Responsible for managing
category represents all agents that have traffic
direct access to information relating to Closed-Circuit Television Controls the TMC’s CCTV
the overall traffic situation (CCTV) Applications cameras
Urban Traffic Collects data relating to road
Management Control environment (e.g. vehicle
(UTMC) Applications counts)
Police Closed-Circuit Monitor CCTV for crime,
Television (CCTV) assisting police operations
Personnel
External Agencies (EA) – this category Radio Stations Distribute information to traffic
represents all agents that both share and and other agents
receive information relating to traffic Information Providers Provide additional information
situations (e.g. Met Office, Highways
England)
Other Transport Control Includes other road TMCs as
Centres well as public transport
control centres (e.g. Bus)
Emergency Services Manage emergency service
Control Centres operations
Traffic Data Distribution Dissemination of information
Services to traffic and third parties
Note: DD and DM reflect the ‘Driver Driving’ and ‘Driver Monitoring’ roles identified by Banks, V. A.
and Stanton, N. A., Theoretical Issues in Ergonomics Science, in press.
192 Systems Thinking in Practice
FIGURE 10.1 Task network showing high-level tasks essential for effective functioning of
the road transportation network.
Analysis of the task network presented above was conducted using AGNA (Benta
2005). The AGNA analysis indicates that the network can be described as binary (i.e.
it can be represented by a zero-one matrix) and symmetric (i.e. it is non-directed). In
total, the network has 68 connections (i.e. the number of in-out connections between
nodes). The network has a diameter of 6 (i.e. six hops from one side of the network to
the other) and a density score of 0.2 (i.e. a low distribution network).
However, in order to compare and contrast how non-CAV and CAV task networks
may differ, a combined networks approach was adopted (e.g. Stanton 2014). A com-
bined task and social network approach enables us to see ‘who’ is involved in com-
pleting tasks within the transportation network in parallel to keep the task network
functioning. In terms of DCOG, this approach provides a means to explore the allo-
cation of system function among social agents spanning the RE, TMC and EA cat-
egories (outlined in Table 10.1). For the purposes of discussion, the authors assume
that the same basic task network exists regardless of whether intelligent features
exist within it. Thus, Figure 10.2 represents the task network (shown in Figure 10.1)
coded by social agents for a non-CAV network, whilst Figure 10.3 represents the task
network for a CAV network – note that subcategories of RE have been added.
Figure 10.2 essentially demonstrates that 14 out of 20 tasks are completed in iso-
lation by a single agent category (i.e. RE, TMC or EA). In practical terms, this means
that there is a clear division between tasks associated with different agent categories.
Importantly, the role of the driver reflected within Figure 10.2 represents that of
‘Driver Driving’ (DD) (Banks and Stanton 2018). The DD role essentially represents
the idea that the driver is responsible for completing all of the physical and cognitive
tasks associated with driving (Walker et al. 2015) and is thus responsible for control-
ling the vehicle, avoiding hazards, navigating routes, obeying laws, monitoring traf-
fic and maintaining safety in the non-CAV network portrayed in Figure 10.2.
EAST in Future Road Transportation Systems 193
FIGURE 10.2 Task network for a non-CAV transportation network coded by social agents.
In contrast, Figure 10.3 represents the task network (coded by social agents) for
a CAV network. Here we see many more tasks becoming shared (i.e. completed
in parallel by two or more agents) in comparison to the non-CAV network. Tasks
completed in isolation appear to have halved as a result of CAV implementation.
This indicates that the divisions between the RE, TMC and EA categories are less
rigid, opening up possibilities to create new communication channels in an effort
to improve information sharing and network cohesiveness. ‘Task sharing’ is par-
ticularly more pronounced within the RE category, as CAV vehicles are capable of
completing the same tasks as a traditional DD. To acknowledge the changing role
of the driver within a CAV network, an additional driver role has been added to this
network representation. A Driver Monitor (DM) reflects the ‘intended’ supervisory
role of the driver during the intermediate phases of automation (Banks and Stanton
2018). A DM would need to continue monitoring the behaviour of the vehicle and
automated sub-systems despite the transfer of physical control and aspects of deci-
sion making to CAV vehicles. This is to ensure that safe and normal driving prac-
tice is maintained. Note that the role of DD remains in the representation to reflect
the potential for mixed traffic driving scenarios (e.g. both automated and manually
driven vehicles may occupy the road), but it also demonstrates further the utility of
CAV to perform all of the tasks typically associated with a DD.
Social Networks
To better understand the structure of communications that may occur between
agents within RE, TMC and EA, social networks were constructed to demonstrate
194 Systems Thinking in Practice
the directional flow of communication between system agents for both non-CAV
and CAV networks. Social networks essentially provide a means to assess the rela-
tionship (i.e. in terms of communication and activity) between different system
agents (Stanton 2014). ‘Communication’ between system agents can range from
being obvious (e.g. gestures between drivers such as flashing lights, radio broad-
casts sharing traffic updates, vehicle displaying information on internal interface to
alert driver to changes in system status, driver manipulating controls within vehicle
to alter its behaviour) to being ‘invisible’ (e.g. Urban Traffic Management Control
[UTMC] data can be used to change behaviour of traffic management equip-
ment). Simplified versions of these networks were then constructed and validated
by Subject Matter Experts (SMEs) for ease of interpretation and are presented in
Figures 10.4 and 10.5. Four SMEs from a leading automotive manufacturer and
members of the Human Factors Research Group at the University of Nottingham
were involved in this process, with a collective 18 years’ experience within the driv-
ing automation field.
Figure 10.4 presents a simplified social network of a non-CAV transportation
network. Here, we see that whilst links exist between the RE, TMC and EA, com-
munications typically remain within operational categories. In contrast, Figure 10.5
presents a social network for future CAV networks and shows that the links that
exist between different operational categories become stronger as new links are
formed. This is because wireless connectivity between vehicles and infrastructure
enables both intra-vehicle, inter-vehicle and real-time communication with traffic
management systems. CAV functionality therefore binds the social network more
EAST in Future Road Transportation Systems 195
Information Radio
Drivers
providers stations
External Roadside
equipment
Traffic data
Vehicles
distribution
TMC UTMC
Operator applications
Emergency vehicles
only
Services/
Goods
only Emergency Police CCTV Engineers
Other transport
services control personnel
control centres
centre
CCTV
applications
Information
Radio stations Drivers
providers
External Roadside
Equipment*
Traffic data
Vehicles*
distribution
TMC UTMC
Operator applications
CCTV
applications
TABLE 10.2
Contrasting Network Metrics for Non-CAV and
CAV Social Networks
Information Networks
The final representational medium within the EAST framework is information net-
works (Stanton et al. 2008, 2013; Walker et al. 2006, 2010). Information networks
detail aspects of communication that underpin the foundations of the system and
how they are linked. The process of constructing information networks typically
follows the interrogation of operator verbalisations. These may be captured using
observational notes, interviews and live audio feeds recorded during task comple-
tion (e.g. Walker et al. 2010). Information nodes are identified and then paired with
their closest relation. For example, nodes within the same sentence will be linked
EAST in Future Road Transportation Systems 197
TABLE 10.3
Contrasting Sociometric Status for Agents Involved in Non-CAV and CAV
Networks
Note: Highlighted Agents Yield Different Sociometric Status Values as a Result of CAV Implementation.
Asterisks Identify ‘Key’ Agents.
(e.g. Stanton 2014; Walker et al. 2010). This strategy quickly builds a network of
information concepts (Banks and Stanton 2018). According to Stanton (2014), infor-
mation may be related temporally or spatially to different agents or tasks. The infor-
mation network presented in Figure 10.6 was constructed based upon this strategy
and combines driver-orientated knowledge (see Banks and Stanton 2018) with TMC-
orientated knowledge (see Price 2016) to represent a non-CAV transportation net-
work. This representation contains 53 nodes and 119 connections and demonstrates
that in order to ensure the effective functioning of the road transportation network, a
plethora of information must be captured, processed and distributed between all of the
agents involved. In contrast, the information network representing the operation of a
CAV network has 18 additional nodes and a further 66 connections (see Figure 10.7).
These additional nodes essentially represent the information that can be generated
from the implementation of CAV into the network.
The information networks presented in Figures 10.6 and 10.7 were subjected to
further analysis using AGNA (Benta 2005), which showed that whilst network dyna-
mism does not significantly change at a global level (see Table 10.4), the CAV net-
work grows rapidly, even at a high level of analysis.
Underlying differences between non-CAV and CAV information networks is
important because we need to ensure that agents within the network are equipped
198 Systems Thinking in Practice
FIGURE 10.6 Information network for non-CAV networks (note that ‘key’ nodes high-
lighted in grey are based upon the calculation of sociometric status – see Table 10.5).
with ‘key’ knowledge about its functioning. Sociometric status was calculated to
assist in the identification of key informational nodes within the non-CAV and CAV
networks above. Data were ranked in descending order to enable the authors to high-
light key informational nodes within both non-CAV and CAV information networks.
The results are shown in Table 10.5 and appear to confirm that any node with four
FIGURE 10.7 Hypothetical information network for CAV networks (note that ‘key’ nodes
highlighted in grey are based upon the calculation of sociometric status – see Table 10.5).
EAST in Future Road Transportation Systems 199
TABLE 10.4
Comparison of Network Metrics Relating to the
Information Networks for Non-CAV and CAV
Networks
TABLE 10.5
Key Informational Nodes Based Upon Rank Sociometric
Status Scores
Non-CAV CAV
1 Strategy Connective functionality
2 Risk assessment Strategy
3 Traffic Risk assessment
4 Signage Traffic
5 Infrastructure Signage
6 Traffic type Infrastructure
7 Hazard type Traffic type
8 Time of occurrence System mode
9 Traffic management Feedback
10 Complexity Hazard type
DISCUSSION
This chapter presents a practical method for analysing and evaluating DCOG at
a macro level. Unlike previous applications that have tended to explore DCOG in
meso-level systems, the authors of this chapter have taken a much ‘broader’ systems
view. Rather than isolating a sub-system operating within a much larger sociotech-
nical system, the authors have taken the road transportation system as their ‘unit of
analysis’ (Grote et al. 2014). This in turn provides a macro-level account of DCOG
200 Systems Thinking in Practice
that has enabled us to explore the dependencies and interdependencies that exist
between human and non-human agents across different operational domains for both
non-CAV and CAV networks.
Inspired by Hutchins (1995), the authors have shown how cognitive processes
can be distributed socially across system agents and internal and external tasks and
through time (acknowledging that earlier processes may transform the nature of later
processing) using EAST. Although EAST has been primarily used to focus on meso-
level activities within varied domains (e.g. Baber et al. 2013; Banks and Stanton
2016; Stanton et al. 2006; Stanton 2014; Walker et al. 2006), this chapter shows that
network representations can also provide a means to explore macro-level DCOG
within much larger sociotechnical systems. Rather than focusing upon an individual
component of a system (for example, the RE), the authors have considered other
dependencies and interdependencies spanning multiple operational environments
(i.e. the inclusion of TMC and EA).
EAST was used to describe non-CAV and CAV networks in terms of task, social
and information networks to help improve our knowledge of how these systems may
work in practice. Whilst the network representations presented in this chapter are by
no means exhaustive, they do provide a basis for discussion into (a) the agents that
play a role in our road transportation system, (b) how these agents are connected to
one another, (c) the types of communication or information that are shared within the
network and (d) how this may change as a result of CAV implementation. Regardless,
any new conceptualisation based upon future transportation systems will need to
consider the changes in these sociotechnical networks.
The combined task and social network approach using the EAST framework can
provide insight into DCOG within the transportation network by identifying ‘who’
is doing ‘what’. It demonstrates that even though the underlying task network for
the transportation system remains the same, a connected and autonomous system
can lead to multiple system agents completing the same tasks in parallel. As long as
CAV architecture complements existing infrastructures and frameworks that uphold
non-CAV networks, tasks spanning the RE, TMC and EA categories could all ben-
efit from CAV implementation. Specifically, CAV should increase the efficiency
and reliability of network operations for all social agents involved (Talebpour and
Mahmassani 2016). However, there are a number of issues that must be considered
in order to make CAV networks a success. For example, there remain issues relating
to cybersecurity, compatibility of data sharing between different cloud computing
platforms and ‘car hacking’ (e.g. Checkoway et al. 2011; Frost and Sullivan 2014).
With non-human agents set to become the most prominent agents within a CAV net-
work, designers must ensure that cloud computing platforms are secure, reliable and
efficient. They must be capable of holding, processing, selecting and re-transmitting
relevant information to relevant social agents. A failure within the network could,
after all, have far-reaching implications in terms of RE, TMC and EA operations.
For example, a loss of network coverage could mean information is shared intermit-
tently, which will affect the reliability and efficiency of the network. It is therefore
important to consider the differences between CAV and non-CAV networks, because
until the network is fully connected (across space and time), transitions between
CAV and non-CAV operation are still likely to occur.
EAST in Future Road Transportation Systems 201
CONCLUSIONS
Vehicle automation and the connected services that they offer appear set to revolutio-
nise the way in which people interact with and behave within the road transportation
network. Essentially, CAV points to a future whereby most, if not all, of the poten-
tial communication links between vehicles and infrastructure within the RE may be
connected. Thus, rather than CAV eliminating ergonomics and human factors issues
from the transportation network entirely, it could actually increase the importance of
them as it highlights the types of activities human and non-human agents will engage
in. Whilst networked simulators exist, enabling multiple drivers to interact in a single
virtual environment, research outputs are limited to a single operational environment
(e.g. Sawyer and Hancock 2012). Thus, it has only been possible to explore how
intelligent transport systems, such as CAV, will impact individual agents involved
within the road environment. EAST goes further than this and provides a framework
that can enable researchers to visualise the impact of CAV on a much larger scale.
Adopting sociotechnical systems design in this way could offer a means to improve
the performance of the whole system rather than individual components in isolation
(Stanton 2014). Modelling system interaction between system agents can provide
an extensive qualitative overview of DCOG within large-scale network operations.
REFERENCES
Atkins Mobility. (2016). Connected & autonomous vehicles: Introducing the future of mobil-
ity. Available at http://www.atkinsglobal.co.uk. [Accessed 10.01.2017].
Baber, C., Stanton, N. A., Atkinson, J., McMaster, R. and Houghton, R. J. (2013). Using
social network analysis and agent-based modelling to explore information flow using
common operational pictures for maritime search and rescue operations. Ergonomics,
56(6), 889–905.
Banks, V. A. and Stanton, N. A. (2016). Driver-centred vehicle automation: Using network
analysis for agent-based modelling of the driver in highly automated driving systems.
Ergonomics, 59(11), 1442–1452.
202 Systems Thinking in Practice
Banks, V. A. and Stanton, N. A. (2018). Analysis of driver roles: Modelling the changing
role of the driver in automated driving systems using EAST. Theoretical Issues in
Ergonomics Science, (In press).
Banks, V. A., Stanton, N. A. and Harvey, C. (2014). Sub-systems on the road to vehicle auto-
mation: Hands and feet free but not ‘mind’ free driving. Safety Science, 62, 505–514.
Benta, M. (2005). Studying communication networks with AGNA 2.1. Cognition Brain
Behaviour, 9, 567–574.
Checkoway, S., McCoy, D., Kantor, B., Anderson, D., Shacham, H., Savage, S., Koscher, K.,
Czeskis, A., Roesner, F. and Kohno, T. (2011). Comprehensive experimental analy-
ses of automotive attack surfaces. Proceedings of USENIX Security Symposium. San
Francisco, CA.
Christoffersen, K. and Woods, D. D. (2002). How to make automated systems team players.
Advances in Human Performance and Cognitive Engineering Research, 2, 1–12.
De La Fortelle, A. (2005). Cybercars: Past, present and future of the technology. 12th Word
Congress on Intelligent Transport Systems. San Francisco, CA.
Eriksson, A. and Stanton, N. A. (2017). Takeover time in highly automated vehicles:
Noncritical transitions to and from manual control. Human Factors, 59(4), 689–705.
DOI:10.1177/0018720816685832.
European Road Transport Research Advisory Council (ERTRAC). (2015). ERTRAC auto-
mated driving roadmap, July 2015. [Accessed 12.13.2016].
Frost and Sullivan. (2014). Cybersecurity in the automotive industry. 30 October. https://
www.ertrac.org/uploads/documentsearch/id38/ERTRAC_Automated-Driving-2015.
pdf [Accessed 01.09.2017].
Grote, G., Stanton, N. A. and Weyer, J. (2014). Beyond human-centred automation.
Ergonomics, 57(3), 289–294.
Harary, F. (1994). Graph Theory. Addison-Wesley: Reading, MA.
Hollan, J., Hutchins, E. and Kirsh, D. (2000). Distributed cognition: Toward a new foundation
for human–computer interaction research. ACM Transactions on Computer Human
Interaction, 7, 174–196.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P. M., Stewart, R. and
Walker, G. H. (2006). Command and control in emergency services operations: A
social network analysis. Ergonomics, 49, 1204–1225.
Hutchins, E. (1995). How a cockpit remembers its speeds. Cognitive Science, 19(3), 265–288.
KPMG. (2015). Connected and autonomous vehicles – The UK economic opportunity. Available
at: https://www.smmt.co.uk/wp-content/uploads/sites/2/CRT036586F-Connected-
and-Autonomous-Vehicles-%E2%80%93-The-UK-Economic-Opportu.1.pdf.
Lavrinc, D. (2014). This is how bad self-driving cars suck in the rain. Available at: http://
jalopnik.com/this-is-how-bad-self-driving-cars-suck-in-the-rain-.
Louw, T. and Merat, N. (2017). Are you in the loop? Using gaze dispersion to understand
driver visual attention during vehicle automation. Transportation Research Part C:
Emerging Technologies, 76, 35–50.
Price, J. (2016). Human factors in the design of traffic management systems. University of
Southampton, Faculty of Engineering and the Environment, London. EngD thesis.
Rudin-Brown, C. M. and Parker, H. A. (2004). Behavioural adaptation to adaptive cruise con-
trol (ACC): Implications for preventative strategies. Transportation Research Part F,
7(2), 59–76.
Salmon, P. M., Lenné, M. G., Walker, G. H., Stanton, N. A. and Filtness, A. (2014). Using the
event analysis of systemic teamwork (EAST) to explore the conflicts between different
road user groups when making right hand turns at urban intersections. Ergonomics, 57
(11), 1628–1642.
EAST in Future Road Transportation Systems 203
Salmon, P. M., Stanton, N. A. and Young K. L. (2012). Situation awareness on the road:
review, theoretical and methodological issues, and future directions. Theoretical Issues
in Ergonomics Science, 13(4), 472–492.
Sawyer, B. D. and Hancock, P. A. (2012). Development of a linked simulation network to
evaluate intelligent transportation system vehicle to vehicle solutions. Proceedings of
the Human Factors and Ergonomics Society Annual Meeting, 56(1), 2316–2320.
Science and Technology Select Committee. (2017). Connected and autonomous vehicles: The
future? Available at: https://www.publications.parliament.uk/pa/ld201617/ldselect/
ldsctech/115/115.pdf.
Society for Automotive Engineers. (2016). Taxonomy and definitions for terms related to on-
road motor vehicle automated driving systems. http://standards.sae.org/j3016_201401/
[Accessed 12.12.2016].
Sorensen, L. J., Stanton, N. A. and Banks, A. P. (2011). Back to SA school: Contrasting three
approaches to situation awareness in the cockpit. Theoretical Issues in Ergonomics
Science, 12(6), 451–471.
Stanton, N. A. (2014). Representing distributed cognition in complex systems: How a subma-
rine returns to periscope depth. Ergonomics, 57(3), 403–418.
Stanton, N. A. (2015). Responses to autonomous vehicles. Ingenia, 62, 9.
Stanton, N. A., Baber, C. and Harris, D. (2008). Modelling Command and Control: Event
Analysis of Systemic Teamwork. Ashgate: Aldershot, UK.
Stanton, N. A. and Harvey, C. (2017). Beyond human error taxonomies in assessment of risk
in sociotechnical systems: A new paradigm with the EAST ‘broken-links’ approach.
Ergonomics, 60(2), 221–233.
Stanton, N. A. and Roberts, A. P. J. (2017a). Examining task, social and information networks
in submarine command and control. IEEE Transactions on Human-Machine Systems,
DOI: 10.1109/THMS.2017.2720659.
Stanton, N. A., Roberts, A. P. J. and Fay, D. T. (2017b). Up periscope: Understanding sub-
marine command and control teamwork during a simulated return to periscope depth.
Cognition, Technology and Work, 19 (2–3), 399–417.
Stanton, N. A., Salmon, P. M., Rafferty, L., Walker, G. H., Baber, C. and Jenkins, D. P. (2013).
Human Factors Methods: A Practical Guide for Engineering and Design. Ashgate:
Aldershot, UK.
Stanton, N. A., Salmon, P. M. and Walker, G. H. (2015). Let the reader decide: A para-
digm shift for situation awareness in sociotechnical systems. Journal of Cognitive
Engineering and Decision Making, 9 (1), 44–50.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon,
P. M. et al. (2006). Distributed situation awareness in dynamic systems: Theoretical
development and application of an ergonomics methodology. Ergonomics, 49 (12–13),
1288–1311.
Talebpour, A. and Mahmassani, H. S. (2016). Influence of connected and autonomous vehicles
on traffic flow stability and throughput. Transportation Research Part C: Emerging
Technologies, 71, 143–163.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. and Green, D. (2006). Event
analysis of systematic teamwork (EAST): A novel integration of ergonomic methods to
analyse C4i activity. Ergonomics, 49 (12–13), 1345–1369.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Gibson, H., Salmon, P. and Jenkins, D.
(2010). From ethnography to the EAST method: A tractable approach for representing
distributed cognition in Air Traffic Control. Ergonomics, 53 (2): 184–197.
Walker, G. H., Stanton, N. A. and Salmon, P. M. (2015). Human Factors in Automotive
Engineering and Technology. Ashgate: Aldershot, UK.
204 Systems Thinking in Practice
INTRODUCTION
The popularity of systems thinking is now such that various systems ergonomics
methods are being applied across the transport domains, including rail (Salmon et al.
2016b; Stefanova et al. 2015), road (Parnell et al. 2017; Salmon et al. 2016a), aviation
(Allison et al. 2017) and maritime transport (Lee et al. 2017). In the case of rail trans-
port specifically, these methods have been applied to a diverse set of issues, including
railway level crossings (RLXs) (Salmon et al. 2016b; Stefanova et al. 2015), ticketing
system design (Read et al. 2015), accident analysis (Chen et al. 2015; Ouyang et al.
2010; Salmon et al. 2013), signals passed at danger (Madigan et al. 2016) and train
cabin design (Jansson et al. 2006). Given the increasing complexity of rail transport
systems, it is likely that systems ergonomics methods will increasingly be applied for
analysis and design in rail systems worldwide.
Although all of these methods share a common alignment with systems theory,
most have differing theoretical underpinnings, giving rise to their own unique
analysis approach. Systems Theoretic Accident Model and Process (STAMP), for
example, is based on control theory and seeks to identify what control structure is
in place in a given system and, in the event of an accident, how the adaptive control
function within the system failed. Event Analysis of Systemic Teamwork (EAST),
on the other hand, focuses on the relationship between tasks, agents and informa-
tion and uses networks to identify issues that impact performance (e.g. information
bottlenecks, overloaded agents). Further differences can be found when considering
the focus of other systems ergonomics methods such as Hierarchical Task Analysis
(goals), Cognitive Work Analysis (CWA) (constraints) and Functional Resonance
Analysis Method (FRAM) (performance variability and resonance). As a result, each
systems ergonomics method brings with it a unique set of strengths and weaknesses,
207
208 Systems Thinking in Practice
and there has been much discussion on the potential benefits of converging different
methods together (Dallat et al. in press; Houghton et al. 2015; Naweed 2014; Salmon
et al. 2010, 2011; Stanton et al. 2013, 2016; Patriarca et al. 2017).
Researchers and practitioners are therefore beginning to explore the utility of
integrating systems ergonomics methods. Patriarca et al. (2017) combined the
abstraction hierarchy from CWA with FRAM, suggesting that using the two in
an integrated manner enables additional analyses of intra-agent and intra-system-
level interactions. Houghton et al. (2015) combined social network analysis (SNA)
and CWA to examine military planning tasks, concluding that using the two
approaches together enables a richer understanding of system structure. Stanton
et al. (2016) integrated CWA and SNA to compare different cockpit crewing con-
figurations and their likely impact on safety on future flight decks. CWA was used
to define system constraints, whereas SNA metrics were used as a measure of
system resilience. Given that modern-day systems are stretching the capabilities
of our methodological toolkit (Salmon et al. 2017; Walker et al. 2017), and the fact
that many methods do not fully align with systems thinking, it is our opinion that
the integration of systems ergonomics methods represents an important area of
investigation for our discipline. This builds on a long history and tradition of meth-
ods integration in ergonomics research and practice (e.g. Kirwan 1992; Stanton
et al. 2005, 2013).
In the case of EAST, it is apparent that adding further forms of network may
enhance the utility of the framework. Candidate additional EAST networks that the
authors have discussed include a network of safety controls, a network of unexpected
emergent behaviours and a risk network. This chapter investigates the utility of add-
ing a safety controls network based on principles from the STAMP method (Leveson
2004). To test this, we undertook a case study in which EAST and an additional
control network were used to examine safety management during the design and
operation of RLXs systems in Victoria, Australia. The four networks were used to
examine the system and its safety controls with a view to identifying recommenda-
tions for strengthening safety management at RLXs.
represent an area of strategic importance for road and rail safety authorities (Read
et al. 2017).
Analyses of fatal collisions provide evidence that RLX collisions have a complex
web of interrelated causes spanning overall road and rail systems. In short, they are
a systems problem (Read et al. 2017; Salmon et al. 2016b; Stefanova et al. 2015). This
has important implications for the methods used to understand and improve RLX
safety. Describing and understanding RLX systems requires analysis methods that
consider the behaviour of overall road and rail systems (Read et al. 2013; Wilson and
Norris 2014). Key elements requiring analysis include
• the tasks that are undertaken across the system as part of RLX design and
operation
• the diverse set of agents that reside within the RLX system and undertake
design and operation tasks
• the interactions between agents (human and non-human) when undertak-
ing these tasks
• the information required for successful completion of these tasks
• the factors influencing behaviour across the system, including safety con-
trols, environmental factors and financial and production pressures
It is apparent that no one method can completely fulfil these requirements. EAST,
for example, considers tasks, agents and information but does not explicitly consider
safety controls and their impact on behaviour. STAMP, on the other hand, consid-
ers controls but does not detail the tasks and information required when enacting
controls. It is our contention, then, that a richer analysis of sociotechnical systems
behaviour can be achieved by integrating different systems ergonomics methods.
The study was undertaken to identify the range of factors influencing behav-
iour and safety in RLX systems and to identify opportunities for introducing new
interventions design to improve safety. To achieve this, the EAST framework and
STAMP control structure methods were integrated and used together to examine a
RLX system ‘lifecycle’, including all activities involved in the design, implementa-
tion, operation and removal (for grade separation) of RLXs in Victoria, Australia.
A short description of how EAST and the STAMP control structure principles were
integrated is given below.
campaigns and road rules and regulations fail to prevent drivers from attempting to
traverse the crossing when a train is present. STAMP therefore views safety as an
issue of control and one that is managed through a control structure that has the goal
of enforcing constraints on actors across the system.
It is worth noting that a broad view of control is adopted when using STAMP.
Leveson (2004) describes various forms of control, including managerial, organ-
isational, physical, operational and manufacturing-based controls; that is, system
behaviour is controlled not only by engineered systems and direct intervention but
also by policies, procedures, shared values and other aspects of the surrounding
organisational and social culture. The first phase of STAMP involves building a
control structure to describe the system under analysis and the control relationships
that exist between actors and organisations related to both system design and sys-
tem operation. The control structure model views systems as comprising interrelated
components that maintain a state of dynamic equilibrium through feedback loops
of control and information (Leveson 2004). Accordingly, control structure models
incorporate a series of hierarchical system levels and describe the actors and organ-
isations that reside at each level. Control and feedback loops are included to show
what control mechanisms are enacted down the hierarchy and what information
about the status of the system is sent back up the hierarchy.
A generic control structure model is presented in Figure 11.1 (Leveson 2004).
The left-hand side of Figure 11.2 shows a generic control structure for system devel-
opment, whereas the right-hand side shows a generic control structure for system
System Development System Operations
Operating assumptions
Design, Documentation Operating procedures
Operating process
Human controller
Safety reports
Safety constraints Test reports
Standards Hazard analyses
Test requirements Review results
Automated
Manufacturing controller
management
Implementation and assurance
Safety reports Revised procedures Actuator(s) Sensor(s)
Work
Audits
procedures Work logs Software revisions
Inspections Hazard analyses Hardware replacement
Documentation Physical
Design rationale process
Manufacturing
Maintenance and Problem reports
evolution Incidents
Performance audits
CONTROL NETWORK
TASK
NETWORK
INFORMATION SOCIAL
NETWORK NETWORK
FIGURE 11.2 EAST network of network approach with added control network.
operation. The arrows flowing down the hierarchy represent control relationships (or
reference channels, Leveson 2004), and the arrows flowing up the hierarchy repre-
sent feedback loops (or measuring channels, Leveson 2004). In relation to the exam-
ple described above, the rail level crossing infrastructure would enact the control
of ‘warnings’ on road users. In turn, information regarding collisions, near misses,
violations of the warnings and road rules and maintenance requirements for the
warning infrastructure represent forms of feedback that would be passed back up the
system. These feedback loops enable road and rail safety authorities and policy mak-
ers to assess the status of controls and whether they are having the desired impact.
The control structure has been employed as a modelling tool to describe systems
and the control and feedback loops involved in safety management (Salmon et al.
2016a). Whilst the usefulness of the control structure has been reported, there are
some notable limitations: (1) it describes control and feedback loops only and does
not examine the relationships between controls; (2) it is difficult to represent control
and feedback loops that exist between actors and/or organisations within levels of the
212 Systems Thinking in Practice
hierarchy; and (3) it is often difficult to place actors and organisations across the five
levels provided (Salmon et al. 2016a).
Information B Information C
Agent A Agent B
Task A
Control A Control B
For example, the task of negotiating a RLX safely is a task undertaken by both
road vehicle drivers (Agent A) and train drivers (Agent B). When negotiating the
RLX, both use various pieces of information such as the status of the warning
devices, the speed and location of the train and the behaviour of other users such
as pedestrians. Road vehicle drivers and train drivers are bound by controls such as
the warnings themselves, rules and regulations and standard operating procedures.
Likewise, the nature of information they are using is influenced by controls such as
design standards (e.g. timing of warnings). It is important to note that controls are
enacted on tasks, agents and information and also on the interactions between them.
For example, various controls at the RLX (e.g. boom gates, flashing lights, train
horn, road rules and regulations) are designed to manage the interactions between
drivers, their vehicle and train drivers and the train.
The task, social and information networks were developed based on a process of
first identifying nodes, then identifying relationships between the nodes and finally
by reviewing the nodes and relationships for internal consistency. The analysis rules
surrounding what constituted a node and a relationship for each network representa-
tion are presented in Table 11.1.
Following the workshop, a draft control network was constructed by two analysts
based on a review of Salmon et al.’s (2016a) in-depth analysis of rail level crossing
systems; Salmon et al.’s (2016b) road safety control structure; and a STAMP control
structure model of rail safety under development by the authors as part of a separate
project. Development of the control network followed the process above whereby
nodes (controls) were first identified followed by the relationships between them (see
Table 11.1 for examples). The draft control structure was subsequently reviewed by
the other analysts from the original workshop.
Network Analysis
Each network was analysed using quantitative metrics that have previously been
used to interrogate EAST networks (e.g. Salmon et al. 2014; Stanton 2014). In the
present study, the following metrics were applied to each network:
TABLE 11.1
Analysis Rules Regarding Relationships between Nodes in EAST Networks in
the Context of RLX Design, Implementation, Operation or Removal
nodes in the network (Houghton et al. 2006). Central nodes represent those
that are closer to the other nodes in the network as, for example, informa-
tion passed from one to another node in the network would travel through
less nodes. Houghton et al. (2006) point out that well-connected nodes can
still achieve low centrality values as they may be on the periphery of the
network. For example, in the case of the control network nodes, higher
216 Systems Thinking in Practice
centrality status values are those that are closest to all other controls in the
network as they have direct rather than indirect links with them.
RESULTS
Task Network
The RLX system lifecycle task network is presented in Figure 11.4. The outcomes for
the task network analysis are presented in Table 11.2. For the sociometric status and
centrality analysis, Table 11.2 includes the values for the nodes that scored above the
mean sociometric status and centrality values for the network. Nodes that achieved
values above the mean + standard deviation for sociometric status and centrality are
shaded grey.
As shown in Figure 11.4, the RLX system lifecycle is underpinned by a network
of 15 high-level tasks. Analysis of the task network in Table 11.2 reveals a network
density of 0.2, which is indicative of a relatively loosely connected network (i.e. tasks
are not tightly coupled). The sociometric status and centrality analyses reveal that
‘Risk management’ and ‘Monitor performance’ are the key tasks within the network.
Social Network
The RLX system lifecycle social network is presented in Figure 11.5. The outcomes
for the SNA are presented in Table 11.3. Table 11.3 follows the same convention as
Table 11.2 for the sociometric status and centrality values.
As shown in Figure 11.5, a diverse set of 27 agents undertake tasks throughout the
RLX system lifecycle and operation. These agents range from RLX components (e.g.
barriers, flashing lights), RLX users (e.g. drivers, pedestrians, road vehicles, trains),
infrastructure owners and rail operators to the regulator, government departments,
unions, courts and the media. Analysis of the social network shown in Table 11.3
reveals a network density of 0.18, which is again indicative of a relatively loosely
connected network in which agents are not tightly coupled. The sociometric sta-
tus and centrality analysis reveals that ‘Government departments’, ‘Rail operators’,
‘Rail infrastructure managers’, ‘Regulators’ (sociometric status) and ‘Train drivers’
(Centrality only) are key agents in the RLX system lifecycle.
Information Network
The RLX system lifecycle information network is presented in Figure 11.6. The out-
comes for the information network analysis are presented in Table 11.4. Table 11.4
follows the same convention as Table 11.2 for the sociometric status and centrality
values.
As shown in Figure 11.6, 28 information nodes are required throughout the RLX
system lifecycle. Analysis of the information network in Table 11.5 reveals a network
density of 0.09, which is indicative of a very loosely connected network. The socio-
metric status analysis reveals that ‘Risk level’ and ‘Design concepts’ are the key nodes
STAMPING on EAST 217
Grade
Close RLX
separate
Check Performance
compliance with monitoring
legislation
Operate RLX
Design
Announce Determine
upgrade Manage
upgrade infrastructure
and issue infrastructure
programme required
tender
Identify
and consult Commission
with RLX and
user construct RLX
community Continuous
improvement of
standards
Budget
allocated to RLX
program
TABLE 11.2
Task Network Analysis Outputs
Note: Cells Shaded Grey Represent Nodes with Values above the Mean + Standard Deviation.
Standard
Courts
setting bodies Other Rail Ops
Local Govts Media
staff
Rail
infrastructure Rail operators
managers Advocacy
Police
groups
Signallers Unions
Commercial
Trackworkers
companies
Construction
Train control and
systems Maintenance
contractors
RLX warnings Professional
and barriers drivers
Local
community
TABLE 11.3
Social Network Analysis Outputs
Note: Cells Shaded Grey Represent Nodes with Values above the Mean + Standard Deviation.
within the information network. The key nodes according to the centrality analysis are
‘Budget’, ‘Demographics’, ‘Mitigations’, ‘Speed’ and ‘Surrounding land use’.
Control Network
The RLX system lifecycle control network is presented in Figure 11.7. The outcomes
for the control network analysis are presented in Table 11.5. Table 11.5 follows the
same convention as Table 11.2 for the sociometric status and centrality values.
As shown in Figure 11.7, 30 controls are present that constrain activities across
the RLX system lifecycle. Analysis of the control network in Table 11.5 reveals a
network density of 0.11, which is indicative of a relatively loosely connected net-
work. The sociometric status analysis reveals that ‘Audits and Inspections’, ‘Design
standards’ and ‘Road rules’ are the key controls within the control network. Key
controls according to the centrality analysis are ‘Insurance premiums’, ‘Timetables’
and ‘Train protection devices’. Other nodes that achieved sociometric status and cen-
trality scores above the mean include controls relating to the RLX itself (e.g. ‘Train’,
‘Vehicle’, ‘Signals’); safety strategy (e.g. ‘Policy and strategy’, ‘Targets’); enforcement
(e.g. ‘Enforcement’, ‘Legal Penalties’); and education (e.g. ‘Education’, ‘Initiatives’).
DISCUSSION
This chapter presents the findings from a case study in which a control network
was added to EAST to enable EAST to incorporate a control network analysis.
220 Systems Thinking in Practice
Polices and
Hazards
procedures
Warnings and
Disrupons Prompts Site condions
Incidents and
Near misses Compliance
Surrounding
Demographics
land use
Stakeholder Legislave
preferences reqs
Separaon
Traffic Competence
Design
Tender reqs
concepts
Complaints and
Migaons
feedback
TABLE 11.4
Information Network Analysis Outputs
Note: Cells Shaded Grey Represent Nodes with Values above the Mean + Standard Deviation.
TABLE 11.5
Control Network Analysis Outputs
Note: Cells Shaded Grey Represent Nodes with Values above the Mean + Standard Deviation.
The intention was to extend EAST’s utility for analysing the behaviour of complex
sociotechnical systems. The addition of a control network analysis component to
EAST enables analysts to identify the system of controls present within a par-
ticular system and to examine how different controls are related to one another.
222 Systems Thinking in Practice
Policy/
Finances/
Strategy Targets
funding
Franchise
agreements Design
standards
Education
Initiatives
Social
norms
Road rules
Safe
working
rules Legal
penalties
e.g. fines
Boom
gates
Enforcement
Flashing
lights
SOPs
Road
markings
Accreditation,
Registration
and Licencing
Signage
Audits and
Inspections
Road
Training
Vehicle
Insurance
premiums
Fences
Timetables
Track
Signals
Horn Train
Train protection
devices
Integration with the task, social and information networks also allows analysts
to examine the relationship between controls and tasks, agents and information
as well as the extent to which controls are likely to be effective. Finally, network
metrics can be used to compare the relevant importance of controls. This provides
an additional capability over and above the STAMP control structure, and it is
anticipated that it will useful for safety critical systems that rely heavily on the use
of controls to manage risk.
An important contribution of the analysis presented was the use of EAST to
describe and analyse the overall sociotechnical system – in this case, the RLX
STAMPING on EAST 223
system design lifecycle. This is a key capability of the framework; however, few
EAST analyses have sought to examine overall sociotechnical systems. The analysis
presented in this chapter demonstrates that it is possible to use EAST to analyse the
behaviour of overall systems and that a richer analysis is produced in doing so. It is
hoped that readers of this book will be encouraged to apply EAST to analyse entire
sociotechnical systems in other areas.
CONCLUSION
This chapter has demonstrated an extended version of the EAST framework that
enables it to analyse risk controls in addition to task, social and information net-
works. This extension enhances the analytical and explanatory power of the EAST
framework, and the analysis presented provides a rich understanding of the RLX
224 Systems Thinking in Practice
REFERENCES
Allison, C., Revell, K. M. A., Sears, R. and Stanton, N. A. (2017). Systems Theoretic Accident
Model and Process (STAMP) safety modelling applied to an aircraft rapid decompres-
sion event. Safety Science, vol. 98, October 2017, pp. 159–166.
Australian Transport Safety Bureau. (2012). Australian Rail Safety Occurrence Data: 1
July 2002 to 30 June 2012 (ATSB Transport Safety Report RR-2012-010). Canberra,
Australia: ATSB.
Chen, L., Zhao, Y. and Zhao, T. (2015). An AcciMap analysis on the China-Yong-Wen rail-
way accident. In: P. W. Tse et al. (Eds.), Engineering Asset Management-Systems,
Professional Practices and Certification. New York City, NY: Springer International
Publishing, 1247–1253.
Dallat, C., Salmon, P. M. and Goode, N. (in press). Risky systems versus risky people: To
what extent do risk assessment methods consider the systems approach to accident
causation? A review of the literature. Safety Science, accepted for publication March
2017.
Evans, A. W. (2011). Fatal accidents at railway level crossings in Great Britain 1946–2009.
Accident Analysis & Prevention, 43(5), 1837–1845.
Federal Railroad Administration. (2013). Railroad Safety Statistics 2012 Preliminary Annual
Report. Department of Transportation, Washington, D.C.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P. M., Stewart, R. and
Walker, G. H. (2006). Command and control in emergency services operations: A
social network analysis. Ergonomics, 49, 1204–1225.
Houghton, R. J., Baber, C., Stanton, N. A., Jenkins, D. P., Revell, K. (2015). Combining net-
work analysis with Cognitive Work Analysis: insights into social organisational and
cooperation analysis. Ergonomics, 58:3, 434–449.
Independent Transport Safety Regulator. (2011). Level crossing accidents in Australia. ITSR,
Sydney. Available at: http://www.onrsr.com.au/__data/assets/pdf_file/0020/2963/Transport-
safety-bulletin-Issue-2-Level-crossing-accidents-in-Australia-August-20112.PDF.
Accessed 10/02/15.
Jansson, A., Olsson, E. and Erlandsson, M. (2006). Bridging the gap between analysis and
design: Improving existing driver interfaces with tools from the framework of cognitive
work analysis. Cognition, Technology & Work, 8, 41–49.
Karsh, B. T., Waterson, P. and Holden, R. J. (2014). Crossing levels in systems ergonomics:
A framework to support ‘mesoergonomic’ inquiry. Applied Ergonomics, 45(1), 45–54.
Kirwan, B. (1992). Human error identification in human reliability assessment: Part 2:
detailed comparison of techniques. Applied Ergonomics, 23, 371–381.
Lee, S., Bo Moh, Y., Tabibzadeh, M. and Meshkati, N. (2017). Applying the AcciMap
methodology to investigate the tragic Sewol Ferry accident in South Korea. Applied
Ergonomics, 59(B), 517–525.
Leveson, N. G. (2004). A new accident model for engineering safer systems. Safety Science,
42(4), 237–270.
STAMPING on EAST 225
Madigan, R., Golightly, D. and Madders, R. (2016). Application of Human Factors Analysis
and Classification System (HFACS) to UK rail safety of the line incidents. Accident
Analysis & Prevention, 97, 122–131.
Naweed, A. (2014). Investigations into the skills of modern and traditional train driving.
Applied Ergonomics, 45(3), 462–470.
Naweed, A., Rainbird, S. and Dance, C. (2015). Are you fit to continue? Approaching rail
systems thinking at the cusp of safety and the apex of performance. Safety Science,
76, 101–110.
Newnam, S., and Goode, N. (2015). Do not blame the driver: A systems analysis of the causes
of road freight crashes. Accident Analysis & Prevention, 76, 141–151.
Office of the National Rail Safety Regulator. (2016). Rail Safety Report 2015–2016. Office of
the National Rail Safety Regulator: Adelaide, Australia.
Ouyang, M., Hong, L., Yu, M-H. and Fei, Q. (2010). STAMP-based analysis on the railway
accident and accident spreading: Taking the China–Jiaoji railway accident for example.
Safety Science, 48(5), 544–555.
Parnell, K., Stanton, N. A. and Plant, K. L. (2017). What’s the law got to do with it? Legislation
regarding in-vehicle technology use and its impact on driver distraction. Accident
Analysis and Prevention, 100, 1–14.
Patriarca, R., Bergström, J. and Di Gravio, G. (2017). Defining the functional resonance anal-
ysis space: Combining abstraction hierarchy and FRAM. Reliability Engineering &
System Safety, 165, 34–46.
Rasmussen, J. (1997). Risk management in a dynamic society: A modelling problem. Safety
Science, 27(2/3), 183–213.
Read, G., Salmon, P. M. and Lenné, M. G. (2013). Sounding the warning bells: The need for a
systems approach to rail level crossing safety. Applied Ergonomics, 44, 764–774.
Read, G., Salmon, P. M. and Lenné, M. G. (2016). When paradigms collide at road and rail
interface. Ergonomics, 59(9), 1135–1157.
Read, G., Salmon, P. M, Lenné, M. G. and Jenkins, D. P. (2015). Designing a ticket to ride
with the Cognitive Work Analysis Design Toolkit. Ergonomics, 58(8), 1266–1286.
doi:10.1080/00140139.2015.1013576.
Read., G. J. M., Beanland, V., Lenné, M. G., Stanton, N. A. and Salmon, P. M. (2017).
Integrating Human Factors Methods and Systems Thinking for Transport Analysis and
Design. CRC Press: Boca Raton, FL.
Salmon, P. M., Lenné, M. G., Mulvihill, C., Young, K., Cornelissen, M., Walker, G. H. and
Stanton, N. A. (2016b). More than meets the eye: Using cognitive work analysis to
identify design requirements for safer rail level crossing systems. Applied Ergonomics,
53(Part B), 312–322.
Salmon, P. M., Lenné, M. G., Walker, G. H., Stanton, N. A. and Filtness, A. (2014). Using the
Event Analysis of Systemic Teamwork (EAST) to explore conflicts between different
road user groups when making right hand turns at urban intersections. Ergonomics,
57(11), 1628–1642.
Salmon, P. M., Read, G., Stanton, N.A . and Lenné, M. G. (2013). The Crash at Kerang:
Investigating systemic and psychological factors leading to unintentional non-compli-
ance at rail level crossings. Accident Analysis and Prevention, 50, 1278–1288.
Salmon, P. M., Read, G. J. M. and Stevens, N. (2016). Who is in control of road safety?
A STAMP control structure analysis of the road transport system in Queensland,
Australia. Accident Analysis and Prevention, 96, 140–151.
Salmon, P. M., Stanton, N. A., Jenkins, D. P. and Walker, G. H. (2010). Hierarchical task
analysis versus cognitive work analysis: Comparison of theory, methodology, and con-
tribution to system design. Theoretical Issues in Ergonomics Science, 11(6), 504–531.
226 Systems Thinking in Practice
Salmon, P. M., Walker, G. H., Read, G. J. M., Goode, N. and Stanton, N. A. (2017). Fitting
methods to paradigms: Are ergonomics methods fit for systems thinking? Ergonomics,
60(2), 194–205.
Stanton, N. A. (2006). Hierarchical task analysis: Developments, applications, and exten-
sions. Applied Ergonomics, 37(1), 55–79.
Stanton, N. A. (2014). Representing distributed cognition in complex systems: How a subma-
rine returns to periscope depth. Ergonomics, 57(3), 403–418.
Stanton, N. A., Harris, D. and Starr, A. (2016). The future flight deck: Modelling dual, single
and distributed crewing options. Applied Ergonomics, 53, 331–342.
Stanton, N. A., Salmon, P. M., Rafferty, L., Walker, G., Baber, C. and Jenkins, D. P. (2013).
Human Factors Methods: A Practical Guide for Engineering and Design. Second
Edition. Ashgate: Aldershot, UK.
Stanton, N. A., Salmon, P. M., Walker, G. H., Baber, C. and Jenkins, D. (2005) Human
Factors Methods: A Practical Guide for Engineering and Design. First Edition.
Ashgate: Aldershot, UK.
Stanton, N. A. and Walker, G. H. (2011). Exploring the psychological factors involved in the
Ladbroke Grove rail accident. Accident Analysis & Prevention, 43(3), 1117–1127.
Stefanova, T., Burkhardt, J.-M., Filtness, A., Wullems, C., Rakotonirainy, A. and Delhomme, P.
(2015). Systems-based approach to investigate unsafe pedestrian behaviour at level
crossings. Accident Analysis & Prevention, 81, 167–186.
Tooth, R. and Balmford, M. (2010). Railway Level Crossing Incident Costing Model. LECG
for the Rail Industry Safety and Standards Board: Canberra, Australia.
Vicente, K. J. (1999). Cognitive Work Analysis: Toward Safe, Productive, and Healthy
Computer-based Work. Lawrence Erlbaum Associates: Mahwah, NJ.
Vivekanandan Dhukaram, A. and Baber, C. (2015). Modelling elderly cardiac patients deci-
sion making using Cognitive Work Analysis: Identifying requirements for patient deci-
sion aids. International Journal of Medical Informatics, 84(6), 430–443.
Walker, G. H., Gibson, H., Stanton, N. A., Baber, C., Salmon, P. M. and Green, D. (2006).
Event analysis of systemic teamwork (EAST): A novel integration of ergonomics meth-
ods to analyse C4i activity. Ergonomics, 49, 1345–1369.
Walker, G. H., Stanton, N. A., Salmon, P. M. (2011). Cognitive compatibility of motorcyclists
and car drivers. Accident Analysis & Prevention, 43 (3): May 2011, pp. 878–888.
Walker, G. H., Salmon, P. M., Bedinger, M., Stanton, N. A. (2017). Quantum ergonomics:
Shifting the paradigm of the systems agenda. Ergonomics, 60(2), 157–166.
Walker, G. H., Stanton, N. A., Baber, C., Wells, L., Jenkins, D. P. and Salmon, P. M. (2010).
From ethnography to the EAST method: A tractable approach for representing distrib-
uted cognition in air traffic control. Ergonomics, 53(2), 184–197.
Wilson, J. R., Norris, B. J. (2005). Rail human factors: Past, present and future. Applied
Ergonomics, 36(6), 649–660.
12 The EAST ‘ Broken-
Links’ Approach
Assessing Risk in
Sociotechnical Systems
With Catherine Harvey
INTRODUCTION
The term Sociotechnical Systems (STS) is used to refer to the interaction between
humans and machines, from the small and simple to the large and highly complex
(Walker et al. 2008; Walker et al. 2010b; Read et al. 2015). These sub-systems oper-
ate and are managed as independently functioning (autonomous) entities with their
own goals, but they must collaborate with other sub-systems to achieve the higher
goals of the STS (Dul et al. 2012; Wilson 2012). A key characteristic is that these
goals can only be achieved by the STS and not by individual sub-systems function-
ing in isolation (Rasmussen 1997; von Bertalanffy 1950). STS present unique chal-
lenges for safety management and risk assessment (Rasmussen 1997; Alexander and
Kelly 2013; Flach et al. 2015; Waterson et al. 2015). Traditional approaches to risk
assessment, such as THERP (Technique for Human Error Rate Prediction) Swain and
Guttmann 1983), TRACEr (Technique for the Retrospective and Predictive Analysis
of Cognitive Errors) Shorrock and Kirwan 2000) and SHERPA (Systematic Human
Error Reduction and Prediction Approach) Embrey 1986), are typically reductionistic
in nature (Stanton et al. 2013), focusing on individual tasks and technologies rather
than the system as a whole (Stanton 2006; Stanton and Stevenage 1998; Stanton et al.
2009; Waterson et al. 2015). These methods use error taxonomies to identify risk, but
recent research has suggested that the term human error is obsolete (Dekker 2014). In
its place, the term human performance variability has been proposed, which includes
both normative and non-normative performance. This latter approach emphasises the
broad spectrum of human behaviour rather than a dichotomy and, therefore, a need
to build resilient systems (Hollnagel et al. 2006). The Systemic Accident Analysis
(SAA) approach treats systems as whole entities with complex, non-linear networks
(Underwood and Waterson 2013). A number of SAA methods were assessed for
their potential for prospective risk analysis within STS in a previous study (Stanton
et al. 2012). Some system methods incorporate error taxonomies, such as CREAM
(Cognitive Reliability and Error Analysis Method) Hollnagel 1998), HFACS (Human
Factors Analysis and Classification System) Shappell and Wiegmann 2001) and
227
228 Systems Thinking in Practice
STPA (System-Theoretic Process Analysis) (Leveson 2012), which, given the recent
shift away from the term human error is something of a conundrum. Rather than
considering risks in systems to be the result of error, the approach taken in this chap-
ter is to propose risks as the failure to communicate information via social and task
networks. This type of failure may be seen in several major incidents. For example,
in the MS Herald of Free Enterprise accident (1987), the state of the bow doors was
not communicated to the ship’ s bridge (Noyes and Stanton 1997), so the ship left
harbour and subsequently capsized. In the Kegworth air disaster (1989), the aircraft
failed to communicate which engine was on fire, leading to the pilots shutting down
the wrong engine (Griffin et al. 2010; Plant and Stanton 2012). In the Ladbroke Grove
rail incident (1999), the signals failed to communicate to the train driver that the sec-
tion of the rail network was protected (Moray et al. 2016). Rather than stopping, the
driver actually increased his speed as he passed the red signal, leading to a collision
with an oncoming high-speed intercity train (Stanton and Walker 2011). So, rather
than conceive these behaviours as errors, we have reconceived them as the failure to
communicate information in the system. This is a new paradigm for risk assessment
that incorporates the value of a holistic perspective for appreciating the relationships
between the various sub-systems and the network diagrams for visualising important
aspects of STS, such as the constraints on communications (see Flach et al. 2015). In
order to analyse the information communications in systems, the Event Analysis of
Systemic Teamwork (EAST) method was selected. EAST takes a different approach
to the error taxonomic methods by modelling and analysing STS-level interactions.
In a previous study, Stanton (2014) analysed communications between various actors
within a submarine control room; in contrast, this case study analyses a retrospec-
tive account of actions within a Royal Navy training activity and is conducted at the
macro level (Grote et al. 2014). The aim of this chapter is to extend the EAST network-
level analysis to include risk prediction by ‘ breaking’ links within networks.
The EAST method was first proposed by Stanton et al. (2005, 2013) and fur-
ther elaborated by Stanton et al. (2008) for modelling distributed cognition in STS.
The method represents distributed cognition in networks, which enables both quali-
tative and quantitative investigations to be performed (Stanton 2014). One of the
main advantages of EAST is its aim to capture the whole system, as opposed to
reductionist methods, which split a system into constituent parts for analysis (Walker
et al. 2010a). It is therefore considered in this study to be a suitable technique for
representing a STS and potential non-normative behaviours. The analysis describes
a system as three different types of network:
The social, task and information networks are developed individually and then
combined to create a complete social-task-information network diagram, showing
The EAST ‘Broken-Links’ Approach 229
all the links and information flows (i.e. distributed cognition) within a network of
networks. EAST has been applied in many domains, including aviation (Stewart
et al. 2008, Walker et al. 2010a, Stanton et al. 2016), the military (Stanton et al. 2006,
Stanton 2014), road (Salmon et al. 2014) and rail (Walker et al. 2006) environments
and the emergency services (Houghton et al. 2006, Baber et al. 2013). The aim of
this work is to extend the EAST method to consider risk in systems via a case study
and to provide an initial STS method evaluation criteria presented by Harvey and
Stanton (2014). The premise of the risk assessment is that STS failures are predomi-
nately caused by the failure to communicate information between agents and tasks.
This will be studied within the context of the following case study.
FIGURE 12.1 AcciMap showing sub-systems within the Hawk jet STS [Please note that the
labels do not indicate a timeline; rather, they are added for clarity of the description below].
230 Systems Thinking in Practice
are used to simulate enemy aircraft attacks and high-speed skimming missiles fired
against ships (Royal Navy 2012). In order to perform these simulation activities, the
Hawk must be flown at a low height above sea level (b); however, the Hawk is not
equipped with a Radar Altimeter (Rad-Alt), which provides a highly accurate mea-
sure of the altitude of the aircraft above the sea. This makes flying the Hawk accu-
rately at very low levels extremely difficult, and a high level of expertise is required
to perform this safely. Prompted by events over a number of years, there have been
some significant changes to the method for assessing the safety of the Hawk STS.
In 2000, a Hawk jet was involved in a sea-strike incident as a consequence of
very low-level flight (c). Although there was no resulting loss of life, this incident
prompted a decision by the Royal Navy to increase the minimum allowable flying
height above sea level for the Hawk (d).
As part of its Strategic Defence and Security Review, HM Government (2010)
took the decision to retire the Harrier jet from service in October 2010 (e). As a
result of this, a number of Royal Navy pilots who would have flown the Harrier were
diverted into the Hawk program (f). Traditionally, the Hawk has been flown by civil-
ian pilots under contract to the Royal Navy (2012); these pilots have extensive mili-
tary experience in fast jets, which includes low-level flight supported by a Rad-Alt.
This experience provided mitigation against the Risk to Life (RtL) for the Hawk air
attack simulation task; however, the cohort of military pilots did not have this same
level of experience, and the RtL had to be reassessed in light of this (g).
In 2006, RAF Nimrod XV230 suffered a catastrophic explosion after a mid-air
refuelling procedure (h); this caused the deaths of all 12 crew members plus two
mission specialists and the total loss of the aircraft (i). The government requested
a comprehensive review into the airworthiness and safe operation of the Nimrod
(j), which was delivered by Haddon-Cave (2009). The report described the develop-
ment of the safety case for the Nimrod as ‘ a story of incompetence, complacency,
and cynicism’ (p. 161) and concluded that it was undermined by the widespread
assumption that the Nimrod was safe because it had been flown successfully for the
preceding 30 years (Haddon-Cave 2009). The report also identified organisational
changes in the years prior to the Nimrod accident as having significant influence;
these included a shift in organisational culture toward business and financial targets
‘ at the expense of functional values such as safety and airworthiness’ (Haddon-Cave
2009, p. 355). As a consequence of the findings, Haddon-Cave (2009) recommended
the establishment of an independent Military Aviation Authority (MAA) to properly
assess RtL and shape future safety culture (k). Further recommendations included
the need for strong leadership , a greater focus on people to deliver ‘ high standards
of safety and airworthiness’ (Haddon-Cave 2009, p. 355) and increased simplicity
of rules and regulations. The tragic consequences of the Nimrod accident, along
with the recommendations of the Haddon-Cave report, effected a culture change
within military aviation; this resulted in a decision to assign individual accountabil-
ity for RtL assessments to ‘ Duty Holders’ (DH), whereas previously, responsibility
for risk had been held at the organisation level (l). The newly established MAA pro-
duced guidelines for the assessment of RtL in the form of the Defence Aviation
Hazard-Risk Matrix (MAA 2011), which supports the classification of single risks
according to their estimated severity (catastrophic, critical, major, minor) and
The EAST ‘Broken-Links’ Approach 231
likelihood (frequent, occasional, remote, improbable). The resulting risk level deter-
mines at which level of DH the risk is held.
The organisational changes brought about by the events described above (i.e.
influx of junior pilots) prompted reassessment of the RtL for the Hawk air attack sim-
ulation activity. The goal of safety management in the UK military is to reduce risk to
a level which is As Low As Reasonably Practicable (ALARP); this is reached when
‘ the cost of further reduction is grossly disproportionate to the benefits of risk reduc-
tion’ (Ministry of Defence 2007). The RtL for all Hawk operations is frequently reas-
sessed, and the shift in pilot experience levels, as described above, prompted changes
to the RtL for the Hawk air attack simulation activity. In order to reduce this RtL to a
level that was ALARP, a decision was taken by the Royal Navy DH with subject mat-
ter expert (SME) advice to further increase the minimum height above sea level (m).
A potential consequence of this decision is the degradation of Royal Navy surface
fleet training against very live low-level targets, as the Hawk can no longer accu-
rately simulate sea-skimming missile attacks on surface ships (n). These events
have changed the nature of Hawk operations within the UK Ministry of Defence
(MoD(2007)) (o).
Potential risks to the safe operation of the missile simulation activity are, in part,
assessed according to the MAA’s Regulatory Articles (MAA 2011). This assessment is
based on the principle that risks can be tolerated provided they are reduced to ALARP.
The MAA regulatory policy outlined its approach to the management of RtL:
Aviation DHs [Duty Holders] are bound to reduce the RtL within their AoR [Area of
Responsibility] to at least tolerable and ALARP; the application of effective and coher-
ent risk management processes will be fundamental to achieving this.
(MAA 2011, p. 18).
a measure of exposure to possible loss [combining] severity of loss (how bad) and the
likelihood of suffering that loss (how often).
(MAA 2011, p. 1).
The MAA suggested that risks can be identified via a number of different meth-
ods including previous occurrences, checklists, HAZOPS (Hazard and Operability),
zonal hazard (safety) analyses and error trend monitoring. Previous work has showed
that these techniques are likely to be inadequate for the analysis of STS (Stanton
et al. 2012). RA 1210 specifically encourages the use of fault trees as accident mod-
els ‘ to assist understanding of the interrelationship between risks and to support the
prioritisation of effort to maximise safety benefit’ (MAA 2010, p. 6). This technique,
along with other traditional error and risk prediction methods, does not account for
the interactions of distributed actors within a STS (Salmon et al. 2011b). Furthermore,
there is also no clear method outlined by the MAA for structuring risk identification;
for example, the recommendation is that a combination of these methods should be
used with the aim of identifying all credible risks, but there is no way of knowing
232 Systems Thinking in Practice
when all possible credible risks have been defined and therefore how many methods
to use and when to stop applying them.
The Hawk RtL case study was identified through interviews with a subject matter
expert (SME) as part of this project. The analysts were provided with a high-level
overview of the case study in an initial interview with the SME. This was followed
up by a second, in-depth interview about the case study with the SME, conducted
by two analysts. This resulted in a detailed account of the Hawk-Frigate STS, which
was supplemented by extra information from official documentation including MAA
(2010, 2011) guidelines, the official report into the Nimrod accident (Haddon-Cave
2009) and Royal Navy safety assessment guidance (Royal Navy 2012). The EAST
method (Stanton 2014) was used to develop the three network diagrams, based upon
the analysis of all case study information, in an iterative process that involved the
SME providing feedback during development.
ANALYSIS OF NETWORKS
Social Network Analysis (SNA) metrics provide quantitative measures that represent
the structures and relations between nodes in the EAST networks (Baber et al. 2013;
Driskell and Mullen 2005; Walker et al. 2009). The SNA metrics describe individual
nodes (including reception, emission, eccentricity, sociometric status, centrality, close-
ness, farness and betweenness). The SNA metrics applied in the current study, along
with their descriptions, are presented in Table 12.1. Analysis software, AGNA version
2.1 (Benta 2005), was used to calculate the SNA metrics. For each EAST network, key
TABLE 12.1
SNA Metrics, along with their Descriptions
nodes were identified according to sociometric status. Sociometric status was selected
to define key nodes because it identifies the prominence of an individual node’s com-
munications with the rest of the network, which influences the whole network’s perfor-
mance (Stanton 2014). In a STS, all of the nodes will have complex safety management
rules and behaviours; however, as the ‘key’ nodes have the largest number of connec-
tions to the rest of the network, these nodes will have the highest degree of influence
over the behaviour of the entire STS. Sociometric status key nodes are defined as nodes
that have a higher sociometric status score than the sum of the mean sociometric status
score plus the standard deviation sociometric status score for all nodes in the network.
SNA metrics were calculated for the EAST networks created for this case study; key
agents for sociometric status are indicated in the social, task and information network
diagrams below.
RESULTS
The step-by-step application of the shortened version of EAST is described in detail
in the following sections. This is accompanied by the outputs of the method along
with interpretation of the results. The first stage in EAST was the identification of all
social, task and information nodes within the Hawk missile simulation case study,
based on the SME’ s account of activities, which informed the analysts’ knowledge
of the case study. The nodes were arranged in social, task and information networks
and links drawn between related nodes. Related nodes were those between which
some information was transferred. As well as providing a visual representation of
a STS, the EAST network diagrams can be analysed to produce quantitative SNA
metrics.
Social Network
Seven social ‘ agents’ and their connections were identified from the Hawk RtL case
study with the SME; these are shown in Figure 12.2. The social network was con-
structed by first identifying the main agents that are in the system, then by examin-
ing the interdependencies between those agents. The SME agreed that the social
network was a reasonable representation of the main agents and their relationships.
The ‘ edges’ , or links, between the agents show where information is transferred
and the direction of transfer. There are 19 edges in total; in some cases, information
transfer is reciprocal, but in others it only goes in one direction between two agents.
The ‘ pilot’ node was identified as the key agent according to sociometric status
(1.33), with the highest number of links to and from other nodes in the network; in
fact, the pilot receives and/or emits information from/to all of the other agents in the
social network.
The pilot had the highest betweenness score (10.0) as it is located on the paths
between a number of other agent pairs. The pilot also had the highest score for recep-
tion (6), highlighting a high degree of connectivity to other nodes in the network and
indicating that the pilot’ s actions and communications are integral to the function-
ing of the STS. The high farness score for the regulator (10) indicates that this agent
is located farthest from most other nodes, and this is supported by the information
234 Systems Thinking in Practice
FIGURE 12.2 Social nodes and their links within the STS.
in the case study, which showed that the regulator really only communicates with
the DH and possibly the pilots but has no contact with the frigate or crew. This is
because the regulator in this case is the MAA, which does not have direct control
over the Navy’ s surface ship operations. The sea scored highest for emission (4) and
lowest for reception (0) as it does not receive information from any other nodes but is
used for feedback only. In this sense, the sea can be regarded as a ‘ passive’ agent, as
it cannot respond to feedback; the social agents can only respond to it.
Task Network
Ten tasks nodes and their connections were identified from the Hawk RtL case study
with the SME; these are shown in Figure 12.3. The task network was constructed by
first identifying the main tasks that are performed by the system, then by examin-
ing the interdependencies between the tasks. The SME agreed that the task network
was a reasonable representation of the system. There are 12 edges in total, and in all
cases, the transfer is uni-directional.
In the task network, key nodes were identified as ‘ safe control of aircraft to simu-
late missile’ and ‘ issuing of RtL document’ , which had sociometric status scores of
.56 and .44 respectively. The task network contains more nodes but fewer edges than
the social network, indicating that there are fewer communications between tasks.
The EAST ‘Broken-Links’ Approach 235
FIGURE 12.3 Task nodes and their links within the STS.
Cohesion is zero because there are no mutual, or bidirectional, links between nodes.
The highest score for betweenness was for ‘ safe control of aircraft to simulate mis-
sile’ (45), demonstrating that this task is integral in the STS as it is located between a
high number of other task nodes. This is unsurprising as this task can be considered
to be the main objective of the STS configuration investigated in this case study. This
task also scored highest on emission (2), reception (3) and B-L centrality (6.26), as
well as sociometric status (.56), showing a high level of connectivity to other nodes.
Information Network
EAST identified 25 information nodes, and their connections were based the Hawk
RtL case study and further knowledge of the STS from the SME; these are shown
in Figure 12.4. There are 50 edges in total; however, in this case, the links are not
directional.
236 Systems Thinking in Practice
FIGURE 12.4 Information nodes and their links within the STS.
Six information nodes were identified as key nodes according to sociometric sta-
tus: missile simulation, (absence of) Rad-Alt, altitude, boundaries, safety and RtL.
Safety had the highest betweenness (315.8), standard closeness (.53) and B-L cen-
trality scores (18.51), and this reflects the importance of this in the case study; the
aim within the STS is to achieve a safe solution for missile simulation. Density and
cohesion were relatively low, that is, compared with the social network, as the edges
between nodes were single and non-directional.
The EAST ‘Broken-Links’ Approach 237
BROKEN-LINKS ANALYSIS
Studies of networks have discussed the effects of removing one or more nodes from a
network on the resilience of that network to systemic failures and the resulting desta-
bilisation (Baber et al. 2013; Houghton et al. 2008; Stanton 2014). This has been used
to explore the resulting influence on network structure, rather than as a method for
predicting specific risks. Previously, the network diagrams in EAST have been used
to provide a visual representation of a system to further the users’ understanding
of distributed cognition (Stanton 2014). In this study, however, the EAST network
analysis was extended to identify and examine possible risks by ‘ breaking’ the links
between the various nodes, in a similar approach to the removal of nodes, to explore
system effects. ‘ Broken links’ represent failures in communication and information
transfer between nodes in the networks and these failures can then be used to make
predictions about the possible risks within the STS. Previously, broken links have
only been investigated by EAST analysts when looking retrospectively at accidents
to identify underlying causes. Griffin et al. (2010) demonstrated that the broken link
between the Engine Vibration Indicator and the pilots in the cockpit was a causal
factor in their failure to shut down the correct engine in the Kegworth accident. If
this information had been communicated more effectively, it could have helped to
prevent the crash. Similarly, the EAST method has been adapted to analyse incidents
of fratricide (Rafferty et al. 2012), although this has been conducted as retrospec-
tive and concurrent, rather than predictive, analyses. The broken-links analysis was
performed for the Hawk missile simulation case study on the social and task net-
works shown in Figures 12.2 and 12.3 respectively. The information network was
not subject to the broken-links analysis because broken links between information
nodes were not considered to represent risks as they are caused by a failure in either
the social or task networks. In other words, information does not fail in isolation;
it is the failure to use or communicate the information correctly, and in all cases,
this can be attributed to social nodes, task nodes or both. For the social and task
networks, each link was identified and documented in a table. The combined EAST
networks diagram (see Figure 12.5) shows the information network tagged with the
social networks nodes (to show who owns each information node in the network)
and grouped by the task network nodes (to show which task each information node
belongs to). Details on construction of the combined network have been reported by
Stanton (2014). This combined network was used to identify what information (from
the information network) should be communicated from the origin node to the des-
tination node in the task and social networks and therefore what information would
not be communicated if the links between the nodes in the task and social networks
were removed.
Figure 12.5 also shows the combined information-task-social network as a single
depiction of the entire STS. This shows the overlaps between the three networks, in
other words, which information is being communicated by which agents in which
tasks and how these nodes are interlinked.
In order to conduct the broken-links analysis, the social and task networks were
compared to the combined information-task-social network in turn. For example,
there is a reciprocal relationship between the duty holder and the pilot (in the social
238 Systems Thinking in Practice
FIGURE 12.5 Combined information-task-social network for the Hawk case study (shading
represents the different tasks being undertaken).
network shown in Figure 12.2), and the duty holder and the pilot share the nodes of
boundaries, RtL, risk likelihood, risk severity, procedures, document, responsibility
and safety (in the combined information-task-social network shown in Figure 12.5).
The risk assessment procedure requires that the relationship between the duty holder
and pilot be interrogated to see what would happen if each information element was
not transmitted, as shown in Table 12.2. The pilot was identified as having the high-
est Sociometric Status in the analysis presented in Figure 12.2, so was chosen for the
The EAST ‘Broken-Links’ Approach 239
TABLE 12.2
Extract from Broken-links Analysis for EAST Social Network
From (Agent) To (Agent) Information Resulting Risk Mitigation Strategy
not
Communicated
Duty Holder Pilot Boundaries Pilots are not aware of Boundaries for risk
the boundaries for reporting must be made
flight operations and clear to pilots as part of
for the identification the RtL process.
and reporting of risks
within this.
Duty Holder Pilot RtL Pilots are not made Results and
aware of the results and consequences of the
consequences of the RtL assessment process
RtL assessment process must be effectively
after it is conducted at communicated to pilots.
DH level.
Duty Holder Pilot Risk likelihood Pilots are not made Risks identified as
aware of risks having a high
assessed that their likelihood of
likelihood of occurrence must be
occurrence. reported to pilots.
Duty Holder Pilot Risk severity Pilots are not made Risks deemed as having
aware of risks a high severity of
assessed and their impact must be
severity of impact. reported to pilots.
Duty Holder Pilot Procedures Pilots are not aware of Pilots must be provided
how the RtL process is with clear procedures
conducted at DH level describing the
and of procedures for assessment of RtL at
reporting incidents to DH level and the
the DH. reporting of risks to DH.
Duty Holder Pilot Document Pilots are not provided Pilots must be provided
with documentation with documentation
covering the RtL covering the RtL
process and its results. process and its results.
Duty Holder Pilot Responsibility Pilots are not aware of The responsibilities of
the DH’ s or their own both the pilot and DH
responsibilities for for safety must be
safety. clearly defined and
understood by pilots.
Duty Holder Pilot Safety Pilots do not receive The safety of operations,
information about the as assessed during the
safety of operations RtL process, must be
based on the RtL reported to the pilots.
assessment process.
(Continued)
240 Systems Thinking in Practice
illustration of the broken-links analysis in Table 12.2. Although the pilot is linked to
all other agents in the social network, for the purpose of illustration, just their recip-
rocal relationship with the duty holder is presented in Table 12.2.
Table 12.2 shows the risks resulting from the failure to pass relevant information
between duty holder and pilot and vice versa. Anecdotal evidence from our SME
suggests that there is variability in what individual pilots will chose to report back
to the duty holder, as they have different interpretations of what they consider to
be a risk and near miss. This shows that there is at least some face validity for the
approach we have proposed.
In the similar manner to the social-information broken-links analysis shown in
Table 12.2, there is a task-information broken-links analysis in Table 12.3. From the
task network, there is a uni-directional relationship between the ‘ Issuing of RtL
document’ and the ‘ Revision of safe flying altitude’ (in the task network shown
in Figure 12.3), and they overlap in the combined information-task-social network
(shown in Figure 12.5). The risk assessment procedure requires that the relationship
between the ‘ Issuing of RtL document’ and the ‘ Revision of safe flying altitude’ be
interrogated to see what would happen if each information element was not transmit-
ted, as shown in Table 12.3. The ‘ Issuing of RtL document’ was chosen as it has the
highest Sociometric Status in the analysis presented in Figure 12.3. The ‘ Safe con-
trol of aircraft to simulate missile’ was chosen for the same reason and is paired with
‘ Navy training’ for the purposes of offering an illustrative example of the method
in Figure 12.3.
Examination of the analysis in Tables 12.2 and 12.3 offers a systematic approach
for examining a system of operation in a holistic manner. For example, increasing
the safe flying attitude (see Figure 12.1) has led to the altitude profile of the Hawk not
matching that of the low-flying missile (see Table 12.3). This has meant that reducing
the risk for the Hawk pilots could have a negative effect on training of the crew on
the frigate, ultimately increasing their risk. So, whilst the top of Table 12.3 is about
improving the safety of the pilot – by increasing altitude, for example – the bottom of
table three shows that this could reduce the safety of the Navy frigate crew as they do
not receive realistic training. The benefit of systems approaches is that the emergent
properties become more readily apparent.
DISCUSSION
This work aimed to explore the use of a modified version of EAST (network model-
ling and broken-links analysis, see Stanton 2014) in a case study of a Royal Navy
training activity. First, the findings of this study are discussed in terms of criteria
that were identified as essential for methods designed to analyse the human com-
ponent of STS (Stanton et al. 2012; Harvey and Stanton 2014). This enabled com-
parisons to be made between the method and the current RtL procedure used in the
Hawk missile simulation case study. Second, the modifications and extensions to
EAST are discussed with reference to use of the method as an assessment of poten-
tial risks within a STS.
Aviation accidents, as with most accidents in STS, usually occur due to a conjunc-
tion of factors (Hodgson et al. 2013; Jenkins et al. 2010), and it is therefore essential
242 Systems Thinking in Practice
that analysis methods are able to explore all of these factors by taking an integrated
and holistic approach (Ramos et al. 2012; Salmon et al. 2011b). EAST specifically
enables the exploration of the social, task and information components of the STS,
allowing a high-level model of the STS to be created (visual diagrams) and analysed
(social network metrics). This visual component is likely to help analysts and other
stakeholders to understand the interactions within networks (Flach et al. 2015); this
is an advantage over many other methods such as HAZOP and Fault Tree analysis,
as well as the MAA’ s RtL/HRM (Hazard-Risk Matrix) approach. Baber et al. (2013)
argued that it is sensible to speak of a ‘ useful’ (rather than ‘ complete’ ) network, as
there will always be a possibility that some connections have been left out due to not
being observed, reported and/or documented. This is certainly applicable to the net-
works generated by EAST, as it is impossible to know whether an analysis has been
exhaustive, and it is therefore safest to assume that it has not. It is also particularly
true in this case as the analysis was performed on an SME’ s reports of activities
within the STS rather than communications between STS actors (as in Stanton 2014).
A consequence of this approach is a lack of richness of information, although if the
main contribution of EAST lies in its ability to visually represent an STS, then this
may not be a significant issue. EAST includes the calculation of SNA metrics, which
provide the analyst with quantitative values to represent various characteristics of
the networks. In this way, the analysis encompasses all elements of a STS and pro-
vides the analyst with an understanding of the structure of a system as a whole and
the relationships between individual system components. These metrics can provide
potential insight into the resilience of the networks (Stanton et al. 2016).
The inclusion of particular agents in an accident model is dependent on the infor-
mation put into the analysis and therefore on the analysts and SMEs involved. This
also is true for more traditional HAZOP and error identification methods and the
current RtL assessment process, as well as EAST. However, because HAZOP and
RtL assessment essentially focus on a list of potential errors, there is no formal pro-
cedure for identifying the decision makers involved. In contrast, EAST enabled a
visual representation of the decision-making agents (Flach et al. 2015) and their
relationships with other nodes in a STS to be constructed, thereby encompassing the
identification of decision makers into the analysis process. This can allow analysts to
understand where responsibility for risks resides within the STS and so target miti-
gation strategies appropriately (Lundberg et al. 2010). This case study showed that
EAST provided a useful visual representation of relationships between the various
components of the STS. EAST examines the links between nodes and so is focused
on communications, and therefore on the consequences of an action at a node, rather
than its causes (Rafferty et al. 2012; Walker et al. 2010a).
In this case study, the analysts used a modified version of EAST, concentrat-
ing on the social, information and task networks (Stanton 2014). Guidance is pro-
vided on structuring a model of the STS under investigation, and there are numerous
examples of previous EAST models (e.g. Griffin et al. 2010; Rafferty et al. 2012;
Walker et al. 2010a; Stanton 2014) in the literature. The ‘ broken-link’ process is very
straightforward indeed and would be a useful addition to the current RtL assessment
process (Haddon-Cave 2009). The current guidance from the MAA states that risks
should be identified from a number of sources including HAZOP, error data and
The EAST ‘Broken-Links’ Approach 243
TABLE 12.3
Extract from Broken-links Analysis for EAST Task Network
From (Task) To (Task) Information not Resulting Risk Mitigation Strategy
Communicated
Issuing of RtL Revision Document The information The RtL document must
document of safe contained in the be used by regulators to
flying RtL document does inform changes to
altitude not trigger a regulations and safety
revision of safe guidance where
flying altitude. appropriate.
Issuing of RtL Revision RtL The outcome of the The outcomes of RtL
document of safe RtL process assessment must be used
flying outlined in the RtL by regulators to inform
altitude document does not changes to regulations
trigger a revision of and safety guidelines
safe flying altitude. where appropriate.
Issuing of RtL Revision Risk likelihood The outcome of the The outcome of the Risk
document of safe Risk likelihood likelihood assessment,
flying assessment, conducted as part of the
altitude conducted as part of RtL process and outlined
the RtL process and in the RtL document,
outlined in the RtL must be used to inform
document, does not changes to regulations
trigger a revision of and safety guidelines
safe flying altitude. where appropriate.
Issuing of RtL Revision Risk severity The outcome of the The outcome of the Risk
document of safe Risk severity severity assessment,
flying assessment, conducted as part of the
altitude conducted as part of RtL process and outlined
the RtL process and in the RtL document,
outlined in the RtL must be used to inform
document, does not changes to regulations
trigger a revision of and safety guidelines
safe flying altitude. where appropriate
Issuing of RtL Revision Safety The safety The safety implications of
document of safe implications of the RtL assessment must be
flying RtL process, used by regulators to
altitude outlined in the RtL inform changes to
document, do not regulations and safety
trigger a revision of guidelines where
safe flying altitude. appropriate.
Issuing of RtL Revision Responsibility Responsibility for Responsibility for changes
document of safe the revision of safe to regulations and safety
flying flying altitude is not guidelines based on RtL
altitude outlined in the RtL assessment must be
document. clearly assigned and
accepted.
(Continued)
244 Systems Thinking in Practice
altitude for the Hawk and the effects of this on missile simulation for the frigate and
crew. Having said this, the emphasis with EAST is not on predicting accidents per se;
rather, it is about creating a comprehensive model of the links and information flows
within the STS and by doing so making the analysts aware of potential breakdowns
and failures that may occur in the future. This means that the success of EAST for
prospective analysis is dependent on the participation in the assessment process of
those who will be impacted by these failures and those that can apply the appropriate
mitigation strategies.
In summary, this study used a modified version of EAST, following the exam-
ples in Stanton (2014). In this case, only the network analysis phases of EAST were
applied (followed by the new paradigm of the broken-links analysis, which has not
been previously reported) because the preliminary stages of EAST were negated
by having already collected and represented the data via interviews with an SME.
Furthermore, some of the EAST methods require communications data, which were
lacking in this particular case study as the information came from a SME’ s account
of the STS. Compared to Stanton’ s (2014) analysis of the operations within a sub-
marine control room, the current study analysed activity at a macro level (Grote
et al. 2014), using an SME’ s account of activities within the STS rather than a tran-
script of direct communications between STS actors. Recording and transcribing
communications within a working system in real time is difficult, time-consuming
and potentially disruptive to the STS under investigation. The approach presented
in the current chapter would be easier for personnel within the STS itself to apply
to support their own safety management and risk prediction activities, as it relies
on a macro-level account of actions and relationships with a STS. This also allows
these personnel to create a systems view of the STS of interest, which, as previ-
ously discussed, offers benefits over traditional taxonomic techniques. The absence
of communications data obviously means that the analysis lacks detail and a rich-
ness of information that comes from speech data. This also meant that frequency of
communications could not be represented in the same way as Stanton (2014). So, in
effect, the network diagrams in this case study offer a basic visual representation of
a STS that could aid understanding of the relationships between agents, tasks and
information as well as their combination. Of greater importance is the extension to
EAST presented in this chapter: the broken-links analysis. In order to identify poten-
tial risk in the STS, these links between nodes in the networks had to be examined in
more detail; this was accomplished in the broken-links analysis. In this phase, each
link between the task and social nodes was ‘ broken’ to illustrate the effect of a com-
munication breakdown between nodes. In this case study, 19 social links and 12 task
links were broken and assessed against numerous information nodes, resulting in
the identification of 137 risks in total. These breakdowns would result in a failure in
information transfer, so each broken link was analysed against the information nodes
to identify potential risks. This extension to the EAST method provides a structured
method for identifying all of the risks within a STS. The broken links can be listed
in table form, along with ‘ to’ and ‘ from’ information detailing the origin and des-
tination nodes between which information is transferred. The broken-links analysis
is concluded by developing mitigation strategies for each of the identified risks in a
similar way to traditional human-error analysis methods.
246 Systems Thinking in Practice
CONCLUSIONS
This chapter presented a case study of the extension to the EAST method applied
in the analysis of a STS, specifically Hawk missile simulation intended to aid with
the training of Navy crew. The approach models the STS in two phases. In the first
phase, the system is modelled as three connected networks (social, information and
task), and the second phase, the social and task network links are systematically
broken to reveal what risks are introduced by the failure to communicate informa-
tion. The broken-links approach is a substantial and novel innovation over traditional
human-error taxonomic approaches to assessing risks in systems. The approach is
based on the premise that most, if not all, accidents and near misses are caused, at
least in part, by the failure to communicate information between agents and tasks.
By enabling the generation of a system model, EAST ensures that all of the compo-
nents of interest within a STS have at been identified, and this should lead to a more
comprehensive analysis of potential risks. The extension to EAST offers a holistic,
structured and systematic approach to the identification of information communica-
tion failures in task and social networks. The EAST network broken-links approach
is a new paradigm for risk assessment in systems. The approach can be applied to
any STS in any domain where an EAST model has been constructed. Future work
should explore the risks associated with multiple communication failures occurring
simultaneously as well as considering the degree of resilience offered by different
system network models.
ACKNOWLEDGEMENTS
The authors would like to thank Wing Commander Neil Bing (Bingo) of Air Cap
SO1 Lightning, RAF High Wycombe, for his account of the Hawk RtL case study
and his very valuable insights into the challenges faced by this complex sociotechni-
cal system. This work was part-funded by the Defence Human Capability Science
and Technology Centre (DHCSTC) grant reference TIN 2.002.
REFERENCES
Alexander, R. and Kelly, T. (2013). Supporting systems of systems hazard analysis using
multi-agent simulation. Safety Science , 51, 302– 318.
Baber, C., Stanton, N. A., Atkinson, J., McMaster, R. and Houghton, R. J. (2013). Using
social network analysis and agent-based modelling to explore information flow using
common operational pictures for maritime search and rescue operations. Ergonomics ,
56, 889– 905.
Benta, M. I. (2005). Studying communication networks with AGNA 2.1. Cognition, Brain,
Behaviour , 9, 567– 574.
Dekker, S. (2014). The Field Guide to Understanding ‘Human Error’ . Ashgate: Aldershot, UK.
Driskell, J. E. and Mullen, B. (2005). Social network analysis. In: N. A. Stanton, A. Hedge,
K. Brookhuis, E. Salas and H. Hendrick (Eds.), Handbook of Human Factors and
Ergonomics Methods . CRC Press: Boca Raton, FL.
Dul, J., Bruder, R., Buckle, P., Carayon, P., Falzon, P., Marras, W. S., Wilson, J. R. and Van
Der Doelen, B. (2012). A strategy for human factors/ergonomics: Developing the disci-
pline and profession. Ergonomics , 55, 377– 395.
The EAST ‘Broken-Links’ Approach 247
Embrey, D. E. (1986). SHERPA: A systematic human error reduction and prediction approach.
Paper presented at the International Meeting on Advances in Nuclear Power Systems,
Knoxville, TN.
Flach, J. M., Carroll, J. S., Dainoff, M. J. and Hamilton, W. I. (2015). Striving for safety:
Communicating and deciding in sociotechnical systems. Ergonomics , 58(4), 615– 634.
Griffin, T. G. C., Young, M. S. and Stanton, N. A. (2010). Investigating accident causation
through information network modelling. Ergonomics , 53, 198– 210.
Grote, G., Weyer, J. and Stanton, N. A. (2014). Beyond human-centred automation – Concepts
for human– machine interaction in multi-layered networks. Ergonomics , 57(3), 289– 294.
Haddon-Cave, C. (2009). The Nimrod Review: An Independent Review into Broader Issues
Surrounding the Loss of the RAF Nimrod MR2 Aircraft XV230 in Afghanistan in 2006 .
HM Stationery Office: London, UK.
Harvey, C. and Stanton, N. A. (2014). Safety in System-of-Systems: ten key challenges. Safety
Science , 70, 358– 366.
H. M Government. (2010). Securing Britain in an age of uncertainty: the strategic defence
and security review . London, UK: The Stationery Office.
Hodgson, A., Siemieniuch, C. E. and Hubbard, E.-M. (2013). Culture and the safety of
complex automated sociotechnical systems. IEEE Transactions on Human-Machine
Systems , 43, 608– 619.
Hollnagel, E. (1998). Cognitive Reliability and Error Analysis Method . Elsevier Science:
Oxford, UK.
Hollnagel, E., Woods, D. D. and Leveson, N. C. (Eds.) (2006). Resilience Engineering:
Concepts and Precepts . Ashgate: Aldershot, UK.
Houghton, R. J., Baber, C., Cowton, M., Walker, G. H. and Stanton, N. A. (2008). WESTT
(workload, error, situational awareness, time and teamwork): An analytical pro-
totyping system for command and control. Cognition, Technology and Work , 10,
199– 207.
Houghton, R. J., Baber, C., McMaster, R., Stanton, N. A., Salmon, P. M., Stewart, R. and
Walker, G. H. (2006). Command and control in emergency services operations: A
social network analysis. Ergonomics , 49, 1204– 1225.
Jenkins, D. P., Stanton, N. A., Salmon, P. M. and Walker, G. H. (2010). A systemic approach
to accident analysis: A case study of the Stockwell shooting. Ergonomics , 53, 1– 17.
Leveson, N. G. (2012). Engineering a Safer World: Systems Thinking Applied to Safety . MIT
Press: Cambridge, MA.
Lundberg, J., Rollenhagen, C. and Hollnagel, E. (2010). What you find is not always what you
fix – How other aspects than causes of accidents decide recommendations for remedial
actions. Accident Analysis and Prevention , 42, 2132– 2139.
MAA (2010). RA 1210: Management of operating risk (risk to life). In: M.A. AUTHORITY
(Ed.) RA 1210 . Military Aviation Authority: London, UK.
MAA (2011). Regulatory Instruction MAA RI/02/11 (DG) – Air Safety: Risk Management .
Military Aviation Authority: London, UK.
Ministry of Defence (MoD). (2007). Defence standard 00-56, issue 4, part 2. London, UK:
MoD.
Moray, N., Groeger, J. and Stanton, N. A. (2017). Quantitative modelling in cognitive ergo-
nomics: Predicting signals passed at danger. Ergonomics , 60(2), 206– 220.
Noyes, J. and Stanton, N. A. (1997). Engineering psychology: Contribution to system safety.
Computing & Control Engineering Journal , 8(3), 107– 112.
Plant, K. L. and Stanton, N. A. (2012). Why did the pilots shut down the wrong engine?
Explaining errors in context using Schema Theory and the Perceptual Cycle Model.
Safety Science , 50(2), 300– 315.
Rafferty, L., Stanton, N. A. and Walker, G. H. (2012). The Human Factors of Fratricide .
Ashgate: Surrey, UK.
248 Systems Thinking in Practice
Flight Decks
With Don Harris and Alison Starr
INTRODUCTION
The trend in flight deck design over the past half century has been one of progressive
‘de-crewing’. Fifty years ago, it was not uncommon for there to be five crew on the flight
deck of a civil airliner (two Pilots, Flight Engineer, Navigator and Radio Operator).
Today, just two pilots accomplish the same tasks once undertaken by five. Many func-
tions are now wholly or partially automated. Consequently, the role of the pilot has
changed from one of being a ‘flyer’ to one of being a systems/flight deck manager.
Airline personnel costs vary between about 11% of operating costs to nearly 25%,
depending upon aircraft type, sector length and how much activity is outsourced
(Ryanair 2009; easyJet plc 2013). Crew costs for smaller commercial aircraft can be
between 15% and 35% of the aircraft direct operating costs (Alcock 2004). Annual
accounts from a typical low-cost operator suggest that even for a larger airliner, the
crew represent nearly 19% of operating costs (excluding fuel and propulsion – easy-
Jet plc 2013). The scope to make significant cost savings with the current common
configuration for aircraft (cylindrical fuselage with wings, rudder and tail plane) is
now limited. This configuration is approaching the end of its development potential.
Alternative configurations such as the blended wing body concept, which offer con-
siderable structural and aerodynamic advantages, have met with limited enthusiasm
from potential passengers. Problems of ensuring a safe and efficient means of pas-
senger evacuation have also been identified (Galea et al. 2011). This configuration
also needs a great deal of development in other areas (such as flight control sys-
tems and structural testing) before it will be suitable for service entry. Reducing the
number of crew on the flight deck to just a single pilot will produce significant cost
savings, especially in smaller commercial aircraft operated on shorter and ‘thinner’
(lower-demand) routes.
Some manufacturers (e.g. Embraer) are already developing the technology for a
single-crew aircraft, as are avionics suppliers (e.g. Honeywell – see Keinrath et al.
2010). The approaches being adopted in these instances centre upon the devel-
opment of sophisticated airborne technology to assist the pilot (e.g. Intelligent
Knowledge-Based Systems and adaptive automation). This approach is also being
adopted in other research programmes looking at flight deck automation and
251
252 Systems Thinking in Practice
the second pilot trapped an error made by the other pilot and avoided an accident;
this is unknown and unknowable. However, observational data obtained from rou-
tine flights reported that 47.2% of errors committed by Captains involved inten-
tional non-compliance with Standard Operating Procedures (SOPs) or regulations;
38.5% were unintentional procedural non-compliance (Thomas 2003). Thomas
also reports that in observations of line operations, crews did not demonstrate
effective error detection, with more than half of all errors remaining undetected by
one or both of the flight crew. As a result, it can be argued that removing one of the
pilots actually reduces the scope for accidents occurring as a result of miscommu-
nication or misunderstanding between the pilots, and that removing the PM does
not double the workload on the flight deck.
Perhaps the greatest concern for the development of a single-crew aircraft is that
associated with pilot death, incapacitation or impairment. However, such instances
are very rare. A study of in-flight medical incapacitations in US airline pilots
between 1993 and 1998 found only 39 instances of incapacitation and 11 instances
of impairment (DeJohn et al. 2004). The rate of in-flight medical events (encompass-
ing both types) was 0.058 per 100,000 flight hours. The probability that one of these
events would subsequently result in an accident was calculated to be 0.04. DeJohn
et al. (2004) observed that the safety of the flight was seriously impacted in only
seven cases and resulted in two non-fatal accidents. A later study of UK commercial
pilots by Evans and Radcliffe (2012) suggest that the annual in-flight incapacitation
rate was 0.25%; however, this study is seriously flawed in than it was not weighted
by flight hour and the rate is expressed as a percentage of all UK registered pilots
(irrespective of flight hours accumulated by each, per year).
It is argued that with the judicious use of existing equipment, there are no
major reasons why a single-pilot-operated commercial aircraft is not feasible in
the very near future using existing technology. Military aviation has flown com-
plex, high-performance single-crew aircraft for many years, and Unmanned Air
Vehicles (UAVs) are now commonplace. UAV technology has matured, and such
aircraft are now regularly being used for national border and port security, home-
land surveillance, scientific data collection and telecommunications services
(Harris 2007). Airworthiness standards for their design and operation in civil
airspace are being developed on both sides of the Atlantic (e.g. UK Civil Aviation
Authority 2010 – Unmanned Aircraft System Operations in UK Airspace –
Guidance [CAP 722]). Several UAVs are now the size of a small aircraft, with
performance similar (or exceeding) that of a conventional aeroplane. It is worth
noting that UAVs still have a designated ‘Pilot in Command’ International Civil
Aviation Organisation Annex 2, ‘Rules of the Air’, states that the ‘Responsibility
of the pilot-in-command’ of an aircraft shall, whether manipulating the controls
or not, be responsible for the operation of the aircraft in accordance with the
rules of the air, except that the pilot-in-command may depart from these rules in
circumstances that render such departure absolutely necessary in the interests of
safety’.
The greatest obstacle to the operation of civilian, single-pilot aircraft is not the
technology per se. Rather, the barriers are combining the ground and airborne tech-
nologies, designing the user interfaces and developing new concepts of operations to
254 Systems Thinking in Practice
make such an aeroplane safe and useable in a wide range of normal and n on-normal
operating situations (when flown by a typical commercial pilot). That is to say that
the Human Factors requirements are the prime driver in this case, not the tech-
nology. The concept evaluated in this chapter is based upon an alternative design
approach to that of utilising a large amount of on-board, complex computing (e.g.
that using agent-based software) first described by Harris (2007). The concept uses
a sociotechnical systems-based design philosophy utilising a great deal of currently
existing technology. In this case, the control and crewing of the aircraft is distrib-
uted in real time across both the aircraft’s flight deck and ground stations (see also
Stanton et al. 2014). The second pilot is not replaced by on-board AI or Intelligent
Knowledge-Based Systems, which would be both difficult to develop and challeng-
ing to certificate; they are merely displaced.
DESIGN APPROACH
The proposed approach regards a future single-crew aircraft as just one part of a
wider operating system, a radical change from the operation of current generation
airliners. The initial high-level design architecture proposed for operating the single-
crew aircraft consists of several discrete elements (Stanton et al. 2014):
This is the initial envisaged instantiation of the system upon which to base a cog-
nitive work analyses in order to evaluate its efficacy and to identify required technol-
ogy development paths. The design of this single-crew aircraft operations system is
intended to form the basis of incremental developments, incorporating subsequent
airborne pilot-support technology as it is developed. This will allow the further rapid
development of the concept.
Aircraft Component
In many ways, the aircraft component will be little different to current types. The
requirements are that aircraft should be able to function in all types of airspace
without any special Air Traffic Control/Air Traffic Management (ATC/ATM)
procedures and should be able to be flown by regular Airline Transport Pilots
Licence (ATPL) qualified professional pilots without extraordinary training. It
should exhibit an equivalent level of safety to fourth-generation modern airliners.
Initially, such an aircraft will be optimised for shorter-range, low-cost operations
(including cargo operations) and for ‘thinner’ routes where cost of operation is a
critical factor. Emphasis will be placed upon reduction of workload and error by
simplification of operation.
From CWA to SNA 255
Ground-Based Component
The ground-based component’s primary functions are to support the pilot (e.g. in
navigation, system management, ATC/ATM support or fault diagnosis), not neces-
sarily to duplicate their skills and functions. Suitably skilled personnel on the ground
may simultaneously support several aircraft (resulting in economy of scale and reduc-
tion in duplication of effort). Furthermore, these personnel need not necessarily have
the same skill set as a pilot; rather, they could be specialists in navigation, commu-
nications or avionics systems. In the case of the single-crew aircraft, control from a
ground station would only be required in the advent of pilot incapacitation, although
assistance from the ground may be required in other circumstances, such as high
workload (e.g. take-off/landing) or abnormal (e.g. re-routing/bad weather/emergency)
situations. This approach would allow ground-based operators to undertake many of
the key roles of the second pilot but to do so for several aircraft simultaneously. This
emphasises that the design of a single-crew aircraft is not simply concerned with the
re-design of the flight deck. It requires a change in the overall operating philosophy.
‘Second Pilot’ Support Station/Office The primary functions of the ground-
based ‘second-pilot’ station/office is to provide real-time support for the pilot on
the aircraft as required and to assist in flight planning and pre-flight preparation.
If the hierarchy of tasks when flying an aircraft can be conceptualised as ‘Aviate’,
‘Navigate’, ‘Communicate’ and ‘Manage’, whenever possible the ‘Aviate’ component
will remain on the flight deck itself. However, if necessary, it will be possible to
operate the aircraft remotely from this position. It is envisaged that this support sta-
tion will be able to support a number of aircraft.
The main focus of ground-based support from this operator station will be on
aircraft configuration management and short-term navigation and communication
support to the pilot. Emphasis will be placed upon decision-aiding aspects of pilot
support.
256 Systems Thinking in Practice
This station will be crewed by pilots qualified on the single-crew aircraft, who
‘rotate’ through the post in between actually flying the aircraft. This should enhance
the shared Situation Awareness between ground and air components.
Real-Time Engineering Support: The single-crew aircraft will routinely pass
system operation information to the ground for automated health monitoring. This
is already done routinely for engine data but may be expanded to encompass all
critical aircraft systems in real time. System information will be monitored for sig-
nificant deviations from normal on the ground. In the event of a non-normal situ-
ation being detected, ground-based automated systems and engineering staff will
evaluate the system failure and either provide advice to the pilot or re-configure the
system remotely. Emphasis will be upon stabilising the situation and evaluating con-
sequences rather than attempting to rectify the problem in flight.
In the event of a serious system failure, the implications for the continuation of the
flight will be evaluated. If it is necessary to perform an immediate descent or diver-
sion, the appropriate navigation/flight planning facility will be notified.
Engineering support will be provided by engineers qualified on the aircraft and trained
to provide remote real-time support in the advent of an airborne system malfunction.
Navigation/Flight Planning Support: This is an extension of the existing airline
flight planning functions to encompass real-time, in-flight planning/re-planning
facilities. This facility will be expanded to encompass an ‘aircraft-centric’ point of
view and will be able to access the on-board flight management computers to up-link
new routing information. Support (long and short term) will be provided by flight
planning specialists.
System ‘Mirror’
The system mirror will be an independent, ground-based (software) representation of
the aircraft system states (in particular the Flight Management System [FMS], autopilot
system and autothrust systems and the general configuration of the aircraft – flaps, slats,
etc.). Ground-based system elements (pilot support station, flight/navigation panning
and engineering support) will be able to interact with the ground-based system mirror
without directly affecting aircraft systems (if required). In the advent of a datalink fail-
ure, the system mirror will contain the last known configuration of the aircraft systems
and will be able to update aircraft systems, if required. During normal operations, the
automation mirror will normally be ‘transparent’ to all operators in the system.
framework leads the analyst to consider the environment within which the task takes
place and the effect of the imposed constraints on the way work can be conducted. The
framework guides the analyst through the process of answering the question of why
the system exists and what activities can be conducted within the domain, as well as
how these activities can be achieved and who can perform them, also identifying the
competencies required. Recent case studies have been conducted in the assessment of
risk associated with nuclear decommissioning (Walker et al. 2014) and command team
activities in control of a submarine (Stanton and Bessell 2014).
The analyses in this chapter commence with a generic CWA concerning the
operation of various options for system configurations in a number of operating sce-
narios. These analyses are supplemented by a Social Network Analysis (SNA) which
provides an indication of the resilience of the operational networks in each case
(Diskell and Mullen 2004; Baber et al. 2013). This approach has previously been
used to examine the characteristics of terror cells (Kenney et al. 2013) and command
networks (Walker et al. 2009). These analyses can be used to examine options for the
proposed distributed system architecture for the operation of a single-crew aircraft.
They also help to define more specific aspects of new on-board automation require-
ments for the single-crew aircraft and the role of the Ground Support Station/Office.
Analyses commence with a ‘conventional’ baseline aircraft (Airbus A320 and
variants) being flown by two crew, followed by an analysis of the same aircraft being
operated by a single pilot. Note that it is a certification requirement that all air-
craft must be capable of being safely operated by a single crew member (FAR/CS
25.1523 – Minimum Flight Crew). These initial analyses were followed by a com-
parative analysis of four different configuration options for a single-crew-operated
aircraft being operated as part of a distributed system. Four potential versions of
single-pilot flight operations are presented for comparison (as shown in Table 13.1),
that is, a single-pilot aircraft (A); a single-pilot aircraft with an additional pilot at a
ground station who can be called upon at times of need (C); a single-pilot aircraft
with an automation mirror on the ground that cross-checks the inputs and outputs
independently of the aircraft automation (B); and a single-pilot aircraft with an addi-
tional pilot at a ground station and also with an independent automation mirror (D).
TABLE 13.1
Comparison of Four Potential Versions of Single-Pilot Flight Operations
Material for undertaking the CWA and SNA was drawn from a number of sources,
including operations manuals and SOPs (Airbus Industrie n.d.). These were comple-
mented by a structured de-brief of an experienced qualified Test Pilot who was also
type rated on a number of Airbus types (and is a training Captain for a major airline),
who also helped to devise the various operating scenarios. The CWA material will
be presented first as the formative design of the future system alternatives. Much
has been made of CWA as a formative approach (Vicente 1999; Jenkins et al. 2009;
Naikar 2013) but little is seen in practice. CWA served as the basis for identifying the
functional loading on agents in the system as well as providing the data for the SNA.
• Functional Purposes (the purposes of the work system and the external con-
straints on its operation)
• Values and Priority Measures (the criteria that the work system uses for
measuring its progress towards the functional purposes)
• Purpose-Related Functions (the general functions of the work system that
are necessary for achieving the functional purposes)
• Object-Related Processes (the functional capabilities and limitations of physi-
cal objects in the work system that enable the purpose-related functions)
• Physical Objects (the physical objects in the work system that afford the
object-related processes).
Functional Purposes
The AH was created in both a top-down and a bottom-up fashion. First, the overall
functional purpose of flight operations was specified. This is the reason why the sys-
tem exists. These purposes are independent of time; they exist for as long as the system
exists. In this case, it is to ‘transport people and cargo safely from A to B’ and ‘increase
From CWA to SNA 259
FIGURE 13.1 Work domain analysis showing the five levels and the means-ends-links.
shareholder dividend’ (i.e. ensure that the aircraft was economic to operate). These
purposes were represented as two nodes at the top of the WDA in Figure 13.1.
Physical Objects
As previously stated, a mixture of a top-down and a bottom-up approach has been
employed in this analysis. Moving down to the lowest level of the hierarchy, the
physical objects within the system were listed. The boundaries of this analysis lim-
ited this list to the systems of direct relevance to the operation of a future single-
crew aircraft rather than every single object. The boundaries of the analysis indicate
the levels of fidelity applied here. In an attempt to keep the analysis manageable,
the boundary has omitted individual system elements. Whilst it would have been
possible to decompose many of the listed objects into their component parts and
describe their affordances more concisely, this was outside the remit of this initial
260 Systems Thinking in Practice
evaluation. A list of the physical objects analysed can be found at the base of Figure
13.1. This list comprises primary flight display, navigation display, engine indication,
anti-ice system, environmental conditioning system, electrical systems, fuel system,
hydraulics, auxiliary power unit, flight management system, nav/comms (navigation/
communication), throttle, rudder pedals, high-lift devices, landing gear, brakes, fire-
extinguishing system and external lighting.
Object-Related Processes
The second level from the bottom of the AH, the object-related processes, captures
the processes that are conducted by the physical objects to perform purpose-related
functions. Most importantly, they capture the affordances of the physical objects
independently of their purpose. For example, movement of the aircraft on the ground
is afforded by the combination of the throttle, landing gear (nose wheel steering) and
brakes. A complete list of the object-related processes can be found at the level above
the base level of Figure 13.1 along with the links indicating to which object they
relate. To aid readability, this list comprises attitude of aircraft, airspeed, altitude
of aircraft, rate of climb or descent; Instrument Landing System (ILS) indications,
current heading of aircraft, flight plan, collision avoidance, terrain display, weather
alerting, ground speed, engine thrust; weight and balance of aircraft; engine health;
preventing icing; maintaining breathable atmosphere, maintaining thermal comfort,
powering aircraft avionics, fuel management, management of hydraulics, communi-
cation management, performance/cost index, movement of aircraft on the ground,
safety of cargo and conspicuity of aircraft.
Purpose-Related Functions
In the middle of the AH, the purpose-related functions are listed. These functions
have the ability to influence one or more of the values and priority measures. They
link the purpose-independent processes with the object-independent functions. They
are listed as ‘aviate’ (i.e. keeping the aircraft airborne); ‘communicate’ (i.e. staying
in touch with ATC/ATM and company operations as well as communicating with
crew and passengers); ‘navigate’ (i.e. plan, change and check the route for the aircraft
as required); ‘manage’ (i.e. manage the avionics system; and ‘warn’ (i.e. indicate to
aircrew and company operations when systems are outside their tolerances).
The use of the means-ends-links and the utility of the AH can be described with
the example shown in Figure 13.1. Figure 13.1 shows the node ‘aviate’ in the pur-
pose-related functions level. Following the links out of the top of this node answers
the question ‘why is this needed?’ – in this case, to ‘maximise comfort of passen-
gers’ and ‘maximise aircraft utilisation’. Following the links down from the ‘aviate’,
it is possible to answer the question ‘how can this be achieved?’ – in this case, by
‘attitude of aircraft’, ‘airspeed’, ‘altitude of aircraft’, ‘rate of climb’, ILS indications’
and ‘current heading/track of aircraft’.
The diagram does not prescribe a particular arrangement for providing this func-
tionality; rather, it lists all of the components that can affect it. In this case, there is
redundancy in the system.
From CWA to SNA 261
along the horizontal axis, and the work functions (associated with controlling and
managing the aircraft) are shown along the vertical axis of the CAT. The circles
indicate the work functions with the bars showing the extent of the table in which
the activity typically occurs. The dotted boxes around each circle indicate all of
the work situations in which a work function can occur (as opposed to must occur),
thus capturing the constraints of the system. Figure 13.2 shows the CAT for the
purpose of related functions derived from the abstraction hierarchy (see Figure
13.1). The situations follow the main phases of flight operations, from the aircraft
standing at a gate to landing on a runway (assuming that taxiing and standing will
be similar for both take-off and landing), along with the addition of an emergency
descent.
Looking at Figure 13.2, perhaps the most salient feature is that in an aircraft dur-
ing flight operations, some function constraints are notably contextually influenced
(e.g. rate of climb or descent, terrain display, ground speed, and movement of aircraft
on the ground) whereas others are not (e.g. engine thrust, engine health, powering
aircraft avionics, management of hydraulics and communication systems). To read
Figure 13.2, note that an empty cell means that the function (vertical axis) cannot be
performed in that situation (horizontal axis); a dashed box means that the function
can be performed in the situation, and a ball-and-whisker means that the function is
typically performed in the situation.
FIGURE 13.3 Social organisation and SOCA-CAT for current flight operations.
fuellers, dispatch and so on. With changes in automated support on the ground and in
the air, coupled with increases in air-traffic density, aircraft operational concepts are
constantly changing. Direct routing and self-assured separation (‘free flight’) have
vastly expanded the Joint Cognitive System boundaries around airliner operations
well beyond the flight deck (Hollnagel 2007). SNA is based upon the notion that
the relationship between agents within a social network has a significant effect upon
the actions performed and also the performance achieved by the network. SNA uses
both graphical and mathematical procedures to represent social networks. Typically,
centrality measures are calculated for each agent (e.g. degree, betweenness and
closeness), and the overall network density is calculated. This allows the identifica-
tion of the key agents within the network and also the classification of the network
structure. The technique has previously been used for the analysis of networks in
a number of areas, such as command and control (Stanton et al. 2008), search and
rescue operations (Baber et al. 2013) and submarine command teams (Stanton 2014).
All three studies have shown those people (agents) who are most important to the
success of the team, based on communication frequencies. There are a number of
metrics associated with the analysis of whole networks, depending upon the type
of evaluation that is being performed. The size of the network determines the num-
ber of possible relations, and the number of possible relations grows exponentially
with the size of the network. This defines the network’s complexity. The latter is
expressed in the form of social relations that are actually observed, represented as
some fraction of the total possible.
A major advantage of networks is that they do not differentiate between different
types of node (e.g. artefacts and/or people), so that from a modelling perspective,
they are not constrained by existing structures but rather help to define the tasks
allocation associated with a particular scenario (Baber et al. 2013; Stanton 2014).
It is also possible to model the temporal aspects of networks by identifying critical
moments in the sequence of activity. To do this, the scenario is divided into task
phases, allowing active and non-active elements to be specified and represented.
The first step in a SNA involves defining the network that is to be analysed. Once
the overall aircraft operation network is specified, the people and/or artefacts need to
be defined. In the case of the development of the single-crew aircraft, a number of dif-
ferent networks were identified for analysis over a number of different flight scenarios.
In this case, the agents identified were the pilot flying, the pilot monitoring, ATC/
ATM, dispatch, flight planning, engineering, ground handling and the fuellers. For
comparison, a description of current operations of two crew flying the baseline aircraft
is provided (see Table 13.2), with which the envisaged single crew commercial aircraft
options are contrasted. The initial analyses pertain to aircraft operations as a whole,
not to any particular normal, non-normal or emergency situation. The matrix repre-
sents the frequency of associations between each agent in the network. This matrix
shows whether or not an agent within the current aircraft system of operation can
be associated with any other agent in the proposed architecture for the single-crew
aircraft, specifically through frequency of communications. As an example, the asso-
ciation matrix for the generic aircraft operational scenario is presented in Table 13.2.
An example social network diagram for the takeoff task is presented in Figure
13.4. Comparison with the network archetypes shows that the network is mesh-like,
From CWA to SNA 265
TABLE 13.2
Association Matrix for Baseline Aircraft Generic Operational Scenario
Ground
handling
Pilot
monitoring
Dispatch
Aircra
automaon
ATC/ATM
Flight
planning
Fuelers
Pilot Flying
FIGURE 13.4 Network diagram for baseline aircraft generic operational scenario.
with dispatch and flight planning on the left-hand side; pilot monitoring, ATC/ATM
and pilot flying in the middle; and ground handling, aircraft automation and fuel-
lers on the right-hand side. Mesh structures are considered to be generally robust
(Stanton et al. 2008).
266 Systems Thinking in Practice
TABLE 13.3
Social Network Analysis Statistics
ATC
Nodal statistics PF PM* AA ATM D FP GH F
Emission/Reception 115 202 102 86 7 8 8 8
Eccentricity 1 1 2 2 2 2 2 2
Sociometric Status 25.55 44.88 22.66 19.11 1.55 1.77 1.77 1.77
Centrality (B-L) 5.28 5.28 4.11 4.11 3.70 3.70 3.36 3.36
Closeness 1.28 1.28 1.00 1.00 0.90 0.90 0.82 0.82
Farness 7 7 9 9 10 10 11 11
Betweenness 7.33 7.33 2.00 1.33 0 0 0 0
• Emission and reception degree are the number of ties emanating from, and
going to, each agent in the network.
• Eccentricity is defined by the largest number of hops an agent has to make
to get from one side of the network to another.
• The sociometric status of each agent refers to the number of communica-
tions received and emitted, relative to the number of nodes in the network.
• Agent centrality is calculated in order to determine the central or key
agent(s) within the network. There are a number of different centrality cal-
culations that can be made; for example, agent centrality can be calculated
using Bavelas-Leavitt’s index.
• Closeness is the inverse of the sum of the shortest distances between each
individual and every other person in the network. It reflects the ability to
access information through the ‘grapevine’ of network members.
• Farness is the index of centrality for each node in the network, computed as
the sum of each node to all other nodes in the network by the shortest path.
• Betweenness is defined by the presence of an agent between two other
agents, which may be able to exert power through its role as an information
broker.
The same principles were used to develop the four networks associated with
each of the single-pilot options, each representing one of the four visions for future
From CWA to SNA 267
flight operations. Again, the networks appeared mesh-like, with fewer connections
in the network in Option A (single-pilot aircraft) and more connections in Option D
(a single-pilot aircraft with an additional pilot at a ground station and also with an
independent automation mirror).
More robust networks generally have more connections, but that does not neces-
sarily mean that everything should be connected to everything else. Unnecessary
connections in a network can lead to greater coordination problems and could also
mean that irrelevant information is being communicated (Rafferty et al. 2012;
Sorensen and Stanton 2013). Analysis of the SOCA-CATs shows some differences
in the functional loading of the single-pilot configurations compared to the current
version of flight operations, as revealed in Table 13.4.
As Table 13.4 shows, removing the pilot monitoring from the network dramati-
cally increases the functional loading on the remaining pilot on the flight deck as
well as reducing the density of the network (where 0 means no connections, and
1 means everything is connected to everything else). The single pilot with a pilot
on the ground (Options C and D) has the closest resemblance to current operations
(although the pilot on the ground would have responsibility for monitoring several
aircraft in different phases of flight). This comparison is for both the loading of
functions and the network density. The most robust network appears to be option D,
with the single pilot with the pilot on the ground and the automation mirror (which
replicates the aircraft automation, using the same inputs and comparing with the
results of the aircraft automation – only reporting when a discrepancy is found), as
this network has the highest density (Walker et al. 2009)
The SOCA-CAT cooperation and collaboration interactions were compiled
for comparative analysis. As before, the analysis assumes that the networks were
TABLE 13.4
Functional Loading for the Generic Scenario
Current
Function Loading/Options System Option A Option B Option C Option D
Pilot Flying (PF) 90 217 217 90 90
Pilot Monitoring (PM) or Pilot on 160 – – 160 160
the Ground (PG)
Aircraft Automation (AA) 143 143 143 143 143
System Mirror (SM) – – 143 – 143
Air Traffic Control (ATC) and Air 51 51 51 51 51
Traffic Management (ATM)
Dispatch (D) 2 2 2 2 2
Flight Planning (FP) 3 3 3 3 3
Ground Handling (GH) 4 4 4 4 4
Fuelers (F) 3 3 3 3 3
Network Density* 0.422 0.266 0.377 0.422 0.555
symmetrical – that each input is met with a corresponding output. For human–
human interaction, this would mean that a request is met with a response or that
an instruction is met with confirmation (this could be verbal or non-verbal, such as
moving a lever that is seen by the person issuing the instruction). In human–machine
interaction, this would mean that depressing a switch or typing an instruction into
the automation is met with some form of output, such as a change in the display sta-
tus or direct voice output (Table 13.5).
The analysis of the networks across the various metrics confirm that the two
networks on the right-hand side of the figures (i.e. the single pilot with additional
pilot on the ground – top right – Option C) and single pilot with additional pilot
on the ground and automation mirror on the ground (bottom right – Option D) are
the most robust versions of the network as there is less dependency on the single
role at the centre of the network (i.e. the pilot flying). This is revealed in several
ways. First, the eccentricity of the nodes in the network (i.e. the largest number of
hops an agent has to make to get from one side of the network to the other) where
the pilot flying and the pilot on the ground have only one hop in the version on
the right-hand side of the figure, making them all connected in the terms of the
network archetypes (as shown by the number of ties). The pilot on the ground has
the highest nodal degree and sociometric status on the right-hand side of the figure,
which is due in part to the number of ties and in part to the greatest number of
emission and reception connections with other nodes in the network. The pilot fly-
ing and the pilot on the ground are highest on the centrality and closeness metrics
because they are both at the centre of the network and have the shortest distance
to every other node. This suggests that they have high importance in the network,
which is not very surprising (Baber et al. 2013; Harris et al. 2015; Kenney et al.
2013). They are also lowest on farness for the same reasons. On the betweenness
metric, the pilot flying exerts less influence over the network because this influence
is shared with the pilot on the ground. The combination of more links and less
dependency on any one agent makes for a more robust network (Stanton 2014). In
summary, SNA can be used to determine the importance of different agents within
a social network and also to classify the network type. SNA offers a comprehensive
analysis of the network in question. The key agents within the network are speci-
fied, as are the frequency and direction of communications within the network. As
such, it proves useful for comparing the different networks that result from the new
single-pilot concepts.
As a development of method, the relationships between CWA and SNA are not
necessarily obvious but have allowed novel exploration of the differences between
dual, single and distributed crewing options in this chapter. To that extent, we have
further developed the approach reported by Houghton et al. (2006) and Baber et al.
(2013). The SOCA-CAT phase of CWA offers a formative allocation of functions
against situations (phases of flight in the present case). As such, it has enabled us
to consider the possible communications between the agents in the system for all
four of our proposed options against the current dual crewing operations. As safety
is paramount in aviation, we require any future option to be as least as safe as con-
temporary crewing. SNA offers the opportunity to consider the likely effects on the
communication networks from a quantitative perspective.
TABLE 13.5
Social Network Analysis of the Four Future Concepts
ATC ATC
Reception Reception
Eccentricity 1 2 2 2 2 2 2 Eccentricity 1 1 2 2 2 2 2 2
Sociometric 33.55 22.66 11.55 1.11 1.33 1.33 1.33 Sociometric 25.55 44.88 22.66 19.11 1.55 1.77 1.77 1.77
Status Status
Centrality 5.00 3.75 3.75 3.33 3.33 3.00 3.00 Centrality 5.28 5.28 4.11 4.11 3.70 3.70 3.36 3.36
(B-L) (B-L)
Closeness 1.5 1.15 1.12 1.00 1.00 0.90 0.90 Closeness 1.28 1.28 1.00 1.00 0.90 0.90 0.82 0.82
Farness 6 8 8 9 9 10 10 Farness 7 7 9 9 10 10 11 11
Betweenness 13 3 2 0 0 0 0 Betweenness 7.33 7.33 2.00 1.33 0 0 0 0
OPTION B PF AA SM ATC D FP GH F OPTION D PF PM AA SM ATC D FP GH F
ATM ATM
Emission/ 245 204 204 54 5 6 10 8 Emission/ 127 284 204 204 88 7 8 12 10
Reception Reception
Eccentricity 1 2 2 2 2 2 2 2 Eccentricity 1 1 2 2 2 2 2 2 2
Sociometric 54.44 45.33 45.33 12.00 1.11 1.33 2.22 1.77 Sociometric 28.22 63.11 45.33 45.33 19.55 1.55 1.77 2.66 2.22
Status Status
Centrality 5.57 4.33 4.33 4.33 3.54 3.54 3.54 3.54 Centrality 5.87 5.87 4.7 4.7 4.7 3.9 3.9 3.9 3.9
(B-L) (B-L)
Closeness 1.28 1.00 1.00 1.00 0.81 0.81 0.81 0.81 Closeness 1.12 1.12 0.9 0.9 0.9 0.75 0.75 0.75 0.75
Farness 7 9 9 9 11 11 11 11 Farness 8 8 10 10 10 12 12 12 12
Betweenness 14 2 2 4 0 0 0 0 Betweenness 8.16 8.16 1.5 1.5 2.66 0 0 0 0
KEY: single pilot (top left – Option A), single pilot with system mirror on the ground (bottom left – Option B), single pilot with additional pilot on the ground (top
right – Option C) and single pilot with additional pilot on the ground and system mirror on the ground (bottom right – Option D).
269
270 Systems Thinking in Practice
CONCLUSIONS
Previous approaches to developing a single-crew aircraft have focused on the
development of sophisticated airborne technology to assist the pilot, but they have
achieved only mixed success (Harris 2007). However, there are no major reasons
why a single-pilot-operated commercial aircraft is not feasible in the very near future
using existing technology. Military aviation has flown complex, high-performance,
single-crew aircraft for many years, and Uninhabited Air Vehicles (UAVs) are now
commonplace. It is time for these technologies to be spun out further into the com-
mercial domain, where they may be applied to financial advantage. The greatest
obstacle to the operation of civil, single-pilot aircraft is not the technology per se.
It is combining the technology, designing the user interfaces and developing a new
concept of operations to make such an aircraft safe and useable in a wide range of
normal and non-normal operating situations when flown by a typical commercial
pilot. The Human Factors requirements are the prime driver in this case, not the
technology (Harris 2007).
Instead of developing a concept of single-pilot operations based upon equipping
an aircraft with complex automation to aid the pilot, the approach described in this
chapter begins to demonstrate how by using a distributed, air/ground, sociotechnical
system, such an aircraft could be ready for service entry within a decade. Instead
of replacing many of the functions of the second pilot, they are simply displaced
to assistance on the ground (q.v. the operation of UAVs). Furthermore, in many cir-
cumstances, the assistance provided from the ground may be of higher quality and
better targeted than that normally available from the second seat on the flight deck
as a result of being able to draw upon a wider range of engineering and flight plan-
ning resources.
CWA, especially the SOCA-CAT phases, has been useful as a formative system
design approach to aid understanding of the function allocation distribution between
the agents and the functional loading on them. Extending this analysis to understand
communication interactions in SNA has revealed Option D (single pilot with addi-
tional pilot on the ground and system mirror on the ground) to be the most resilient,
even more than the current dual-pilot cockpit. It is debatable whether or not this option
could have prevented the recent tragedy with Germanwings (BBC 2015), which has
revealed a further weakness with current operations. Nevertheless, it is most likely that
reduced crewing options are most likely to be implemented in short-haul cargo opera-
tions before they ever become a possibility for passenger-carrying aircraft.
The baseline descriptions for general operations of a conventional two-crew air-
liner (using CWA and SNA) and the same airliners being operated by just a single
crew member give an overall idea of the level of complexity and resilience in the
current system that need to be achieved in future single-crew operations. There is a
natural split between the PF and PM functions that have evolved over decades. The
main question being addressed here is whether these roles have to be co-located. In
particular, the CWA and SNA describe the functions required irrespective of their
location. The social network statistics produced for the various configurations of
single-crew operations indicate that equivalent (or even enhanced) levels of system
resilience may be achieved.
From CWA to SNA 271
Future research will extend the analysis into contemporary issues such as
trajectory, conflict and system-wide information management. Another important
goal of this research is to validate the SOCA-CAT and SNA models in flight sim-
ulators. This would require developing the scenarios and structures as presented
in the four options and testing against the baseline with pilot crews. This analysis
would also enable experiential feedback from pilots to be gathered to supplement the
performance data, offering an opportunity to understand how alternative crewing
options might affect the duty of care the pilots have for the passengers that they are
carrying. The immediate future of the flight deck is unlikely to change dramatically,
but we can foresee a time within the next 20 years when the distributed crewing
concept could enter short-haul cargo operations. When this is proven to be safe and
effective, it might even enter into service for short-haul passenger aircraft.
REFERENCES
Airbus Industrie (n.d.). A319/A329/A321 Flight Crew Operating Manual (Volume 3: Flight
Operations) – Revision 36. Author: Blagnac, France.
Alcock, C. (2004). New turboprop push tied to rising fuel costs. Aviation International
News, 29 September 2004. Available at HYPERLINK “http://www.ainonline.
com/Publications/era/era_04/era_newturbop18.html” http://www.ainonline.com/
Publications/era/era_04/era_newturbop18.html (Accessed 30 January 2007).
Baber, C., Stanton, N. A., Atkinson, J., McMaster, R. and Houghton, R. J. (2013). Using
social network analysis and agent-based modelling to explore information flow using
common operational pictures for maritime search and rescue operations. Ergonomics,
56, 889–905.
BBC (2015). Germanwings crash latest updates. Available at http://www.bbc.com/news/live/
world-europe-32070570 (Accessed 4 June 2015).
Bonner, M., Taylor, R., Fletcher, K. and Miller, C. (2000). Adaptive automation and decision
aiding in the military fast jet domain. In: D. B. Kaber and M. R. Endsley (Eds.), Human
Performance, Situation Awareness and Automation: User-Centred Design for the New
Millennium (pp. 154–159). Omnipress: Madison, WI.
Civil Aviation Authority (2008). Global Fatal Accident Review 1997–2006 (CAP 776). Civil
Aviation Authority: London, UK.
DeJohn, C. A., Wolbrink, A. M. and Larcher, J. G. (2004). In-Flight Medical Incapacitation
and Impairment of U.S. Airline Pilots: 1993 to 1998 (DOT/FAA/AM-04/16). US
Department of Transportation, Federal Aviation Administration, Office of Aerospace
Medicine: Washington, DC.
Deutch, S. and Pew, R. W. (2005). Single Pilot Commercial Aircraft Operation (BBN Report
No. 8436). BBN Technologies: Cambridge, MA.
Driskell, J. E. and Mullen, B. (2004). Social network analysis. In N. A. Stanton et al. (Eds.),
Handbook of Human Factors and Ergonomics Methods (pp. 58.1–58.6). CRC Press:
London, UK.
easyJet plc (2013). Annual report and accounts 2013. Available at: http://corporate.easyjet.
com/~/media/Files/E/Easyjet-Plc-V2/pdf/investors/result-center-investor/annual-
report-2013.pdf (Accessed 27 June 2014).
European Aviation Safety Agency (2014). Certification Specifications for Large Aeroplanes
(CS-25): Amendment 15. EASA: Cologne. Available at: http://easa.europa.eu/system/
files/dfu/00%20Annex%20to%20ED%20Decision%202014-026-R.pdf.
Evans, S. and Radcliffe, S. A. (2012). The annual incapacitation rate of commercial pilots.
Aviation, Space and Environmental Medicine, 83(1), 42–49.
272 Systems Thinking in Practice
Galea, E. R., Filippidis, L., Wang, Z., Lawrence, P. J. and Ewer, J. (2011). Evacuation analysis
of 1000+ seat Blended Wing Body aircraft configurations: Computer simulations and
full-scale evacuation experiment. In: R. D. Peacock, E. D. Kuligowski and J. D. Averill
(Eds), Proceedings Pedestrian and Evacuation Dynamics 2010: 5th International
Conference (pp. 151–162). Springer: New York, NY.
Harris, D. (2003). The human factors of fully automatic flight. Measurement and Control,
36, 184–187.
Harris, D. (2007). A human-centred design agenda for the development of a single crew oper-
ated commercial aircraft. Aircraft Engineering and Aerospace Technology, 79, 518–526.
Harris, D. and Stanton, N. A. (2010). Aviation as a system of systems. Ergonomics, 53(2),
145–148.
Harris, D., Stanton, N. A. and Starr, A. (2015). Spot the difference: Operational event sequence
diagrams as a formal method for work allocation in the development of single-pilot
operations for commercial aircraft. Ergonomics, 58 (11), 1773–1791.
Hollnagel, E. (2007). Flight decks and free flight: Where are the system boundaries? Applied
Ergonomics, 38, 409–416.
Houghton, R. J, Baber, C., McMaster, R., Stanton, N. A., Salmon, P. M., Stewart, R. and
Walker, G. H. (2006). Command and control in emergency services operations: A
social network analysis. Ergonomics, 49(12–13), 1204–1225.
Jenkins, D. P., Stanton, N. A., Walker, G. H. and Salmon, P. M. (2009). Cognitive Work
Analysis: Coping with Complexity. Ashgate: Aldershot, UK.
Keinrath, C., Vašek, J. and Dorneich, M. (2010). A cognitive adaptive man–machine Interface
for future flight decks. In: A. Droog and M. Heese (Eds), Performance, Safety and Well-
being in Aviation Proceedings of the 29th Conference of the European Association
for Aviation Psychology (20–24 September 2010, Budapest, Hungary). European
Association of Aviation Psychology.
Kenney, M., Horgan, J., Horne, C., Vining, P., Carley, K. M., Bigrigg, M. W., Bloom, M. and
Braddock, K. (2013). Organisational adaptation in an activist network: Social networks,
leadership, and change in al-Muhajiroun. Applied Ergonomics, 44(5), 739–747.
McIlroy, R. C. and Stanton, N. A. (2011). Getting past first base: Going all the way with cogni-
tive work analysis. Applied Ergonomics, 42(2), 358–370.
Naikar, N. (2006a). Beyond interface design: Further applications of cognitive work analysis.
International Journal of Industrial Ergonomics, 36, 423–438.
Naikar, N. (2006b). An examination of the key concepts of the five phases of cognitive work
analysis with examples from a familiar system. Proceedings of the Human Factors and
Ergonomics Society 50th Annual Meeting, 447–451.
Naikar, N. (2013). Work Domain Analysis: Concepts, Guidelines, and Cases. CRC Press:
London, UK.
Onken, R. (1994). Human-centred cockpit design through the knowledge-based cockpit assistant
system CASSY. In: NATO DRG Panel 8 Workshop on Improving Function Allocation for
Integrated System Design. TNO Institute for Perception: Soesterberg, NL.
Onken, R. (1997). Functional development and field test of CASSY – A knowledge based
cockpit assistant system. Knowledge-Based Functions in Aerospace Systems, AGARD
Lecture Series 200, AGARD, Neuilly-sur-Seine, France.
Rafferty, L. A., Stanton, N. A. and Walker, G. H. (2012). Human Factors of Fratricide.
Ashgate: Aldershot, UK.
Rasmussen, J., Pejtersen, A. and Goodstein, L. P. (1994). Cognitive Systems Engineering.
Wiley: New York, NY.
Ryanair (2009). Full Year Results, 2009. Available at: http://www.ryanair.com/doc/inves-
tor/2009/q4_2009_doc.pdf (Accessed 17 August 2010).
From CWA to SNA 273
Schulte, A. and Stütz, P. (2001). Cognitive concepts in mission management for air-to-ground
attack aircraft. In D. Harris (Ed.), Engineering Psychology and Cognitive Ergonomics
(pp. 23–30), Volume 5. Ashgate: Aldershot, UK.
Sorensen, L. J. and Stanton, N. A. (2013). Y is best: How distributed situational awareness is
mediated by organisational structure and correlated with task success. Safety Science,
56, 72–79.
Stanton, N. A., Baber, C. and Harris, D. (2008). Modelling Command and Control: Event
Analysis of Systemic Teamwork. Ashgate: Aldershot.
Stanton, N. A. (2014). Representing distributed cognition in complex systems: How a subma-
rine returns to periscope depth. Ergonomics, 57(3), 403–418.
Stanton, N. A. and Bessell, K. (2014). How a submarine returns to periscope depth: Analysing
complex socio-technical systems using cognitive work analysis. Applied Ergonomics,
45(1), 110–125.
Stanton, N. A., Harris, D. and Starr, A. (2014). Modelling and analysis of single pilot opera-
tions in commercial aviation. Proceedings of HCI Aero 2014. 30 July–1 August 2014,
Santa Clara, CA.
Stütz, P. and Schulte, A. (2001). Evaluation of the Cockpit Assistant Military Aircraft
(CAMA) in flight trials. In D. Harris (Ed.), Engineering Psychology and Cognitive
Ergonomics (pp. 15–22), Volume 5. Ashgate: Aldershot, UK.
Taylor, R. M., Howells, H. and Watson, D. (2000). The cognitive cockpit: Operational require-
ment and technical challenge. In: P. T. McCabe, M. A. Hanson and S. A. Robertson
(Eds.), Contemporary Ergonomics 2000 (pp. 55–59). Taylor and Francis: London, UK.
Thomas, M. J. W. (2003). Improving organisational safety through the integrated evaluation
of operational and training performance: An adaptation of the Line Operations Safety
Audit (LOSA) methodology. Human Factors and Aerospace Safety, 3, 25–45.
Vicente, K. J. (1999). Cognitive Work Analysis: Toward Safe, Productive, and Healthy
Computer-based Work. Lawrence Erlbaum Associates: Mahwah, NJ.
Walker, G. H., Cooper, M., Thompson, P. and Jenkins, D. (2014). Practitioner versus ana-
lyst methods: A nuclear decommissioning case study. Applied Ergonomics, 45(6),
1622–1633.
Walker, G. H., Stanton, N. A., Salmon, P. M., Jenkins, D., Stewart, R. and Wells, L. (2009).
Using an integrated methods approach to analyse the emergent properties of military
command and control. Applied Ergonomics, 40(4), 636–647.
Wiener, E. L. and Curry, R. E. (1980). Flight deck automation: Promises and problems.
Ergonomics, 23, 995–1011.
Wilson, J. R. and Carayon, P. (2014). Systems ergonomics: Looking into the future – Editorial
for special issue on systems ergonomics/human factors. Applied Ergonomics, 45(1),
3–4.
14 Future Directions for
the Event Analysis of
Systemic Teamwork
INTRODUCTION
This book has presented a series of studies in which the Event Analysis of Systemic
Teamwork (EAST) framework has been used to describe, understand, and even fore-
cast the behaviour of complex systems. EAST has shown itself capable of dealing
with highly complex, multi-agent, distributed systems, and in most cases the outputs
were used to identify interventions to enhance performance or safety. Whilst this is
encouraging, however, the systems in which human factors and ergonomics practitio-
ners work are arguably becoming more complex and technology driven (Grote et al.
2013; Dekker et al. 2013; Salmon et al., 2017; Walker et al. 2017; Woods and Dekker
2000). This, coupled with a dramatic shift towards the systems thinking paradigm, is
beginning to stretch the capabilities of many human factors and ergonomics methods.
We are certainly not alone in expressing these concerns. Dekker (2014), Leveson
(2011), Salmon et al. (2011; 2017) and Walker et al. (2017) discuss the increasing
complexities of modern-day systems and the extent to which they are rapidly outpac-
ing the capabilities of our methodological toolkit. Salmon et al. (2017) in particular
outlines five key challenges that human factors and ergonomics methods face. It is
our contention that the EAST framework can respond to these challenges.
The aim of this chapter is to demonstrate this by examining the contemporary ergo-
nomics problem space and the extent to which EAST can meet the challenges posed.
Specifically, we outline Salmon et al.’s five key challenges, and discuss the capacity of
EAST to respond to them. The five challenges include (Salmon et al., 2017):
275
276 Systems Thinking in Practice
Rasmussen 1997), and there are a range of methods that enable accidents to be ana-
lysed from this perspective (e.g. Hollnagel 2012; Svedung and Rasmussen 2002;
Leveson 2004). Accidents are now widely acknowledged to be systems phenomena,
just as safety is (Hollnagel 2004; Dekker 2011). Both safety and accidents, there-
fore, are emergent properties arising from non-linear interactions between multiple
components distributed across a complex web of human and machine agents and
interventions (e.g. Leveson 2004).
This form of thinking, and the evolution of it, brings the methods we currently use
into question. Salmon et al. (2017) point out that, despite the great progress in safety
performance that has been made in most safety-critical sectors since the Second
World War, significant trauma still occurs, and in some areas, progress may be
slowing. Worse still, in some domains, incidents appear to be rising again. Leveson
(2011) agrees, and suggests that one reason is that our methods do not fully uncover
the underlying causes of accidents. Salmon et al. (2017) argue that a major the issue
may be that the evolution in accident causation models is not reflected in current
accident analysis methods.
One of the fundamental advances provided by state-of-the-art accident causa-
tion models relates to the idea that the behaviours underpinning accidents do not
necessarily have to be errors, failures or violations (e.g. Dekker 2011; Leveson
2004; Rasmussen 1997). As Dekker (2011) points out, systems thinking is about
how accidents can happen when no parts are broken. ‘Normal performance’
plays a role too (Perrow 1984). Salmon et al. (2017) outlines two tenets that have
important implications for the methods that we use. First, normal performance
plays a role in accident causation; and second, accidents arise from the very same
FIGURE 14.1 The pattern of global passenger fatalities per 10 million passenger miles on
scheduled commercial air transport since 1993. The graph shows that the precipitous drop in
fatality rates since 1945 has, since 2003, levelled off.
Future Directions for Systems Ergonomics Methods 277
behaviours and processes that create safety. Dekker (2011), for example, argues
that the seeds for failure can be found in ‘normal, day-to-day processes’ (p. 99)
and are often driven by goal conflicts and production pressures. These normal
behaviours include workarounds, improvisations, and adaptations (Dekker 2011)
but may also just be normal work behaviours routinely undertaken to get the job
done. It is only with hindsight and a limited investigation method that these normal
behaviours are treated as failures.
The tenets described above provide an interesting shift in the requirements for
accident analysis methods. Dekker (2014) argues that practitioners should not look
for the known problems that appear in incident reporting data or safety management
systems. Instead, he argues that the focus should be in the places where there are
no problems, in other words, normal work. In addition, the burgeoning concept of
Safety II (Hollnagel et al. 2013) argues that safety management needs to move away
from attempting to ensure that as little as possible goes wrong and towards ensuring
that as much as possible goes right. A key part of this involves understanding perfor-
mance when it went right as well as when it went wrong.
Salmon et al. (2017) discuss how, out of three popular contemporary acci-
dent analysis methods (Accimap, STAMP, HFACS), only the Accimap method
(Rasmussen, 1997) is capable of describing normal performance and of consid-
ering the role of normal performance in accident causation. AcciMap is used to
describe accidents in terms of contributory factors and the relationships between
them. This enables a comprehensive representation of the network of contributory
factors involved. It does this by decomposing systems into six levels, across which
analysts place the decisions and actions that enabled the accident in question to
occur (although the method is flexible in that the number of levels can be adjusted
based on the system in question). Interactions between the decisions and actions are
subsequently mapped onto the diagram to show the relationships between contribu-
tory factors within and across the six levels. A notable feature of AcciMap is that
it does not provide analysts with taxonomies of failure modes; rather, analysts have
the freedom to incorporate any factor deemed to have played a role in the accident
in question.
Both HFACS and STAMP provide taxonomies of error and failure modes that are
used to classify the behaviours involved in accident scenarios, which in turn means
that there is little scope for analysts to include behaviours other than those deemed to
have been failures of some sort. There is no opportunity for analysts to incorporate
normal behaviours in their descriptions of accidents – they have to force-fit events
into one of the error or failure modes provided. A consequence is that the normal
behaviours that contribute to accidents are not picked up during accident analysis
efforts. This may impact accident prevention activities by providing a false sense
of security that nothing else is involved and thus nothing needs modification (apart
from error-producing human operators).
AcciMap, on the other hand, does not use a taxonomy of failure or error modes
and so enables analysts to incorporate normal performance and to show its relation-
ship with other behaviours (Salmon et al., 2017). Despite this, AcciMap descriptions
still tend to incorporate contributory factors that relate only to failures, and few
Accimap analyses actually incorporate normal performance.
278 Systems Thinking in Practice
The EAST framework provides an approach that can be used to integrate analyses
of normal performance and accident causation. As demonstrated in this book, the
EAST framework is used primarily to describe ‘normal performance’ by describ-
ing the task, social and information networks underpinning behaviour. In addi-
tion, EAST has also been used for accident analysis purposes (Griffin et al., 2008;
Rafferty et al., 2012; Salmon et al., 2011; 2016). Since EAST was originally devel-
oped to describe normal performance, and has since been applied for accident analy-
sis purposes, it seems suited to incorporating both normal performance and failures
in descriptions of accidents. It is therefore recommended that further applications of
EAST for accident analysis purposes are undertaken. In particular, within the three
networks a focus should be placed on how normal performance either creates or
interacts with failures. This will allow rich, in-depth descriptions of the role of both
normal performance and failures in accidents.
The conclusion, then, is that there is room for improvement in our accident
analysis methods. Not all state-of-the-art methods are consistent with our current
understanding of accident causation. Further, even for the methods that are, such as
AcciMap, it is questionable whether they are being used in a manner that is consis-
tent with contemporary models of accident causation. This represents a key issue
for human factors and ergonomics researchers and practitioners and for safety sci-
ence generally. On the one hand, there is now a widespread understanding that the
role of normal performance in accidents is apparent and needs to be understood
(Dekker 2011, 2014; Leveson 2011; Rasmussen 1997). On the other hand, accident
analysis efforts, regardless of domain, do not seem to be dealing particularly well
with this feature. This means our understanding of accidents may be incomplete.
The EAST framework described in this book provides can be used to respond to
this challenge.
ACCIDENT PREDICTION
Forecasting accidents before they occur has been labelled the final frontier for human
factors and ergonomics (Moray 2008; Salmon et al. 2011; Stanton and Stammers
2008). Although there have been various attempts at developing accident prediction
models (e.g. Deublein et al. 2013), most are statistical models that are unable to iden-
tify and describe how behaviours across overall sociotechnical systems might com-
bine to create failure scenarios. Other predictive methods are available, such as those
that can be used to predict the ‘human errors’ that lead to accidents (see Stanton et al.
2013). Indeed, some of these methods have been shown to achieve acceptable levels
of reliability and validity (e.g. Stanton et al. 2009). The problem is that they predict
what is likely the last behaviour in a long and complex network of interacting and
emergent behaviours occurring across various parts of the system. They predict con-
sequences, not causes, and they do not identify the network of contributory factors
that might co-occur to create accidents. Accident prevention efforts are better served
by looking at the interactions that occur before the human operator makes the error.
In short, it is the entire accident scenario, including interacting factors and emergent
behaviours, that are important for understanding how to prevent accidents.
Future Directions for Systems Ergonomics Methods 279
FIGURE 14.2 The EAST models sociotechnical systems by combining task, social and
knowledge networks into composite networks that can be systematically degraded into all
possible configurations.
boundary of safe operations (Rasmussen 1997). This systems level focus encourages
a different approach to forecasting resilience: to examine persistent and emergent
patterns that arise even though the boundaries of the system cannot always be fully
known. Further testing of EAST in this capacity is currently being undertaken by
the authors, and it is recommended that further predictive applications of EAST are
undertaken.
Economic failure
boundary
Adverse events
Unacceptable
workload boundary
Boundary defined by
official work practices
FIGURE 14.3 Rasmussen’s dynamic safety space (Adapted from Rasmussen 1997).
behaviour can cause the system to cross safety boundaries and accidents to happen
(Qureshi 2007; Rasmussen 1997). The key, then, is to detect in advance a) where
those boundaries are and b) where the system is travelling in relation to them.
Mapping Migration
Unfortunately, there are few human factors and ergonomics methods that are capable
of describing where boundaries are situated and whereabouts organisations may be
in relation to them. Further, the ability to dynamically track an organisation’s migra-
tion is not readily supported by current methods. Whilst information on so-called
lagging indicators can provide an indication of proximity to a safety boundary, there
is an absence of human factors and ergonomics methods that use leading indicators
to track organisational performance and safety. Work currently being undertaken by
the authors of this book is exploring the capacity for EAST to be used as a frame-
work for a. identifying leading indicators, and b. tracking organisational behaviour
and ultimately migration towards and away from safety boundaries.
SYSTEMS CONCEPTS
Salmon et al. (2017) argue that many human factors and ergonomics concepts could
be better understood by adopting a systems thinking lens. Citing accident causa-
tion and distributed situation awareness as examples of where a systems thinking
approach has proved successful, Salmon et al. (2017) argue that other concepts such
as mental workload and decision making should be viewed through a systems lens.
They also argue, however, that we do not possess the methods to support this. It is
282 Systems Thinking in Practice
our view that EAST provides an appropriate method with which to view concepts
such as mental workload and decision making through a systems lens.
Mental workload (see Young et al. 2015) is a case in point. Whilst it has predomi-
nantly been thought of as an individual operator concept, it is increasingly being
examined at the team level (Helton et al. 2014), and there is no reason why it cannot
be considered at a systems level. Just as Stanton et al. (2006) describe how situa-
tion awareness is an emergent property of systems and is distributed across opera-
tors, mental workload can be also thought of in this way. Moreover, similar to the
transactions in awareness described by Stanton and colleagues, transactions in men-
tal workload between operators are readily apparent in sociotechnical systems. An
example of this is the workload shedding by air traffic controllers, dividing sectors
up as the air traffic increases (Walker et al. 2010).
There are many methods available to support the assessment of individual operator
workload, including the highly popular NASA TLX (Hart and Staveland 1988) and
many similar subjective rating scales (see Stanton et al. 2013). In addition, there are
other individual focused methods, such as psychophysiological measures. Further,
methodologies that support the assessment of team mental workload are emerging
(Helton et al. 2014), although these are not without their problems. Unfortunately,
methods that can specifically consider mental workload at a systems level do not yet
exist. Such a method, something akin to ‘distributed mental workload’ assessment,
would need to consider the workload of multiple agents, how interactions between
actors shapes each other’s workload, how different levels of workload dynamically
shift throughout task performance and, further, what wider systemic factors con-
strain or facilitate workload. In addition, under a systems view, workload across
system levels and even non-human actors should be considered.
Again, it is our opinion that EAST can be used to provide such an analysis.
Specifically, EAST considers multiple agents and interactions between them (via
the social network), the tasks being undertaken by different agents (via the task
network), and the information load associated with different tasks and agents (via
the information network). Early applications of the EAST framework used the
information network to provide an indirect assessment of operator workload by
calculating the total number of information nodes being used by different opera-
tors during different scenario phases (e.g. Salmon et al., 2008). This provides a
dynamic indication of workload as different tasks are undertaken. As such, EAST
can be used to assess the level of workload imposed on different agents, the dis-
tribution of this workload across the system, and how this workload is exchanged
across agents.
The requirement to shift the emphasis on human factors and ergonomics to the
front end of the design life cycle is well known (Norros 2014; Salmon et al., 2017).
However, it requires human factors and ergonomics methods that can be used by
designers and design teams to design or that can at least be integrated with existing
design approaches. It also requires human factors and ergonomics researchers and
practitioners to take the lead to facilitate design efforts, which would be a paradigm
shift in the way complex systems are engineered.
Whilst a significant shift is required, it is notable that many of our methods are
suited to directly and indirectly informing design. Rather than develop new meth-
ods per se, the pressing requirement seems to be the development of processes that
bridge the gap between analysis and design. Specifically, processes are required
to translate human factors and ergonomics analyses into specific design require-
ments. One such approach that has been developed recently for this purpose is the
Cognitive Work Analysis design toolkit (CWA-DT) (Read et al. 2015; 2017).
The CWA-DT assists CWA users to identify extract insights from CWA analyses
and to use these insights within a participatory design paradigm. It promotes the col-
laborative involvement of experts (i.e. human factors and ergonomics professionals,
designers and engineers), stakeholders (i.e. company representatives, supervisors,
unions) and end-users (i.e. workers or consumers) to solve design problems based on
insights gained through CWA.
Underlying the CWA-DT is both the design philosophy of CWA (i.e. ‘let the
worker finish the design’) and the related sociotechnical systems theory approach,
which aims to design organisations and systems that have the capacity to adapt and
respond to changes and disturbances in the environment (Trist and Bamforth 1951;
Cherns 1976; Clegg 2000; Walker et al. 2009). Consequently, the CWA-DT provides
design tools and methods that encourage consideration of the values underlying the
sociotechnical systems approach (and indeed underpinning human factors ergonom-
ics more generally). These include the notion of humans as assets or adaptive deci-
sion makers rather than error-prone liabilities; of technology being designed as a tool
to assist humans to achieve their goals, rather than implemented because of assumed
efficiency or cost savings; the consideration of the needs and capabilities of a diverse
set of end-users; and of design focussing on promoting the quality of life or wellbe-
ing for end-users. Further, the consideration of sociotechnical design principles, such
as minimal critical specification, boundary management and joint design of social
and technical elements, intends to achieve the design of systems that can operate
within their safety and performance boundaries both on implementation and in an
ongoing fashion through continual monitoring and re-design.
Whilst the approach was originally designed for use with CWA outputs, there
is no reason why it cannot be used in conjunction with the outputs of other systems
human factors and ergonomics methods such as EAST. Indeed, Salmon et al (2018)
recently used the CWA-DT in conjunction with both CWA and EAST as part of an
intersection design process. This involved using insights derived from the EAST
analyses of road user behaviour presented in Chapter 7 as part of a CWA-DT par-
ticipatory design process to design three new intersections. An emphasis was placed
on creating designs that catered to the needs of all forms of end-user, rather than
designing exclusively for drivers and motorised vehicles. The intention was to create
284 Systems Thinking in Practice
FIGURE 14.4 The EAST models sociotechnical systems by combining task, social and
knowledge networks into composite networks that can be systematically degraded into all
possible configurations.
intersection design concepts that, once implemented, would support safe interactions
between drivers, cyclists, motorcyclists and pedestriansby ensuring that all road
users are aware of each other and understand each others’ likely behaviours. The
design brief was to replace one of the intersections from the EAST study presented
in Chapter 6 (See Figure 14.4).
When we evaluated the three designs with drivers, cyclists, motorcyclists and
pedestrians, two of the designs performed best against key criteria: alignment with
sociotechnical systems values, attainment of key intersection functions (such as to
minimise collisions, maximise efficiency, maximise compliance, optimise flexibil-
ity), and user preferences.
The first design is known as the “turning team” design (see Figure 14.5).
It works on the premise that different road users could work effectively as a
team when proceeding through the intersection. To do this the design aims to
make drivers explicitly aware of other forms of road user (to connect the team)
and provides each with a clear and dedicated path through the intersection. The
design aims to clear cyclists from the intersection before allowing motorised
traffic to enter. Other features include a pedestrian crossing path wide enough to
accommodate cyclists who are not comfortable with using the road, motorcyclist
filtering lanes, and phasing of traffic lights based on road user type and direction
of travel.
The second design is the “circular” concept. It explicitly separates motorised and
non-motorised traffic. A circular pathway around the intersection is provided for
pedestrians and cyclists to use. This pathway links with cycle lanes running down
the centre of the road, separated by a kerb from the roadway. On the roadway, this
design provides a separate bus lane and a motorcycle zone at the front of the intersec-
tion to encourage motorcyclists to filter to the front. Finally, the design incorporates
signs warning motorists to be on the lookout for cyclists and for motorcyclists filter-
ing through the traffic from behind (Figure 14.6).
Future Directions for Systems Ergonomics Methods 285
CONCLUSIONS
Following on from Salmon et al. (2017), this chapter examined some of the chal-
lenges posed for human factors and ergonomics methods by the contemporary par-
adigm of systems thinking and discussed how the EAST framework can respond
to the challenges posed. Although human factors and ergonomics researchers and
practitioners have a range of methods at their disposal, the popular paradigm of
systems thinking requires analyses that go beyond their capabilities. The discussion
presented in this chapter has suggested that
beginning to show its capacity for predicting system behaviour and can be
used to predict specific failure scenarios;
• the migration of systems towards and away from safety boundaries has not
yet been dealt with by ergonomics methods. EAST could potentially be
used to identify leading indicators and then track the migration of system
behaviour towards and away from system boundaries;
• various ergonomics constructs may be suited to systems level analysis, but
there is a lack of ergonomics-based systems methods to support this. EAST
can be used to describe and assess concepts such as mental workload and
decision making from a systems perspective; and
• despite its critical role in the design process, few ergonomics methods are
actually used by designers to design. The recently developed CWA-DT
(Read et al., 2015; 2017) can be used in conjunction with EAST to create
novel designs that align with core sociotechnical systems theory values and
principles.
In closing, we would like to emphasise the important role that new and emerging
systems thinking-based methods such as EAST have in ensuring that human factors
and ergonomics remain relevant. In a world where complexity is apparently increas-
ing, and problems are becoming more difficult to resolve, methods that have the
capacity of describing systems in a manner that allows us to understand what compo-
nents exist in the system and how they interact together are required. Only by taking
the overall system as the unit of analysis, and by considering all components and how
they interact together to shape behaviour can we begin to understand systems and
their emergent properties. EAST allows human factors and ergonomics researchers
and practitioners to do this. We hope that the reader has found this book useful, and
that further applications of EAST are undertaken. In particular, we encourage appli-
cations in new domains and focussed on problems not previously examined such as
terrorism, cybersecurity, and artificial intelligence.
REFERENCES
Cherns, A. (1976). The principles of sociotechnical design. Human Relations, 29, 783–792.
Clegg, C. W. (2000). Sociotechnical principles for system design. Applied Ergonomics, 31,
463–477.
Dekker, S. (2011). Drift into Failure: From Hunting Broken Components to Understanding
Complex Systems. Ashgate: Aldershot, UK.
Dekker, S. (2014). The Field Guide to Understanding Human Error, Third Edition. Ashgate:
Aldershot, UK.
Dekker, S. W. A., Hancock, P. A. and Wilkin, P. (2013). Ergonomics and sustainability:
Towards an embrace of complexity and emergence. Ergonomics, 56(3), 357–364.
Deublein, M., Schubert, M., Adey, B. T., Köhler, J. and Faber, M. H. (2013). Prediction of
road accidents: A Bayesian hierarchical approach. Accident Analysis & Prevention,
51, 274–291.
Goode, N. Salmon, P. M., Lenné, M. G. and Hillard, P. (2014). Systems thinking applied to
freight handling operations. Accident Analysis and Prevention, 68, 181–191.
Griffin, T. G. C., Young, M. S. and Stanton, N. A. (2008). Investigating accident causation
through information network modelling. Ergonomics, 53(2), 198–210.
Griffin, T. G. C., Young, M. S. and Stanton, N. A. (2010). Investigating accident causation
through information network modelling. Ergonomics, 53(2), 198–210.
Grote, G., Weyer, J. and Stanton, N. A. (2013). Beyond human-centred automation – concepts
for human–machine interaction in multi-layered networks. Ergonomics, 57(3), 289–294.
Helton, W. S, Funke, G. J, and Knott, B. A. (2014). Measuring workload in collaborative con-
texts: Trait versus state perspectives. Human Factors, 56(2), 322–332.
Hollnagel, E. (2012). FRAM: The Functional Resonance Analysis Method: Modelling
Complex Socio-technical Systems. Ashgate: Aldershot, UK.
Hollnagel, E., Leonhardt, J., Licu, T. and Shorrock, S. (2013). From Safety-I to Safety-II:
A white paper. Eurocontrol. Available at: https://www.eurocontrol.int/sites/default/
files/content/documents/nm/safety/safety_whitepaper_sept_2013-web.pdf (Accessed
21 July 2015).
Hutchins, E. (1995). Cognition in the Wild. MIT Press: Cambridge, MA.
Leveson, N. G. (2004). A new accident model for engineering safer systems. Safety Science,
42(4), 237–270.
Leveson, N. G. (2011). Applying systems thinking to analyze and learn from events. Safety
Science, 49, 55–64.
288 Systems Thinking in Practice
Moray, N. (2008). The good, the bad, and the future: On the archaeology of ergonomics.
Human Factors, 50(3), 411–417.
Norros, L. (2014). Developing human factors/ergonomics as a design discipline. Applied
Ergonomics, 45(1), 61–71.
Perrow, C. (1984). Normal Accidents: Living with High-Risk Technologies. Basic Books: New
York, NY.
Qureshi, Z. H. (2007). A review of accident modelling approaches for complex critical socio-
technical systems. Conferences in Research and Practice in Information Technology
Series, Vol. 336.
Rafferty, L. A., Stanton, N. A., (2012). The Human Factors of Fratricide. CRC Press, Boca
Raton.
Rasmussen, J. (1997). Risk management in a dynamic society: A modelling problem. Safety
Science, 27(2/3), 183–213.
Read, G., Salmon, P. M., Lenne, M. G., Jenkins, D. P., (2015). Designing a ticket to ride
with the Cognitive Work Analysis Design Toolkit. Ergonomics. 58:8, 1266–86. doi:
10.1080/00140139.2015.1013576.
Read, G. J. M., Beanland, V., Lenne, M. G., Stanton, N. A., Salmon, P. M., (2017). Integrating
Human Factors methods and systems thinking for transport analysis and design. CRC
Press, Boca Raton, FL.
Reason, J. (1990). Human Error. Cambridge University Press: New York, NY.
Salmon, P. M., Stanton, N. A., Lenné, M., Jenkins, D. P., Rafferty, L. A. and Walker, G.H.
(2011). Human Factors Methods and Accident Analysis. Ashgate: Aldershot.
Salmon, P. M., Lenné, M. G., Read, G., Walker, G. H. and Stanton, N. A. (2014a). Pathways
to failure? Using Work Domain Analysis to predict accidents in complex systems. In:
T. Ahram, W. Karwowski and T. Marek (Eds), Proceedings of the 5th International
Conference on Applied Human Factors and Ergonomics AHFE 2014, Kraków, Poland,
19–23 July 2014.
Salmon, P. M., Goode, N., Lenné, M. G., Cassell, E. and Finch, C. (2014c). Injury causation in
the great outdoors: A systems analysis of led outdoor activity injury incidents. Accident
Analysis and Prevention, 63, 111–120.
Salmon, P. M., Walker, G. H., Stanton, N. A. (2016). Pilot error versus sociotechnical sys-
tems failure? A distributed situation awareness analysis of Air France 447. Theoretical
Issues in Ergonomics Science, 17(1), 64–79.
Salmon, P. M., Walker, G. H., Read, G. J. M., Goode, N. and Stanton, N. A. (2017). Fitting
methods to paradigms: are ergonomics methods fit for systems thinking?. Ergonomics,
60(2), 194–205.
Salmon, P. M., Read, G. J. M., Walker, G. H., Lenne, M. G. and Stanton, N. A. (2018).
Distributed situation awareness in road transport: theory, measurement, and applica-
tion to intersection design. CRC Press, Boca Raton, FL.
Stanton, N. A. and Harvey, C. (2017). Beyond human error taxonomies in assessment of risk
in sociotechnical systems: A new paradigm with the EAST ‘broken-links’ approach.
Ergonomics, 60(2), 221–233.
Stanton, N. A. and Stammers, R. B. (2008). Bartlett and the future of ergonomics. Ergonomics,
51(1), 1–13.
Stanton, N. A., Salmon, P. M., Rafferty, L., Baber, C., Walker, G. H. and Jenkins, D. P. (2013).
Human Factors Methods: A Practical Guide for Engineering and Design, Second
Edition. Ashgate: Aldershot, UK.
Stanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon,
P. M., Hoyle, G., Walker, G. H., Young, M. S., Linsell, M., Dymott, R. and Green, D.
(2006). Distributed situation awareness in dynamic systems: Theoretical development
and application of an ergonomics methodology. Ergonomics, 49, 1288–1311.
Future Directions for Systems Ergonomics Methods 289
291
292 Index
Coordination Demand Analysis (CDA), OOW, see Officer of the Watch (OOW)
44–46 Operation Sequence Diagrams (OSD), 25, 54–56,
EAST structure, 45 66, 116
Operation Sequence Diagrams (OSD), Operational tasks, 173
54–56 Operator and Overhead Line Party (OLP), 68, 72
Propositional Networks (PN), 56–58 OSD, see Operation Sequence Diagrams (OSD)
Social Network Analysis (SNA), 48–54
scenarios, 39–41 Participant Demographics, 138
Modality Matrix, 53 ‘Passive’ agent, 236
Modelling future flight decks Peloton, 158, 160, 162
airline personnel costs, 253 attack, 158, 161
automated deck systems, 254 bunch sprint, 158
design approach, 256 Periscope Watch Keeper (PWK), 97
aircraft component, 256 Periscope, 87
ground-based component, 257–258 Person in charge of possession (PICOP), 119
system ‘mirror’, 258 PICOP, see person in charge of possession
navigation/flight planning support, 258 (PICOP)
pilot workload, 254–255 Pilot, 253–271
poor CRM, 254 Pilot Flying (PF), 170
real-time engineering support, 258 Pilot Monitor (PM), 171
rules of the air, 255 Pilot node, 235
safe passenger evacuation, 253 Pilot Not Flying (PNF), 170
‘second pilot’ support station/office, 257 Planning Aids, 53
single-crew aircraft, 255 PM, see Pilot Monitor (PM)
system configurations, 258–271 Position, cycling 162
tasks of pilot, 253 Possession, 119
working costs, 254 Post-drive tasks, 173
Monitor other riders, 161 Power stations, 67
Motorcyclists, 142 Practitioners, 4
MS Herald of Free Enterprise accident (1987), 230 Pre-drive tasks, 173
Multi-disciplinary approaches, 5 ‘Principal’ planning staff, 51
Multi-faceted, 4 Propositional networks, 25, 28, 42, 116–117
Protection, 119
National Highway Traffic Safety Administration PWK, see Periscope Watch Keeper (PWK)
(NHTSA), 169
Naturalistic study, 160 Queen of the Mountain (QOM), 158
Naval warfare, 4
Navy training, 243 Race officials, 158
NEC, see Network Enabled Capability (NEC) Radar Altimeter (Rad-Alt), 232
Negotiate intersection, 141 Radar contact, 23
Negotiation architecture, 32 Radio, 23, 53
Network centric, 33 RAF Nimrod XV230, 232
Network density, 214 Railway maintenance, 109–131
Network Enabled Capability (NEC), 46, 54 development of EAST methodology, 110–111
‘Network of networks’ approach, 4, 66 Communications Usage Diagram
Network metrics, 8–9,189 (CUD), 115
Neutral spares, 158 Coordination Demand Analysis
NHTSA, see National Highway Traffic Safety (CDA), 114–115
Administration Hierarchical Task Analysis (HTA), 112–114
Nimrod accident, 234 Layer 1 – Data Collection Methods,
Nodes, 7, 9 111–112
Non-human artefacts, 23, 158–159 Layer 2 – Analysis Methods, 112
Non-verbal transactions, 165 Layer 3 – Representational Methods, 115
Operation Sequence Diagram (OSD), 116
Officer of the Watch (OOW), 87, 97–99 Propositional Network (PN), 116–117
OLP, see Operator and Overhead Line Party Social Network Analysis (SNA), 115
(OLP) summary of methods, 117–118
296 Index