BrokerhofBulow 2016 QuiskScan Quick Risk Scan
BrokerhofBulow 2016 QuiskScan Quick Risk Scan
BrokerhofBulow 2016 QuiskScan Quick Risk Scan
To cite this article: Agnes W. Brokerhof & Anna E. Bülow (2016) The QuiskScan—a quick risk
scan to identify value and hazards in a collection, Journal of the Institute of Conservation, 39:1,
18-28, DOI: 10.1080/19455224.2016.1152280
Keywords
risk assessment; collection management; cultural value; vulnerability; preventive conserva-
tion; decision making
develop mitigation options for the relevant risks and the best choices can be Risks to Cultural Heritage: Analysis of a
decided upon. For many institutions, such a process is cost-prohibitive. Course Metamorphosis’, in ICOM–CC
However, organizations such as the British Museum (UK), the Netherlands 17th Triennial Conference Preprints, Mel-
Open Air Museum (Arnhem, NL) and museums in the city of Leiden (NL) bourne, 15–19 September 2014,
ed. J. Bridgland (Paris: International
have been willing to invest a limited amount of time in engaging with risk
Council of Museums, 2014), art. 0301, 8;
management either to get an overview of their risks or of risks in specific A.W. Brokerhof, T. Luger, B. Ankersmit,
situations, or to assess whether the correct mitigation measures were in F. Bergevoet, R. Schillemans,
place. These needs have triggered the development of a tool that quickly P. Schoutens, T. Muller, J. Kiers,
provides the first systematic insights into risks without going into in- G. Muething and R. Waller, ‘Risk Assess-
ment of Museum Amstelkring: Appli-
depth analysis of specific risks. Such a tool would not replace a full risk
cation to an Historic Building and its
assessment but would serve to generate a first integral overview on Collections and the Consequences for
which an organization may choose to build a detailed risk assessment. Preservation Management’, in Preprints
of the ICOM–CC 14th Triennial Meeting,
Different approaches to risk assessment The Hague, The Netherlands, 12–16 Septem-
ber 2005 (London: James & James, 2005),
Risk is usually defined as something negative such as ‘the possibility of
590–6; A.E. Bülow, ‘Risk Management as
loss’. It is a combination of the likelihood and the consequence of something a Strategic Driver for a Large Archive’,
happening that causes a loss. All methods for risk assessment seek to Collections: A Journal for Museums and
answer three questions: Archives Professionals 5, no. 9 (2009): 61–
72; A.E. Bülow, ‘Collection Management
1 What might happen? This is often thought of as a one-off event but can Using Preservation Risk Assessment’,
also be an ongoing process. Journal of the Institute of Conservation 33,
no. 1 (2010): 65–78; L.K. Elkin,
2 How likely is that? How often will the event happen or how fast will the D. Fenkart-Froeschl, E. Nunan and
process unfold? R. Waller, ‘A Database Tool for Collections
3 What will be the consequences? How bad will it be when the event or Risk Evaluation and Planning’, in ICOM–
process happens? CC 16th Triennial Meeting Preprints, Lisbon,
Portugal, 19–23 September,
with underlying questions about: ed. J. Bridgeland and C. Antomarchi
(CD_ROM, ICOM–CC and Almada Cri-
a Which hazards do we worry about? terio, 2011); M. McCubbin, A. Cannon,
C. Carter, D. Henry, H. Privett, N. Ladas,
b Are the assets exposed to those hazards? D. Leggett, R. Leveson, M. Raberts,
L. Stedman and R. Waller, ‘Improving
Both the ABC and CPRAM methodologies describe risks as scenarios Risk Assessment Methods in a Complex
with a cause – pathway –effect structure. The causes all act through one or Setting: Museum Victoria’s Collection
more of the agents of deterioration. However, the root cause may lie Risk Assessment’, in Bridgland, ICOM–
beyond the immediacy of those agents. For example, collections may get CC 17th Triennial Conference Preprints;
A. Paolini, A. Vafadari, G. Cesaro,
wet in a flood which is a risk which, ultimately, can be argued to have
M. Santana Quintero, K. Van Balen,
been caused by human activity causing climate change and higher water O. Vileikis and L. Fakhoury, Risk Manage-
levels. While with the ABC method one constantly has to aggregate and dis- ment at Heritage Sites: A Case Study of the
aggregate to find the comfortable level at which to quantify the risk, Petra World Heritage Site (Paris/Amman:
CPRAM allows for adding the magnitudes of risk of specific scenarios to UNESCO, 2012), http://unesdoc.unesco.
org/images/0021/002171/217107 m.pdf
express the magnitude of a generic risk or number of similar scenarios.
(accessed 3 September 2015); Waller, ‘Con-
They are deterministic in the sense that each scenario has a single servation Risk Assessment’, 12–16; and
outcome, although best, worst and most likely case options may be given ‘Special Issue: International Symposium
to indicate the range of the uncertainty. on Cultural Property Risk Analysis’, ed.
With these methods probability and consequence can be described in Robert Waller, Collections: A Journal for
Museum and Archives Professionals 8, no. 4
terms of low, medium or high, without being too exact about what each cat-
(2012) and 9, no. 1 (2013).
egory means. Results can then be represented in a risk matrix (Fig. 1 left) to
illustrate and communicate the outcomes of any assessment. Instead of 4 R. Waller and S. Michalski, ‘A Para-
digm Shift for Preventive Conservation,
named categories, probability and consequence can be assessed on a and a Software Tool to Facilitate the
scale of 1 – 5 which allows for calculating a composite risk index which Transition’, in Preprints of the ICOM–
then allows for ranking risks in a bar graph (Fig. 1 middle). Alternatively, CC 14th Triennial Meeting, 733–8.
probability and consequence may be expressed in numbers to calculate 5 J. Ashley-Smith, Risk Assessment for
the expected loss (for example, in monetary units or percentage of the Object Conservation (Oxford: Butter-
asset) within a certain period of time (Fig. 1 right). The ABC method uses worth-Heinemann, 1999).
logarithmic scores, whereas CPRAM calculates the fraction of the collection 6 See, American Society of Heating,
lost in a century. Graphs serve as good illustrations, show rankings and are Refrigerating and Air-Conditioning
generally well understood by colleagues at all levels and so allow for dis- Engineers, ‘Museums, Libraries and
cussion of the outcome. Archives’, in ASHRAE Handbook: Heating,
Mapping a collection—flying over instead of walking through Hazards and Earth System Sciences 6 (2006):
A scenario-based approach would not provide the required outcome within 573–86, https://hal.archives-ouvertes.
the given resources for the museums that the authors have worked with. fr/hal-00299344/document (accessed 28
Instead, a variation of risk mapping of the entire collection seemed, in July 2015).
their experience, to be the direction in which to proceed. Thus the risk 9 A.W. Brokerhof, ‘Exhibiting with
mapping approach was developed into a matrix-based scan; a ‘mapping’ Minimal Light Risks’ (presentation at
of the collection within a matrix. Similar to overlaying geological maps of ‘The Future’s Bright: Managing Colour
Change in Light Sensitive Collections’,
asset values, vulnerability and exposure, the matrix crosses value (signifi- National Museum, Stockholm, Sweden,
cance) of collection units with vulnerability to the 10 agents of deterio- 15 November 2012).
ration, thus identifying a ‘vulnerable value’. If desired, this could be
overlapped with, or analyzed for exposure, to get an indication of the mag-
nitude of risk. This approach allows for a quick risk scan for the collection,
hence its name QuiskScan.
One might think of this methodology as flying over a forest instead of
walking through it.10 If each tree were to represent a risk, its height 10 A.W. Brokerhof, ‘Risk Assessment
would be a measure of its magnitude. Without a perspective to see the for Cultural Heritage—Methods and
Tools’ (presentation at the Konferens
height from ground level, one needs to measure all the trees to determine
Riskhantering och kulturvård, Saltsjö-
which ones are the tallest. This implies measuring more trees than necess- baden, Stockholm, Swedish Heritage
ary to guide further decisions. A benefit of this approach is that one can Board, 1–3 December 2014), https://
argue that the organization is managing the risks in areas where trees are youtu.be/2zbk_nFzFl0 (accessed 2 Sep-
short. Nevertheless, the forester with limited time wants to have an idea tember 2015).
of where the tall trees are and zoom in on those to see whether they
require action without spending time on measuring all of the trees. When
risk is considered to be the probability of loss, then the biggest losses
will occur where high value meets high vulnerability. Hence for a quick
(preliminary) risk assessment, one wants to find the ‘vulnerable value’
(Fig. 3). Vulnerability in this case focusses on the tangible susceptibility of
an object or collection (unit) to undergoing material change as a result of
exposure to an agent of deterioration. In addition, susceptibility to intangi-
ble factors such as political, social, economic, and reputational, can be con-
sidered when appropriate.11 11 O.D. Cardona, ‘The Need for
Rethinking the Concepts of Vulner-
ability and Risk from a Holistic Perspec-
tive: A Necessary Review and Criticism
for Effective Risk Management’, in
Mapping Vulnerability: Disasters, Develop-
ment and People, ed. G. Bankoff, G. Frerks
and D. Hilhorst (London: Earthscan
Publishers, 2004), 37– 51.
Fig. 3 Difference between a scenario-based approach, walking through the forest (upper) and
the QuiskScan, flying over the forest (lower).
1a Purpose
The purpose should be clear to all involved. Why is the collection assessed?
What questions need to be answered or which decisions need to be made
that require insights into collection, values, and risks? Having a clear
picture of the purpose also allows limiting the scan to the relevant collection
units and agents of deterioration and thereby avoids unnecessary work.
1b Scope
The scope should be defined. Which part of the collection is being scanned?
This is closely related to the purpose. If decisions do not involve the entire
collection, then the scope can be limited to the relevant parts. For example,
within a paper-based collection, one might only want to examine the prints
and drawings, and exclude libraries and archives. The scan can always be
expanded at a later stage if required. The scope is also needed to determine
the reference framework for value assessment. Is the scope the entire collec-
tion or a few units within that collection? Are values to be assessed within a
regional, national or even international context? This is needed when it
comes to determining what makes a collection score ‘high’ or ‘low’ for
the various criteria. It provides a level of comparison.
Table 1 Result of the QuiskScan showing the collection anatomy, the value of collection units
A– E with a weighting and the vulnerability of each unit for the agents of deterioration I– V.
1c Collection anatomy
Considering the entire collection as one unit for the scan would not give a
useful output for decision making. Thus it is necessary to split the collection
into units. This subdivision is referred to as the collection anatomy. The
more units, the more work the group will need to do. Hence when deter-
mining the collection anatomy one aims at having as few units as possible,
yet at a level of differentiation such that the objects within each collection
unit show a high degree of similarity and are well distinguished from
other units. Collection units can be based on, for example, curatorial classi-
fication, object type, material or location. For each collection unit, its facts
and figures, a short description and its quantity in some logical dimension
are listed. For example, the number of objects or boxes, meters of shelving,
volume, weight or bytes.
Like any value or risk assessment, the process should be well documen-
ted so that its arguments and decisions can be traced back and understood
by custodians in the future.
The collection’s units are compared with each other within the context of
the host organization’s constitution or mission. Units are given an overall
‘high’, ‘medium’ or ‘low’ score, based on arguments from their evaluation
against a standard set of criteria described in the publication, Assessing
Museum Collections; Collection Valuation in Six Steps.13 13 Luger et al., Assessing Museum Collec-
The method distinguishes between attributes and value criteria. Attri- tions.
butes consider state and condition, completeness, provenance and rarity.
They do not in themselves make something valuable, but can enhance
value when they are good or attenuate the value when they are poor.
Units can score ‘good’, ‘average’ or ‘poor’ for these attributes.
The value criteria are divided into three clusters: cultural-historical (artis-
tic, historic, information values), social and societal (contemporary societal
and personal experience values), and use (values related to the museum’s
business and its public). Objects or collection units can score ‘high’,
‘medium’ or ‘low’ for these criteria.
In order to assess the units consistently, the team has to agree on the
evaluation framework and define for each criteria what makes a unit
score ‘high’ or ‘low’, ‘good’ or ‘poor’. Once the framework is available,
the assessment can be made.
The assessment of attributes and value criteria combines to create a
‘value score’ for each collection unit which is entered under ‘current
value’ in the matrix for each collection unit, as in the example of Table 1.
This is not a calculated sum of individual scores. It is the overall value jud-
gement underpinned by the arguments set out in the agreed evaluation fra-
mework.
In practice it proves to be easier to start with the team’s overall score and
ask them to provide arguments for that assessment by going through the
criteria rather than by constructing a final verdict based on the accumu-
Fig. 4 Distribution of total collection value from Table 1 over value categories visualized in a pie
chart (value pie) (a, upper left) and a weighted value pie (b, upper right), in a mosaic plot (c,
lower left) and a population distribution (d, lower right).
lation of all the details. For example, curators are usually aware of what has
a higher or lower value, yet are rarely asked to make such evaluations expli-
cit. With the QuiskScan the criteria can be used to support arguments so as
to help reach overall agreement amongst the diverse range of specialists in
the team. For example, within the assessed prints and drawings collection
one might agree that the watercolours by J.M.W. Turner are of high value
based on their artistic merits, their historic significance and their popularity
with the public. The final verdict is usually reached through a mix of
zooming in and zooming out between general impressions and detailed
arguments. Furthermore, if a collection unit contains objects with different
overall values, then, in our opinion, the most pragmatic way to deal with
this is to attribute the mode or median value as an overall judgement
whilst specifying any exceptions for later consideration. This is where the
team’s moderator plays an important role in soliciting arguments and rep-
resentations in order to arrive at a group decision, with the caveat that this
can be subsequently amended, if deemed appropriate.
Based on these overall scores the collection anatomy thus provides
insight into how the total collection value is distributed between the
various collection units. There are several different ways of visualizing
this. Figure 4 shows examples of a value pie (a), weighted value pie (b),
mosaic plot (c) and population distribution (d) for the example of Table 1.
While in the value pie (a) the number of objects in each value category is
plotted, the distribution of the total collection value in the weighted
value pie (b) shows where most of the value actually is. In this case the
‘medium’ value is normalized at 1, with ‘high’ value objects being 10
times as valuable while ‘low’ value objects are just 0.1 times as valuable.
In terms of equivalent value, one would swap for instance one ‘high’
value object for 10 objects of ‘medium’ value and for 100 ‘low’ value
objects. In the example of Table 1 the 1800 objects of units D and E only con-
tribute 1% to the total collection value, whereas the 1500 objects in units A
and B together account for 74% of the total collection value.
Fig. 5 Vulnerability of the collection from Table 1 for agents of deterioration I-V stacked as
number of objects per collection unit classified as ‘high’ (red), ‘medium’ (yellow) and ‘low’
(green) (left) and multiplied by their value to classify the ‘vulnerable value’ in terms of a per-
centage of the collection for each agent (right).
by, for example, moving the unit somewhere else, or improving specific
conditions.
From the number of objects in each collection unit and the mode or
median assigned for their value and vulnerability to the different agents
one can generate broad brush profiles for the entire collection. Figure 5
shows the vulnerability of the collection to each agent of deterioration as
number of objects classified as ‘high’, ‘medium’ and ‘low’ vulnerability
(left). It can be seen that some 80% of the collection has a high vulnerability
to agent I. If that 80% is also exposed to that agent, this provides convincing
arguments to at least pay attention to the agent and its mitigation. To a
slightly lesser extent this also holds for agents III and IV. Agent V seems
less of a threat as only unit B with its 1000 objects shows a high vulner-
ability. This is where the inclusion of the value becomes important.
Figure 5 (right) shows the stacked graph for percentage ‘vulnerable
value’ of the collection. Now agent V appears as relatively more important
than III which necessitates further analysis. The matrix and the graphs
become the basis for discussion about further action, such as the need for
a more detailed analysis of exposure, the probability of damage and the
estimation of actual loss of value. After all, not all damage results in a sig-
nificant loss of value. It is also at this point that the exceptions, flagged up
earlier in the process, need to be reconsidered to assess their impact on the
overall picture and whether they deserve special attention.
At this point it can be seen that the QuiskScan can be used to form a sys-
tematic overview of the collection and its risks, but that it contains a con-
siderable degree of uncertainty due to the high level of aggregation and
the possible variation within any particular set of collection units. Thus,
whilst the QuiskScan methodology can be said to have some limitations,
it can form the basis for prompting a more in-depth risk analysis using
one of the established methods in the areas of the collection where it has
indicated the possibility of significant loss of value.
Discussion
The QuiskScan should be regarded as a tool that fits in between relying on
best practices and conducting a comprehensive risk assessment. Due to its
broad brush approach many details will be missed, and as with other
models and tools, the output is only as good as the input. Weaknesses in
the QuiskScan include its initial high level of aggregation, a disregard for
the variability in both value and vulnerability within collection units by
basing its assessment methodology on modes and medians, and its accep-
tance of large uncertainties. Furthermore, as the QuiskScan attempts to sys-
tematically extract data from existing knowledge in the first instance, there
Zusammenfassung
„Der QuiskScan-ein schnellerScan um Werte und Risiken in einer
Sammlung zu identifizieren“
Während der letzten zwei Jahrzehnte haben eine Reihe von Kultur- Biographies
institutionen verschiedene Formen von Risikoanalyse durchgeführt. Agnes Brokerhof studied Chemistry and Art History at Leiden Uni-
Obwohl der Konsens ist, dass solche Analysen tiefgreifende Verän- versity (The Netherlands). From 1989 to 1991 she worked at the
derungen bei der Sammlungspflege innerhalb einer Institution Australian Museum in Sydney and was a research fellow at
auslösen, besteht ein allgemeiner Widerstand gegen den nicht uner- CSIRO in Canberra (Australia). After taking the ICCROM course
heblichen Aufwand, den die Durchführung einer solchen Analyse ‘Scientific Principles of Conservation’ in Rome (1992) she joined
mit sich bringt. Dieser Artikel beschreibt die Entwicklung des the Central Research Laboratory for Objects of Art and Science in
‘QuiskScan’, einer schnellen Risikoanalyse, die mit vergleichsweise Amsterdam as conservation scientist. Subsequently she worked at
wenig Aufwand einen Überblick über eine Sammlung, ihre Werte, ‘Instituut Collectie Nederland’ (ICN) as programme manager of
und ihre Schadensanfälligkeit gibt. Der QuiskScan nutzt eine ‘Collection Risk Management’. Since the merger of ICN into the
Methode, die auf einer Matrix basiert, mittels derer Werte und Cultural Heritage Agency of the Netherlands (RCE) in 2011 she
Schadensanfälligkeit unterschiedlicher Sammlungsteile gegenüber has been a senior conservation scientist in its Conservation & Res-
verschiedenen Risiken identifiziert werden können. Ähnlich toration Department based in Amsterdam. Currently her activities
anderer Analysemethoden bedingt der QuiskScan den Einsatz rele- focus on teaching, coaching and applying the developed models for
vanter Experten innerhalb einer Institution, was bei der Bildung value and risk assessment in collection management.
gemeinsamer Ziele und Wissen um die Risiken einer Sammlung Dr Anna Bülow apprenticed as a bookbinder in Germany before
hilft. Die Methode sollte als ein Werkzeug verstanden werden, das graduating with a degree in paper conservation from the
zwischen bewährten Praktiken und einer umfassenden Risikoana- Hochschule für Gestaltung, Kunst und Konservierung in Bern, Swit-
lyse liegt. zerland. She worked as a research fellow at the Canadian Conserva-
tion Institute in Ottawa and graduated from Queen’s University in
Resumen Kingston, Ontario, Canada, with an MAC in conservation research
“El QuiskScan—un rápido análisis de riesgos para identificar el in 1999. Specializing in preventive conservation, she completed
valor y las amenazas de una colección” her PhD at De Montfort University in Leicester, UK, in 2002, and
En las últimas dos décadas, diferentes instituciones que se ocupan worked as Head of Preservation at The National Archives, UK
del patrimonio han llevado a cabo distintos tipos de evaluaciones between 2003 and 2013. She is currently the Head of Conservation
de riesgos. A pesar de que en general hay consenso de cómo tales at the British Museum.
Contact address
Agnes W. Brokerhof Dr Anna E. Bülow
Senior Conservation Scientist Head of Conservation
Conservation & Restoration Department British Museum
Cultural Heritage Agency of The Nether- Great Russell Street
lands London WC1B 3DG
Hobbemastraat 22 UK
1071 ZC Amsterdam, The Netherlands Email: [email protected]
Email: [email protected]