PLM 59
PLM 59
PLM 59
The Psychology of
LEARNING AND
MOTIVATION
Series Editor
BRIAN H. ROSS
Beckman Institute and Department of Psychology
University of Illinois, Urbana, Illinois
VOLUME FIFTY NINE
The Psychology of
LEARNING AND
MOTIVATION
Edited by
BRIAN H. ROSS
Beckman Institute and Department of Psychology
University of Illinois, Urbana, Illinois
Permissions may be sought directly from Elsevier’s Science & Technology Rights
Department in Oxford, UK: phone (+44) (0) 1865 843830; fax (+44) (0) 1865 853333;
email: [email protected]. Alternatively you can submit your request online by
visiting the Elsevier web site at http: //elsevier.com/locate/permissions, and selecting
Obtaining permission to use Elsevier material
Notice
No responsibility is assumed by the publisher for any injury and/or damage to persons
or property as a matter of products liability, negligence or otherwise, or from any use or
operation of any methods, products, instructions or ideas contained in the material herein.
Because of rapid advances in the medical sciences, in particular, independent verification of
diagnoses and drug dosages should be made
ISBN: 978-0-12-407187-2
ISSN: 0079-7421
Contributors ix
1. Introduction 2
2. What Is Reasoning? 4
3. Models of Possibilities 6
4. Icons and Symbols 9
5. The Principle of Truth 11
6. Models as Counterexamples 13
7. Modulation and the Use of Knowledge 16
8. Induction and Abduction 20
9. Probabilities: Extensional and Intensional 23
10. Mental Simulations and Informal Programs 27
11. Toward a Unified Theory 33
12. Conclusions 37
Acknowledgments37
References 38
1
. Introduction: The “Centipede’s Dilemma” of Interaction Research 44
2 . An Example Theoretical Debate and the Need for Integration 46
3 . Self-Organization and Human Interaction 49
4 . Cognitive Dynamics under Social Constraints 57
5 . Coordination, Complementarity, and Interactive Performance 68
6 . Conclusion: Time for More Models 77
Acknowledgments84
References 84
1.
Introduction 98
2.
Modifier-Noun Phrases and Compounds as Expressions of Combined Concepts 100
v
vi Contents
1
. Introduction 133
2 . List-Method DF: Design and Measurement 134
3 . Our Framework of List-Method DF 138
4 . Forgetting is a Strategic Decision 140
5 . Context Change as an Explanation for DF Impairment 148
6 . Areas of Disagreement Across Studies 165
7 . Strategy Change Explains DF Benefits 167
8 . Implications for Clinical Populations 172
9 . Concluding Thoughts 181
Acknowledgments182
References 182
1
. Introduction 192
2 . Recognition Memory 192
3 . Models of Memory 193
4 . Estimating Recollection and Familiarity 198
5 . Pupillometry 203
6 . Psychophysiological Correlates of Memory for Faces 210
7 . General Conclusions 215
References 215
Contents vii
1
. Introduction 224
2 . What Does It Mean to Measure Spatial Learning and Navigational Ability? 225
3 . Dual Systems for Spatial Learning in Rodents 229
4 . Place and Response Learning in Humans 232
5 . The Place/Response Framework for Individual Differences 239
6 . Connections to Other Sources of Variability 246
7 . Competition or Interaction of Systems 250
8 . Conclusions 252
References 255
1
. Introduction 262
2 . When Do “Distractors” Cause Distraction? 264
3 . A Brief Case Study on Distraction 291
4 . A Theory of Attention and Distractibility 300
5 . Conclusions 307
References 310
Index 317
Contents of Previous Volumes 331
This page intentionally left blank
CONTRIBUTORS
Branden Abushanab
Department of Psychology, University of North Carolina at Greensboro, Greensboro,
NC, USA
Simona Buetti
Department of Psychology, University of Illinois at Urbana-Champaign, Champaign, IL, USA
Rick Dale
Cognitive and Information Sciences, University of California Merced, Merced, CA, USA
Peter F. Delaney
Department of Psychology, University of North Carolina at Greensboro, Greensboro,
NC, USA
Nicholas D. Duran
Cognitive and Information Sciences, University of California Merced, Merced, CA, USA;
Division of Psychology and Language Sciences, University College London, London, UK
Nathaniel L. Foster
Department of Psychology, University of North Carolina at Greensboro, Greensboro,
NC, USA
Andrew J. Furman
Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore,
MD, USA
Riccardo Fusaroli
Cognitive and Information Sciences, University of California Merced, Merced, CA, USA;
Interacting Minds Center and Center for Semiotics, Aarhus University, Aarhus, Denmark
Christina L. Gagné
Department of Psychology, University of Alberta, Edmonton, AB, Canada
Stephen D. Goldinger
Department of Psychology, Arizona State University, Tempe, AZ, USA
P. N. Johnson-Laird
Department of Psychology, Princeton University, Princeton, NJ, USA;
Department of Psychology, New York University, New York, NY, USA
Sangeet S. Khemlani
Navy Center for Applied Research in Artificial Intelligence, Naval Research Laboratory,
Washington, DC, USA
Alejandro Lleras
Department of Psychology, University of Illinois at Urbana-Champaign, Champaign,
IL, USA
ix
x Contributors
Steven A. Marchette
Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore,
MD, USA
J. Toby Mordkoff
Department of Psychology, University of Iowa, Iowa City, IA, USA
Megan H. Papesh
Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
Daniel C. Richardson
Division of Psychology and Language Sciences, University College London, London, UK
Lili Sahakyan
Department of Psychology, University of North Carolina at Greensboro, Greensboro,
NC, USA
Amy L. Shelton
Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore,
MD, USA
Thomas L. Spalding
Department of Psychology, University of Alberta, Edmonton, AB, Canada
CHAPTER ONE
Contents
1. Introduction2
2. What Is Reasoning? 4
3. Models of Possibilities 6
4. Icons and Symbols 9
5. The Principle of Truth 11
6. Models as Counterexamples 13
7. Modulation and the Use of Knowledge 16
8. Induction and Abduction 20
9. Probabilities: Extensional and Intensional 23
10. Mental Simulations and Informal Programs 27
11. Toward a Unified Theory 33
12. Conclusions37
Acknowledgments37
References38
Abstract
This article describes a theory that uses mental models to integrate deductive, induc-
tive, and probabilistic reasoning. It spells out the main principles of the theory and
illustrates them with examples from various domains. It shows how models underlie
inductions, explanations, estimates of probabilities, and informal algorithms. In all
these cases, a central principle is that the mind represents each sort of possibility in a
separate mental model and infers whatever holds in the resulting set of models. Finally,
the article reviews what has been accomplished in implementing the theory in a single
large-scale computer program, mReasoner.
1. INTRODUCTION
The capacity to reason underlies mathematics, science, and technol-
ogy. It is essential for coping with everyday problems—without it, social life
would be almost unimaginable. The challenge to psychologists is to explain
its underlying mental mechanisms. Since Störring’s (1908) pioneering study,
they have discovered several robust phenomena. Perhaps the most important
is that naive reasoners—those with no training in logic—can make valid
deductions, that is, inferences in which the conclusion is true in all the cases
in which the premises are true (cf. Jeffrey, 1981, p. 1). And they are happy
to do so about abstract matters with no ecological validity, as in Sudoku
puzzles (Lee, Goodwin, & Johnson-Laird, 2008).
Fifty years ago, psychologists took for granted that human reasoning
was rational. Individuals developed deductive competence during child-
hood, and the psychologists’ task was to pin down the nature of the formal
logic underlying this ability. As Inhelder and Piaget (1958, p. 305) wrote,
“Reasoning is nothing more than the propositional calculus itself ”. There
may be vagaries in performance, but faulty reasoning does not occur (Henle,
1962) or is attributable to local malfunctions in the system—a spanner in
the works rather than an intrinsic flaw (Cohen, 1981). Indeed, theories of
deduction in cognitive psychology began with accounts based on formal
logic (e.g. Braine, 1978; Johnson-Laird, 1975; Osherson, 1974–1976). These
views, of course, echo those of Enlightenment philosophers. But, another
robust phenomenon that psychologists discovered is that individuals differ
in their ability to reason. A few are very good, a few are very bad, and most
are somewhere in the middle. Differences in ability are vast, and correlate
with the tests of academic achievement, as proxies for measures of intel-
ligence (Stanovich, 1999). For everyone, however, failures are inevitable:
complex inferences are computationally intractable.
Nowadays, a consensus exists that that the psychology of reasoning has
undergone a deep change—even, some say, a paradigm shift. The acces-
sibility of digital computers was a license for theorizing, and psychological
theories of reasoning have multiplied at a startling rate. Quite what the new
foundations of reasoning should be is controversial. One view is that humans
are rational but in terms of the probability calculus rather than logic (e.g.
Oaksford & Chater, 2007; Tenenbaum & Griffiths, 2001). One view is that
natural selection has equipped the mind with modules for reasoning about
special topics, such as social exchange (Cosmides & Tooby, 2005). One view
is that rationality presupposes a normative system, and psychologists should
Toward a Unif ied Theory of Reasoning 3
main sorts of reasoning. It follows with sections that elucidate each of the
theory’s main principles. It then considers the role of models in inductive
reasoning, explanatory reasoning, reasoning about probabilities, and reason-
ing that yields informal algorithms. The final section of the article reviews
what has been accomplished in unifying the theory, and in implementing it
in a single computer program to achieve Leibniz’s (and our) dream.
2. WHAT IS REASONING?
Suppose you infer:
If the ink cartridge is empty then the printer won’t work.
The ink cartridge is empty.
So, the printer won’t work.
You are making a deduction: your inference is valid because your conclusion
holds in any case in which the premises hold. Suppose instead you infer:
If the ink cartridge is empty then the printer won’t work.
The printer won’t work.
So, the ink cartridge is empty.
You are making an induction. Your inference isn’t valid because there
may be another reason that the printer won’t work. Yet, your conclusion
may be true, especially if the printer is producing blank pages. For many
theorists—Aristotle for one, all inferences fall into one of these two catego-
ries: deduction and induction.
Aristotle defined induction as an inference from a particular assertion to
a universal one (Topics, 105a13). But, inductions are often from the particu-
lar to the particular, as is your induction about the printer. Hence, a better
way to distinguish between the two sorts of inference is in terms of seman-
tic information ( Johnson-Laird, 1983, chap. 2). The more possibilities that
an assertion rules out, the more information it conveys (Bar-Hillel, 1964).
An inference to a conclusion that refers to all the same possibilities as the
premises do, or at least includes them all in what it refers to, is a deduction.
Consider again your earlier deduction:
If the ink cartridge is empty then the printer won’t work.
The ink cartridge is empty.
So, the printer won’t work.
The premises refer to just one possibility:
The ink cartridge is empty and the printer won’t work.
Hence, your inference is valid because its conclusion holds in the one pos-
sibility to which the premises refer. The conclusion therefore does not
Toward a Unif ied Theory of Reasoning 5
3. MODELS OF POSSIBILITIES
The fundamental assumption of the model theory is that each mental
model represents what is common to a distinct set of possibilities. Hence, an
assertion such as:
A triangle is on the right of a circle
has a single mental model, which we depict in this diagram:
In this case, spatial relations play no role in the use of the models. An exclu-
sive disjunction, such as:
Either there’s a triangle or there’s a circle, but not both
exclude the joint possibility, and so it calls for only two mental models:
Models preoccupy system 2, and so more models mean more work. The
theory therefore predicts that deductions from exclusive disjunctions should
be easier than those from inclusive disjunctions, as when either of the dis-
junctions above occurs with the categorical assertion:
There isn’t a circle.
This assertion eliminates any model in which there is a circle, and so it
follows validly in both cases that:
There is a triangle.
Evidence corroborates the prediction (e.g. Johnson-Laird, Byrne, &
Schaeken, 1992), and it also shows that inferences from conjunctions, which
have just one model, are easier than those based on disjunctions (García-
Madruga, Moreno, Carriedo, Gutiérrez, & Johnson-Laird, 2001).
8 P. N. Johnson-Laird and Sangeet S. Khemlani
The sorts of inference that can overwhelm the deliberative system are
“double disjunctions” ( Johnson-Laird et al., 1992), which are from pairs of
disjunctive premises, such as:
June is in Wales, or Charles is in Scotland, but not both.
Charles is in Scotland, or Kate is in Ireland, but not both.
What follows?
The two possibilities compatible with the first premise are relatively easy
to envisage, but it is difficult to update them with those from the second
premise, although the result is just two possibilities:
June in Wales Kate in Ireland
Charles in Scotland
Of course, real mental models represent these spatial relations, and are not
phrases, which we use here for convenience. The two models yield the
conclusion:
Either June is in Wales and Kate is in Ireland or Charles is in Scotland.
Inferences become even harder when disjunctions are inclusive. In one
experiment, 25% of the participants, who were from the general public,
drew valid conclusions from exclusive disjunctions, but this figure fell to
below 10% for inclusive disjunctions. The result is hardly surprising, but
what was striking was the nature of the modal errors: for all the inferences,
the participants drew conclusions corresponding to a model of a single
possibility. Just under a third of all the participants’ responses were conclu-
sions of this sort. The result suggests that when the task was too much for
them, they fell back on their intuitions and envisaged just a single model
of the premises. So, their conclusions were consistent with the premises
but did not follow from them. The performance of undergraduates showed
the same pattern. But, when the disjunctions were presented in equivalent
electrical circuit diagrams or analogs of them, they performed better and
faster (Bauer & Johnson-Laird, 1993). Their conclusions, however, still bore
out a failure to consider all the possibilities, and so most errors were at least
consistent with the premises.
Mental models represent possibilities, and so the more models that are
necessary to make an inference, the harder that inference is to make. Indi-
viduals are in danger of overlooking a model. When the deliberative system
is vastly overburdened, reasoners may even fall back on the intuitive system
and draw a conclusion that is consistent with only a single model. One
side effect of the use of models is that reasoners are most unlikely to draw
Toward a Unif ied Theory of Reasoning 9
It yields a new relation, namely, the square is on the right of the circle, and so
this transitive inference emerges from scanning the model. To establish its
validity, reasoners need to call on the deliberative system to check that no
alternative model of the premises refutes the conclusion.
When premises are consistent with more than one spatial layout, infer-
ences are more difficult than the preceding example (e.g. Byrne & Johnson-
Laird, 1989; Carreiras & Santamaría, 1997; Vandierendonck, Dierckx, & De
Vooght, 2004). Likewise, reasoners try to construct initial models that do
not call for a rearrangement of entities (e.g. Jahn, Knauff, & Johnson-Laird,
2007; Knauff & Ragni, 2011), and inferences that call for such rearrange-
ments are more difficult than those that do not (e.g. Krumnack, Bucher,
Nejasmic, Nebel, & Knauff, 2011). Analogous results bear out the use of
iconic representations in temporal reasoning, whether it depends on rela-
tions such as “before” and “after” (Schaeken, Johnson-Laird, & d’Ydewalle,
1996a) or on the tense and aspect of verbs, as in:
John has cleaned the house.
John is taking a shower.
John is going to read the paper.
Mary always does the dishes when John cleans the house.
Mary always drinks her coffee when John reads the paper.
What is the relation between Mary drinking coffee and doing the dishes?
10 P. N. Johnson-Laird and Sangeet S. Khemlani
Participants inferred that Mary drinks her coffee after doing the dishes, in
an experiment that controlled such factors as order of mention (Schaeken,
Johnson-Laird, & d’Ydewalle, 1996b).
The earlier example of a transitive inference is child’s play (see, e.g. Bryant &
Trabasso, 1971). But, many inferences based on iconicity are more complex,
such as those that combine both spatial and temporal relations in kinematic
simulations (see Section 10). The intuitive system can also mislead adult
reasoners. It constructs only a simple model of a typical situation. Given this
sort of problem:
Ann is a blood relative of Beth.
Beth is a blood relative of Cal.
Is Ann a blood relative of Cal?
Many adult reasoners respond, “Yes”. The relation holds in their model,
which represents lineal descendants or siblings. They fail to search assidu-
ously for an alternative model—it takes work to engage the deliberative sys-
tem, or a clue to a possible alternative model, such as a reminder that people
can be related by marriage. Indeed, Ann and Cal could be Beth’s parents,
not blood relatives of one another (Goodwin & Johnson-Laird, 2005, 2008).
Visual images are iconic, and so some theorists suppose that they play a
key role in reasoning (e.g. Kosslyn, 1994, p. 404). They do play a role: they
impede reasoning.To see why, it is crucial to distinguish among relations that
elicit visual images, such as “dirtier than”, relations that elicit spatial relations,
such as “on the right of ”, and relations that are abstract, such as “better than”.
Individuals are slowest in reasoning from visual relations (Knauff & Johnson-
Laird, 2002), but do not differ reliably in reasoning from the other sorts of
relation. As an fMRI study showed, only visual relations elicited additional
activity in visual cortex (Knauff, Fangmeier, Ruff, & Johnson-Laird, 2003).
Knauff (2013) tells the whole story: visual imagery is not necessary for rea-
soning, which is just as well because some relations, such as those between
sets, have iconic representations that may not be visualizable.
Not everything can be represented in an icon. A crucial example is a
negation, such as:
The triangle is not on the right of the circle.
Reasoners could try to list all the alternative affirmative possibilities—the
triangle is on the left of the circle, behind it, and so on—but it would be criti-
cal, not only to include all the possibilities but also to make explicit that the
list is exhaustive. Alas, neither these conditions nor the meaning of negation
itself can be represented in an icon.The model theory accordingly introduces
a symbol for negation, which is linked to its meaning: a negative assertion
Toward a Unif ied Theory of Reasoning 11
or clause is true if, and only if, its corresponding affirmative is false. This
meaning goes back to Aristotle’s De Interpretatione, and with some exceptions,
it holds for English usage (Khemlani, Orenes, & Johnson-Laird, 2012). The
mental model of the preceding assertion is denoted in the following diagram:
where “¬” denotes the symbol for negation, and the brackets symbolize the
scope of the negation, that is, what it applies to. Hence, a comparison of this
model with an actual scene would yield the value “true” if, and only if, the
relevant circle and triangle were not in the spatial relation represented in
the embedded model.
Few people grasp the concept of “negation”, and so prudent experi-
menters ask them about the “denial” of assertions. But, even so, most reason-
ers err in enumerating the possibilities referred to by compound assertions,
such as:
He denied that John was watching TV and smoking, or else Ann was
writing a letter.
Once again, however, number of models is the key variable (Khemlani et al.,
2012). It is harder to enumerate the possibilities for the denial of a conjunc-
tion, A and B, which has three models:
¬A ¬B
¬A B
A ¬B
than to enumerate the possibilities for the denial of an inclusive disjunction,
A or B, which has one model:
¬A ¬B
There are plenty of other abstract concepts, such as “possibility”, “truth”,
and “obligation” that transcend iconicity.
They represent the possibilities in which the disjunction is true, not the
possibilities in which it is false. But, the principle of truth applies at a lower
level. Both of the preceding models represent clauses in the disjunction only
when they are true. In contrast, fully explicit models also represent clauses
that are false. In the first model above, it is false that there is a circle; and
in the second model, it is false that there isn’t a triangle, that is, there is a
triangle. Hence, the fully explicit models of the exclusive disjunction are:
where we use negation to represent falsity. The fully explicit models show
that the disjunction is equivalent to the biconditional assertion:
There isn’t a triangle if, and only if, there isn’t a circle.
Reasoners don’t immediately grasp this equivalence—a failure that shows
that they rely on mental models, not fully explicit models.
When participants are given a compound assertion, such as a disjunction,
and are asked to list what is possible, the principle of truth constrains them, and
so they list the possibilities corresponding to mental models (see, e.g. Barres &
Johnson-Laird, 2003; Johnson-Laird & Savary, 1995). The advantage of the prin-
ciple is that it reduces the processing load of reasoning. But, when we implemented
the principle in a computer program, we discovered an unexpected downside.
Could both of these disjunctions be true at the same time?
Either the pie is on the table or the cake is on the table, but not both.
Either the pie isn’t on the table or the cake is on the table, but not both.
Most people say,“Yes” ( Johnson-Laird, Lotstein, & Byrne, 2012).The mental
models of what’s on the table according to the first disjunction are:
Pie
Cake
And the mental models of what’s on the table according to the second dis-
junction are:
¬ Pie
Cake
Toward a Unif ied Theory of Reasoning 13
The presence of the cake is common to both sets of models, and so it seems
that the two assertions can both be true at the same time, that is, when the
cake is on the table. In contrast, the fully explicit models of the two disjunc-
tions are as follows:
Pie ¬ Cake
¬ Pie Cake
and:
¬ Pie ¬ Cake
Pie Cake
As readers can see, no model is common to both assertions, and so they can-
not both be true at the same time.
The program implementing the model theory predicts these fallacies,
and others too. Their occurrence has been corroborated in many sorts of
deductions, including those based on:
• Disjunctions and biconditionals of conditionals ( Johnson-Laird & Savary,
1999);
• Disjunctions of conjunctions (Walsh & Johnson-Laird, 2004);
• Disjunctions of disjunctions (Khemlani & Johnson-Laird, 2009);
• Disjunctions of quantified assertions (Yang & Johnson-Laird, 2000).
The fallacies tend to be compelling and to elicit judgments of high con-
fidence in their conclusions, and so they have the character of cogni-
tive illusions. Other illusions led to conclusions about what is probable
(Johnson-Laird & Savary, 1995), possible (Goldvarg & Johnson-Laird, 2000),
and permissible (Bucciarelli & Johnson-Laird, 2005). And still others con-
cerned the evaluation of the consistency of assertions (Legrenzi, Girotto, &
Johnson-Laird, 2003). Each study examined several sorts of illusion and
matched control problems. Why so many studies of illusions? Because only
the model theory predicts them, and so they are a litmus test for the use of
mental models.
6. MODELS AS COUNTEREXAMPLES
In reasoning, a counterexample is a possibility that is consistent with a
set of premises, but not with a putative conclusion, and so it shows that the
conclusion does not follow validly from the premises. The intuitive system
can generate at most a single model at a time. To establish the validity of a
14 P. N. Johnson-Laird and Sangeet S. Khemlani
conclusion, the deliberative system has to search for alternative models and
to show either that no other mental model can be formed from the premises
or that the conclusion holds in the alternatives. If the deliberative system
creates a model that is a counterexample then it can search for an alterna-
tive conclusion that holds in all the models or, if this search fails, declare that
no valid conclusion follows from the premises. As we pointed out earlier, a
conclusion such as a conjunction of the premises follows validly from any
set of premises, and so an alternative conclusion needs to be parsimonious
and to establish a new relation not explicitly asserted among the premises.
In short, counterexamples are crucial for rationality. Without the ability to
create them, individuals can infer conclusions, but they have no ready way to
establish their invalidity. So, to what extent do individuals make use of them?
On the one hand, reasoners often fail to use counterexamples when they
are drawing conclusions from premises—to the degree that one model-
based theory makes no use of them (Polk & Newell, 1995). On the other
hand, all the participants in one study spontaneously used them to revise
their responses (Bucciarelli & Johnson-Laird, 1999).
There are two sorts of invalid conclusion. One sort contradicts the
premises—their respective sets of possibilities are disjoint. The other sort is
consistent with the premises, but does not follow from them, that is, there
are possibilities to which the premises, but not the conclusion, refer. The
model theory predicts that the invalidity of contradictions should be easier
to detect than the invalidity of consistent premises: the former don’t have
a mental model in common with the premises whereas the latter do. The
theory also predicts that when individuals are asked to explain why a con-
clusion does not follow from the premises, they should tend to point out
the contradiction in the first case but to exhibit a counterexample in the
second case. A study corroborated both of these predictions (Johnson-Laird &
Hasson, 2003). The participants were more accurate in identifying invalid
inferences in which the conclusion contradicted the premises (92% cor-
rect) than those in which the conclusion was consistent with the premises
(74% correct). To justify their judgments, they used counterexamples more
often for conclusions consistent with the premises (51% of cases) than for
conclusions inconsistent with them (21% of cases). Of course, they used
other strategies too. One participant, for instance, pointed out that a piece of
necessary information was missing from the premises. But, the use of coun-
terexamples correlated with accuracy in the evaluation of the inferences.
An fMRI study contrasted reasoning and mental arithmetic from
the same premises (Kroger, Nystrom, Cohen, & Johnson-Laird, 2008).
Toward a Unif ied Theory of Reasoning 15
Jogger Writer
Jogger Dancer
Writer Dancer
Dancer
Hence, it doesn’t follow that a student is all three. While the participants
were reading the premises, the language areas of their brains were active
(Broca’s and Wernicke’s areas), but then other areas carried out the solu-
tion to the problems. Right prefrontal cortex and inferior parietal lobe
were more active for reasoning than for calculation, whereas regions in left
prefrontal cortex and superior parietal lobe were more active for calcula-
tion than for reasoning. Right prefrontal cortex—a region known as the
right frontal pole—was active only during the difficult inferences calling
for a search for counterexamples. Other studies have shown that difficult
inferences activate right frontal cortex (Kroger et al., 2002; Waltz et al.,
1999). The anterior frontal lobes evolved most recently, they take longest to
mature, and their maturation relates to measured intelligence (Shaw et al.,
2006). Whether they are activated merely by problems calling for delibera-
tion remains unclear.
16 P. N. Johnson-Laird and Sangeet S. Khemlani
¬A B
¬A ¬B
where A and B have as values actual propositions (see, e.g. Johnson-Laird &
Savary, 1995). Barrouillet and his colleagues have shown that children
around the age of 8 years list only one possibility, A and B, a conjunctive
interpretation; around the age of 11 years, they include another possibility,
¬ A and ¬ B, a biconditional interpretation; and around the age of 15 years,
they list the three possibilities above (Barrouillet & Lecas, 1998). The pro-
cessing capacity of working memory is a better predictor than chronologi-
cal age for the number of possibilities that children list (Barrouillet, Grosset, &
Lecas, 2000; Barrouillet & Lecas, 1999).
In reasoning, individuals rely on the mental models of conditionals, which
consist of an explicit model of the salient case in which both clauses hold, and
a content-less placeholder for other possibilities in which the if-clause is false:
A B
. . .
One corollary concerns inferences of the form:
If A then B.
A.
What follows?
Toward a Unif ied Theory of Reasoning 17
Individuals easily infer the conclusion, B. It follows at once from the mental
models. A contrasting inference is:
If A then B.
Not-B.
What follows?
The second premise eliminates the one explicit mental model, and so it seems
that nothing follows—a common response. Only if reasoners flesh out their
mental models, or adopt some analogous strategy, can they make the valid
inference: Not-A.The difference between the two sorts of inference is highly
robust. A more striking corroboration of the model theory is that the presen-
tation of the premises in the opposite order improves performance with the
difficult inference—it renders unnecessary the need to construct the explicit
mental model of the conditional, thus making room for models of the pos-
sibilities in which not-A holds (see Girotto, Mazzocco, & Tasso, 1997).
Modulation has several effects, and one of them is to block the construction
of models of possibilities. A conditional, such as:
If she played a musical instrument then it wasn’t the flute
refers to only two possibilities because knowledge that a flute is a musical
instrument blocks the construction of the possibility that she didn’t play a
musical instrument but did play the flute. Hence, the conditional alone yields
the conclusion that she didn’t play the flute.The principal possibility to which
almost all conditionals refer is the one in which both the if-clause and the
then-clause hold. Hence, the theory postulates that if a conditional refers to
more than one possibility, then this possibility must be one of them. Modula-
tion can accordingly yield the preceding interpretation or the biconditional
interpretation. Still other effects of modulation occur with then-clauses that
themselves express only a possibility, such as “if Hillary runs then she may win”.
Experiments have corroborated that modulation blocks the construc-
tion of models (Quelhas, Johnson-Laird, & Juhos, 2010). Consider these two
conditionals translated from the Portuguese:
If the dish is lasagne then its basis is pasta.
If the cake is made of eggs then it can be suspiro.
For the first sort of conditional, participants allow that the dish can be pasta
but not lasagne. But, for the second sort of conditional, they do not allow
that the cake can be suspiro but not made of eggs—all Portuguese know
that suspiro is made from eggs. The two sorts of conditionals yield appro-
priately different patterns of inference.
Consider the inference:
Luisa didn’t play soccer.
18 P. N. Johnson-Laird and Sangeet S. Khemlani
¬ Music ¬ Soccer
¬ Music Soccer
Hence, the conclusion refers to the possibility to which the premise refers,
and so the inference is valid. Yet, most people reject it. Why? One answer
is that it is unacceptable because it throws information away, that is, its
conclusion also refers to an alternative possibility that conflicts with the
premise:
¬ Music Soccer
This conflict, as Orenes and Johnson-Laird (2012) argued, may deter indi-
viduals from drawing the inference. If so, then modulation that blocks the
conflicting model should yield an acceptable inference, for example:
Luisa didn’t play soccer.
Therefore, if Luisa played a game then she didn’t play soccer.
The conditional now refers to just two possibilities in which Luisa played:
A game ¬ Soccer
¬ A game ¬ Soccer
The conditional can’t refer to the case in which Luisa didn’t play a game
but played soccer because soccer is a game. So, both the preceding possibili-
ties refer to the same possibility as the premise. In this case, a highly reliable
increase occurs in the percentage of participants who accepted the inference.
And analogous phenomena occur with inferences to disjunctive conclusions.
Another effect of modulation is to introduce spatial, temporal, or other
relations between the if-clause and the then-clause. As a consequence, indi-
viduals make different inferences (Quelhas et al., 2010). For example, given
these premises:
If Laura got the virus, then she infected Renato.
If she infected Renato, then he went to hospital.
Laura got the virus.
Toward a Unif ied Theory of Reasoning 19
Participants tend to infer that Laura got the virus before Renato went to
hospital. But, given these premises:
If Cristina wrote the article, then Marco asked her to write it.
If Marco asked her to write it, then he met her at the meeting.
Cristina wrote the article.
Participants tend to infer that Cristina wrote the article after Marco met
her.The temporal inferences depend on the participants’ general knowledge
about the typical orders of events.
A subtle effect of temporal modulation is illustrated in the following
contrasting examples (Juhos, Quelhas, & Johnson-Laird, 2012). The first
example is:
If the author writes the book, then the publisher publishes it.
The author writes the book.
What follows?
Individuals tend to infer:
The publisher publishes it.
The second example is:
If the author writes the book, then the publisher publishes it.
The publisher publishes the book.
What follows?
Individuals tend to infer:
The author wrote the book.
The difference is that for the first inference, the participants tended to use
the present tense (the experiment was carried out in Portuguese), whereas
for the second inference, they tended to use the past tense. As in English,
which has no future tense, the present tense in Portuguese can be used
to refer to future events. The same phenomenon occurred in inferences
from disjunctions. The categorical premise accordingly establishes a refer-
ence time, and events prior to it are referred to in the past tense, and events
subsequent to it are referred to in the present tense. This sort of modula-
tion is tacit—participants are not usually aware of its effects—but it shows
that general knowledge influences the interpretation of conditionals and
disjunctions.
A crucial corollary of modulation concerns logical form. A typical for-
mal rule of inference is:
A or B.
Not-B.
Therefore, not-A.
20 P. N. Johnson-Laird and Sangeet S. Khemlani
This rule is applicable to any premises that have the corresponding logical
forms, which are transparent in logic, because they are defined by its gram-
mar. In language, however, logical forms are far from transparent, and no
algorithm exists to determine them because they are not just a matter of
grammar. They depend on the possibilities to which assertions refer. So too
does validity, and it therefore can be decided only on a case-by-case basis.
The model theory makes no use of logical form, but merely the grammatical
structure of sentences, and it uses meaning, reference, and knowledge to
modulate logical interpretations.
What is the probability that both the green and the blue balls are there?
The mental models of the premise are:
Green
Blue
Green Blue
Green Blue
They imply that the red and blue marbles cannot occur together, and so
their probability is zero. And most people make this estimate. However, the
disjunction means that when its first clause is true, its second clause is false,
and it can be false in three ways:
Red Green ¬ Blue
¬ Green Blue
¬ Green ¬ Blue
When the second clause of the premise is true, the first clause is false:
¬ Red Green Blue
Hence, there are four distinct possibilities for what’s in the box, and, on the
assumption of equiprobability, the probability of green and blue is, not zero,
but 25%. The participants in an experiment performed much better with
the control problems than with the illusory problems of this sort (Johnson-
Laird et al., 1999).
Toward a Unif ied Theory of Reasoning 25
| −−−^ |
in which the left vertical represents impossibility, the right vertical rep-
resents certainty, and the pointer at the end of the line corresponds to
the strength of the particular belief, such as, Hillary will be elected President.
The intuitive system can translate this representation into the sorts of
description that a non-numerate individual would use, such as: “it’s as
likely as not”.
The deliberative system can map the degrees of belief represented in an
icon into a numerical estimate. Because this system has access to working
memory, it can carry out proper arithmetical operations. It can also try to
keep track of the complete joint probability distribution (the JPD). Given
two unique events, such as the election of Clinton in 2016 and the Demo-
crats gaining control of Congress, the JPD consists in the set of probabilities
for each possible combination of the affirmations and negations of the rel-
evant propositions:
Hillary is President & Democrats control Congress 35%
Hillary is President & not (Democrats control Congress) 30%
Not(Hillary is President) & Democrats control Congress 15%
Not(Hillary is President) & not(Democrats control Congress) 20%
The JPD provides all the information needed to estimate any probability
concerning the domain. There are many different sets of probabilities from
26 P. N. Johnson-Laird and Sangeet S. Khemlani
which the values of the JPD can be inferred. For instance, if you know the
values of the three probabilities in each of the following triples then, in
principle, you can infer that values of the probabilities in the JPD, where,
say, A denotes “Hillary is President” and B denotes “Democrats control
Congress”:
P(A), P(B), P(A and B)
P(A), P(B), P(A or B, or both)
P(A), P(B), P(A|B)
The last of these triples includes P(A|B), which is the conditional probabil-
ity of B on the assumption that A occurs.
Granted the limited ability of the intuitive system to carry out loops
of operations (see Section 3), it is capable of only a small number of
primitive analogs of arithmetical operations of the sort found in infants
(Barth et al., 2006; Dehaene, 1997; Xu & Spelke, 2000) and adults in
non-numerate cultures (Gordon, 2004). It can add two pointers, subtract
one from another, take their mean, and multiply a proportion signified
by one pointer by another—all within the bounds between certainty and
impossibility and all in crude error-prone ways. The theory accordingly
postulates that to estimate the probability of a conjunction of events,
reasoners should tend to split the difference between them, but some
may take the proportion of a proportion. The latter is a more complex
operation (in terms of Kolmogorov complexity, see Li & Vitányi, 1997),
and so it should tend to be used less often. Reasoners should likewise
make analogous inferences in estimating conditional and disjunctive
probabilities.
We implemented the intuitive and deliberative systems in a computer
model and tested its predictions in experiments (Khemlani et al., 2012).
The results showed that the participants concurred in the rank orders of
their estimates of the probabilities of unique events. For example, they
agreed that the US is more likely to make English the official language
of the country (the average estimate was a probability of 46%) than to
adopt an open border policy (an average estimate was a probability of
15%). Hence, they are to some extent relying on knowledge and men-
tal processes in common. They tended to estimate the probability of a
conjunction by taking the mean of their estimates of the probabilities of
its conjuncts. This tendency was even evident in the overall means, for
example, their mean estimate of the conjunction of the US adopting an
open border policy and making English the official language was 26%, a
Toward a Unif ied Theory of Reasoning 27
value falling between their mean estimates of the two conjuncts. It yields a
violation of the JPD, that is, the negative probability in the third conjunc-
tion shown here:
English Open borders: 26%
English ¬ Open borders: 20%
¬ English Open borders: -11%
¬ English ¬ Open borders: 65%
Violations of the JPD, however, were smaller when the conjunction came
last as opposed to first in the sequence of judgments. When it was last,
the participants had already made numerical estimates of the probabili-
ties of its conjuncts, and so they could use a deliberative procedure, such
as taking a proportion of a proportion. This method is appropriate only
for independent events, but a prior study established that they were not
independent.
The model theory of probabilities dispels some common misconcep-
tions. Probabilistic reasoning isn’t always inductive. Extensional estimates
can be deductively valid, but they can also yield illusory values. Likewise,
nonextensional estimates of unique events depend on intuitions, and the
resulting violations of the JPD suggest that the probability calculus is not
native to human cognition. Individuals simulate events, but their restricted
repertoire of intuitive methods leads them into error.
Figure 1.1 The railway domain with an example of an initial configuration in which a set
of cars is on the left side (a) of the track, the siding (b) can hold one or more cars while
other cars are moved to the right side of the track (c).
28 P. N. Johnson-Laird and Sangeet S. Khemlani
all 24 possible rearrangements of four cars, and the participants easily solved
each of them, but they did tend to perseverate: every participant made one
or more unnecessary moves.
In the principal experiment, the participants, who were not program-
mers, had to formulate algorithms for three sorts of rearrangement: reversals
in which, say, ABCDEFGH on left track becomes HGFEDCBA on right
track; palindromes in which, say, ABCDDCBA becomes AABBCCDD, and
parity sorts in which, say, ABCDEFGH becomes ACEGBDFH, that is, cars
in odd-numbered positions precede those in even-numbered positions.
Each solution calls for recursion, that is, a loop of operations. Primitive
recursion in the theory of recursive functions corresponds to a loop car-
ried out for a given number of times, a so-called “for-loop”, whereas mini-
mization corresponds to a loop carried out while a given condition holds,
a “while-loop” (see Rogers, 1967). While-loops are more powerful than
for-loops because only they can compute certain functions. Indeed, when
a while-loop is entered, there may be no way to determine how many
times it will repeat before it yields an output or whether it will ever halt
to yield an output. But, how do nonprogrammers formulate informal
algorithms? The task isn’t deductive: they can deduce the consequences
of a program, but they can’t create it using deduction alone (Kitzelmann,
Schmidt, Mühlpfordt, & Wysotzki, 2002). Likewise, they don’t rely on
probabilities any more than they do for Sudoku puzzles (Lee et al., 2008).
The one viable method is to simulate a solution to a problem, observe
what happens in the simulation, and translate these observations into a
description. The simulation depends on a kinematic sequence of men-
tal models representing successive states of the world, real or imaginary
(Johnson-Laird, 1983, chap. 15).
Let’s examine the process in more detail. The first step is to solve two
different examples of the relevant rearrangement problem. Without two
examples differing in numbers of cars, rearrangements are ambiguous. The
solution to reversing a train of four cars is as follows:
ABCD[ ], A[BCD], [BCD]A, B[CD]A, [CD]BA, C[D]BA, [D]CBA,
D[ ]CBA, [ ]DCBA
As this protocol illustrates, only three sorts of move are possible, and they
occur in these summaries of simulations that solve reversals of trains of four
and five cars:
S3 R1 L1 R1 L1 R1 L1 R1
S4 R1 L1 R1 L1 R1 L1 R1 L1 R1
30 P. N. Johnson-Laird and Sangeet S. Khemlani
where “S3” means move three cars to the siding from left track, “R1” means
move one car to right track from left track, and “L1” means move one car
to left track from the siding. The second step uses the two summaries to
work out the loop of moves they contain and any moves before or after it
(pace Miller, 1974,1981; Pane, Ratanamahatana, & Myers, 2001). The loop
in the simulations above is (R1 L1). But, how many times should it be iter-
ated? There are two ways to answer this question, depending on whether
reasoners are formulating a while-loop or a for-loop. The simpler way is to
observe the conditions in the simulation when the loop halts, which are
respectively:
D[ ]CBA
E[ ]DCBA
The condition that halts the loop is that no cars are left on the siding,
and so the while-loop should continue as long as the siding isn’t empty.
The alternative is to compute the number of times that a for-loop should be
executed. It calls for the solution of a pair of simultaneous linear equations
to obtain the values of a and b in:
Number of iterations = a × length of the train + b.
The final step maps the structure of the solution into an informal descrip-
tion. We implemented this entire process in a computer program, which
constructs programs for any rearrangement problem based on a single loop.
It produces a for-loop and a while-loop in Lisp and translates the while-
loop into informal English. Each of these functions solves any instance of
the relevant class of rearrangements. Table 1.1 presents its solutions for the
three sorts of rearrangement: reversals, palindromes, and parity sorts.
If individuals use simulation to devise algorithms, then they should tend
to use while-loops rather than for-loops because it is easier to observe the
halting condition of a while-loop than to solve simultaneous equations.
The overall difficulty of formulating an algorithm should depend on its
Kolmogorov complexity, which is the length of its shortest description in
a given language, such as Lisp (Li & Vitányi, 1997). A good proxy is the
number of instructions. In Table 1.1, the functions for reversals and palin-
dromes call for four instructions, whereas parity sorts call for five instruc-
tions. Within a given level of complexity, another factor should also affect
difficulty: the mean number of operands (i.e., cars) per move. This mea-
sure distinguishes reversals, which have 1.38 operands per move for eight
cars, from palindromes, which have 1.75 operands per move for eight cars.
Hence, the three sorts of problem should increase in difficulty from reversals
through palindromes to parity sorts.
Toward a Unif ied Theory of Reasoning
Table 1.1 Loops for Computing Minimal Solutions to Three Sorts of General Problem: Reversals, Palindromes, and Parity Sorts Using “for”-
loops and “while”-loops and Their Informal Description (from the Output of the Computer Program mReasoner for Abducing them)
While-loops
31
32
Table 1.1 Loops for Computing Minimal Solutions to Three Sorts of General Problem: Reversals, Palindromes, and Parity Sorts Using “for”-
loops and “while”-loops and Their Informal Description (from the Output of the Computer Program mReasoner for Abducing them)—(Cont’d)
While-loops
apart, and so on, may not be intended to represent their real sizes or dis-
tances apart. Analogous issues occur with mental models of other sorts of
assertion. For instance, a quantified assertion, such as:
Some of the actors are bakers
has the following sort of iconic model shown in this diagram of four
individuals:
Actor Baker
Actor Baker
Actor
Baker
The numbers of mental tokens in this case are not intended to represent
the actual numbers of actors or bakers. Only the overlap between the two
sets is iconic. When reasoners search for an alternative model of a set of
premises, they can modify all but the essentials of a model. So, how does
the system keep track of the essentials? A single uniform answer is that
it relies on the meanings of assertions. Hence, mReasoner uses a gram-
mar, a lexicon, and a parser to construct representations of meanings, that
is, intensional representations (for an account of their construction, see
Khemlani, Lotstein, & Johnson-Laird, submitted for publication). They are
then used to build extensional representations, that is, mental models. Both
sorts of representations are crucial in reasoning, and to illustrate this point,
we consider the intuitive and deliberative systems in reasoning from quan-
tified assertions.
The model theory treats the intensions of quantified assertions as rela-
tions between sets (see Boole, 1854; Cohen & Nagel, 1934).The advantages
of this treatment are twofold. First, it dovetails with a long-standing treat-
ment of quantifiers in the model theory (Johnson-Laird, 1983, chap. 15):
a set is represented iconically as a set of mental tokens, and a quantified
assertion is represented as a relation between such sets. Second, it works for
all quantifiers in natural language, including those such as “more than half
of the artists”, which cannot be defined using the quantifiers that range
over entities in logic (Barwise & Cooper, 1981). Here are some illustrative
examples of this treatment of quantifiers, which the intensions of assertions
capture:
Toward a Unif ied Theory of Reasoning 35
No A is a B A B= (Intersection of A and
B is empty.)
Actor
Baker Colleague
In general, affirmative premises are added so as to minimize the number
of distinct sorts of individual, whereas negative premises are added so as to
maximize the number of distinct sorts of individual.
36 P. N. Johnson-Laird and Sangeet S. Khemlani
Once the intuitive system has an initial model, it can draw a conclusion
establishing a new set-theoretic relation, that is, a relation that is not asserted
in the premises. In the past, the model theory has eschewed heuristics, but
it now embodies them to frame both the quantifier in the conclusion (its
mood) and the order of the terms that occur in it: “actors” and “colleagues”
(its figure). When two premises differ in mood, one of them dominates the
other in determining the mood and figure of the initial conclusion. The
order of dominance reflects two principles governing valid inferences:
• A negative premise can yield only valid conclusions that are negative.
• Within both negative and affirmatives, a particular premise—one based,
for instance, on “some”—can yield only valid conclusions that are par-
ticular.
The resulting order of dominance for syllogisms is accordingly:
Some _ are not _ > No _ are _ > Some _ are _ > All _ are_
In our example, the first premise is dominant: “artists” is its subject, and so
“artists” is the subject of the conclusion, and the term in the other premise,
“colleagues”, is in the predicate of the conclusion, that is, “some of the art-
ists are colleagues”. Analogous principles apply to other sorts of premise.
They account for the well-known figural effect that occurs in syllogistic
reasoning, for example, the tendency to infer the conclusion above rather
than the converse,“some colleagues are artists” (see, e.g. Bucciarelli & Johnson-
Laird, 1999). The order of dominance is the same as the order invoked in
Chater and Oaksford (1999) from probabilistic considerations. But, since
our principles derive from valid inferences, and yield only conclusions that
hold in initial mental models, they do not depend on probabilities.The heu-
ristics operate without storing any information in working memory, and so
they are rapid, but fallible.
The deliberative system makes a recursive search for alternative mod-
els falsifying an initial conclusion. When the system finds a counterex-
ample, it formulates a new conclusion if one is possible or else declares
that no definite conclusion follows about the relation between the end
terms. It searches for counterexamples using the same operations as
did participants working with external models in the form of cutout
shapes (Bucciarelli & Johnson-Laird, 1999): adding a new individual to
a model, breaking an individual into two, and moving a property from
one individual to another. As a meta-analysis showed, the resulting the-
ory embodied in mReasoner outperforms all current theories of syllogis-
tic reasoning (see Khemlani & Johnson-Laird, 2012c; Khemlani et al.,
submitted for publication).
Toward a Unif ied Theory of Reasoning 37
12. CONCLUSIONS
The psychology of reasoning would have been simpler if human
beings were logicians or probabilists. Logic and the probability calculus
are not native mental faculties but cultural discoveries. Some individu-
als master these technologies; some do not. And, in our culture, most
individuals have smatterings of them at best. As the model theory pre-
dicts, deductive and probabilistic inferences are difficult and fallible. An
awareness of the occurrence of errors led Aristotle and his intellectual
descendants to devise logical and probabilistic calculi. These technolo-
gies, however, are unlikely foundations for human reasoning. So, what is?
We have argued that it is mental simulation. Reasoners build models of
premises and base their inferences on them. This view seems undeniable
for reasoning that creates informal algorithms. The evidence we have
presented shows that it applies also to all the main domains and tasks of
reasoning, from deductions based on sentential connectives to inductions
about the probabilities of unique events. But, its manifold applications are
a source of its main weakness—its potential disintegration into a bunch
of separate subtheories. Their unification is viable because each subthe-
ory is constrained by the main principles of the theory. What is much
harder is to implement a computer program that predicts the responses
that reasoners make to any inferential task, but mReasoner is a step toward
that goal.
ACKNOWLEDGMENTS
This research was supported by a National Science Foundation Grant No. SES 0844851 to
the first author to study deductive and probabilistic reasoning and by a National Research
Council Research Associateship to the second author. We are grateful to more colleagues
than we can name here, but many of them can be found among the references.
38 P. N. Johnson-Laird and Sangeet S. Khemlani
REFERENCES
Bar-Hillel,Y. (1964). Language and information processing. Reading, MA: Addison-Wesley.
Barnes, J. (Ed.), (1984). The complete works of Aristotle. Princeton, NJ: Princeton University
Press.
Barres, P., & Johnson-Laird, P. N. (2003). On imagining what is true (and what is false).
Thinking & Reasoning, 9, 1–42.
Barrouillet, P., & Lecas, J.-F. (1998). How can mental models theory account for content
effects in conditional reasoning? A developmental perspective. Cognition, 67, 209–253.
Barrouillet, P., & Lecas, J.-F. (1999). Mental models in conditional reasoning and working
memory. Thinking & Reasoning, 5, 289–302.
Barrouillet, P., Grosset, N., & Lecas, J. F. (2000). Conditional reasoning by mental models:
chronometric and developmental evidence. Cognition, 75, 237–266.
Barth, H., La Mont, K., Lipton, J., Dehaene, S., Kanwisher, N., & Spelke, E. S. (2006).
Nonsymbolic arithmetic in adults and young children. Cognition, 98, 199–222.
Barwise, J., & Cooper, R. (1981). Generalized quantifiers and natural language. Linguistics and
Philosophy, 4, 159–219.
Bauer, M. I., & Johnson-Laird, P. N. (1993). How diagrams can improve reasoning. Psychological
Science, 4, 372–378.
Boole, G. (1854). An investigation of the laws of thought. London: Macmillan.
Braine, M. D. S. (1978). On the relation between the natural logic of reasoning and standard
logic. Psychological Review, 85, 1–21.
Brewka, G., Dix, J., & Konolige, K. (1997). Nonmonotonic reasoning: An overview. Stanford, CA:
CLSI Publications, Stanford University.
Bryant, P. E., & Trabasso, T. (1971). Transitive inferences and memory in young children.
Nature, 232, 456–458.
Bucciarelli, M., & Johnson-Laird, P. N. (1999). Strategies in syllogistic reasoning. Cognitive
Science, 23, 247–303.
Bucciarelli, M., & Johnson-Laird, P. N. (2005). Naive deontics: a theory of meaning,
representation, and reasoning. Cognitive Psychology, 50, 159–193.
Byrne, R. M. J., & Johnson-Laird, P. N. (1989). Spatial reasoning. Journal of Memory & Language,
28, 564–575.
Byrne, R. M. J. (2005). The rational imagination: How people create alternatives to reality.
Cambridge, MA: MIT.
Carreiras, M., & Santamaría, C. (1997). Reasoning about relations: spatial and nonspatial
problems. Thinking & Reasoning, 3, 191–208.
Chater, N., & Oaksford, M. (1999). The probability heuristics model of syllogistic reasoning.
Cognitive Psychology, 38, 191–258.
Cohen, M. R., & Nagel, E. (1934). An introduction to logic and scientific method. London:
Routledge & Kegan Paul.
Cohen, L. J. (1981). Can human irrationality be experimentally demonstrated? Behavioral and
Brain Sciences, 4, 317–370.
Cosmides, L., & Tooby, J. (1996). Are humans good intuitive statisticians after all? R
e-thinking
some conclusions of the literature on judgment under uncertainty. Cognition, 58, 1–73.
Cosmides, L., & Tooby, J. (2005). Neurocognitive adaptations designed for social exchange.
In D. M. Buss (Ed.), Evolutionary psychology handbook (pp. 584–627). New York: Wiley.
Craik, K. (1943). The nature of explanation. Cambridge: Cambridge University Press.
Dehaene, S. (1997). The number sense. Oxford, UK: Oxford University Press.
deKleer, J. (1986). An assumption-based TMS. Artificial Intelligence, 28, 127–162.
Elio, R., & Pelletier, F. J. (1997). Belief change as propositional update. Cognitive Science, 21,
419–460.
Evans, J. St. B.T. (2008). Dual-processing accounts of reasoning, judgment and social cogni-
tion. Annual Review of Psychology, 59, 255–278.
Toward a Unif ied Theory of Reasoning 39
Evans, J. St. B.T. (2012). Questions and challenges for the new psychology of reasoning.
Thinking & Reasoning, 18, 5–31.
Falk, R. (1992). A closer look at the probabilities of the notorious three prisoners. Cognition,
43, 197–223.
Frosch, C. A., & Johnson-Laird, P. N. (2011). Is everyday causation deterministic or probabilistic?
Acta Psychologica, 137, 280–291.
García-Madruga, J. A., Moreno, S., Carriedo, N., Gutiérrez, F., & Johnson-Laird, P. N. (2001).
Are conjunctive inferences easier than disjunctive inferences? A comparison of rules and
models. Quarterly Journal of Experimental Psychology, 54A, 613–632.
Gärdenfors, P. (1992). Belief revision: an introduction. In P. Gärdenfors (Ed.), Belief revision
(pp. 1–20). Cambridge, UK: Cambridge University Press.
Girotto, V., Mazzocco, A., & Tasso, A. (1997). The effect of premise order in conditional
reasoning: a test of the mental model theory. Cognition, 63, 1–28.
Goldvarg, Y., & Johnson-Laird, P. N. (2000). Illusions in modal reasoning. Memory & Cogni-
tion, 28, 282–294.
Goldvarg,Y., & Johnson-Laird, P. N. (2001). Naive causality: a mental model theory of causal
meaning and reasoning. Cognitive Science, 25, 565–610.
Goodwin, G. P., & Johnson-Laird, P. N. (2005). Reasoning about relations. Psychological
Review, 112, 468–493.
Goodwin, G. P., & Johnson-Laird, P. N. (2008). Transitive and pseudo-transitive inferences.
Cognition, 108, 320–352.
Gordon, P. (2004). Numerical cognition without words: evidence from Amazonia. Science,
306, 496–499.
Hacking, I. (1975). The emergence of probability. Cambridge: Cambridge University Press.
Harman, G. (1986). Change in view: Principles of reasoning. Cambridge, MA: MIT Press,
Bradford Book.
Henle, M. (1962). On the relation between logic and thinking. Psychological Review, 69,
366–378.
Hopcroft, J. E., & Ullman, J. D. (1979). Formal languages and their relation to automata. Reading,
MA: Addison-Wesley.
Inhelder, B., & Piaget, J. (1958). The growth of logical thinking from childhood to adolescence.
London: Routledge, Chapman & Hall.
Jahn, G., Knauff, M., & Johnson-Laird, P. N. (2007). Preferred mental models in reasoning
about spatial relations. Memory & Cognition, 35, 2075–2087.
James, W. (1907). Pragmatism—a new name for some old ways of thinking. New York: Longmans,
Green.
Jeffrey, R. (1981). Formal logic: Its scope and limits (2nd ed.). New York, NY: McGraw-Hill.
Johnson-Laird, P. N., & Byrne, R. M. J. (1991). Deduction. Hillsdale, NJ: Erlbaum.
Johnson-Laird, P. N., & Byrne, R. M. J. (2002). Conditionals: a theory of meaning, pragmatics,
and inference. Psychological Review, 109, 646–678.
Johnson-Laird, P. N., & Hasson, U. (2003). Counterexamples in sentential reasoning. Memory
& Cognition, 31, 1105–1113.
Johnson-Laird, P. N., & Savary, F. (1995). How to make the impossible seem probable. In J. D.
Moore & J. F. Lehman (Eds.), Proceedings of the seventeenth annual conference of the cognitive
science society. Mahwah, NJ: Erlbaum.
Johnson-Laird, P. N., & Savary, F. (1999). Illusory inferences: a novel class of erroneous
deductions. Cognition, 71, 191–229.
Johnson-Laird, P. N., Byrne, R. M. J., & Schaeken, W. S. (1992). Propositional reasoning by
model. Psychological Review, 99, 418–439.
Johnson-Laird, P. N., Legrenzi, P., Girotto,V., Legrenzi, M., & Caverni, J.-P. (1999). Naive prob-
ability: a mental model theory of extensional reasoning. Psychological Review, 106, 62–88.
Johnson-Laird, P. N., Girotto, V., & Legrenzi, P. (2004). Reasoning from inconsistency to
consistency. Psychological Review, 111, 640–661.
40 P. N. Johnson-Laird and Sangeet S. Khemlani
Johnson-Laird, P. N., Lotstein, M., & Byrne, R. M. J. (2012). The consistency of disjunctive
assertions. Memory & Cognition, 40, 769–778.
Johnson-Laird, P. N. (1975). Models of deduction. In R. Falmagne (Ed.), Reasoning: Represen-
tation and process (pp. 7–54). Springdale, NJ: Erlbaum.
Johnson-Laird, P. N. (1983). Mental models. Cambridge: Cambridge University Press.
(Cambridge, MA: Harvard University Press).
Johnson-Laird, P. N. (2004).The history of mental models. In K. Manktelow & M. C. Chung
(Eds.), Psychology of reasoning:Theoretical and historical perspectives (pp. 179–212). New York:
Psychology Press.
Johnson-Laird, P. N. (2006). How we reason. New York: Oxford University Press.
Juhos, C., Quelhas, C., & Johnson-Laird, P. N. (2012). Temporal and spatial relations in sen-
tential reasoning. Cognition, 122, 393–404.
Kahneman, D. (2011). Thinking, fast and slow. New York, NY: Farrar, Strauss, Giroux.
Khemlani, S., & Johnson-Laird, P. N. (2009). Disjunctive illusory inferences and how to
eliminate them. Memory & Cognition, 37, 615–623.
Khemlani, S., & Johnson-Laird, P. N. (2011). The need to explain. Quarterly Journal of
Experimental Psychology, 64, 276–288.
Khemlani, S., & Johnson-Laird, P. N. (2012a). The processes of inference. Argument and
Computation, 1–17. (iFirst).
Khemlani, S., & Johnson-Laird, P. N. (2012b). Hidden conflicts: explanations make inconsis-
tencies harder to detect. Acta Psychologica, 139, 486–491.
Khemlani, S., & Johnson-Laird, P. N. (2012c). Theories of the syllogism: a meta-analysis.
Psychological Bulletin, 138, 427–457.
Khemlani, S., & Johnson-Laird, P.N. (2013). Mental simulation and the construction of informal
algorithms. In M. Knauff M. Pauen, N. Sebanz, & I. Wachsmuth (Eds.), Proceedings of
the 35th Annual Conference of the Cognitive Science Society. Austin, TX: Cognitive
Science Society.
Khemlani, S., Lotstein, M., & Johnson-Laird, P. N. (2012). The probabilities of unique events.
PLoS ONE, 7, 1–9. (Online version).
Khemlani, S., Lotstein, M., & Johnson-Laird, P. N. A unified theory of syllogistic reasoning,
submitted for publication.
Khemlani, S., Orenes, I., & Johnson-Laird, P. N. (2012). Negation: A theory of its meaning,
representation, and use. Journal of Cognitive Psychology, 24, 541–559.
Kitzelmann, E., Schmidt, U., Mühlpfordt, M., & Wysotzki, F. (2002). Inductive synthesis
of functional programs. In J. Calmet B. Benhamou, et al. (Eds.), Artificial intelligence,
automated reasoning, and symbolic computation (pp. 26–37). New York: Springer.
Knauff, M., & Johnson-Laird, P. N. (2002).Visual imagery can impede reasoning. Memory &
Cognition, 30, 363–371.
Knauff, M., & Ragni, M. (2011). Cross-cultural preferences in spatial reasoning. Journal of
Cognition and Culture, 11, 1–21.
Knauff, M., Fangmeier, T., Ruff, C. C., & Johnson-Laird, P. N. (2003). Reasoning, models,
and images: behavioral measures and cortical activity. Journal of Cognitive Neuroscience, 15,
559–573.
Knauff, M. (2013). Space to reason: A spatial theory of human thought. Cambridge, MA: MIT Press.
Kosslyn, S. M. (1994). Image and brain. Cambridge, MA: MIT Press.
Kroger, J. K., et al. (2002). Recruitment of anterior dorsolateral prefrontal cortex in human
reasoning: a parametric study of relational complexity. Cerebral Cortex, 12, 477–485.
Kroger, J. K., Nystrom, L. E., Cohen, J. D., & Johnson-Laird, P. N. (2008). Distinct neural
substrates for deductive and mathematical processing. Brain Research, 1243, 86–103.
Krumnack, A., Bucher, L., Nejasmic, J., Nebel, B., & Knauff, M. (2011). A model for relational
reasoning as verbal reasoning. Cognitive Systems Research, 11, 377–392.
de Laplace, P.-S. (1995). Philosophical essay on probabilities. New York: Springer- Verlag.
(Originally published in 1819).
Toward a Unif ied Theory of Reasoning 41
Lee, N. Y. L., Goodwin, G. P., & Johnson-Laird, P. N. (2008). The psychological problem of
sudoku. Thinking & Reasoning, 14, 342–364.
Legrenzi, P., Girotto, V., & Johnson-Laird, P. N. (2003). Models of consistency. Psychological
Science, 14, 131–137.
Leibniz, G. W. (1685, 1952). The art of discovery. In P. P. Weiner (Ed.), Selections—Gottfried
Wilhelm Leibniz. New York: Charles Scribners. (Originally published 1685).
Li, M., & Vitányi, P. (1997). An introduction to Kolmogorov complexity and its applications (2nd
ed.). New York: Springer-Verlag.
Miller, L. (1974). Programming by non-programmers. International Journal of Man–Machine
Studies, 6, 237–260.
Miller, L. (1981). Natural language programming: styles, strategies, and contrasts. IBM Systems
Journal, 20, 184–215.
Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs: Prentice-Hall.
Newell, A. (1990). Unified theories of cognition. Cambridge, MA: Harvard University Press.
Oaksford, M., & Chater, N. (2007). Bayesian rationality. Oxford: Oxford University Press.
Orenes, I., & Johnson-Laird, P. N. (2012). Logic, models, and paradoxical inferences. Mind &
Language, 27, 357–377.
Osherson, D. N. (1974). 1976). Logical abilities in children. (Vols. 1–4). Hillsdale, NJ: Erlbaum.
Pane, J. F., Ratanamahatana, C. A., & Myers, B. A. (2001). Studying the language and
structure in non-programmers’ solutions to programming problems. International Journal
of Human-Computer Studies, 54, 237–264.
Peirce, C. S. (1931–1958). Collected papers of Charles Sanders Peirce. ( Vols. 8). C. Hartshorne,
P. Weiss, & A. Burks, (Eds.), Cambridge, MA: Harvard University Press.
Perrow, C. (1984). Normal accidents: Living with high-risk technologies. New York: Basic
Books.
Polk, T. A., & Newell, A. (1995). Deduction as verbal reasoning. Psychological Review, 102,
533–566.
Quelhas, A. C., Johnson-Laird, P. N., & Juhos, C. (2010). The modulation of conditional
assertions and its effects on reasoning. Quarterly Journal of Experimental Psychology, 63,
1716–1739.
Reitman, W. R. (1965). Cognition and thought. New York: Wiley.
Rips, L. J. (1994). The psychology of proof. Cambridge, MA: MIT Press.
Rogers, H. (1967). Theory of recursive functions and effective computability. New York:
McGraw-Hill.
Schaeken,W. S., Johnson-Laird, P. N., & d’Ydewalle, G. (1996a). Mental models and temporal
reasoning. Cognition, 60, 205–234.
Schaeken, W. S., Johnson-Laird, P. N., & d’Ydewalle, G. (1996b). Tense, aspect, and temporal
reasoning. Thinking & Reasoning, 2, 309–327.
Shaw, P., Greenstein, D., Lerch, J., Clasen, L., Lenroot, R., Gogtay, N., et al. (2006). Intellectual
ability and cortical development in children and adolescents. Nature, 440, 676–679.
Shimojo, S., & Ichikawa, S. (1989). Intuitive reasoning about probability: theoretical and
experimental analyses of the “problem of three prisoners”. Cognition, 32, 1–24.
Sloman, S. A. (1996). The empirical case for two systems of reasoning. Psychological Bulletin,
119, 3–22.
Stanovich, K. E. (1999). Who is rational? Studies of individual differences in reasoning. Mahwah,
NJ: Erlbaum.
Stenning, K., & van Lambalgen, M. (2008). Human reasoning and cognitive science. Cambridge,
MA: MIT Press.
Störring, G. (1908). Experimentelle Untersuchungen über einfachen Schlussprozesse. Archiv
für die gesamte Psychologie, 11, 1–27.
Tenenbaum, J. B., & Griffiths, T. L. (2001). Generalization, similarity, and Bayesian inference.
Behavioral and Brain Sciences, 24, 629–640.
42 P. N. Johnson-Laird and Sangeet S. Khemlani
Tversky, A., & Kahneman, D. (1973). Availability: a heuristic for judging frequency and
probability. Cognitive Psychology, 5, 207–232.
Tversky, A., & Kahneman, D. (1983). Extensional versus intuitive reasoning: the conjunction
fallacy in probability judgment. Psychological Review, 90, 292–315.
Vandierendonck, A., Dierckx, V., & De Vooght, G. (2004). Mental model construction in
linear reasoning: evidence for the construction of initial annotated models. Quarterly
Journal of Experimental Psychology, A, 57, 1369–1391.
Verschueren, N., Schaeken, W., & d’Ydewalle, G. (2005). A dual-process specification of
causal conditional reasoning. Thinking & Reasoning, 11, 278–293.
Walsh, C., & Johnson-Laird, P. N. (2004). Co-reference and reasoning. Memory & Cognition,
32, 96–106.
Waltz, J. A., Knowlton, B. J., Holyoak, K. J., Boone, K. B., Mishkin, F. S., et al. (1999). A system
for relational reasoning in human prefrontal cortex. Psychological Science, 10, 119–125.
Xu, F., & Spelke, E. S. (2000). Large number discrimination in 6-month-old infants. Cognition,
74B, 1–11.
Yang, Y., & Johnson-Laird, P. N. (2000). Illusions in quantified reasoning: how to make the
impossible seem possible, and vice versa. Memory & Cognition, 28, 452–465.
CHAPTER TWO
Contents
1. Introduction: The “Centipede’s Dilemma” of Interaction Research 44
2. An Example Theoretical Debate and the Need for Integration 46
3. Self-Organization and Human Interaction 49
3.1. The Need to Integrate Accounts of Cognition in Linguistic Interaction 49
3.2. Dynamics, Self-organization, and All that Jazz 50
3.2.1. Complex System 51
3.2.2. Self-Organization 53
3.2.3. Synergies and the Reduction of Degrees of Freedom 54
3.3. Summary, Social Modulation, and Multimodal Coordination 55
3.3.1. Social Modulation of Cognitive Dynamics 56
3.3.2. Coordination, Complementarity, Synergies 56
4. Cognitive Dynamics under Social Constraints 57
4.1. Social Modulation of the Dynamics of Low-Level Visual Attention 57
4.2. Social Modulation of Higher Level Processes, Like Perspective-Taking 60
4.3. Perspective-Taking as Self-Organization under Social Constraint 63
5. Coordination, Complementarity, and Interactive Performance 68
5.1. Behavioral Synchrony and Interactive Alignment 69
5.2. An Alternative Model: Interpersonal Synergies 71
5.2.1. Complementarity 72
5.2.2. Interactional Patterns 73
5.3. Testing Models of Linguistic Coordination: Alignment and Synergy 74
5.4. Interpersonal Synergies: A Summary 77
6. Conclusion: Time for More Models 77
6.1. Summary77
6.2. Moving Forward: Models of These Processes 78
6.3. Surface Network Analysis, and Mechanistic Models 78
6.4. Conclusion84
Acknowledgments84
References84
Abstract
We describe a “centipede’s dilemma” that faces the sciences of human interaction.
Research on human interaction has been involved in extensive theoretical debate,
although the vast majority of research tends to focus on a small set of human behaviors,
cognitive processes, and interactive contexts. The problem is that naturalistic human
interaction must integrate all of these factors simultaneously, and grander theoretical
mitigation cannot come only from focused experimental or computational agendas.
We look to dynamical systems theory as a framework for thinking about how these
multiple behaviors, processes, and contexts can be integrated into a broader account
of human interaction. By introducing and utilizing basic concepts of self-organization
and synergy, we review empirical work that shows how human interaction is flexible
and adaptive and structures itself incrementally during unfolding interactive tasks, such
as conversation, or more focused goal-based contexts. We end on acknowledging
that dynamical systems accounts are very short on concrete models, and we briefly
describe ways that theoretical frameworks could be integrated, rather than endlessly
disputed, to achieve some success on the centipede’s dilemma of human interaction.
and builds common representational states across individuals while they talk
(Garrod & Pickering, 2004; Pickering & Garrod, 2004). Some have taken
the suggestion of a human “mirror system” to be central, specifying core
social processes that must be in place for us to interact successfully (for
review, see Gallese, 2008). Recent accounts have articulated the important
role of executive function during conversation (Brown-Schmidt, 2009a,b),
of memory (Horton, 2005; Horton & Gerrig, 2005), and of the integration
of basic contextual parameters of an interaction (Brennan et al., 2010). Still
others have identified kinds of coordination, such as the emergent versus
nonemergent linguistic interaction that see different origins in activities
done jointly (Knoblich, Butterfill, & Sebanz, 2011).
We see at least three exciting characteristics to this growing litera-
ture. First, researchers in these areas are beginning to tap into the cogni-
tive mechanisms that might underlie social and linguistic interaction (e.g.
Brown-Schmidt, 2009a,b; Gambi & Pickering, 2011; Horton, 2005; Mehler,
Weiß, Menke, & Lücking, 2010; Pickering & Garrod, 2009; Reitter, Keller, &
Moore, 2011). This advances the valuable work on observational and con-
versation analysis that has shed great light on the structure of interaction
(Sacks, Jefferson, & Schegloff, 1995; Schegloff, 2007), but is not capable of
identifying the cognitive processes that drive it.1
Secondly, and relatedly, social cognitive neuroscience (e.g. Frith &
Frith, 2001; Van Overwalle, 2008) and related areas (e.g. imitation: Wang &
Hamilton, 2012) have begun to explore these basic mechanisms at the level
of the brain. The growth of this subfield of cognitive neuroscience has been
very rapid, with many programmatic proposals for studying the circuits
underlying social interaction (e.g. Cooper, Catmur, & Heyes, 2012; Dumas,
Chavez, Nadel & Martinerie, 2012; Hasson, Ghazanfar, Galantucci, Garrod,
& Keysers, 2012; Konvalinka & Roepstorff 2012; Wolpert, Doya, & Kawato,
2003).
Thirdly—and this should sound odd—researchers have come to embrace
the inherent social nature of language and to carry out investigations of
cognitive processing in more naturalistic circumstances (see Tanenhaus &
Brown-Schmidt, 2008 and Fusaroli & Tylén, 2012 for a review). The past
century has seen some fundamentally different assumptions for a scien-
tific understanding of language. For example, the classic conception of the
ideal speaker–hearer, perhaps useful in some circumscribed domains, is an
1 Although the brilliant corpus strategies used by researchers like Bard, Aylett, and others can reveal
substantial clues about cognitive mechanism through, for example, acoustic properties of what one
person says to another (see, e.g. Bard & Aylett, 1999; Bard et al., 2000).
48 Rick Dale et al.
assumption that has outlived any usefulness it may have had in understand-
ing how people actually use language in so wide a circumstance. Con-
versation analysis and discourse psychology have now been coupled with
sophisticated computational and behavioral methods such as natural lan-
guage processing and computational linguistics (Graesser, Swamer, & Hu,
1997), eye-tracking (Tanenhaus, Spivey-Knowlton, Eberhard, & Sedivy,
1995), automated body movement (Paxton & Dale, in press; Schmidt, Morr,
Fitzpatrick, & Richardson, 2012) and acoustic analysis (Oller et al., 2010;
Wyatt, Bilmes, Choudhury, & Kitts, 2008), dynamical systems methods
(Riley & Van Orden, 2005; Shockley, Santana, & Fowler, 2003), and more.
Language is a complex and multidimensional activity, and our understand-
ing of it—how it evolved, is learned, and is used—must come from inte-
grating such sophisticated methods in naturalistic circumstances, not only
from abstract assumptions about linguistic structure that rarely manifest
themselves except in preempirical intuitions.
Although these are exciting developments, we would argue that theoreti-
cal integration has been less emphasized. We can think of a few reasons why
this might be. For one, a researcher’s theoretical proposals are usually tied to
the specific contexts she or he studies. This is a natural feature of any scien-
tific explanation (see Cartwright, 1999), but it limits the generalizability of
the processes proposed. The very fact, for example, that language users can
be rendered relatively egocentric, or relatively “other-centric,” by experi-
mental design means that something more complex is going on cognitively
than simply the deployment of fixed architectures (see also Brennan et al.,
2010 for discussion). Another reason, in our opinion, is that the multidi-
mensional and “multimechanism” aspect of human interaction means that
traditional conceptions of cognitive explanations are fundamentally chal-
lenged. In such a complex circumstance, theories seem unlikely to succeed
by anchoring to small set of specific mechanisms, but rather to a context-
dependent integration of a wide variety of processes acting together. This is
what we mean by the “centipede’s dilemma”: there tends to be much local
and circumscribed analysis and much less cross-paradigm and intertheoreti-
cal synthesis.
We introduce one way that approaches integration. Specifically, we
look to the tools offered by what is often termed the “dynamical systems”
approach in cognitive science (Chemero, 2009; Port & Van Gelder, 1995;
Richardson, Dale, & Marsh, in press; Spivey, 2007; Thelen & Smith, 1994;
Turvey, 1990; more on this below). A dynamical approach to these phenom-
ena affords a variety of theoretical tools that embrace context-dependent
The Self-organization of Human Interaction 49
articles, have described the vocabulary as “Star Wars terminology”. Readers may have other examples.
The Self-organization of Human Interaction 51
somewhere. Readers wishing to have pure operationalized definitions of all things can consult the
success of Rudolf Carnap’s early-20th-century attempt to do so. One of the authors would wager that
readers recognize this attempt in proportion to the success of it.
52 Rick Dale et al.
Wu & Keysar, 2007), social status adaptation (Duran & Dale, 2011), execu-
tive control (Brown-Schmidt, 2009a,b), priming processes and alignment
(Garrod & Pickering, 2004), the mirror neuron system (Gallese, 2008), for-
ward models of social and linguistic prediction (Pickering & Garrod, in
press), rich common ground representations (Clark, 1996), socially guided
attention (Kingstone, Smilek, Ristic, Friesen, & Eastwood, 2003), percep-
tuomotor linkages (Shockley, Richardson, & Dale, 2009), and even processes
at various linguistic levels such as perception of accent (Lev-Ari & Keysar,
2010) and lexical (Bortfeld & Brennan, 1997; Brennan & Clark, 1996;
Niederhoffer & Pennebaker, 2002) and syntactic choice (Branigan,
Pickering, & Cleland, 2000; Branigan, Pickering, Stewart, & McLean, 2000).
Treated as a system of intersecting mechanisms, our language capac-
ity appears quite complicated. In the parlance of researchers who embrace
dynamics and complexity science, this complex system is unlikely to be con-
trolled by a central “homunculus”. No theory of our language capacity
has proposed such a central executive that simultaneously integrates all of
these mechanisms. For example, emerging models of sentence processing
imply that, even at just this processing level, central processing cannot alone
account for our success, and an explanation must derive from exploring
the dynamic relationship between memory retrieval, working memory, and
focal attention (e.g. Lewis, Vasishth, & Van Dyke, 2006; McElree, 2006;
Raczaszek-Leonardi, 2010). In the domain of motor control, where
dynamical systems have been and continue to be highly influential, this is
sometimes referred to as “Bernstein’s problem” or the “degrees of freedom
problem” (Turvey, 1990). If the components making up our language sys-
tem are truly modular, there are simply too many ways in which our overall
language system can change, with each mechanism flailing about unto itself
unless it is somehow anchored to other processes around it. Put simply,
there are too many degrees of freedom in this system for it to be managed
by a single control process. These many proposed mechanisms must some-
how influence each other, directly and continually, in order for language to
function in naturalistic circumstances. In any one experiment, we focus on
a very deliberately narrowed set of controlling variables and identify their
influence on a very specific set of resultant behaviors. Such is the justifiable
nature of experimental science.
Naturalistic language performance seems very unlikely to be based on
a single control process. Somehow, our system integrates all of these com-
ponents simultaneously. There are, at present, a limited number of theo-
ries for how this is accomplished (although see, for the closest current
The Self-organization of Human Interaction 53
3.2.2. Self-Organization
So if there is not a control process that “calculates the positions” of all
mechanisms (working memory, social judgment, visual attention, etc.), then
there must be some other means by which we can understand how they
function together. A process that contrasts with the presence of a central
controller is self-organization. Without a central control process, the mecha-
nisms must mutually constrain each other to behave (in whole) as a stable
performance. There are plenty of natural examples that are often raised to
exemplify this concept (see Kauffman, 1996, for many examples). For exam-
ple, the behavior of a beehive, termite, or ant’s nest is not controlled by a
single entity but is a large self-organizing organism unto itself (see Seeley,
2010, and Richardson et al., in press, for more discussion).The same may be
true for human interaction.
This is often where things get heated between dynamical systems
researchers and other cognitive scientists. Isn’t working memory that exec-
utive controller? Clearly it cannot be because there is much more being
coordinated during conversation than just a handful of manipulated chunks
of information (and see note about sentence processing above). What about
process threading in working memory extended over time? Recent com-
putational models of complex cognitive control may be relevant here, but
even these require articulating the details of interacting components in the
system (see, e.g. Salvucci & Taatgen, 2008). Similarly, what we are suggesting
is that there may be “chains of influence” between processes of the cogni-
tive system that we tend not to explore. Whatever one’s favorite array of
4 Complex systems are also figured to involve interactions among components, which produce
collective higher level behaviors not reducible to properties of the components themselves. We
wish to avoid this debate here (“emergence” or “emergentism”), although it seems likely a natural
consequence of the perspective we describe here (see also Knoblich et al., 2011).
54 Rick Dale et al.
Bernstein’s solution has, in many respects, become standard in broad strokes, how it is solved can
be the subject of some debate (see, among many, Latash et al., 2007; Newell, Broderick, Deutsch, &
Slifkin, 2003; Todorov & Jordan, 2002; Turvey, 2007).
56 Rick Dale et al.
One framework for thinking about this, which we have outlined in brief
in the previous section, is to import the concepts of self-organization and
synergies into this discussion. Our reasoning is that there are far too many
degrees of freedom available to a dyad during conversational performance
for the cognitive system to compute their activities all at once. In the fol-
lowing sections, we offer extensive empirical review, looking to two general
features of this issue of conversational performance.
was also looking at the same images at the same time. Across all of these
levels, the researchers find a pervasive effect of social context on low-level
visual processes.
When two people are engaged in a conversation with each other, they
can display great sensitivity to each others’ thoughts and beliefs. But what
happens at a lower level of social context? Here, we look at the case where
the participant is merely a spectator, watching a prerecorded video of a
group of people and listening to one of them give their opinion. A standard
cognitive approach might be to focus on the words of the speaker and how
they are processed by the participant. But Crosby, Monin, and Richardson
(2008) looked at the relevance of the other people in the video, the silent
bystanders who provided a social context.
In their experiment, participants watched a video of four people giving
their views on Stanford University’s admissions policies. All four members
of the “focus group” could be seen on screen at the same time, in a grid
arrangement of cubicles, and they all wore headphones so they could hear
what each other said. At one point, the speaker in the top right corner com-
plained that, “certain groups who come from less privileged backgrounds…
get an unfair advantage.” At this point, participants routinely fixated a man
on the bottom row of the screen who was black. It appeared that partici-
pants were sensitive to the fact that the speakers’ words, criticizing policies
of affirmative action which would typically benefit black Americans, might
be offensive to members of that group.
A parsimonious explanation, however, is that the participants sim-
ply noticed the ethnicity of everyone at the start, and the speaker’s words
simply activated a memory of one person on the screen. This memory
trigger launches an eye movement, as memory representations often do
(Richardson, Dale, & Tomlinson, 2009; Richardson & Spivey, 2000). But
Crosby et al. (2008) were able to rule out this “association hypothesis”. In
another condition, before the speaker began talking, an offscreen voice said
that the headphones of people on the bottom row were being turned off.
Then the participants saw exactly the same video. The association hypoth-
esis predicted that since the black member of the focus group was still on
screen, he would still attract a fixation. In this case, however, participants
barely looked at him when the potentially offensive remarks were made.
Participants were supposed to be simply listening to the speaker’s words. But
these results show that they were also keeping track of the social identity of
all the other people on screen, monitoring whether or not they could hear
the speaker and, presumably, anticipating how each might respond to the
The Self-organization of Human Interaction 59
speaker’s words. In other words, for the participants, the cognitive task of
processing speech was embedded in a social context.
Other paradigms too have shown an effect of “social tuning” (Shteynberg,
2010; Shteynberg and Galinsky, 2011). In these paradigms, stimuli are
explicitly identified as being relevant by other people and as a consequence
are processed selectively by individuals. Recently, researchers have adapted
the Simon task and inhibition of return paradigms, splitting these cognitive
tasks between pairs of participants. The behavior of the pairs is remarkably
similar to the individuals’, showing the same patterns of response interfer-
ence (Knoblich et al., 2011). This work suggests that when participant act
jointly with each other, in a very simple social context, they immediately
represent each others’ tasks and goals.
The final set of experiments attempt to reduce social context to it low-
est level. Our strategy was to take a simple perceptual task that participants
carry out alone or jointly with another person and to make the difference
between those conditions as small as possible (Richardson et al., 2012). Pairs
of participants were sat in opposite corners of a laboratory room, each look-
ing up at a screen while their gaze was tracked (see Figure 2.1). On each
trial of the experiment, they saw four images on screen for 8 s. Beforehand,
Figure 2.1 Example context in which two people were given different beliefs about
what their “socially copresent” partner could see. Imagines of differing emotional
valence were presented. (Adapted with permission from Richardson et al. (2012)).
60 Rick Dale et al.
they were either told that both they and their partner would be looking at
the same images or that they would be looking at images and their partner
would be looking at symbols. Participants could not see each other and
could not interact at all. Nevertheless, when they thought that their current
perceptual experience was being shared with another, their eye movements
were systematically changed.They looked more toward pictures with a neg-
ative valance than when looking alone. We believe that people are doing
so because they each believe that the other person is looking more at the
negative images. At least, when participants are told that this is a memory
task and that they will score more points if they recall the same pictures as
their partners, they too look more at negative images (unpublished data).
When the images are replaced by album covers, people will look more at
classical albums when they are looking jointly, and their partner (a confed-
erate in this case) walked in carrying a violin (unpublished data). Across all
these experiments, we have found that even a minimal social context—the
belief that an unseen other was seeing the same stimuli—was enough to
manipulate an individuals’ visual processing.
From a rich interactive conversation to listening to one person against
a backdrop of bystanders, to gazing at images alone, believing that someone
else is too, social context can have a pervasive influence on visual attention
(Risko & Kingstone, 2011; Laidlaw et al., 2011). Under even subtle circum-
stances, people take into account each other’s knowledge and visual context
to coordinate their gaze around an empty display.They anticipate each others’
responses to potentially offensive remarks. And even with the thinnest slice of
social context, when there is no interaction or contact between people, they
will still shift their gaze toward where they think each other is looking. Impor-
tantly, this process occurs when the variables are in the right arrangement—for
example, when the unintended recipient of the offensive remark can hear it.
2000
Them
1700
1550
1400
0 90 180
You
Relative rotation (ego vs. other)
Figure 2.2 When participants are asked to retrieve a folder in an “ostensibly social” com-
puter task as shown on the left, they tend to exhibit different mental rotation functions,
predicted by whether they are taking theirs or another person’s perspective. When the
ostensible partner asks for a folder in ambiguous trials (left), participants taking the
other perspective exhibit a mental rotation function (right). Figure based on the designs
and typical mental rotation results found in Duran & Dale (in press), Duran et al. (2011),
and originally of course the classic Schober (1993).
neural process, akin to a population code (top row of Figure 2.3), one can
derive a direct visualization in lower dimensions of how the system is
transitioning between stable states (bottom row of Figure 2.3). Self-
organization into “other” or “ego” perspectives can be seen as traversing a
low-dimensional landscape.
In the current instantiation of the model, a control parameter in a poten-
tial function is set to initiate bistable attractor basins of other-centric or
egocentric interpretations. These basins are a reduction of system complex-
ity to a quantifiable and transparent outcome variable of the two perspective
types. In other words, perspective-taking is characterized as in a system of
substantially reduced degrees of freedom, a “lower dimensional” cognitive
space in which choices are made. The particular shape of each basin cor-
responds to the likelihood and speed in which the system can settle into a
particular response, with deeper and steeper basins indicating a stronger pull
and therefore more rapid stabilization. During the time course of a single
trial, “settling” occurs through nonlinear competition between landscape
shape, initial conditions (i.e. starting position in the landscape), and a subtle
noise impulse. When a response threshold is met, the control parameter is
adjusted, and a new trial is allowed to run. This is analogous to updating a
belief about one’s partner being real or simulated at the end of each trial,
with beliefs becoming stronger and more stable over time. In doing so, the
global characteristics of response choice stability are captured, as well as
the competition effects that influence the moment-by-moment processes
involved in response execution. By capturing the response dynamics also
exhibited by human participants, simple social constraints, in the form of
belief attributions, are essential pieces of information that bias a system’s
“perspectival” landscape and thus its eventual behavioral strategy (see exam-
ples in Figure 2.3).
Figure 2.4 shows the timing and response characteristics of data seen in
Duran and Dale (in press) and Duran et al. (2011). In the top left, a represen-
tative response histogram of this task is shown. The model can capture two
stable strategies, namely as attractors in the lower dimensional landscape.
Models of this kind naturally display organization in the form of two stable
“modes” or strategies. The bottom left panel shows that, over trials, humans
display a drop in reaction time across trials, but more so for ego versus
other reaction times. Finally, the panel to the right shows a zooming into
the very dynamics of responses. Subjects often show faster more direct ego
trajectories; if they are responding using the other-centric perspective, their
mouse movement trajectories tend to show more curvature.These are three
The Self-organization of Human Interaction 67
(a)
Across subjects
(c)
# subjects
Target Comp.
(b)
Other trajectory
Ego trajectory
Other subjects
RT
Ego subjects
by the other is not even possible, the “afforded” response is to assume the
other’s perspective in interpreting their ambiguous instructions.
Such spontaneous perspective-taking occurs despite enacting increased
cognitive demands. However, demand is minimized in communication
where assessments about a partner can be reduced to simple alternatives,
such as whether a conversational partner is very young or not or has a lan-
guage disorder that changes the goals of mutual understanding (Newman-
Norlund et al., 2009; Perkins & Milroy, 1997). Of course, reciprocal and
emergent constraints occur during the course of an interaction that sub-
sumes any individual-level sources of difficulty. The dyad operates as a unit
that collaboratively minimizes processing load, with success depending on
the level of coordination shared between the language users (Fusaroli et al.,
2012; Louwerse et al., 2012).
videotape, showed that participants shook their foot more in the presence
of the foot-shaking confederate and rubbed their faces more in the pres-
ence of the face-rubbing confederate. Debriefing indicated that participants
were unaware of their mimicry. Analogously, facial expressions, gestures, and
yawns have been observed to spread across interlocutors and around a room
(Louwerse et al., 2012; Platek, 2010).
Pickering and Garrod have argued that mimicry is commonly co-
opted in linguistic interactions through what is called “interactive linguistic
alignment”: interlocutors tend to imitate each other’s choice of linguis-
tic forms. Participants primed with a specific syntactic structure are more
likely to produce new sentences employing the same syntactic structure
under circumstances in which alternative nonsyntactic explanations could
be excluded (Bock, 1986; Branigan et al., 2000; Gries, 2005; Hartsuiker &
Westenberg, 2000; Levelt & Kelter, 1982; Pickering & Branigan, 1999;
Smith & Wheeldon, 2001; Szmrecsanyi, 2005, 2006). Analogously, topics
(Angus, Smith, & Wiles, 2012; Angus,Watson, Smith, Gallois, & Wiles, 2012)
and lexical choices (Brennan & Clark, 1996; Clark & Wilkes-Gibbs, 1986;
Garrod & Anderson, 1987; Garrod & Clark, 1993; Garrod & Doherty,
1994; Orsucci, Giuliani, & Webber, 2006; Orsucci, Giuliani, & Zbilut, 2004;
Orsucci, Walter, Giuliani, Webber, & Zbilut, 1997; Wilkes-Gibbs & Clark,
1992) tend to be imitated across interlocutors. Linguistic alignment can also
be found at more subtle levels of linguistic coordination: interlocutors align
accent and speech rate (Giles, Coupland, & Coupland, 1991). More recently,
a lot of effort has also been put in showing that the organization of pauses
in and between interlocutors’ speech and their average pitch, intensity, and
voice quality tend to become similar over time (De Looze & Rauzy, 2012;
Kousidis & Dorran, 2009; Lee et al., 2010; Lelong & Bailly, 2011; Levitan &
Hirschberg, 2011; Nishimura, Kitaoka, & Nakagawa, 2008; Pardo, Gibbons,
Suppes, & Krauss, 2011;Truong & Heylen, 2012; Vaughan, 2011). In a single
conversation, many of these channels will be aligned, as recently shown in
a massive study by Louwerse et al. (2012). These channels have been argued
not to be independent. On the contrary, aligning on one channel in many
cases seems to facilitate alignment on others. For instance, syntactic priming
is enhanced when the same lexical items or even just semantically related
ones are also repeated (Branigan, Pickering, & Cleland, 2000; Branigan,
Pickering, Stewart, et al., 2000; Cleland & Pickering, 2003).
Several mechanisms have been proposed to underlie these phenom-
ena: most researchers seem to agree on an unconscious priming mecha-
nisms, a “perception–action link” (Chartrand & Bargh, 1999; Dijksterhuis &
The Self-organization of Human Interaction 71
The rest of this section will argue that linguistic coordination is achieved
through interpersonal synergies, that is, through functionally driven reduc-
tion of the degrees of freedom involved in the interaction. This approach
does not dispense with alignment but introduces additional mechanisms—
complementarity and interactional patterns—and integrates alignment with
this dynamical inspired perspective.
5.2.1. Complementarity
Several studies have pointed out that interlocutors strive to complement
each other’s behavior to develop a structured conversation. For example,
turn-taking seems one of the most elementary examples of complementar-
ity: a remarkable—and seemingly universal (Sidnell & Enfield, 2012; Stivers
et al., 2009)—ability of humans to not do the same thing at the same time,
that is, stay quiet when the other speaks. Simultaneous starts are reported to
be surprisingly rare in dyadic conversations ( Jefferson, 1988), even if more
than 50% of the pauses between interlocutors are below the usual threshold
for reactions (300 ms). Wilson and Wilson (2005) have been developing a
model of turn-taking that explains this fine-tuned complementarity: the
beginning of an interaction sets up an oscillator in each of the interlocu-
tors’ cognitive systems establishing a shared frequency of speech rate (see
also Buder & Eriksson, 1999). This cyclic pattern governs the potential for
initiating speech at any given instant for both interlocutors. The interlocu-
tors, in other words, have to keep the same pace (alignment). However, if
the oscillators were simply entrained in phase, simultaneous starts would be
frequent.Therefore, the oscillators must be entrained in antiphase, giving the
participants both a common rhythm, constituted by speech rate and length
of comfortable pauses, and complementarity—readiness to take the floor
must be opposite at any given moment for speaker and hearer. This ability
seems to appear at a very early developmental stage (Gratier & Devouche,
2011; Murray & Trevarthen, 1985; Nadel, Carchon, Kervella, Marcelli, &
Réserbat-Plantey, 1999; Spurrett & Cowley, 2004; Warlaumont, 2012).
Recent work on conversations involving patients with speech impairment
further shows the importance of complementarity. Expert interlocutors—for
example, family members—tend to engage compensatory procedures to keep
the conversation fluent despite the impairment (Dressler, Buder, & Cannito,
2009; Goodwin, 2003, 2011; Wilkinson, Beeke, & Maxim, 2003). For exam-
ple, Goodwin reports on Chil, who, after having suffered a severe stroke, can
only speak three words: “yes,” “no,” and “and”. Despite this clear impairment,
Chil is able to engage in complex conversations by coordinating other people’s
The Self-organization of Human Interaction 73
Figure 2.5 Interactive perceptual detection task. (a) Participants both view noisy stim-
uli and can communicate regarding the presence of a target. (b) The sequence of events
in the task from stimulus presentation to the presentation of feedback. Trials began with
two stimulus intervals, which contained Gabor patches, with one of them appearing
quickly during one of the intervals, and participants had to guess which one. If their
decisions did not match, they were required to negotiate about it and come to an agree-
ment. (Image adapted with permission from Bahrami et al. (2010)).
Figure 2.6 Results from the alignment of word usage during the task. The Collective
Benefit (y-axis) is a measure of how much dyads benefited from their interaction; local
linguistic alignment was a benefit (right plot); however, rampant widespread “indiscrim-
inate” alignment predicted a drop in joint performance (left plot). (Adapted with permis-
sion from Fusaroli et al. (2012)).
The Self-organization of Human Interaction 77
manner that is shaped by these social variables. But how do these lower level
processes constrain each other and act together? Akin to the centipede’s
dilemma, rather than understanding the interaction “leg by leg by leg,”
we entertained the notion of a synergy between interacting human beings:
the behaviors—turn-taking and rhythms, use of particular words, emer-
gence of adjacency pairs, and so on—can be seen as an array of levels that
are mutually constraining, and dynamically evolving, as two people come
to form in an important way, a “unit of analysis,” and the interaction itself a
stable, if temporary, synergy itself. Perspective-taking might be seen as part
of this synergetic process, shifting from allo- to egocentric or vice versa, as
the interlocutors enact or develop coordinative routines.
6 Here, we are using “degree of freedom” in a very informal way, simply to specify whether a channel,
or set of channels, is “free to vary” or whether they constrain each other in some fashion. Of course,
network analysis can involve gradient aspects of these couplings, but we ignore this for simplicity here.
80
D
C
B
A
D
C
B
A
0 50 100 150 200 250 300 350 400 450 500
D
Person 2
C
B
Behaviors
D
Person 1
C
B
A
0 50 100 150 200 250 300 350 400 450 500
Time (250 ms interval)
Figure 2.7 Simulated point processes of behavioral events. “Person 1” and “Person 2” have four behavioral dimensions (A–D). In human data,
these would correspond to delimitable actions such as nods, laughter, or gesture (Louwerse et al., 2009, 2012). Across time, these events
occur and may serve to coordinate behavior both within and across modeled processes. In the top plot, all processes are random; in the bot-
tom, there is a greater probability of “alignment” (e.g. Person 1’s A occurring with Person 2’s A). This may not be evident by mere visualization,
82
D C D C D C
A B A B A B
D C D C D C
Person 1
A B A B
Saturation Transition
D C D C
A B A B
D C D C
Figure 2.8 An illustration of different graph (network) structures induced from different interrelationships among simulated point processes
(Person 1 and Person 2). On the top left, only very light gray edges reflect a weak connection across all pairs of nodes (no behaviors are
6.4. Conclusion
We have not advocated for an approach that supplants existing theoretical
accounts of interaction. The role of memory (Horton, 2005), executive
control (Brown-Schmidt, 2009a,b), alignment and priming processes
(Pickering & Garrod, 2004), coordination and adaptation (Brennan et al.,
2010; Schober & Brennan, 2003), perceptuomotor coupling (Richardson
et al., 2009; Shockley et al., 2003), accessibility accounts (Barr & Keysar, 2002),
and so on, are all crucial for accounting for interacting persons. Although the
authors of this article may wrestle with each other on this grander point,
it seems instructive to proclaim that all of these theories have central contri-
butions to play in accounting for interaction. One major, and very simple,
reason for this could be advanced in the following way: These theories have
been usefully deployed in specific experimental contexts investigated by the
researchers who have advocated for them. This means that they have strong
empirical backing in some subset of human interactive situations; a corollary
of this is that they are predictive of human interaction in similar situations.
We have argued that it is time to integrate, to go beyond the centipede’s
dilemma, and gain an understanding of the manner in which processes coor-
dinate and act together. Motivated by basic concepts of self-organization
and synergy, we described a series of experiments that show the flexibil-
ity of human interaction. Under different social situations, low- and high-
level cognitive processes flexibly adapt. Under d ifferent task conditions, the
dyad self-organizes through local exchanges, incrementally emerging, that
develop whole new “synergies”. By exploring the structure and underlying
control mechanisms, perhaps an integration of these theories will be pos-
sible. We haven’t done this here, but we have provided some clues that seem
useful to us. We hope some readers feel the same way.
ACKNOWLEDGMENTS
This research was supported in part by NSF grants BCS-0826825 and a Minority Postdoctoral
Research Fellowship (to the third author), and in part by the Danish Council for Independent
Research - Humanities (FKK) project “Joint Diagrammatical Reasoning in Language”, and the
EUROCORES grant EuroUnderstanding “Digging for the Roots of Understanding”.
REFERENCES
Ambady, N., Bernieri, F. J., & Richeson, J. A. (2000). Toward a histology of social behavior:
judgmental accuracy from thin slices of the behavioral stream. In Mark P. Zanna (Ed.),
Advances in experimental social psychology (Vol. 32, pp. 201–271). Academic Press.
Angus, D., Smith, A., & Wiles, J. (2012). Human communication as coupled time series:
quantifying multi-participant recurrence. IEEE Transactions on Audio, Speech and Language
Processing, 20, 1795–1807.
The Self-organization of Human Interaction 85
Angus, D., Watson, B., Smith, A., Gallois, C., & Wiles, J. (2012). Visualising conversation
structure across time: insights into effective doctor-patient consultations. PLoS ONE, 7,
e38014. http://dx.doi.org/10.1371/journal.pone.0038014.
Bahrami, B., Olsen, K., Latham, P. E., Roepstorff, A., Rees, G., & Frith, C. D. (2010). Optimally
interacting minds. Science, 329, 1081–1085. http://dx.doi.org/10.1126/science.1185718.
Bard, E. G., & Aylett, M. P. (1999). The dissociation of deaccenting, givenness, and syntactic
role in spontaneous speech. In Proceedings of the 1999 International Conference on
Spoken Language Processing (pp. 1753–1756).
Bard, E. G., Anderson, A. H., Sotillo, C., Aylett, M., Doherty-Sneddon, G., & Newlands, A.
(2000). Controlling the intelligibility of referring expressions in dialogue. Journal of
Memory and Language, 42(1), 1–22.
Barr, D. J. (2008). Pragmatic expectations and linguistic evidence: listeners anticipate but do
not integrate common ground. Cognition, 18–40.
Barr, D. J., & Keysar, B. (2002). Anchoring comprehension in linguistic precedents. Journal of
Memory and Language, 46(2), 391–418.
Bechtel, W. (1997). Representations and cognitive explanations: assessing the dynamicist’s
challenge in cognitive science. Cognitive Science, 22(3), 295–318.
Bergmann, K., & Kopp, S. (2009). GNetIc–Using bayesian decision networks for iconic ges-
ture generation. In Intelligent virtual agents (pp. 76–89).
Bernstein, N. A. (1967). Coordination and regulation of movement. New York: Pergamon Press.
Bicknell, K., & Levy, R. (2010). A rational model of eye movement control in reading. In
Proceedings of the 48th annual meeting of the association for computational linguistics (pp. 1168–1178).
Bock, J. K. (1986). Syntactic persistence in language production. Cognitive Psychology, 18, 355–387.
Bortfeld, H., & Brennan, S. E. (1997). Use and acquisition of idiomatic expressions in refer-
ring by native and non‐native speakers. Discourse Processes, 23(2), 119–147. http://dx.doi.
org/10.1080/01638537709544986.
Branigan, H. P., Pickering, M. J., & Cleland, A. A. (2000). Syntactic co-ordination in dialogue.
Cognition, 75, 13–25.
Branigan, H. P., Pickering, M. J., Pearson, J., McLean, J. F., & Brown, A. (2011). The role of
beliefs in lexical alignment: evidence from dialogs with humans and computers. Cogni-
tion, 121(1), 41–57. http://dx.doi.org/10.1016/j.cognition.2011.05.011.
Branigan, H. P., Pickering, M. J., Stewart, A. J., & McLean, J. F. (2000). Syntactic priming
in spoken production: linguistic and temporal interference. Memory and Cognition, 28,
1297–1302.
Brennan, S. E., & Clark, H. H. (1996). Conceptual pacts and lexical choice in conversation.
Journal of Experimental Psychology. Learning, Memory, and Cognition, 22, 1482–1493.
Brennan, S. E., Galati, A., & Kuhlen, A. K. (2010). Two minds, one dialog: coordinating
speaking and understanding. Psychology of Learning and Motivation, 53, 301–344.
Brennan, S. E., & Hanna, J. E. (2009). Partner-specific adaptation in dialog. Topics in Cognitive
Science, 1(2), 274–291.
Brown-Schmidt, S. (2009a). Partner-specific interpretation of maintained referential prec-
edents during interactive dialog. Journal of Memory and Language, 61(2), 171–190.
Brown-Schmidt, S. (2009b). The role of executive function in perspective taking during
online language comprehension. Psychonomic Bulletin & Review, 16(5), 893–900.
Brown-Schmidt, S., & Tanenhaus, M. K. (2008). Real-time investigation of referential
domains in unscripted conversation: a targeted language game approach. Cognitive Sci-
ence, 32(4), 643–684. http://dx.doi.org/10.1080/03640210802066816.
Brown-Schmidt, S., Gunlogson, C., & Tanenhaus, M. K. (2008). Addressees distinguish shared
from private information when interpreting questions during interactive conversation.
Cognition, 107(3), 1122–1134.
Brown-Schmidt, S., & Hanna, J. E. (2011). Talking in another person’s shoes: Incremental
perspective-taking in language processing. Dialogue & Discourse, 2(1), 11–33.
86 Rick Dale et al.
Buder, E. H., & Eriksson, A. (1999). Time-series analysis of conversational prosody for the
identification of rhythmic units. Proceedings of the 14th international congress of phonetic sciences,
(Vol. 2, pp. 1071–1074). Retrieved from: http://www.ling.gu.se/∼anders/papers/1071.pdf.
Busch, M. W. (2007). Task-based pedagogical activities as oral genres: a systemic functional
linguistic analysis. ProQuest.
Carruthers, P. (2002). The cognitive functions of language. Behavioral and Brain Sciences,
25(06), 657–674.
Cartwright, N. (1999). The dappled world. Cambridge, UK: Cambridge University Press.
Chartrand, T. L., & Bargh, J. A. (1999). The chameleon effect: the perception-behavior link
and social interaction. Journal of Personality and Social Psychology, 76, 893–910.
Chartrand, T. L., & Van Baaren, R. (2009). Human mimicry. Advances in Experimental Social
Psychology, 41, 219–274.
Chemero, A. (2009). Radical embodied cognitive science. MIT Press.
Clark, H. H. (1996). Using language. Cambridge University Press.
Clark, H. H., & Brennan, S. E. (1991). Grounding in communication. In L. B. Resnick (Ed.),
Perspectives on socially shared cognition (pp. 127–149). Washington: American Psychological
Association.
Clark, H. H., & Krych, M. A. (2004). Speaking while monitoring addressees for understand-
ing. Journal of Memory and Language, 50(1), 62–81.
Clark, H. H., & Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition,
22(1), 1–39.
Cleland, A. A., & Pickering, M. J. (2003). The use of lexical and syntactic information in
language production: evidence from the priming of noun- phrase structure. Journal of
Memory and Language, 49, 214–230.
Cooper, R. P., Catmur, C., & Heyes, C. (2012). Are automatic imitation and spatial compat-
ibility mediated by different processes? Cognitive Science.
Crosby, J. R., Monin, B., & Richardson, D. (2008). Where do we look during potentially
offensive behavior? Psychological Science, 19(3), 226–228.
Dale, R. (2008).The possibility of a pluralist cognitive science. Journal of Experimental & Theo-
retical Artificial Intelligence, 20(3), 155–179.
Dale, R. (2010). Critique of radical embodied cognitive science. Journal of Mind and Behavior,
31, 127-140.
Dale, R., & Louwerse, M. M. (2012). Human interaction as a multimodal network structure.
Presented at the Conceptual Structures, Discourse, and Language.
Dale, R., Warlaumont, A. S., & Richardson, D. C. (2011). Nominal cross recurrence as a gen-
eralized lag sequential analysis for behavioral streams. International Journal of Bifurcation
and Chaos, 21, 1153-1161.
De Jaegher, H., Di Paolo, E., & Gallagher, S. (2010). Can social interaction constitute social
cognition? Trends in Cognitive Sciences, 14(10), 441–447.
De Looze, C., & Rauzy, S. (2012). Measuring speakers’ similarity in speech by means of
prosodic cues: methods and potential (pp. 1393–1396). Presented at the interspeech 2011.
Di Paolo, E., & De Jaegher, H. (2012). The interactive brain hypothesis. Frontiers in Human
Neuroscience, 6. http://dx.doi.org/10.3389/fnhum.2012.00163.
Dijksterhuis, A., & Bargh, J. A. (2001). The perception-behavior expressway: automatic effects
of social perception on social behavior. Advances in Experimental Social Psychology, 33, 1–40.
Dixon, J. A., & Stephen, D. G. (2012). Multi-scale interactions in dictyostelium discoideum
aggregation. Physica A: Statistical Mechanics and Its Applications. Retrieved from: http://
www.sciencedirect.com/science/article/pii/S0378437112006280.
Dixon, J. A., Stephen, D. G., Boncoddo, R., & Anastas, J. (2010). The self-organization of
cognitive structure. Psychology of Learning and Motivation, 52, 343–384.
Dressler, R. A., Buder, E. H., & Cannito, M. P. (2009). Rhythmic patterns during conversa-
tional repairs in speakers with aphasia. Aphasiology, 23, 731–748.
The Self-organization of Human Interaction 87
Dumas, G., Chavez, M., Nadel, J., & Martinerie, J. (2012). Anatomical connectivity influences
both intra- and inter-brain synchronizations. PLoS One, 7(5), e36414.
Duran, N. D., & Dale, R. (in press). Perspective-taking in dialogue as self-organization under
social constraints. New Ideas in Psychology.
Duran, N. D., Dale, R., & Kreuz, R. J. (2011). Listeners invest in an assumed other’s perspec-
tive despite cognitive cost. Cognition, 121, 22–40.
Eliasmith, C. (1996). The third contender: a critical examination of the dynamicist theory of
cognition. Philosophical Psychology, 9(4), 441–463.
Eliasmith, C. (2012). The complex systems approach: rhetoric or revolution. Topics in Cogni-
tive Science, 4(1), 72–77. http://dx.doi.org/10.1111/j.1756-8765.2011.01169.x.
Engstrom, D. A., Kelso, J. A., & Holroyd, T. (1996). Reaction-anticipation transitions in
human perception-action patterns. Human Movement Science, 15(6), 809–832.
Epley, N., Keysar, B., Van Boven, L., & Gilovich, T. (2004). Perspective taking as egocentric
anchoring and adjustment. Journal of Personality and Social Psychology, 87(3), 327.
Fowler, C. A., Richardson, M. J., Marsh, K. L., & Shockley, K. (2008). Language use,
coordination, and the emergence of cooperative action. In A. Fuchs & V. Jirsa (Ed.),
Coordination: Neural, behavioral and social dynamics. Springer.
Frank, T. D., Richardson, M. J., Lopresti-Goodman, S. M., & Turvey, M. T. (2009). Order
parameter dynamics of body-scaled hysteresis and mode transitions in grasping behavior.
Journal of Biological Physics, 35(2), 127–147.
Frith, U., & Frith, C. (2001). The biological basis of social interaction. Current Directions in
Psychological Science, 10(5), 151–155.
Fusaroli, R., Abney, D. H., Bahrami, B., Kello, C., & Tylén, K. (submitted). Conversation,
coupling and complexity: Matching Scaling Laws Predict Performance in a Joint Deci-
sion Task.
Fusaroli, R., Bahrami, B., Olsen, K., Roepstorff, A., Rees, G., Frith, C., & Tylén, K. (2012).
Coming to terms quantifying the benefits of linguistic coordination. Psychological science,
23(8), 931–939.
Fusaroli, R., Raczaszek-Leonardi, J., & Tylén, K. (in press). Dialogue as interpersonal synergy.
New Ideas in Psychology.
Fusaroli, R., & Tylén, K. (2012). Carving language for social interaction: a dynamic approach.
Interaction Studies, 13, 103–123.
Fusaroli, R., & Tylén, K. (submitted). Individual behavior, interactive alignment or interper-
sonal synergy? A model-comparison study on linguistic dialog.
Fussell, S. R., & Krauss, R. M. (1992). Coordination of knowledge in communication: effects
of speakers’ assumptions about what others know. Journal of Personality and Social Psychol-
ogy, 62(3), 378.
Galantucci, B. (2009). Experimental Semiotics: a new approach for studying communication
as a form of joint action. Topics in Cognitive Science, 1, 393–410.
Galantucci, B., & Sebanz, N. (2009). Joint action: current perspectives. Topics in Cognitive
Science, 1, 255–259.
Galati, A., & Brennan, S. E. (2010). Attenuating information in spoken communication: for
the speaker, or for the addressee? Journal of Memory and Language, 62(1), 35–51.
Gallagher, R., & Appenzeller, T. (1999). Beyond reductionism. Science, 284(5411), 79–79.
http://dx.doi.org/10.1126/science.284.5411.79.
Gallagher, H., Jack, A. I., Roepstorff, A., & Frith, C. D. (2002). Imaging the intentional stance
in a competitive game. Neuroimage, 16(3 pt. 1). Retrieved from: https://pure.au.dk/ws/
files/48455072/gallagher2002.pdf.
Gallese,V. (2008). Mirror neurons and the social nature of language: the neural exploitation
hypothesis. Social Neuroscience, 3(3–4), 317–333.
Gambi, C., & Pickering, M. J. (2011). A cognitive architecture for the coordination of utter-
ances. Frontiers in Psychology, 2.
88 Rick Dale et al.
Garrod, S., & Anderson, A. (1987). Saying what you mean in dialogue: a study in conceptual
and semantic co-ordination. Cognition, 27, 181–218.
Garrod, S., & Clark, A. (1993). The development of dialogue co-ordination skills in school-
children. Language and Cognitive Processes, 8, 101–126.
Garrod, S., & Doherty, G. (1994). Conversation, co-ordination and convention: an empiri-
cal investigation of how groups establish linguistic conventions. Cognition, 53, 181–215.
Garrod, S., & Pickering, M. J. (2004).Why is conversation so easy? Trends in Cognitive Sciences,
8(1), 8–11. http://dx.doi.org/10.1016/j.tics.2003.10.016.
Garrod, S., & Pickering, M. J. (2009). Joint action, interactive alignment, and dialog. Topics in
Cognitive Science, 1, 292–304.
Giles, H., Coupland, J., & Coupland, N. (1991). Contexts of accomodation. New York: Cam-
bridge University Press.
Goodwin, C. (2000). Action and embodiment within human situated interaction. Journal of
Pragmatics, 32, 1489–1522.
Goodwin, C. (2003). Conversation and brain damage. Oxford; New York: Oxford University Press.
Goodwin, C. (2011). Building action in public environments with diverse semiotic resources.
Versus, 112–113.
Graesser, A. C., Swamer, S. S., & Hu, X. (1997). Quantitative discourse psychology. Discourse
Processes, 23(3), 229–263. http://dx.doi.org/10.1080/01638539709544993.
Grammer, K., Kruck, K. B., & Magnusson, M. S. (1998). The courtship dance: patterns of
nonverbal synchronization in opposite-sex encounters. Journal of Nonverbal Behavior,
22(1), 3–29.
Gratier, M., & Devouche, E. (2011). Imitation and repetition of prosodic contour in vocal
interaction at 3 months. Developmental Psychology, 47, 67–76. http://dx.doi.org/10.1037/
a0020722.
Gries, S. T. (2005). Syntactic priming: a corpus-based approach. Journal of Psycholinguistic
Research, 34, 365–399. http://dx.doi.org/10.1007/s10936-005-6139-3.
Hakkani-Tur, D. (2009). Towards automatic argument diagramming of multiparity meetings.
In IEEE international conference on Acoustics, Speech and Signal Processing, 2009. ICASSP
2009 (pp. 4753–4756). Retrieved from: http://ieeexplore.ieee.org/xpls/abs_all.
jsp?arnumber=4960693.
Hanna, J. E., & Brennan, S. E. (2007). Speakers’ eye gaze disambiguates referring expressions
early during face-to-face conversation. Journal of Memory and Language, 57(4), 596–615.
Hanna, J. E., & Tanenhaus, M. K. (2004). Pragmatic effects on reference resolution in a col-
laborative task: evidence from eye movements. Cognitive Science, 28(1), 105–115.
Hanna, J. E., Tanenhaus, M. K., & Trueswell, J. C. (2003). The effects of common ground
and perspective on domains of referential interpretation. Journal of Memory and Language,
49(1), 43–61. http://dx.doi.org/10.1016/S0749-596X(03)00022-6.
Hartsuiker, R. J., & Westenberg, C. (2000). Word order priming in written and spoken sen-
tence production. Cognition, 75, 27–39.
Hasson, U., Ghazanfar, A. A., Galantucci, B., Garrod, S., & Keysers, C. (2012). Brain-to-brain
coupling: a mechanism for creating and sharing a social world. Trends in Cognitive Sciences,
16(2), 114–121. http://dx.doi.org/10.1016/j.tics.2011.12.007.
Healey, P. G. T., Howes, C., & Purver, M. (2010). Does structural priming occur in ordinary
conversation? Presented at the linguistic evidence.
Healey, P. G. T., & Mills, G. (2006). Participation, precedence and co-ordination in dialogue.
Presented at the 28th annual conference of the science society.
Horton, W. S. (2005). Conversational common ground and memory processes in language
production. Discourse Processes, 40(1), 1–35.
Horton, W. S., & Gerrig, R. J. (2002). Speakers’ experiences and audience design: knowing
when and knowing how to adjust utterances to addressees. Journal of Memory and Language,
47(4), 589–606.
The Self-organization of Human Interaction 89
Horton, W. S., & Gerrig, R. J. (2005). The impact of memory demands on audience design
during language production. Cognition, 96(2), 127–142. http://dx.doi.org/10.1016/
j.cognition.2004.07.001.
Hutchins, E. (1995a). How a cockpit remembers its speeds. Cognitive Science, 19, 265–288.
Hutchins, E. (1995b). Cognition in the Wild. Cambridge, Mass: MIT Press.
Hutchins, E., & Johnson, C. M. (2009). Modeling the emergence of language as an embod-
ied collective cognitive activity. Topics in Cognitive Science, 1, 523–546. http://dx.doi.
org/10.1111/J.1756-8765.2009.01033.X.
Hutchins, E. (2010). Cognitive Ecology. Topics in Cognitive Science, 2(4), 705–715.
Hutchins, E. (2011). Enculturating the Supersized Mind. Philosophical Studies, 152(3), 437–446.
Jaeger, T. F. (2010). Redundancy and reduction: speakers manage syntactic informa-
tion density. Cognitive Psychology, 61, 23–62. http://dx.doi.org/10.1016/j.cog-
psych.2010.02.002.
Jefferson, G. (1988). On the Sequential Organization of Troubles-Talk in Ordinary Conver-
sation. Social Problems, 35(4), 418–441.
Kauffman, S. (1996). At home in the universe: the search for the laws of self-organization and com-
plexity: the search for the laws of self-organization and complexity. Oxford University Press.
Kello, C. T. (2013). Critical branching neural networks. Psychological Review, 120, 230–254.
Kelso, J. A.S. (1981). On the oscillatory basis of movement. Bulletin of the Psychonomic Society,
18(63), 9.
Kelso, J. A. (1995). Dynamic patterns:The self-organization of brain and behavior. The MIT Press.
Kelso, J. A.S. (2009). Synergies: atoms of brain and behavior. Advances in Experimental Medicine
and Biology, 629, 83–91. http://dx.doi.org/10.1007/978-0-387-77064-2_5.
Keysar, B., Barr, D. J., Balin, J. A., & Brauner, J. S. (2000). Taking perspective in conversation:
the role of mutual knowledge in comprehension. Psychological Science, 11(1), 32–38.
Keysar, B., Barr, D. J., & Horton, W. S. (1998). The egocentric basis of language use: Insights
from a processing approach. Current Directions in Psychological Science, 7(2), 46–50.
Keysar, B., Lin, S., & Barr, D. J. (2003). Limits on theory of mind use in adults. Cognition,
89(1), 25–41.
Kingstone, A., Smilek, D., Ristic, J., Friesen, C. K., & Eastwood, J. D. (2003). Attention,
researchers! It is time to take a look at the real world. Current Directions in Psychological
Science, 12(5), 176–180. http://dx.doi.org/10.1111/1467-8721.01255.
Knoblich, G., Butterfill, S., & Sebanz, N. (2011). Psychological research on joint action: the-
ory and data. Psychology of Learning and Motivation-Advances in Research and Theory, 54, 59.
Knoblich, G., & Sebanz, N. (2006).The social nature of perception and action. Current Direc-
tions in Psychological Science, 15(3), 99–104.
Konvalinka, I., & Roepstorff, A. (2012). The two-brain approach: how can mutually interact-
ing brains teach us something about social interaction? Frontiers in Human Neuroscience. 6.
Kopp, S. (2010). Social resonance and embodied coordination in face-to-face conversation
with artificial interlocutors. Speech Communication, 52(6), 587–597.
Kousidis, S., & Dorran, D. (2009). Monitoring convergence of temporal features in spontane-
ous dialogue speech. In Conference papers (p. 1). Retrieved from: http://arrow.dit.ie/cgi/
viewcontent.cgi?article=1003&context=dmccon.
Laidlaw, K. E., Foulsham, T., Kuhn, G., & Kingstone, A. (2011). Potential social interactions
are important to social attention. Proceedings of the National Academy of Sciences, 108(14),
5548–5553.
Latash, M. L. (2008). Synergy. Oxford; New York: Oxford University Press.
Latash, M. L., Scholz, J. P., & Schoner, G. (2007). Toward a new theory of motor synergies.
Motor Control, 11, 276–308.
Lee, C., Black, M., Katsamanis, A., Lammert, A., Baucom, B., Christensen, A., et al. (2010).
Quantification of prosodic entrainment in affective spontaneous spoken interactions of
married couples (Vols. 793–796). Presented at the interspeech.
90 Rick Dale et al.
Lelong, A., & Bailly, G. (2011). Study of the phenomenon of phonetic convergence thanks to
speech dominoes. In Analysis of Verbal and Nonverbal Communication and Enactment.
The Processing Issues (pp. 273–286). Springer Berlin Heidelberg.
Lev-Ari, S., & Keysar, B. (2010).Why don’t we believe non-native speakers? The influence of
accent on credibility. Journal of Experimental Social Psychology, 46(6), 1093–1096.
Levelt,W. J. M., & Kelter, S. (1982). Surface form and memory in question answering. Cogni-
tive Psychology, 14, 78–106.
Levinson, S. C. (1983). Pragmatics. Cambridge Cambridgeshire; New York: Cambridge
University Press.
Levitan, R., & Hirschberg, J. (2011). Measuring acoustic-prosodic entrainment with respect
to multiple levels and dimensions (pp. 3081–3084). Presented at the interspeech 2011.
Lewis, R. L., Vasishth, S., & Van Dyke, J. A. (2006). Computational principles of working
memory in sentence comprehension. Trends in Cognitive Sciences, 10(10), 447–454.
Lin, S., Keysar, B., & Epley, N. (2010). Reflexively mindblind: using theory of mind to inter-
pret behavior requires effortful attention. Journal of Experimental Social Psychology, 46(3),
551–556.
Lockridge, C. B., & Brennan, S. E. (2002). Addressees’ needs influence speakers’ early syntactic
choices. Psychonomic Bulletin & Review, 9(3), 550–557.
Louwerse, M. M., Benesh, N.,Watanabe, S., Zhang, B., Jeuniaux, P., & Vargheese, D. (2009).The
multimodal nature of embodied conversational agents. In N. A. Taatgen, & H. van Rijn
(Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 1459–1463).
Louwerse, M. M., Dale, R., Bard, E. G., & Jeuniaux, P. (2012). Behavior matching in multi-
modal communication is synchronized. Cognitive Science, 36(8), 1404–1420.
Marsh, K. L., Richardson, M. J., Baron, R. M., & Schmidt, R. C. (2006). Contrasting
approaches to perceiving and acting with others. Ecological Psychology, 18(1), 1–38.
Marsh, K. L., Richardson, M. J., & Schmidt, R. C. (2009). Social connection through joint
action and interpersonal coordination. Topics in Cognitive Science, 1, 320–339.
Marwan, N., Carmen Romano, M., Thiel, M., & Kurths, J. (2007). Recurrence plots for the
analysis of complex systems. Physics Reports, 438, 237–329.
McElree, B. (2006). Accessing recent events. Psychology of Learning and Motivation, 46, 155–200.
Mehler, A.,Weiß, P., Menke, P., & Lücking, A. (2010).Towards a simulation model of dialogi-
cal alignment. In Proceedings of the 8th international conference on the evolution of language
(Evolang8), 14–17 April 2010, Utrecht (pp. 238–245).
Mills, G. (2011). The emergence of procedural conventions in dialogue. Presented at the 33rd
annual conference of the cognitive science society.
Mills, G. (in press). Dialogue in joint activity: complementarity, convergence and conven-
tionalization. New Ideas in Psychology.
Mills, G., & Gregoromichelaki, E. (2010). Establishing coherence in dialogue: sequentiality,
intentions and negotiation. Presented at the SemDial (PozDial).
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D.
(2000). The unity and diversity of executive functions and their contributions to com-
plex “frontal lobe” tasks: a latent variable analysis. Cognitive Psychology, 41(1), 49–100.
Murray, G., Renals, S., Carletta, J., & Moore, J. (2006). Incorporating speaker and discourse
features into speech summarization. In Proceedings of the main conference on human language
technology conference of the North American chapter of the association of computational linguistics
(pp. 367–374). : Retrieved from: http://dl.acm.org/citation.cfm?id=1220882.
Murray, L., & Trevarthen, C. (1985). Emotional regulation of interactions between two-
month-olds and their mothers. Social Perception in Infants, 177–197.
Nadel, J., Carchon, I., Kervella, C., Marcelli, D., & Réserbat-Plantey, D. (1999). Expectancies
for social contingency in 2 month olds. Developmental Science, 2, 164–173.
Nass, C., Fogg, B. J., & Moon,Y. (1996). Can computers be teammates? International Journal of
Human-Computer Studies, 45(6), 669–678.
The Self-organization of Human Interaction 91
Newell, K. M., Broderick, M. P., Deutsch, K. M., & Slifkin, A. B. (2003). Task goals and
change in dynamical degrees of freedom with motor learning. Journal of Experimental
Psychology: Human Perception and Performance, 29(2), 379–387.
Newman-Norlund, S. E., Noordzij, M. L., Newman-Norlund, R. D.,Volman, I. A.C., Ruiter,
J. P., Hagoort, P., et al. (2009). Recipient design in tacit communication. Cognition,
111(1), 46–54.
Niederhoffer, K. G., & Pennebaker, J. W. (2002). Linguistic style matching in social interac-
tion. Journal of Language and Social Psychology, 21(4), 337–360.
Nishimura, R., Kitaoka, N., & Nakagawa, S. (2008). Analysis of relationship between
impression of human-to-human conversations and prosodic change and its modeling
(pp. 534–537). Presented at the interspeech 2008.
Oller, D., Niyogi, P., Gray, S., Richards, J., Gilkerson, J., Xu, D., et al. (2010). Automated vocal
analysis of naturalistic recordings from children with autism, language delay, and typical
development. Proceedings of the National Academy of Sciences of the United States of America,
107(30), 13354.
Onnis, L., & Spivey, M. J. (2012). Toward a new scientific visualization for the language sci-
ences. Information, 3(1), 124–150.
Orsucci, F., Giuliani, A., & Webber, C. (2006). Combinatorics and synchronization in natural
semiotics. Physica A: Statistical Mechanics and Its Applications, 361, 665–676.
Orsucci, F., Giuliani, A., & Zbilut, J. (2004). Structure & coupling of semiotic sets. AIP confer-
ence proceedings (Vol. 742, pp. 83). : Retrieved from: http://pdfserv.aip.org/APCPCS/
vol_742/iss_1/83_1.pdf.
Orsucci, F.,Walter, K., Giuliani, A.,Webber, C. L., & Zbilut, J. P. (1997). Orthographic s tructuring
of human speech and texts: Linguistic application of recurrence quantification analysis. Arxiv
Preprint cmp-lg/9712010.
Pardo, J. S., Gibbons, R., Suppes, A., & Krauss, R. M. (2011). Phonetic convergence in college
roommates. Journal of Phonetics.
Paxton, A., & Dale, R. Frame-differencing methods for measuring bodily synchrony in con-
versation. Behavior Research Methods, in press.
Paxton, A., & Dale, R. Argument disrupts interpersonal synchrony, submitted for publication.
Perkins, L., & Milroy, L. (1997). Sharing the communicative burden: a conversation-analytic
account of aphasic/non-aphasic interaction. Multilingua, 16(2–3), 199–215.
Perry, M. (2010). Socially distributed cognition in loosely coupled systems. AI & Society, 1–14.
Pickering, M. J., & Branigan, H. P. (1999). Syntactic priming in language production. Trends
in Cognitive Sciences, 3, 136–141.
Pickering, M. J., & Ferreira,V. S. (2008). Structural priming: a critical review. Psychological Bul-
letin, 134, 427–459. http://dx.doi.org/10.1037/0033-2909.134.3.427.
Pickering, M. J., & Garrod, S. (2004).Toward a mechanistic psychology of dialogue. Behavioral
and Brain Sciences, 27, 169–190.
Pickering, M. J., & Garrod, S. (2009). Prediction and embodiment in dialogue. European
Journal of Social Psychology, 39(7), 1162–1168.
Pickering, M. J., & Garrod, S. An integrated theory of language production and comprehen-
sion. Behavioral and Brain Sciences, in press.
Platek, S. M. (2010). Yawn, yawn, yawn, yawn; yawn, yawn, yawn! The social, evolutionary
and neuroscientific facets of contagious yawning. Frontiers of Neurology and Neuroscience,
28, 107–112. http://dx.doi.org/10.1159/000307086.
Port, R. F., & Van Gelder, T. (1995). Mind as motion: explorations in the dynamics of cognition.
Cambridge, Mass: MIT Press.
Ramenzoni,V. C., Davis,T. J., Riley, M. A., Shockley, K., & Baker, A. A. (2011). Joint action in
a cooperative precision task: nested processes of intrapersonal and interpersonal coordi-
nation. Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale,
211, 447–457. http://dx.doi.org/10.1007/s00221-011-2653-8.
92 Rick Dale et al.
Ramenzoni,V. C., Riley, M. A., Shockley, K., & Baker, A. A. (2012). Interpersonal and intra-
personal coordinative modes for joint and single task performance. Human Movement
Science. http://dx.doi.org/10.1016/j.humov.2011.12.004.
Reidsma, D., Heylen, D. K. J., & Ordelman, R. J.F. (2006). Annotating emotions in meetings.
LREC 2006. Retrieved from: http://eprints.eemcs.utwente.nl/8381/.
Reitter, D., Keller, F., & Moore, J. D. (2011). A computational cognitive model of syntactic
priming. Cognitive Science, 35(4), 587–637.
Reitter, D., & Moore, J. D. (2007). Predicting success in dialogue. Presented at the proceedings of
the 45th annual meeting of the association of computational linguistics (Vol. 45, pp. 808–815).
Reitter, D., Moore, J. D., & Keller, F. (2006). Priming of syntactic rules in task-oriented dia-
logue and spontaneous conversation (pp. 685–690). Presented at the proceedings of the 28th
annual conference of the cognitive science society.
Richardson, M. J., Dale, R., & Marsh, K. L. Complex dynamical systems in social and per-
sonality psychology: theory, modeling and analysis. In handbook of research methods in
social and personality psychology, in press.
Richardson, D. C., Dale, R., & Tomlinson, J. M. (2009). Conversation, gaze coordination,
and beliefs about visual context. Cognitive Science, 33(8), 1468–1482. http://dx.doi.
org/10.1111/j.1551-6709.2009.01057.x.
Richardson, M. J., Marsh, K. L., Isenhower, R. W., Goodman, J. R., & Schmidt, R. C.
(2007). Rocking together: dynamics of intentional and unintentional interpersonal
coordination. Human Movement Science, 26, 867–891. http://dx.doi.org/10.1016/j.
humov.2007.07.002.
Richardson, M. J., Marsh, K. L., & Schmidt, R. C. (2005). Effects of visual and verbal inter-
action on unintentional interpersonal coordination. Journal of Experimental Psychology:
Human Perception and Performance, 31(1), 62.
Richardson, M. J., Marsh, K. L., Schmidt, R. C., & Richardson, M. J. (2010). Challenging the
egocentric view of coordinated perceiving, acting and knowing. The Mind in Context,
307–333.
Richardson, D. C., & Spivey, M. J. (2000). Representation, space and Hollywood Squares:
looking at things that aren’t there anymore. Cognition, 76(3), 269–295.
Richardson, D. C., Street, C. N. H., Tan, J.Y. M., Kirkham, N. Z., Hoover, M. A., & Cavana-
ugh, A. G. (2012). Joint perception: gaze and social context. Frontiers in Human Neuro-
science, 6. Retrieved from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3388371/.
Riley, M. A., Richardson, M. J., Shockley, K., & Ramenzoni,V. C. (2011). Interpersonal syn-
ergies. Frontiers in Psychology, 2, 38. http://dx.doi.org/10.3389/fpsyg.2011.00038.
Riley, M. A., & Van Orden, G. C. (2005). Tutorials in contemporary nonlinear methods for the
behavioral sciences. : National Science Foundation.
Risko, E. F., & Kingstone, A. (2011). Eyes wide shut: implied social presence, eye tracking and
attention. Attention, Perception, & Psychophysics, 73(2), 291–296.
Roche, J., Jaeger,T. F., Dale, R., & Kreuz, R. J. Don’t rush the navigator: disambiguating strat-
egies are hard to establish but easier to maintain, submitted for publication.
Sacks, H., Jefferson, G., & Schegloff, E. A. (1995). Lectures on conversation. (Vol. 1). :Wiley. Online
Library. Retrieved from: http://onlinelibrary.wiley.com/doi/10.1002/9781444328301.
fmatter/summary.
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization
of turn-taking for conversation. Language, 50, 696–735.
Salvucci, D. D., & Taatgen, N. A. (2008).Threaded cognition: an integrated theory of concur-
rent multitasking. Psychological Review, 115(1), 101.
Schank, R. C., & Abelson, R. P. (1977). Scripts, plans, goals, and understanding: an inquiry into
human knowledge structures. Hillsdale, N.J. New York: L. Erlbaum Associates. (distributed
by the Halsted Press Division of John Wiley and Sons).
Schegloff, E. A. (1986). The routine as achievement. Human Studies, 9, 111–151.
The Self-organization of Human Interaction 93
Wilkinson, R., Beeke, S., & Maxim, J. (2003). Adapting to conversation. In C. Goodwin
(Ed.), Conversation and brain damage (pp. 59–89). : Oxford University Press.
Wilson, M., & Wilson, T. P. (2005). An oscillator model of the timing of turn-taking. Psycho-
nomic Bulletin & Review, 12, 957–968.
Wolpert, D. M., Doya, K., & Kawato, M. (2003). A unifying computational framework for
motor control and social interaction. Philosophical Transactions of the Royal Society of Lon-
don. Series B: Biological Sciences, 358(1431), 593–602.
Wu, S., & Keysar, B. (2007a).The effect of information overlap on communication effective-
ness. Cognitive Science, 31(1), 169–181.
Wu, S., & Keysar, B. (2007b). The effect of culture on perspective taking. Psychological science,
18(7), 600–606.
Wyatt, D., Bilmes, J., Choudhury,T., & Kitts, J. A. (2008).Towards the automated social analy-
sis of situated speech data. In Proceedings of the 10th international conference on ubiquitous
computing (pp. 168–171). Retrieved from: http://dl.acm.org/citation.cfm?id=1409658.
This page intentionally left blank
CHAPTER THREE
Contents
1. Introduction98
2. Modifier-Noun Phrases and Compounds as Expressions of Combined Concepts 100
3. Theoretical Framework: A Three-Stage Theory of Conceptual Combination 101
4. Evidence of the Modifier’s Role in Relation Suggestion 104
4.1. General Usage 104
4.2. Recent Usage 107
5. The Nature of Relations and the Nature of Relational Competition 108
5.1. Nature of Relations 108
5.1.1. Relational Information is Accessed via Conceptual Representations 108
5.1.2. Representation of the Relations 109
5.1.3. Level of Relational Abstraction 111
5.2. Nature of Relational Competition 111
5.2.1. Is Competition Because of Number of Competitors? 111
5.2.2. Is Competition due to Inhibition or Facilitation? 113
5.2.3. Is There Competition among Alternative Interpretations? 114
6. T he Role of Relation Competition in the Processing of Compounds that
Lack an Underlying Relation 115
7. Evaluation of Relational Interpretations 119
8. Elaboration of Combined Concepts Following Relation Selection 121
9. Summary124
10. Concluding Remarks 126
References127
Abstract
Compositionality and productivity, which are the abilities to combining existing
concepts and words to create new concepts and phrases, words, and sentences, are
hallmarks of the human conceptual and language systems. Combined concepts are
formed within the conceptual system and can be expressed via modifier-noun phrases
(e.g. purple beans) and compound words (e.g. snowball), which are the simplest forms
of productivity. Modifier-noun phrases and compound words are often paraphrased
using a relation to connect the constituents (e.g. beans that are purple, ball made of
snow). The phrase or compound does not explicitly contain the underlying relation,
but the existence of the relation can be shown by manipulating the availability of the
relation and observing the effect on the interpretation of the phrase or compound. This
chapter describes how novel modifier-noun phrases and established compounds are
interpreted. We present a theoretical account of relational interpretation of combined
concepts and present the empirical evidence for the use of relational structures. We
then present the empirical evidence supporting our theoretical account’s specific pre-
dictions about how relational interpretations are selected and evaluated and how the
relational interpretation is elaborated to create a fully specified new concept.
1. INTRODUCTION
Concepts are mental entities that allow a person’s experience with
the world to be organized into meaningful units. The ability to store and
access conceptual information is vital to human cognition because many
tasks that people perform on a daily basis (such as classification, prediction,
reasoning, and communication) require the application of existing knowl-
edge to new situations. Indeed, concepts have been called the “building
blocks of cognition” (Solomon, Medin, & Lynch, 1999). Concepts are not
represented in isolation but rather are part of a complex and highly inter-
related conceptual system. Relational information plays a vital role in the
organization of the conceptual system (for an overview, see Medin, 1989) as
well as a central role in nominal compounding (e.g. Allen, 1978; Gleitman &
Gleitman, 1970; Kay & Zimmer, 1976; Levi, 1978). In particular, knowledge
about how concepts interrelate underlies conceptual composition, which is
a process through which new concepts are created by combining existing
concepts.
In English, combined concepts are often expressed as modifier-noun
phrases (e.g. chocolate recipe) or, as they become more commonly used, as
compound words (e.g. handbag). Teall (1892, p. 5) made the observation that
“in the English language it is very common to name a thing, or express
an attribute, or assert an action or manner of action by omitting minor or
connecting parts of a full expression, and using only the principal elements
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 99
Figure 3.1 Schematic of the RICE (Relational Interpretation Competitive Evaluation) theory.
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 103
was initially tested using information about which relations are most likely
to be used with constituents of novel combinations.To estimate the compet-
itiveness of various relations for particular constituents, Gagné and Shoben
(1997) created a set of potential novel compounds by crossing 91 modifiers
and 91 head nouns and each pairing was evaluated in terms of whether it
had a sensible literal interpretation. Each of the 3239 sensible phrases were
classified in terms of relational categories that were based on Levi’s (1978)
set of thematic relations. Levi’s categories are general and are based on her
hypothesis that all complex nominals are derived from underlying semantic
structures from which a predicate (e.g. CAUSE, HAVE, MAKE, FOR) is
deleted in the linguistic expression.
Next, the frequency with which each modifier and head noun appeared
with the various relations was determined. For example, of the 38 phrases in
which plastic was used as a modifier, 28 used the noun MADE OF modifier
relation, seven used the noun ABOUT modifier relation, two used the noun
DERIVED FROM modifier relation, and one used the modifier CAUSES
noun relation. These distributions were used to identify which relations
were highly competitive and which were less competitive for an individual
modifier or head noun. Relations were considered a good competitor for a
particular constituent if that relation was among the set of relations that was
used for the majority (60% or more) of all phrases using the constituent in
question. All other relations were considered weaker competitors.
To evaluate whether ease of comprehension was affected by relation com-
petitiveness, three experimental conditions were created. HH (High-High)
items had an underlying relation that was among the set of highly competitive
relations for both the modifier and the head, HL (High-Low) items were used a
relation that was among the set of highly competitive relations for the modifier
only, and LH (Low-High) items used an underlying relation that was among
the set of highly competitive relations for the head noun only. In Experiment
1, the individual words were controlled in that the identical words were used in
all three experimental conditions. In Experiment 2, the relation was controlled
such that there was an equal number of each relation type in each condition.
Nonsense filler items (e.g. plastic rain and scarf soda) were included. Each item
was presented on a computer screen, and participants indicated, by pressing a
key, whether the item had a sensible literal interpretation.
Both experiments demonstrated that it is easier to indicate that a phrase
has a sensible interpretation when the underlying relation is highly com-
petitive for the modifier than when it is a weak competitor; the HH and
HL conditions yielded faster response times than did the LH condition.
106 Christina L. Gagné and Thomas L. Spalding
The results also indicated that the competitiveness of the relation with respect
to the head noun constituent did not influence response time; the HH and
HL conditions did not differ from each other. These two findings were
observed both in the analysis of variance (ANOVA), which used a dichoto-
mous measure (H vs L) of a relation’s competitiveness, as well as in a regres-
sion analysis, which used a continuous measure of a relation’s competitiveness.
Although there has been concern that the results reported in Gagné
and Shoben (1997) were because of the familiarity and plausibility of the
phrase rather than because of relation availability (Wisniewski & Murphy,
2005), regression analyses show this not to be the case (Gagné & Spalding,
2006). Objective familiarity (i.e. frequency) did not differ across the three
conditions. Also, even after subjective familiarity and plausibility were statis-
tically controlled, items with highly competitive relations took less time to
interpret than did items with less competitive relations. In addition, Gagné
and Spalding (2006) found that subjective familiarity ratings were affected
by relation availability; noun–noun phrases were more likely to be viewed as
familiar when preceded by an item with the same relation than by an item
with a different relation. If subjective familiarity were the causal factor, it
would not have been influenced by the manipulation of relation availability.
Similarly, sense/nonsense judgments (in which the person is instructed to
respond “sense” if they can think of a plausible meaning for the phrase) are
also affected by manipulations of relational availability (e.g. Gagné, 2001).
Hence, neither familiarity nor plausibility are reasonable explanations for
the results of Gagné and Shoben (1997).
Another concern has been that relation frequencies based on Gagné
and Shoben’s (1997) relational distributions might not be consistent with
relation frequencies calculated using an actual corpus (Maguire, Devereux,
Costello, & Cater, 2007). Contrary to this claim, Spalding and Gagné (2008)
found that there is a close relationship (r = 0.87) between the relation
frequencies derived by Gagné and Shoben and those based on the British
National Corpus.
A third concern might be that relational effects such as those demon-
strated by Gagné and Shoben (1997) would only occur when the com-
binations are interpreted out of context. Gerrig and Bortfeld (1999), for
example, have argued that interpreting combined concepts in isolation
could lead to a distorted view of the process of interpretation. Gagné
and Spalding (2004a), however, showed that the modifier-based relation
frequency effects are maintained, even when the combined concepts are
embedded in a supportive context. Novel modifier-noun phrases were
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 107
placed in either a neutral context (i.e. one that did not provide the inter-
pretation for the combination) or a supportive context (i.e. a context that
implied the interpretation). Phrases were read more quickly in a supportive
context than a neutral context, but the supportive context did not eliminate
the effect of modifier relation frequency; sentences containing a combina-
tion using a high-frequency relation were read more quickly than were
sentences containing a combination using a lower frequency relation.These
findings suggest that contextual information might be used in the verifica-
tion of potential interpretations but that it does not override the effect of
competing relations. That is, the context might suggest possible referents
for the phrase and that information might be used to evaluate which of the
suggested relations is most feasible in the current context.
In sum, the strength of a relation for the modifier constituent of a novel
phrase affects the ease of processing that phrase, in or out of context, and
even when other factors such as familiarity are controlled.
Prime items were constructed for each target compound (e.g. snowball); the
same-relation prime (e.g. snowfort) used the same relation (MADE OF) as
the target and the different-relation prime (e.g. snowshovel) used a differ-
ent relation. As was the case for novel compounds, sense/nonsense judg-
ments and lexical decision latencies were faster when the target had been
preceded by the same-relation compound than when it was preceded by
the different-relation compound. This relation-priming effect in estab-
lished compounds has been replicated several times (e.g. Gagné et al., 2009;
Spalding & Gagné, 2011). Relational priming was also observed when the
primes were restricted to existing compounds (Gagné & Spalding, 2009); so
the relational p riming effect for compounds is not limited to experiments
in which a large number of novel combinations are presented. In sum,
recent relational usage affects the interpretation of both novel and familiar
combinations, strongly suggesting a continuity of processing between novel
and familiar combinations.
showed relation priming when the modifier constituent of the prime com-
bination was highly semantically similar to the modifier constituent of the
target, in addition to when the modifier constituents were identical. Hence,
identical lexical items are not necessary to demonstrate relational priming.
However, when the prime modifier constituent is semantically unrelated
to the target, Gagné (2001) found no relational priming (see also Gagné,
Spalding, & Ji, 2005, for several failures to find relational priming when the
prime and target modifier constituents are unrelated). In addition, Gagné
et al. (2009) investigated relation priming when the repeated constituent
was either in the same position between prime and target or in a differ-
ent position (e.g. a given constituent served as the modifier for both prime
and target or moved from the modifier position in the prime to the head
position in the target). Relational priming was observed only when the
repeated constituent was in the same position in the prime and target.Thus,
relational access appears to depend on both the concept underlying the
constituent and the role (i.e. modifier or head) that the concept is playing
in the combination.
modifier; modifier CAUSES noun) appear to have more primitives than the
MADE OF relation. However, Shoben and Medin found no support for
this complexity hypothesis: there were no systematic differences in process-
ing time that could be attributed to relational complexity.
Estes (2003) proposed that the relations have separate representations
and, consequently, they could be primed when the constituents of the
primes and targets were completely unrelated. Estes (2003) claimed to
demonstrate relation priming without access via the constituents. How-
ever, Gagné et al. (2005) showed that the relational effect observed in
Estes (2003) was confounded with an extremely strong semantic prim-
ing effect. For example, swimming flippers primed rugby shoes more than
did road construction. However, it is clear that swimming and rugby are both
sports, and flippers and shoes are also o
bviously semantically related. Thus,
the same-relation primes were semantically similar to the targets, in addi-
tion to being relationally similar. This is problematic for Estes’ conclusion
because Gagné (2002) had previously demonstrated relation priming fol-
lowing the presentation of a prime containing a semantically similar modi-
fier; so it was already clear that lexically identical constituents were not
required for relation priming. Indeed, as Gagné et al. showed, this semantic
similarity between primes and targets was common in Estes’ materials,
leading to a highly significant difference in semantic similarity between
the same-relation pairs and the different-relation pairs. Gagné et al. failed
to find relational priming in four experiments when the prime-target
semantic similarity was controlled. This outcome is consistent with the
results of Experiment 6 of Gagné (2001) in which relation priming was
not observed when only the relation, but neither constituent, was in com-
mon between the prime and the target, as well as the finding that repeating
only the head constituent was not sufficient to result in relation priming
(Gagné, 2001, 2002; Gagné & Shoben, 2002).
In subsequent work, Estes and Jones (2006) claimed to have demon-
strated relation priming without access via the constituents, while control-
ling for semantic similarity between the primes and the targets. However,
they used only one relation in all their experimental target items; thus, an
unusually large proportion of the “sense” target items were a MADE OF
relation, while the filler items were of many different relations. Hence, a
problem arises with this data. If the prime is a MADE OF, then the target
item was more likely to require a “sense” response, than if the prime has
some other relation. Being able to predict the correct response to the target
from the prime is, of course, a critical problem in a priming paradigm
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 111
(Estes and Jones did have sense–sense filler items, but they varied in relation;
so they did not provide a complete control for this particular problem).Thus,
again, the purported general relation-priming effect is likely not because of
relation priming, per se. We should perhaps note here that some degree of
facilitation may occur with only a repeated relation under some circum-
stances because the relations do carry semantic information and seman-
tic information can affect relational interpretation (e.g. Spalding & Gagné,
2007). However, it appears that relation priming without at least strong
similarity of the constituent concepts is unlikely in the standard relational
priming paradigm as a number of attempts to demonstrate such priming
have failed, as discussed above.
the numerator and the sum of the frequency of the three strongest competi-
tors and the selected relation in the denominator (Gagné & Shoben, 1997).
An exponential function is applied to each proportion. Although Maguire
et al. (2007) have suggested that this ratio does not embody competition,
Spalding and Gagné (2008) have demonstrated that the ratio makes sharp
distinctions between items on the basis of the number of competing rela-
tions that are stronger than the selected relation and that these distinctions
become sharper with increasing numbers of competitors.The original anal-
ysis (in Gagné & Shoben, 1997) found that including more than the three
strongest relations in the denominator of the strength ratio did not improve
the fit of the model; therefore, the number of stronger competitors was
based on the three strongest relations in a given modifier’s relational distri-
bution. Spalding and Gagné showed that three mathematical models that
instantiate sensitivity to number of stronger competitors fit the data better
than a model that includes only frequency of the selected relation. In addi-
tion, a model that simply includes the number (0–3) of stronger competitor
relations fits the Gagné and Shoben data as well as the original Gagné and
Shoben mathematical model. The model that simply has the number of
stronger competitors also fits the Gagné and Shoben (1997) data as well as
(or better than) the rank of the selected relation (Experiment 1, r = 0.47 for
rank and r = 0.45 for number of competitors, and Experiment 3, r = 0.25
for rank and r = 0.36 for number of competitors). Thus, as in Gagné and
Shoben’s analyses and models, including more stronger competitors (i.e.
ranks beyond 3) did not improve the fit of the model.
If the process of suggesting, evaluating, and eliminating relations is serial,
then using more competitors (i.e. rank) should have been a much better
predictor than just the number of stronger competitors as it should have
been able to pick up any variance associated with the competitors beyond
the third. However, the analysis shows that competitors beyond the third
have little impact on ease of processing. Overall, then, the data are con-
sistent with a parallel process in which the number of strong competitors
matters greatly, but the number of weak competitors (even if still stronger
than the required relation) does not matter as much. This might be because
such weak competitors require very little negative evidence from the head
to rule them out, while strong competitors require substantial negative
evidence from the head. As shown in Spalding et al. (2010) and discussed
below, the head plays a large role in the evaluation of suggested relations,
and perhaps the relations beyond the third competitor have little impact
because the information from the head has been brought online by this
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 113
slow, and the baseline should be in the middle. The results were consistent
with inhibition. In both experiments, recent presentation of a compound
using a different relation made it more difficult to interpret the target com-
pound, whereas responses in the same-relation and modifier-only prime
conditions did not differ.
wore plenty of bug spray”) or the innovative reading (e.g. “As a defense
mechanism against predators, the Alaskan beetle can release a deadly bug
spray”). Immediately after viewing the sentence, the participants saw the
phrase (e.g. bug spray) with a definition that was based on either the con-
ventional interpretation (e.g. “a spray for bugs”) or the innovative interpre-
tation (e.g. “spray produced by bugs”) and indicated whether the definition
was a plausible interpretation for the phrase. When the sentence used the
established meaning, the conventional definition was judged plausible 89%
of the time. However, when the sentence used the innovative meaning, the
conventional definition was judged plausible only 64% of the time. In terms
of response time, participants took longer to indicate that the conventional
reading was plausible when the sentence supported the innovative read-
ing than when it supported the conventional reading. We should note that
these results occurred even though the participants were told explicitly that
the definition did not have to be the best definition but that they should
indicate “yes” if the definition was plausible.Thus, the competition between
the relations was not restricted to a case in which the interpretations were
explicitly pitted against each other, as would be the case if the participants
were told to select the best definition. These findings indicate that compe-
tition from the innovative interpretation made it more difficult to accept
the conventional interpretations. This finding is highly consistent with the
fact that relation priming for established compounds is primarily a result of
increasing the availability of a relation other than the one required for the
target item (Spalding & Gagné, 2011), as previously discussed.
That is, the more available the constituent representation, the more
difficult it was to process an opaque compound, as would be expected if
the processing of opaque compounds entailed an attempt at meaning con-
struction that would interfere with the established meaning. In general,
these results are highly consistent with the idea that meaning construction
occurs for both opaque and transparent compounds. However, this process
produces a meaning that strongly conflicts with the conventional meaning
of opaque compounds.
Gagné and Spalding (submitted for publication) investigated whether
transparent and opaque compounds are sensitive to potentially competing
relational interpretations, as suggested by Ji et al. (2011).To answer this ques-
tion, Gagné and Spalding used the lexical decision data for transparent and
opaque compounds from Ji et al. and attempted to predict response time
using the diversity of relational interpretations that are possible for those
compounds. In this case, the potentially competing relations were assessed at
the level of the whole phrase using a possible relations task and using a com-
pletely different group of research participants. In the possible relations task,
participants are presented with a compound consisting of two words and are
asked to pretend that they are learning English and know each of the two
words, but have never seen the words used together. Then, they are asked
to select the most likely interpretation of the words when used together.
The participants select one relation from a list of relations derived from
Levi (1978). Relational diversity was computed for each compound simply
by counting the number of relations that were chosen by any participant
for a given compound. This relational diversity measure was a significant
predictor of lexical decision response time for both transparent and opaque
compounds. Thus, although there was no obvious reason for participants
in Ji et al.’s lexical decision task to be considering the possible relational
interpretations of the compounds, the ease of making the lexical decision
was affected by how many possible alternative interpretations exist for the
compound. In particular, the more possible relations there were, the slower
the lexical decision response time was, as predicted by the view that com-
peting relational interpretations slow processing. That such an effect occurs
even for opaque compounds (i.e. those compounds where the established
meaning cannot be computed from the constituents’ meanings) is strong
evidence that the meaning construction process is likely to be automatically
initiated when compound words are encountered. Furthermore, this mean-
ing construction process appears to be generally relational in nature so that
there seems to be a very strong continuity between the processing of novel
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 119
(as does the modifier’s relational distribution). Spalding et al. also dem-
onstrated a robust head-based relational priming effect for unambiguous
combined concepts with the relation verification task. Finally, Spalding
et al. showed that the particular form of relational competition found in
the sense/nonsense task (i.e. the particular sensitivity to stronger competi-
tor relations, as discussed above) did not play a strong role in the relation
verification task. In other words, in the evaluation of an individual relation,
it is only the required relation’s strength (for both the modifier and the
head) that seems to play a role in relation verification response time. The
strength of other relations appears to play little role in the verification task.
We should note that this complex pattern of asymmetries between the
modifier and the head, and the differences among the different phases of
the relational interpretation process, are not consistent with any other exist-
ing theory of conceptual combination (see the discussion in Spalding et al.,
2010, pp. 304–307).
DOG has LEGS as a part, nor does the fact that people know that dogs have
legs mean that their concept of DOG must include LEGS as a part. Instead,
the features are themselves generally concepts linked to the (target) concept
in the act of predication. Aristotle often refers to this as combining and
dividing. Putting together two concepts (combining; e.g. dogs have legs)
or denying their combination (dividing; e.g. dogs do not have hard drives)
is a separate cognitive act from those involved in creating the concept or
in using the concept to represent the thing to the mind. The predication
can be remembered and can become habitual, but it is not part of the con-
cept. Critically, in such views, the properties predicated of concepts need
not combine in any mechanistic way, but are highly amenable to reason-
ing about whether the property would continue to be true of a modified
concept.
One point that has not yet been investigated much is the extent to which
elaboration is immediate and relatively automatic or neither immediate nor
automatic. The results of Gagné and Spalding (2007) that it becomes more
difficult to say that apples are red following a presentation of peeled apples
suggest at least some relatively immediate and automatic elaboration. On
the other hand, the results of Gagné and Spalding (2011) suggest that some
elaboration is not automatic and might only occur as needed (e.g. to answer
a particular question or to integrate with a new context). Furthermore, if
elaboration proceeds from the relational gist, then the elaboration of com-
bined concepts will presumably have strong similarity to other areas of text or
discourse processing. In particular, elaboration of combined concepts would
have to be highly similar to the processing of full noun phrases. As Wisniewski
(1996) points out, elaboration will also often involve selecting different senses
of modifiers (see also Mullaly, Gagné, Spalding, & Marchak, 2010) and prop-
erty terms, which will raise further complexities of processing. Clearly, the
elaboration of combined concepts is highly complex and is much less well
understood than relation selection. However, investigating elaboration may
provide important insight into a number of cognitive processes, including
reasoning, text or discourse processing and the relationship between concepts
and features. In short, this is a promising avenue for further research.
9. SUMMARY
This chapter reviews the recent literature on the relational interpreta-
tion of modifier-noun phrases and compound words. Section 1 argues for
the importance of conceptual composition processes in understanding how
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 125
meaning of the opaque compound. Such effects strongly suggest that the
relational interpretation process is more or less obligatory when modifier-
noun phrase or compound word structures are encountered.
In Section 7, we describe research that used a relation verification task
to isolate the evaluation process and focus it on a single relational inter-
pretation. This research demonstrates effects of the relation’s availability
for both the modifier and the head and contrasts these results with the
results of experiments using sense/nonsense judgments. This section shows
two critical points. One, although the effects of relational availability for
the head can be hidden in the sense/nonsense task, those effects are real.
Second, this result strongly suggests that the effect of multiple competitor
relations arises in the evaluation stage, even though the effects are related to
the relational availability for the modifier.
Section 8 provides a discussion of how the elaboration of the relational
interpretations might proceed. In particular, the idea that the elaboration
proceeds from the relational gist via reasoning processes is explored and
related to some other aspects of the literature on concepts.
REFERENCES
Allen, M. R. (1978). Morphological investigations. University of Connecticut. (Ph.D. Dissertation).
Bauer, L. (2008). Dvandva. Word Structure, 1, 1–20.
Bertram, R., Laine, M., & Karvinen, K. (1999). The interplay of word formation type, affixal
homonymy, and productivity in lexical processing: evidence from a morphologically
rich language. Journal of Psycholinguistic Research, 28, 213–226.
Bisetto, A., & Scalise, S. (2005). The classification of compounds. Lingue E Linguaggio, 4,
319–332.
Booij, G. (2005). Compounding and derivation: evidence for construction morphology. In
W. Dressler, D. Kastovsky, O. E. Pfeiffer & F. Rainer (Eds.), Morphology and its demarcations
(pp. 109–132). Amsterdam/Philadelphia: John Benjamins.
Connolly, A. C., Fodor, J. A., Gleitman, L. R., & Gleitman, H. (2007). Why stereotypes don’t
even make good defaults. Cognition, 103, 1–22.
Downing, P. (1977). On the creation and use of English compound nouns. Language, 53,
810–842.
Estes, Z. (2003). Attributive and relational processes in nominal combination. Journal of
Memory and Language, 48, 304–319.
Estes, Z., & Jones, L. L. (2006). Priming via relational similarity: a COPPER HORSE is
faster when seen through a GLASS EYE. Journal of Memory and Language, 55, 89–101.
Finin, T. W. (1980). The semantic interpretation of compound nominals. Urbana-Champaign:
University of Illinois. (Ph.D. Dissertation).
Fiorentino, R., & Poeppel, D. (2007). Compound words and structure in the lexicon.
Language and Cognitive Processes, 22, 953–1000.
Francis, W. N., & Kučera, H. (1982). Frequency analysis of English usage: Lexicon and grammar.
Boston: Houghton Mifflin.
Gagné, C. L. (2000). Relation-based combinations versus property-based combinations: a
test of the CARIN theory and the dual-process theory of conceptual combination.
Journal of Memory and Language, 42, 365–389.
Gagné, C. L. (2001). Relation and lexical priming during the interpretation of noun-noun
combinations. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27,
236–254.
Gagné, C. L. (2002). Lexical and relational influences on the processing of novel compounds.
Brain and Language, 81, 723–735.
Gagné, C. L., & Murphy, G. L. (1996). Influence of discourse context on feature availability
in conceptual combination. Discourse Processes, 22, 79–101.
Gagné, C. L., & Shoben, E. J. (1997). Influence of thematic relations on the comprehension
of modifier-noun combinations. Journal of Experimental Psychology: Learning, Memory, and
Cognition, 23, 71–87.
Gagné, C. L., & Shoben, E. J. (2002). Priming relations in ambiguous noun-noun combina-
tions. Memory & Cognition, 30, 637–646.
Gagné, C. L., & Spalding, T. L. (2004a). Effect of discourse context and modifier rela-
tion frequency on conceptual combination. Journal of Memory and Language, 50,
444–455.
Gagné, C. L., & Spalding, T. L. (2004b). Effect of relation availability on the interpretation
and access of familiar noun-noun compounds. Brain and Language, 90, 478–486.
Gagné, C. L., & Spalding, T. L. (2006). Relation availability was not confounded with
familiarity or plausibility in Gagné and Shoben (1997): comment on Wisniewski and
Murphy (2005). Journal of Experimental Psychology: Learning, Memory, and Cognition, 32,
1431–1437. discussion 1438–1442.
Gagné, C. L., & Spalding, T. L. (2007). The availability of noun properties during the
interpretation of novel noun phrase. Mental Lexicon, 2, 241–260.
128 Christina L. Gagné and Thomas L. Spalding
Gagné, C. L., & Spalding, T. L. (2009). Constituent integration during the processing of
compound words: does it involve the use of relational structures? Journal of Memory and
Language, 60, 20–35.
Gagné, C. L., & Spalding, T. L. (2011). Inferential processing and meta-knowledge as the
bases for property inclusion in combined concepts. Journal of Memory and Language, 65,
176–192.
Gagné, C. L. & Spalding, T. L. Relation diversity for opaque and transparent English
compounds. In F. Rainer, W. Dressler, F. Gardani, H. C. Luschutzky (Eds.), Current issues
in linguistic theory. John Benjamins, submitted for publication.
Gagné, C. L., Spalding, T. L., Figueredo, L., & Mullaly, A. C. (2009). Does snow man prime
plastic snow? The effect of constituent position in using relational information during
the interpretation of modifier-noun phrases. Mental Lexicon, 4, 41–76.
Gagné, C. L., Spalding, T. L., & Gorrie, M. C. (2005). Sentential context and the interpreta-
tion of familiar open-compounds and novel modifier-noun phrases. Language and Speech,
48, 203–221.
Gagné, C. L., Spalding, T. L., & Ji, H. (2005). Re-examining evidence for the use of
independent relational representations during conceptual combination. Journal of
Memory and Language, 53, 445–455.
Gerrig, R. J. (1989). The time-course of sense creation. Memory & Cognition, 17, 194–207.
Gerrig, R. J., & Bortfeld, H. (1999). Sense creation in and out of discourse contexts. Journal
of Memory and Language, 41, 457–468.
Gleitman, L. R., & Gleitman, H. (1970). Phrase and paraphrase: Some innovative uses of language.
New York: Norton.
Inhoff, A. W., Radach, R., & Heller, D. (2000). Complex compounds in German: interword
spaces can facilitate segmentation but hinder assignment of meaning. Journal of Memory
and Language, 42, 23–50.
Ji, H. (2008). The influence of morphological complexity on word processing. Department of
Psychology, University of Alberta. (Ph.D. dissertation).
Ji, H., & Gagné, C. L. (2007). Lexical and relational influences on the processing of Chinese
modifier-noun compounds. Mental Lexicon, 2, 387–417.
Ji, H., Gagné, C. L., & Spalding, T. L. (2011). Benefits and costs of lexical decomposition
and semantic integration during the processing of transparent and opaque English
compounds. Journal of Memory and Language, 65, 406–430.
Jönsson, M. L., & Hampton, J. A. (2008). On prototypes as defaults (Comment on Connolly,
Fodor, Gleitman and Gleitman, 2007). Cognition, 106, 913–923.
Kay, P., & Zimmer, K. E. (1976). On the semantics of compounds and genitives in English.
In Proceedings of the sixth California Linguistics Association. San Diego: San Diego State
University.
Koester, D., Gunter, T. C., & Wagner, S. (2007). The morphosyntactic decomposition and
semantic composition of German compound words investigated by ERPs. Brain and
Language, 203, 64–79.
Laurence, S., & Margolis, E. (1999). Concepts and cognitive science. In E. Margolis &
S. Laurence (Eds.), Concepts: Core readings. Cambridge, MA: A Bradford Book, MIT Press.
Lees, R. B. (1960). The grammar of English nominalizations. Bloomington, IN: Indiana
University.
Levi, J. N. (1978). The syntax and semantics of complex nominals. New York: Academic Press.
Libben, G. (1998). Semantic transparency in the processing of compounds: consequences for
representation, processing, and impairment. Brain and Language, 61, 30–44.
Libben, G., Gibson, M., Yoon, Y. B., & Sandra, S. (2003). Compound fracture: the role of
semantic transparency and morphological headedness. Brain and Language, 84, 50–64.
Libben, G., & Jarema, G. (2006). The representation and processing of compound words. New York:
Oxford University Press.
Role of Relational Competition in Modifier-Noun Phrases and Noun–Noun Compounds 129
Maguire, P., Devereux, B., Costello, F., & Cater, A. (2007). A reanalysis of the CARIN theory
of conceptual combination. Journal of Experimental Psychology: Learning, Memory, and
Cognition, 33, 811–821.
Marchand, H. (1969). The categories and types of present-day English word-formation: A synchronic-
diachronic approach. Wiesbaden: Otto Harrassowitz.
Medin, D. L. (1989). Concepts and conceptual structure. American Psychologist, 44, 1469–1481.
Meyer, R. (1993). Compound comprehension in isolation and in context: the contribution of
conceptual and discourse knowledge to the comprehension of German novel noun–noun compounds.
Tübingen: Niemeyer.
Mullaly, A. C., Gagné, C. L., Spalding, T. L., & Marchak, K. A. (2010). Examining ambig-
uous adjectives in adjective-noun phrases: evidence for representation as a shared
core-meaning with sense specialization. Mental Lexicon, 5, 87–114.
Olsen, S. (2004). The case of copulative compounds. In A. ter Meulen & W. Abraham (Eds.),
The composition of meaning, from lexeme to discourses (pp. 17–37). Amsterdam: Benjamins.
Olsen, S., & Van der Meer, G. (2001). Coordination in morphology and syntax: the case of
copulative compounds. In A. ter Meulen (Ed.), Making sense: From lexeme to discourse.
Festschrift for Werner Abraham (pp. 87–101). Dorderecht: Kluwer.
Scalise, S., & Bisetto, A. (2009). The classification of compounds. In R. Lieber &
P. Stekauer (Eds.), Oxford handbook of compounding (pp. 34–53). Oxford: Oxford
University Press.
Schreuder, R., & Baayen, R. H. (1995). Modeling morphological processing. Hillsdale, NJ, England:
Lawrence Erlbaum.
Schreuder, R., & Baayen, R. H. (1997). How complex simple words can be. Journal of Memory
and Language, 37, 118–139.
Shoben, E. J. (1991). Predicating and nonpredicating combinations. In P. J. Schwanenflugal
(Ed.), The psychology of word meanings (pp. 117–135). Hillsdale, NJ: Erlbaum.
Solomon, K. O., Medin, D. L., & Lynch, E. (1999). Concepts do more than categorize. Trends
in Cognitive Sciences, 3, 99–105.
Spalding,T. L., & Gagné, C. L. (2007). Semantic property activation during the interpretation
of combined concepts. Mental Lexicon, 2, 25–47.
Spalding, T. L., & Gagné, C. L. (2008). CARIN theory reanalysis reanalyzed: a comment
on Maguire, Devereux, Costello, and Cater (2007). Journal of Experimental Psychology:
Learning, Memory, and Cognition, 34, 1573–1578.
Spalding, T. L., & Gagné, C. L. (2011). Relation priming in established compounds: facilita-
tion? Memory & Cognition, 39, 1472–1486.
Spalding, T. L., & Gagné, C. L. Concepts in Aristotle and Aquinas: implications for current
theoretical approaches. Journal of Theoretical and Philosophical Psychology, in press.
Spalding, T. L., Gagné, C. L., Mullaly, A. C., & Ji, H. (2010). Relation-based interpretations
of noun-noun phrases: a new theoretical approach. In S. Olson (Ed.), New impulses in
word-formation (Linguistische Berichte Sonderheft 17) (pp. 283–315). Hamburg: Buske.
Storms, G., & Wisniewski, E. J. (2005). Does the order of head noun and modifier explain
response times in conceptual combination? Memory & Cognition, 33, 852–861.
Štekauer, P. (2005). Meaning predictability in word formation: Novel, context-free naming units.
Amsterdam: John Benjamins Publishing Company.
Štekauer, P. (2006). On the meaning predictability of novel context-free converted naming
units. Linguistics, 44, 489–539.
Štekauer, P. (2009). Meaning predictability of novel context-free compounds. In R. Lieber
& P. Štekauer (Eds.), The Oxford handbook of compounding (pp. 272–298). Oxford, UK:
Oxford University Press.
Taft, M. (2003). Morphological representation as a correlation between form and
meaning. In E. Assink & D. Sandra (Eds.), Reading complex words: Cross-language studies
(pp. 113–137). Amsterdam: Kluwer Academic.
130 Christina L. Gagné and Thomas L. Spalding
Taft, M. (2004). Morphological decomposition and the reverse base frequency effect.
Quarterly Journal of Experimental Psychology, 57, 745–765.
Taft, M., & Kougious, P. (2004).The processing of morpheme-like units in monomorphemic
words. Brain and Language, 90, 9–16.
Teall, F. (1892). English compound words and phrases. New York: Funk & Wagnalls.
Warren, B. (1978). Semantic patterns of noun-noun compounds. Goteborg: Acta Universitatis
Gothoburgensis.
Wisniewski, E. J. (1996). Construal and similarity in conceptual combination. Journal of
Memory and Language, 35, 434–453.
Wisniewski, E. J. (1997).When concepts combine. Psychonomic Bulletin and Review, 4, 167–183.
Wisniewski, E. J., & Murphy, G. L. (2005). Frequency of relation type as a determinant of
conceptual combination: a reanalysis. Journal of Experimental Psychology: Learning, Memory,
and Cognition, 31, 169–174.
Zwitserlood, P. (1994). The role of semantic transparency in the processing and representa-
tion of Dutch compounds. Language and Cognitive Processes, 9, 341–368.
Zwitserlood, P., Bolwiender, A., & Drews, E. (2005). Priming morphologically complex
verbs by sentence contexts: effects of semantic transparency and ambiguity. Language and
Cognitive Processes, 20, 395–415.
CHAPTER FOUR
Contents
1. Introduction133
2. List-Method DF: Design and Measurement 134
2.1. Basic Design Issues 134
2.2. Multilist Designs in DF 136
2.3. Additional Dependent Measures in DF 137
3. Our Framework of List-Method DF 138
3.1. Older Ideas about the Causes of DF 138
3.2. A Two-Factor, Process-Based Account 139
4. Forgetting is a Strategic Decision 140
4.1. Importance of Controlled Strategies 141
4.2. Why do Some People Fail to Engage in DF? 142
4.3. Beliefs about Memory Developed during the Experiment 143
4.4. Preexisting Beliefs about Intentional Forgetting 144
4.5. Forgetting Strategies and Their Relative Effectiveness 146
5. Context Change as an Explanation for DF Impairment 148
5.1. Mental Context-Change Paradigm and Its Relation to DF 149
5.2. Recognition Tests and Indirect Tests of Memory 150
5.3. Mental Reinstatement of Context 153
5.4. Cuing with Context Cues vs Category Cues 154
5.5. Encoding Strength: Item vs Context Strength 155
5.6. Contextual Variability 156
5.7. Extralist Cued Recall 157
5.8. Importance of L2 Learning 158
5.9. Related Items Across Lists 159
5.10. Retrieving L2 before L1 160
5.11. Delay Effects 161
5.12. Individual Differences in DF as a Function of Working Memory Capacity 162
5.13. Reexposure or Retrieval of L1 Items Affects Subsequent Memory 162
5.14. Summary164
Psychology of Learning and Motivation, Volume 59 © 2013 Elsevier Inc.
ISSN 0079-7421, http://dx.doi.org/10.1016/B978-0-12-407187-2.00004-6 All rights reserved. 131
132 Lili Sahakyan et al.
Abstract
The primary purpose of this chapter is to provide an up-to-date review of the
twenty-first century research and theory on list-method directed forgetting (DF) and
related phenomena like the context-change effect. Many researchers have assumed
that DF is diagnostic of inhibition, but we argue for an alternative, noninhibitory
account and suggest reinterpretation of earlier findings. We first describe what DF is
and the state of the art with regard to measuring the effect. Then, we review recent
evidence that brings DF into the family of effects that can be explained by global
memory models. The process-based theory we advocate is that the DF impairment
arises from mental context change and that the DF benefits emerge mainly but perhaps
not exclusively from changes in encoding strategy. We review evidence (some new to
this paper) that strongly suggests that DF arises from the engagement of controlled
forgetting strategies that are independent of whether people believed the forget cue
or not. Then we describe the vast body of literature supporting that forgetting strategies
result in contextual change effects, as well as point out some inconsistencies in the DF
literature that need to be addressed in future research. Next, we provide evidence—
again, some of it new to this chapter—that the reason people show better memory
after a forget cue is that they change encoding strategies. In addition to reviewing
List-Method Directed Forgetting in Cognitive and Clinical Research 133
the basic research with healthy population, we reinterpret the evidence from the litera-
ture on certain clinical populations, providing a critique of the work done to date and
outlining ways of improving the methodology for the study of DF in special populations.
We conclude with a critical discussion of alternative approaches to understanding DF.
1. INTRODUCTION
Forgetting is often a passive process that happens regardless of our con-
scious intentions. However, this is not always the case; forgetting sometimes
is an active process of intentionally engaging strategies that reduce memory
for material that interferes with one’s current goals. To this end, forget-
ting can be an adaptive process. For example, to use software that has been
recently updated, the user must forget the prior ways of doing things to
avoid errors. Similarly, we are often told “never mind, forget what I just said”
following exposure to erroneous information.
Intentional forgetting has been studied extensively in the laboratory via
directed forgetting (DF) manipulations, which produce impaired mem-
ory for material following an instruction to try to forget. In DF studies,
participants study some information and are subsequently told to forget
certain portions of it. The list-method instructs people to forget an entire list
of earlier studied items, whereas the item-method instructs people to forget or
remember on item-by-item basis. Both methods demonstrate forgetting of
unwanted information on demand, although the way by which forgetting
is accomplished differs between procedures.
This chapter primarily centers on list-method DF, partly because the
mechanisms proposed to explain it have been a topic of active debate in the
recent decade, and partly because the presumed connection with inhibitory
processes has made the paradigm an attractive diagnostic tool for investigat-
ing clinical and special populations.We provide an up-to-date review of DF
and related phenomena (e.g. the context-change paradigm) with a focus on
studies conducted since 2000. There is already an excellent edited volume
describing twentieth century DF research (Golding & MacLeod, 1998).
We will begin by describing methodological issues in list-method DF.
The designs used to study DF in cognitive research have evolved to keep
pace with theoretical and methodological developments, and so we will
review the difficulties posed by earlier designs and suggest better-controlled
procedures. We will then outline our broad theory of DF and describe the
large number of studies supporting that broad theory, as well as areas of cur-
rent controversy in DF. Even researchers who are familiar with our previous
134 Lili Sahakyan et al.
manifestos on this topic may find this section interesting, as our view has
evolved and expanded even since 2010, and because we will present pre-
viously unpublished data that bear on a number of issues. Finally, we will
explore how the theory can inform studies of individual differences, espe-
cially in clinical populations, and make recommendations for conducting
such studies.
have allowed participants to recall all items in any order (Golding & G ottlob,
2005; Joslyn & Oakes, 2005; Minnema & Knowlton, 2008; Wessel &
Merckelbach, 2006; Zellner & Bäuml, 2006).
One obvious concern is that differences in output order might affect
DF through output interference (Anderson, 2005). Output interference is
the finding that retrieving some items from a set first reduces the likelihood
of retrieving the rest of the set (Dong, 1972; Roediger, 1974; Roediger &
Schmidt, 1980; Tulving & Arbuckle, 1966). In DF, when test order is not
controlled people might be inclined to begin recall with L2 items due to
recency, causing output interference on L1 items. Given that L2 is better
remembered in the forget group than the remember group, there may be
greater output interference on L1 in the forget group. Indeed, when left
to recall lists in any order, participants prefer to initiate recall with postcue
remember items, thereby resulting in an effect of output order (Golding &
Gottlob, 2005). However, a recent meta-analysis of list-method DF stud-
ies that included both forget and remember groups did not support this
notion; initiating retrieval with L2 did not exaggerate the magnitude of
DF costs, although it made it easier to detect the DF benefits (Pastötter
et al., 2012). Although these results suggest that output order affects the
benefits more than the costs (at least with unrelated items across the lists),
we nevertheless suggest fully controlling the test order of each list to obtain
more “pure” measures of recall uncontaminated by prior retrieval. Output
interference could become a particularly thorny issue if the lists contain a
mixture of items (e.g. neutral and emotional words), which could create
different degrees of output interference if the test order is left uncontrolled.
Another procedural inconsistency across DF studies is whether a control
group is included in the design. In the past, many DF paradigms have failed
to include a control group wherein both L1 and L2 presentations are fol-
lowed by a remember cue. In such paradigms, the magnitude of forgetting
was quantified by comparing recall performance for the forget list (L1)
relative to the remember list (L2). This measure is referred to as the “R–F”
measure. The justification for not including a control group is based on the
notion that the only ostensible difference between L1 and L2 is the type of
cue received. However, there are several confounding variables that high-
light the necessity for a control group. First, heightened recall performance
for L2 items could be attributed to a recency effect, making it difficult to
assume that L2 gains are a result of L1 forgetting. Second, increased acces-
sibility for L2 items may be attributed to learning effects. That is, following
L1 exposure, participants may be more adapted to the procedure, leading
136 Lili Sahakyan et al.
them to shift their encoding strategies for L2 items. Finally, reduced recall
performance for L1 items may be attributed to retroactive interference
accrued from L2 items. In other words, at the time of recall, L1 accessibility
is reduced due to the interference built up from L2 encoding. Given the
number of alternative explanations for reduced L1 recall and heightened
L2 recall, it is challenging to attribute these findings solely to DF with-
out comparing recall performance to a control group that was required to
remember both lists.
Such results are important not only for demonstrating that forgetting is an
active process that requires conscious activity in order to forget, but also for
explaining individual differences—including between-group differences—
in the ability to forget unwanted information.
0.45
Remember Forget-did something Forget-did nothing
0.40
0.35
Proportion list 1 recall
0.30
0.25
0.20
0.15
0.10
0.05
0.00
"yes" "no"
Believing the forget cue
Figure 4.2 Directed forgetting impairment as a function of belief in the cue and
controlled forgetting strategies. (New figure based on the data reported in Foster and
Sahakyan (2011)).
that intention to learn, per se, is not important for remembering, but rather
what people do to learn the information is what matters (Hyde & Jenkins,
1973; Mandler, 1967; Postman, 1964), the findings of Foster and Sahakyan
(2011) demonstrate that merely believing the forget cue is not sufficient
for demonstrating DF; what matters is what people do in response to the
forget cue (see also Mulji & Bodner, 2010). Second, because believing the
forget cue is not critical for obtaining DF, future research should be less
concerned about staging an event to make the forget cue more b elievable
(e.g. simulating a computer crash in the middle of the experiment), and
should instead be more vigilant about reporting whether participants
engaged in DF or not. For example, the absence of DF in certain condi-
tions or certain populations could simply be linked to “doing nothing”.
Finally, u
nderstanding why some participants engage in DF whereas others
do not should become a priority for future research as it will help to pro-
vide insights for understanding DF in special populations.
though, the “do nothing” people show recall levels comparable to that of
the remember group. Maybe some people simply cannot formulate a strat-
egy in a brief period of time between the lists. Most experiments deliver
the forget cue and move on to the second list right away. Indeed, some of
the participants in our experiment reported “I didn’t do anything in particular,
there wasn’t enough time,” or “I wanted to forget but didn’t know how to forget,
so I didn’t do anything,” suggesting that extending the postcue time might
increase the chances of obtaining DF or produce larger-than-normal effects.
These reports also indicate that one may want to forget but be unable
to formulate a strategy. It is essential to be mindful of these issues when
interpreting DF performance among special populations, who may have
difficulty self-initiating a controlled strategy.
Metacognitive beliefs could also play a role in why some participants fail
to engage in DF. For example, if participants have a preexisting belief that
their memory is not good even before they attempt to memorize the mate-
rial in an experiment, then they may be less likely to engage in DF because
they may believe that they already forgot. Indeed, a study in our lab with
older adults revealed this problem (Sahakyan, Delaney, & Goodmon, 2008).
Many older adults, in response to the forget cue, spontaneously volunteered
that they had already forgotten. Not surprisingly, they did not engage in
DF. We consequently modified DF instructions that emphasized the need
to engage in forgetting despite the beliefs that they already forgot, and we
found that such instructions were more conducive for obtaining DF with
older adults than were the standard instructions.
Figure 4.3 Directed forgetting impairment as a function of cue and aggregate predic-
tions of list 1 learning. (New figure based on the data reported in Sahakyan, Delaney, and
Kelley (2004)).
Figure 4.3 shows L1 recall during the final test as a function of JOLs
and the cue. As the figure demonstrates, DF impairment was larger when
participants anticipated recalling many L1 items than when they antici-
pated recalling few L1 items. Although we did not collect forgetting strat-
egy reports in that study, it is possible that the more people expected to
remember from the first list, the more likely they were to engage in DF. In
contrast, if they felt they could not remember L1 that well, they may have
been less likely to engage in DF. Individual differences in JOLs could be
correlated with other variables that are involved in this effect (e.g. higher
intelligence or working memory capacity), but these data are consistent
with the idea that beliefs about memory could contribute to list-method
DF (for a demonstration of how item-by-item JOLs affect item-method DF,
see Foster & Sahakyan, 2012).
0.45
Forget-did something Forget-did nothing Remember
0.40
0.35
Proportion list 1 recall
0.30
0.25
0.20
0.15
0.10
0.05
0.00
"It is possible to intentionally forget" "It is NOT possible to intentionally forget"
0.35
0.30
0.25
10% 31% 100%
0.20
0.15 21% 8%
12%
0.10
19%
0.05
0.00
Stop Stop thinking Focus on Diverting Clearing head Nothing Remember
rehearsing upcoming thoughts
0.40
0.35
0.30
21% 8%
0.25 19% 10% 31%
thoughts in order to forget. Figure 4.5 confirms that this strategy leads
to the largest DF impairment (although other strategies could also con-
tribute to DF). We reasoned that engaging in diversionary thoughts could
change peoples’ mental context between L1 and L2. Recently, Lehman
and Malmberg (2009) developed a computational model of DF within the
framework of search of associative memory, by capitalizing on our notion
of context change between the lists, and the difficulty reinstating L1 context
during the test in the forget group.
In this section, we review the findings from various conditions that were
predicted to interact with list-method DF based on the context-change
mechanism along with other theoretically relevant findings.
Because performance on the forget and the remember items did not
differ on recognition tests (or on implicit tests), the inhibitory account pro-
posed that those items were released from inhibition by virtue of being
represented during the test (e.g. Bjork, 1989; Bjork & Bjork, 1996, 2003;
Geiselman et al., 1983; Zellner & Bäuml, 2006). Although this explanation
is still rather popular, we think of it more as a description rather than a spe-
cific assumption or an explanation offered by theory. The release of inhibi-
tion was proposed mainly to reconcile the discrepant findings across the list
and the item methods. However, there is nothing a priori in the inhibitory
account to propose a release from inhibition on certain tests. For example,
assumptions of release are not made for the RIF phenomenon, which was
discovered much later than DF, and which is usually observed on recogni-
tion and lexical decision tests (e.g. Aslan & Bäuml, 2011; Hicks & Starns,
2004; Soriano, Jiménez, Román, & Bajo, 2009; Spitzer & Bäuml, 2007,
2009; Veling & van Knippenberg, 2004; Verde, 2004). If list-method DF
was observed on various memory tests just like the item-method, assump-
tions of release would not be made and the inhibitory interpretation of DF
would probably not even be proposed.
We have interpreted DF from the perspective of our contextual account,
and have a different take on the null effects of DF in various direct and indi-
rect tests. For example, the absence of DF in implicit memory tests is con-
sistent with the contextual account. Implicit tests do not require retrieval of
contextual information because they do not direct attention to the original
study episode. Since they do not require reinstating prior episodic context, we
would not expect to observe DF on such tests. Environmental context effects
also are not found on implicit tests (e.g. Parker, Gellatly, & Waterman, 1999).
The absence of DF in recognition is consistent with a body of literature
that shows that environmental context effects typically are not detected in
recognition (e.g. Godden & Baddeley, 1975). That said, the meta-analysis of
that literature revealed that under certain conditions, environmental con-
text effects do emerge in recognition, and those effects are larger when the
encoding processes are primarily nonassociative in nature (for a review, see
Smith & Vela, 2001). For example, a number of studies using nonwords or
unfamiliar faces as stimuli detected environmental context effects in recog-
nition (e.g. Dalton, 1993; Krafka & Penrod, 1985; Macken, 2002; Malpass &
Devine, 1981; Russo, Ward, Geurts, & Scheres, 1999; Smith & Vela, 1992).
Building on those findings, we predicted and obtained DF in recogni-
tion using nonword stimuli, despite not obtaining such effects using words
(Sahakyan, Waldum, Benjamin, & Bickett, 2009).
152 Lili Sahakyan et al.
list. Finally, Gottlob and Golding (2007) demonstrated that despite the lack
of list-method DF in the item recognition, the forget instruction impaired
source memory for color and case of L1 items.
Overall, the reports of significant list-method DF in item recognition
suggest that the typical conditions of recognition rather than the recogni-
tion test itself were the reasons for the observed lack of DF in previous
research. When stimuli or test conditions encouraged greater utilization
of global contextual information, DF was observed in recognition. These
results challenge the inhibitory interpretation because it does not a priori
predict the conditions under which the release can or cannot be obtained.
In contrast, these results fit well with the context account. As the need to
retrieve context increases, the likelihood of seeing list-method DF in item
recognition or recognition of source also increases.
One of the earlier explanations of DF involved selective rehearsal, and
some researchers lately acknowledged that this account should not be pre-
maturely dismissed for intentional learning (e.g. Benjamin, 2006; Sheard &
MacLeod, 2005). Considering that people often report stopping rehearsal in
response to the forget cue and that engaging in this type of strategy produces
DF impairment, we briefly discuss the results of recognition findings from
the perspective of selective rehearsal.The absence of DF in recognition tests
is particularly problematic for the selective rehearsal account because recog-
nition and recall are sensitive to elaborative rehearsal (Geiselman & Bjork,
1980), and recognition is even more sensitive than recall to rote rehearsal
(Benjamin & Bjork, 2000; Craik & Watkins, 1973).Thus, regardless of nature
of the rehearsal process involved in DF, terminating rehearsal of to-be-
forgotten items should have negative consequences for recognition memory.
We note that recognition is typically not at ceiling despite the short lists
used in many DF studies, and even longer lists do not lead to DF impair-
ment in recognition (Benjamin, 2006; Sahakyan & Delaney, 2005). Thus,
any explanation that attempts to revive the selective rehearsal account must
successfully deal with this limitation, and should also be able to explain why
recognition effects emerge under the specific conditions described above.
more than will more general temporal context cues (e.g. Raaijmakers &
Shiffrin, 1981). Successful initial recall would in turn provide a good retrieval
cue for subsequent items. Replicating prior work, DF was obtained with
unrelated lists. There was also significant DF with the categorized list as
long as the test cue was just the temporal context. In contrast, when a cat-
egory cue was used to test memory, the costs were eliminated, as predicted.
Lehman and Malmberg’s (2011a) findings highlight the importance of the
interaction between retrieval cues and the contents of memory at test: The
same categorical list can either show DF or be released from DF depending
on the type of retrieval cues utilized during the test. The more specific the
cue is to the L1 study context, the less likely DF is to be observed.
Note that another study conducted by Wilson, Kipp, and Chapman
(2003) obtained a different outcome with categorical lists, arguing that
categorical lists were resistant to DF. However, before the study of each
list, Wilson et al. (2003) drew special attention to the fact that the lists in
their study were either unrelated or categorical in nature.Their test instruc-
tions were not described in sufficient detail to infer what type of retrieval
cues were given to participants. Thus, methodological differences between
the two studies may be responsible for the discrepant findings. Note that
Sahakyan (2004) also obtained intact DF using different categorical items
across the lists while probing memory with temporal context cues.
Based on their findings, we predicted that spaced items should suffer more
when context changes because item-to-context associations are stronger for
spaced items. Indeed, our study showed that spaced items showed larger DF
impairment than did massed items. Similar results have also been obtained in
an environmental context-change study (Isarida & Morii, 1986). In contrast
to the spacing manipulation, we predicted that the depth of processing or
the extrastudy time manipulations should not interact with DF, and indeed
the results confirmed our predictions. Even though items studied for longer
duration were remembered better than items studied for shorter duration,
they showed equivalent impairment from DF. Taken together, these results
suggest that what determines interactions with DF is not the strength of the
items per se, but rather the strength of item-to-context associations. Along
the same lines, Waldum and Sahakyan (2012) found that statements incon-
gruent with one’s attitude show greater DF impairment than do congru-
ent statements. Using a variety of memory paradigms, they confirmed that
greater DF of incongruent statements was driven by stronger associations
with episodic context, entirely consistent with the context account.
Forget
0.40
Remember
0.35
Proportion list 1 recalled
0.30
0.25
0.20
0.15
0.10
0.05
0.00
"low" Context variability "high"
Figure 4.6 Directed forgetting impairment as a function of context variability of s tudied
items. (Based on unpublished data.)
the test, L1 was always tested before L2. Figure 4.6 summarizes the findings.
DF impairment was much greater for low-CV items than for high-CV
items, consistent with the predictions of the context account.
2000; Sahakyan & Goodmon, 2007). These findings are not consistent with an
inhibitory viewpoint that assumes suppression at the level of items. Specifically,
one would assume that when the two lists involve related items, then L1 items
may be more likely to come to mind during L2 learning and require greater
inhibition compared to when the two lists are unrelated. However, the results
show that related items across the lists reduce rather than increase DF.
Although items across the lists may be related to each other in a num-
ber of ways, our research showed that when L2 items remind participants
of L1 items due to backward associations (e.g. chip← chisel), DF is elimi-
nated, but when L1 items are related to L2 items via forward associations
(e.g. chip→ wood), DF remains intact (Sahakyan & Goodmon, 2007; for
arelated result using the item procedure, see Golding, Long, & MacLeod,
1994). We proposed several mechanisms by which related items could
reduce DF. First, reminding could reinstate the context of L1 during L2
learning, thereby preventing or reducing contextual differentiation between
the lists. Second, reminding could initiate retrieval of L1 items during L2
learning, thereby linking L1 items to the context of both lists. This would
enhance the probability of their retrieval even if L2 context is used as the
main retrieval cue during the test. Finally, reminding could strengthen L1
items via retrieval during L2, and enhanced strength of L1 items could also
make them resistant to DF.
(2010, 2012a, 2012b), who showed that both part-set cuing and also selec-
tive retrieval of a subset of L1 items can enhance recall of the remain-
ing L1 items in the forget group, while the same manipulations impaired
recall in the remember group. Similar effects were obtained in the men-
tal context-change paradigm (Bäuml & Samenieh, 2012a, 2012b). Prior
studies also showed that reexposure to L1 items on an intervening test
can release subsequent DF depending upon the nature of the intervening
test. The typical design of these studies involves (1) giving an initial test,
(2) reexposing all or a subset of items from both lists on an intervening
test, and (3) administering a final recall test. The intervening tests included
recognition (Basden et al., 1993; Basden et al., 2003; Bjork & Bjork, 1996),
word fragment completion (Basden et al., 2003; Bjork & Bjork, 1996),
implicit free association test (Basden et al., 1993), or a lexical decision
test intermixing all studied items with unstudied items and nonwords
(Racsmány & Conway, 2006). Although initial recall revealed significant
DF in these studies, the intervening tests did not (neither recognition,
nor lexical decision, nor fragment completion showed evidence of DF).
Importantly, the final recall findings differed depending upon the nature
of the intervening task. When the intervening test involved a recognition
test that included a subset of L1 items as lures, DF was released on a final
recall test. In contrast, intervening word fragment completion or lexical
decision tests did not release DF.
We interpret these findings to suggest that retrieval of contextual infor-
mation associated with the study episode is critical to reinstating access to
L1 items (similar arguments have been made by Bauml et al. for the part-set
cuing and part-set retrieval effects in the forget group). The fragment com-
pletion test is an indirect memory test because it does not direct the subject
to go back to the original learning episode, and it is considered mainly data
driven. Likewise, the lexical decision task does not require reinstating prior
episodic context.The intervening recognition test, however, is a direct mea-
sure of memory because the subject is instructed to think back to the learn-
ing episode and make a decision about a specific item (note that Bjork &
Bjork, 1996 included an exclusion instruction on the intervening test of
recognition, which would further facilitate retrieval of contextual informa-
tion).Thus, DF on the final free recall test is reduced when participants have
to think back to the original study episode and reinstate its episodic context.
In contrast, DF is unaffected by indirect tests that do not make any connec-
tion to the earlier study episode.
164 Lili Sahakyan et al.
5.14. Summary
The evidence that contextual change underlies DF impairment comes from
a wide range of experimental sources.The idea came about because partici-
pants in DF studies self-reported thinking of something else, and subsequent
research confirmed that this strategy was effective in producing forgetting.
Furthermore, context is used to explain many other findings in memory, so
it is not invented specifically to explain DF, and can be modeled in context-
based formal models of memory. Among the findings that are predictable
from a context viewpoint are that recognition does not show DF unless it
relies on retrieval of contextual information; that mentally reinstating the
original study context releases DF; that indirect memory tests do not show
DF because they do not redirect back to the context of the study episode;
that items more strongly associated with episodic context show greater DF;
that cuing the items with stronger extralist cues leads to larger rather than
smaller DF; that having strong reminders on L2 can reduce DF; that having
no L2 eliminates DF; that categorized items can be susceptible to DF or not
depending on whether the test cue involves context cue or a category cue.
In our view, the account is strongly supported by the existing data, and any
future theory should strive to not only explain the effects that the context-
change account predicts but also make novel predictions that cannot be
handled by the current theory.
Shortly after we proposed the context-change account of DF, Anderson
(2005) proposed that the context-change mechanism is compatible with an
inhibitory interpretation of DF if inhibition is assumed to be the mecha-
nism by which context change takes place. According to Anderson’s inter-
pretation, inhibition is a flexible mechanism that can be targeted at different
levels of representation, including at a context representation. We are reluc-
tant to embrace this notion because we do not see it as advancing our
theoretical understanding of DF. It redescribes context change with new
terms (i.e. inhibition of context) without specifying a new theory of inhi-
bition of context. There is currently no evidence to suggest that context
is inhibited as opposed to being changed across the lists in DF. Impaired
memory of L1 items does not constitute any evidence of inhibition of
context or indeed any inhibition at all (MacLeod et al., 2003). Equating
mental context change with inhibition of context implies that any time we
change what we are thinking about, we engage in inhibition. By this view,
everything becomes inhibition, and thus impossible to know what does not
involve inhibition. Inhibition of context also complicates the explanation of
List-Method Directed Forgetting in Cognitive and Clinical Research 165
whereas others do not. Note that Sahakyan and Foster (2009) obtained
equivalent DF impairment across L1 serial position curves of performed
actions phrases which typically do not produce primacy effects, suggesting
that the magnitude of DF impairment may not be linked to the primacy
effects. Considering these controversies and the methodological differences
that could have given rise to these findings, more careful attention is needed
to serial position effects in DF research.
starting out with some strategy on L2, but further down the list they report
being overwhelmed and being unable to keep it up.This could explain why
the benefits of DF are more prominent in the early sections of L2 serial
position curves than in later sections.
7.4. Summary
Most researchers now agree that DF benefits on L2 arise from a different
mechanism than the costs. We argued that the underlying factor is the
strategy change triggered by the forget cue. As with the context-change
mechanism, the idea for this came from verbal reports given by participants
List-Method Directed Forgetting in Cognitive and Clinical Research 171
0.50 Remember
Proportion recalled
0.40
0.30
0.20
0.10
0.00
List 1 (costs) List 2 (benefits) List 1 (costs) List 2 (benefits)
0.40
0.30
0.20
0.10
0.00
List 1 (costs) List 2 (benefits) List 1 (costs) List 2 (benefits)
that the same inhibitory deficits should occur there as well. We will review
evidence that is consistent with a context-based interpretation of clinical
difficulties in DF, and that other putatively “inhibitory” tasks do not show
the same pattern of deficits as DF, consistent with our theory. The notion
that DF impairments are linked to context processing (and not inhibition)
provides new ways of thinking about how DF elucidates clinical disorders.
Having shown that context may be important to clinical disorders, we
will next argue that many of the studies that have been conducted in the
clinical literature are lacking in rigor, and that improving the m
ethodological
rigor of future studies will be necessary to draw firmer conclusions from DF
research. We will provide specific advice for clinical researchers seeking to
use DF as a tool for understanding context processing in clinical disorders.
Without singling out any earlier study, we will suggest that many earlier
studies could be repeated with more recently developed methodologies
from the cognitive literature in order to yield more detailed conclusions
about disorders.
8.1.2. Schizophrenia
Impairments in DF sometimes co-occur with deficits in other inhibitory
tasks. For example, schizophrenia is thought to be associated with defi-
cits in memory and inhibitory control (for reviews, see Hoff & Krennan,
2002; Perlstein, Carter, Barch, & Baird, 1998), and therefore researchers who
believe that DF reflects inhibition should predict deficits in list-method
DF in schizophrenics. Several studies have tested this possibility. In our
judgment, these are among the best-conducted list-method DF studies in
the clinical literature, and should be viewed as models for others.
Racsmány et al. (2008) examined medicated schizophrenics. While the
control group showed robust costs and benefits, the schizophrenic patients
showed neither costs nor benefits. Their overall memory was also lower.
List-Method Directed Forgetting in Cognitive and Clinical Research 175
8.1.4. Depression
An even more interesting pattern would occur if a clinical problem improved
DF. A study by Power, Dalgeish, Claudio,Tata, and Kentish (2000) examined
subclinically dysphoric people, comparing people with low-Beck Depression
176 Lili Sahakyan et al.
one is interested in the costs, there is little evidence that the within-subjects
design distorts the effect, as reviewed earlier. It is important to counterbal-
ance the assignment of words to lists as well; at least one study obtained odd
results because they failed to ensure that the words assigned to the forget
condition were assigned to the remember condition for other participants,
and hence item effects emerged (Albu, 2008).The four-list procedure allows
the researcher to compute both costs and benefits using a powerful within-
subjects comparison, which is clearly advantageous. If there are concerns
about order effects, they can also be addressed using this design. If there are
serious order effects, one can also focus on only the first lists studied.
neutral words is occurring later than for trauma words for this participant.
Further, significant differences in output percentiles between groups would
be evidence for differences in output order of different types of items.
category. Of course, this restricts the kinds of tests that can be run with a
single design, but it is better to get meaningful answers about one or two
different types of item than to get meaningless floor effects with a large
number of different types of item.
9. CONCLUDING THOUGHTS
Obtaining DF requires engaging in controlled strategies, and the deci-
sion to engage in those strategies may be mediated by beliefs about one’s
182 Lili Sahakyan et al.
ACKNOWLEDGMENTS
The authors are grateful to Colleen Kelley, Colin MacLeod, and Tanya Jonker for their feed-
back and constructive comments on the earlier draft of this chapter.
REFERENCES
Albu, M. (2008). Automatic and intentional inhibition in patients with generalized anxiety
disorder. Cognition, Brain, & Behavior, 12, 233–249.
Anderson, M. C. (2003). Rethinking interference theory: executive control and the
mechanisms of forgetting. Journal of Memory and Language, 49(4), 415–445.
Anderson, M. C. (2005). The role of inhibitory control in forgetting unwanted memories:
a consideration of three methods. In C. MacLeod & B. Uttl (Eds.), Dynamic cognitive
processes (pp. 159–190). Tokyo: Springer-Verlag.
List-Method Directed Forgetting in Cognitive and Clinical Research 183
Anderson, M. C., Bjork, R. A., & Bjork, E. L. (1994). Remembering can cause forgetting:
retrieval dynamics in long-term memory. Journal of Experimental Psychology: Learning,
Memory, and Cognition, 20, 1063–1087.
Anderson, J. R., & Bower, G. H. (1972). Recognition and retrieval processes in free recall.
Psychological Review, 79(2), 97–123.
Aslan, A., & Bäuml, K. T. (2008). Memorial consequences of imagination in children and
adults. Psychonomic Bulletin & Review, 15(4), 833–837.
Aslan, A., & Bäuml, K. T. (2011). Individual differences in working memory capacity pre-
dict retrieval-induced forgetting. Journal of Experimental Psychology: Learning, Memory, and
Cognition, 37(1), 264–269.
Aslan, A., Zellner, M., & Bäuml, K. T. (2010). Working memory capacity predicts listwise
directed forgetting in adults and children. Memory, 18(4), 442–450.
Barkley, R. A. (1997). Behavioral inhibition, sustained attention, and executive functions:
Constructing a unifying theory of ADHD. Psychological Bulletin, 121, 65–94.
Barnier, A. J., Conway, M. A., Mayoh, L., Speyer, J., Avizmil, O., & Harris, C. B. (2007).
Directed forgetting of recently recalled autobiographical memories. Journal of Experimen-
tal Psychology: General, 136(2), 301–322.
Basden, B. H., & Basden, D. R. (1996). Directed forgetting: further comparisons of the item
and list methods. Memory, 4(6), 633–653.
Basden, B. H., & Basden, D. R. (1998). Directed forgetting: a contrast of methods and inter-
pretations. In J. M. Golding & C. M. MacLeod (Eds.), Intentional forgetting: Interdisciplinary
approaches (pp. 139–172). Mahwah, NJ US: Lawrence Erlbaum Associates Publishers.
Basden, B. H., Basden, D. R., & Gargano, G. J. (1993). Directed forgetting in implicit and
explicit memory tests: a comparison of methods. Journal of Experimental Psychology:
Learning, Memory, and Cognition, 19(3), 603–616.
Basden, B. H., Basden, D. R., & Morales, E. (2003).The role of retrieval practice in directed for-
getting. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29(3), 389–397.
Basden, B. H., Basden, D. R., & Wright, M. J. (2003). Part-list reexposure and release of
retrieval inhibition. Consciousness and Cognition: An International Journal, 12(3), 354–375.
Bäuml, K. H. (2008). Inhibitory processes. In H. L. RoedigerIII (Ed.), Cognitive psychology of
memory (pp. 195–220). Oxford: Elsevier.
Bäuml, K.-H., Hanslmayr, S., Pastotter, B., & Klimesch, W. (2008). Oscillatory correlates of
intentional updating in episodic memory. NeuroImage, 41, 596–604.
Bäuml, K. T., & Samenieh, A. (2010). The two faces of memory retrieval. Psychological Science,
21(6), 793–795.
Bäuml, K.T., & Samenieh, A. (2012a). Influences of part-list cuing on different forms of episodic
forgetting. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38(2), 366–375.
Bäuml, K. T., & Samenieh, A. (2012b). Selective memory retrieval can impair and improve
retrieval of other memories. Journal of Experimental Psychology: Learning, Memory, and
Cognition, 38(2), 488–494.
Benjamin, A. S. (2006). The effects of list-method directed forgetting on recognition mem-
ory. Psychonomic Bulletin & Review, 13, 831–836.
Benjamin, A. S., & Bjork, R. A. (2000). On the relationship between recognition speed and
accuracy for words rehearsed via rote versus elaborative rehearsal. Journal of Experimental
Psychology: Learning, Memory, and Cognition, 26(3), 638–648.
Bjork, R. A. (1970). Positive forgetting: the noninterference of items intentionally forgotten.
Journal of Verbal Learning and Verbal Behavior, 9, 255–268.
Bjork, R. A. (1972). Theoretical implications of directed forgetting. In A. W. Melton &
E. Martin (Eds.), Coding processes in human memory (pp. 217–325). Washington, D. C.:
V. H. Winston & Sons.
Bjork, R. A. (1989). Retrieval inhibition as an adaptive mechanism in human memory. In
H. Roediger & F. M. Craik (Eds.), Varieties of memory and consciousness: Essays in honour
of Endel Tulving (pp. 309–330). Hillsdale, NJ England: Lawrence Erlbaum Associates, Inc.
184 Lili Sahakyan et al.
Foster, N. L., & Sahakyan, L. (2011). The role of forget-cue salience in list-method directed
forgetting. Memory, 19, 110–117.
Foster, N. L., & Sahakyan, L. (2012). Metacognition influences item-method directed forget-
ting. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38, 1309–1324.
Gaultney, J. F., Kipp, K., Weinstein, J., & McNeill, J. (1999). Inhibition and mental effort in
attention deficit hyperactivity disorder. Journal of Developmental and Physical Disabilities,
11(2), 105–114.
Geiselman, R. E., & Bjork, R. A. (1980). Primary versus secondary rehearsal in imagined
voices: differential effects on recognition. Cognitive Psychology, 12(2), 188–205.
Geiselman, R. E., Bjork, R. A., & Fishman, D. (1983). Disrupted retrieval in directed forget-
ting: a link with posthypnotic amnesia. Journal of Experimental Psychology: General, 112,
58–72.
Gillund, G., & Shiffrin, R. M. (1984). A retrieval model for both recognition and recall.
Psychological Review, 91(1), 1–67.
Godden, D. R., & Baddeley, A. D. (1975). Context-dependent memory in two natural envi-
ronments: on land and underwater. British Journal of Psychology, 66(3), 325–331.
Goernert, P. N., & Larson, M. E. (1994). The initiation and release of retrieval inhibition.
Journal of General Psychology, 121, 61–66.
Golding, J. M., & Gottlob, L. R. (2005). Recall order determines the magnitude of directed
forgetting in the within-participants list method. Memory & Cognition, 33(4), 588–594.
Golding, J. M., & Keenan, J. M. (1985). Directed forgetting and memory for directions to a
destination. American Journal of Psychology, 98, 579–590.
Golding, J. M., Long, D. L., & MacLeod, C. M. (1994).You can’t always forget what you want:
directed forgetting of related words. Journal of Memory and Language, 33, 493–510.
Golding, J. M., & MacLeod, C. M. (1998). Intentional forgetting: Interdisciplinary
approaches. Mahwah, NJ US: Lawrence Erlbaum Associates Publishers.
Gottlob, L. R., & Golding, J. M. (2007). Directed forgetting in the list method affects recogni-
tion memory for source. Quarterly Journal of Experimental Psychology, 60(11), 1524–1539.
Hanczakowski, M., Pasek, T., & Zawadska, K. (2012). Context-dependent impairment of
recollection in list-method directed forgetting. Memory.
Hanslmayr, S.,Volberg, G., Wimber, M., Oehler, N., Staudigl, T., HYartmann, T., et al. (2012).
Prefrontally driven downregulation of neural synchrony medicated goal-directed
forgetting. Journal of Neuroscience.
Hicks, J. L., & Starns, J. J. (2004). Retrieval-induced forgetting occurs in tests of item
recognition. Psychonomic Bulletin & Review, 11(1), 125–130.
Hintzman, D. L. (1988). Judgments of frequency and recognition memory in a multiple-trace
memory model. Psychological Review, 95(4), 528–551.
Hoff, A. L., & Krennan, W. S. (2002). Is there a cognitive phenotype for schizophrenia: the
nature and course of the disturbance in cognition? Current Opinion in Psychiatry, 15,
43–48.
Howard, M. W., & Kahana, M. J. (2002). A distributed representation of temporal context.
Journal of Mathematical Psychology, 46(3), 269–299.
Hyde, T. S., & Jenkins, J. J. (1973). Recall for words as a function of semantic, graphic, and
syntactic orienting tasks. Journal of Verbal Learning and Verbal Behavior, 12(5), 471–480.
Isarida, T., & Morii, Y. (1986). Contextual dependence of the spacing effect in free recall.
Japanese Journal of Psychology, 57(1), 20–26.
Jang,Y., & Huber, D. E. (2008). Context retrieval and context change in free recall: recalling
from long-term memory drives list isolation. Journal of Experimental Psychology: Learning,
Memory, and Cognition, 34, 112–127.
Joormann, J., Levens, S. M., & Gotlib, I. H. (2011). Sticky thoughts: depression and rumi-
nation are associated with difficulties manipulating emotional material in working
memory. Psychological Science, 22(8), 979–983.
186 Lili Sahakyan et al.
Joormann, J., & Tran, T. B. (2009). Rumination and intentional forgetting of emotional
material. Cognition and Emotion, 23(6), 1233–1246.
Joslyn, S. L., & Oakes, M. A. (2005). Directed forgetting of autobiographical events. Memory
& Cognition, 33(4), 577–587.
Kimball, D. R., & Bjork, R. A. (2002). Influences of intentional and unintentional forgetting
on false memories. Journal Of Experimental Psychology: General, 131, 116–130.
Koppel, R. H., & Storm, B. C. (2012). Unblocking memory through directed forgetting.
Journal of Cognitive Psychology.
Krafka, C., & Penrod, S. (1985). Reinstatement of context in a field experiment on eyewit-
ness identification. Journal of Personality and Social Psychology, 49(1), 58–69.
Lehman, M., & Malmberg, K. J. (2009). A global theory of remembering and forgetting from
multiple lists. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(4),
970–988.
Lehman, M., & Malmberg, K. J. (2011a). Overcoming the effects of intentional forgetting.
Memory & Cognition, 39(2), 335–347.
Lehman, M., & Malmberg, K. J. (2011b, November). Modeling intentional forgetting
in depressed participants. (Poster presentation at the 52nd annual meeting of the
Psychonomic Society, Seattle, WA).
Liu, X. (2001). On the dynamics of directed forgetting: facilitation and interference in the
updating of human memory. Dissertation Abstracts International, 61(11), 6159B.
Macken, W. J. (2002). Environmental context and recognition: the role of recollection and
familiarity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(1),
153–161.
MacLeod, C. M. (1975). Long-term recognition and recall following directed forgetting.
Journal of Experimental Psychology: Human Learning and Memory, 1, 271–279.
MacLeod, C. M. (1998). Directed forgetting. In J. M. Golding & C. M. MacLeod (Eds.),
Intentional forgetting: Interdisciplinary approaches (pp. 1–57). Mahwah, NJ: Erlbaum.
MacLeod, C. M. (1999).The item and list methods of directed forgetting: test differences and
the role of demand characteristics. Psychonomic Bulletin & Review, 6(1), 123–129.
MacLeod, C. M., Dodd, M. D., Sheard, E. D., Wilson, D. E., & Bibi, U. (2003). In opposition
to inhibition. In B. H. Ross (Ed.), The psychology of learning and motivation: Advances in
research and theory (Vol. 43, pp. 163–214). New York, NY US: Elsevier Science.
Macrae, C., Bodenhausen, G.V., Milne, A. B., & Ford, R. L. (1997). On regulation of recollec-
tion: the intentional forgetting of stereotypical memories. Journal of Personality and Social
Psychology, 72(4), 709–719.
Malmberg, K. J., & Shiffrin, R. M. (2005). The ‘One-Shot’ hypothesis for context storage.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(2), 322–336.
Malpass, R. S., & Devine, P. G. (1981). Guided memory in eyewitness identification. Journal
of Applied Psychology, 66(3), 343–350.
Mandler, G. (1967). Organization and memory. In K. W. Spence & J. T. Spence (Eds.), The
psychology of learning and motivation. (Vol. 1). New York: Academic Press.
Marsh, R. L., Meeks, J., Hicks, J. L., Cook, G. I., & Clark-Foos, A. (2006). Concreteness and
item-to-list context associations in the free recall of items differing in context variability.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(6), 1424–1430.
McNally, R. J. (2005). Directed forgetting tasks in clinical research. In A. Wenzel & D. C.
Rubin (Eds.), Cognitive methods and their application to clinical research (pp. 197–212).
Washington, DC: American Psychological Association.
McNally, R. J., Metzger, L. J., Lasko, N. B., Clancy, S. A., & Pitman, R. K. (1998). Directed
forgetting of trauma cues in adult survivors of childhood sexual abuse with and without
posttraumatic stress disorder. Journal of Abnormal Psychology, 107, 596–601.
Mensink, G., & Raaijmakers, J. G. (1988). A model for interference and forgetting. Psychologi-
cal Review, 95, 434–455.
List-Method Directed Forgetting in Cognitive and Clinical Research 187
Minnema, M. T., & Knowlton, B. J. (2008). Directed forgetting of emotional words. Emotion,
8(5), 643–652.
Mulji, R., & Bodner, G. E. (2010). Wiping out memories: new support for a mental context
change account of directed forgetting. Memory, 18, 763–773.
Nelson, D. L., Goodmon, L. B., & Ceo, D. (2007). How does delayed testing reduce effects of
implicit memory: context infusion or cuing with context? Memory & Cognition, 35(5),
1014–1023.
Nelson, D., & McEvoy, C. L. (2005). Implicitly activated memories: the missing links of
remembering. In C. Izawa & N. Ohta (Eds.), Human learning and memory: Advances in
theory and application: The 4th Tsukuba International Conference on memory (pp. 177–198).
Mahwah, NJ US: Lawrence Erlbaum Associates Publishers.
Nelson, D. L., McKinney, V. M., Gee, N. R., & Janczura, G. A. (1998). Interpreting the
influence of implicitly activated memories on recall and recognition. Psychological Review,
105(2), 299–324.
Parker, A., Gellatly, A., & Waterman, M. (1999). The effect of environmental context manip-
ulation on memory: dissociation between perceptual and conceptual implicit tests.
European Journal of Cognitive Psychology, 11(4), 555–570.
Pastötter, B., & Bäuml, K.-H. (2007). The crucial role of post-cue encoding in directed
forgetting and context-dependent forgetting. Journal of Experimental Psychology: Learning,
Memory, and Cognition, 33, 977–982.
Pastötter, B., & Bäuml, K. (2010). Amount of postcue encoding predicts amount of directed
forgetting. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36(1), 54–65.
Pastötter, B., Bäuml, K. H., & Hanslmayr, S. (2008). Oscillatory brain activity before and after
an internal context change—evidence for a reset of encoding processes. NeuroImage, 43,
173–181.
Pastötter, B., Kliegl, O., & Bäuml, K. T. (2012). List-method directed forgetting: the forget
cue improves both encoding and retrieval of postcue information. Memory & Cognition,
40(6), 861–873.
Perlstein, W. M., Carter, C. S., Barch, D. M., & Baird, J. (1998). The Stroop task and
attention deficits in schizophrenia: a critical evaluation of card and single-trial Stroop
methodologies. Neuropsychology, 12, 414–425.
Postman, L. (1964). Acquisition and retention of consistent associative responses. Journal of
Experimental Psychology, 67(2), 183–190.
Power, M. J., Dalgleish, T. T., Claudio, V. V., Tata, P. P., & Kentish, J. J. (2000). The directed
forgetting task: Application to emotionally valent material. Journal Of Affective Disorders,
57, 147–157.
Raaijmakers, J. G. W., & Jakab, E. (2013). Rethinking inhibition theory: On the problematic
status of the inhibition theory for forgetting. Journal of Memory and Language, 68, 98–122.
Raaijmakers, J. G. W., & Shiffrin, R. M. (1981). Search of associative memory. Psychological
Review, 88, 93–134.
Racsmány, M., & Conway, M. A. (2006). Episodic inhibition. Journal of Experimental
Psychology: Learning, Memory, and Cognition, 32, 44–57.
Racsmány, M., Conway, M. A., Garab, E. A., Cimmer, C., Janka, Z., Kurimay,T., et al. (2008).
Disrupted memory inhibition in schizophrenia. Schizophrenia Research, 101(1–3),
218–224.
Racsmány, M., Conway, M. A., Garab, E. A., & Nagymáté, G. (2008). Memory awareness
following episodic inhibition. Quarterly Journal of Experimental Psychology, 61(4), 525–534.
Reitman, W., Malin, J. T., Bjork, R. A., & Higman, B. (1973). Strategy control and directed
forgetting. Journal Of Verbal Learning & Verbal Behavior, 12, 140–149.
Roediger, H. L. (1974). Inhibiting effects of recall. Memory & Cognition, 2(2), 261–269.
Roediger, H., & Karpicke, J. D. (2006).Test-enhanced learning: taking memory tests improves
long-term retention. Psychological Science, 17(3), 249–255.
188 Lili Sahakyan et al.
Roediger, H. L., & Schmidt, S. R. (1980). Output interference in the recall of categorized
and paired-associate lists. Journal of Experimental Psychology: Human Learning and Memory,
6(1), 91–105.
Russo, R., Ward, G., Geurts, H., & Scheres, A. (1999). When unfamiliarity matters: chang-
ing environmental context between study and test affects recognition memory for
unfamiliar stimuli. Journal of Experimental Psychology: Learning, Memory, and Cognition,
25(2), 488–499.
Sahakyan, L. (2004). Destructive effects of ‘forget’ instructions. Psychonomic Bulletin & Review,
11(3), 555–559.
Sahakyan, L., & Delaney, P. F. (2003). Can encoding differences explain the benefits of directed
forgetting in the list-method paradigm? Journal of Memory and Language, 48, 195–201.
Sahakyan, L., & Delaney, P. F. (2005). Directed forgetting in incidental learning and recogni-
tion testing: support for a two-factor account. Journal of Experimental Psychology: Learning,
Memory, and Cognition, 31, 789–801.
Sahakyan, L., & Delaney, P. F. (2010). Item-specific encoding produces an additional benefit
of directed forgetting: evidence from intrusion errors. Journal of Experimental Psychology:
Learning, Memory, and Cognition, 36(5), 1346–1354.
Sahakyan, L., Delaney, P. F., & Goodmon, L. B. (2008). “Oh, honey, I already forgot that”:
strategic control of directed forgetting in older and younger adults. Psychology and Aging,
23, 621–633.
Sahakyan, L., Delaney, P. F., & Kelley, C. M. (2004). Self-evaluation as a moderating factor
in strategy change in directed forgetting benefits. Psychonomic Bulletin & Review, 11,
131–134.
Sahakyan, L., Delaney, P. F., & Waldum, E. R. (2008). Intentional forgetting is easier after two
‘shots’ than one. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(2),
408–414.
Sahakyan, L., & Foster, N. L. (2009). Intentional forgetting of action: comparison of list-
method and item-method directed forgetting. Journal of Memory and Language, 61, 134–152.
Sahakyan, L., & Goodmon, L. B. (2007).The influence of directional associations on directed
forgetting and interference. Journal of Experimental Psychology: Learning, Memory, and
Cognition, 33, 1035–1049.
Sahakyan, L., & Goodmon, L. B. (2010). Theoretical implications of extralist probes for
directed forgetting. Journal of Experimental Psychology: Learning, Memory, and Cognition,
36(4), 920–937.
Sahakyan, L., & Kelley, C. M. (2002). A contextual change account of the directed forgetting
effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28, 1064–1072.
Sahakyan, L., Waldum, E. R., Benjamin, A. S., & Bickett, S. P. (2009). Where is the forget-
ting with list-method directed forgetting in recognition? Memory & Cognition, 37(4),
464–476.
Shapiro, S., Lindsey, C., & Krishnan, H. (2006). Intentional forgetting as a facilitator for recalling
new product attributes. Journal of Experimental Psychology: Applied, 12(4), 251–263.
Sheard, E. D., & MacLeod, C. M. (2005). List method directed forgetting: return of the
selective rehearsal account. In N. Ohta, C. M. MacLeod & B. Uttl (Eds.), Dynamic
cognitive processes (pp. 219–248). Tokyo: Springer.
Smith, S. M. (1979). Remembering in and out of context. Journal of Experimental Psychology:
Human Learning and Memory, 5, 460–471.
Smith, E. E., Barresi, J., & Gross, A. E. (1971). Imaginal versus verbal coding and the
primary-secondary memory distinction. Journal of Verbal Learning and Verbal Behavior,
10(6), 597–603.
Smith, S. M., & Vela, E. (1992). Environmental context-dependent eyewitness recognition.
Applied Cognitive Psychology, 6, 125–139.
Smith, S. M., & Vela, E. (2001). Environmental context-dependent memory: a review and
meta-analysis. Psychonomic Bulletin & Review, 8, 203–220.
List-Method Directed Forgetting in Cognitive and Clinical Research 189
Soriano, M. F., & Bajo, M.T. (2007).Working memory resources and interference in directed-
forgetting. Psicológica, 28, 63–85.
Soriano, M. F., Jiménez, J. F., Román, P., & Bajo, M. T. (2009). Intentional inhibition in
memory and hallucinations: directed forgetting and updating. Neuropsychology, 23,
61–70.
Spillers, G. J., & Unsworth, N. (2011). Are the costs of directed forgetting due to failures
of sampling or recovery? Exploring the dynamics of recall in list-method directed
forgetting. Memory & Cognition, 39(3), 403–411.
Spitzer, B., & Bäuml, K. (2007). Retrieval-induced forgetting in item recognition: evidence
for a reduction in general memory strength. Journal of Experimental Psychology: Learning,
Memory, and Cognition, 33(5), 863–875.
Spitzer, B., & Bäuml, K. (2009). Retrieval-induced forgetting in a category recognition task.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(1), 286–291.
Steyvers, M., & Malmberg, K. J. (2003). The effects of normative context variability on rec-
ognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29,
760–766.
Storm, B. C., & Levy, B. J. (2012). A progress report on the inhibitory account of
retrieval-induced forgetting. Memory & Cognition, 40(6), 827–843.
Tulving, E. (1983). Elements of episodic memory. New York: Oxford.
Tulving, E., & Arbuckle, T.Y. (1966). Input and output interference in short-term associative
memory. Journal of Experimental Psychology, 72, 145–150.
Unsworth, N., & Engle, R. W. (2008). Speed and accuracy of accessing information in
working memory: an individual differences investigation of focus switching. Journal of
Experimental Psychology: Learning, Memory, and Cognition, 34(3), 616–630.
Unsworth, N., Spillers, G. J., & Brewer, G. A. (2012). Dynamics of context-dependent recall:
an examination of internal and external context change. Journal of Memory and Language,
66(1), 1–16.
Vadnais, S. A., Behm, A., Laake, L. M., Lopez, N. M., Oddi, K. B., Wu, K., et al. (2012,
May). Executive function correlates of symptoms of specific anxiety disorders and major
depression. (Poster presented at the 24th Annual Convention of the Association for
Psychological Science). Chicago, IL.
Veling, H., & van Knippenberg, A. (2004). Remembering can cause inhibition: retrieval-
induced inhibition as cue independent process. Journal of Experimental Psychology:
Learning, Memory, and Cognition, 30(2), 315–318.
Verde, M. F. (2004). The retrieval practice effect in associative recognition. Memory &
Cognition, 32, 1265–1272.
Waldum, E. R., & Sahakyan, L. (2012). Putting congeniality effects into context: investigating
the role of context in attitude memory using multiple paradigms. Journal of Memory and
Language, 66(4), 717–730.
Wessel, I., & Merckelbach, H. (2006). Forgetting “murder” is not harder than forgetting
“circle”: listwise-directed forgetting of emotional words. Cognition and Emotion, 20,
129–137.
Whetstone, T., Cross, M. D., & Whetstone, L. M. (1996). Inhibition, contextual segregation,
and subject strategies in list method directed forgetting. Consciousness and Cognition, 5,
395–417.
White, H. A., & Marks, W. (2004). Updating memory in list-method directed forgetting:
individual differences related to adult attention-deficit/hyperactivity disorder. Personality
and Individual Differences, 37, 1453–1462.
Wilson, S., Kipp, K., & Chapman, K. (2003). Limits of the retrieval-inhibition construct: list
segregation in directed forgetting. Journal of General Psychology, 130(4), 341–358.
Zellner, M., & Bäuml, K. (2006). Inhibitory deficits in older adults: list-method directed
forgetting revisited. Journal of Experimental Psychology: Learning, Memory, and Cognition,
32(2), 290–300.
This page intentionally left blank
CHAPTER FIVE
Contents
1. Introduction192
2. Recognition Memory 192
3. Models of Memory 193
3.1. Threshold-Based Models 193
3.2. Continuous Models 195
3.3. Hybrid Models 196
4. Estimating Recollection and Familiarity 198
4.1. The Process-Dissociation Procedure 199
4.2. The Remember/Know Paradigm 201
5. Pupillometry203
5.1. The Neurophysiology of the Pupillary Reflex 203
5.2. Task-Evoked Pupillary Responses 204
5.3. Pupillometry and Memory 206
6. Psychophysiological Correlates of Memory for Faces 210
6.1. PDP and Pupillometry 211
6.2. RK and Pupillometry 214
7. General Conclusions 215
References215
Abstract
In this chapter, we discuss several distinct conceptualizations of recognition memory,
and their treatment of the (putative) processes underlying recollection and familiar-
ity. We focus most closely on the concept of recollection, which many dual-process
memory models assume to be a relatively slow, controlled process, during which con-
textual details from encoding are brought to mind (i.e., retrieval of episodic detail). We
then introduce the use of pupillometry—continuously measuring pupil diameter dur-
ing task performance—as an efficient means to estimate effortful cognitive processes
during memory encoding and retrieval. We review evidence from three pupillometric
studies of face memory, providing evidence to suggest that recollection is not slow
and effortful, as is often assumed, but is instead fast and easy.
1. INTRODUCTION
Have you ever spotted a familiar colleague who had recently changed
hairstyles, or had perhaps shaved off his signature mustache? You may have
experienced a slightly unsettled feeling, asking “What’s different about you?”
Similarly, you may feel a seemingly inexplicable familiarity with someone
you encounter at the market, avoiding interaction with that person because
you cannot determine how, or even if, you know him. The latter situation
exemplifies Mandler’s (1980) famous “butcher on the bus” phenomenon
(wherein you see your local butcher on a city bus, out of context, and
cannot determine why he seems familiar), but both situations give rise to
a nagging feeling of memory. Despite this subjective experience, both sce-
narios actually represent failures of memory, as you are unable to successfully
retrieve information that you know to be stored in your memory. Often,
these memory failures go unresolved; you cannot name the person in the
market, but are certain that you know him. Contrast that situation with one
more easily attributed to the success of memory: you see your butcher at
the grocery store, and recognize him instantly and automatically.This expe-
rience is by far more common. Throughout the day, you routinely interact
with people whom you instantly identify, fluently recollecting their names,
recent conversations and personal details. Indeed, a great deal of stored
memory is immediately available, with no effort, and no particular “feelings
of memory” whatsoever. Although these memories (and memory failures)
are experienced as disparate events, their underlying cognitive processes are
nonetheless captured by two-component processes that are often said to
make up “recognition memory”, recollection of episodic details, and vague
feelings of familiarity. This chapter will address some of the characteristics of
recollection and familiarity, and will present recent pupillometric data sug-
gesting that certain long-accepted assumptions ought to be reconsidered.
2. RECOGNITION MEMORY
In broadly conceptualizing recognition memory, in particular the
experience of recollection, two dominant and opposing views have persisted
for decades, single- and dual-process models. Variations upon each model
exist, and each has been implemented with varying degrees of success, but
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 193
3. MODELS OF MEMORY
3.1. Threshold-Based Models
Threshold models are often traced back to Fechner’s psychophysical research
(Boring, 1929), as the assumption inherent in these models is that a single
“evidence” threshold must be exceeded before an item can be detected as
previously encountered. High-threshold model is perhaps the simplest of such
views: according to high-threshold model, memory is characterized by two
distributions (often visually depicted as square distributions, but this is not a
theoretically constrained assumption), one representing target item strength
and one representing foil item strength. Each of the item types, targets and
foils, is assumed to have some “resting level” of inherent strength; by virtue
of the study session, targets accumulate additional strength, which serves
to separate the hypothetical target and foil distributions (Figure 5.1). The
“threshold”, according to this model, is the upper end of the foil distribu-
tion; items to the right of this point are said to fall above threshold, and are
194 Stephen D. Goldinger and Megan H. Papesh
Figure 5.1 Hypothetical distribution of item strength for targets and foils in high-
threshold model. Note that, because of their recent exposure, targets are assumed to
have increased levels of strength.
Figure 5.2 Hypothetical distribution of item strength for targets and foils in high-low
threshold model. The lower end of the target distribution is the low-threshold and the
upper end of the foil distribution is the high-threshold.
foil distribution (right panel of Figure 5.1; see, Ratcliff, Sheu, & Gronlund,
1992; Wixted & Stretch, 2004). Critically, regardless of the distributional
assumptions, continuous models all propose that recognition decisions are
based on a concept of continuous memory strength (Wixted & Stretch, 2004),
not on a threshold memory process.
whether they fall above a high criterion or below a low criterion (Atkinson
& Juola, 1973, 1974; as cited in Wixted, 2007). According to this model,
recollection is only initiated if the memory strength falls between the two
criteria, acting, in essence, as a backup process. Later,Yonelinas (1994, 2001)
provided another attempt to combine the two models, with the DPSD
model. According to DPSD, recollection is a high-threshold, categorical
process: It either occurs or does not, and if it does occur, it will always be
associated with high confidence. Familiarity, on the other hand, is gener-
ally viewed as a continuous, ahistorical memory-strength variable, capable
of ranging in strength from low to high (Mandler, 1980; Yonelinas, 1994).
Familiarity, being described by strength of the signal, is therefore compat-
ible with an equal-variance signal-detection model. DPSD differs from the
two-criterion model of Atkinson and Juola primarily in its order of opera-
tions (and its added quantitative detail). Whereas the two-criterion model
assumes that recollection is initiated as a backup for failures of familiarity,
DPSD assumes the reverse. That is, if recollection does not occur, responses
are based on familiarity. Regardless of the order in which the processes are
said to occur (in fact, there are many instantiations of dual-process theory
in which the processes are initiated in parallel), dual-process theories almost
universally consider recollection and familiarity to be separate, indepen-
dent processes with distinct quantitative and qualitative characteristics (see
Yonelinas, 2002 for a review).
The majority of evidence in favor of separate recollection and familiar-
ity processes comes from functional process dissociations, or manipulations that
affect the contributions of each system independently. For example, several
studies have indicated that responses based on familiarity are faster than those
based on recollection (e.g. Hintzman & Caulton, 1997; Hintzman, Caulton,
& Levitin, 1998). Furthermore, it has been shown that this “fast familiar-
ity” process increases false alarms immediately after the presentation of a
new item, but the false alarm probability drops off with increased response
time, reflecting slower recollective retrieval dynamics (e.g. Gronlund &
Ratcliff, 1989; Hintzman & Curran, 1994; Jacoby, 1999; McElree, Dolan,
& Jacoby, 1999). Using event-related potentials (ERPs), many studies have
also found distinct electrophysiological correlates for recognition memory
responses based on recollection versus familiarity (Curran, 2000; Duarte,
Ranganath, Winward, Hayward, & Knight, 2004; Guo, Duan, Li, & Paller,
2006; Klimesch et al., 2001) and some have found opposite effects on rec-
ollection and familiarity following hippocampal damage (Sauvage, Fortin,
Owens, Yonelinas, & Eichenbaum, 2008). These dissociations (and others)
198 Stephen D. Goldinger and Megan H. Papesh
recollection-based memory decisions, a review of the single- versus dual-process debate regarding
the neuroscience of is beyond the scope of this chapter. Interested readers are encouraged to consult
Squire and Wixted (2011 or Wais, Squire, and Wixted, 2009).
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 199
3 Note that Jacoby also modified the paradigm to test associative memory and stem completion
( Jacoby & Rhodes, 2006). Only the classic paradigm will be discussed here.
200 Stephen D. Goldinger and Megan H. Papesh
presented with new words, as well as those from the two study lists, and are
asked to make recognition responses. However, instead of responding “old”
to any previously encountered words, participants are now asked to exclude
specific items. In this example, assume that they are asked to exclude words
that were previously heard, responding “old” only to those words that were
read during study. According to Jacoby, the probability of issuing an “old”
response to a previously heard word is now given by OEh = Fh(1 − Rh),
where E denotes the exclusion test. Based on simple algebra, this can be
represented as OEh = Fh − RhFh. In words, the probability of incorrectly
responding “old” to a previously heard word during the exclusion test is
equal to the familiarity of that word minus the multiplied contributions
of recollection and familiarity for heard words. The contribution of recol-
lection can thus be estimated by Rh = OIh − OEh, which simply indicates
that recollection and familiarity both contribute to “old” responses in the
inclusion test, but correct responses to excluded items during the exclusion
test can only be based on recollection: Participants must recollect an item’s
presentation modality to reject it. Subtracting the influence of familiarity
from the combination of R and F leaves only R. Familiarity can thereby be
estimated as Fh = OEh/(1 − Rh).
Although the PDP method has considerable utility, one of the key
criticisms of PDP regards the definition of recollection. Specifically, rec-
ollection is a relatively vague term, as people can (arguably) experience
varying degrees of recollection. Participants can recall varying degrees of
information about List 1 and List 2 items. For example, if spoken words are
used, voice can be a critical detail and participants may recall only gender
or more detailed, speaker-specific information (as in Dodson, Holland, &
Shimamura, 1998). In PDP experiments, both memories would be classi-
fied as recollection, despite their varying degrees of specificity. To address
this, researchers may differentiate between diagnostic and nondiagnositic recol-
lection (Gruppuso, Lindsay, & Kelley, 1997; Mulligan & Hirshman, 1997;
Yonelinas & Jacoby, 1996), with diagnostic information reflecting memory
for the source of test items and nondiagnostic information reflecting other,
noncriterial, memorial information. From this, it is clear that the recol-
lection parameter in PDP only measures the overall amount of diagnostic
memorial information, ignoring a potentially vast amount of other recol-
lective experiences.
Additional criticisms of PDP regard the underlying assumptions, pri-
marily the assumption that recollection and familiarity independently con-
tribute to recognition memory (Curran & Hintzman, 1995, 1997; Joordens
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 201
& Merikle, 1993; Richardson-Klavehn, Gardiner, & Java, 1996; but see
Jacoby, 1998; Jacoby, Begg, & Toth, 1997). This issue has been extensively
debated and, like the single-/dual-process distinction, each side has inter-
preted evidence as consistent with their view. For example, Curran and
Hintzman (1995, 1997) argued that high correlations between recollection
and familiarity at the item level violate the PDP independence assump-
tion, whereas Jacoby et al. (1997) argued that the correlations are “trivial”
and likely reflect violations of the boundaries within which PDP must be
used. Because the estimates of recollection and familiarity provided by PDP
critically rely on their functional independence, equivocal empirical results
necessitate investigations via other paradigms.
than they reflect the function of two separate memory processes (Donaldson,
1996; Hirshman, 1998). Instructions to respond “remember” or “know”,
according to this view, are interpreted by participants as a requirement to
adopt a more conservative or liberal response criterion, respectively (Dunn,
2004). Donaldson (1996) approached the RK task from a single-process
viewpoint, and suggested that participants complete the task by adopting
two-decision criteria, one (high-criterion) for remember responses and one
(low-criterion) for know responses. He argued that, although participants
were issuing responses that appeared to reflect two different memory systems,
they were responding in line with their decision criteria, which reflected
memory strength, and not separate processes (cf. Knowlton & Squire, 1995).
Meta-analyzes of decades of data and critical tests of recent data have been
taken to support both single-process (Donaldson, 1996; Dunn, 2004, 2008;
Hirshman & Master, 1997; Wixted, 2007; Wixted & Stretch, 2004) and dual-
process models (Conway, Dewhurst, Pearson, & Sapute, 2001; Gardiner,
Ramponi, & Richardson-Klavehn, 1998, 2002; Yonelinas, 2002).
The hybrid CDP model (Wixted & Mickes, 2010) was developed in
response to the dual-process interpretation of RK data. Although the model
is entirely based upon signal-detection theory, it assumes that participants
are able to determine whether their memorial experiences are based on the
function of recollection or familiarity. In short, CDP assumes that recogni-
tion decisions reflect the combined influence of recollection and familiarity,
such that decisions are still based on a “strength of evidence” dimension, but
that participants have access to the source of the predominant strength. Evi-
dence for this model comes from RK tasks in which participants provide
both confidence estimates and source discriminations. During encoding,
participants study words presented at either the top or bottom of the screen,
in red or blue font. When prompted to recognize a test item (centrally
presented, in black), participants provide RK judgments, confidence esti-
mates, and responses regarding original location and color (source discrimi-
nations). Wixted and Mickes found that, although “know” responses can be
associated with a high degree of confidence, corresponding source accuracy
was lower, relative to “remember” responses.
As discussed above, neuropsychological evidence has consistently been
interpreted within a dual-process framework, and this is largely because
of the widespread use of RK in neuroimaging studies. In many experi-
ments, researchers have observed elevated activity in the hippocampus for
R judgments, and almost no activity for K judgments (e.g. Aggleton et al.,
2005; Eldridge, Engel, Zeineh, Bookheimer, & Knowlton, 2000; Holdstock,
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 203
Mayes, Gong, Roberts, & Kapur, 2005; Moscovitch & McAndrews, 2002;
Uncapher & Rugg, 2005; Verfaellie, Rajaram, Fossum, & Williams, 2008;
Yonelinas et al., 2002). One difficulty in interpreting these effects, however,
is that R judgments are typically associated with higher confidence, rela-
tive to K judgments (e.g. Dunn, 2004, 2008; Rotello & Zeng, 2008; Wixted
& Mickes, 2010; Wixted & Stretch, 2004), making it impossible to deter-
mine whether the effect arises from differences in fundamental processes,
or differences in retrieved strength. This “strength confound” was originally
pointed out by Wixted (2009), who noted that recollective detail is almost
never entirely absent from know judgments (Mickes,Wais, & Wixted, 2009).
In fact, when subjective retrieval strength was equated, Wais, Squire, &
Wixted (2009) observed similar levels of hippocampal activity during puta-
tively recollection-based and familiarity-based memories (see also Kirwan,
Wixted, & Squire, 2008; Wais, 2008; W ais,Wixted, Hopkins, & Squire, 2006).
In order to interpret RK data, it seems, one needs to take an additional step
and collect overt, metacognitive estimates of confidence.
5. PUPILLOMETRY
5.1. The Neurophysiology of the Pupillary Reflex
To further examine differences in processes that are said to be fast and auto-
matic, versus slow and deliberate, researchers can appeal to neuroimaging
evidence, as discussed above, or they can examine a recently rediscovered
correlate of cognitive activity, pupil diameter. Pupillometry, the measurement
of the diameters of the eyes’ pupils, has been used for centuries to examine
visual and cognitive processing (e.g. Fontana, 1765). Although it is well-
known that the pupils dilate in response to changes in ambient lighting, it is
less well-known that the pupils also dilate in response to nonvisual stimuli,
such as emotions and thoughts (Goldwater, 1972; Janisse, 1974; Loewenfeld,
1958). This distinction characterizes two independent types of pupillary
reflex, tonic changes, which occur in response to general factors, such as
emotional arousal, stress, and anxiety, and phasic changes, which occur fol-
lowing the onset of stimuli for cognitive processing (Karatekin, Couperus,
& Marcus, 2004). These cognitively evoked pupillary reflexes occur follow-
ing inhibition of the parasympathetic nervous system’s Edinger–Westphal
nucleus (Steinhauer, Siegle, Condray, & Pless, 2004), which is controlled by
the locus coeruleus–norepinephrine (LC–NE) system. The LC is a subcor-
tical brain system that contains the noradrenergic system, which is the sole
source of the neurotransmitter NE. This system plays a critical role in the
204 Stephen D. Goldinger and Megan H. Papesh
Further, pupil sizes were also larger when the study and test voices matched,
relative to when they did not match. Together, these findings revealed that
during intentional encoding of spoken material, the degree of cognitive
effort devoted to encoding can accurately predict subsequent recognition
memory.
Papesh et al. (2012) interpreted their results within Whittlesea’s (1997)
Selective Construction and Preservation of Experience (SCAPE) frame-
work for recognition decisions. According to Whittlesea and Leboe (2000)
and Whittlesea and Williams (1998, 2001), recognition decisions are made in
two stages. The first stage is characterized by the production of mental states,
such that the perceptual material (e.g. the test item) is identified, elaborated,
and any missing information is “filled in” by bringing to mind associated
images or ideas (Neisser, 1967). In the second step, the perceiver evaluates the
fluency of the production process. Rather than directly evaluating the stim-
ulus and comparing memory strength to a decision criterion, the perceiver
evaluates the relative harmony of mind; how easily did the production pro-
cess end? If the production process was characterized by “extra” elaboration,
then the expectation of fluent processing is violated, and the perceiver is left
with a sense of memory failure (e.g. a sense of familiarity). Because Papesh
et al. (2012) essentially observed a pupillary reinstatement of cognitive pro-
cessing across study and test, they concluded that memory traces are com-
posed of rich, detailed events, and that memory decisions are characterized
by an assessment of how easily those details are brought to mind.
Otero, Weekes, & Hutton (2011) obtained a similar result, and proposed
that pupillometry can be used to reveal the strength of memories across
encoding and retrieval.To more closely examine the roles of recollection and
familiarity, they employed the RK procedure, asking participants to provide
remember/know judgments for all “old” decisions. Using emotionally neu-
tral words, they obtained a pupillary old/new effect that was stronger when
participants reported the subjective experience of recollection: pupils were
largest when participants reported remembering, and were smallest when
participants correctly rejected items. Responses based on familiarity (know
responses) yielded diameters that were reliably smaller than those accom-
panying remember responses, but they were not significantly different from
correct rejections. Although this pattern is consistent with Võ et al.’s (2008)
interpretation, that the pupillary old/new effect is driven by the cognitively
demanding experience of recollection, when Otero et al. (2011) manipu-
lated levels of processing during study, they observed larger diameters for
items processed in deep, relative to shallow, orientations. This finding argues
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 209
Figure 5.4 Pupil diameter as a function of confidence and word frequency during a
recognition test. Error bars represent standard errors of the mean. (From Papesh (2012)).
(For color version of this figure, the reader is referred to the online version of this book.)
210 Stephen D. Goldinger and Megan H. Papesh
6. PSYCHOPHYSIOLOGICAL CORRELATES OF
MEMORY FOR FACES
Recently, we have begun to apply converging methods to more fully
investigate the pupillary old/new effect, and the possible indices of recollec-
tion and/or familiarity in the pupillary reflex.To do this, we have conducted
several experiments using the same stimuli, but different methods, each of
which is aimed at eliciting measures of recollection versus familiarity. By
using the same stimuli, we can begin to more fully appreciate the mne-
monic properties of the pupillary reflex.
Goldinger et al. (2009) reported an investigation of the own-race bias
(ORB) in face recognition, in which we used eye movements and pupil-
lometry to provide insight into a well-studied cognitive phenomenon. Asian
and White participants had their eye movements and pupil sizes monitored
as they encoded a series of Asian and White faces. Afterward, participants
discriminated old from new faces, and were labeled as “high performers”
(i.e. participants who were relatively good at recognizing other-race faces)
and “low performers” (participants who performed relatively poorly).
Goldinger et al. (2009) also examined pupillary waveforms during encoding
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 211
Figure 5.5 Baseline-corrected pupil diameter as a function of face race and subsequent
memory performance in the exclusion (a) and inclusion (b) groups. (For color version of
this figure, the reader is referred to the online version of this book.)
by memory type. Figure 5.5 shows pupillary results during face encoding.
In each panel, the data represent baseline-corrected pupil diameters, shown
across an 8 s span. Recall that faces were only visible for 5 s, which is why
there are characteristic drops in pupil diameter at the 6 s mark (pupillary
changes typically lag by about 500 ms, relative to stimulus changes). Although
it is not shown in these figures, we also impose variable ITIs to ensure that
pupil diameters return to their resting values before the next face is shown.
In Figure 5.5(a,b), separate functions are shown, representing the race of
the studied face (Asian, White) and the eventual recognition outcome (Hit,
Miss). Figure 5.5(a) shows data from the exclusion condition; Figure 5.5(b)
shows the inclusion condition. In both (a) and (b), similar findings are appar-
ent. First participants devoted greater effort, as operationalized by pupil size,
to encoding other-race faces, as the blue (Asian) functions are generally
higher than the black (White) functions. Second, and of particular interest,
the pupil functions representing future hits show a dramatic asymmetry:
when participants studied Asian faces, and would later produce recognition
hits, they devoted considerable effort during encoding (this is more easily
appreciated in the left-hand panel, but was true in both conditions), rep-
licating Goldinger et al. (2009). When face encoding would lead to future
misses, no differences were observed as a function of race. Most intriguing,
when participants studied own-race faces, and would later produce recogni-
tion hits, their pupils were actually constricted, relative to baseline.
The results in Fig. 5.5 suggest that successful face encoding requires dif-
ferent cognitive resources, depending on the face of the race. However, it
remains unclear how these results address the question of future recollection
versus familiarity. To more fully appreciate the role of recollection, consider
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 213
just the exclusion group, specifically the “excluded” faces. As reviewed earlier,
in a correct exclusion trial, the participant must first recognize the face as hav-
ing been studied. After that, she must also retrieve the original border color.
In other words, the participant must recollect the item in order to successfully
exclude it. On the other hand, if the participant fails to correctly exclude
the face, it can be inferred that there was a failure of recollection: either the
participant did not recollect the face, or she may have falsely remembered
the wrong border. Given these assumptions, researchers can infer that correct
exclusion trials are completed on the basis of recollection, whereas incor-
rect exclusion trials represent the function of familiarity, in the absence of
recollection. As shown in Figure 5.6, we observed significantly larger pupils
during encoding trials that led to incorrect exclusion.When participants would
subsequently experience detailed recollection, their pupil sizes were smaller,
relative to when they would experience vague feelings of memory.
From these results, Papesh and Goldinger (2011) suggested that, consistent
with anecdotal experiences of easily recognizing well-known acquaintances,
recollection is typically fast, automatic, and cognitively easy. Although our
earlier work suggested that pupil size nicely tracks future memory strength,
Figure 5.6 Baseline-corrected pupil diameters as a function of face race and subse-
quent memory performance in the exclusion study trials. (For color version of this fig-
ure, the reader is referred to the online version of this book.)
214 Stephen D. Goldinger and Megan H. Papesh
these PDP data suggested that some memories are too strong to elicit this
standard pattern; when a memory is retrieved easily, as SCAPE would argue,
it involves relatively little cognitive effort.
clear pattern that hits designated as “remember” elicited less pupil dilation
than hits designated as “know”.
7. GENERAL CONCLUSIONS
In popular conceptualizations of recognition memory, two processes
are said to contribute to memorial decisions, recollection and familiarity. All
current dual-process models assume that recollection is a slow, deliberate,
and demanding cognitive process, whereas familiarity is fast and automatic.
Here, we hope to have shown evidence that recollection may not be as slow
and cognitively taxing as previously theorized. By examining pupil dilations,
as a proxy for cognitive effort, we observe several very clear patterns. Dur-
ing the creation of memories, those items that will eventually lead to the
experience of recollection (as determined by the PDP procedure or “R”
responses in RK) are characterized by less effort during encoding. In similar
fashion, those same items elicit less effort during later recognition testing.
Effort during encoding closely predicts effort during test: recollected items
have a privileged existence, being easily encoded and easily retrieved.
Indeed, our findings are consistent with evidence that recollection-
based responses often occur more quickly than familiarity-based responses
(Dewhurst et al., 2006; Duarte et al., 2004; Wheeler & Buckner, 2004). In
our research, we use a psychophysiological index of cognitive processing,
finding evidence that recollection is fast and relatively automatic. Although
pupil dilation is sensitive to the strength and detail of memories (e.g. Otero
et al., 2011; Papesh et al., 2012), across two experiments, we have shown that
creating and retrieving memories via recollection engenders less pupil dila-
tion, relative to creating and retrieving memories via familiarity. Rather than
being slow and deliberate, we suggest that recollection is fast and easy. After
all, you do not have to work very hard to recognize your spouse when you
get home from work. It might require more effort to recognize your local
butcher, if he is there too (or so we assume… it’s an empirical question).
REFERENCES
Aggleton, J. P.,Vann, S. D., Denby, C., Dix, S., Mayes, A. R., Roberts, N., et al. (2005). S paring
of the familiarity component of recognition memory in a patient with hippocampal
pathology. Neuropsychologia, 12, 1810–1823. http://dx.doi.org/10.1016/j.neuropsycho-
logia.2005.01.019.
Beatty, J. (1982). Task-evoked pupillary responses, processing load, and the structure of
processing resources. Psychological Bulletin, 91, 276–292. http://dx.doi.org/10.1037/0033-
2909.91.2.276.
216 Stephen D. Goldinger and Megan H. Papesh
Beatty, J., & Kahneman, D. (1966). Pupillary changes in two memory tasks. Psychonomic Sci-
ence, 5, 371–372.
Boring, E. G. (1929). A history of experimental psychology. New York: Century.
Buchanan, T. W., Etzel, J. A., Adolphs, R., & Tranel, D. (2006). The influence of autonomic
arousal and semantic relatedness on memory for emotional words. International Journal of
Psychophysiology, 61, 26–33. http://dx.doi.org/10.1016/j.ijpsycho.2005.10.022.
Cansino, S., & Trejo-Morales, P. (2008). Neurophysiology of successful encoding and retrieval
of source memory. Cognitive, Affective, and Behavioral Neuroscience, 8, 85–98. http://dx.doi.
org/10.3758/CABN.8.1.85.
Clark, K. B., Naritoku, D. K., Smith, D. C., Browning, R. A., & Jensen, R. A. (1999). Enhanced
recognition memory following vagus nerve stimulation in human subjects. Nature Neu-
roscience, 2(1), 94–98. http://dx.doi.org/10.1038/4600.
Conway, M. A., Dewhurst, S. A., Pearson, N., & Sapute, A. (2001). The self and recollec-
tion reconsidered: how a ‘failure to replicate’ failed and why trace strength accounts
of recollection are untenable. Applied Cognitive Psychology, 15, 673–686. http://dx.doi.
org/10.1002/acp.740.
Croiset, G., Nijsen, M. J. M. A., & Kamphuis, P. J.G.H. (2000). Role of corticotropin-releasing
factor, vasopressin and the autonomic nervous system in learning and memory. European
Journal of Pharmacology, 405, 225–234.
Curran, T. (2000). Brain potentials of recollection and familiarity. Memory & Cognition, 28,
923–938.
Curran, T., & Hintzman, D. L. (1995). Violations of the independence assumption in pro-
cess dissociation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21,
531–547. http://dx.doi.org/10.1037/0278-7393.21.3.531.
Curran,T., & Hintzman, D. L. (1997). Comparing retrieval dynamics in recognition memory
and lexical decision. Journal of Experimental Psychology: General, 126, 228–247. http://
dx.doi.org/10.1037/0096-3445.126.3.228.
Dewhurst, S. A., Holmes, S. J., Brandt, K. R., & Dean, G. M. (2006). Measuring the speed of
the conscious components of recognition memory: remembering is faster than knowing.
Consciousness and Cognition, 15, 147–162.
Dietrich, D. E., Emrich, H. M.,Waller, C.,Wieringa, B. M., Johannes, S., & Münte,T. F. (2000).
Emotion/cognition-coupling in word recognition memory of depressive patients: an
event-related potential study. Psychiatry Research, 96, 15–29. http://dx.doi.org/10.1016/
S0165-1781(00)00187-6.
Dodson, C. S., Holland, P.W., & Shimamura, A. P. (1998). On the recollection of specific- and
partial-source information. Journal of Experimental Psychology: Learning, Memory, and Cog-
nition, 24, 1121–1136. http://dx.doi.org/10.1037/0278-7393.24.5.1121.
Donaldson, W. (1996). The role of decision processes in remembering and knowing. Memory
& Cognition, 24(4), 523–533.
Duarte, A., Ranganath, C., Winward, L., Hayward, D., & Knight, R. T. (2004). Dissociable
neural correlates for familiarity and recollection during the encoding and retrieval of
pictures. Cognitive Brain Research, 18, 255–272.
Dunn, J. C. (2004). Remember-know: a matter of confidence. Psychological Review, 111(2),
524–542. http://dx.doi.org/10.1037/0033-295X.111.2.524.
Dunn, J. C. (2008). The dimensionality of the remember-know task: a state-trace
analysis. Psychological Review, 115, 426–446. http://dx.doi.org/10.1037/0033-
295X.115.2.426.
Eldridge, L. L., Engel, S. A., Zeineh, M. M., Bookheimer, S. Y., & Knowlton, B. J. (2000).
A dissociation of encoding and retrieval processes in the human hippocampus. Journal of
Neuroscience, 25, 3280–3286. http://dx.doi.org/10.1523/JNEUROSCI.3420-04.2005.
Engelkamp, J., & Dehn, D. M. (1997). Strategy and consciousness in remembering subject-
performed actions. Sprache & Kognition, 16, 94–109.
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 217
Eschenko, O., & Sara, S. J. (2008). Learning-dependent, transient increase of activity in norad-
renergic neurons of locus coeruleus during slow wave sleep in the rat: brain stem-cortex
interplay for memory consolidation? Cerebral Cortex, 18, 2596–2603. http://dx.doi.
org/10.1093/cercor/bhn020.
Fontana, F. (1765). Dei moti dell’iride. : Lucca: J. Giusti.
Gardiner, J. M. (1988). Functional aspects of recollective experience. Memory & Cognition,
16, 309–313.
Gardiner, J. M., & Java, R. I. (1991). Forgetting in recognition memory with and without
recollective experience. Memory & Cognition, 19, 617–623. http://dx.doi.org/10.3758/
BF03197157.
Gardiner, J. M., Java, R. I., & Richardson-Klavehn, A. (1996). How level of processing really
influences awareness in recognition memory. Canadian Journal of Experimental Psychology,
50, 114–122. http://dx.doi.org/10.1037/1196-1961.50.1.114.
Gardiner, J. M., & Parkin, A. J. (1990). Attention and recollective experience in recognition
memory. Memory & Cognition, 18, 579–583.
Gardiner, J. M., Ramponi, C., & Richardson-Klavehn, A. (1998). Experiences of remem-
bering, knowing, and guessing. Consciousness and Cognition, 7, 285–288. http://dx.doi.
org/10.1006/ccog.1997.0321.
Gardiner, J. M., Ramponi, C., & Richardson-Klavehn, A. (2002). Recognition memory and
decision processes: a meta-analysis of remember, know, and guess responses. Memory, 10,
83–98. http://dx.doi.org/10.1080/0965210143000281.
Gardner, R. M., Mo, S. S., & Borrego, R. (1974). Inhibition of pupillary orienting reflex by
novelty in conjunction with recognition memory. Bulletin of the Psychonomic Society, 3,
237–238.
Gardner, R. M., Mo, S. S., & Krinsky, R. (1974). Inhibition of pupillary orienting reflex by
heteromodal novelty. Bulletin of the Psychonomic Society, 4, 510–512.
Gianaros, P. J., Van Der Veen, F. M., & Jennings, J. R. (2004). Regional cerebral blood flow
correlates with heart period and high-frequency heart period variability during work-
ing-memory tasks: implications for the cortical and subcortical regulation of cardiac
autonomic activity. Psychophysiology, 41(4), 521–530. http://dx.doi.org/10.1111/1469-
8986.2004.00179.x.
Gilzenrat, M. S., Nieuwenhuis, S., Jepma, M., & Cohen, J. D. (2010). Pupil diameter tracks
changes in control state predicted by the adaptive gain theory of locus coeruleus function.
Cognitive, Affective, and Behavioral Neuroscience, 10, 252–269. http://dx.doi.org/10.3758/
CABN.10.2.252.
Goldinger, S. D., He,Y., & Papesh, M. H. (2009). Deficits in cross-race face learning: insights
from eye-movements and pupillometry. Journal of Experimental Psychology: Learning, Mem-
ory, and Cognition, 35, 1105–1122. http://dx.doi.org/10.1037/a0016548.
Goldinger, S. D., & Papesh, M. H. (2012). Pupil dilation reflects the creation and retrieval
of memories. Current Directions in Psychological Science, 21, 90–95. http://dx.doi.
org/10.1177/0963721412436811.
Goldwater, B. C. (1972). Psychological significance of pupillary movements. Psychological Bul-
letin, 77, 340–355. http://dx.doi.org/10.1037/h0032456.
Granholm, E., Asarnow, R. F., Sarkin, A. J., & Dykes, K. L. (1996). Pupillary responses
index cognitive resource limitations. Psychophysiology, 33, 457–461. http://dx.doi.
org/10.1111/j.1469-8986.1996.tb01071.x.
Granholm, E., & Steinhauer, S. R. (2004). Introduction: pupillometric measures of cognitive
and emotional processing. International Journal of Psychophysiology, 52, 1–6. http://dx.doi.
org/10.1016/j.ijpsycho.2003.12.001.
Granholm, E., & Verney, S. P. (2004). Pupillary responses and attentional allocation problems
on the backward masking task in schizophrenia. International Journal of Psychophysiology,
52, 37–52. http://dx.doi.org/10.1016/j.ijpsycho.2003.12.004.
218 Stephen D. Goldinger and Megan H. Papesh
Gronlund, S. D., Edwards, M. B., & Ohrt, D. D. (1997). Comparison of the retrieval of item
versus spatial position information. Journal of Experimental Psychology: Learning, Memory,
and Cognition, 23, 1261–1274. http://dx.doi.org/10.1037/0278-7393.23.6.1261.
Gronlund, S. D., & Ratcliff, R. (1989). Time course of item and associative informa-
tion: implications for global memory models. Journal of Experimental Psychology:
Learning, Memory, and Cognition, 15, 846–858. http://dx.doi.org/10.1037/0278-
7393.15.5.846.
Gruppuso,V., Lindsay, D. S., & Kelley, C. M. (1997). The process-dissociation procedure and
similarity: defining and estimating recollection and familiarity in recognition memory.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 23, 259–278. http://
dx.doi.org/10.1037/0278-7393.23.2.259.
Guo, C., Duan, L., Li, W., & Paller, K. A. (2006). Distinguishing source memory and item
memory: brain potentials at encoding and retrieval. Brain Research, 1118, 142–154.
Heaver, B., & Hutton, S. B. (2011). Keeping an eye on the truth? Pupil size changes associ-
ated with recognition memory. Memory, 19, 398–405. http://dx.doi.org/10.1080/0965
8211.2011.575788.
Hess, E. H. (1965). Attitude and pupil size. Scientific American, 212, 46–54.
Hess, E. H., & Polt, J. M. (1964). Pupil size in relation to mental activity during simple
problem-solving. Science, 143, 1190–1192.
Hess, E. H., Seltzer, A. L., & Schlien, J. M. (1965). Pupil response of hetero- and homosexual
males to pictures of men and women: a pilot study. Journal of Abnormal Psychology, 70,
165–168.
Hilford, A., Glanzer, M., Kim, K., & DeCarlo, L.T. (2002). Regularities of source recognition:
ROC analysis. Journal of Experimental Psychology: General, 131, 494–510.
Hintzman, D. L., & Caulton, D. A. (1997). Recognition memory and modality judgments:
a comparison of retrieval dynamics. Journal of Memory and Language, 37, 1–23. http://
dx.doi.org/10.1006/jmla.1997.2511.
Hintzman, D. L., Caulton, D. A., & Levitin, D. J. (1998). Retrieval dynamics in recognition
and list discrimination: further evidence of separate processes of familiarity and recall.
Memory & Cognition, 26, 449–462.
Hintzman, D. L., & Curran, T. (1994). Retrieval dynamics of recognition and frequency
judgments: evidence for separate processes of familiarity and recall. Journal of Memory and
Language, 33, 1–18. http://dx.doi.org/10.1006/jmla.1994.1001.
Hirshman, E. (1998). On the logic of testing the independence assumption in the process-
dissociation procedure. Memory & Cognition, 26, 857–859. http://dx.doi.org/10.3758/
BF03201168.
Hirshman, E., & Master, S. (1997). Modeling the conscious correlates of recognition mem-
ory: reflections on the remember-paradigm. Memory & Cognition, 25, 345–351. http://
dx.doi.org/10.3758/BF03211290.
Holdstock, J. S., Mayes, A. R., Gong, Q. Y., Roberts, N., & Kapur, N. (2005). Item recog-
nition is less impaired than recall and associative recognition in a patient with selec-
tive hippocampal damage. Hippocampus, 15, 203–215. http://dx.doi.org/10.1002/
hipo.20046.
Jacoby, L. L. (1991). A process dissociation framework: separating automatic from inten-
tional uses of memory. Journal of Memory and Language, 30, 513–541. http://dx.doi.
org/10.1016/0749-596X(91)90025-F.
Jacoby, L. L. (1998). Invariance in automatic influences of memory: toward a user’s guide for
the process-dissociation procedure. Journal of Experimental Psychology: Learning, Memory,
and Cognition, 24, 3–26. http://dx.doi.org/10.1037/0278-7393.24.1.3.
Jacoby, L. L. (1999). Ironic effects of repetition: measuring age-related differences in mem-
ory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 3–22. http://
dx.doi.org/10.1037/0278-7393.25.1.3.
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 219
Jacoby, L. L., Begg, I. M., & Toth, J. P. (1997). In defense of functional independence: vio-
lations of assumptions underlying the process-dissociation procedure? Journal of
Experimental Psychology: Learning, Memory, and Cognition, 23, 484–495. http://dx.doi.
org/10.1037/0278-7393.23.2.484.
Jacoby, L. L., & Rhodes, M. G. (2006). False remembering in the aged. Current Directions in
Psychological Science, 15, 49–53. http://dx.doi.org/10.1111/j.0963-7214.2006.00405.x.
Jacoby, L. L., Yonelinas, A. P., & Jennings, J. M. (1997). The relation between conscious and
unconscious (automatic) influences: a declaration of independence. In J. D. Cohen &
J. W. Schooler (Eds.), Scientific approaches to consciousness. Carnegie Mellon symposia on cogni-
tion (pp. 13–47). Hillsdale, NJ: Erlbaum.
Janisse, M. P. (1974). Pupil size, affect and exposure frequency. Social Behavior and Personality,
2, 125–146. http://dx.doi.org/10.2224/sbp.1974.2 2.125.
Johansson, M., Mecklinger, A., & Treese, A. (2004). Recognition memory for emotional and
neutral faces: an event-related potential study. Journal of Cognitive Neuroscience, 16, 1840–
1853. http://dx.doi.org/10.1162/0898929042947883.
Joordens, S., & Merikle, P. M. (1993). Independence or redundancy? Two models of con-
scious and unconscious influences. Journal of Experimental Psychology: General, 122, 462–
467. http://dx.doi.org/10.1037/0096-3445.122.4.462.
Kafkas, A., & Montaldi, D. (2011). Recognition memory strength is predicted by pupillary
responses at encoding while fixation patterns distinguish recollection from familiarity.
Quarterly Journal of Experimental Psychology, 64, 1971–1989. http://dx.doi.org/10.1080/
17470218.2011.588335.
Kahneman, D. (1973). Attention and effort. New York: Prentice Hall.
Kahneman, D., & Beatty, J. (1966). Pupil diameter and load on memory. Science, 154, 1583–
1585. http://dx.doi.org/10.1126/science.154.3756.1583.
Kahneman, D., Beatty, J., & Pollack, I. (1967). Perceptual deficit during a mental task. Science,
157, 218–219. http://dx.doi.org/10.1126/science.157.3785.218.
Karatekin, C., Couperus, J. W., & Marcus, D. J. (2004). Attention allocation in the dual-task
paradigm as measured through behavioral and psychophysiological responses. Psycho-
physiology, 41, 175–185. http://dx.doi.org/10.1111/j.1469-8986.2004.00147.x.
Kirwan, C. B., Wixted, J. T., & Squire, L. R. (2008). Activity in the medial temporal lobe
predicts memory strength, whereas activity in the prefrontal cortex predicts recollec-
tion. Journal of Neuroscience, 28, 10541–10548. http://dx.doi.org/10.1523/JNEURO-
SCI.3456-08.2008.
Klimesch, W., Doppelmayr, M., Yonelinas, A., Kroll, N. E.A., Lazzara, M., Röhm, D., et al.
(2001). Theta synchronization during episodic retrieval: neural correlates of conscious
awareness. Cognitive Brain Research, 12, 33–38. http://dx.doi.org/10.1016/S0926-
6410(01)00024-6.
Knowlton, B. J., & Squire, L. R. (1995). Remembering and knowing: two difference expres-
sion of declarative memory. Journal of Experimental Psychology: Learning, Memory, and
Cognition, 21, 699–710. http://dx.doi.org/10.1037//0278-7393.21.3.699.
Koss, M. (1986). Pupillary dilation as an index of central nervous system α2-adrenoceptor
activation. Journal of Pharmacology Methods, 15, 1–19.
Kuchinke, L.,Võ, M. L.-H., Hofmann, M., & Jacobs, A. M. (2007). Pupillary responses dur-
ing lexical decisions vary with word frequency but not emotional valence. International
Journal of Psychophysiology, 65, 132–140.
Laeng, B., Sirois, S., & Gredebäck, G. (2012). Pupillometry: a window to the preconscious? Per-
spectives on Psychological Science, 7, 18–27. http://dx.doi.org/10.1177/1745691611427305.
Loewenfeld, I. E. (1958). Mechanisms of reflex dilation of the pupil: historical review and
experimental analysis. Documenta Ophthalmologica, 12, 185–448.
Mandler, G. (1980). Recognizing: the judgment of previous occurrence. Psychological Review,
87, 252–271. http://dx.doi.org/10.1037/0033-295X.87.3.252.
220 Stephen D. Goldinger and Megan H. Papesh
McElree, B., Dolan, P. O., & Jacoby, L. L. (1999). Isolating the contributions of familiar-
ity and source information to item recognition: a time course analysis. Journal of
Experimental Psychology: Learning, Memory, and Cognition, 25, 563–582. http://dx.doi.
org/10.1037//0278-7393.25.3.563.
Mickes, L., Wais, P. E., & Wixted, J. T. (2009). Recollection is a continuous process: implica-
tion for dual-process theories of recognition memory. Psychological Science, 20, 509–515.
http://dx.doi.org/10.1111/j.1467-9280.2009.02324.x.
Moscovitch, M., & McAndrews, M. P. (2002). Material-specific deficits in “remembering”
in patients with unilateral temporal lobe epilepsy and excisions. Neuropsychologia, 40,
1335–1342. doi:PII S0028-3932(01)00213-5.
Mulligan, N. W., & Hirshman, E. (1997). Measure the bases of recognition memory: an
investigation of the process-dissociation framework. Journal of Experimental Psychol-
ogy: Learning, Memory, and Cognition, 23, 280–304. http://dx.doi.org/10.1037/0278-
7393.23.2.280.
Neisser, U. (1967). Cognitive psychology. New York: Appleton-Century-Crofts.
Otero, S. C., Weekes, B. S., & Hutton, S. B. (2011). Pupil size changes during recogni-
tion memory. Psychophysiology, 48, 1346–1353. http://dx.doi.org/10.1111/j.1469-
8986.2011.01217.x.
Papesh, M. H. (2012). Source memory revealed through eye movements and pupil dilation. Doctoral
dissertation, Arizona State University.
Papesh, M. H., & Goldinger, S. D. (2011).Your effort is showing! Pupil dilation reveals mem-
ory heuristics. In P. Higham & J. Leboe (Eds.), Constructions of remembering and metacogni-
tion (pp. 215–224). : Palgrave Macmillan.
Papesh, M. H., & Goldinger, S. D. (2012). Pupil-blah-metry: cognitive effort in speech plan-
ning reflected by pupil dilation. Attention, Perception, & Psychophysics, 74, 754–765. http://
dx.doi.org/10.3758/s13414-011-0263-y.
Papesh, M. H., Goldinger, S. D., & Hout, M. C. (2012). Memory strength and specific-
ity revealed by pupillometry. International Journal of Psychophysiology, 83, 56–64. http://
dx.doi.org/10.1016/j.ijpsycho.2011.10.002.
Partala, T., & Surakka, V. (2003). Pupil size variation as an indication of affective pro-
cessing. International Journal of Human-computer Studies, 59, 185–198. http://dx.doi.
org/10.1016/S1071-5819(03)00017-X.
Porter, G., & Troscianko, T. (2003). Pupillary response to grating stimuli. Perception, 32, 156.
Porter, G., Troscianko, T., & Gilchrist, I. D. (2007). Effort during visual search and counting:
insights from pupillometry. Quarterly Journal of Experimental Psychology, 60, 211–229.
Rajaram, S. (1993). Remembering and knowing: two means of access to the personal past.
Memory & Cognition, 21, 89–102.
Rajkowski, J., Kubiak, P., & Aston-Jones, G. (1993). Correlations between locus coeruleus
(LC) neural activity, pupil diameter and behavior in monkey support a role of LC in
attention. Society of Neuroscience Abstracts, 19, 974.
Rajkowski, J., Majczynski, H., Clayton, E., & Aston-Jones, G. (2004). Activation of monkey
locus coeruleus neurons varies with difficulty and performance in a target detection task.
Journal of Neurophysiology, 92, 361–371.
Ranganath, C., Yonelinas, A. P., Cohen, M. X., Dy, C. J., Tom, S. M., & D’Esposito, M. D.
(2004). Dissociable correlates of recollection and familiarity within the medial tem-
poral lobes. Neuropsychologia, 42, 2–13. http://dx.doi.org/10.1016/j.neuropsycholo-
gia.2003.07.006.
Ratcliff, R., Sheu, C., & Gronlund, S. D. (1992). Testing global memory models using
ROC curves. Psychological Review, 99, 518–535. http://dx.doi.org/10.1037/0033-
295X.99.3.518.
Richardson-Klavehn, A., Gardiner, J. M., & Java, R. I. (1996). Memory: task dissociations,
process dissociations, and dissociations of awareness. In G. Underwood (Ed.), Implicit
cognition (pp. 85–158). Oxford: Oxford University Press.
Recollection is Fast and Easy: Pupillometric Studies of Face Memory 221
A Mechanistic Approach to
Individual Differences in
Spatial Learning, Memory, and
Navigation
Amy L. Shelton1, Steven A. Marchette, Andrew J. Furman
Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
1Corresponding author: E-mail: [email protected]
Contents
1. Introduction224
2. What Does It Mean to Measure Spatial Learning and Navigational Ability? 225
2.1. Differences in Navigational Success Rates 225
2.2. Differences in Strategies/Styles: Landmark–Route–Survey Framework 226
2.3. Challenges to the Landmark–Route–Survey Framework 227
3. Dual Systems for Spatial Learning in Rodents 229
4. Place and Response Learning in Humans 232
4.1. Virtual Water Maze 232
4.2. Human Radial Arm Mazes 235
4.3. Ecological Paradigms 236
5. The Place/Response Framework for Individual Differences 239
5.1. Balance of Systems as the Foundation for Individual Differences 240
5.2. Classification vs Predicting Solutions 241
5.3. Advantages and Disadvantages for Different Solutions 242
5.4. Separating Preference from Prowess 244
6. Connections to Other Sources of Variability 246
6.1. Aging247
6.2. Sex Differences and Hormonal Influences 248
7. Competition or Interaction of Systems 250
8. Conclusions252
References255
Abstract
Navigation is a complex task that depends on the processes of perception, learning,
memory, and reasoning to be successful. Given this complexity, it is not surprising that
humans (and other species) vary dramatically in their approach and success at naviga-
tion. This wide range of abilities has been of great interest to the field of human spatial
cognition. In addition, spatial navigation is a cross-species phenomenon that can speak
1. INTRODUCTION
Whether considering how ancestral humans learned to hunt for food
and shelter in the wilderness or the more mundane issues of how you got
to work today, there is little question that navigation is an important aspect
of the human experience. Many of our everyday tasks—finding the car in a
parking lot, getting to the checkout line at the grocery store—involve spa-
tial navigation. As humans, we accomplish this navigation in various ways,
and everyone has an opinion about his or her own navigational abilities.
Ask any random group of people, and you will get answers ranging from
“I am great with directions” to “I get lost all the time”. This massive range
of individual differences in perceived spatial prowess can also be seen in
behavior. Most people can identify those friends or family members who
they prefer to ride with on trips or those who give good or bad direc-
tions. We also know people who are dependent on their Global Positioning
System (GPS) units for even the most basic of travel tasks. This variability
in navigational ability likely reflects the fact that navigation is a complex
task that requires individuals to encode the immediate surroundings, inter-
rogate memory (working memory and/or long-term memory), determine
how to proceed, and execute the relevant movements through space. As
such, understanding individual differences in navigation requires a com-
prehensive approach to understanding how individuals might differ in the
way they learn and remember information about the spatial organization of
their environments.
Individual differences in spatial learning and navigation have enjoyed a
long history in the literature. Here, we review that literature in light of the
extensive work on nonhuman animal models of spatial learning mecha-
nisms. In particular, we explore how using these learning mechanisms to
A Mechanistic Approach to Individual Differences 225
they navigate to work each day. Some individuals will report using the
same set route over and over again, whereas others will report navigat-
ing by just keeping a desired direction in mind. Still others might report
changing their route as a function of time of day, observed patterns of
traffic, or even weather conditions. Any comprehensive understanding of
individual differences will require an appreciation of these different styles
or strategies for navigating and how those different approaches might be
more or less effective for different individuals and under different naviga-
tional conditions.
Like success rate, navigational styles and strategies have a history in the
research literature. A common framework for thinking about such indi-
vidual differences has stemmed from ideas about the progression of knowl-
edge (Siegel & White, 1975). In this popular framework, one first learns the
landmarks in an environment. Landmarks are defined as features or objects
that can demarcate locations or directions. As landmarks become linked,
one develops route knowledge, which is generally defined as the knowledge
of a set of ordered paths. Finally, this information begins to form a repre-
sentation of the global context as survey knowledge, generally defined as
knowledge of the organization of locations in a more global framework. In
its strongest instantiation, this framework suggests that learning an environ-
ment goes through each of these stages, each building upon the previously
acquired knowledge, with survey knowledge as the ultimate representation
of an environment.
The landmark–route–survey framework has influenced the direction of
a wide range of studies in spatial cognition, including approaches to indi-
vidual differences. For example, one tool used to assess spatial navigational
strategies is the Questionnaire on Spatial Representation (QSR; Pazzaglia &
De Beni, 2001). In this self-report survey, questions are directed at assessing
the degree to which people use different types of information, and scoring
allows assessment of landmark use, route-based strategies, and survey-based
strategies. Similar efforts to classify navigational behaviors have taken a simi-
lar approach, with a strong emphasis on the route-based and survey-based
distinctions (e.g. Lawton, 1994, 1996).
than others. Most notably, this framework has given top status to survey
knowledge or the use of spatial information in a flexible manner based on
knowledge of the global organization. This is reflected in many empirical
studies that assess ability based on flexibility and use of detours. However,
there are important counterpoints to consider when considering how to
classify navigational style and its relationship to ability.
The first counterpoint is the evidence challenging the successive nature
of the stages of knowledge. Although there is little doubt that the distinc-
tion between route-based and survey-based information is important to
understanding the kinds of strategies people use and the cues that might
be involved in spatial learning, it is not clear that the progression from one
type of knowledge to another is a critical feature (e.g. Ishikawa & Montello,
2006; Taylor, Naylor, & Chechile, 1999). For example, Taylor, Naylor, and
Chechile gave people specific goals that emphasized the need for either
route-based knowledge or survey-based knowledge. They then gave tests
that tapped each type of knowledge. By the stage theory, individuals who
show survey-based knowledge should also have the route-based knowl-
edge from which the survey knowledge was built. By contrast, their results
showed that the specific goals drove the type of representation such that
people who developed survey-based representations did not necessarily
develop the route-based representations as well. This suggests that different
types of representations can be built up somewhat independently (or at least
without a strict dependence on each other’s presence).
Second, the sense that survey-based strategies convey a clear advantage
over other strategies does not account for the potential interaction between
the navigational situation and strategies. Emerging frameworks have started
to acknowledge that the success of navigational wayfinding likely depends
on the combination of strategies (e.g. Ishikawa & Montello, 2006) and/or
the interplay of skills or strategies and the specific environment or naviga-
tional challenges (e.g. Carlson, Hölscher, Shipley, & Dalton, 2010; Wolbers
& Hegarty, 2010). For example, Carlson et al. put forth a conceptual frame-
work for indoor navigation where navigational success depends on the
combination of the building features, the cognitive representation of the
space that has been formed, and the strategies and skills that are brought
to bear. The latter distinction between the mental representation and the
strategies and skills suggests that there is not a one-to-one link between
a particular navigational strategy and the underlying representation. This
opens the door for thinking about strategies (or styles of navigation) as a
more flexible tool that interacts with the information that is represented.
A Mechanistic Approach to Individual Differences 229
Finally, both anecdotal and empirical evidence suggests that the route-
based and survey-based dichotomy (or landmark–route–survey trichotomy)
may be insufficient to account for the variety of behaviors people actually
utilize in navigation. There have been recent proposals for additional cat-
egories of processing such as “graph knowledge” (for review, see Chrastil,
2012). However, even within a category, there may be additional distinc-
tions that need to be considered (e.g. Allen et al., 1996; Chan, Baumann,
Bellgrove, & Mattingly, 2012; Waller & Lippa, 2007). For example, Allen
et al. tested environmental learning with tasks that tapped both the for-
ward and the backward sequences of the routes. Participants could vary in
both of these depending on the degree to which they had strong explicit
knowledge of the route or more associative knowledge of the sequence in
a stimulus–response fashion. Similarly, people who report using landmarks
could be using them as cues to a specific action (e.g. turn left at the church)
or simply as beacons detached from the specific action required (e.g. look
for the church and head in that direction). These two cases would likely
result in similar classification as some combination of landmark and route-
based strategies, but they are serving different purposes and require differ-
ent levels of explicit knowledge in the act of navigating. Waller and Lippa
demonstrated how differences in performance depended on which way
the landmarks were used, suggesting that these distinctions may be impor-
tant for understanding what people can or cannot do. This represents just
one case where the landmark–route–survey framework may be incomplete.
Once we break away from this framework, the potential to identify and
characterize these additional navigational strategies will enhance our appre-
ciation for individual differences.
Figure 6.1 Diagram of the dual-solution T-maze used to explore place and response
learning in rodents (e.g. Packard & McGaugh, 1996; Restle, 1957; Tolman et al., 1947). (A)
Encoding environment with stable cues and path; (B) probe trial from novel start arm.
Shapes represent cues visible in the surrounding environment. (For color version of this
figure, the reader is referred to the online version of this book.)
Scalability
Virtual reality has made it easy to create environments of nearly any size and shape,
but one can ask whether a physically scalable environment is still appropriate for
asking the same questions in humans. The virtual radial arm maze (e.g. Bohbot et al.,
2004; Iaria et al., 2003) may represent the most direct analog to a rodent paradigm
in terms of scalability because both the human versions can essentially replicate the
physical structure of the rodent mazes. The virtual variants on the MWM for humans
(Cornwell et al., 2008; Hamilton et al., 2002; Newman & Kaszniak, 2000; Skelton et al.,
2006) are often similar in structure to the rodent paradigm, in that they tend to
use circular (or multisided) drums scaled up for humans; however, humans are not
dropped into murky water to hide the locations and instead navigate in "dry" ver-
sions, which may have additional implications for other factors noted below.
In contrast to the radial arm maze and MWM, some rodent paradigms are phys-
ically scalable in virtual space but likely operate very differently for humans. For
example, the dual-solution T-maze has been a long-standing tool for eliciting place-
and response-learned behaviors in rodents (e.g. Packard & McGaugh, 1996; Restle,
1957; Tolman, 1948), but they are not particularly useful in (adult) humans because
humans reduce them to single-trial learning. In pilot work, healthy adult humans
very quickly learned that they had two things to remember and often asked after
just one training trial whether they were supposed to just make a specific turn or go
toward a specific arm in the room. As such, these mazes did not offer us the same
window into place and response systems in humans that they did in rodents.
Motivation
A second important issue is to consider whether the motivation for navigation
matters. For example, when a rat is dropped into the MWM, it is arguably swim-
ming for survival, whereas a human placed in a virtual water maze has little or
no threat to survival if he/she decides to stand still. At worst, the human par-
ticipant faces boredom (or perhaps reduced compensation in incentive-based
paradigms), and it would be unethical to introduce truly comparable manipu-
lations. The cases that use reward in rodents may allow for more comparable
motivational states if "getting out", and/or monetary compensation in humans is
sufficiently rewarding. However, given that navigation and memory systems are
affected by such things as stress (e.g. Kim & Yoon, 1998), it is important to at least
consider how the motivational factors contribute.
(Continued)
234 Amy L. Shelton et al.
Figure 6.2 Diagram of a typical water maze preparation (e.g. Morris, 1981). Shapes rep-
resent cues visible in the surrounding environment or on the walls of the drum. The
platform is not visible to the animal during testing. (For color version of this figure, the
reader is referred to the online version of this book.)
Figure 6.3 Diagram of a typical eight-arm radial arm maze, similar to those used in rats
(e.g. Olton et al., 1977) and humans (e.g. Bohbot et al., 2004; Iaria et al., 2003). Shapes
represent cues visible in the surrounding environment. (For color version of this figure,
the reader is referred to the online version of this book.)
Figure 6.4 The human DSP: (A) schematic of an environment showing the familiar path
learned during encoding and locations of the 12 target objects. (Adapted from Figure 1
of Marchette, Bakker, et al. (2011)). (B) Image of the actual environment as seen by par-
ticipants during initial encoding and subsequent navigation. (For color version of this
figure, the reader is referred to the online version of this book.)
Figure 6.5 Histogram of individual differences in the solution index in the DSP. (Adapted
from Marchette, Bakker, et al. (2011), Figure 2). (For color version of this figure, the reader
is referred to the online version of this book.)
Figure 6.6 Regions of interest analysis for linking brain activation during encoding to
navigational solutions. Left panel shows the regions identified in an overall contrast of
learning to control. Right panel shows the correlation between the normed ratio of acti-
vation in these regions and the subsequent solution index that was observed. (Adapted
from Marchette, Bakker, et al. (2011), Figure 4). (For color version of this figure, the reader
is referred to the online version of this book.)
conditions of stress or distraction (e.g. Kim, Lee, Han, & Packard, 2001;
Packard & Wingard, 2004). Human navigators also face a wide range of
conditions, including both unexpected detours and concurrent distractions
while navigating. Individual differences in the bias to engage the place and
response systems likely affect the reaction to these changing conditions. In
a study of distraction, we asked participants to complete the DSP naviga-
tional task with and without verbal shadowing (Clark, Marchette, Furman,
& Shelton, in preparation).We measured their propensity to use shortcuts or
familiar paths (solution index) and observed that people shifted to using the
familiar path more often when distracted by verbal shadowing than when
not distracted.We also found that performance was worse under distraction.
In addition, those who maintained the use of shortcuts in the face of distrac-
tion also appeared to take the largest hit on accuracy, suggesting that these
individuals were not switching to the more optimal familiar route solutions.
To consider more broadly how different solutions and different learning
mechanisms might convey different advantages, it is useful to think in terms
of the interaction of (1) the environmental structure and available cues, (2)
the skills that the observer brings to bear, and (3) the goals and demands
of the navigational challenge. This interaction of factors is consistent with
recent models (e.g. Carlson et al., 2010), and the learning mechanisms
framework offers a starting point for thinking about how some aspects of
this coordination might occur.
In the simplest form, the goal of navigation is to get to one’s destination.To
that simple goal, we can add different features (one-way streets, hills, multiple
stoplights) or different constraints (running late, avoiding bad neighborhoods)
that may affect which solutions or strategies might be optimal. For example,
in a city with a lot of one-way streets, establishing known routes may be the
safest and most efficient way to be successful. This might convey an advan-
tage for someone traditionally classified as a route learner or someone in the
place/response framework who has a stronger tendency toward familiar paths.
However, this advantage may disappear in that same environment when walk-
ing instead of driving. Similarly, we can imagine an environment rich with
salient landmarks. In such an environment, encoding locations with respect to
landmark proximity might offer an advantage over established sets of routes.1
1 This
example reminds me of an anecdote from a visit to a colleague’s campus. A graduate student
was guiding us to lunch and seemed to be taking a somewhat circuitous route. Upon our arrival at the
building, he admitted that he was nervous about getting there correctly because he had been using
a crane to beacon to that location for the past 2 years. The crane had recently been removed, and his
previously efficient strategy was no longer available.
244 Amy L. Shelton et al.
been clear recognition that “success” has been defined in specific contexts
that may favor one solution or strategy over another. One of the important
features of the DSP, driven by the place/response framework, is that different
solutions are equally successful.That is, whether someone sticks to the famil-
iar route or opts for a novel path, the trial will be successful as long as they
arrive within the time limit. This ability to use different solutions to solve
the same problem is consistent with the real-world situation of navigating
familiar environments. Although we do encounter the occasional roadblock,
our environments generally afford finding and using a particular route or
knowing the environmental structure well enough to use multiple routes.
The first important question then is whether there is a clear relationship
between success rate and the types of solutions people use. In earlier stud-
ies, it is clear that sense of direction as measured by SBSOD was related to
an individual’s ability to complete certain navigational tasks (for review, see
Wolbers & Hegarty, 2010); however, as we have suggested, both the SBSOD
and the empirical tests of navigation tend to emphasize the flexible use of
space and should therefore by related. In the DSP, where success is deter-
mined by taking a clean path to the destination within a reasonable time
limit, we can compare solution index (rate of use of shortcuts or familiar
paths) to the success rate (percent trials completed). As shown in Figure 6.7,
in a large sample, the ability to successfully complete the trials was not
dependent on which solution the individual preferred. Critically, the rela-
tionship trends in the opposite direction of that predicted from the idea that
flexible use of space is best; that is, people using more shortcuts (more place
learning) appear more variable and slightly less successful on average than
those using more familiar paths. More recent work (as yet unpublished) has
replicated this work and substantiated it by showing that self-report mea-
sures of strategic preferences are also unrelated to success rate on the DSP,
even with more stringent time limits.
Predicting success also carries with it the important question of general-
ization. Taking the individual’s most frequent solution or most pronounced
solution may miscalculate their actual ability to respond to certain situations.
In other words, just because someone prefers to use familiar routes does not
necessarily mean that he/she does not have the knowledge to use shortcuts.
The use of a more continuous measure of preference (as in the solution index
and its variants) may offer more insight into how to measure success rates. Sub-
stantial efforts are underway to try to make use of more quantitative approaches
to classification, and the place/response framework may offer one of the clearest
starting points from which to work.
246 Amy L. Shelton et al.
Figure 6.7 Data from the Marchette, Bakker, et al. (2011) studies showing no relation-
ship between solution index and rate of success. (For color version of this figure, the
reader is referred to the online version of this book.)
between these factors and how they may shape individual differences in the
way people use strategies and solutions.
6.1. Aging
Aging is associated with decline in a number of cognitive domains; among
them are the processes of spatial learning and navigation. When compared
with their younger counterparts, older adults are impaired in their ability
to learn and remember ways of finding their way to important destinations
(for review, see Moffat, 2009), the physical layout of the environment (Iaria,
Palermo, Committeri, & Barton, 2009; Kirasic & Mathes, 1990; Kirasic, 2000),
as well as their position within it (Iaria et al., 2009; Mahmood, Adamo,
Briceno, & Moffat, 2009).This suggests one important area where an appeal
to learning mechanisms might offer insights into the effects of aging.
In rodents, there has been substantial effort to understand how such
changes in behavior with aging might be related to differential changes in
the underlying spatial learning mechanisms (e.g. Gallagher & Pelleymounter,
1988; Rapp, Rosenberg, & Gallagher, 1987; Rosenzweig & Barnes, 2003).
For example, when allowed to solve a task using place- or response-related
information, aged rats rely on more response-based solutions than younger
animals (Barnes, Nadel, & Honig, 1980). In humans, a similar case appears to
be building. Notably, the kinds of tasks that demonstrate the spatial memory
decline focus on explicit route learning or the ability to make flexible infer-
ence using spatial representations of the environment. For example, in vari-
ants of the MWM adapted for humans, the common observation is that older
adults take consistently longer to locate the platform, spend less time near its
former location on probe trials, and are less able to explicitly indicate where
the platform is located compared with younger adults (e.g. Driscoll et al.,
2005; Moffat, 2009; Moffat & Resnick, 2002). In addition, these age-related
deficits are accompanied by functional impairment within the medial tem-
poral lobe (e.g. De Leon et al., 1997; Jack et al., 1998) and often the broader
navigation network (parahippocampal gyrus and retrosplenial cortex; see
e.g. Meulenbroek, Petersson, Voermans, Weber, & Fernández, 2004; Moffat,
Elkins, & Resnick, 2006).Taken together, these results in rodents and humans
are consistent with a relatively selective impairment in the place-learning
system.
In the framework we have outlined, these apparent deficits in place
learning with aging would suggest the loss or impairment with some strat-
egies and only in some situations, allowing specific predictions about pat-
terns of impairment and sparing. First, individuals who favor solutions and
248 Amy L. Shelton et al.
predicts that conditions that reduce place learning might enhance response
learning, which would, in turn, change the balance of strategies that indi-
viduals utilize. Again, as in other areas, this would take our thinking away
from ideas about how hormones are good or bad for navigation and toward
ideas about what people might engage under different hormonal influences.
Hormones are a particularly interesting factor to consider because, in
addition to capturing features about the specific individual (e.g. baseline
levels of circulating testosterone), hormones are sensitive to acute state
changes. For example, stress-related hormones may play a similar role in
changing the bias between the memory systems associated with place and
response learning (for review, see Packard, 2009; Brain Research). In par-
ticular, chronic stress appears to reduce the hippocampal plasticity that is
thought to be a core component of the place-learning system (e.g. Kim &
Yoon, 1998). What’s more, systemic administration of corticosteroids, a class
of hormones released in response to stress, biases rodents away from place
learning and toward response learning in a maze that allowed both solu-
tions (Sadowski, Jackson, Wieczorek, & Gold, 2009; Schwabe et al., 2010).
This may offer interesting insights into human navigational styles because
high spatial anxiety tends to coincide with more frequent use or reliance on
familiar routes (Hund & Minarik, 2006; Lawton, 1994). Thinking in terms
of biasing systems allows us to make specific predictions about the interplay
of stress hormones, acute or chronic stress/anxiety, and navigational styles.
This is another example of the theoretical richness a neurobiologically
grounded framework of individual differences might provide.
one type of behavior can be produced, and therefore, only one system can
be manifested at any given time. For example, when Tolman and colleagues
placed rats in a T-maze from a novel start position, the rat had to either turn
toward the arm consistent with the target location relative to the environ-
mental cues or turn toward the arm consistent with the repeated action
during the acquisition (e.g. Packard & McGaugh, 1996; Restle, 1957;Tolman
et al., 1946, 1947). Therefore, in terms of being able to drive behavior, there
must at least be some form of competition that allows one system to dominate
at any given time.
Beyond the competition to drive behavior, one can ask whether there
is a necessary trade-off in resources between the two neural systems that
support the different learning mechanisms.The first important point is that
the two systems are operating in parallel during encoding, as evidenced
by the extensive work showing that rodents can successfully learn under
conditions that require either a place or a response approach. Moreover,
shutting down one system at the time of retrieval allows the other system
to control behavior (Packard & McGaugh, 1996), further supporting the
ideas that learning was occurring simultaneously. This coincidental learning
is consistent with an account that allows for either independence or coor-
dination of these systems, with the “competition” largely at the behavioral
output end.
In humans, the story with respect to competition or cooperation is
less clear. Marchette, Bakker, et al. (2011) found that the activation in
the hippocampus and caudate nucleus during encoding predicted the
solutions that were employed. Critically, although the individual regions
predicted performance as expected, it was the relative activation of the
two regions that offered the strongest correlation. This appeal to the bal-
ance of activation suggests that both systems may be operating at higher
or lower levels such that when they are in balance, people are likely
to use a mixture of solutions and that mixture shifts as the balance of
engagement shifts.
In an alternative approach to the distinction between hippocampal and
striatal contributions, Brown et al. (2012) investigated the concurrent acti-
vation in hippocampus and caudate, as well as prefrontal regions, in par-
ticipants learning and navigating in virtual mazes. Participants learned to
navigate in a series of small mazes and were then asked to navigate those
learned environments during fMRI scans. The activation was then interro-
gated for mazes that shared overlapping features compared with those that
did not. The results revealed greater functional connectivity between the
252 Amy L. Shelton et al.
8. CONCLUSIONS
Our understanding of individual differences in navigation has long
been shaped by models and approaches that emphasize how people engage
novel spaces. The standard landmark–route–survey framework proposes
that, in an attempt to maximize their later success, people try to focus on
learning the information they think will be important to remember later,
such as the location of a particularly salient landmark, a sequence of direc-
tions along a route, or the spatial relationships between important places.
People then ultimately meet with different amounts of success that reflect
how much their strategy has allowed them to accurately learn about the
environment, with good navigators identified by their ability to form more
holistic spatial representations. This framework stresses what people explic-
itly try to do, and much of our understanding of these complex strate-
gies necessarily comes from people’s self-report.These descriptions of what
people report using are then in turn used to classify navigators into differ-
ent discrete categories.
The work summarized here on human place- and response-learning
mechanisms paints a complementary picture to the landmark–route–survey
model but may also challenge some of its norms for defining individual
differences. The principle challenge stems from the observation that when
we tested participants on the DSP, we did not see two clear clusters of
people who preferred place-like or response-like solutions. Instead, par-
ticipants ranged continuously across the spectrum of possible preferences.
Consistent with the rodent models, this continuous range suggests that both
A Mechanistic Approach to Individual Differences 253
learning mechanisms are available to any individual and that each individual
has some bias of variable strength toward one learning mechanism or the
other. In practice, this also means that an individual is using fundamentally
different solutions on different trials. This observation may push us out of
old norms for thinking about distinct categories for classifying individuals
based on what they report to be their dominant strategy.
Once we allow the possibility that the use of navigational strategy,
at least at the level of the deployment of learning mechanisms, is con-
tinuous rather than discrete, we have to develop ideas about why strate-
gies are deployed continuously. One possibility is that the strategy of the
moment may be shaped by the particular circumstances of navigation,
rather than being determined by what participants try to do in general.
This is a concept that heralds a change from thinking about there being
strategies that are “better” and “worse” overall: normatively, under a bet-
ter/worse scheme, an individual should principally use the best strategy
that he or she can!
An alternative to the standard viewpoint, and one that we subscribe to,
is that different strategies may convey advantages and disadvantages, which
might be suitable to particular situations or optimize different navigational
criteria, such as weighing speed of travel against certainty of arrival. Having
access to both learning mechanisms is then adaptive because it allows an
individual to select the strategy that will best match their own navigational
goals and constraints. This framing may redirect our attention to how strat-
egy selection may reflect the constraints that an individual navigator places
on defining a successful trip.
Taken together, these different profiles of strengths and weaknesses mean
that some situations will call for place learning whereas others may call for
response learning. Navigational success, then, is not simply associated with
which solution one may prefer in the DSP. However, a fine point in this
argument is that we are not arguing that one’s predisposition for place and
response learning is unrelated to navigational success in the real world. The
DSP was designed such that both place and response learning can support
successful navigation, but in the real world, this may not always be the case.
Our suggestion is that, while prowess with a chosen strategy matters, navi-
gational success on a particular trip will be based primarily on how well the
individual’s strategy fits the particular situation. Our traditional predisposi-
tion as researchers to call place-like strategies “good” consequently results
from the fact that they are widely applicable, rather than universally more
successful than response-like strategies. Under this view, a truly successful
254 Amy L. Shelton et al.
REFERENCES
Allen, G. L., Kirasic, K. C., Dobson, S. H., Long, R. G., & Beck, S. (1996). Predicting
environmental learning from spatial abilities: an indirect route. Intelligence, 22(3),
327–355.
Astur, R. S., Taylor, L. B., Mamelak, A. N., Philpott, L., & Sutherland, R. J. (2002). Humans
with hippocampus damage display severe spatial memory impairments in a virtual Mor-
ris water task. Behavioural Brain Research, 132(1), 77–84.
Barnes, C. A., Nadel, L., & Honig, W. K. (1980). Spatial memory deficit in senescent rats.
Canadian Journal of Psychology, 34(1), 29.
Bellassen,V., Iglói, K., de Souza, L. C., Dubois, B., & Rondi-Reig, L. (2012). Temporal order
memory assessed during spatiotemporal navigation as a behavioral cognitive marker for
differential Alzheimer’s disease diagnosis. Journal of Neuroscience, 32(6), 1942–1952.
Bell, S., & Saucier, D. (2004). Relationship among environmental pointing accuracy, mental
rotation, sex, and hormones. Environment and Behavior, 36(2), 251–265.
Bird, C. M., & Burgess, N. (2008). The hippocampus and memory: insights from spatial pro-
cessing. Nature Reviews Neuroscience, 9(3), 182–194.
Bohbot, V. D., Iaria, G., & Petrides, M. (2004). Hippocampal function and spatial memory:
evidence from functional neuroimaging in healthy participants and performance of
patients with medial temporal lobe resections. Neuropsychology, 18(3), 418.
Bohbot, V. D., Kalina, M., Stepankova, K., Spackova, N., Petrides, M., & Nadel, L. Y. N. N.
(1998). Spatial memory deficits in patients with lesions to the right hippocampus and to
the right parahippocampal cortex. Neuropsychologia, 36(11), 1217–1238.
Brown,T. I., Ross, R. S.,Tobyne, S. M., & Stern, C. E. (2012). Cooperative interactions between
hippocampal and striatal systems support flexible navigation. NeuroImage, 60(2), 1316.
Carlson, L. A., Hölscher, C., Shipley, T. F., & Dalton, R. C. (2010). Getting lost in buildings.
Current Directions in Psychological Science, 19(5), 284–289.
Chan, E., Baumann, O., Bellgrove, M. A., & Mattingley, J. B. (2012). From objects to land-
marks: the function of visual location information in spatial navigation. Frontiers in Psy-
chology, 3, 304.
Chang, Q., & Gold, P. E. (2004). Inactivation of dorsolateral striatum impairs acquisition of
response learning in cue-deficient, but not cue-available, conditions. Behavioral Neurosci-
ence, 118(2), 383.
Chrastil, E. R. (2012). Neural evidence supports a novel framework for spatial navigation.
Psychonomic Bulletin & Review.
Clark, S., Marchette, S. A., Furman, A. J., & Shelton, A. L. Talking while walking: investigating the
effects of verbal distraction on human navigation performance and strategy selection, in preparation.
Clark, A. S., Mitre, M. C., & Brinck-Johnsen, T. (1995). Anabolic-androgenic steroid and
adrenal steroid effects on hippocampal plasticity. Brain Research, 679(1), 64–71.
Cornwell, B. R., Johnson, L. L., Holroyd, T., Carver, F. W., & Grillon, C. (2008). Human hip-
pocampal and parahippocampal theta during goal-directed spatial navigation predicts
performance on a virtual Morris water maze. Journal of Neuroscience, 28(23), 5983–5990.
Davis, D. M., Jacobson, T. K., Aliakbari, S., & Mizumori, S. J.Y. (2005). Differential effects of
estrogen on hippocampal-and striatal-dependent learning. Neurobiology of Learning and
Memory, 84(2), 132–137.
De Leon, M. J., George, A. E., Golomb, J., Tarshish, C., Convit, A., Kluger, A., et al. (1997).
Frequency of hippocampal formation atrophy in normal aging and Alzheimer’s disease.
Neurobiology of Aging, 18(1), 1–11.
Devan, B. D., & White, N. M. (1999). Parallel information processing in the dorsal striatum:
relation to hippocampal function. Journal of Neuroscience, 19(7), 2789–2798.
Driscoll, I., Hamilton, D. A., Petropoulos, H.,Yeo, R. A., Brooks, W. M., Baumgartner, R. N.,
et al. (2003). The aging hippocampus: cognitive, biochemical and structural findings.
Cerebral Cortex, 13(12), 1344–1351.
256 Amy L. Shelton et al.
Driscoll, I., Hamilton, D. A., Yeo, R. A., Brooks, W. M., & Sutherland, R. J. (2005). Virtual
navigation in humans: the impact of age, sex, and hormones on place learning. Hormones
and Behavior, 47(3), 326–335.
Elliott, A. E., & Packard, M. G. (2008). Intra-amygdala anxiogenic drug infusion prior to
retrieval biases rats towards the use of habit memory. Neurobiology of Learning and Memory,
90(4), 616–623.
Featherstone, R. E., & McDonald, R. J. (2004). Dorsal striatum and stimulus–response learn-
ing: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a
simple discrimination task. Behavioural Brain Research, 150(1), 15–23.
Featherstone, R. E., & McDonald, R. J. (2005). Lesions of the dorsolateral or dorsomedial
striatum impair performance of a previously acquired simple discrimination task. Neuro-
biology of Learning and Memory, 84(3), 159–167.
Fields, A.W., & Shelton, A. L. (2006). Individual skill differences and large-scale environmen-
tal learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(3), 506.
Furman, A. J., , Marchette, S. A., & Shelton, A. L. (2013). Individual differences in navigational
style and its relationship to volitional strategy shifting. Manuscript submitted for publication.
Gallagher, M., Burwell, R., & Burchinal, M. R. (1993). Severity of spatial learning impair-
ment in aging: development of a learning index for performance in the Morris water
maze. Behavioral Neuroscience, 107(4), 618.
Gallagher, M., & Pelleymounter, M. A. (1988). Spatial learning deficits in old rats: a model for
memory decline in the aged. Neurobiology of Aging, 9, 549–556.
Gold, P. E., & Korol, D. L. (2010). Hormones and memory. In G. Koob, M. Le Moal &
R. F. Thompson (Eds.), Encyclopedia of behavioral neuroscience (Vol. 2, pp. 57–64). Oxford:
Academic Press.
Hamilton, D. A., Driscoll, I., & Sutherland, R. J. (2002). Human place learning in a virtual
Morris water task: some important constraints on the flexibility of place navigation.
Behavioural Brain Research, 129(1), 159–170.
Hartley, T., Maguire, E. A., Spiers, H. J., & Burgess, N. (2003). The well-worn route and the
path less traveled: distinct neural bases of route following and wayfinding in humans.
Neuron, 37(5), 877–888.
Hegarty, M., Richardson, A. E., Montello, D. R., Lovelace, K., & Subbiah, I. (2002). Develop-
ment of a self-report measure of environmental spatial ability. Intelligence, 30(5), 425–447.
Hund, A. M., & Minarik, J. L. (2006). Getting from here to there: spatial anxiety, wayfinding
strategies, direction type, and wayfinding efficiency. Spatial Cognition and Computation,
6(3), 179–201.
Iaria, G., Palermo, L., Committeri, G., & Barton, J. J. (2009). Age differences in the formation
and use of cognitive maps. Behavioural Brain Research, 196(2), 187–191.
Iaria, G., Petrides, M., Dagher, A., Pike, B., & Bohbot, V. D. (2003). Cognitive strategies
dependent on the hippocampus and caudate nucleus in human navigation: variability
and change with practice. Journal of Neuroscience, 23(13), 5945–5952.
Ishikawa,T., & Montello, D. R. (2006). Spatial knowledge acquisition from direct experience
in the environment: individual differences in the development of metric knowledge and
the integration of separately learned places. Cognitive Psychology, 52(2), 93–129.
Jack, C. R., Petersen, R. C., Xu, Y., O’Brien, P. C., Smith, G. E., Ivnik, R. J., et al. (1998).
Rate of medial temporal lobe atrophy in typical aging and Alzheimer’s disease. Neurology,
51(4), 993–999.
Kelly, J. W., McNamara, T. P., Bodenheimer, B., Carr, T. H., & Rieser, J. J. (2009). Individual
differences in using geometric and featural cues to maintain spatial orientation: cue
quantity and cue ambiguity are more important than cue type. Psychonomic Bulletin &
Review, 16(1), 176–181.
Kim, J. J., Lee, H. J., Han, J. S., & Packard, M. G. (2001). Amygdala is critical for stress-induced
modulation of hippocampal long-term potentiation and learning. Journal of Neuroscience,
21(14), 5222–5228.
A Mechanistic Approach to Individual Differences 257
Kim, J. J., & Yoon, K. S. (1998). Stress: metaplastic effects in the hippocampus. Trends in Neu-
rosciences, 21(12), 505–509.
Kirasic, K. C. (2000). Age differences in adults’ spatial abilities, learning environmental layout,
and wayfinding behavior. Spatial Cognition and Computation, 2(2), 117–134.
Kirasic, K. C., & Mathes, E. A. (1990). Effects of different means for conveying environmental
information on elderly adults’ spatial cognition and behavior. Environment and Behavior,
22(5), 591–607.
Korol, D. L. (2004). Role of estrogen in balancing contributions from multiple memory
systems. Neurobiology of Learning and Memory, 82(3), 309–323.
Lawton, C. A. (1994). Gender differences in way-finding strategies: relationship to spatial
ability and spatial anxiety. Sex Roles, 30(11), 765–779.
Lawton, C. A. (1996). Strategies for indoor wayfinding: the role of orientation. Journal of
Environmental Psychology, 16(2), 137–145.
Lawton, C. A., Charleston, S. I., & Zieles, A. S. (1996). Individual-and gender-related differ-
ences in indoor wayfinding. Environment and Behavior, 28(2), 204–219.
Maguire, E. A., Burgess, N., Donnett, J. G., Frackowiak, R. S., Frith, C. D., & O’Keefe,
J. (1998). Knowing where and getting there: a human navigation network. Science,
280(5365), 921–924.
Mahmood, O., Adamo, D., Briceno, E., & Moffat, S. D. (2009). Age differences in visual path
integration. Behavioural Brain Research, 205(1), 88–95.
Marchette, S. A., Bakker, A., & Shelton, A. L. (2011). Cognitive mappers to creatures of habit:
differential engagement of place and response learning mechanisms predicts human
navigational behavior. Journal of Neuroscience, 31(43), 15264–15268.
Marchette, S. A.,Yerramsetti, A., Burns, T. J., & Shelton, A. L. (2011). Spatial memory in the
real world: long-term representations of everyday environments. Memory & Cognition,
39(8), 1401–1408.
Meulenbroek, O., Petersson, K. M., Voermans, N., Weber, B., & Fernández, G. (2004). Age
differences in neural correlates of route encoding and route recognition. NeuroImage,
22(4), 1503–1514.
Moffat, S. D. (2009). Aging and spatial navigation: what do we know and where do we go?
Neuropsychology Review, 19(4), 478–489.
Moffat, S. D., Elkins, W., & Resnick, S. M. (2006). Age differences in the neural systems sup-
porting human allocentric spatial navigation. Neurobiology of Aging, 27(7), 965–972.
Moffat, S. D., Kennedy, K. M., Rodrigue, K. M., & Raz, N. (2007). Extrahippocampal
contributions to age differences in human spatial navigation. Cerebral Cortex, 17(6),
1274–1282.
Moffat, S. D., & Resnick, S. M. (2002). Effects of age on virtual environment place navigation
and allocentric cognitive mapping. Behavioral Neuroscience, 116(5), 851.
Morris, R. G. (1981). Spatial localization does not require the presence of local cues. Learning
and Motivation, 12(2), 239–260.
Morris, R. (1984). Developments of a water-maze procedure for studying spatial learning in
the rat. Journal of Neuroscience Methods, 11(1), 47–60.
Morris, R. G. M., Garrud, P., Rawlins, J. N.P., & O’Keefe, J. (1982). Place navigation impaired
in rats with hippocampal lesions. Nature, 297(5868), 681–683.
Naghdi, N., Majlessi, N., & Bozorgmehr, T. (2005). The effect of intrahippocampal injec-
tion of testosterone enanthate (an androgen receptor agonist) and anisomycin (protein
synthesis inhibitor) on spatial learning and memory in adult, male rats. Behavioural Brain
Research, 156(2), 263–268.
Newman, M. C., & Kaszniak, A. W. (2000). Spatial memory and aging: performance on a
human analog of the Morris water maze. Aging, Neuropsychology, and Cognition, 7(2),
86–93.
Olton, D. S., Collison, C., & Werz, M. A. (1977). Spatial memory and radial arm maze per-
formance of rats. Learning and Motivation, 8(3), 289–314.
258 Amy L. Shelton et al.
Packard, M. G. (2009). Anxiety, cognition, and habit: a multiple memory systems perspective.
Brain Research, 1293, 121–128.
Packard, M. G., & McGaugh, J. L. (1996). Inactivation of hippocampus or caudate nucleus
with lidocaine differentially affects expression of place and response learning. Neurobiol-
ogy of Learning and Memory, 65(1), 65–72.
Packard, M. G., & Wingard, J. C. (2004). Amygdala and “emotional” modulation of the relative
use of multiple memory systems. Neurobiology of Learning and Memory, 82(3), 243–252.
Pazzaglia, F., & De Beni, R. (2001). Strategies of processing spatial information in survey and
landmark-centred individuals. European Journal of Cognitive Psychology, 13(4), 493–508.
Poldrack, R. A., & Packard, M. G. (2003). Competition among multiple memory systems:
converging evidence from animal and human brain studies. Neuropsychologia, 41(3),
245–251.
Rapp, P. R., Rosenberg, R. A., & Gallagher, M. (1987). An evaluation of spatial information
processing in aged rats. Behavioral Neuroscience, 101(1), 3.
Restle, F. (1957). Discrimination of cues in mazes: a resolution of the “place-vs.-response”
question. Psychological Review, 64(4), 217.
Ritchie, B. F., Aeschliman, B., & Pierce, P. (1950). Studies in spatial learning.VIII. Place per-
formance and the acquisition of place dispositions. Journal of Comparative and Physiological
Psychology, 43(2), 73.
Roof, R. L., & Havens, M. D. (1992). Testosterone improves maze performance and induces
development of a male hippocampus in females. Brain Research, 572(1–2), 310–313.
Rosenzweig, E. S., & Barnes, C. A. (2003). Impact of aging on hippocampal function: plastic-
ity, network dynamics, and cognition. Progress in Neurobiology, 69(3), 143–179.
Sadowski, R. N., Jackson, G. R., Wieczorek, L., & Gold, P. E. (2009). Effects of stress, cor-
ticosterone, and epinephrine administration on learning in place and response tasks.
Behavioural Brain Research, 205(1), 19–25.
Sandstrom, N. J., Kaufman, J., & Huettel, S. A. (1998). Males and females use different distal
cues in a virtual environment navigation task. Cognitive Brain Research, 6(4), 351–360.
Sandstrom, N. J., Kim, J. H., & Wasserman, M. A. (2006).Testosterone modulates performance
on a spatial working memory task in male rats. Hormones and Behavior, 50(1), 18–26.
Saucier, D. M., Green, S. M., Leason, J., MacFadden, A., Bell, S., & Elias, L. J. (2002). Are sex
differences in navigation caused by sexually dimorphic strategies or by differences in the
ability to use the strategies? Behavioral Neuroscience, 116(3), 403.
Schwabe, L., Schächinger, H., de Kloet, E. R., & Oitzl, M. S. (2010). Corticosteroids operate
as a switch between memory systems. Journal of Cognitive Neuroscience, 22(7), 1362–1372.
Shelton, A. L., & Gabrieli, J. D. (2002). Neural correlates of encoding space from route and
survey perspectives. Journal of Neuroscience, 22(7), 2711–2717.
Shelton, A. L., & Gabrieli, J. D. (2004). Neural correlates of individual differences in spatial
learning strategies. Neuropsychology, 18(3), 442.
Siegel, A. W., & White, S. H. (1975). The development of spatial representations of large-scale
environments. Advances in Child Development and Behavior, 10, 9–55.
Skelton, R. W., Ross, S. P., Nerad, L., & Livingstone, S. A. (2006). Human spatial navigation
deficits after traumatic brain injury shown in the arena maze, a virtual Morris water
maze. Brain Injury, 20(2), 189–203.
Spiers, H. J., & Maguire, E. A. (2007). A navigational guidance system in the human brain.
Hippocampus, 17(8), 618–626.
Stewart, C. A., & Morris, R. G. M. (1993). The watermaze. In A. Saghal (Ed.), Behavioral neu-
roscience. A practical approach (Vol. 1, pp. 107–122). Oxford: IRL Press.
Taylor, H. A., Naylor, S. J., & Chechile, N. A. (1999). Goal-specific influences on the repre-
sentation of spatial perspective. Memory & Cognition, 27(2), 309–319.
Tolman, E. C. (1948). Cognitive maps in rats and men. Psychological Review, 55(4), 189.
A Mechanistic Approach to Individual Differences 259
Tolman, E. C., Ritchie, B. F., & Kalish, D. (1946). Studies in spatial learning. II. Place learning
versus response learning. Journal of Experimental Psychology, 36(3), 221.
Tolman, E. C., Ritchie, B. F., & Kalish, D. (1947). Studies in spatial learning. V. Response
learning vs. place learning by the non-correction method. Journal of Experimental Psychol-
ogy, 37(4), 285.
Waller, D., & Lippa,Y. (2007). Landmarks as beacons and associative cues: their role in route
learning. Memory & Cognition, 35(5), 910–924.
Warren, S. G., & Juraska, J. M. (1997). Spatial and nonspatial learning across the rat estrous
cycle. Behavioral Neuroscience, 111(2), 259.
Wolbers, T., & Hegarty, M. (2010). What determines our navigational abilities? Trends in
Cognitive Sciences, 14(3), 138–146.
Yerramsetti, A., Marchette, S. A., & Shelton, A. L. (2012). Accessibility versus accuracy in
retrieving spatial memory: evidence for suboptimal assumed headings. Journal of
Experimental Psychology: Learning, Memory, and Cognition. http://dx.doi.org/10.1037/
a0030905. Advance online publication.
This page intentionally left blank
CHAPTER SEVEN
Contents
1. Introduction262
2. When Do “Distractors” Cause Distraction? 264
2.1. Visual Search 264
2.1.1. Effect of Distractors on Search Performance 264
2.1.2. When Distractors Do Not Impact Search Performance 265
2.1.3. The End of Preattentive Vision 267
2.1.4. Nothing about Distraction Can be Learned from Visual Search Experiments 269
2.2. Divided Attention 271
2.3. Flanker Effect 272
2.3.1. Traditional View: The Flanker Effect Implies Late Selection 272
2.3.2. The Flanker Effect is Not a Measure of Distraction 273
2.3.3. The Information Processing Tradition and the Flanker Task 274
2.3.4. Why are Flankers Referred to as “Task-Irrelevant”? 276
2.4. A Different Form of Distractor: The Inattentional Blindness’ “Critical Stimulus” 278
2.4.1. The Unexpected Event Paradigms 278
2.4.2. Recruitment of “Central” Resources and the Ensuing Blindness 280
2.5. Empirical Study: Comparing the Salience vs the Relevance of a Distractor 281
2.6. Distraction or Distractor Interference? 285
2.6.1. The Current State of Confusion 285
2.6.2. Distractor Interference as a Measure of Attentional Success 288
2.6.3. Connecting Flanker Experiments to Real-World Situations 289
3. A Brief Case Study on Distraction 291
3.1. Limitations of Unexpected Event Paradigms 291
3.2. A New Paradigm 293
3.3. Discussion296
4. A Theory of Attention and Distractibility 300
4.1. The Need for Inner Focus 300
4.2. Predicting Inattentional Blindness 301
4.3. A Look Back at Visual Attention 303
5. Conclusions307
References310
Abstract
We discuss how, at the present time, there is a large deal of confusion in the attention
literature regarding the use of the label “distractor” and what may be inferred from
experiments using distractors. In particular, investigators seem to use the concepts of
distractor interference and distractibility almost interchangeably. In contrast, we argue
at both the theoretical and empirical levels that these two concepts are not only differ-
ent, but in fact mutually exclusive. To that end, a brief review of several subliteratures is
presented, in which we identify some examples of the misuse of these terms. We also
propose a new paradigm for the study of distraction, as well as present a contemporary
general theory of visual attention that provides a better framework for understanding
distractor-interference effects, as well as instances of true distraction.
1. INTRODUCTION
What is “distraction”? To borrow some from James’ famous definition
of attention, one could say that distraction is the taking possession of the
mind in clear and vivid form by a thought or stimulus that one never intended
to process in the first place. It is a thought or stimulus that takes us “out” of
our intended task and drives our attention onto new thoughts or sensations.
This definition seems quite close to our intuitions of what being distracted
is like, and matches the vernacular definition of distraction (e.g. “the draw-
ing away [of the mind or thoughts] from one point or course to another;
diversion of the mind or attention”, Oxford English Dictionary). It is also a
definition that is implied by work in applied psychology, such as the recent
studies on distracted driving (e.g. Cooper, Vladisavljevic, Medeiros-Ward,
Martin, & Strayer, 2009; Strayer, Watson, & Drews, 2011). It certainly is an
important concept in our everyday life, so it is to no surprise that we, in
the attention field, may want to draw inferences about this concept from
our investigations. One of the primary goals of this chapter is to point out
where this effort has faltered and identify one reason why this has happened:
the inappropriate assumption that the effects of distractors are always a mea-
sure of distraction.
The history of the term “distractor” is as old as the discipline of psy-
chology itself. One can easily find papers using this term as far back as
the nineteenth century (e.g. Darlington & Talbot, 1898). In the early days,
distractors were understood to be that type of stimulus that can distract
us from our main tasks and, thereby, disturb our performance. Darlington
& Talbot (1898) were interested, for example, in testing whether music
could be considered a distractor and used a weight-lifting task to assess
the impact of music on performance. (Results suggested that, no, music
Distractors and Distractibility 263
was not a “distractor”.) Another example was Tinker (1925) who studied
whether the presence of bells ringing intermittently during an intelligence
test would affect performance of the test, a marker that distraction hinders
performance. (On average, it did not.) Yet, from the start, the early intuition
that distraction ought to hinder performance was there and a significant
debate arose as to what ought to be called a distractor (see Dulsky, 1932,
Psychological Review). In fact, early efforts to study attention using distractors
often failed “because it was impossible to obtain a satisfactory distractor”
(Dulsky, 1932, p. 590).That said, what did come from those early years was a
new way of talking about distractors: “distractor” is not a label to be used in
relation to attention (or as a means to study that abstract concept), but rather
in relation to performance. The rationale is simple: given that we don’t
know what attention is, but we do know how to measure performance, it
is best to simply define distractors as those stimuli that hinder performance
(Dulsky, 1932).
The goal of this chapter is to challenge this conception of “distrac-
tor,” which is closely related to the modern use of this term. Our hope is
to highlight the problems with this term, the confusion that it engenders
and, hopefully, provide a way out of this state of affairs by creating a more
modern context in which we can (a) redefine the study of distraction; (b)
clarify the terminology that is used to study attention and distraction; and
(c) identify current sources of confusion in the literature that are very much
related to the confusability between the labels “distractor” and “distrac-
tion”. We will begin by presenting a literature where the term distractor
is heavily used (viz, visual search) in spite of the fact that the goal of this
work is not to study distraction at all (but in fact attention). Along the
way, we will argue that not all “distractors” are created equal and, thus,
one must be careful when trying to extend the findings from laboratory
visual search to real-world search tasks. Next, we will quickly discuss (and
dismiss) an example of the use of the term “distractor” within the literature
on redundancy gains. Then we will describe a relatively more nuanced case
study regarding the perils of the use of the label “distractor”: the Flanker
Effect literature, a domain in which this term has gained a very promi-
nent role. From this section, we will conclude that it is in fact inappropriate
to make claims about the phenomenon of “distraction” from experiments
using modern-day “distractors,” in spite of our field’s tendency to want to
make such claims. One of our goals, too, is to differentiate the concept of
“distraction” from that of “distractor interference,” which are actually quite
different phenomena.
264 Alejandro Lleras et al.
(2010), subjects were asked to detect the presence of a color oddball item
(i.e. the one item that differed from all others in color). Two different sets of
color pairs were used. In one block of trials, participants were tested with red
and green items, while, in a different block, the items were pink and fuchsia
(two colors closely matched in luminance). Both color pairs produced visual
pop-out: in both cases, RTs were unaffected by set size (3, 8, or 12), with
search slopes of −0.09 ms/item for red among green and 1.19 ms/item
for pink among fuchsia, neither of which was different from zero. So far so
good: the standard interpretation would be that these pop-out discrimina-
tions were computed in preattentive fashion by the visual system.Yet, there
is a kink with this interpretation. Overall, responses were much slower with
the pink and fuchsia stimuli (mean RT = 698 ms) than with the red and
green stimuli (565 ms). How are we to interpret this 133 ms increase in
mean RT? At what point(s) in processing was this rather large delay added?
And what were observers doing during this time? W ere they waiting for pre-
attentive vision to finish processing, without attending to the display? This
seems implausible given other performance benchmarks of the attention
system. For instance, saccades to sudden onsets that match our attentional
template can be triggered extremely quickly, in the range of 130–150 ms
(Hollingworth, Matsukura, & Luck, in press; Kirchner & Thorpe, 2006). Not
only it is difficult to believe that participants would have an added processing
difficulty in “preattentive” vision of a magnitude of 133 ms (during which
attention would not be involved), but the overall magnitude of the RTs is
also equally difficult to interpret. Preattentive vision is supposed to be “fast
and automatic;” the sort of stuff that gets done “before we know it.” How
can this type of processing produce detection RTs on the order of 700 ms?
Are we to infer that preattentive vision can sometimes be that slow? No, we
would argue, even though this answer is at odds with the prevailing view
in the field on how to interpret results from visual search experiments (e.g.
Duncan & Humphreys, 1989). Attention is involved in finding a pop-out
target, and some pop-outs are, in fact, rather hard to find.
Going back to the central issue of what distractors are and how they
are used, it is clear that we (as vision scientists) have a very poor model
for what goes on with attention when distractors fail to have a measurable
effect on performance. This area of potential research has gone unrecog-
nized for the most part, and is still in its infancy (with some exceptions,
Purcell et al., 2010; Schall, Purcell, Heitz, Logan, & Palmeri, 2011; Townsend,
1972; Tseng, Glaser, Caddigan, & Lleras, submitted for publication; Wenger
and Townsend (2000), who earlier recognized the perceived need to use
Distractors and Distractibility 267
of distracting thoughts, which can happen in a benign manner (as in the task-
unrelated thoughts literature, Giambra, 1989; McVay & Kane, 2009, 2012;
Smallwood, Obonsawin, & Heim, 2003) or even pathological manner
(as in Obsessive compulsive disorder, Depression and Anxiety). However, we
are here interested in perceptual distraction: when the occurrence of an event
in the world comes to derail our train of thought or interfere with our task at
hand. More specifically, we will use the domain of vision to understand this
concept. In our terminology, distraction can be defined as times when a visual
event that was initially processed by unattended vision forces the attention
system to orient to it. This reorienting must occur at the cost of disengaging
attention from whatever other object (in vision or thought) that was previ-
ously being attended.We will return to this definition after presenting theory
and methodology that is currently used to assess “distractibility” (the study of
distraction) in our field. But first we must dispense with visual search.
1 A notable exception is the literature on the phenomenon known as Visual Marking (Watson &
Humphreys, 1997). In this phenomenon, it is typically found that previewing half of the search items
(say all green stimuli) for some time before the second set of search items (say, the blue items) is
presented produces search efficiencies identical to those that are obtained when participants only see
and search through the second set of search items (i.e. only blue items). Interestingly, this improved
search efficiency in the “preview” condition is always accompanied by a substantial main effect, in the
order of 50–150 ms. This visual marking effect is critically dependent on attention being allocated to
the previewed items (Watson & Humphreys, 1997), and we would argue that it reflects the process of
candidate selection (selecting all blue items as search candidates, while ignoring green items) and is
central to this paradigm. In spite of its importance, most of the research on visual marking has focused
overwhelmingly in the analysis of slopes, ignoring all intercept effects.
Distractors and Distractibility 271
Definition
Candidates: A candidate is a stimulus that contains at least some of the
defining attributes of a target. In both visual search and many selective-
attention tasks, a candidate is an object that closely resembles the target
in terms of its event-like descriptive characteristics. Does it belong to the
same visual category of items than the target? Is it visually similar to the
target? Does it have the same temporal characteristics as the target (i.e. it
appears/disappears at the same time as a target)? Does it appear nearby or
at a possible target location? As a result, which elements of a display are
candidates can only be determined once a task is defined and the target of
the attention system is determined. In visual search, the number of candi-
dates is what determines the functional set size for a scene. Candidates are
always highly relevant to the search task because of their status as “poten-
tial targets”. Candidates do not have stimulus–response associations in a
task, but they can nonetheless inform responses. For example, in a present/
absent visual search task, every inspected and discarded distractor is further
evidence that the response on the trial is more likely to be “absent”. See
Bundesen (1990) for a similar definition regarding relevant distractors: those
that are similar to the target along the defining characteristics of the target.
of targets (Mordkoff & Yantis, 1991); when these correlations were elimi-
nated, single-target trials produced exactly the same RTs whether or not a
nontarget was also included within the display. In other words, there was no
actual decrement in performance due to the nontarget item; the slowing of
RT was caused by the information carried by this item, instead. Even more,
we would here argue that this nontarget should not really be thought of as
being a distractor, because it was a candidate, due to being in one of the very
few locations in the entire display at which targets ever appear.
The second way in which this work might be relevant to the study of
distraction is in how a distinction was made between nontargets that some-
times appeared with targets, which were called “distractors,” and nontargets
that never appeared with targets, which were called “noise”. The main rea-
son for keeping these two types of nontarget stimuli separate was to be able
to calculate separate correlations between their presence and the correct
response (Mordkoff & Yantis, 1991); these calculations were crucial to the
demonstration that the so-called “distraction decrement” does not actually
exist. But the use of two different labels for items that, on the surface, play
identical (non-)roles in the task also shows that the idea that some nontar-
gets are more equal than others is not completely new. When one adds in
that these nontargets can carry different amounts of information—in the
technical sense of the word—a few doubts should be raised about the use of
the label “task-irrelevant” to refer to nontargets. But this is probably better
explained in the context of the task to be discussed next.
the term “noise” element was replaced by “distractor” (or sometimes just
“flanker” because the distractors tend to be presented on both sides of the
target letter, flanking it). In other words, in this context, one uses the word
“distractor” to refer to target-like stimuli (most often, exact copies of the
possible targets themselves) that are presented at locations that are near to
the target. The goal of this paradigm is to measure the degree to which
attention can focus solely on the target item itself (a test for what is referred
to as “early selection”, Neisser & Becklen, 1975; Sperling, 1960;Treisman &
Geffen, 1967). If performance is unaffected by the presence or identity of
the distractors, then one can conclude that selective attention successfully
“filtered out” the “irrelevant” information from the display. In most cases,
however, it is found that response times are strongly modulated by the iden-
tity of these flanking distractors (e.g. evidence for so-called “late selection”,
Deutsch & Deutsch, 1963; Norman, 1968), an effect known as the Flanker
Effect.This result is interpreted as evidence that the distractors have been pro-
cessed to a sufficiently deep level of processing (at least to the level of stimulus
identification) such that they, too, can activate response selection processes. In
fact, the Flanker Effect is most often measured as the difference in RTs between
two conditions: one in which the distractors activate the same response as the
target for the trial (compatible or congruent condition) and one in which the
distractors activate a different (incorrect) response from the target (incompatible
or incongruent condition), with responses on incongruent trials typically being
anywhere between 30 and 100 ms slower than on congruent trials. When a
Flanker Effect is obtained, it is generally concluded that selective attention has
failed in some way, allowing task-irrelevant items to be processed.2
2 It should be noted that, with regard to the presence or absence of a Flanker Effect, the same logical
error is being made as is for visual search. While the presence of a (significant) Flanker Effect is
evidence that the flanking distractors were, indeed, processed, the absence of a Flanker Effect does not
necessarily imply that the flankers were not processed. This point was made rather forcefully by Driver
& Tipper (1989).
274 Alejandro Lleras et al.
3 Note that not all stimuli need be response informative to be considered task-relevant. Candidates
are one such example: in visual search tasks where participants must report the identity of the target,
candidates themselves are uninformative to the trial’s response. A spatial cue in a Posner-type cueing
paradigm is also an example of a task-relevant but response-uninformative stimulus: it tells observers
where they might find items that contain response-related information. But the cue itself is not
informative to the response.
276 Alejandro Lleras et al.
Definition
Foil: A foil is a type of candidate that can cause a participant to produce
the wrong response in a trial because foils have links to potentiated responses
in a task. They often contain the same response-defining attributes as the
set of targets. In a selective attention task, a foil is often an object that is
identical to one of the possible targets but is not the target itself because
of a priori reasons: it differs from the target along one (or several) defining
characteristics. For instance, the target might be determined by its unique
location, or the foil itself might have a unique prespecified location. A foil
may also appear at a different point in time in a trial than the target (as
in priming experiments). Foils are automatically selected by the attention
system, to the extent that they are perceptually well represented. Selecting
and rejecting foils is a critical part of what attention must do in order to
properly respond on a given trial.
see why there was a need in the literature to differentiate between these
two forms of Flanker Effects: the one that arises when distractors carry
some information about the response (by design or by accident), which is
the correlated-flankers effect, and the one that arises when the distractors
carry no information about the response, but have an effect because they
are the same stimulus as one of the actual targets, which is the traditional
Flanker Effect.4
In a somewhat unfortunate turn of events, contemporary cognitive
psychology has continued to use the original “task-irrelevant” modifier to
describe distractors in a flanker task. It is unfortunate because most of us
have moved beyond that use of the term “task relevancy” and use a more
contemporary definition of relevance that implies a very different under-
standing of the role of distractors in the flankers task and their relationship
to the study of distraction. The newer use of the term “task-relevant” arises
from research on phenomena like attentional capture, task switching, and
executive control. In attentional capture, for instance, people study what
aspects of a stimulus make the stimulus more or less “attractive” to the atten-
tion system. Folk et al. (1994) demonstrated the phenomenon of contingent
attentional capture: that a visually salient element captures attention to the
extent that some of its defining characteristics match those characteristics
that define the target stimulus. A moving stimulus draws attention to itself
to the extent that the attention system is looking for moving-like things
(e.g. targets that are moving or have sudden onsets, or some other stimulus
property that also characterizes motion). These attentional control settings are
determined by the task demands, and, some would argue also by the behav-
ioral urgency of certain stimuli (e.g. Franconeri, Alvarez, & Enns, 2007; Lin,
Franconeri, & Enns, 2008; von Mühlenen & Lleras, 2007).
In sum, we now use the term “task-relevant” to describe the level of
overlap between distractors and targets, either in terms of their visual char-
acteristics or their functional description with respect to the task character-
istics (Are they both sudden onsets? Do they appear in tandem? Does one
precede the other? At the same or different locations? etc. See also Yantis &
Egeth, 1999).
4 It is worth noting that, by the information theory-based definition of task relevance, all the nontargets
in nearly every published visual search study have actually been highly relevant, since each item that
is identified as not being a target increases the likelihood that any given not-yet-identified item is a
target. Likewise, the total number of items in the display is equally relevant, because, as more items are
included, the odds of any particular item being a target are reduced. In other words, reverting to the
old definition of task relevance is not going to change our earlier argument that the nontargets in a
visual search display are not a source of distraction, even when they cause responses to be slower.
278 Alejandro Lleras et al.
strongly suggests that the unexpected stimulus is not seen. Subsequent work (e.g. Moore & Egeth,
1997) has indicated that the unexpected stimulus is, indeed, perceived, but never reaches awareness
and/or is quickly forgotten. But we are stuck with the name for the paradigm.
Distractors and Distractibility 279
ignore the stimulus for their primary task (i.e. the cross in our example) and
just focus on trying to detect any other objects in the display. In this last
trial (referred to as the full attention trial), participants are typically at ceil-
ing at detecting the critical stimulus.This is important because it guarantees
that the critical stimulus is actually perfectly visible. Furthermore, it allows
the experimenters to conclude that the reason why participants failed to be
aware of the critical stimulus was that they were completely immersed in
processing a different object (the cross) at the time it appeared.
This is not the only paradigm in which inattentional blindness has been
studied. Neisser had earlier pioneered the use of video to study the same
phenomenon (Neisser, 1979; Neisser & Becklen, 1975) asking participants
to attend to one of the two superimposed movies. Participants were, as
one would suspect, quite unaware of unexpected events in the unattended
film. The video paradigm was also popularized recently by Simons et al.
who demonstrated that one does not need two superimposed videos to
create inattentional blindness: grabbing a cue from Mack and Rock (1998)
and Simons and Chabris (1999) showed that simply asking participants to
be intensely engaged in some attentive task (like counting the number of
bounces and passes of a basketball) would trigger inattentional blindness to
unexpected events occurring in that same video. The added benefit of this
technique is that unexpected events can be prolonged in time (the time it
takes a gorilla to walk across a scene, and pump its chest a few times), as long
as they start and finish while participants are engaged in the attentive task.
Follow-up experiments also showed that the likelihood participants will
become aware of the critical stimulus increases the more the critical stimu-
lus resembles the events in the attentive task. For instance, people counting
bounces and passes in a team of people wearing black t-shirts will be more
likely to detect the appearance of a (black) gorilla, than those counting
passes in a team wearing white t-shirts (for a similar demonstration, see
Most et al., 2001).
In this sense, unexpected event paradigms do hold promise for the study
of distractibility. Why? Because they allow one to ask the question: will an
observer’s train of thought be interrupted by a secondary event, against the
observer’s own goals to concentrate on a primary task. In fact, the unex-
pected event paradigm has inspired a number of applied investigations
into issues relating to distractibility. In the driving domain, Strayer et al.
(e.g. Strayer & Drews, 2007) have proposed that talking on a cell phone
produces a form of inattentional blindness (to the extent that people overly
concentrate on the cell phone conversation) such that participants will be
280 Alejandro Lleras et al.
less likely to remember or identify objects that they actually fixated during
the driving task, if they were talking on the cell phone when those objects
appeared. In other words, the work of Strayer et al. suggests that the addi-
tional cognitive load involved in having a cell phone conversation creates
a situation where participants are less likely to attentively experience the
objects that their eyes fixate during driving. This is perfectly in line with
Mack and Rock’s initial account of inattentional blindness but extends that
account to attentionally engaging events outside of the realm of vision.That
is to say, whereas one could have interpreted the initial findings of inatten-
tional blindness as reflecting a limitation of visual attention, the findings in
the applied literature suggest that they are more general than that. We do
not fail to see the critical stimulus in the unexpected event paradigm
(or the gorilla in Simons & Chabris’ video) because our visual attention
cannot be focused on two visual aspects of the scene at once. Rather, we
fail to see the critical stimulus because our attention system (irrespective
of modality) has a difficult time doing two things at once: processing the
information required in the demanding primary task, as well as encoding
and responding to the unexpected stimulus.
actively engaged by the reorganization task (i.e. by the time the Critical
Stimulus appeared, participants were just rehearsing the ordered letters in
memory).
Overall, this brief (and admittedly selective) glance at some of the inat-
tentional blindness literature suggests that distractibility may depend on the
degree to which we are currently engaged in a centrally demanding task: the
more engaged we are in that task, the less distractible we are by unexpected
events (see also Macdonald & Lavie, 2008, 2011). To touch back briefly
on an issue raised in the section on visual search, all evidence suggests that
visual processing proceeds normally even in the absence of attention.Visual
processes like perceptual grouping and surface completion (and others) are
all performed even in the absence of attention, as operationalized by the
occurrence of inattentional blindness (e.g. Moore & Egeth, 1997; Moore,
Grosjean, & Lleras, 2003).This is important because it underscores the need
for revisiting some visual attention theories. We can be fairly confident that
(1) vision unfolds with or without attention, which is the reason we have
a rich phenomenal experience of the visual world even though we cannot
attend to it in its entirety at any given moment; (2) attention can access any
level of visual processing to bias processing in a particular direction; and
(3) therefore, there seems to be no need to assume or propose some form
of uniquely preattentive processing that must precede attention in time.
There are no proto-objects (Rensink, 2000); there is no massive parallel
preattentive vision (Treisman & Gelade, 1980). We believe that any model
of attention that assumes so is likely misguided.
Returning to the issue of distraction, the question is: why do we expe-
rience inattentional blindness in the first place? What factors determine
whether we do? Is inattentional blindness a failure of some sort or might it
reflect an efficient, calculated tradeoff, instead? These are complex question
and we will attempt to offer a possible answer to them in Section 3 of this
chapter. But first, let us reexamine the issue of task relevance in the stimulus,
using a simple inattentional blindness paradigm.
variation. Rather than comparing stimuli that vary along their color, we
will simply compare two different critical stimuli: one will be clearly task-
relevant (it will be a foil), the second one will not. However, the irrelevant
stimuli will be significantly more luminant than the first. Here then, we are
pitting the salience of a stimulus (in terms of its overall luminance) against
the relevance of a stimulus (in terms of the task set).The question is: can we
create inattentional blindness when the critical stimulus is a foil (i.e. task-
relevant)? If not, then this is evidence that task-relevant stimuli (like the
distractors used in the flankers paradigm) are not good stimuli to use when
one wants to draw conclusions about distractibility. That is because such
evidence would show that task-relevant stimuli are never unattended in the
first place. To answer this question, we will use two possible critical stimuli
(CS) a bright-white square and a white letter. The main task of the partici-
pants will be (as in a flankers task) to identify the letter in the center of the
display.The task-relevant critical stimulus will be simply a traditional flanker
(i.e. a foil, one of the possible target letters, presented slightly above, below,
to the right or left of the target).We will compare performance in this con-
dition to performance in a condition where, rather than a letter, we present
a white square that is 1.5 times larger than the letter. Because the square is
completely filled-in with white, and the letter is only drawn with a small
portion of the pixels used to fill up the square, we can be certain that the
square is substantially more luminant than the letter. Thus, if we are correct
that stimuli which are highly relevant to the task are almost always selected
by our attention system (as something that attention should select from the
display), one would expect very small levels of inattentional blindness to
the foil version of the CS. In contrast, given that the square is completely
irrelevant to the letter-identification task, one would expect a much larger
degree of inattentional blindness to the square, in spite of its much larger
visual presence in the display.
Eighty four subjects were asked to complete a brief five-trial study, using
a traditional unexpected event paradigm. Participants were told that their
task was to identify a briefly presented letter and report its identity. The
letter could be an A or an E, in lower or upper case, although the letter
case was irrelevant to the response. To make matters challenging, the let-
ter (about 1° of visual angle in extent) was preceded by a ∼100 ms long
random-dot mask (about 2° of visual angle in extent), which was imme-
diately followed by the letter (presented only for ∼70 ms), which was in
turn immediately followed by a new random-dot pattern mask that stayed
on the screen until participants had recorded a response. In the first three
Distractors and Distractibility 283
trials of the experiment, those were the only visual events in the display, and
participants completed the task with a good degree of accuracy. Average
accuracy in the letter identification task in the first trial was 74%, and rose to
90% and 92% on the second and third trials, respectively. By the third trial,
participants had a mean response time of 1470 ms (st. dev. 316 ms), which
is not unusually long given that response time was not stressed in the task.
Then came the unexpected event trial: the critical stimulus was pre-
sented on the screen at the same time as the first random-dot mask and
remained on the display until the target letter was replaced by the sec-
ond random-dot mask. In all, the critical stimulus stayed on the screen for
160 ms, more than twice the duration of the target.The critical stimulus was
presented 2° of visual angle away from the mask and could appear above,
below, to the right or left of it.
Let us begin by establishing whether or not our main task and stimuli
can, indeed, produce inattentional blindness by looking at performance
in the group of subjects that was assigned to the square critical stimulus
(which was approximately 0.75° of visual angle), a stimulus that was very
much like the critical stimulus in many of Mack & Rock’s original stud-
ies. How many participants reported seeing the unexpected square? Only
18 out of 42 participants (43%). When forced to guess the location of
the unexpected stimulus, 17 out of 42 correctly reported its location. In
other words, we produced a substantial degree of inattentional blindness
to the square. Did the onset of the unexpected square interfere with the
participants’ effort in the primary task? Trial 4 accuracy was 97%, so, at
first sight, one would argue that it did not. A post hoc RT analysis (limited
by the variability of a one-observation/participant measure) suggested
that it did not: subjects who did not report seeing the square responded
to the letter target with an average RT of 1450 ms (st. dev. 600 ms), well
in line with their performance on Trial 3. In other words, even though
an unseen stimuli could theoretically have affected their RT (e.g. Moore
et al., 2003), it failed to do so. In contrast, there was some suggestion in
the data that those who did see the square actually slowed down in their
response to the letter: the RT for the 18 participants that did see the
square was 1661 ms (st. dev. 510 ms).The difference failed to reach signifi-
cance, mostly because of the inherent variability in the measure. Finally, it
should be noted that in the full attention trial, 40 out of 42 observers saw
the square, and 38 out of 42 correctly reported its location. So, about 90%
of subjects had no trouble seeing the square when not attentively engaged
in the central letter task.
284 Alejandro Lleras et al.
Overall, we can conclude that with our task parameters, and using a task-
irrelevant stimulus, we can create substantial levels of inattentional blindness
(almost 50%, the difference in detection between full attention and inatten-
tion trials). What happens when we replace the white square with a much
smaller foil (i.e. a task-relevant letter)? In this task-relevant group, the critical
stimulus was either the capital letter A or E. It should be noted that the two
experimental groups were ran simultaneously and that our research assis-
tants were blind to the experimental condition. This is important because
it guarantees that all participants received the same instructions and that
research assistants could not knowingly or unknowingly affect the outcome
of the experiment. So, was this smaller “flanking” letter treated differently
by the attention system of our subjects than the square? Absolutely: 34 out
of 42 (81%) participants reported seeing the distractor letter, almost twice
as many subjects who saw the square. Did the onset of this letter affect their
performance in the central letter identification task before they even knew we
would ask questions about this unexpected letter? Yes, again. Remember, when
the critical stimulus was a square, participants in Trial 4 identified the target
letter almost perfectly (97% correct). When the critical stimulus was a foil
(one of the possible targets), target identification performance dropped to a
dismal 69% (chance being 50%). RTs also substantially increased to 2022 ms
and were highly variable (st. dev. 1408 ms). Importantly, it was only after
participants had completed this response that we asked whether they had
seen an unexpected event in the display. By the time we asked, all perfor-
mance indicators suggested that yes, indeed, the foil had by and large not
gone unnoticed. How visible was the foil? In the full attention trial, 40 out
of 42 participants reported seeing the foil and 38 out of 42 (90%) correctly
reported the foil’s location. So, the a priori visibility of the square and letter
foil was well matched across conditions, both were at 90%. Given that 81%
of participants reported seeing the letter in the inattention trial, our results
suggest that for the most part, there was little-to-no inattentional blindness
in this condition. In sum, the attention system spontaneously detected and
selected the foil (letter distractor), even though participants knew nothing
about the possibility that a letter might appear in the periphery, and the
act of selecting this letter substantially impacted their performance in the
primary task.
Knowing that participants were not blind to the foil, one can do a
second pass at the results and ask the question: was there a Flanker-like
congruency effect in our experiment? Was the main letter identification
task modulated by the congruence between target and foil? Yes again.
Distractors and Distractibility 285
might be tempted to infer that adding clutter (or otherwise increasing percep-
tual load) would be advised for situations where attentional focus is required,
such as driving, but – as even Lavie (2010) admits – this advice would best be
not taken. At gut level, this proposal sounds just wrong and ill-advised. Another
important finding to come out of the review is that increased cognitive load creates
more distractibility.We have not yet defined cognitive load here, but it can intui-
tively be thought as reflecting the cognitive difficulty of a task or the additional
cognitive difficulty brought on by a secondary task. So, one should try to work
under conditions of low cognitive load to avoid distractibility.While at first this
sounds reasonable, let us translate the technical jargon in this conclusion: Lavie
proposes that when we are mentally busy, we are at our most distractible, and the
more we try to concentrate, the more distractible we will be. This is why she
proposes that we should try to work under conditions of low mental load. But,
what would be the point of concentrating on a task if not to shut out the world
and protect our thoughts from worldly distractions? Lavie’s “cognitive load”
proposal again is not only counterintuitive, but it is a proposal that flies in the
face of the entire inattentional blindness literature (in addition to being at odds
with data from her own lab, Macdonald & Lavie, 2008, 2011): if nothing else,
the theoretical and applied literature on this phenomenon has taught us that we
are insensitive to otherwise easily visible events when we are highly focused on
a cognitive task, it be judging the lengths of the arms of a cross (Mack & Rock,
1998), getting ready to produce a list of complicated navigation instructions
(Simons & Levin, 1998), identifying a briefly presented letter (above), alpha-
betizing a list of letters (Fougnie & Marois, 2007) or talking on the cell phone
(Strayer & Drews, 2007).
So, what gives? We propose that these conclusions (all based on soundly
conducted experiments and robust effects) arise from a fundamental misun-
derstanding of the term “task-irrelevant distractor” and confusion between
the concepts of distraction and distractor interference. Lavie (2010) calls the Flanker
Effect: “the most conventional laboratory index of distraction” (p. 144). Lavie’s
Load Theory was entirely inspired by results from Flankers experiments and
most of her work on attention uses variations on “task-irrelevant distractor”
paradigms in which the distractors are not really task irrelevant.We have already
suggested these are not appropriate paradigms for studying distraction. Dis-
traction is the concept about how events or thoughts that we have no a priori
intention of attending to or thinking about, come nonetheless to be attended
or thought of. To reiterate, foils in a flanker task are task-relevant by design,
so they fail the basic litmus test to be informative regarding the phenome-
non of distraction. Our attention is actively set to select and scrutinize foils.
Distractors and Distractibility 287
Thus, (1) we should not be surprised if they end up influencing behavior, and
(2) they do not really distract us, as much as they interfere with our stated goal of
reporting the identity of only one letter in the display (the target). We propose
that there is a fundamental difference between these two ways in which our
thoughts can be affected by an event (or thought): distraction, which we already
defined, and distractor interference. Unlike distraction, distractor interference refers
to the impact on performance of stimuli that are a priori relevant to our behavior
but not the target of our task.
Let’s return to the example of a visual search task: if the goal is to find
a red circle and we bias our visual attention to select red items, the degree
to which the number of distractors will interfere with our task of finding
the red target will be determined by the level of functional overlap (or task
relevance) between the distractors in the display and the target. If all distrac-
tor shapes are blue, there will be no distractor interference in this task and
participants will find the target irrespective of set size. If, on the other hand,
there are also red square distractors, these red distractors (because they are
candidates) will interfere with our goal of finding the red circle, and RTs
will increase with set size. Unless of course, we can bias our attention s ystem
to find the target in terms of its shape (rather than its color), in which
case, there will be no functional overlap between our a priori intentions
(of finding circles) and the distractors (squares). In Section 4 of this chapter
we will review how we believe selection works in these simple examples.
For the time being, it is important to recognize that the set-size effect in
visual search is an example of distractor interference, not one of distraction.
We are not distracted by the distractors, we are interfered with by the distractors,
and in particular, by those distractors that are relevant to our task of finding
the target. In our new terms, we inspect any and all and only candidates.
The same is true with the Flanker Effect and this follows because the flanker
task is functionally equivalent to a visual search task without spatial uncertainty
(Eriksen & Eriksen, 1974). In other words, it is incorrect to say that we are dis-
tracted by foils in a flanker task, we are simply interfered with by them. From
this perspective, it is also easy to understand why the actual number of objects
in a real-world scene will always be larger than the functional set size for any
given visual search in that scene (the number of candidates).The functional set
size will be determined by the number of objects that are a priori of interest
to us in the scene. Looking for a person in a room filled with various furniture
items will be accomplished without any effect of the number of pieces of
furniture because the furniture cannot exert any distractor interference with
our search task since they bear no functional overlap with our task settings
288 Alejandro Lleras et al.
(for finding a person). But, if we are looking for a specific furniture item, then
furniture items will be a priori items of interest to attention and will produce
distractor interference effects (a significant set-size effect), whereas the number
of persons in the room will be irrelevant to performance in that case.
Returning to Lavie’s arguments, as explained earlier, we believe that
extrapolating from Flanker tasks to the domain of distraction is inappropri-
ate. The problem is that, while the flankers might not be providing infor-
mation in the sense of information theory, they are highly task-relevant
because they are foils—i.e. they are very much like the targets. This greatly
contrasts with the truly irrelevant stimuli that are used in most experiments
on inattentional blindness, such as the presentation of an unexpected square.
Even more, the data from our small experiment confirmed that attention
does treat those two situations extremely differently: when we are looking
for As and Es, the presentation of an A or E near the target location will not
go unnoticed, whereas the presentation of a bigger, brighter white square
can be completely ignored. Thus, the foil in a flanker task will be processed,
which in a way is the point of the Flanker Effect. But, as our results suggest,
one cannot generalize between situations with flanking foils (which are
actually task-relevant) to those obtained with flanking squares (which
are substantially less task-relevant). The two types of distractors are treated
in a profoundly different manner by the attention system.
In sum, one cannot, as Lavie does, extend the findings from traditional
congruent and incongruent flanking stimuli (the sort that produce Flanker
Effects) to task-irrelevant stimuli (the sort that cannot produce distractor
interference), like those in most real-life situations pertaining to actual dis-
traction. In fact, we want to argue that finding a Flanker Effect in an experi-
ment is, to some important degree, a measure of the success of our attention
system (not of its failures) because it demonstrates the degree to which our
attention and information-processing system is able to simultaneously per-
form the task (with accuracies close to 100%) while also picking up several
other candidate stimuli from the display. So, whereas Lavie (and many others
before her) has characterized the presence of a Flanker Effect as a limitation
of the selective attention system, we propose that it might index its efficiency.
The Flanker Effect is not to be interpreted as evidence that attention works
as a late selection filter. Just the opposite: it is clear evidence of attention
working as an early filter, a filter whose setting is determined by our goals.
for representation among items in the display. In other words, when the
brain can (without the need for biased competition, i.e. constrained spatial
attention) represent all letters in the display, there will be larger Flanker
Effects, precisely because the brain can successfully represent and select
the relevant items in the display, and these representations have, in turn, an
opportunity to independently activate response selection processes. The
fact that this opportunity exists is what gives rise to distractor interfer-
ence. Well-represented/identified distractors can activate stimuli–response
associations and thereby interfere with our goal of producing a response to
the target only. In contrast, when display items are poorly represented, our
attention system ends up having to bias the competition to each stimu-
lus separately (via spatial attention, which is effortful and works in serial
manner) and thus there are fewer opportunities for distractor interference
to arise. In other words, we believe that the presence of a Flanker Effect
reflects to some degree a level of attentional success: it reflects the success
of selecting multiple stimuli from a display. Which stimuli? Those that are
relevant to our task, those that we a priori set our system to select from the
display. Certainly, the magnitude of the Flanker Effect is likely determined
by a number of factors (e.g. how small can we make our “spotlight” of
spatial attention; the spatial arrangement of targets and distractors; is the
target at fixation and distractor in periphery or vice versa; as well as a
host of grouping and segregation cues that may further help attention
to discard distractors, like color, etc.). The point here, though, is that the
fact that there is an opportunity for distractor interference should be inter-
preted as evidence that attention is efficiently selecting from the display
the things it cares about.
These are all tasks that ask the same question: to what degree aspects of
a task-relevant stimulus impact target processing. They measure distractor
interference.Yet, in our haste to extend our results to the real world, to claim
that our experiments can be applied to important real-life challenges, like
the understanding of distraction and distractibility, we might be tempted to
substitute one term for the other. This is wrong. This is not to say that the
results from these experiments do not inform important real-world deci-
sions like, for example, how to design a high-efficiency workplace. They
clearly do, as we reviewed in the paragraph above. That said, we must be
more careful about what the conclusions that we can draw about our
experiments are and avoid overreaching in our explanatory power. To avoid
making such mistakes, we believe it is important that we start being more
mindful in the use of terms in our discipline, like distraction, distractibility
and task (ir)relevance. Or we risk drawing the exact opposite conclusions
from our data, as Lavie (2010) has done, or perhaps more subtle, use the
results of our experiments to make inferences about phenomena that they
cannot inform (as Kim et al., 2005).To this end, we have proposed the use of
new terms, candidates and foils, to identifying different types of distractors.
These labels are useful because they also help us to determine the explana-
tory bounds of the effects observed with each type of distractor.
attentive task can be seen in Moore, Lleras, Grosjean, and Marrara (2004). In
that experiment, participants were asked to report the identity of a centrally
presented letter (forward and backward masked). In addition to the target
letter, a small dot could appear either to the right or to the left of the target.
Participants completed a first block of 64 trials with this setup, followed by
a short block of trials where we tested participants’ awareness for the small
lateralized square, as in an inattentional blindness experiment. Only 16% of
participants reported having seen the square in the inattentional blindness
trial. Critically, participants were asked to complete a second full set of 64
trials, identical in every way to the first block of trials.We used the accessory
Simon effect (e.g. Simon, Acosta, Mewaldt, & Speidel, 1976) as a measure
of distractor processing (via distractor interference). Whereas the square did
not produce any interference on the letter identification task before the inat-
tentional blindness trial, it produced robust levels of distractor interference
in the second block of trials. In other words, participants in the first block
of trials were unaware of the square (as assessed by the inattentional blind-
ness results) and therefore it failed to impact performance. In contrast, once
we asked questions about the square, they not only became aware of it, but
incorporated it into their task. From then on, the presence of this square
interfered with the responses to the central target on every trial.
A second problem with the unexpected event paradigm is one of gener-
alizability. It is true that the paradigm does reflect a setting that one may find
often in the real world (when one is effortfully attending to one event and a
completely unexpected event takes place).Yet, there is the perhaps far more
common situation of being in a busy environment (and knowing some of
the characteristics of the environment) while trying to effortfully engage in
some mental activity. For instance, one may be trying to read an important
email from work while children are playing around. Or one may be talk-
ing on the cell phone while driving. In both cases, one is well aware of the
characteristics of the environment. And one may decide to only pay atten-
tion to one thing (i.e. ignore the children in the first example) or pay mostly
attention to one thing (i.e. momentarily decreasing attention to the driv-
ing). How will we react to events along these unattended (or significantly
underattended) channels of information? This is an important question that
has been asked as far back as Treisman (1960). And one that deserves being
asked. With respect to the domain of driving, Strayer et al. have shown, for
example, that drivers talking on the phone are 10 times more likely to fail
to come to a stop at a four-way intersection, and they are significantly less
likely to remember traffic-related events that occurred during their driving
Distractors and Distractibility 293
(in a simulator) than when the events appeared and they were not talking
on the phone (Strayer & Drews, 2007). What Strayer et al. argue is that this
is because of inattentional blindness: drivers actually are less aware of the
world while on the phone, and this decreased level of awareness does not
appear to be mitigated by the traffic relevance of worldly events. That is,
once drivers start underattending the driving environment, they seem to
lose sensitivity to the driving relevance of events in the world. But one must
highlight a certain incompatibility between Strayer’s findings and those in
the inattentional blindness’ laboratory: whereas Strayer and Drews’ findings
suggest that the relevance of events is not associated with drivers’ awareness
of those events, the inattentional blindness literature shows that relevance
does impact awareness. Clearly, more research needs to be done to under-
stand underattended perception in a paradigm where we can systematically
manipulate such things as the degree of cognitive difficulty in a task (cogni-
tive load), the cognitive engagement in a task (motivation), as well as the
relevance of events in the unattended/underattended channels of informa-
tion. Below, we propose one such paradigm.
task-relevant stimulus and 700–1200 ms before the onset of the next task-
relevant stimulus. Images could appear at one of the four possible locations
(above, below, to the right or left of the center of the display). Only one
image was present at a time.When a new image appeared, it always appeared
at one of the three unoccupied locations. An image disappeared exactly at
the time the next image in the sequence appeared.
To summarize the experimental task, participants engaged in a com-
plex cognitive task for a period of 1 min at a time. While they did this,
images appeared every now and then on the display. Importantly, when a
new image appeared, it was the only event in the world, the only “interest-
ing” location to look at on the monitor and its presentation was isolated
in time from the presentation of the task-relevant stimuli (that is, it did not
compete with other stimuli for sensory attention). A schematic of the trial
events is shown in Figure 7.1(a). Figure 7.1(b) and (c) show results from
this task in three versions of the task. The experimental stimuli and events
were identical in all three experiments. The only thing that differed was
the task we asked participants to perform on the task-relevant stimuli. The
task-relevant stimuli were a set of audio files with someone’s voice recit-
ing a simple mental operation (“plus one”, “minus one”, “plus two”,… up
to “minus five”). First group of participants performed a 1-back task on
the list of operations, that is, they counted the number of times the same
math instruction was presented twice in a row. This was a “low-cognitive
load” group. A second group of participants performed a 2-back task on the
operations, that is, they counted the number of times in the 1 min trial, the
current operation was the same as the operation before the last one. This
was a “high-cognitive load” group. Finally, a third group of participants was
asked to actually compute all the math operations starting from a three-digit
number that was presented to them at the start of the 1 min trial (a running
arithmetic task). This was also a “high-cognitive load” group.
As can be seen from Figure 7.1, the data we collect is simply a measure
of where people look when a new and very salient photograph suddenly
appears in the display.The results speak for themselves. As one would expect
(and as would be predicted by all theories of visual attention), when par-
ticipants are only doing a very easy cognitive task (one that only requires
rehearsal of auditory information), participants spontaneously look at our
photos: 75% of the time, within 200 ms of a new image appearing, their
eyes land on the photo. No surprise there. In fact, if there is a surprise is
that the percentage is this low: one might have expected something closer to
100%. Be that as it may, it provides us with a baseline level of performance:
Distractors and Distractibility 295
(a) +1 -2
123 …
1500 ms 1500 ms 700 + 200 ms ~ 650 ms 1650 + 200 ms 700 + 200 ms ~ 650 ms
3000 ms
(b) Regards to new image (c) Regards to blank regions of the screen
before and after onset of image before and after onset of image
1.0 1.0
0.9 0.9
Proportion of regards
0.8 0.8
to area of interest
0.7 0.7
0.6 0.6
0.5 0.5
0.4 0.4
0.3 0.3
0.2 0.2
0.1 0.1
0.0 0.0
–200 –100 0 +100 +200 +300 +400 +500 –200 –100 0 +100 +200 +300 +400 +500
Time (ms) Time (ms)
1-back task (low load) 2-back task (high load) math task (high load)
Figure 7.1 Oculomotor capture during mental engagement. (a) Schematic of events in
a trial. Every 3 s, participants heard a new operation. The sound file lasted on average
650 ms. A new image always appeared at an unoccupied location, on average 1650 ms
after the end of the sound file. (b) Proportion of regards to the new image within 500 ms
after image onset (time = 0). Participants reflexively oriented to about 75% of images
in the 1-back task, whereas they oriented to fewer than 50% of new image onsets both
in the 2-back and math tasks. (c) Proportion of regards directed to empty regions of
the display as a function of time across the three cognitive load conditions. All three
experimental groups showed a gross insensitivity to the image onset (time 0). If a par-
ticipant had been looking at an empty region of the display before the image onset, he/
she continued to do so after the onset. Furthermore, the degree of regards to “nothing”
was about twice as likely in the high-cognitive load conditions as it was in the low-load
condition. (For color version of this figure, the reader is referred to the online version of
this book.)
3.3. Discussion
This new task to study distraction is interesting because it reproduces a
real-life situation in which one is trying to complete a mental task, and is
focused on doing so, while there are ongoing events in the world. Interest-
ingly, one has a general idea about the structure of the environment: here,
that images appear with a certain frequency and that one can ignore them,
inasmuch as one wants to ignore them, since they do not inform our deci-
sion making on the primary task. The results suggest that we are sensitive
to some degree to the cognitive demands of a task and that we tradeoff
attention, giving more to our thoughts and less to the world, when cogni-
tive demands are high. Interestingly, this does not seem to be the end of
the story. It is difficult to compare performance and mental effort across
the two high-cognitive load tasks (perhaps separate measures of effort and
mental workload like hear-rate variability and skin conductance would be
informative). So, to further investigate the effect of cognitive demands on
attention, we performed a follow-up analysis on the math task, because we
had a level of control over the actual cognitive difficulty of specific math
operations. We measured on a separate, self-timed task, how long it took
participants to complete each of the math operations in the experiment.
For instance, it took our participants 1.7 s to complete a +1 operation on a
three-digit number, whereas it took twice as long to complete a −5 opera-
tion (3.2 s).These data suggest a higher degree of cognitive effort is required
to complete +5 operations compared to +1 operations. When we analyzed
regards as a function of the difficulty of the math operation, we found no
measurable effect of the difficulty of the operation on the likelihood that
participants will look at the next new image when it appears (Figure 7.2).
Thus, even though for our participants it is substantially easier to add 1 to
a three-digit number than to add 5, the complexity of this operation does
not determine whether they will look or not at the next new image on the
screen.This suggests that the “tradeoff ” between attentiveness to the outside
world (images) and attentiveness to the mental world (cognitive operations)
Distractors and Distractibility 297
(a) (b)
4 1 Proportion looks at new image 500 ms after onset
Self paced time to complete math operation
0.9
Completion time (sec)
3.5
Proportion looks
0.8
3
0.7
2.5 0.6
2 0.5
1.5 0.4
0.3
1
0.2
0.5 0.1
0 0
+1 –1 +2 –2 +4 –4 +5 –5 +1 –1 +2 –2 +4 –4 +5 –5
Operation Operation
Figure 7.2 Analysis of the math task. (a) Participants completed at the end of the exper-
iment a self-paced version of the main experiment, where they had a chance to advance
the operations at their own pace. No images were presented on the screen. Operation
times varied greatly as a function of the operation. (b) Proportion regards on the new
image, 500 ms after its onset. Comparing panels (a) and (b) demonstrates that in spite of
large differences in the degree of difficulty of specific math operations, the type of math
operation participants were performing when the image appeared had no impact on
their likelihood to look at the new image.
Figure 7.3 (a) Figure 3 from Helton & Russell (2012) showing performance (as indexed
by A’) in a demanding sustained attention task, as a function of periods of watch.
Distractors and Distractibility 299
Richter, 2010; Silvia, McCord, & Gendolla, 2010). In their paper, Silvia et al.
assessed motivation in terms of a personality trait (“self-focused attention”),
which has been shown to reflects participants’ willingness to exert effort in
a task, as well as their own level of trait motivation (e.g. Carver & Scheier,
2001; Duval & Silvia, 2001).The authors manipulated the difficulty of a task
by changing the response window (long, medium and short = easy, medium
and difficult, respectively), using a perceptual discrimination that was dif-
ficult to begin with. They measured systolic blood pressure (SBP) reactivity,
which is a good physiological marker of effort (e.g. Bongard, 1995; Smith,
Ruiz, & Uchino, 2000). Participants high in self-focused attention showed
increased SBP reactivity as the difficulty of the task increased. In contrast, for
participants low in self-focused attention, SBP reactivity increased from low
to medium task difficulty levels, and then it dropped when task difficulty
became high. This is evidence that some people can motivate themselves to
exert larger effort in difficult tasks than others. Here we propose that this
decision of how much effort to put into a task is as critical a determinant
of their distractibility as is the cognitive requirements of the attentive task.
Note that we believe motivation can also be directly manipulated by incen-
tives or pressure, and we believe those manipulations would result in the
same effects on attention. There is a need for research along these lines.
Periods of watch are 2 min intervals during which performance is evaluated. The entire
experiment lasts 12 min. (b) Figure 4 from Helton & Russell (2012) showing mean reaction
time in the same task. As can be seen from these two figures, participants initially engage
strongly in the task (first 2 min), both in terms of their initial effort to be accurate (higher
A′) and fast (slower RT). However, performance drops quickly after that initial period
and there is little-to-no change in the remaining five periods of watch, either in terms of
accuracy or RT. Notice that this is the opposite of a speed-accuracy tradeoff: participants
become both less accurate and slower, even though nothing has changed about the task.
This is evidence of voluntary changes in effort (or engagement) in the task, as partici-
pants calibrate their effort, and settle into the task. (c) Figure 1 from Silvia et al. (2011).
Systolic blood pressure reactivity (an index of incurred effort) as a function of task dif-
ficulty (low, medium and high) for participants either low or high in self-focus attention,
which is a measure of how people evaluate their performance with respect to their own
standards and how they motivate themselves to achieve (or not) those standards. People
high in self-focused attention will try harder than people low in self-focused attention as
success is more significant to them and they will motivate themselves endogenously to
achieve better performance. As can be seen, people high in self-focus increase the degree
of effort they put in the task as task difficulty increases from low to medium and from
medium to high. In contrast, participants low in self-focused attention try harder when
difficulty goes from low to medium, but when difficulty further increases to high levels,
they stop trying, and SBP reactivity simply drops. (All figures reprinted with permission).
300 Alejandro Lleras et al.
aversion. This makes it clear how gaze aversion is not merely a reaction to
heightened cognitive demands; it is strategic in nature. We propose that the
attentional system has an executive component that is sensitive to anticipated
cognitive demands (and whether said demands will exceed capacity), as well
as motivational states to bring about a tradeoff between sensory attention
(i.e. attention to world events) and mental attention (i.e. attention to inner
cognitive processing). And we propose that it is this tradeoff, when pushed
to extremes, that leads to the more blatant failures of awareness observed
in inattentional blindness and when driving while talking on the phone. In
a momentary need for extreme inner focus, attention to the world suffers.
The need to reorient attention inward may also help explain other psy-
chological phenomena, such as the attentional blink (Raymond, Shapiro,
& Arnell, 1992). This phenomenon refers to the finding that people often
miss the second of two successive targets, at least when those targets are
presented embedded in a rapid visual stream of distractors and the second
target appears 200–500 ms after the first one. There are several theories as
to why the attentional blink occurs, but most models agree that the blink
itself seems to be tightly linked to the need to “save” information from the
first target in working memory, so that it can be accessible for response later
on. Functionally, this seems like a brief but acute need for inner focus: upon
detection of the first target, and given the presence of so many distractors
(the other letters in the stream), the participant may need to effortfully pick
and store the detected target in working memory. If it is true that an acute
need for inner processing triggers a disengagement from potential sources
of distraction, then the need to store the first target, once it is detected
(“Oh, that’s a target! I need to remember it.”), in the face of rapid steam of
stimuli, may be what causes the blink to occur. This account is not novel
per se. What is new is the explicit presentation of a framework from which
to understand why consolidation into working memory (or any other
demanding and inwardly directed process) would create a blink in the first
place (as several theories have argued, Bowman & Wyble, 2007; Chun
& Potter, 1995; Craston, Wyble, Chennu, & Bowman, 2009; Di Lollo,
Kawahara, Ghorashi, & Enns, 2005; Raymond et al., 1992; Shapiro, Caldwell,
& Sorensen, 1997).
Several studies have shown that more difficult (primary) tasks lead to more
blindness (e.g. Cartwright-Finch & Lavie, 2007; Fougnie & Marois, 2007;
Simons & Jensen, 2009). But performance in the primary task alone is not a
good predictor of inattentional blindness (Cartwright-Finch & Lavie, 2007;
but see Simons & Jensen, 2009). In fact, Simons & Jensen (2009) recently
demonstrated that someone’s skill at a task also fails to predict the degree
of blindness. Why is that? The attentional tradeoff we propose is sensitive to
the anticipated need for executive control, as well as the motivational state
of the participant. The anticipated need for executive control will depend
on a number of factors.The self-perceived skill of a participant at a task will
play a big role in determining need: cigar-rolling experts will require less-
executive oversight of the activity than a beginner, thus, one would predict
that the expert will be less likely to suffer from inattentional blindness while
engaged in this activity. Once an anticipated need is identified, one must ask
the question: how well can the participant fulfill that request? Does he have
the ability to precisely match the need with the corresponding resources?
It is possible and more research is needed to answer this question, but it is
also likely that participants spontaneously assign resources in gross fashion:
“I will focus on this task” vs “I will focus on this task a lot,” rather than
“I will focus on this task with 47% of my resources” vs “I will focus on this
task with 66% of my resources.” This is not to say that participants are inca-
pable of allocating their attention in fine quanta, but that it is more likely
that they spontaneously allocate in relatively large chunks. This may also be
a reason why experimental manipulations of the degree of difficulty of the
attentive task (aimed at capturing incremental levels of attentiveness in the
participants) may not lead to a nicely titrated relationship with performance.
It may also explain why the actual difficulty of the mental arithmetic task
failed to influence gaze aversion in the task presented above: participants are
either attentive to the math task or they are not, as they anticipate a need
for focusing on it to succeed. But once that determination has been made,
whether a specific operation is easy (+1) or hard (−5) is unlikely to change
their overall attentive engagement to the task (Figure 7.2).
Finally, the amount of attentiveness to the main task (and ergo the
degree of unattentiveness to the rest of the world) will also be determined
by motivational and personality characteristics of each individual. As shown
by Silvia et al. (2011), once a task becomes too difficult, some people will
continue to increase their effort to match the demands of the task, whereas
others will simply stop trying. Factors like the self-focused attention trait
(as suggested by Silvia et al.), as well as conscientiousness (e.g. Trautwein,
Distractors and Distractibility 303
(e.g. Anderson, Vogel, & Awh, in press; Duncan & Humphreys, 1989). So,
we can both put in place large “adoption” as well as large “rejection” filters
to process information in parallel. The output of the “adoption” filter is the
set of likely targets for the current task (i.e. candidates). Again, assuming that
the items in the display can be accurately represented (i.e. no crowding),
how fine the “adoption” filter will be in part determined by the ability of a
particular “node” to process specific sets of features that discriminate targets
from other stimuli in the set. The more diagnostic target features there are
(relative to the specific vision node responsible for computing said features),
the smaller the set of candidates or likely targets will be (i.e. the more
effective the first sweep of selection will be). The less diagnostic the target
features are, the larger the set of items is that will be selected in that initial
sweep of selection.
What happens next? It depends on the task. In visual search, the task is
to select the “one” target among the “selected few” possible candidates at
various locations. To perform this operation, a comparison must be made
between the candidates and the target template, and this comparison will
be made in parallel in working memory and will be determined by the
capacity of working memory (Anderson et al., in press). The larger the
capacity is, the more of these comparisons can be made simultaneously.
The smaller it is, the fewer of these comparisons can be made. So, in
fact, the “serial” aspect of visual search observed in most experiments is
actually the result of two massively parallel operations (see also Young &
Hulleman, 2012). An initial sweep that determines candidates (i.e. a priori
targets), that is likely of unlimited capacity (not counting visual acuity
limitations or representational crowding). This initial sweep is followed by
a second parallel sweep that compares candidates to the target template,
also in parallel. However, this second sweep is capacity-limited (Anderson
et al., in press; Pashler, 1987). For the current purposes, let us say that the
maximum number of items is four. Search then will proceed in serial
manner, in groups of four, inspecting the set of candidates, until a match
is found (or until acuity and/or crowding require refixations to new loca-
tions in the search space). Note that the comparison process will also be
limited by the precision of the target representations in memory as well
as the confusability between candidates and target templates (e.g. Alvarez
& Cavanagh, 2004; Awh, Barton, & Vogel, 2007). It is also likely that when
the target is fixed, the comparison process will become more and more
efficient over time (e.g. Carlisle, Arita, Pardo, & Woodman, 2011; Logan,
1988; Woodman & Arita, 2011).
306 Alejandro Lleras et al.
5. CONCLUSIONS
A Flanker Effect experiment is an experiment that studies the
response interference that is created by selected foils on target processing—
what people may call a form of “distractor interference”. Another example
of distractor interference is seen in the color-word Stroop task, where foils
are words that semantically activate the same response tokens as the colors
of the ink in which the word is written (which is what determines the
response). So, there are various forms of distractor interference effects, but,
in general, it is important to recognize that the effects arise because the dis-
tractors are in fact “foils” of some sort (foils because of their visual similarity
to the target as in the traditional flanker or their semantic overlap with the
target information as in the classic Stroop). The attention system efficiently
selects foils from a display (as it does with candidates). As we have argued
before then, paradigms like the Flanker and Stroop cannot measure distract-
ibility and cannot be used to study distractibility because the stimulus caus-
ing the interference was selected in the first place. Inspecting candidates and
foils is a critical part of the task. It is what is intended from the start. Given
that foils are present in the display, inspecting them is in an important way
part of what the participant must do to successfully complete the task.
We have reviewed a number of issues regarding various selective atten-
tion paradigms and more specifically, we have identified the problematic
use of certain labels within this literature (Figure 7.4). We have proposed
a new labeling system for qualifying “distractors” across various tasks, so
as to minimize issues with the interpretation of results from these para-
digms. Importantly, the labels themselves make it clear what the explana-
tory power and the explanatory domain are of a given stimulus and task
set. One cannot and should not try to generalize results from one type of
distractors to another set of distractors without proper evidence that such
generalization is warranted. Conducting a Flanker Effect and conclud-
ing something about distraction is therefore problematic. Having defined
this new set of labels is important because it allows investigators who are
interested in using our paradigms to understand other aspects of cogni-
tion (such as cognitive problems in clinical populations) to know which
tasks and stimuli are most appropriate for studying their phenomenon of
308 Alejandro Lleras et al.
200
Selective attention and distraction
180 Task-irrelevant distractors
160
140
120
100
80
60
40
20
0
1960s 1970s 1980s 1990s 2000s 2010–2012
Figure 7.4 Citation counts each decade for two different searches in PsychInfo.
In white are the citation counts for the keyword “distraction” in all fields within the
specific subject “selective attention”. In black are the citation counts for the search
“task-irrelevant distractors” or “task-irrelevant distractor”. This citation count simply
illustrates the sudden explosion of articles using the terms “task-irrelevant distractors”
in the last dozen years (2000–2012). The citation count for the conjunction selective
attention and distraction is presented here as a baseline. This is instructive as it docu-
ments the research interest in understanding distraction, within the selective atten-
tion literature. That said, most selective attention paradigms are not appropriate for
drawing conclusions about distraction, if they use candidates or foils as stimuli. With
respect to the use of the term “task-irrelevant distractor,” its rise in prominence in the
literature is clearly worrisome as it is likely people are misusing and/or misunderstand-
ing the meaning of the term: 75 of those papers (almost 40%) also include the word
“distraction” as a descriptor of their paper.
performing a Flanker or a Stroop task. The instructions for the task are set
and the participant feels in compliance throughout the trial. In terms of
executive control, the goal structure to complete the task does not change,
even when one is suffering from severe levels of distractor interference, as
in the traditional Stroop task. A person trying to name the ink of a color
word throughout the trial is struggling with completing one specific goal:
naming the ink (not saying the word) of the colored word. That much is
clear. A corollary to this is that no matter the type of task-relevant distractor,
a task-relevant distractor can never alter the boundaries of the task space. In
contrast, the study of distraction is itself a study of changes to the task space.
Distraction is the taking possession of the mind by a stimulus or thought
that the subject never intended to process in the first place. It is a thought or
event that interferes with the “goal stack,” therefore changes the task space.
Participants are suddenly doing (or thinking about) something other than
their stated intention. If prompted, participants can answer the question “are
you currently doing the task you are supposed to be doing”. If distracted,
the answer to that question will be no (Giambra, 1989; McVay & Kane,
2009, 2012; Smallwood et al., 2003), because they can recognize that their
goal stack has changed.
What is particularly pernicious about distraction is that we are not always
aware that a change in the goal stack has occurred.That is troublesome.That
is why understanding distraction is a matter of crucial importance to us as
we try to understand problems like “distracted driving” or rumination in
anxiety and depression. If we are not doing what we are meant to be doing
and are not aware of it, that is a problem. The example that jumps to mind
is distracted reading (Smilek, Carriere, & Cheyne, 2010). Often we realize
we have been “reading” a book but have no idea of what it is that we just
read, because our goal of reading was pushed down our goal stack to a lower
priority than, for example, our preoccupation with Mom’s dinner plans
for thanksgiving. In the visual world, understanding sensory distractibility
is also of crucial importance to understanding issues like performance at
work or human response to alert and alarm systems. A number of interest-
ing questions remain completely open and thus far are largely unanswered:
What events in our intended task are capable of bringing us back to our
main task? The death of the main character in our book? In the case of dis-
tracted driving, will the change of a traffic light to red bring us back from
our cell phone conversation and into the driving task again? This issue of
“competition for goal status” is fascinating and will likely be the source of
much fruitful research in the years to come.
310 Alejandro Lleras et al.
REFERENCES
Alexander, R. G., & Zelinsky, G. J. (2011).Visual similarity effects in categorical search. J ournal
of Vision, 11(8).
Alvarez, G. A., & Cavanagh, P. (2004). The capacity of visual short term memory is set
both by visual information load and by number of objects. Psychological Science, 15,
106–111.
Anersdon, D. E., Vogel, E. K., & Awh, E. A common discrete resource for visual working
memory and visual search. Psychological Science, in press.
Awh, E., Barton, B., & Vogel, E. K. (2007).Visual working memory represents a fixed number
of items, regardless of complexity. Psychological Science, 18(7), 622–628.
Beattie, G. W. (1978a). Floor apportionment and gaze in conversational dyads. British Journal
of Social and Clinical Psychology, 17(1), 1–9.
Beattie, G.W. (1978b). Sequential temporal patterns of speech and gaze in dialogue. Semiotica,
23, 1–24.
Bichot, N., Rossi, A., & Desimone, R. (2005). Parallel and serial neural mechanisms for
visual search in macaque area V4. Science, 308(5721), 529–534.
Bongard, S. (1995). Mental effort during active and passive coping: a dual-task analysis.
Psychophysiology, 32(3), 242–248.
Bowman, H., & Wyble, B. (2007). The simultaneous type, serial token model of temporal
attention and working memory. Psychological Review, 114(1), 38–70.
Bundesen, C. (1990). A theory of visual attention. Psychological Review, 97(4), 523–547.
Carlisle, N. B., Arita, J. T., Pardo, D., & Woodman, G. F. (2011). Attentional templates in visual
working memory. Journal of Neuroscience, 31(25), 9315–9322.
Cartwright-Finch, U., & Lavie, N. (2007). The role of perceptual load in inattentional
blindness. Cognition, 102(3), 1–20.
Carver, C. S., & Scheier, M. F. (2001). On the self-regulation of behavior. New York: Cambridge
University Press.
Chong, S., & Treisman, A. (2003). Representation of statistical properties. Vision Research,
43(4), 1–12.
Chong, S., & Treisman, A. (2005a). Attentional spread in the statistical processing of visual
displays. Perception & Psychophysics, 67(1), 1–13.
Chong, S., & Treisman, A. (2005b). Statistical processing: computing the average size in
perceptual groups. Vision Research, 45(7), 1–10.
Choo, H., & Franconeri, S. (2010). Objects with reduced visibility still contribute to size
averaging. Attention, Perception & Psychophysics, 72(1), 86–99.
Chun, M., & Potter, M. (1995). A two-stage model for multiple target detection in rapid
serial visual presentation. Journal of Experimental Psychology: Human Perception and
Performance, 21(1), 109–127.
Cooper, J. M., Vladisavljevic, I., Medeiros-Ward, N., Martin, P. T., & Strayer, D. L. (2009).
An investigation of driver distraction near the tipping point of traffic flow stability.
Human Factors, 51(2), 261–268.
Craston, P., Wyble, B., Chennu, S., & Bowman, H. (2009). The attentional blink reveals serial
working memory encoding: evidence from virtual and human event-related potentials.
Journal of Cognitive Neuroscience, 21(3), 550–566.
Cunningham, C. A., & Wolfe, J. M. (2012). Extending “Hybrid” visual X memory search to
very large memory sets and to category search. Paper presented at the 53th Annual Meeting
of the Psychonomic Society.
Darlington,T., & Talbot, E. B. (1898). A study of certain methods of distracting the attention.
III. Distraction by musical sounds; the effect of pitch upon attention. American Journal of
Psychology, 9(3), 332–345.
Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual
Review of Neuroscience, 18, 1–30.
Distractors and Distractibility 311
Deutsch, J., & Deutsch, D. (1963). Some theoretical considerations. Psychological Review, 70,
80–90.
Di Lollo,V., Kawahara, J., Zuvic, S., & Visser, T. A.W. (2001). The preattentive emperor has no
clothes: a dynamic redressing. Journal of Experimental Psychology: General, 130(3), 479–492.
Di Lollo, V., Kawahara, J., Ghorashi, S., & Enns, J. (2005). The attentional blink: resource
depletion or temporary loss of control? Psychological Research, 69(3), 191–200.
Doherty-Sneddon, G., & Phelps, F. (2005). Gaze aversion: a response to cognitive or social
difficulty? Memory & Cognition, 33(4), 727–733.
Doherty-Sneddon, G., Bruce, V., Bonner, L., Longbotham, S., & Doyle, C. (2002).
Development of gaze aversion as disengagement from visual information. Developmental
Psychology, 38(3), 438–445.
Driver, J., & Tipper, S. P. (1989). On the nonselectivity of ‘selective’ seeing: contrasts between
interference and priming in selective attention. Journal of Experimental Psychology: Human
Perception and Performance, 15, 304–314.
Dulsky, S. G. (1932). Discussion: what is a distractor? Psychological Review, 39(6), 590–592.
Duncan, J., & Humphreys, G. (1989). Visual search and stimulus similarity. Psychological
Review, 96(3), 433–458.
Duval, T., & Silvia, P. (2001). Self-awareness & causal attribution: A dual systems theory. Boston:
Kluwer Academic.
Ehrlichman, H. (1981). From gaze aversion to eye-movement suppression: an investigation
of the cognitive interference explanation of gaze patterns during conversation. British
Journal of Social Psychology, 20(4), 1–9.
Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon identification of a target
letter in a non-search task. Perception & Psychophysics, 16, 143–149.
Estes,W. K., & Taylor, H. A. (1966).Visual detection in relation to display size and redundancy
of critical elements. Perception & Psychophysics, 1, 9–16.
Fecteau, J. (2007). Priming of pop-out depends upon the current goals of observers. Journal
of Vision, 7(6), 1.
Fischer, J.T., & Whitney, D. (2012). Distractor suppression: attention gates visual coding in the
human pulvinar. Nature Communications.
Folk, C. L., Remington, R. W., & Wright, J. H. (1994). The structure of attentional control:
contingent attentional capture by apparent motion, abrupt onset, and color. Journal of
Experimental Psychology: Human Perception and Performance, 20(2), 317–329.
Folk, C. L., Leber, A. B., & Egeth, H. E. (2008).Top-down control settings and the attentional
blink: evidence for nonspatial contingent capture. Visual Cognition, 16(5), 616–642.
Fougnie, D., & Marois, R. (2007). Executive working memory load induces inattentional
blindness. Psychonomic Bulletin and Review, 14(1), 142–147.
Franconeri, S., Alvarez, G., & Enns, J. (2007). How many locations can be selected at once?
Journal of Experimental Psychology: Human Perception and Performance, 33(5), 1003–1012.
Gendolla, G. H., & Richter, M. (2010). Effort mobilization when the self is involved: some
lessons from the cardiovascular system. Review of General Psychology, 14(3), 212–226.
Giambra, L. M. (1989). Task-unrelated thought frequency as a function of age: a laboratory
study. Psychology and Aging, 4(2), 136–143.
Glenberg, A., Schroeder, J., & Robertson, D. (1998). Averting the gaze disengages the envi-
ronment and facilitates remembering. Memory & Cognition, 26(4), 651–658.
Goldman-Eisler, F. (1967). Sequential temporal patterns and cognitive processes in speech.
Language and Speech, 10(2), 122–132.
Grice, G. R., & Gwynne, J. W. (1987). Dependence of target redundancy effects on noise
conditions and number of targets. Perception & Psychophysics, 42, 29–36.
Grice, G. R., Canham, L., & Boroughs, J. M. (1984). Combination rule for redundant
information in reaction time tasks with divided attention. Perception & Psychophysics, 35,
451–463.
312 Alejandro Lleras et al.
Haberman, J., & Whitney, D. (2009). Seeing the mean: ensemble coding for sets of faces.
Journal of Experimental Psychology: Human Perception & Performance, 35(3), 718–734.
Haberman, J., & Whitney, D. (2011). Efficient summary statistical representation when
change localization fails. Psychonomic Bulletin and Review, 18(5), 855–859.
Helton, W., & Russell, P. N. (2012). Brief mental breaks and content-free cues may not keep
you focused. Experimental Brain Research, 219(1), 37–46.
Hillyard, S. A., & Münte, T. F. (1984). Selective attention to color and location: An analysis
with event-related brain potentials. Perception and Psychophysics, 36, 185–198.
Hollingworth, A., Matsukura, M., & Luck, S. J.Visual working memory modulates rapid eye
movements to simple onset targets. Psychological Science, in press.
Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews
Neuroscience, 2(3), 194–203.
Jaensch, E. R. (1929). Grundformen menschlichen Seins. Berlin: Otto Elsner.
Kastner, S., O’Connor, D. H., Fukui, M. M., Fehd, H. M., Herwig, U., & Pinsk, M. A. (2004).
Functional imaging of the human lateral geniculate nucleus and pulvinar. Journal of
Neurophysiology, 91(1), 438–448.
Kim, S., Kim, M., & Chun, M. (2005). Concurrent working memory load can reduce
distraction. Proceedings of the National Academy of Sciences of the United States of America,
102(45), 16524–16529.
Kirchner, H., & Thorpe, S. (2006). Ultra-rapid object detection with saccadic eye movements:
visual processing speed revisited. Vision Research, 46(11), 1762–1776.
Lachter, J., Forster, K. I., & Ruthruff, E. (2004). Forty years after Broadbent: still no
identification without attention. Psychological Review, 111, 880–913.
Lang, P., Bradley, M., & Cuthbert, B. (2008). International affective picture system (IAPS): Affective
ratings of pictures and instruction manual. Technical Report A-8, Gainesville, FL: University
of Florida.
Lavie, N., Hirst, A., de Fockert, J. W., & Viding, E. (2004). Load theory of selective attention
and cognitive control. Journal of Experimental Psychology: General, 133(3), 339–354.
Lavie, N. (2010). Attention, distraction, and cognitive control under load. Current Directions in
Psychological Science, 19(3), 143–148.
Lin, J., Franconeri, S., & Enns, J. (2008). Objects on a collision path with the observer
demand attention. Psychological Science, 19(7), 686–692.
Lleras, A., & Buetti, S. (2012a). Ocular capture by abrupt onsets is severely reduced during
mental arithmetic: evidence against cognitive load theory. Paper Presented at the 53rd
Annual Meeting of the Psychonomic Society.
Lleras, A., & Buetti, S. (2012b). Where do the eyes go when you think? Away from visually
salient information. Paper presented at the 12th Annual Meeting of the Vision Sciences Society,
Naples, Florida. 12(9), 1261, http://dx.doi.org/10.1167/12.9.1261.
Logan, G. D. (1988). Toward an instance theory of automatization. Psychological Review, 95,
492–527.
Macdonald, J., & Lavie, N. (2008). Load induced blindness. Journal of Experimental Psychology:
Human Perception and Performance, 34(5), 1078–1091.
Macdonald, J., & Lavie, N. (2011). Visual perceptual load induces inattentional deafness.
Attention, Perception & Psychophysics, 73(6), 1780–1789.
Mack, A., & Rock, I. (1998). Inattentional blindness. Cambridge, MA: MIT Press.
Maljkovic, V., & Nakayama, K. (1994). Priming of pop-out: I. Role of features. Memory &
Cognition, 22(6), 657–672.
Maljkovic,V., & Nakayama, K. (1996). Priming of pop-out: II. The role of position. Perception
& Psychophysics, 58(7), 977–991.
Max, R., & Tsal, Y. (2011). Efficient selection is modulated by target-distractor discrim-
inability and not by perceptual load. Poster presented at the 52nd Annual Meeting of the
Psychonomic Society, Seattle, WA, November 4, 2011.
Max, R., & Tsal,Y. (2012). Exact temporal locus of visual distraction. Poster presented at the 53rd
Object Perception Attention and Memory Workshop, Minneapolis, MN, November 15, 2012.
Distractors and Distractibility 313
McGugin, R.W., Gatenby, J. C., Gore, J. C., & Gauthier, I. (2012). High-resolution i maging of
expertise reveals reliable object selectivity in the FFA related to perceptual performance.
Proceedings of the National Academy of Sciences of the United States of America, 109(42),
17063–17068.
McVay, J. C., & Kane, M. J. (2009). Conducting the train of thought: working memory
capacity, goal neglect, and mind wandering in an executive-control task. Journal of
Experimental Psychology: Learning Memory and Cognition, 35(1), 196–204.
McVay, J. C., & Kane, M. J. (2012). Drifting from slow to “D’oh!”: working memory capacity
and mind wandering predict extreme reaction times and executive control errors. Journal
of Experimental Psychology: Learning Memory and Cognition, 38(3), 525–549.
Miller, J. (1982). Divided attention: evidence for coactivation with redundant signals. Cognitive
Psychology, 14, 247–279.
Miller, J. (1987). Priming is not necessary for selective-attention failures: semantic effects of
unattended, unprimed letters. Perception & Psychophysics, 41, 419–434.
Moore, C., & Egeth, H. (1997). Perception without attention: evidence of grouping under con-
ditions of inattention. Journal of Experimental Psychology: Human Perception and Performance,
23(2), 339–352.
Moore, C., Grosjean, M., & Lleras, A. (2003). Using inattentional blindness as an opera-
tional definition of unattended: the case of surface completion. Visual Cognition, 10,
299–318.
Moore, C., Lleras, A., Grosjean, M., & Marrara, M. (2004). Using inattentional blindness as an
operational definition of unattended: a response-end effect. Visual Cognition, 11, 705–719.
Mordkoff, J.T., & Halterman, R. (2008). Feature integration without visual attention: evidence
from the correlated flankers task. Psychonomic Bulletin and Review, 15, 385–389.
Mordkoff, J. T., & Yantis, S. (1991). An interactive race model of divided attention. Journal of
Experimental Psychology: Human Perception and Performance, 17(2), 520–538.
Mordkoff, J.T. (1996). Selective attention and internal constraints: there is more to the flanker
effect than biased contingencies. In A. F. Kramer, M. G. H. Coles & G. Logan (Eds.),
Converging operations in the study of visual selective attention (pp. 483–502). Washington,
DC: APA.
Most, S., Simons, J., Scholl, B., Jimenez, R., Clifford, E., & Chabris, C. (2001). How not to
be seen: the contribution of similarity and selective ignoring to sustained inattentional
blindness. Psychological Science, 12(1), 9–17.
Most, S., Scholl, B. J., Clifford, E. R., & Simons, D. J. (2005). What you see is what you
set: sustained inattentional blindness and the capture of awareness. Psychological Review,
112(1), 217–242.
Navalpakkam,V., & Itti, L. (2007). Search goal tunes visual features optimally. Neuron, 53(4),
605–617.
Neider, M., & Zelinsky, G. (2011). Cutting through the clutter: searching for targets in evolving
complex scenes. Journal of Vision, 11(14).
Neisser, U., & Becklen, R. (1975). Selective looking: attending to visually specified events.
Cognitive Psychology, 7(4), 480–494.
Neisser, U. (1979). The control of information pickup in selective looking. In A. D. Pick
(Ed.), Perception and its development: A tribute to Eleanor J. Gibson (pp. 201–219). Hillsdale,
NJ: Lawrence Erlbaum.
Nestor, A., Plaut, D., & Behrmann, M. (2012). Orthographic form processing—a multi-
variate investigation of its neural basis. Cerebral Cortex, Cereb. Cortex firxt published
online June 12, 2012, http://doi.10.1093/cercor/bhs158.
Norman, D. A. (1968). Towards a theory of memory and attention. Psychological Review, 75,
522–536.
O’Connor, D., Fukui, M., Pinsk, M., & Kastner, S. (2002). Attention modulates responses in
the human lateral geniculate nucleus. Nature Neuroscience, 5(11), 1203–1209.
Pashler, H. (1987). Detecting conjunctions of color and form: reassessing the serial search
hypothesis. Perception & Psychophysics, 41(3), 191–201.
314 Alejandro Lleras et al.
Peters, R., Iyer, A., Itti, L., & Koch, C. (2005). Components of bottom-up gaze allocation in
natural images. Vision Research, 45(18), 1–20.
Purcell, B., Heitz, R., Cohen, J., Schall, J., Logan, G., & Palmeri, T. (2010). Neurally
constrained modeling of perceptual decision making. Psychological Review, 117(4),
1113–1143.
Raab, D. H. (1962). Statistical facilitation of simple reaction times. Transactions of the New York
Academy of Sciences, 24, 574–590.
Raymond, J., Shapiro, K., & Arnell, K. (1992). Temporary suppression of visual processing in
an RSVP task: an attentional blink? Journal of Experimental Psychology: Human Perception
and Performance, 18(3), 849–860.
Rensink, R. (2000). Seeing, sensing, and scrutinizing. Vision Research, 40(10–12), 1–19.
Scalf, P. E., & Beck, D. M. (2010). Competition in visual cortex impedes attention to multiple
items. Journal of Neuroscience, 30(1), 161–169.
Schall, J., Purcell, B., Heitz, R., Logan, G., & Palmeri, T. (2011). Neural mechanisms of sac-
cade target selection: gated accumulator model of the visual-motor cascade. European
Journal of Neuroscience, 33(11), 1991–2002.
Serences, J., & Boynton, G. (2007). Feature-based attentional modulations in the absence of
direct visual stimulation. Neuron, 55(2), 1–12.
Shapiro, K., Caldwell, J., & Sorensen, R. (1997). Personal names and the attentional blink:
a visual "cocktail party" effect. Journal of Experimental Psychology: Human Perception and
Performance, 23(2), 504–514.
Shiffrin, R. M., & Gardner, G. T. (1972). Visual processing capacity and attentional
control. Journal of Experimental Psychology, 93(1), 72–82.
Silvia, P., McCord, D., & Gendolla, G. (2010). Self-focused attention, performance expectan-
cies, and the intensity of effort: do people try harder for harder goals? Motivation and
Emotion, 34, 363–370.
Silvia, P., Jones, H., Kelly, C., & Zibaie, A. (2011). Trait self-focused attention, task difficulty,
and effort-related cardiovascular reactivity. International Journal of Psychophysiology: Official
Journal of the International Organization of Psychophysiology, 79(3), 1–6.
Simon, J., & Rudell, A. (1967). Auditory S-R compatibility: the effect of an irrelevant cue on
information processing. Journal of Applied Psychology, 51(3), 300–304.
Simon, J., Acosta, E., Mewaldt, S., & Speidel, C. (1976).The effect of an irrelevant directional
cue on choice reaction time: duration of the phenomenon and its relation to stages of
processing. Perception & Psychophysics, 19, 1–7.
Simons, D., & Chabris, C. (1999). Gorillas in our midst: sustained inattentional blindness for
dynamic events. Perception, 28(9), 1059–1074.
Simons, D., & Jensen, M. (2009). The effects of individual differences and task difficulty on
inattentional blindness. Psychonomic Bulletin and Review, 16(2), 398–403.
Simons, D., & Levin, D. T. (1998). Failure to detect changes to people during a real-world
interaction. Psychonomic Bulletin and Review, 5, 644–649.
Smallwood, J., Obonsawin, M., & Heim, D. (2003). Task unrelated thought: the role of
distributed processing. Consciousness and Cognition, 12(2), 169–189.
Smilek, D., Carriere, J. S.A., & Cheyne, J. A. (2010). Out of mind, out of sight: eye blink-
ing as indicator and embodiment of mind wandering. Psychological Science, 21(6),
786–789.
Smith,T., Ruiz, J., & Uchino, B. (2000).Vigilance, active coping, and cardiovascular reactivity
during social interaction in young men. Health psychology: Official Journal of the Division of
Health Psychology, American Psychological Association, 19(4), 382–392.
Sperling, G. (1960). The information available in brief visual presentations. Psychological
Monographs: General and Applied.
Strayer, D. L., & Drews, F. (2007). Cell-phone induced inattention blindness. Current
Directions in Psychological Science, 16, 128–131.
Distractors and Distractibility 315
Strayer, D. L., Watson, J. M., & Drews, F. A. (2011). Cognitive distraction while multitasking
in the automobile. In B. Ross (Ed.), The psychology of learning and motivation (Vol. 54,
pp. 29–58). Burlington: Academic Press.
Stroop, J. (1935). Studies of interference in serial verbal reactions. Journal of Experimental
Psychology, 18(6), 643–662.
Temple, J., Warm, J., Dember, W., Jones, K., LaGrange, C., & Matthews, G. (2000). The effects
of signal salience and caffeine on performance, workload, and stress in an abbreviated
vigilance task. Human Factors, 42(2), 183–194.
Tinker, M. A. (1925). Intelligence in an intelligence test with an auditory distractor. American
Journal of Psychology, 36(3), 467–468.
Torralbo, A., & Beck, D. (2008). Perceptual-load-induced selection as a result of local com-
petitive interactions in visual cortex. Psychological Science, 19(10), 1045–1050.
Townsend, J. T. (1972). Some results concerning the identifiability of parallel and serial
processes. British Journal of Mathematical and Statistical Psychology, 25, 168–199.
Trautwein, U., Lüdtke, O., Roberts, B., Schnyder, I., & Niggli, A. (2009). Different forces,
same consequence: conscientiousness and competence beliefs are independent predic-
tors of academic effort and achievement. Journal of Personality and Social Psychology, 97(6),
1115–1128.
Treisman, A., & Geffen, G. (1967). Selective attention: perception or response? Quarterly
Journal of Experimental Psychology, 19(1), 1–17.
Treisman, A., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive
Psychology, 12(1), 97–136.
Treisman, A. (1960). Contextual cues in selective listening. Quarterly Journal of Experimental
Psychology, 12, 242–248.
Tseng,Y. C., Glaser, J. I., Caddigan, E., & Lleras, A. Attentional decision making in pop-out visual
search, Submitted for publication.
von Mühlenen, A., & Lleras, A. (2007). No-onset looming motion guides spatial attention.
Journal of Experimental Psychology: Human Perception and Performance, 33, 1297–1310.
Wan, X., & Lleras, A. (2010).The effect of feature discriminability on the inter-trial i nhibition
of focused attention. Visual Cognition, 18, 920–944.
Watson, D. G., & Humphreys, G. W. (1997). Visual marking: prioritizing selection for new
objects by top-down attention inhibition of old objects. Psychological Review, 104,
90–122.
Wenger, M. J., & Townsend, J. T. (2000). Basic tools for attention and general processing
capacity in perception and cognition. Journal of General Psychology: Visual Attention,
127(1), 67–99.
Wolfe, J., Alvarez, G., Rosenholtz, R., Kuzmova, Y., & Sherman, A. (2011). Visual search
for arbitrary objects in real scenes. Attention, Perception & Psychophysics, 73(6),
1650–1671.
Wolfe, J.,Vo, M., Evans, K., & Greene, M. (2011).Visual search in scenes involves selective and
nonselective pathways. Trends in Cognitive Sciences, 15(2), 77–84.
Wolfe, J. (1994). Guided search 2.0: a revised model of visual search. Psychonomic Bulletin and
Review, 1(2), 202–238.
Woodman, G. F., & Arita, J. T. (2011). Direct electrophysiological measurement of attentional
templates in visual working memory. Psychological Science, 22(2), 212–215.
Yantis, S., & Egeth, H. (1999). On the distinction between visual salience and stimulus-driven
attentional capture. Journal of Experimental Psychology: Human Perception and Performance,
25(3), 661–676.
Yigit-Elliott, S., Palmer, J., & Moore, C. M. (2011). Distinguishing blocking from attenuation
in visual selective attention. Psychological Science, 22(6), 771–780.
Young, A. H., & Hulleman, J. (2012). Eye movements reveal how task difficulty moulds visual
search. Journal of Experimental Psychology: Human Perception and Performance.
This page intentionally left blank
INDEX
Note: Page numbers followed by “f ” and “t” indicate figures and tables respectively.
317
318 Index
interactive perceptual detection task, 68f face race and memory performance, 213f
low-dimensional dynamic process, 65f key criticisms, 200
moment-by-moment linguistic ORB, 211–212
processing, 62 participants, 199–200
social interaction, 62–63 recognition memory, 200–201
social variables, 60–61 recollection, 199
Phasic pupillary reflexes, 205 Property mapping. See Relation linking
Place learning, 230. See also Spatial learning Psychophysiological correlation of memory
in humans, 232 for faces, 210
ecological paradigms, 236–239 ORB, 210–211
human radial arm mazes, 235 PDP, 211
virtual water maze, 232–234 anecdotal experiences, 213–214
for individual differences, 239 Asian and White functions, 212
advantages and disadvantages, 242–244 baseline-corrected pupil diameter, 212f
classification vs. predicting solutions, cognitive resources, 212–213
241–242 face race and memory performance,
separating preference, 244–246 213f
systems balance as foundation, ORB, 211–212
240–241 RK procedure
rodent paradigms adaption, 233b–234b baseline-corrected pupil diameters,
Place systems 214f
characterization, 250–251 ORB, 214–215
competition or cooperation, 251 Pupillometry, 203–204
during encoding, 251 and memory
during fMRI scans, 251–252 CVC trigrams, 206–207
in individual differences, 250 fMRI and ERP investigations, 206
variability, 252 memory strength, 207–208
Principle of truth memory-based effects, 209–210
biconditional assertion, 12f phasic pupillary changes, 210
cognitive illusions, 13 production process, 208
compound assertion, 12 pupil diameter function, 209f
exclusive disjunction, 11 pupillary old/new effect, 208–209
explicit models, 12–13, 13f recollection, 207
fallacies, 13 TEPR investigations, 206
first disjunction, 12, 12f pupillary reflex
fully explicit, 12 LC–NE system, 203–204
second disjunction, 12, 12f–13f memory-based effects, 209–210
Process-based account neurophysiological evidence, 204
context change, 139–140 TEPRs
two-factor, 140f cognitive processing, 204–205
Process-dissociation procedure (PDP), phasic pupillary reflexes, 205
198–199, 211
anecdotal experiences, 213–214 Q
Asian and White functions, 212 QSR. See Questionnaire on Spatial
automatic processes, 199 Representation
baseline-corrected pupil diameter, 212f Questionnaire on Spatial Representation
cognitive resources, 212–213 (QSR), 227
326 Index
R Relational competition
Reasoning alternative interpretations
abduction, 5 competition, 114
assertion, 6 innovative interpretation, 114
categorical, 7 non-impaired individuals, 114–115
contradiction, 5 compound processing
deduction, 4 constituent representations, 116
deliberations, 6–7 construction process, 115
disjunction lexical representation, 117
double, 8 opaque compounds, 115–116
exclusive, 7 relational interpretations diversity,
inclusive, 7 118–119
dual process, 6–7 semantic representation, 116–117
indefinite number of possibilities, 6 transparent compounds, 117–118
induction, 4–5 inhibition
intuitions, 6–7 modifier’s relational distribution, 113
mental models, 6f–7f relational priming results, 113
modal errors, 8 nature of relations, 108
parsimonious conclusions, 5 conceptual representations, 108–109
possibilities, 6 relational abstraction level, 111
side effect of, 8–9 relations representation, 109–110
spatial relations, 8 numbers of competitors, 111–112
systems, 6–7 parallel process, 112–113
theories of, 6–7 stronger competitors, 111–112
theory of deductive competence, 5–6 Relational gist interpretation, 104, 121–122
Recognition memory, 192–193 Relational information, 98, 101–102
signal-detection models, 195f head-based, 120
single-process, 195f process, 99
Recognition tests Relational interpretation competitive
associative recognition, 152–153 evaluation theory (RICE theory), 102
DF null effects, 151 clay machine, 119–120
distractors, 152 head-based relational information, 120
inhibitory account, 151 relation verification, 120–121
item recognition, 153 semantic information, 119–120
memory tests, 150 stage, 119
meta-analysis, 151 Relational interpretations, 99–100
rehearsal process, 153 Relational priming effect, 108–109
Recollection, 196, 198 lexicalized compounds, 107–108
estimation, 198–199 novel combination, 107
process-dissociation procedure, 199–201 Relations
remember/know paradigm, 201–203 filler items, 110–111
Redundancy gain, 271 frequencies, 106
Regression analysis, 105–106 linking, 99
Reinterpreting clinical list-method relational effects, 109–110
ADHD, 173 selection
context, 173 elaboration process, 121
Relational abstraction level, 111 full noun phrases, 124
Index 327
CONTENTS OF PREVIOUS VOLUMES
331
332 Contents of Previous Volumes
VOLUME 57 VOLUME 58
Meta-Cognitive Myopia and the Dilemmas Learning Along With Others
of Inductive-Statistical Inference Robert L. Goldstone, Thomas N. Wisdom,
Klaus Fiedler Michael E. Roberts, Seth Frey
Relations Between Memory and Reasoning Space, Time, and Story
Evan Heit, Caren M. Rotello and Brett Barbara Tversky, Julie Heiser, Julie Morrison
K. Hayes The Cognition of Spatial Cognition: Domain-
The Visual World in Sight and Mind: How General within Domain-specific
Attention and Memory Interact to Holly A. Taylor, Tad T. Brunyé
Determine Visual Experience Perceptual Learning, Cognition, and Expertise
James R. Brockmole, Christopher C. Philip J. Kellman, Christine M. Massey
Davoli and Deborah A. Cronin
Causation, Touch, and the Perception of
Spatial Thinking and STEM Education: Force
When, Why, and How? Phillip Wolff, Jason Shepard
David H. Uttal and Cheryl A. Cohen
Categorization as Causal Explanation: Dis-
Emotions During the Learning of Difficult counting and Augmenting in a Bayesian
Material Framework
Arthur C. Graesser and Sidney D’Mello Daniel M. Oppenheimer, Joshua B.
Specificity and Transfer of Learning Tenenbaum, Tevye R. Krynski
Alice F. Healy and Erica L. Wohldmann Individual Differences in Intelligence and
What Do Words Do? Toward a Theory of Working Memory: A Review of Latent
Language-Augmented Thought Variable Models
Gary Lupyan Andrew R. A. Conway, Kristof Kovacs
Index Index
This page intentionally left blank