How The Body Shapes Knowledge Sample
How The Body Shapes Knowledge Sample
http://dx.doi.org/10.1037/0000136-001
How the Body Shapes Knowledge: Empirical Support for Embodied Cognition, by R. Fincher-Kiefer
Copyright © 2019 by the American Psychological Association. All rights reserved.
3
Copyright American Psychological Association
4 HOW THE BODY SHAPES KNOWLEDGE
is to have my students play a few rounds of “20 Q”—an electronic version of the game
“Twenty Questions”—with me on the first day of my advanced laboratory course
in cognition. My goal is to give them firsthand knowledge of “symbolic knowledge
representations,” or nonembodied knowledge, and they come to understand this when
playing this handheld game. Here’s why: The electronic version begins just as the
verbal version of the game does—you come up with your animal, vegetable, mineral,
or “other” thought, and then the handheld device begins the electronic questioning
by posing questions such as, “Is it bigger than a microwave?” You respond with the
“yes,” “no,” or “sometimes” button press on the device. This continues for 20 ques-
tions, or fewer if the device decides it has an early guess.
My students are always amused when they see that this toy can in fact “read
their mind” and, more often than not, guess their thought correctly. So I ask them,
“Does this game have a mind?” (They can’t be tricked into responding that it has a
physical brain, but to ask if it has a mind is a different issue.) Most tentatively say
no—the “mind” seems to be quintessential to being human, so it is hard to claim that
an inanimate object has one. But of course some students answer, “Well, sort of . . .”
I ask those pondering this, “Why do you think it has a mind?” They respond, “Because
it’s thinking and processing information and guessing.” The mind is the game’s intel-
lect, and it clearly has one because it is able to guess what someone is thinking. “So
how does it have this intellect?” I ask my students, and that makes them start thinking
about how the computer chip inside this game stores knowledge, how it is structured
and organized, and then I use the word represented.
Once it is acknowledged that the device has to have knowledge represented to
play the game, then we can discuss what the nature of that representation is and what
the processes are that eventually lead to it being able to guess what they are think-
ing (i.e., “20 Q” cognition). After playing the game, students intuit that once the first
answer is processed (e.g., “Yes” it is an animal), that narrows the possibilities for what
the correct guess is going to be and influences what questions should be asked (e.g.,
“Does it swim?”). Each new answer continues to constrain what the guess could be;
by the time 20 questions are asked, the pruning of possibilities in the game’s knowl-
edge base has left very few, if not one, best guess. And students understand that the
literal representation of that network of knowledge in “20 Q” is binary code, as in all
computers.
What my students have described as they work through how “20 Q” makes its
guess is that the game has a hierarchical semantic network of knowledge that uses
the process of spreading activation to get to its response. This is exactly what cogni-
tive psychologists theorized for human knowledge representation in the early days
of the subdiscipline. In fact, the representation of knowledge was perhaps the central
problem for cognitive psychologists when the subdiscipline first became recognized
as a branch of experimental psychology in the late 1950s and early 1960s. Cognitive
psychologists were questioning what philosophers had been debating for centuries—
what is knowledge? Where does it come from? How do we derive meaning from
our world? Some very early philosophy-of-mind theorists, starting with Descartes,
argued for mind–body dualism, such that mental phenomena were completely sepa-
rate from any body effects. However, in response to Cartesian dualism, Kant argued
Copyright American Psychological Association
An Introduction to the Theory of Embodied Cognition 5
that knowledge results from the interaction of the mind and the external world and,
as an early precursor to the theory of embodied cognition, suggested that the body is
essential or central to human cognition.
More recently, some philosophers responsible for initially defining and devel-
oping the theory of embodied cognition have viewed cognition as serving the needs
of the body as it meets the demands of real-world situations (hence the name). From
this perspective, internal mental representations of the world are not essential, and
there is little need to discuss the actions of “the brain” (see dynamical systems theory
of Thelen & Smith, 1994, and Beer, 2003, as well as Brooks’s 1991a, 1991b, work
in robotics). This stance arose from a general philosophical belief that the concept of
internal mental representations had been overused in explaining cognition, as well
as a disillusionment with cognitive science’s lack of interest in how perception and
cognition were linked to action. This brought about the antirepresentational view
of “radical embodied cognitive science” (Chemero, 2009; Gallagher, 2005; Thelen &
Smith, 1994).
However, other philosophers flipped the relationship to suggest that the body
serves the mind (cognition), such that the external world leads our body to respond in
a way that will inform and guide the mental representations that constitute thought.
For example, Clark’s (1998; 1999; 2008) view is more moderate in terms of consid-
ering the role of internal representations in cognition and yet still suggests that the
interaction of the body and the external world can explain much of what has typically
been considered the work of the brain. Clark, as well as Varela, Thompson, and Rosch
(1991), argued that the body is essential in the production of cognition; in fact, the
body plays a constitutive role in cognitive processing. The position of these philoso-
phers and cognitive scientists has been referred to as “embodied cognitive science,”
and the central issue that distinguishes it from radical embodied cognitive science is
the presence of internal representations (Alsmith & de Vignemont, 2012).
There has been extensive discussion of how these philosophical approaches to
the theory of embodied cognition emerged and how they differ (e.g., Shapiro, 2011,
2014; and M. Wilson, 2002), but it is important to remember that in the philosophi-
cal tradition, empirical work is often cited to support a view, but it is not essential in
developing and testing the theory. Cognitive psychologists became interested in the
theory of embodied cognition because we, too, were interested in the body–mind
interplay. However, within the experimental psychological tradition, the theory’s
tenets required examination and testing. Cognitive psychologists adopted only one
perspective of the theory of embodied cognition, and from a philosophical and cogni-
tive science standpoint, it is considered a “narrow view” of the theory. This is because
the perspective is “brain centered”—it assumes internal representations and, as such,
shifts from the view that the mind operates to serve the body to a view that the body
serves the mind. As M. Wilson (2002) stated,
This takeover by the mind, and the concomitant ability to mentally represent
what is distant in time or space, may have been one of the driving forces
behind the runaway train of human intelligence that separated us from other
hominids. (p. 635)
Copyright American Psychological Association
6 HOW THE BODY SHAPES KNOWLEDGE
FIGURE 1.1
STREET
VEHICLE
CAR
BUS
TRUCK
AMBULANCE FIRE
ENGINE HOUSE
FIRE
ORANGE
RED
YELLOW APPLES
GREEN
PEARS
CHERRIES
VIOLETS ROSES
FLOWERS SUNSETS
SUNRISES CLOUDS
hierarchical earlier models, and are distributed across brain sites (cf., McClelland &
Rogers, 2003).
The zeitgeist of the subdiscipline of cognitive psychology for its first 40 or so
years was to think about cognitive processes such as sensation, perception, atten-
tion, and memory as modular, that is, they existed in and of themselves with minimal
interaction with each other (Fodor & Pylyshyn, 1988; Newell & Simon, 1972). The
representation of knowledge was also functionally autonomous, and there was little
discussion of how processes would affect or determine what was being represented.
This could be likened to having a computer on one’s shoulders with input and output
modules that worked fairly independently from one another. This traditional view
Copyright American Psychological Association
8 HOW THE BODY SHAPES KNOWLEDGE
Imagine that you land at an airport, perhaps in China, where you don’t speak
the local language. You see what appears to be a sign consisting of logograms
(or any other noniconic marks). Although you don’t speak the language, you
do have a dictionary written in that language. You look up the first logogram
and find its definition, but of course the definition consists of more logograms
whose meanings are obscure to you. Undaunted, you look up the definition of
the first logogram in the definition, and you find that its definition consists of
even more uninterpretable logograms. The point is that no matter how many
of the logograms you look up, this closed system of abstract symbols will never
produce any meaning for you. (p. 165)
What Glenberg (2015) pointed out about the standard cognitive models of knowl-
edge representation is that in those models, understanding the meaning of a symbol
could be likened to going round and round in an infinite circle. Looking for the mean-
ing of one symbol involves trying to find the meaning of another arbitrary symbol,
and the meaning of that symbol requires the same kind of internal search for another
Copyright American Psychological Association
An Introduction to the Theory of Embodied Cognition 9
arbitrary symbol. If you look back at Figure 1.1, it seems as if the symbols (the ellipses
that have the labels underneath) are meaningful—but that is because we are provid-
ing them with meaning. The shape is not related to the meaning, and the label (the
word) is something we have provided. The words are there for the convenience of the
reader; if we opened up someone’s head and looked inside, we would not see labels
on ellipses. Figure 1.2 more accurately represents the semantic network theory. Here
the abstract symbols (ellipses) are not labeled, and thus they are authentically amodal,
abstract symbols. This portrayal of the theory makes clear this symbol merry-go-round
argument. One can start at any node and trace relations to any and all other nodes, but
no matter how many relations are traced, no meaning will ever be available.
FIGURE 1.2
Never leaving “the head” (or the computer) to determine what a symbol is refer-
ring to in the external world would mean an infinite regress of search for mean-
ing. We can only break from this symbol-grounding problem if the symbols refer to
something in our external world, that is, have referents that ground those symbols in
perception, action, and/or emotion. This grounding represents the meaning of the
symbol. The embodied approach to cognition argues that all knowledge is grounded
in sensory, perceptual, and motoric processes and that these processes are a function
of one’s own morphology (shape and size) and physiology (internal processes).
Evidence from cognitive neuroscience supports embodiment in revealing that
thinking involves the reactivation and reuse of processes and representations involved
in perception and action. For example, Hauk, Johnsrude, and Pulvermüller (2004)
recorded neural activity while readers listened to action verbs such as kick and pick.
They found that as readers read those action verbs, there was greater activation in the
specific part of the motor cortex responsible for producing that action than other motor
cortex areas. This suggests that understanding an action concept may be grounded in
action-specific motor neurons.
The discovery of mirror neurons in the motor cortex of monkeys may help
us understand a similar neural system in humans that would allow us to compre-
hend others’ actions, goals, and intentions (e.g., Gallese, Keysers, & Rizzolatti, 2004;
Iacoboni, 2009; Rizzolatti & Craighero, 2004). In monkeys, single-cell recordings from
mirror neurons show that a neuron in this tract is similarly active when a monkey is
performing a task as when the monkey is observing another monkey engage in the
same task. Researchers have suggested that the purpose of having mirror neurons that
are active both during action and during observation is that this provides the animal
with the ability to infer goals and emotions to another. If an animal acts in a purpose-
ful way, the neurons that fire during that action, and then are later “reused” while
observing another’s action, must reflect the meaning of that action. This is evidence
for that neuron serving both action and cognition, supporting the view that the body
plays a constitutive role in cognition.
This evidence seriously challenges the view that conceptual representations are
abstract and amodal. Of course there are quite disparate views of the extent to which
mental representations are modal or both amodal and modal. And even those that
argue that meaning is found in modality-specific representations have quite different
approaches to the theory of embodiment (see Gentsch, Weber, Synofzik, Vosgerau, &
Schütz-Bosbach, 2016; A. D. Wilson & Golonka, 2013).