Brain Mechanisms Linking Language and Action
Brain Mechanisms Linking Language and Action
Brain Mechanisms Linking Language and Action
net/publication/7784335
CITATIONS READS
1,008 1,031
1 author:
Friedemann Pulvermüller
Freie Universität Berlin
300 PUBLICATIONS 18,070 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Modelling the cortical mechanisms underlying language processes in the brain View project
All content following this page was uploaded by Friedemann Pulvermüller on 02 June 2014.
Face/arm-related word Leg-related word between two interpretations of this finding. words ‘hotki’ (eat) and ‘potki’ (kick) — which
Action word recognition could either auto- included the same recording of the syllable
matically and immediately trigger the acti- [kI] spliced to the end of each word’s first
vation of specific action-related networks, as syllable — were compared. In this way, any
predicted by the semantic somatotopy model, differential activation elicited by the final syl-
or motor activation could be the consequence lable [kI] in the context of [hot] or [pot] could
110 ms
of a late, postlexical strategy to imagine or be uniquely attributed to its lexico–semantic
plan an action. Earlier fMRI research showed context. Magnetoencephalography (MEG)
that the observation of action-related pic- results showed that an early brain response,
tures, and also mere mental imagery of the mismatch negativity50, was elicited by
actions, activates the premotor cortex in a face/arm- and leg-related word contexts
140 ms somatotopic fashion43. Neurophysiological (FIG. 4). Relatively stronger activation was
experiments were conducted to reveal the present in the left inferior frontal cortex
time course of cortical activation in action for the face/arm-related word, but signifi-
word recognition, and to investigate whether cantly stronger activation was seen in supe-
specific motor areas are activated immedi- rior central areas, close to the cortical leg
ately or after some delay. Late postlexical representation, for the leg-related word49.
170 ms meaning-related processes are reflected These MEG results were confirmed with
Figure 4 | Cortical activation dynamics elicited by late components of the event-related a different method, electroencephalography
by face/arm- and leg-related words. potential (ERP) and field, which are maximal (EEG), using words from different languages,
Magnetoencephalography (n = 16) was used to ~400 ms after word onset44. However, neuro- including, for example, the English word pair
measure the activation elicited at different times
after spoken action words could be uniquely
physiological differences between word cat- ‘pick’ versus ‘kick’48. It is remarkable that the
recognized. Note the slight upward movement of egories that reflect lexico–semantic processes activation peak of the superior central source
the inferior central source for the face/arm-related have been found as early as 100–200 ms45. followed that of the inferior frontal source
word and the delayed appearance of the superior ERP experiments that focused on silent with an average delay of only 30 ms, which is
central source for the leg-related word. These reading of the face-, arm- and leg-related consistent with the spread of activation being
activation time courses might reflect the words used in the fMRI study by Hauk et al. mediated by fast-conducting cortico-corti-
movement of neuronal activity in distributed
showed that category-specific differential cal fibres between the perisylvian and dorsal
neuronal assemblies that represent and process
words with different action-related meanings. activation was present ~200 ms after word sensorimotor cortex.
Modified, with permission, from REF. 49 © (2005) onset46,47. Consistent with the fMRI results, Even if action word processing activates
MIT Press. distributed source localization performed on the motor system in a specific somatotopic
stimulus-triggered ERPs revealed an inferior fashion, this does not necessarily imply that
frontal source that was strongest for face- the motor and premotor cortex influence
with earlier findings, all words equally acti- related words, and a superior central source the processing of action words. In another
vated areas in the temporal cortex and also that was maximal for leg-related items47. study, different parts of the motor system
the inferior frontal cortex25–27. The additional This dissociation in brain activity patterns were stimulated with weak magnetic pulses
category-specific somatotopic activation that supports the idea of stimulus-triggered early while participants processed action words
was seen in the motor system in response to lexico–semantic processes. To investigate in a lexical decision task 51. To minimize
face-, arm- and leg-related words was close to whether motor preparation processes co- interference between word-related activa-
and overlapped with the motor and premotor determined this effect, experiments were tion of the motor system and response
representations of the tongue, fingers and carried out in which the same response — a execution processes, lip movements were
feet, respectively. These results indicate that button press with the left index finger — was required while arm- and leg-related words
specific action representations are activated required for all words. The early activation were presented. When subthreshold TMS
during action word understanding. difference between face- and leg-related was applied to the arm representation in the
A similar experiment was carried out words persisted, which indicates that lexico– left hemisphere, causing strong magnetic
with action words embedded in sentences. semantic processes, rather than postlexical pulses to elicit muscle contractions in the
In this case, participants heard action motor preparation, were reflected46. right hand, faster processing of arm-related
descriptions such as ‘the boy kicked the The earliness of word category-specific words occurred relative to leg-related words.
ball’ or ‘the man wrote the letter’ while their semantic activation in the sensorimotor When TMS was applied to the cortical leg
brain metabolism was monitored42. Specific cortex in passive reading tasks indicates area, the opposite pattern of faster leg-related
premotor areas reflecting the differential that this feature might be automatic. To than arm-related word responses emerged51.
involvement of body part information in the further investigate this possibility, partici- Processing speed did not differ between
semantic analysis of the language input were pants were actively distracted while action stimulus word groups in control conditions in
again found to be active. Taken together, words were being presented, and their brain which ineffective ‘sham’ stimulation or TMS
these fMRI results indicate that somatotopic responses were measured48,49. Participants to the right hemisphere was applied. This
activation of motor circuits reflects aspects were instructed to watch a silent video film shows a specific influence of activity in the
of word and sentence meaning. and ignore the language input while spoken motor system in response to the processing
Although these studies showed language- face/arm- and leg-related action words were of action-related words (FIG. 5).
related somatotopic cortical activation, the presented. Care was taken to exactly control Further evidence for specific functional
low temporal resolution of haemodynamic for physical and psycholinguistic features of links between the cortical language and
imaging makes it impossible to decide the word material. For example, the Finnish action systems comes from TMS-induced
29. Liberman, A. M., Cooper, F. S., Shankweiler, D. P. & 50. Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P. 70. Rizzolatti, G., Fadiga, L., Gallese, V. & Fogassi, L.
Studdert-Kennedy, M. Perception of the speech code. & Winkler, I. ‘Primitive intelligence’ in the auditory cortex. Premotor cortex and the recognition of motor actions.
Psychol. Rev. 74, 431–461 (1967). Trends Neurosci. 24, 283–288 (2001). Brain Res. Cogn. Brain Res. 3, 131–141 (1996).
30. Liberman, A. M. & Whalen, D. H. On the relation of 51. Pulvermüller, F., Hauk, O., Nikulin, V. V. & Ilmoniemi, R. J. 71. Jeannerod, M. Neural simulation of action: a unifying
speech to language. Trends Cogn. Sci. 4, 187–196 Functional links between motor and language systems. mechanism for motor cognition. Neuroimage 14,
(2000). Eur. J. Neurosci. 21, 793–797 (2005). S103—S109 (2001).
31. Fowler, C. A. An event approach to the study of speech 52. Buccino, G. et al. Listening to action-related sentences 72. Hari, R. et al. Activation of human primary motor cortex
perception from a direct realist perspective. J. Phonetics modulates the activity of the motor system: a combined during action observation: a neuromagnetic study.
14, 3–28 (1987). TMS and behavioral study. Cogn. Brain Res. (in the Proc. Natl Acad. Sci. USA 95, 15061–15065 (1998).
32. Fowler, C. A., Brown, J. M., Sabadini, L. & Weihing, J. press). 73. Barsalou, L. W. Perceptual symbol systems. Behav.
Rapid access to speech gestures in perception: evidence 53. Patterson, K. & Hodges, J. R. in International Brain Sci. 22, 577–609; discussion 610–660 (1999).
from choice and simple response time tasks. J. Mem. Encyclopaedia of the Social and Behavioural Sciences 74. Barsalou, L. W., Kyle Simmons, W., Barbey, A. K. &
Lang. 49, 396–413 (2003). (eds Thompson, R. F. & McClelland, J. L.) 3401–3405 Wilson, C. D. Grounding conceptual knowledge in
33. Fadiga, L., Craighero, L., Buccino, G. & Rizzolatti, G. (Pergamon, New York, USA, 2001). modality-specific systems. Trends Cogn. Sci. 7, 84–91
Speech listening specifically modulates the excitability of 54. Scott, S. K. & Johnsrude, I. S. The neuroanatomical and (2003).
tongue muscles: a TMS study. Eur. J. Neurosci. 15, functional organization of speech perception. Trends 75. Lakoff, G. & Johnson, M. Philosophy in the Flesh: the
399–402 (2002). Neurosci. 26, 100–107 (2003). Embodied Mind and its Challenge to Western Thought
34. Horwitz, B. & Braun, A. R. Brain network interactions in 55. Posner, M. I. & Pavese, A. Anatomy of word and (Basic Books, New York, USA, 1999).
auditory, visual and linguistic processing. Brain Lang. 89, sentence meaning. Proc. Natl Acad. Sci. USA 95, 76. Shastri, L., Grannes, D., Narayana, S. & Feldman, J. in
377–384 (2004). 899–905 (1998). Hybrid Information Processing in Adaptive Autonomous
35. Rizzolatti, G. & Craighero, L. The mirror-neuron system. 56. Chao, L. L., Haxby, J. V. & Martin, A. Attribute-based Vehicles (eds Kraetzschmar, G. K. & Palm, G.) (Springer,
Annu. Rev. Neurosci. 27, 169–192 (2004). neural substrates in temporal cortex for perceiving and Berlin, Germany, 2005).
36. Penfield, W. & Rasmussen, T. The Cerebral Cortex of knowing about objects. Nature Neurosci. 2, 913–919 77. Pulvermüller, F., Mohr, B. & Schleichert, H. Semantic or
Man (Macmillan, New York, USA, 1950). (1999). lexico–syntactic factors: what determines word-class
37. He, S. Q., Dum, R. P. & Strick, P. L. Topographic 57. Pulvermüller, F., Lutzenberger, W. & Preissl, H. Nouns and specific activity in the human brain? Neurosci. Lett. 275,
organization of corticospinal projections from the frontal verbs in the intact brain: evidence from event-related 81–84 (1999).
lobe: motor areas on the lateral surface of the potentials and high-frequency cortical responses. Cereb. 78. Wittgenstein, L. Philosophical Investigations (Blackwell,
hemisphere. J. Neurosci. 13, 952–980 (1993). Cortex 9, 498–508 (1999). Oxford, UK, 1953).
38. Matelli, M., Camarda, R., Glickstein, M. & Rizzolatti, G. 58. Bird, H., Lambon-Ralph, M. A., Patterson, K. & 79. Hommel, B., Musseler, J., Aschersleben, G. & Prinz, W.
Afferent and efferent projections of the inferior area 6 in Hodges, J. R. The rise and fall of frequency and The theory of event coding (TEC): a framework for
the macaque monkey. J. Comp. Neurol. 251, 281–298 imageability: noun and verb production in semantic perception and action planning. Behav. Brain Sci. 24,
(1986). dementia. Brain Lang. 73, 17–49 (2000). 849–878; discussion 878–937 (2001).
39. Elbert, T., Pantev, C., Wienbruch, C., Rockstroh, B. & 59. Humphreys, G. W. & Riddoch, M. J. On telling your fruit 80. Wermter, S. et al. Towards multimodal neural network
Taub, E. Increased cortical representation of the fingers from your vegetables: a consideration of category- robot learning. Rob. Auton. Syst. 47, 171–175 (2004).
of the left hand in string players. Science 270, 305–307 specific deficits after brain-damage. Trends Neurosci. 10, 81. Wermter, S., Weber, C., Elshaw, M., Gallese, V. &
(1995). 145–148 (1987). Pulvermüller, F. in Biomimetic Learning for Neural Robots
40. Graziano, M. S., Taylor, C. S. & Moore, T. Complex 60. Tyler, L. K., Moss, H. E., Durrant-Peatfield, M. R. & (eds Wermter, S., Palm, G. & Elshaw, M.) (Springer,
movements evoked by microstimulation of precentral Levy, J. P. Conceptual structure and the structure of Berlin, Germany, in the press).
cortex. Neuron 34, 841–851 (2002). concepts: a distributed account of category-specific 82. Knoblauch, A., Markert, H. & Palm, G. in International
41. Hauk, O., Johnsrude, I. & Pulvermüller, F. Somatotopic deficits. Brain Lang. 75, 195–231 (2000). Work-Conference on the Interplay Between Natural and
representation of action words in the motor and premotor 61. McClelland, J. L. & Rogers, T. T. The parallel distributed Artificial Computation 2005 (eds Mira, J. & Alvarez, J. R.)
cortex. Neuron 41, 301–307 (2004). processing approach to semantic cognition. Nature Rev. 405–414 (Springer, Berlin, Germany, 2005).
42. Tettamanti, M. et al. Listening to action-related sentences Neurosci. 4, 310–322 (2003). 83. Pulvermüller, F., Hummel, F. & Härle, M. Walking or talking?:
activates fronto-parietal motor circuits. J. Cogn. 62. Bak, T. H., O’Donovan, D. G., Xuereb, J. H., Boniface, S. Behavioral and neurophysiological correlates
Neurosci. 17, 273–281 (2005). & Hodges, J. R. Selective impairment of verb processing of action verb processing. Brain Lang. 78, 143–168 (2001).
43. Buccino, G. et al. Action observation activates premotor associated with pathological changes in Brodmann areas
and parietal areas in a somatotopic manner: an fMRI 44 and 45 in the motor neurone disease-dementia- Acknowledgements
study. Eur. J. Neurosci. 13, 400–404 (2001). aphasia syndrome. Brain 124, 103–120 (2001). This work was supported by the Medical Research Council (UK)
44. Holcomb, P. J. & Neville, H. J. Auditory and visual 63. Neininger, B. & Pulvermüller, F. Word-category specific and by the European Community under the Information Society
semantic priming in lexical decision: a comparision using deficits after lesions in the right hemisphere. Technologies Programme. For discussions related to this work,
event-related brain potentials. Lang. Cognit. Process. 5, Neuropsychologia 41, 53–70 (2003). I am grateful to R. Assadollahi, T. Bak, V. Gallese, R. Ilmoniemi,
281–312 (1990). 64. Pulvermüller, F. & Mohr, B. The concept of transcortical O. Hauk, M. Kiefer, A. Knoblauch, W. Marslen-Wilson, B. Mohr,
45. Sereno, S. C., Rayner, K. & Posner, M. I. Establishing a cell assemblies: a key to the understanding of cortical B. Neininger, G. Palm, K. Patterson, G. Rizzolatti, Y. Shtyrov and
time line for word recognition: evidence from eye lateralization and interhemispheric interaction. Neurosci. S. Wermter.
movements and event-related potentials. Neuroreport Biobehav. Rev. 20, 557–566 (1996).
13, 2195–2200 (1998). 65. Liberman, A. M. & Mattingly, I. G. The motor theory of Competing interests statement
46. Pulvermüller, F., Härle, M. & Hummel, F. speech perception revised. Cognition 21, 1–36 (1985). The author declares no competing financial interests.
Neurophysiological distinction of verb categories. 66. Braitenberg, V. & Schüz, A. in Language Origin:
Neuroreport 11, 2789–2793 (2000). A Multidisciplinary Approach (eds Wind, J., Chiarelli, B.,
47. Hauk, O. & Pulvermüller, F. Neurophysiological distinction Bichakjian, B. H., Nocentini, A. & Jonker, A.) 89–102 Online links
of action words in the fronto-central cortex. Hum. Brain (Kluwer, Dordrecht, Germany, 1992).
Mapp. 21, 191–201 (2004). 67. Baddeley, A. Working memory: looking back and looking FURTHER INFORMATION
48. Shtyrov, Y., Hauk, O. & Pulvermüller, F. Distributed forward. Nature Rev. Neurosci. 4, 829–839 (2003). Cognition and Brain Sciences Unit EEG laboratory:
neuronal networks for encoding category-specific 68. Fadiga, L., Fogassi, L., Pavesi, G. & Rizzolatti, G. Motor http://www.mrc-cbu.cam.ac.uk/eeg/index.shtml
semantic information: the mismatch negativity to action facilitation during action observation: a magnetic Pulvermüller’s homepage: http://www.mrc-cbu.cam.ac.uk/
words. Eur. J. Neurosci. 19, 1083–1092 (2004). stimulation study. J. Neurophysiol. 73, 2608–2611 (1995). common/people/people-pages/friedemann.pulvermuller.shtml
49. Pulvermüller, F., Shtyrov, Y. & Ilmoniemi, R. J. Brain 69. Gallese, V., Fadiga, L., Fogassi, L. & Rizzolatti, G. Action The Neuroscience of Language:
signatures of meaning access in action word recognition. recognition in the premotor cortex. Brain 119, 593–609 http://www.cambridge.org/us/features/pulvermuller/
J. Cogn. Neurosci. (in the press). (1996). Access to this interactive links box is free online.