Van Leeuwen, Kress - 1995
Van Leeuwen, Kress - 1995
Author(s): Theo Van Leeuwen, Theo von Leeuwen and Gunther Kress
Source: Internationale Schulbuchforschung , 1995, Vol. 17, No. 1 (1995), pp. 25-43
Published by: Berghahn Books
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide
range of content in a trusted digital archive. We use information technology and tools to increase productivity and
facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected].
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
https://about.jstor.org/terms
l.
All texts are multimodal. Language always comes in the company of other
semiotic modes. When we speak we articulate our message not just with
words, but through a complex interplay of speech, facial expression, gesture
and posture. When we write our message is not only expressed linguistically,
but also through a visual arrangement of marks on a page. Any form of text
analysis which ignores this will not be able to account for all the meanings
expressed in texts.
Nevertheless, there has long been a trend towards the monomodal,
especially in the most "serious", the most highly valued kinds of speech and
writing. Television newsreaders minimize facial expression and gesture, and in
the early days of BBC television were not even shown, as "illustration would
destroy balance" (Inglis, 1983: 211). Academic papers, important documents
and "high" literature worked, and to some extent still work, with words alone,
in densely printed pages, with a minimum of visual illustration, and without
much attention to layout and presentation.
This trend is now being reversed. Increasingly the written text is no longer
structured by linguistic means, through verbal connectors and verbal cohesive
devices, but visually, through layout, through the spatial arrangement of
blocks of text, pictures and other graphic elements on the page. The wordpro-
cessor has accelerated this trend. Writing now everywhere involves close
attention to typeface choices and layout. Newspapers, magazines, company
reports, textbooks and many other kinds of text are no longer just written, but
"designed" and multimodally articulated.
The semiotic modes in such texts can interrelate in different ways. Writing
may remain dominant, with the visual fulfilling a "prosodie" role of highlight-
ing important points and emphasizing structural connections. But it may also
diminish in importance, with the message articulated primarily in the visual
mode, and the words serving as commentary and elaboration. Visually and
verbally expressed meanings may be each other's double and express the same
meanings, or they may complement and extend each other, or even clash and
contradict.
Given these changes in writing practices, it becomes important to develop
modes of text analysis which can adequately describe the interplay between
the verbal and the visual, and adequately analyze visually expressed meanings.
In this paper we will present a descriptive framework for the analysis of layout
which can, we hope, go some way towards achieving these aims. The frame-
work builds on our earlier work (Kress and Van Leeuwen, 1990) but extends
and refines it in various ways, and is here published for the first time.
2.
Information value :
The placement of elements in a layout endows these elements with the specific
information values that are attached to the various zones of the visual space.
A given element does not have the same value and meaning when it is placed
on the right or on the left, in the upper or in the lower section of the page, in
the centre or in the margins. Each of these zones accords specific values to the
elements placed within it. We will discuss these values in sections 3 to 6 below.
Salience :
The elements of a layout are made to attract the reader's attention to different
degrees, and this through a wide variety of means: placement in the fore-
ground or background, relative size, contrasts in tonal value or colour, differ-
ences in sharpness and so on. This we will discuss in section 7 below.
Framing:
Framing devices (for instance framelines or white space between elements)
can disconnect the elements of a layout from each other, signifying that they
are to be read as, in some sense, separate and independent, perhaps even con-
trasting, items of information.
Connective devices (for instance vectors between elements or repetitions
of shapes and colours) have the opposite effect. They express that the
elements thus connected are to be read as belonging together in some sense, as
continuous or complementary for instance.
We will discuss this in section 8 below. In addition we will, in section 9, pay
attention to the "reading path", the trajectory followed by the reader in scan-
ning or reading the text.
These signifying systems operate simultaneously and are independently
variable. They apply, in fact, not just to layout, but also to the composition of
single pictures, where they also have an integrating function, a function of
bringing the pictorial elements together into a coherent and meaningful whole.
In this paper we will, however, concentrate on layout.
26
When a layout polarizes left and right, placing one kind of element on the left,
and another, perhaps contrasting element on the right, the elements on the left
are presented as Given, the elements on the right as New. For something to be
Given means that it is presented as something the reader already knows, as a
familiar and agreed upon departure point for the message. For something to
be New means that it is presented as something which is not yet known to the
reader, hence as the crucial point of the message, the issue to which the reader
must pay special attention. The New is therefore in principle problematic,
contestable, the information at issue, while the Given is presented as com-
monsense and selfevident.
In figure 2 the verbal text is Given and the pictures are New. On these two
pages, the first pages of the chapter, the reader is asked to concentrate on the
pictorially expressed message rather than on the verbal text. The layout of the
pictures themselves presents the past as Given and the present as New.
Although the chapter is called "Wie es früher war" ("How it was in the past"),
it is on the present, and in particular on the contrast between the drab, black
and white past and the lively, colourful present, that the reader is asked to
focus.
Such structures are ideological in the sense that they may not correspond
to what is the case either for the producer or for the consumer of the layout:
the important point is that the information is presented as though it had that
status or value for the reader, and that readers have to read it within that
structure, even if that valuation may then be rejected by a particular reader.
A similar structure exists in the English language, in the structure of the
clause, as shown by Halliday (1985: 274 ff) whose ideas have played a signifi-
cant role in developing our theory of layout. In language, this is realized by a
combination of word order ("theme-rheme") and intonation. Intonation cre-
ates two peaks of salience within each "tone group", one at the beginning of
the group, and another, the major one, the "tonic", as the culmination of the
New. Thus what comes first (in language it is a question of "before" and
"after" rather than of "left" and "right") is Given, and what comes last is New.
In our earlier work (Kress and Van Leeuwen, 1990) we develop these parallels
with language more fully, but it should be stressed that there are no parallels
for all the visual systems we describe (for instance the systems described in the
next three sections have no clear linguistic parallels), and that, in the case of
layout, the analogies are between layout and aspects of speech (intonation and
rhythm), rather than between layout and grammar or (linguistic) discourse
structures.
27
4.
When a layout polarizes top and bottom, placing different, perhaps contrast-
ing, elements in the upper and lower sections of the page, the elements placed
on top are presented as the Ideal and those placed at the bottom as the Real.
For something to be Ideal means that it is presented as the idealized or gen-
eralized essence of the information, and therefore also as its ideologically most
salient part. The Real is then opposed to this in that it presents more specific
information (e.g. details) and/or more "down to earth" information (e.g.
28
29
5.
30
Margin Margin
Ideal Ideal
Given .
Margin Margin
Real Real
Given New
6.
One common mode of combining Given and New with Centre and Margin is
the triptych. In many medieval triptychs there is no sense of Given and New.
The Centre shows a key religious theme, such as the Crucifixion or the Virgin
and Child, and the side panels show Saints or donors, kneeling down in
admiration. The composition is symmetrical rather than polarized, although
the left was regarded as a slightly less honorific position. In the 16th century,
altar pieces became more narrative, and showed, for instance, the birth of
Christ or the road to Golgotha on the left panel, the Crucifixion in the Centre,
and the Resurrection on the right panel. This could involve some polarization,
albeit subordinated to the temporal order, with the left, for instance, as the
"bad" side (e.g. the transgression of Adam), the right as the "good" side (e.g.
the ascent of the blessed) and the middle panel representing Christ's role as
Mediator and Saviour (e.g. the Crucifixion).
The triptychs in the layout of modern newspapers, magazines and text-
books are generally polarized, with a Given on the left, a New on the right,
and with the central element as Mediator, as bridging and linking the two
31
Vertical triptychs are less common than horizontal triptychs, but figure 3 is
an example. As the Ideal we see, in colour, immigrants ("Ausländer",
"foreigners") in high status professions. As the Real we see "foreigners" in
low status professions. This Real is, itself, divided into a Given and a New,
with a colour photo as the Given and a black and white photo as the New, as
though, in the 1990s, the low status of immigrants should be looked at in a
more sober light, and is no longer as Given as it once was. The Mediator is a
single immigrant worker, cleaning a train, and shown in black and white. The
accompanying text encourages students to explore what would happen if "one
day all foreign workers had to leave the Bundesrepublik" What, it asks, would
be the consequences for "the building industry, the children of the workers,
the owners of hostels, the workers themselves, the managers of hospitals and
cleaning firms?" In other words, the triptych, itself the New of the double
32
7.
33
8.
The elements of a layout may either be disconnected, marked off from each
other, or connected, joined together. Connection and disconnection are a
matter of degree. Elements may be strongly or weakly framed, and the
stronger the framing, the more the elements are presented as separate units of
information - the context can then colour in the more precise nature of this
separation. Elements may also be strongly or weakly connected, and the
stronger the connection, the more they are presented as one unit of
information, as belonging together.
Disconnection can be realized in many different ways, for instance by
framelines (the thickness or colour of which can then indicate the strength of
the framing), by discontinuities of colour or shape, or simply by empty space
between the elements. In figure 2 the white space around the icons of modern
technology, the astronaut, the aeroplane and the computer, separates the pres-
ent from the preceding stages of history, with relatively little continuity to the
past. The individual pictures in figure 1 are disconnected by strong three-
dimensional frames, and so presented as separate, disconnected, jumbled
pieces of a jigsaw puzzle - a puzzle which can then be solved in the course of
the chapter of which this layout forms the title page.
Connection can be realized by vectors, formed either by features of
depicted objects, such as the tilted angle of the colour photograph of Frank-
furt in figure 2, which creates a connection to the following page, or by
abstract graphic elements, such as the oblique lines formed by the jagged bot-
tom frameline of the text block on top of the left page in figure 2. It can also
34
9.
In densely printed pages of text, reading is linear and strictly coded. Such texts
must be read the way they are designed to be read - from left to right and
from top to bottom, line by line. Any other form of reading (skipping, looking
at the last page to see how the plot will be resolved or what the conclusion will
be) is a form of cheating and may produce a slight sense of guilt in the reader.
Other kinds of pages, e.g. traditional comic strips, are also designed to be read
in this way.
The pages discussed in this paper are read differently, and can be read in
more than one way. Their reading path is less strictly coded, less fully pre-
scribed. Readers may flick through the pages, stopping every now and again to
glance at a picture or read a salient piece of text, and perhaps later returning
to the sections which drew their attention. The layout of the pages sets up par-
ticular reading paths, particular hierarchies of the movement of the hypotheti-
cal readers within and across their different elements. Such reading paths
begin with the most salient element, from there move on to the next most
salient element, and so on. We would assume, for instance, that the pictures in
figure 5 are noticed before the text is read, and that the central pictures will be
scanned before the photographs are looked at. In other words, the reading
path moves from the most salient element, the central pictures, to the next
most salient element, the marginal pictures, and from there to the text (if that
text is read at all). And whether the reader only "reads" the pictures or also
part or all of the text, a complementarity, a to-and-fro between text and image
is guaranteed.
The reading path we have just sketched, however, is not the only possible
reading path. It is at best the most plausible one. Pages such as these may be
scanned or read, just as pictures may be taken in at a glance or scrutinized for
their every detail. Different readers will in all likelihood follow different read-
ing paths, and which paths they will follow will depend on their socio-cultural
position, for cultural factors play a significant role in the perception of
salience, and different cultural groupings are likely to have different hier-
archies of salience.
As non-linear texts become more common, even densely printed pages of
text begin to be read differently. The scientist, reading a journal of organic
35
36
10.
37
I- Mediator/Polarized elemen
L No horizontal polarizatio
-*[ r LL Minimum
Minimum t salience
p Maximum framing
- t
V_ L Maximum connectednes
Realizations
Centered: An element (the Centre or Mediator) i
Polarized: There is no element in the centre of t
Triptych: The non-central elements in a centere
or above and below the Mediator
Circular: The non-central elements in a centered composition are placed both above and below and
to the sides of the Centre or Mediator, and further elements may be placed in between these
polar elements
Margin: The non-central elements in a centered composition are identical or near-identical, so crea-
ting symmetry in the composition
Mediator: The central element in a polarized central composition
Given: The left element in a polarized composition or the left polarized element in a centered com-
position. This element is not identical or near-identical to the corresponding right element
New: The right element in a polarized composition or the right polarized element in a centered
composition. This element is not identical or near-identical to the corresponding left ele-
ment
Ideal: The top element in a polarized composition or the top polarized element in a centered com-
position. This element is not identical or near-identical to the corresponding bottom ele-
ment
Real: The bottom element in a polarized composition or the bottom polarized element in a cente-
red composition. This element is not identical or near-identical to the corresponding top
element
Salience: The degree to which an element draws attention to itself, due to its size, its place in the fore-
ground or its overlapping of other elements, its colour, its tonal values, its sharpness or defi-
nition, and other features
Disconnection:The degree to which an element is visually separated from other elements through frameli-
nes, pictorial framing devices, empty space between elements, discontinuities of colour and
shape, and other features
Connection: The degree to which an element is visually joined to another element, through the absence
of disconnection devices, through vectors and through continuities and similarities of colour,
visual shape, etc.
38
39
12.
Figure 3 shows the opening pages of a chapter entitled "Ich, Wir, Andere"
("Me, Us, and the Others"). The remaining pages of the chapter introduce
"life in a Turkish village", complete with recipes for Turkish food, and then
move on to the question of prejudice, with the ultimate message that "people
on the one hand want to live with people from their own culture, to share
common experiences and activities. . .on the other hand we live together with
people from different cultures and will have to talk to them and work with
them and come to terms with them. . .What can you do to understand other
people?" But before this point is reached, the chapter lays down a number of
Givens, a number of inescapable aprioris.
The Given of the left page is, again, verbal - a brief historical overview of
postwar immigration. New on this page are two salient and colourful graphs,
the top one representing the proportions of immigrants coming from various
countries of origin. This graph is not quite as innocent as it looks. It is drawn
as a chart, and the horizontal axis of such charts is usually a timeline, so that
the charts are typically about the "increase" or "decrease" of some phenom-
enon. This graph, however, is about composition rather than about a temporal
process. It could, and perhaps should, have been drawn as a pie-chart. It can
therefore easily be misread as suggesting a sense of increase, as saying "there
are increasingly many Turkish immigrants". And, in salient yellow, it is the
Ideal with respect to the other, less salient graph, which is in fact a timeline
chart - a Real which shows a decrease , in the amount of successful appli-
cations for political asylum.
The New of the righthand page is the vertical triptych we have already dis-
cussed. Its Ideal is formed by two pictures of successful immigrants. They have
high status professions, and they are shown as individuals, and photographed
from a low angle ("looked up at") and in colour. Its Real is formed by two
pictures of immigrants working in lower status jobs, shown as a group, and
photographed from a high angle ("looked down upon"), and, in part, in black
and white. In other words, it may be "ideal" for immigrants to achieve high
status, but it is not the reality.
How can ideal and reality be reconciled? The central photo also shows an
immigrant worker. Like the high achieving immigrants he is shown as an indi-
vidual, but like the workers in the lower pictures he works in a low status job
and is shown in black and white. But at least he has become a person in his
own right, someone we can "talk to and work with and come to terms with",
rather than an anonymous foreigner in a crowd of other foreigners.
40
13.
Figure 1 opens a chapter about the environment. Although the individual pic-
tures are numbered, the structure is not linear, and the picture of the country-
side, centre right, is most salient - a picture of the "Lebensraum" after which
we all hanker.
Given on this page are pictures of a polluted environment - a denuded
forest, an industrial complex belching forth smoke, an overflowing rubbish
bin. That we live in a polluted world is not in question and presented as a self-
evident point of departure.
New, on the other hand, is a world cleaned up - the fragile butterfly as a
symbol of the fragile environment, in need of protection; the human rural
environment, clean and spacious; and a picture of technology, but clean-look-
ing technology, a helicopter in an environment of clear water and blue skies.
This, then, is the issue of the chapter, the problem: how to clean up the
environment.
The vertical structure presents fragile nature as the Ideal. Perhaps the four
pictures can be read as something like a story: (1) nature despoilt; (2) the
motorcar, with its unbridled energy consumption, as the culprit; (3) the dump-
ing of cars as the solution; (4) the restoration of nature as the result. But that
is the Ideal. If only it were so simple.
As the Real we have technology, moving from unadulterated pollution to
clean-looking technology. In reality we cannot dump technology. We need it.
The problem is how to clean it up.
The page as a whole is structured as a vertical triptych, and the central pic-
tures not only reiterate the Given of pollution and the New of the clean
environment, saliently and centrally, they also act as Mediators. A picture of
industrial pollution forms a bridge between the despoliation of nature and the
pollution of the human environment. The clean rural environment is shown as
on the one hand like nature (the butterfly), and on the other hand like tech-
nology (it is, after all, a human environment).
Compared to the picture of the rural landscape, the picture of the heli-
copter may seem small and insignificant. But its position is important. New
and Real, it is the position of the pragmatic imperative. In advertisements it is
41
14.
On each of the pages we have analyzed major ideological issues are at stake,
and in each case they are articulated multimodally, through the orchestration
of visual and verbal elements achieved by layout.
We hope that our analysis has demonstrated that layout cannot be ignored
in critical readings of texts of this kind, and that it plays a significant role in
the representation of social issues. Layout is not just a matter of making the
text more attractive, more "pupil-friendly", although it does that too. It is a
semiotic mode of its own, and as such it contributes vitally to the production
of meaning in texts. In this visual age it is highly unlikely that such meanings
would escape children, even if at present the means for making ourselves con-
scious of them are still in their infancy compared to the rich resources we have
for analyzing the linguistic code.
Zusammenfassung
Das Layout dient nicht nur dazu, Texte attraktiver zu gestalten, es leistet auch
einen wichtigen Beitrag zu der Struktur und der Bedeutung von multimodalen
Texten, die sprachliche und visuelle Kommunikation kombinieren. Es arbeitet
gleichzeitig auf drei Ebenen. Die Layout-Elemente (Textblöcke, Bilder und
andere graphische Elemente) sind durch ihre Seitenpositionierung mitei-
nander verbunden (links-rechts, oben-unten und Mitte-Rand), was ihnen
einen spezifischen informativen Wert wie „gegeben" und „neu", „ideell" und
„real", „zentral" und „marginal" verleiht. Die Elemente stechen unterschied-
lich hervor und verbinden sich oder heben sich voneinander auf verschiedene
Weise ab. Eine Analyse von Seiten aus zwei deutschen Schulbüchern der
Sozialkunde/ Politik für das Gymnasium veranschaulicht den Wert dieser
Layout-Methode für eine kritische Analyse der Schulbuchdarstellung von
sozialen Fragen.
Résumé
La mise en page n'est pas seulement un moyen de rendre les textes plus attray-
ants, elle contribue également beaucoup à la structure et au sens de textes
multimodaux combinant la communication linguistique et visuelle. Elle opère
simultanément à trois niveaux. Les éléments de mise en page (blocs textuels,
42
References
Ackermann, P., Becker, H., Feick, J., Hufnagel, G. and Uhi, H. (1987) Thema Politik
7-10 , Stuttgart, Ernst Klett Schulbuchverlag
Arnheim, R. (1982) The Power of the Centre , Berkeley, Los Angeles, UCLA Press
Halliday, M.A.K. (1985) Introduction to Functional Grammar , London, Edward
Arnold
Inglis, K.S. (1983) This is the ABC - The Australian Broadcasting Commission
1932-1983, Melbourne, Melbourne University Press
Kress, G. and Van Leeuwen, T. (1990) Reading Images , Geelong, Deakin University
Press
Nitzschke, V. (1990) Politik - Lernen und Handeln für heute und morgen , Band 1 ,
Frankfurt an Main, Verlag Moritz Diesterweg
43