Does Intensive Explicit Grammarinstruction Make All The Difference
Does Intensive Explicit Grammarinstruction Make All The Difference
Does Intensive Explicit Grammarinstruction Make All The Difference
297–327
I Introduction
The research reported in this paper is set within an international debate
on the value of an explicit focus on grammar in second language (L2)
classrooms (see Doughty and Williams, 1998 for a comprehensive review
of the theme). It is also set within a (UK) national modern foreign lan-
guage (MFL) context which has seen repeated calls, by both theorists and
practitioners, for a return to more explicit grammar teaching in schools
(Marsden, 1999; Metcalfe et al., 1998; Mitchell, 2000; Wright, 1999), but
II Background
1 The role of explicit and implicit knowledge
There has been considerable focus of attention on the relationship
between explicit (analysed) grammatical knowledge and implicit
(unanalysed) grammatical knowledge and how this might relate to lan-
guage development. It is generally accepted that explicit knowledge is
acquired through controlled processes in declarative memory, while
implicit knowledge is acquired through much less conscious or even
subconscious processes.
The implications of these two types of knowledge for L2 instruction
are twofold. First, if grammar is taught explicitly can it then become
automatic so that language can be understood and produced without
constant recourse to the rules that generated the explicit knowledge in
the first place? Conversely, can language that is acquired implicitly be
reflected on if and when the language situation or task demands it?
Second, if different language programmes want to measure these
different types of knowledge, can they be measured validly?
The degree to which implicitly acquired knowledge is accessible has
been questioned (Han and Ellis, 1998), for example in production tasks,
where knowledge and behaviour are not easily distinguishable.
Grammaticality judgement tests (GJT), where subjects have to declare
whether a sentence is correct or incorrect, may be more appropriate for
distinguishing between knowledge and performance. However, whether
such tests really measure implicit (as opposed to explicit) knowledge is
now considered to be dependent on a number of conditions, of which the
pressure to respond within a given time, and the use of ‘rule’ rather than
‘feel’, appear to be the most important (Bialystok, 1979; R. Ellis, 2005).
A difficulty also resides in measuring knowledge about language, in
that learners cannot be said to lack explicit knowledge simply because
they do not possess the required metalinguistic competence to articulate
it. Nevertheless, studies have explored the relationship between metalin-
guistic knowledge and general language proficiency. For example,
Alderson et al. (1997) carried out such research among undergraduates
and found ‘no evidence to support the belief that students with higher
levels of metalinguistic knowledge perform better at French, or that they
improve their French proficiency at higher rates than other students’
(1997: 118) and concluded that ‘metalinguistic knowledge and linguistic
300 Does grammar instruction make all the difference?
between learners’ knowledge about the L2 and their ability to use the
L2 in different situations (Bialystok, 1982), leading to an uncertainty
regarding how to measure interlanguage development. Macrory and
Stone (2000) investigated pre-intermediate learners’ acquisition of the
perfect tense in French and found not only considerable within-subject
variability in the use or non-use of the auxiliary, but also that subjects
used an auxiliary (both correctly and incorrectly) in gap-fill exercises
while frequently omitting it completely in oral and written production
tasks. On a related theme, Hulstijn and de Graaf (1994) theorized that
explicit knowledge facilitates the acquisition of implicit knowledge
under certain conditions. An interesting speculation of theirs, resulting
from this line of reasoning, is that explicit instruction may have a greater
effect on comprehension tasks than on production tasks.
In sum, although the distinctions between the explicit and implicit
acquisition of knowledge, and between intuitive and reflective demon-
stration of knowledge are still being established, it may nevertheless be
the case that the two types of knowledge, although acquired differently,
do in fact interact in long term memory. This is sometimes known as the
interface position (Ellis, 1994; McLaughlin, 1987), a position also held
by N. Ellis (2005). It is this interface that continues to interest
researchers in that, as a consequence, explicit instruction may indeed
have a part to play in developing L2 acquisition.
3 Summary
Whilst there is research evidence that some focus on the grammatical
features of the L2 is beneficial to developing the interlanguage of a
learner, the evidence with regard to the explicit teaching of grammatical
features is not sufficiently conclusive to be able to influence pedagogy
directly. Particularly inconclusive is the issue of whether being taught
rules explicitly leads to successful internalization of those rules. This
appears to be linked to the considerable uncertainty over the nature of
the relationship between implicit and explicit knowledge, and between
implicitly acquired knowledge and the application of knowledge which
is, at least in part, intuitive. Nevertheless, the evidence from research
tends to support an interaction between these constructs rather than a
complete dissociation. For that reason alone, it would seem to be worth
continuing to ask questions about explicit grammar instruction.
However, there are additional reasons for continuing to investigate the
effectiveness of explicit grammar teaching.
First, it remains to be determined whether explicit knowledge can
become sufficiently automatic to enable both fluency and accuracy in
production tasks. Conversely, we need to explore whether explicit
knowledge can be easily brought back under selective attention in order
to monitor for possible mistakes in production tasks.
Second, the relationship between implicit and explicit knowledge
appears to account for variability between tasks which measure different
things. Although GJTs are not without controversy with regard to their
validity (Birdsong, 1994; Ellis, 1990a; Gass, 1994), they continue to be
used, alongside other types of tasks, in order to test for grammatical
306 Does grammar instruction make all the difference?
IV Method
1 Participants
Participants were drawn from the population of first-year students study-
ing French at the university. The context of the study required us to
adopt a purposive strategy by recruiting exclusively those students from
a percentile who had achieved the lowest scores in the AGT. The inter-
vention group was recruited by invitation in summer 2003 and numbered
12 students. For the comparison group we identified the tranche of stu-
dents who had achieved the next lowest scores in the AGT and sent them
invitations on their arrival in October 2003. We recruited 10 students
who received payment for taking part. All students in the overall sample
308 Does grammar instruction make all the difference?
Table 1 Summary of AGT scores
begun the previous day, and also revised other grammatical elements
which had been covered in earlier sessions:
1) Working individually or in pairs, students composed sentences
incorporating que, dont, lequel, etc. (continuation of previous day’s
topic) (9 minutes).
2) Tutor used a sentence written by a student in a previous exercise to
explain the agreement of the direct object in relative clauses with
the passé composé (3 minutes).
3) Tutor explained the use of the relative pronoun dont and set an
exercise for students to compose sentences. He then coached indi-
vidual students during the exercise and gave feedback to the whole
class (9 minutes).
4) Tutor set an exercise for students to work in pairs to reconstruct
fragmented sentences involving relative pronouns and the future
and conditional verb tenses (15 minutes). Tutor then asked students
to read out their work and included explanations of grammatical
rules in his feedback. He also asked them to write the sentences in
their notebooks (7 minutes).
5) Tutor set a computer-based exercise for students to read articles on
the Website of Le Monde, identify constructions containing relative
pronouns and copy them into their notebooks (8 minutes).
6) Tutor gave a dictation and asked students to underline occurrences
of grammatical elements studied during this session and on the
previous day, including demonstrative adjectives and agreement of
the past participle (9 minutes).
The daily classroom activities were reinforced by independent study
tasks, including translating, essay writing and memorizing verb forms.
Students also had twice-weekly sessions, in pairs, with a postgraduate
student to help them consolidate what they had learnt.
3 Grammar tests
Three grammar tests were administered to participants during the study
as follows:
• Interim test: Intervention group only – one week after the end of the
intensive grammar course and immediately prior to starting their
studies (October 2003).
• Post-test: Both groups: after 11⁄2 terms’ tuition (12 weeks) (February
2004).
c Translation (Part 3)
V Results
1 Discrete-point grammar tests within groups
In order to begin answering research questions 1 and 2, we first analysed
the within-group change over time. The discrete-point grammar tests
(Parts 1 and 2) were computed for frequencies and their mean scores
compared at each time point using a paired samples t-test. These
are summarized in Table 2. Part 1 in the table is split in two, to reflect
the different marking schemes used with erroneous and error-free
sentences.
The mean ability of the intervention group to spot and correct errors,
and to provide explanations for their corrections, improved significantly
over the period of the tests. However, it should be noted that the ability
to spot errors improved significantly between interim- and post-test
rather than between pre- and interim-test. Moreover, the improvement in
their ability to recognize error-free sentences was less marked, and
even declined between the interim and post-tests. It should also be noted
Ernesto Macaro and Liz Masterman 313
Table 2 Within-groups mean scores (and standard deviations) for parts 1 and 2 of
grammar tests.
that the intervention group’s ability to correct errors and provide rule
explanations improved significantly only between pre- and post-test, and
not between pre- and interim test.
In contrast, the comparison group’s scores did not improve signifi-
cantly and, in the error correction and rule explanation task, declined.
Standard deviations indicate some wide variations in individual scores
and this issue will be address later.
Table 3 Within-groups mean scores (and standard deviations) for translation (part 3)
3. Translation
(max.12) I 6.58 7.12 6.92 t ⫽ 1.096 t ⫽ 0.405 t ⫽ 0.471
(1.72) (1.90) (2.19) p ⫽ 0.297 p ⫽ 0.693 p ⫽ 0.647
C 7.35 7.80 t ⫽ 0.927
(1.73) (1.75) p ⫽ 0.378
3 Between-group comparisons
In order to further answer research questions 1, 2 and 3, and specifically
answer question 4, we carried out between group comparisons.
Mann-Whitney calculations were performed for the reasons given
above. Table 5 shows the results for each part of the tests. The second
and fourth columns show which group obtained the higher mean
score for the relevant part (for the actual figures, please refer to the
preceding tables).
In the pre-test, none of the differences were significant between the
two conditions, reflecting the absence of a significant difference in the
AGT scores of the two groups. In the post-test, there was a significant
Ernesto Macaro and Liz Masterman 315
Table 4 Within-groups mean scores (and standard deviations) for narrative composi-
tion (part 4)
Table 5 Statistical analysis of the differences between the two groups in their pre-
and post-test scores
as it lies just outside upper bound (1.13) of the 95% confidence level
computed by Norris and Ortega in their meta-analysis of metalin-
guistic tasks. In other words, sample size did not appear to influence
results.
Figure 1 Students’ total scores for parts 1 and 2 in the tests (grammaticality judge-
ment and error correction/rule explanation). Asterisks denote students who attended
additional grammar classes.
318 Does grammar instruction make all the difference?
VI Discussion
The study described in this paper set out to answer four inter-related
questions regarding whether an intensive course in French grammar
given to high-achieving first-year undergraduates, prior to starting their
degree programme proper, was a sufficiently powerful intervention to
bring about an improvement in their grammatical knowledge, both in the
short and long term, a reduction in their production errors without any
detrimental effect on other aspects of written production, and these
improvements as compared to a group who did not receive the intensive
course.
Our findings suggest that the intensive grammar course was not a
sufficient factor to bring about a significant improvement in their gram-
matical knowledge as there was no greater ability to make judgements
overall of grammaticality when compared to the comparison group.
There was, however, evidence of a greater ability to correct errors in
Ernesto Macaro and Liz Masterman 319
VII Limitations
Our study, of course, was not without its limitations. These were
imposed largely by the non-random nature of the selection and the small
number of participants. Both of these factors lay outside the researchers’
control due to the ‘remedial purpose’ of the grammar course and the
reliance on volunteers for participation in the comparison group. It was
thus a matter of fortune rather than of deliberate design that the differ-
ences in the AGT scores between the two groups proved statistically
non-significant, as did the pre-tests. Even though effect size calculations
reinforced the significance of our principal findings, our lack of control
over other variables – such as the quantity and quality of regular
language teaching received by students and individual learner differ-
ences in approaches to self-study – means that we cannot generalize
the results with confidence beyond our sampling frame of Oxford MFL
students.
VIII Conclusions
The intensive course of explicit grammar teaching was not a sufficiently
powerful independent variable in bringing about the intended structural
change in the intervention group’s interlanguage. In other words, it did
not ‘make all the difference’.
322 Does grammar instruction make all the difference?
Acknowledgements
We acknowledge funding for both the grammar course and the associ-
ated research study from the Higher Education Funding Council for
England (HEFCE). We also thank the following for their contribution to
the study: Michaël Abecassis, Kate Tunstall, Ursula Wingate, Suzanne
Graham, Brian Richards, Robert Vanderplank and Lynn Erler.
We would also like to acknowledge the two anonymous reviewers for
their constructive comments in helping to shape this article.
Ernesto Macaro and Liz Masterman 323
Note
1 It should be made clear that neither the authors nor the university consider the AGT
a standardized test of grammatical knowledge. It is merely a component in
the admissions process designed to provide an indicator of current grammatical
knowledge.
IX References
Alderson, J.C., Clapham, C. and Steel, D. 1997: Metalinguistic knowledge,
language aptitude, and language proficiency. Language Teaching
Research 1(2): 93–121.
AQA 2005: Qualifications and subjects. Retrieved 24 February 2005 from
http://www.aqa.org.uk/qual/.
Baddeley, A. 1986: Working memory. Clarendon Press.
—— 1997: Human memory: theory and practice. Psychology Press.
Bailey, N., Madden, C. and Krashen, S. 1974: Is there a ‘natural
sequence’ in adult second language learning? Language Learning 21:
235–43.
Bautier-Castaing, E. 1977: Acquisition comparée de la syntaxe du Français
par des enfants francophones et non francophones. Études de linguis-
tique appliquée 27: 19–41.
Benati, A. 2001: A comparative study of the effects of processing instruction
and output-based instruction on the acquisition of the Italian future
tense. Language Teaching Research 5(2): 95–127.
Bialystok, E. 1979: Explicit and implicit judgements of L2 grammaticality.
Language Learning 29(1): 81–103.
—— 1982: On the relationship between knowing and using forms. Applied
Linguistics 3: 181–206.
Birdsong, D. 1994: Decision making in second language acquisition. Studies
in Second Language Acquisition 16(2): 169–82.
Brown, R. 1973: A first language: the early stages. Harvard University Press.
Cook, V. 2001: Second language learning and language teaching, third
edition. Arnold.
Doughty, C. 1991: Second language instruction does make a difference.
Studies in Second Language Acquisition 13(4): 431–69.
Doughty, C. and Williams, J., editors, 1998: Focus on form in classroom
second language acquisition. Cambridge University Press.
Dulay, H. and Burt, M. 1974: Natural sequences in child second language
acquisition. Language Learning 24: 253–78.
Edexcel 2004: Edexcel qualifications. Retrieved 24 February 2005 from
http://www.edexcel.org.uk/qualifications/.
324 Does grammar instruction make all the difference?
Malvern, D., Richards, B., Chipere, N. and Durán, P. 2004: Lexical diver-
sity and language development: quantification and assessment. Palgrave.
Manley, J. and Calk, L. 1997: Grammar instruction for writing skills: do stu-
dents perceive grammar as useful? Foreign Language Annals 39: 73–83.
Marsden, R. 1999: Go for the ‘a-ha!’ factor in grammar learning. Deutsch:
Lehren und Lernen 19: 15–16.
Metcalfe, P., Laurillard, D. and Mason, R. 1998: ‘It’s just a word’: pupils’
perceptions of verb form and function. Language Learning Journal 17:
14–20.
Mitchell, R. 2000: Applied linguistics and evidence-based classroom
practice: the case of foreign language grammar pedagogy. Applied
Linguistics 21(3): 281–303.
Norris, J.M., and Ortega, L. 2000: Effectiveness of L2 instruction: a
research synthesis and qualitative meta-analysis. Language Learning
50: 417–528.
Pienemann, M. 1984: Psychological constraints on the teachability of lan-
guages. Studies in Second Language Acquisition 6(2): 186–214.
Prabhu, N.S. 1987: Second language pedagogy. Oxford University Press.
Richards, J.C. and Rogers, T.S., editors, 1986: Approaches and methods in
language teaching. Cambridge University Press.
Rivers, W.M. 1983: Communicating naturally in a second language: theory
and practice in language teaching. Cambridge University Press.
Robinson, P. 1996: Learning simple and complex second language rules
under implicit, incidental, rule-search and instructed conditions. Studies
in Second Language Acquisition 18(1): 27–68.
Schmidt, R. 1990: The role of consciousness in second language learning.
Applied Linguistics 11: 129–58.
Scott, V. 1989: An empirical study of explicit and implicit teaching strategies
in French. Modern Language Journal 72: 14–22.
Sharwood-Smith, M. 1981: Consciousness raising and the second language
learner. Applied Linguistics 2: 159–69.
—— 1994: Second language learning: theoretical foundations. Longman.
Sheppard, R. 1993: Getting down to brass syntax: German teaching and the
great standards debate. German Teaching 8: 3–9.
Skehan, P. 1998: A cognitive approach to language learning. Oxford
University Press.
Soars, J. and Soars, L. 1987: Headway. Oxford University Press.
Spada, N. and Lightbown, P.M. 1999: Instruction, first language influence,
and developmental readiness in second language acquisition. Modern
Language Journal 83(1): 1–22.
Ernesto Macaro and Liz Masterman 327