句法复杂性发展(2017)
句法复杂性发展(2017)
句法复杂性发展(2017)
Syntactic Complexity in L2
Development: Syntactic Elaboration
and Diversity
BASTIEN DE CLERCQ1 and ALEX HOUSEN2
1
Vrije Universiteit Brussel, TALK, Pleinlaan 2, 1050 Brussels, Belgium Email: [email protected]
2
Vrije Universiteit Brussel, TALK, Pleinlaan 2, 1050 Brussels, Belgium Email: [email protected]
Syntactic and linguistic complexity have been studied extensively in applied linguistics as indicators of
linguistic performance, development, and proficiency. Recent publications have equally highlighted the
reductionist approach taken to syntactic complexity measurement, which often focuses on one or two
measures representing complexity at the level of clause-linking or the sentence, but eschews complexity
measurement at other syntactic levels, such as the phrase or the clause. Previous approaches have also
rarely incorporated measures representing the diversity of syntactic structures in learner productions.
Finally, complexity development has rarely been considered from a cross-linguistic perspective, so that
many questions pertaining to the cross-linguistic validity of complexity measurement remain. This article
reports on an empirical study on syntactic complexity development and introduces a range of syntactic
diversity measures alongside frequently used measures of syntactic elaboration. The study analyzed 100
English and 100 French second language oral narratives from adolescent native speakers of Dutch, sit-
uated at 4 proficiency levels (beginner–advanced), as well as native speaker benchmark data from each
language. The results reveal a gradual process of syntactic elaboration and syntactic diversification in
both learner groups, while, especially in French, considerable differences between learners and native
speakers reside in the distribution of specific clause types.
Keywords: complexity; syntax; L2 French; L2 English; cross-linguistic
Proficiency group 1 2 3 4 1 2 3 4
N 25 25 25 25 25 25 25 25
Age 12–13 12–13 17–18 17–18 12–15 12–15 17–18 17–18
% error-free clauses Mean 22% 61% 75% 88% 8% 34% 56% 74%
SD 12% 14% 8% 5% 7% 20% 10% 13%
% correct prepositions Mean 55% 80% 85% 90% 33% 68% 84% 94%
SD 16% 12% 6% 7% 23% 18% 9% 5%
% correct verb forms Mean 28% 61% 85% 98% 35% 75% 92% 97%
SD 28% 31% 17% 3% 17% 17% 6% 3%
length measures calculated at three syntactic lev- in-text standard deviation may distinguish texts
els, that is, the noun phrase (LenNP), the clause that simple length measures would consider iden-
(LenC), and the AS-unit (LenAS), as well as a tical (Examples 3a and 3b).
clause-linking measure representing the number
of clauses per AS-unit (C/AS). The AS-unit is a EXAMPLE 3
multiclausal unit encompassing an independent (3a) Average clause length: 6 words; Standard
clause and its dependent clauses and is thus simi- deviation of clause length: 0 words
lar to the frequently studied T-unit (Hunt, 1965) and he climbed on a rock.
in writing research. In contrast to the T-unit, the and held himself on a tree.
AS-unit also includes subclausal units, which are the tree was n(o)t a tree.
not necessarily organized around a verb (Foster (3b) Average clause length: 6 words; Standard
et al., 2000). Our working definition for clauses deviation of clause length: 2 words
identified these as syntactic units headed by a the frog is n(o)t in the jar anymore.
verb, whether finite or nonfinite. The NP is here and he looks sad.
he looks everywhere in the room.
defined as a syntactic unit headed by a nominal el-
ement, and was operationalized by including only
Obviously, both traditional length measures
NPs with a common head noun which were not
and standard deviation are holistic, global metrics
embedded in another NP. Only words of the tar-
of structural surface complexity that cannot dis-
get language or idiosyncratic words that had a
tinguish the underlying structural differences of
phonological or morphological structure corre-
utterances in (4a) and (4b).
sponding to the target language were included in
the counts. EXAMPLE 4
(4a) and he does n(o)t find him. (6 words)
EXAMPLE 2 (4b) the guy find the frog not. (6 words)
(2a) The boy roeping [Dutch: CALL+ING]
again. (4 words) However, the use of these measures is based
on their status as proxies of syntactic complex-
Since few L2 studies have included syntactic ity and, in the case of length measures specifi-
diversity measures, the ones used in this study cally, on their high correlation with other types
are exploratory. We used three types of measures. of measures such as node-based measures (Szm-
First, as a proxy of syntactic diversity analogous to recsanyi, 2004). The advantage of these diversity
the length measures, the within-text standard de- measures is that they are easy to calculate and in-
viation of the syntactic length is used.2 The un- terpret, are analogous to length-based measures,
derlying assumption for this measure is that, if and can be applied to several syntactic levels. As
length can be used as a proxy of underlying struc- such, they will be applied to the same units as
tural differences, as is the case for most frequently the length measures, that is, noun phrase diversity
used syntactic elaboration measures, more syntac- (DivNP), clause diversity (DivC), and AS-unit di-
tically diverse texts will include more units of vary- versity (DivAS).
ing length and have higher standard deviations Second, we used a measure representing
for length measures. Thus, measures based on the percentage of various clause types in each
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Bastien De Clercq and Alex Housen 323
text. We distinguished three general types of EXAMPLE 7
clauses in the corpus: matrix clauses (%mat),
[sub.adv.fin = S.ADV-F] when the boy wakes up.
subordinate clauses (%sub), and coordinated
[mat = M] he sees.
clauses (%coor). Following Cosme (2007) and
[sub.com.fin. = S.C-F] that the frog is n(o)t in his
Biber et al. (2011), we further distinguished
jar anymore.
two formal subtypes of subordinate clauses (fi-
Clause-linking pattern = S.ADV-F+M+S.C-F
nite/nonfinite) and three functional subtypes
(complement/adverbial/relative). Note that in An automatic tool (Brezina & Pallotti, 20153 )
our analysis the category of coordinated clauses then segmented each text into random samples
only covers coordinated clauses with ellipsis of five AS-units, for which the number of different
(of the verb and/or the subject). This decision syntactic codes within and across each sample was
was made to account for the frequent use of counted. After 100 repetitions of this process, the
coordinating conjunctions such as ‘and’ as filler tool averaged the number of unique codes within
items in oral data rather than as true connectives each sample and across each sample and calcu-
(Beaman, 1984; Kerr–Barnes, 1998) (see Exam- lated the SDI using the following formula:
ple 5).
uniq ue c ode s within s ample s
EXAMPLE 5 uniq ue c ode s acr os s s ample s
+ − 1
[mat] he look after a tree. 2
[mat] and there is his frog with a girl frog. Since the SDI requires the presence of at least
[mat] and they have a lot of children. two 5-code samples in order to calculate across-
[mat] and they are playing with them. segment diversity, six Level 1 French texts that
[mat] and then see he leaves. contained fewer than 10 AS-units were excluded
[mat] and they are watching at him. from the SDI analysis.
Note. LenNP = Length of noun phrase; LenC = Length of clause; LenAS = Length of AS-unit; C/AS = Number of
clauses per AS-unit; NS = Native speaker.
differed considerably between Level 1 (.68) and At the NP level (DivNP), a Games–Howell post-
Level 2 (1.24). As was the case for the syntac- hoc test found no differences in syntactic diversity
tic elaboration measures, the difference between in the English learner groups, although learners
learners and native speakers was always statisti- at Level 1 tended to use more diverse NPs (1.37)
cally significant (p < .05), except for DivC, for than at Level 2 (1.18). As in French, we found
which only the learners at Levels 1 and 2 did not higher increases of syntactic diversity than of elab-
attain scores comparable to those of the native oration at the clausal level even though these are
speakers (p < .05). As was the case for syntactic only statistically significant between Level 1 on the
elaboration, there were no statistically signifi- one hand and Levels 3 and 4 on the other hand
cant differences in NP diversity in the learner (p < .05). Finally, the two measures show that
groups, with group means varying between 1.03 the increase in diversity found for both measures
and 1.31, although the gap between the learn- is more pronounced when measured in terms of
ers and the native speakers was considerable clause-linking patterns (SDI), for which we found
and statistically significant (p < .05). Interest- statistically significant differences between Levels
ingly, while no systematic increase was observed 1 and 2 and Levels 3 and 4, than when measured
for syntactic elaboration at the clausal level in terms of word length (DivAS), for which only
(LenC), clausal diversity increased. We find the the differences between Levels 1 and 2 and Lev-
highest effect sizes for the AS-unit measures els 3 and 4 were statistically significant. While no
(η2p = .513 for DivAS and .596 for SDI). statistically significant differences were observed
The scores in English indicate more moderate between the English native speakers and the more
increases in syntactic diversity than in French. A advanced learners of Levels 3 and 4, these learners
one-way ANOVA revealed statistically significant actually tended to use more diverse syntax than
differences for DivC (F(4,120) = 4.83, p < 0.05), the native speakers for all measured units.
DivAS (F(4,120) = 13.92, p < 0.05), and SDI A comparison of the two languages reveals
(F(4,120) = 23.61, p < 0.05), but not for DivNP that effect sizes in English are typically lower
(F(4,120) = .863, p = 0.488) (η2p = .028 – .440) than those found for French
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
326 The Modern Language Journal 101 (2017)
TABLE 3
Summary of Diversity Measures: Simple Indices
Note. DivNP = Noun phrase diversity; DivC = Clause diversity; DivAS = AS-unit diversity; SDI = Syntactic diversity
index; NS = Native speaker.
(η2p = .179 – .596). Group averages for syntac- decrease in the percentage of matrix clauses, sta-
tic diversity are consistently higher, more so than tistically significant from Levels 1 to 3 (p < .05), is
for syntactic elaboration, in the English learner offset by a similar increase in subordinate clauses,
data than in the French learner data, indicating equally statistically significant from Levels 1 to 3
that the learners start out using more diverse syn- (p < .05). No statistically significant differences
tax in English than in French, and their English were observed between any of the learner groups
maintains this edge at more advanced stages as in both languages for the coordination measure,
well. Once more, the French native speakers re- even if considerable differences were nonetheless
verse this trend by achieving higher scores than found in the group averages. The proportion of
both the English native speakers and the more ad- coordinated clauses with ellipsis was generally
vanced English learners. higher in English than in French, and decreased
As for the distribution measure (Table 4), a considerably in French from Level 3 onward.
one-way ANOVA reveals statistically significant dif- The clause-type distribution in the French
ferences in French and English for the percentage native speaker data converges with the trend
of matrix clauses (F(4,120) = 55.28, p < .05 for observed in the learner data and indicates that
French; F(4,120) = 21.65, p < .05 for English) and French native speakers rely even more on sub-
the percentage of subordinate clauses (F(4,120) ordinate clauses than the advanced learners.
= 55.01, p < .05 for French; F(4,120) = 28.11, p In English, the native speaker scores typically
< .05 for English). Additionally, a Kruskal–Wallis fall between those of Levels 3 and 4 for the use
test found a statistically significant difference for of matrix or subordinate clauses. Interestingly,
the percentage of coordinate clauses in English the learners seem to underuse coordinated
(χ 2 (4) = 16.76, p < 0.05), but not in French clauses with ellipsis in French and English when
(χ 2 (4) = 3.56, p = .464). compared to the native speakers.
A closer look at the scores reveals a strong in- Turning our attention to the different cat-
verse tendency in both languages. A progressive egories of subordinate clauses, a one-way
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Bastien De Clercq and Alex Housen 327
TABLE 4
Summary of Diversity Measures: Distribution Measures
Note. %Mat = Percentage of matrix clauses; %Coor = Percentage of coordinated clauses; %Sub = Percentage of
subordinate clauses; NS = Native speaker.
ANOVA of the various formal and functional proportion of subordinate clauses in the French
subtypes (Table 5) reveals statistically significant native speaker data was mostly due to the high
differences in both languages for the percentage number of relative clauses in the L1 data, while
of complement clauses (F(4,120) = 25.92, p < .05, the more advanced learners scored similarly to
for French, F(4,120) = 13.26, p < .05, for English) the native speakers with regard to complement
and finite subordinate clauses (F(4,120) = 41.30, clause use.
p < .05, for French, F(4,120) = 25.04, p < .05, In the English data, the various subcategories
for English), as well as for the percentage of non- also increased overall throughout development,
finite subordinate clauses in English (F(4,120) especially from Levels 1 to 3. Compared to the
= 12.44, p < .05). An additional Kruskal–Wallis French data, however, all clause types already
test revealed statistically significant differences in appear at Level 1, even if complement clauses
both languages for the percentage of adverbial remain the dominant subordinate clause type
clauses (χ 2 (4) = 70.98, p < .05 for French; χ 2 (4) throughout development. The data also revealed
= 55.30, p < .05 for English) and relative clauses that the learners at Level 4 frequently surpassed
(χ 2 (4) = 62.94, p < .05 for French; χ 2 (4) = 32.82, the English native speakers in their use of most
p < .05 for English), as well as a statistically signif- subordinate clause types and that this difference
icant difference for the percentage of nonfinite was statistically significant for adverbial and finite
clauses in French (χ 2 (4) = 48.48, p < .05). subordinate clauses (p < .05).
These data reveal that, in French, the observed In sum, the analyses of syntactic diversity
increase in subordinate clauses can largely be suggest that this dimension develops similarly
explained by an increased use of complement to syntactic elaboration in that we found an
clauses and finite clauses. If all subordinate clause overall diversification with increased proficiency
types tended to increase with proficiency in the particularly at the supraclausal level. Moderate
French learner data, relative clauses remained a increases were observed as well for clausal diver-
minor and, compared to the native speakers, un- sity in both languages. The data also foreground
derused category. Note that the French learners at coordination as a more prominent category in
Level 1 only relied on complement clauses, both English than in French, although in both lan-
finite and nonfinite, but not adverbials or rela- guages its role throughout development seems
tives. The data equally revealed that the higher limited.
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
328 The Modern Language Journal 101 (2017)
TABLE 5
Summary of Diversity Measures: Functional and Formal Subtypes
Note. %Com = Percentage of complement clauses; %Adv = Percentage of adverbial clauses; %Rel = Percentage of
relative clauses; %Fin = Percentage of finite subordinate clauses; %N-Fin = Percentage of nonfinite subordinate
clauses; NS = Native speaker.
DISCUSSION EXAMPLE 8
This section discusses the results in relation to (8a) le garçon et le chien cherche une
our two main research questions by focussing first grenouille. (L2: level 1)
on syntactic elaboration, then on syntactic diver- the boy and the frog search for a frog
(8b) and the boy see an uil [Dutch: ‘owl’]. (L2:
sity. Throughout our discussion we will consider
level 1)
the impact of our methodological choices.
Our first research question pertained to the
This does not imply that all clauses at Level 1
development of syntactic elaboration and poten-
are organized around finite verbs (9a), although
tial cross-linguistic differences. The data revealed
some complex structures, such as negatives with
that syntactic complexification mainly occurred
do-support in English (9b), already occur at Level
at the level of the AS-unit, where we found pro-
1 alongside simpler constructions (9c).
gressive complexification, especially from Levels
1 to 3, whereas no consistent differences were
observed at the clausal or NP level. These tenden- EXAMPLE 9
cies were observed for both languages and suggest (9a) mais ce soir le grenouille partir. (L2:
that learners at Level 1 are already past the basic level 1)
variety stage (cf. Klein & Perdue, 1997), and have but that evening the frog leave-INF
already mastered basic NP and clause structures (9b) but they do n(o)t find it. (L2: level 1)
(see Examples 8a and 8b). (9c) but they find him not. (L2: level 1)
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Bastien De Clercq and Alex Housen 329
While no statistically significant differences even more syntactically complex texts than in
were found between the learner groups for NP native English. The more advanced English
length in both languages, the French benchmark learners (and sometimes even beginning learn-
group scored significantly higher than the learner ers) achieved scores similar to the English native
groups, suggesting that the learners may have speakers’, which in turn tended to be lower than
mastered the basic NP structure but that devel- the scores of the French native speaker group.
opment at a more advanced level might involve Thus, if the English learners’ narratives tended
further NP complexification. This finding is in to be more syntactically complex than the French
line with previous findings that suggest a prefer- learners’ narratives, the inverse trend holds for
ence for phrasal elaboration in written French the native benchmark groups.
(cf. Cosme, 2007): It seems to hold for oral L2 As for our second research question, which
French as well. This higher complexity of the focuses on syntactic complexity as diversity, our
native speakers’ NPs is likely due to their higher simple diversity indices indicated a development
use of post-modification through relative clauses which parallels that of the syntactic elaboration
rather than through modification by preposi- measures. The strongest increases were observed
tional phrases and adjectives, which appear fre- for the two AS-unit measures (DivAS and SDI).
quently in the learner data as well: We also found a strong and statistically significant
difference in NP diversity between native speak-
EXAMPLE 10 ers and learners in French. In other words, na-
tive speakers seem to alternate more frequently
le petit garçon regarde en tout le maison. (L2 : between longer nominal structures (with post-
level 1) modifiers) and short NPs (determiner + noun):
the little boy looks in the whole house
il crie le nom de le grenouille. (L2: level 1)
EXAMPLE 11
he shouts the name of the frog
[mat] c’est {NP1: l’histoire d’un garcon
Turning to the supraclausal level, one may ex- it is the story of a boy
pect a considerable degree of collinearity between [fin-rel.] qui a reçu une grenouille}.
the length of AS-unit and the number of subordi- who got a frog.
nate clauses per AS-unit, in the sense that the use [mat] et alors avec {NP2: son chien} il la regarde.
of subordinate clauses will also affect the length (L1)
of the overarching AS-unit. Importantly, however, and he then looks at it with his dog.
AS-unit length may in theory also be affected by
the use of adjuncts at the clausal level or post- Additionally, English learners showed a strong
modification at the phrasal level. Yet, the lack of increase in AS-unit diversity (SDI) at early levels,
systematic differences between learner groups at even if intra-group variation for this measure
the clausal and NP level, on the one hand, and was high in all groups. Thus, if the increase in
the simultaneous increase of AS-unit length and AS-unit length was minor and not statistically
the number of clauses per AS-unit, on the other significant between Levels 1 and 2, the English
hand, indicate that the progressive complexifica- learners nonetheless combined more different
tion observed at the supraclausal level is mostly clause types.
caused by an increased reliance on subordinate Interestingly, minor increases were found for
clauses (from 1.08 to 1.43 clauses per AS-unit in clausal diversity in both languages (statistically
French and from 1.18 to 1.53 clauses per AS-unit significant between Level 1 and Levels 3 and
in English) rather than by changes at lower syn- 4), contrary to our results for clause length.
tactic levels. Thus, even if same-level measures tended to
The two languages mainly differ in the ten- indicate converging trends (e.g., for LenNP and
dency of learners to attain higher scores in En- DivNP), diversity and elaboration measures can
glish than in French, which is most pronounced still display different tendencies. One possible
for AS-unit length and clauses/AS-unit and the explanation for the increased diversity at the
least clear for NP length. The lower scores in clausal level is the increased use of (finite and
French may partly be explained by the compara- nonfinite) complement clauses, which results
tively lower overall proficiency level of the French in AS-units consisting of shorter main clauses
learner groups, rather than by typological differ- and longer complement clauses (Example 12a).
ences, especially since the benchmark data indi- The clause-length measure does not necessarily
cate that native speaker productions tend toward distinguish between such utterances as those
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
330 The Modern Language Journal 101 (2017)
in Example 12b, while AS-unit and diversity than most learners, but the native speakers’ use of
measures will pick up these differences. the different subordinate clause types is typically
situated between the scores of Levels 2 and 3, with
EXAMPLE 12 the difference between the native speakers and
the higher scores at Level 4 achieving statistical
(12a) LenC: 3.5 DivC: 2.12 LenAS:7 significance. Thus, while the syntactic elaboration
[mat] il pense measures indicate comparable levels of syntactic
he thinks
complexity in the more advanced learners’ pro-
[sub. comp. fin.] que c’est des branches.
(L2 : level 3)
ductions and the narratives from the L1 English
that they are branches. group, there is a strong tendency toward higher
(12b) LenC: 3.5 DivC: .71 LenAS:3.5 diversity in the learner group.
[mat] et il cherchE. A number of explanations could account for
and he search-INF. the lower diversity in the English benchmark
[mat] il tombe en arbre. (L2: level 1) data. It is possible that the English benchmark re-
he falls in tree. flects the fact that the narratives did not require
highly diverse language in order to be told effec-
Such examples may thus shed new light on so- tively. The increasing complexity in the learner
called ceiling effects in syntactic complexity at the groups would then be the result of a focus of
clausal level, since in certain cases clause length the language learning process on acquiring more
measures may conceal changes at the clausal level structures and using more complex language (cf.
that are captured by other measures. Lambert & Kormos, 2014), rather than an indi-
Turning to the distribution measures, these re- cation of increased effectiveness in performing
veal an important increase in subordinate clauses the task. In other cases, learners might rely on
in both languages, mainly of complement clauses, more syntactically complex paraphrases to over-
although all categories occur in the learner data come lexical problems, as can be seen in Exam-
from Level 2 onward. The measures also revealed ples 13a and 13b.
a number of differences between the two lan-
guages. The English learners relied more on
subordination than the French learners and this EXAMPLE 13
difference was most apparent for adverbial clauses (13a) [mat] There is a big animal with horns.
and nonfinite clauses. Moreover, while the pro- (L2: level 2)
portion of adverbial and relative clauses was low (13b) [mat] But there is a deer. (L2: level 4)
at Level 1 in English, they did not occur in any of
the French Level 1 narratives. The English learn- Alternatively, the age difference between the
ers also relied more extensively on coordinated native speaker benchmark and the advanced
clauses with ellipsis than the French learners, English learners might be such that the level
although high intra-group variation equally sug- of complexity in the L1 English group is not
gests considerable individual differences. Thus, representative of that of 17–18-year-old native
even within our restricted definition of clausal co- speakers of English.
ordination, our data seem to cautiously confirm In sum, the results of this study largely corrob-
previous findings (cf. Cosme, 2007) that both orate previous findings in that the French and
learners and native speakers rely more extensively English L2 learners both progressively use more
on coordination in English than in French. subordinate clauses and that this development is
The results from the benchmark groups are also accompanied by a diversification of formal
equally interesting. While the French learner and functional subordinate clause types, although
data suggest an increased use of subordinate few changes were observed at the level of the
clauses with proficiency, there nonetheless re- noun phrase and the clause in terms of syntactic
mains a considerable difference between the elaboration. The study revealed as well that learn-
most advanced learners (27.62%) and the native ers start using most clause types at relatively early
speakers (34.12%). This difference can mostly levels, although, especially in French, the main
be explained by the underuse of relative clauses differences between learners and native speakers
in all French learner groups, while the use of reside in the distribution of these categories.
complement clauses at Level 4 (18.34%) largely Since there was a tendency toward increased
coincided with native speaker usage (18.59%). elaboration and diversification at the group
In English, on the other hand, the benchmark level, regardless of the considerable overlap in
group relies considerably more on coordination the individual scores across all groups for most
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Bastien De Clercq and Alex Housen 331
measures, we were unable to confirm previously tic structures of different orders (e.g., clausal
formulated hypotheses that more advanced learn- embedding and negative structures) remains
ers use more syntactically simple language (cf. challenging and, if based on factors such as dif-
Lambert & Kormos, 2014). The generally lower ficulty or developmental timing, irreconcilable
complexity scores of the English benchmark with the absolute view on complexity advocated
group could be considered insightful in this re- by, for instance, Pallotti (2015).
gard, although it is debatable whether our group
of 9–11-year-old native speakers is representative CONCLUSION
of the ‘expert speakers’ discussed by Lambert
and Kormos (2014). This study aimed to enrich the current litera-
The results of this study have to be interpreted ture on linguistic and syntactic complexity in the
in light of a number of limitations. First, while L2 learning process by adopting a cross-linguistic
the learner groups covered a considerable part perspective. It proposed a systematic approach to
of the developmental spectrum, the study in- syntactic complexity that introduced a new set
cluded few if any absolute beginners, nor did it of measures tapping into complexity as syntactic
cover near-native learners. Hence, it is unclear diversity, alongside more traditional complexity
whether the learners of French in this study will measures that target complexity as syntactic elab-
continue along the path of syntactic elaboration oration, while at the same time tapping into the
and diversification to approach native speaker complexity of units at different levels of syntactic
levels. Moreover, the learners’ increased reliance analysis. While our results generally corroborate
on syntactically complex language could reflect those of previous studies, foregrounding the im-
their own cognitive and academic development portance of clause linking in the syntactic L2 de-
as the age of the participants varies from 12 to 18 velopment of both French and English, they also
years, and is thus not necessarily specific to the L2 pointed to the important role of the gradual di-
learning process. That is, an increase in complex- versification of structures. The study also opened
ity can be expected in the learners’ L1 (Dutch) up new research avenues, as future studies might
as well (Berman & Verhoeven, 2002), just like the extend the cross-linguistic comparison not only to
French and English benchmark groups will likely more typologically distant languages but also to
continue to develop in this respect. true beginner and very advanced stages of L2 de-
Second, care should also be taken when velopment and apply the notion of syntactic diver-
comparing the data across languages. While sity to longitudinal analyses.
we attempted to capture a similar range of
the developmental spectrum, no independent
cross-linguistically valid tool to assess proficiency NOTES
was used and future studies could rely on other
methods to capture the construct of proficiency 1 Length and subordination (or embedding) could
in a more nuanced or inclusive manner by, for arguably also be considered different forms of syntactic
example, not only focusing on productive skills complexity, but for the purpose of this article, we will re-
but also on receptive skills. Additionally, while fer to these as syntactic elaboration, which is contrasted
this study approached syntactic complexity using with syntactic diversification.
2 This measure thus represents the standard deviation
an arguably elaborate set of measures, concerns
of unit length in each individual performance and is not
about concept reductionism and the opacity of
to be confused with the more commonly used within-
complexity measures may still persist. Concerns group standard deviation. For a similar use of this mea-
about the validity of length-based measures, both sure, see Byrnes et al. (2010).
mean length of syntactic unit and the variation 3 While this tool was originally developed for morpho-
thereof, may also remain legitimate since these logical analyses, it equally functions with custom labels,
measures tap holistically into linguistic surface such as our syntactic codes. For more details on the tool,
phenomena and reveal little about what exactly see Brezina & Pallotti (2015, 2017) and Pallotti (2015).
happens linguistically. In this study, these issues
were partly remedied by using simple complexity
indices alongside a more descriptive set of clause- REFERENCES
distribution measures. Other studies (typically in
L1 acquisition; cf. Botel, Dawkins, & Grabowsky, Ågren, M., Granfeldt, J., & Schlyter, S. (2012). The
1973; Scarborough, 1990) have considered syn- growth of complexity and accuracy in L2 French:
tactic complexity in greater detail, although Past observations and recent applications of de-
the attribution of complexity weights to syntac- velopmental stages. In A. Housen, F. Kuiken, &
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
332 The Modern Language Journal 101 (2017)
I. Vedder (Eds.), Dimensions of L2 performance and Fleury (Eds.), Actes des 12es Journées Internationales
proficiency: Complexity, accuracy and fluency in SLA d’Analyse Statistique des Données Textuelles (pp. 529–
(pp. 95–120). Philadelphia/Amsterdam: John 538). Paris.
Benjamins. Buysse, M., Housen, A., & Pierrard, M. (2017).
Bartning, I., & Kirchmeyer, N. (2003). Le développe- The development of complex sentences in sec-
ment de la compétence textuelle à travers les ond language acquisition—A crosslinguistic study
stades acquisitionnels en français L2 [The devel- of French and English. Studia Linguistica. doi:
opment of textual competence across the acquisi- 10.2137/0269258316679371
tion stages of L2 French]. Acquisition et interaction Byrnes, H. (2009). Emergent L2 German writing abil-
en langue étrangère, 19, 9–39. ity in a curricular context: A longitudinal study of
Bartning, I., & Schlyter, S. (2004). Itinéraires acquisi- grammatical metaphor. Linguistics and Education,
tionnels et stades de développement en français 20, 50–66.
L2 [Acquisition routes and developmental stages Byrnes, H., Maxim, H., & Norris, J. M. (2010). Realizing
in L2 French]. Journal of French Language Studies, advanced FL writing development in collegiate ed-
14, 281–299. ucation: Curricular design, pedagogy, assessment.
Beaman, K. (1984). Coordination and subordination re- Modern Language Journal, 94 (Supplement 2010),
visited: Syntactic complexity in spoken and writ- iv–vi, 1–235.
ten narrative discourse. In D. Tannen (Ed.), Cosme, C. (2007). Clause linking across languages. A
Coherence in spoken and written discourse (pp. 45–80). corpus-based study of coordination and subordination in
Norwood, NJ: Ablex. English, French and Dutch. (Unpublished doctoral
Benazzo, S., & Starren, M. (2007). L’émergence de dissertation). Université Catholique de Louvain,
moyens grammaticaux pour exprimer les relations Louvain-la-Neuve, Belgium.
temporelles en L2 [The emergence of grammati- Crossley, S. A., Louwerse, M. M., McCarthy, P. M., & Mc-
cal resources to express temporal relations in the Namara, D. S. (2007). A linguistic analysis of sim-
L2]. Acquisition et interaction en langue étrangère, 25, plified and authentic texts. Modern Language Jour-
129–157. nal, 91, 15–30.
Berman, R. A., & Verhoeven, L. (2002). Cross- Dahl, Ö. (2009). Testing the assumption of complex-
linguistic perspectives on the development ity invariance: The case of Elfdalian and Swedish.
of text-production abilities: Speech and writing. In G. Sampson, D. Gil, & P. Trudgill (Eds.), Lan-
Written Language & Literacy, 5, 1–43. guage complexity as an evolving variable (pp. 50–63).
Biber, D., & Gray, B. (2010). Challenging stereotypes Oxford: Oxford University Press.
about academic writing: Complexity, elaboration, De Clercq, B. (2015). The development of lexical com-
explicitness. Journal of English for Academic Purposes, plexity in second language acquisition: A cross-
9, 2–20. linguistic study of L2 French and English. EuroSLA
Biber, D., Gray, B., & Poonpon, K. (2011). Should we use Yearbook, 15, 69–94.
characteristics of conversation to measure gram- De Clercq, B., & Housen, A. (2016). The development of
matical complexity in l2 writing development? morphological complexity: A comparative study of
TESOL Quarterly, 45, 5–35. L2 French and English. Second Language Research.
Botel, M., Dawkins, J., & Granowsky, A. (1973). A syntac- doi:10.1177/0267658316674506
tic complexity formula. In W. H. MacGinitie (Ed.), Doherty, M. (2005). Introduction: Language-specific
Assessment problems in reading (pp. 77–86). Newark, conditions for discourse linking and appropriate-
DE: International Reading Association. ness. Linguistics, 43, 1–15.
Brezina, V., & Pallotti, G. (2015). Morphological com- Ehret, K., & Szmrecsanyi, B. (2016). An information-
plexity tool. Accessed 20 June 2016 at http:// theoretic approach to assess linguistic complexity.
corpora.lancs.ac.uk/vocab/analyse_morph.php In R. Baechler & G. Seiler (Eds.), Complexity and
Brezina, V., & Pallotti, G. (2017). Morphological com- isolation (pp. 71–94). Berlin: De Gruyter Mouton.
plexity in written ESL texts. Second Language Ellis, R. (2009). The differential effects of three types
Research. of task planning on the fluency, complexity, and
Bulté, B., & Housen, A. (2012). Defining and op- accuracy in L2 oral production. Applied Linguistics,
erationalising L2 complexity. In A. Housen, 3, 474–509.
F. Kuiken, & I. Vedder (Eds.), Dimensions of Ellis, R., & Barkhuizen, G. P. (2005). Analysing learner lan-
L2 performance and proficiency: Complexity, accu- guage. Oxford: Oxford University Press.
racy and fluency in SLA (pp. 21–46). Philadel- Ellis, R., & Yuan, F. (2004). The effects of planning on
phia/Amsterdam: John Benjamins. fluency, complexity and accuracy in second lan-
Bulté, B., & Housen, A. (2014). Conceptualizing and guage narrative writing. Studies in Second Language
measuring short-term changes in L2 writing com- Acquisition, 28, 50–84.
plexity. Journal of Second Language Writing, 26, 42– Fenk–Oczlon, G., & Fenk, A. (2008). Complexity trade-
65. offs between the subsystems of language. In M. Mi-
Buysse, M., & De Clercq, B. (2014). Matching the data: estamo, K. Sinnemäki, & F. Karlsson (Eds.), Lan-
Developing a multilingual corpus of language de- guage complexity: Typology, contact, change (pp. 43–
velopment. In E. Née, J. M. Daube, M. Valette, & S. 66). Philadelphia/Amsterdam: John Benjamins.
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Bastien De Clercq and Alex Housen 333
Fenk–Oczlon, G., & Fenk, A. (2014). Complexity trade- task performance. Language Learning, 62, 439–
offs do not prove the equal complexity hypothesis. 472.
Poznán Studies in Contemporary Linguistics, 50, 145– Kuiken, F., & Vedder, I. (2007). Task complexity and
155. measures of linguistic performance in L2 writing?
Ferrari, S. (2012). A longitudinal study of complex- International Review of Applied Linguistics in Lan-
ity, accuracy and fluency variation in second lan- guage Teaching (IRAL), 45, 261–284.
guage development. In A. Housen, F. Kuiken, & Kuiken, F., & Vedder, I. (2012). Syntactic complexity,
I. Vedder (Eds.), Dimensions of L2 performance and lexical variation and accuracy as a function of task
proficiency: Complexity, accuracy and fluency in SLA complexity and proficiency level in L2 writing and
(pp. 277–298). Philadelphia/Amsterdam: John speaking. In A. Housen, F. Kuiken, & I. Vedder
Benjamins. (Eds.), Dimensions of L2 performance and proficiency:
Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Mea- Complexity, accuracy and fluency in SLA (pp. 143–
suring spoken language: A unit for all reasons. Ap- 170). Philadelphia/Amsterdam: John Benjamins.
plied Linguistics, 21, 354–375. Lambert, C., & Kormos, J. (2014). Complexity, accuracy,
Graesser, A. C., McNamara, D. S., Louwerse, M. M., & and fluency in task-based L2 research: Toward
Cai, Z. (2004). Coh-Metrix: Analysis of text on more developmentally based measures of second
cohesion and language. Behavior Research Methods, language acquisition. Applied Linguistic, 35, 606–
Instruments, & Computers, 36, 193–202. 614.
Gunnarsson, C. (2012). The development of complex- Larsen–Freeman, D. (2006). The emergence of com-
ity, accuracy and fluency in the written production plexity, fluency, and accuracy in the oral and writ-
of L2 French. In A. Housen, F. Kuiken, & I. Vedder ten production of five Chinese learners of English.
(Eds.), Dimensions of L2 performance and proficiency: Applied Linguistics, 27, 590–619.
Complexity, accuracy and fluency in SLA (pp. 247– Lu, X. (2010). Automatic analysis of syntactic complex-
276). Philadelphia/Amsterdam: John Benjamins. ity in second language writing. International Journal
Han, Z., & Lew, W. M. (2012). Acquisitional complexity: of Corpus Linguistics, 15, 474–496.
What defies complete acquisition in second lan- Lu, X. (2011). A corpus-based evaluation of syntactic
guage acquisition. In B. Kortmann & B. Szmrec- complexity measures as indices of college-level
sanyi (Eds.), Linguistic complexity: Second language ESL writers’ language development. TESOL Quar-
acquisition, indigenization, contact (pp. 192–217). terly, 45, 36–62.
Berlin: De Gruyter Mouton. MacWhinney, B. (2000). The CHILDES Project: Tools for
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, analyzing talk. Mahwah, NJ: Lawrence Erlbaum.
and fluency in second language acquisition. Ap- Malvern, D., Richards, B. J., Chipere, N., & Duran, P.
plied Linguistics, 30, 461–473. (2004). Lexical diversity and language development:
Housen, A., Kuiken, F., & Vedder, I. (2012). Complexity, Quantification and assessment. Basingstoke, UK: Pal-
accuracy and fluency: Definitions, measurement grave Macmillan.
and research. In A. Housen, F. Kuiken, & I. Vedder Martin, M., Mustonen, S., Reiman, N., & Seilonen, M.
(Eds.), Dimensions of L2 performance and proficiency: (2010). On becoming an independent user. In I.
Complexity, accuracy and fluency in SLA (pp. 1–20). Bartning, M. Martin, & I. Vedder (Eds.), Commu-
Philadelphia/Amsterdam: John Benjamins. nicative proficiency and linguistic development: intersec-
Housen, A., & Simoens, H. (2016). Cognitive perspec- tions between SLA and language testing research (pp.
tives on difficulty and complexity in L2 acqui- 57–80). Amsterdam: EuroSLA.
sition. Studies in Second Language Acquisition, 38, Mayer, M. (1969). Frog, Where are you? New York: Dial
163–175. Press.
Hunt, K. (1965). Grammatical structures written at three Michel, M. C., Kuiken, F., & Vedder, I. (2007). The influ-
grade levels. NCTE Research report No. 3. Cham- ence of complexity in monologic versus dialogic
paign, IL: NCTE. tasks in Dutch L2. International Review of Applied
IBM. (2015). IBM SPSS Statistics (Version 23.0). Linguistics, 45, 241–259.
Iwashita, N., Brown, A., McNamara, T., & O’Hagan, S. Miestamo, M. (2008). Grammatical complexity in a
(2008). Assessed levels of second language speak- cross-linguistic perspective. In M. Miestamo, K.
ing proficiency: How distinct? Applied Linguistics, Sinnemäki, & F. Karlsson (Eds.), Language complex-
29, 24–49. ity: Typology, contact, change (pp. 23–41). Philadel-
Jarvis, S. (2013). Capturing the diversity in lexical diver- phia/Amsterdam: John Benjamins.
sity. Language Learning, 63, 87–106. Miestamo, M. (2009). Implicational hierarchies and
Kerr–Barnes, B. (1998). The acquisition of connectors grammatical complexity. In G. Sampson, D. Gil, &
in French L2 narrative discourse. Journal of French P. Trudgill (Eds.), Language complexity as an evolv-
Language Studies, 8, 189–208. ing variable (pp. 80–97). Oxford: Oxford Univer-
Klein, W., & Perdue, C. (1997). The Basic Variety (or: sity Press.
Couldn’t natural languages be much simpler?). Neff, J., Dafouz, E., Diez, M., Prieto, R., & Chaudron,
Second Language Research, 13, 301–347. C. (2004). Constrastive discourse analysis: Argu-
Kormos, J., & Trebits, A. (2012). The role of task mentative text in English and Spanish. In C.
complexity, modality, and aptitude in narrative Moder & A. Martinovic–Zic (Eds.), Discourse across
15404781, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/modl.12396 by Cochrane Japan, Wiley Online Library on [19/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
334 The Modern Language Journal 101 (2017)
languages and cultures (pp. 267–283). Philadel- B. Szmrecsanyi (Eds.), Linguistic complexity: Second
phia/Amsterdam: John Benjamins. language acquisition, indigenization, contact (pp. 6–
Norris, J. M., & Ortega, L. (2009). Towards an organic 34) Berlin: De Gruyter Mouton.
approach to investigating CAF in instructed SLA: Towell, R. (2012). Complexity, accuracy and fluency
The case of complexity. Applied Linguistics, 30, from the perspective of psycholinguistic second
555–578. language acquisition research. In A. Housen,
Ortega, L. (2003). Syntactic complexity measures and F. Kuiken, & I. Vedder (Eds.), Dimensions of L2
their relationship to L2 proficiency: A research performance and proficiency: Complexity, accu-
synthesis of college-level L2 writing. Applied Lin- racy and fluency in SLA (pp. 47–69). Philadel-
guistics, 24, 492–518. phia/Amsterdam: John Benjamins.
Ortega, L. (2012). Interlanguage complexity: A con- Véronique, D. (Ed.). (2009). L’acquisition de la grammaire
struct in search of theoretical renewal. In B. Kort- du français, langue étrangère. Paris: Didier.
mann & B. Szmrecsanyi (Eds.), Linguistic complex- Verspoor, M., Schmid, M. S., & Xu, X. (2012). A dynamic
ity: Second language acquisition, indigenization, con- usage-based perspective on L2 writing. Journal of
tact (pp. 127–155). Berlin: De Gruyter Mouton. Second Language Writing, 21, 239–263.
Pallotti, G. (2009). CAF: Defining, refining and differen- Vyatkina, N. (2012). The development of second lan-
tiating constructs. Applied Linguistics, 30, 590–601. guage writing complexity in groups and individ-
Pallotti, G. (2015). A simple view of linguistic complex- uals: A longitudinal learner corpus study. Modern
ity. Second Language Research, 31, 117–134. Language Journal, 96, 576–598.
Perdue, C. (Ed.), (1993). Adult language acquisition: Vyatkina, N. (2013). Specific syntactic complexity: De-
Cross-linguistic perspectives. Volume 2. The results. velopmental profiling of individuals based on an
Cambridge: Cambridge University Press. annotated learner corpus. Modern Language Jour-
Salamoura, A., & Saville, N. (2010). Exemplifying the nal, 97 (Supplement 2013), 11–30.
CEFR: Criterial features of written learner English Welcomme, A. (2013). Connecteurs et complexité syn-
from the English Profile Programme. In I. Bart- taxique dans les récits d’apprenants néerlando-
ning, M. Martin, & I. Vedder (Eds.), Communica- phones de FLE: Premiers résultats [Connectors
tive proficiency and linguistic development: Intersections and syntactic complexity in the narratives of
between SLA and language testing research (pp. 101– Dutch learners of L2 French]. In U. Paprocka–
131). Amsterdam: EuroSLA. Piotrowska, C. Martinot, & S. Gerolimich (Eds.),
Scarborough, H. S. (1990). Index of productive syntax. La complexité en langue et son acquisition (pp. 261–
Applied Psycholinguistics, 11, 1–22. 284). Lublin Poland: Towarzystwo Naukowe Kul
Schleppegrell, M. J. (1992). Subordination and linguis- Katolicki Uniwersytet Jana Pawla II.
tic complexity. Discourse Processes, 15, 117–131. Wolfe–Quintero, K., Inagaki, S., & Kim, H.–Y. (1998).
Szmrecsanyi, B. (2004, March). On operationalizing syn- Second language development in writing: Measures of
tactic complexity. Paper presented at the Journées fluency, accuracy, and complexity. Honolulu, HI: Na-
Internationales d’Analyse statistique des Données tional Foreign Language Resource Center.
textuelles, 2004. Louvain-la-Neuve, Belgium. Yoon, H.–J., & Polio, C. (2016). The linguistic develop-
Szmrecsanyi, B., & Kortmann, B. (2012). Introduction: ment of students of English as a second language
Linguistic complexity: Second Language acquisi- in two written genres. TESOL Quarterly. Early View
tion, indigenization, contact. In B. Kortmann & 6 May 2016; doi:10.1002/tesq.296