Qualitative Characteristics of Coherence, Substitution, and Reference by Non-English Major Chinese Students
Qualitative Characteristics of Coherence, Substitution, and Reference by Non-English Major Chinese Students
Qualitative Characteristics of Coherence, Substitution, and Reference by Non-English Major Chinese Students
org/elt
104
English Language Teaching Vol. 3, No. 2; June 2010
105
English Language Teaching www.ccsenet.org/elt
106
English Language Teaching Vol. 3, No. 2; June 2010
medical university students inferred from the results of several statistical tests, such as a t-test, Pearsons
correlation test, and nonparametric Wilcoxon test?
(2) Are there any similarities and differences between coherence, substitution, and reference based on gender
differences?
5.2 Research objective
The main objective of the questionnaire used for this study is to determine whether there is a relationship
between coherence, substitution, and reference by non-English major Chinese undergraduate students. In other
words, I want to understand if coherence has an influential role in substitution and reference or vice versa. Based
on this notion, I asked thirty participants to complete the questionnaire that I previously designed, for which the
knowledge of coherence, substitution, and reference is necessary for the participants to finish this questionnaire.
The final score is calculated by using a ten-point rating system.
5.3 Research participants
An important consideration for this study was the university context for the research. The main participants in
this study are non-English major Chinese students. Specifically, thirty medical university students (i.e., 14 males
and 16 females) were randomly selected as participants for this study. Their ages range from twenty-one to
twenty-two and they have studied English for twelve to fourteen years. All of them are monolingual and their
native language is Chinese.
Compared with data collected from secondary school students learning English in China, data is preferred from
non-English major undergraduate students. This is because it is difficult for secondary school students in China
to answer the questionnaire that I designed for this study, especially to answer the question related to coherence.
In China, knowledge of textual coherence in English is not taught to secondary school students as a grammar
item.
The participants were allowed to answer the questionnaire either in the classroom or outside of class.
Nevertheless, the participants were asked to limit their time answering the questionnaire to 90 minutes. They
were not allowed to rely on a dictionary to complete the questionnaire.
5.4 Research method
I calculated the total number of correct answers to the questionnaire by all of the participants in this study and
then placed the total correct answer scores into SPSS 17, which was used to conduct a Pearsons correlation test,
t-test, and nonparametric Wilcoxon test in order to evaluate what I want to know about the relationship between
coherence, substitution, and reference as used by non-English major Chinese students.
6. Findings
The following answers can be derived from research question one.
First, from the mean correct responses to questions one through three listed in the questionnaire by the
participants, I noticed that the subjects in this study received the highest scores in the use of reference, with the
mean reference scores reaching 6.72, while the mean scores of coherence were 0.61 and those of substitution
were 5.56. Table 1 displayed the detailed information.
Second, no correlations were found between coherence, substitution, and reference for the answers to questions
one through three by non-English major Chinese students in this study. To explain this in greater detail, the
Pearsons correlation coefficient (r) is 0.43 between substitution and reference, 0.42 between coherence and
reference, and 0.40 between coherence and substitution respectively. However, the correlation between
substitution and reference is stronger (i.e., r = 0.43) in comparison to the correlation between coherence and
reference (i.e., r = 0.42), and between coherence and substitution (i.e., r = 0.40). Please refer to Table 2 for
detailed correlations.
Third, with respect to the results of the t-test for all of the subjects in this study, no mean difference was
observed between substitution and reference (t = 1.6, p = 0.12), whereas an obvious mean difference appears
between coherence and substitution (t = -16.1, p = 0.000**) and between coherence and reference (t = -8.5, p =
0.000**) at the level of 1%. Please see Table 3 for the results of the t-test.
Fourth, according to the results of the nonparametric Wilcoxon test shown in Table 4, significant median
differences were clearly seen between coherence and substitution and between coherence and reference, yet no
obvious differences were observed between substitution and reference.
Besides the above results, we must consider the results of coherence, substitution, and reference based on gender
107
English Language Teaching www.ccsenet.org/elt
108
English Language Teaching Vol. 3, No. 2; June 2010
participants can receive, the more likely the participants would get relatively high scores on reference. At the
same time, this suggests that all of the participants may have nearly the same tendencies in the use of substitution
and reference, compared with that of coherence and substitution, and that of coherence and reference. In sum,
what we can learn from the results of our data analysis is that non-English major Chinese students
understanding of substitution has significant effects on their use of reference.
8. Conclusions and pedagogical implications
In the light of the above findings it should be clear that to report the results of this study by saying that although
this study is not an extensive one, the results suggest certain pragmatic directions that teachers might profitably
follow.
First of all, the participants got the lowest scores on question one in the questionnaire, which most directly
requires the knowledge of coherence. To state it more clearly, of the thirty participating subjects in this study,
twenty-one got a score of zero on the first question in the questionnaire. This means 70% of the participants were
confirmed not to have any knowledge about how to produce a coherent passage by uniting several individual
incoherent sentences into a coherent one. Therefore, teachers should more highly prioritize the effective teaching
of coherence in the future.
Because coherence seems to continue to be a difficult concept for non-English majors, it would be worthwhile to
conduct in-depth case studies to find out what actually occurs in the minds of the writers as they employ
coherence-creating mechanisms in writing. In other words, further research should be implemented to explore
coherence as a property of the mind of the writers through think-aloud protocols.
In addition, given the importance of grammar in learning English as a foreign language, the relationship between
the teaching of coherence and grammar may provide another interesting area for future research.
Furthermore, as shown in previous studies on the relationship between coherence and cohesion (Widdowson
1973; Carrell 1982; Fitzgerald 1990; Enkvist 1990; Oller 1994; & Chau 1999), I realized some researchers
claimed that there is a close relationship between coherence and cohesion (Widdowson 1973; Fitzgerald 1990; &
Chau 1999), whereas others (Carrell 1982; Enkvist 1990; & Oller 1994) ignored such kind of correlation
between coherence and cohesion. In this study I have successfully underscored that a true correlation between
coherence, substitution and reference does exist, which has been supported by this studys data analyses via
several statistical evaluations. Therefore, the result of this study can be thought of as having added a component
to the existing literature in elaborating on the relationship between coherence and cohesion, which was detected
by means of making a questionnaire survey of non-English major Chinese students. As a result of this, the future
teaching and learning of English as a foreign language can be recommended to be implemented without
neglecting to take a teaching and learning of coherence and cohesion into a specific consideration. In other
words, the findings of this study may provide information to help instructors to think out better teaching methods
and techniques and learners to find more efficient ways to master English from discourse analysis.
9. Limitations of this study
This study only deals with how to clarify the characteristics and relationship between coherence, substitution and
reference. Whether this result based on non-English major Chinese students is applicable in practical English
language teaching for general English learners in China as well as in other Asian countries (e.g., Japan or Korea)
will be worth investigating in the future.
In addition, thirty non-English major Chinese undergraduate students participated in my research. The total
number of the participants in this study is relatively small. The results obtained from this research could
therefore result in some implications for future English language teaching, but it is far from a comprehensive
study. In future research much more data should be collected in order to elaborate on a more substantial study of
the teaching and learning of coherence, substitution, and reference.
In future research, not only should the perception of coherence, substitution and reference be handled out, studies
should also include other elements of coherence and cohesion (e.g., lexical cohesion, ellipsis, and conjunctions).
10. Future research subjects
One of my hopeful future research subjects is considered to apply the findings of this study to other foreign
language learning environments such as Japan or Korea in order to find comparatively common characteristics in
the use of coherence, substitution, and reference by Asian non-native English speakers. In addition to this, many
other questionnaires different from those used in this study should be taken into consideration. For example, in
order to analyze possible problems existing in coherence performance by the participants, STAR 2 can be tried to
109
English Language Teaching www.ccsenet.org/elt
be integrated into the analysis of coherence, especially into the topic structure analyses 3 that are closely related
to coherence.
Acknowledgments
I want to thank Professor Huang Jiang at Guangxi Medical University, China, who distributed the questionnaire
for me to non-English major Chinese medical university undergraduate students for the purpose of this studys
data collection.
References
Bain, A. (1890). English composition and rhetoric. London:Longmans, Green.
Biber, D., Contad, S., & Reppen, R. (1998). Corpus linguistics: Investigating language structure and use.
Cambridge, England: Cambridge University Press.
Bloor, M., & Bloor, T. (1995). The Functional Analysis of English: A Hallidayan Approach. London: Arnold.
Brown, G., & Yule, Y. (1983). Discourse analysis. Cambridge: Cambridge University Press.
Carrell, P.L. (1982). Cohesion is not coherence. TESOL Quarterly 16, 479-488.
Chau, H.H. (1999). Cohesion and coherence in translation theory and pedagogy. Word-Journal of the
International Linguistic Association 50, 33-46, 1999.
Connor, Ulla M. (1984a). A study of cohesion and coherence in English as a second language students writing.
Papers in linguistics International Journal of Human Communication 17, 301-316.
Connor, Ulla M. (1996). Contrastive Rhetoric: Cross-Cultural Aspects of Second-language Writing. The
Cambridge Applied Linguistics Series.
de Beaugrande, R. (1980). Text, discourse and process. Hilldale, NJ:Lawrence Erlbaum.
de Beaugrande, R., & Dressler, W. (1981). Introduction to text linguistics. London: Longman.
Dubois, B.L., & Crouch, I. (1975). The question of tag questions in womens speech: They dont really use more
of them, do they? Language in Society 4 (3), 289-294.
Enkvist, N.E. (1985). Coherence and composition: A symposium. Publications of the Research Institute of the
Abo Akademi Foundation 101. Abo. Finland: Abo Akademi.
Enkvist, N.E. (1990). Seven problems in the study of coherence and interpretability. In U. Connor & A.M. Johns
(eds.), Coherence in writing: Research and pedagogical perspectives (pp. 9-28). Alexandria, VA: Teachers of
English to Speakers of Other Languages.
Fitzgerald, G. (1990). Using the computer with students with emotional and behavioral disorders. Tech use
guide: Using computer technology. Reston, V.A. The Council for Exceptional Children.
Gleser, G. C., Gottschalk, L.A., & John, W. (1959). The relationship of sex and intelligence to choice of words:
A normative study of verbal behavior. Journal of Clinical Psychology 15, 183-191.
Hadley, I. L. (1987). Understanding CohesionSome Practical Teaching Implications. Literacy 21 (2),
106114.
Halliday, M.A.K., & Hasan, R. (1976). Cohesion in English. London: Longman.
Kintsch, W., & van Dijk, T. (1978). Toward a model of text comprehension and production. Psychological
Review 85, 363-394.
Labov, W. (1970). The study of language in its social context. Studium Generale 23, 30-87.
Lakoff, R. (1975). Language and womans place. New York: Harper Colophon Books.
Lautamatti, L. (1987). Observation on the development of the topic in simplified discourse. in U. Connor & R.B.
Kaplan (Eds.), Writing across languages: analysis of L2 test (pp. 92-126). Reading, MA: Addison-Wesley.
McMillan, J.R., Clifton, A.K., McGrath, D., & Gale, W.S. (1977). Womens language: uncertainty or
interpersonal sensitivity and emotionality? Sex Roles 3, 545-559.
Mulac, A., & Lundell, T.L. (1986). Linguistic contributors to the gender-linked language effect. Journal of
Language & Social Psychology 5, 81-101.
Oller, J.W. (1994). Cloze, discourse and approximations to English. In: J.W. Oller Jr. and J. Jonz, Editors, Cloze
and coherence, Bucknell University Press, Cranbury, NJ (1994), pp. 119133.
110
English Language Teaching Vol. 3, No. 2; June 2010
Phelps, L.W. (1985). Dialects of coherence: Toward and integrated theory. College English 47, 12-19.
Shen, Y. (2008a). Characteristics of Reference Cohesion in Writing by Chinese Non-English Majors.
International Cultural Studies 14, 2008, pp: 197-210.
Shen, Y. (2008b). Understanding Substitutions and Ellipses Used by Non-native English Learners: Some
Practical Teaching Implications. Tohoku English Language Education Studies 28, 2008, pp: 49-60.
Widdowson, H.G. (1973). An Applied Linguistic Approach to Discourse Analysis. Unpublished Ph.D. Thesis,
Department of Linguistics, University of Edinburgh, May 1973.
Notes
Note 1. Discourse is a communicative event in which language plays a prominent role. It minimally requires a
sender (writer, speaker), a receiver (reader, listener), and a message that is being communicated. The message is
not just a concatenation of clauses; it forms a unified, coherent whole. Both the sender and receiver normally
have the implicit agreement that the message being communicated is coherent.
Note 2. STAR is used to teach coherence. It was developed using a basic system model. In this model, the
objectives and the scope of the project are defined first. Next, the lesson is designed using principles and
techniques derived from learning theory and research. An instructional product is then developed based on the
design requirements. The product is tested to see if it meets its objectives, the necessary revisions are made.
Note 3.Topic structure analyses, originally developed by Lautamatti (1987) for the purpose of describing
coherence in texts, focuses on the semantic relation between the sentence topics and the discourse topic,
analyzing the relation of topic and comment in sentences.
Appendix: Questionnaire
Question 1: Using what you have learnt in this unit, rearrange each group of the following sentences, so as to
make it a coherent paragraph.
(1) A. Of the effects caused by vitamin A deficiency, those involving eye diseases are the most pronounced
and widespread.
B. Another result of vitamin A deficiency is skin dryness.
C. What children eat can affect their health.
D. Several thousand children become blind each year because of this dietary deficiency, which is most prevalent
in poor, non-industrialized countries.
E. Children who do not eat enough foods containing vitamin A can develop serious nutritional disorders.
(2) A. So, even at their middle age, they were as ignorant as children, and could hardly support themselves, not
to speak of rendering valuable service to their country.
B. Some of them did not continue their course to the end for fear of difficulties, while others, having studied for
some years, grew tired of their lessons, and tried to pursue some new studies.
C. In one word, they did not endeavor to reach their destination, but stopped halfway.
D. I have heard that many students failed because they stopped halfway.
E. Their time and strength were thus wasted.
(3) A. The kiwi deserves to become much better known in America.
B. I found a rare treat in our supermarket todaya kiwi!
C. Its appearance makes it look rather unappetizing, but the kiwi has a slightly tart, melon-like pulp that most
people enjoy from the first bite.
D. A kiwi is a kind of fruit that is imported from faraway New Zealand.
E. About the size of a lemon, it has a distinctive golden-brown skin coated with a light fuzz.
(4) A. When Professor Adams returned to the college this fall, we noticed several changes in his appearance.
B. Instead of shoes he wore leather sandals.
C. His hair was combed forward over his forehead.
D. His coats were brighter in color than they used to be.
E. On his upper lip grew a small moustache.
111
English Language Teaching www.ccsenet.org/elt
Table 1. Mean and standard deviation (SD) of all the participants calculated from their scores on questions one
through three listed in the questionnaire
Coherence Substitution Reference
Mean 0.61 5.56 6.72
Standard deviation (SD) 0.85 1.38 3.32
Table 2. Correlation matrix of all of the participants calculated from their scores on questions one through three
listed in the questionnaire
Coherence Substitution Reference
Coherence 1 0.40 0.42
Substitution 0.40 1 0.43
Reference 0.42 0.43 1
112
English Language Teaching Vol. 3, No. 2; June 2010
Table 3. Results of the t-test for all the participants calculated from their scores on questions one through three
listed in the questionnaire
N Mean Std. deviation t-value 2-Tailed probability
Coherence vs. substitution 30 -4.9 1.3 -16.1 0.000**
Coherence vs. reference 30 -6.1 3.1 -8.5 0.000**
Substitution vs. reference 30 -1.2 3 -1.6 0.12
**The difference is significant at the 1% level.
Table 4. Results of the nonparametric Wilcoxon test for all of the participants obtained from their scores on
questions one through three listed in the questionnaire
Z 2-Tailed probability
Coherence vs. substitution -3.749 0.000**
Coherence vs. reference -3.532 0.000**
Substitution vs. reference -1.546 0.122
**The difference is significant at the 1% level.
Table 5. Mean scores (MS) and the standard deviation (SD) of the two genders calculated from their scores on
questions one through three listed in the questionnaire
Coherence Substitution Reference
Mean scores (MS) for males 0.5 5.83 6.83
Mean scores (MS) for females 0.83 5 6.5
Standard deviation (SD) (males) 0.80 1.47 3.34
Standard deviation (SD) (females) 0.98 1.10 3.78
Table 6. Correlation matrix of the male participants calculated from their scores on questions one through three
listed in the questionnaire
Coherence Substitution Reference
Coherence 1 0.777** 0.387
Substitution 0.777** 1 0.491
Reference 0.387 0.491 1
**The difference is significant at the 1% level.
Table 7. Correlation matrix of the female participants calculated from their scores on questions one through three
listed in the questionnaire
Coherence Substitution Reference
Coherence 1 -0.186 0.511
Substitution -0.186 1 0.34
Reference 0.511 0.34 1
Table 8: Results of the t-test for the male participants calculated from their scores on questions one through three
listed in the questionnaire
N Mean Standard deviation t-value 2-Tailed probability
Coherence vs. substitution 14 -5.33 0.98 -18.76 0.000**
Coherence vs. reference 14 -6.33 3.02 -7.25 0.000**
Substitution vs. reference 14 -1.00 2.83 -1.23 0.25
**The difference is significant at the 1% level.
113
English Language Teaching www.ccsenet.org/elt
Table 9. Results of the nonparametric Wilcoxon test for the male participants obtained from their scores on
questions one through three listed in the questionnaire
Z 2-Tailed probability
Coherence vs. substitution -3.105 0.002**
Coherence vs. reference -2.946 0.003**
Substitution vs. reference -1.209 0.227
**The difference is significant at the 1% level.
Table 10. Results of the t-test of the female participants calculated from their scores on questions one through
three listed in the questionnaire
N Mean Standard deviation t-value 2-Tailed probability
Coherence vs. substitution 16 -4.16 1.60 -6.37 0.001**
Coherence vs. reference 16 -5.67 3.39 -4.10 0.009*
Substitution vs. reference 16 -1.50 3.56 -1.03 0.35
** The difference is significant at the 1% level.
*The difference is significant at the 5% level.
Table 11. Results of the nonparametric Wilcoxon test for the female participants obtained from their scores on
questions one through three listed in the questionnaire
Z 2-Tailed probability
Coherence vs. substitution -2.214 0.027*
Coherence vs. reference -2.032 0.042*
Substitution vs. reference -1.054 0.292
* The difference is significant at the 5% level.
114