Comprehension Assessment Instrument
Comprehension Assessment Instrument
net/publication/270580077
CITATIONS READS
3 767
2 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Donna Caccamise on 01 October 2015.
Acknowledgement: The work on this paper has been supported, in part, by The McDonnell Foundation, award #16084757L to the lead author. Any opinions, conclusions, and
recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the McDonnell Foundation.
The International Dyslexia Association Perspectives on Language and Literacy Spring 2009 23
Comprehension Processes continued from page 23
1 Scaled research is when the well-developed educational intervention is tested in many, diverse classrooms to determine whether, the intervention that worked so well in a
laboratory setting or just a couple of monitored classrooms, will work as well in any classroom without researcher support.
24 Perspectives on Language and Literacy Spring 2009 The International Dyslexia Association
by teaching better summarization skills. These teachers, after the textbase and situation model for the lesson’s text. The pro-
all, had state and district mandated instructional goals by gram uses discussion, graphic organizers, the application of
which they were specifically evaluated. Their teaching perfor- knowledge, and writing to do this. As the students work their
mance was judged by how well their students learned to sum- way through the chapters, they build content knowledge right
marize. Our research objectives, however, also led us to con- along with skills in the use of comprehension strategies.
stantly strive to “infiltrate” content area classes with our sum- • strategies consistent with the CI model of comprehen-
marization tool, but this was generally viewed as a “luxury” in sion that are emphasized in this program include
an already over-filled classroom hour designed to meet perfor- • summarizing, that is, restating the text in the readers
mance goals in the content area. But neither we, nor other own words. This strategy requires readers to grasp the
reading comprehension researchers, are put off by these prac- gist of the text by creating a situation model.
ticalities. Below, we report on a couple of promising compre- • explaining how ideas and sections of text relate to one
hension programs that are designed to be embedded in content another, that is, building text coherence
area curriculum, including our work on summarization. • developing domain specific vocabulary
• answering open ended questions that require domain
IDEAS specific vocabulary and making connections within the
Vitale and Romance (2007) have developed a knowledge- text
based instructional framework, called IDEAS that unifies con- • developing an awareness of text structures so that stu-
tent-area reading comprehension with reading comprehension dents can develop metacognition that will help them
strategies. They successfully implemented a combined read- build a coherent textbase
ing—science content area 2-hour class in a grade school set- • creating graphic organizers that display the ideas in the
ting—grade 5, which involved over 50 teachers and 1200 eth- text and the students’ understanding of this information
nically diverse students. This class replaced the reading curricu- and how the ideas relate
lum at these schools. Control classrooms were matched to • discussing related ideas across texts (i.e., ideas that are
experimental classrooms. The students in control classrooms independent but are related by theme)
studied reading comprehension in the context of the usual dis- • writing and discussion to demonstrate understanding
trict basal reading program which focused on narrative texts. Currently, this program has been successfully implemented
The students in the experimental classrooms studied reading in a few classrooms as a supplemental program—after school
comprehension strategies embedded in their science instruc- or pull-out—and does not replace a school’s reading curricu-
tion. Their tasks included three main types of strategies: text lum or English language arts program. However, the format
elaboration via discussions, which included the identification could be adapted to content classes. Our research lab is look-
of key ideas, question answering to link the text and engage it ing into this theory-based program to gain further understand-
with students’ prior knowledge; concept mapping, in which ing of the factors that provide the most efficient and effective
students identify, arrange and link together the core ideas, sub- application of the constructs of the CI model. More specifically,
ordinate ideas, and examples; and summarization/writing, in we are evaluating the program with regard to concrete improve-
which students organize and communicate the ideas generated ment in and therefore transfer of comprehension skills learned
from the text. in executing these lessons as well as an increase in learning the
In IDEAS, teachers model the appropriate comprehension knowledge that makes up the reading content and its transfer to
strategies and monitor the students’ use and progress using subsequent related learning.
the strategies themselves. This program required a reported The summarization tool we reported earlier in this article is
30 hours of training during the summer and 30 hours of plan- called Summary Street, and is currently offered commercially
ning time on the part of the teachers, along with continued by Pearson Knowledge Technologies, (http://www.pearsonkt.
mentoring from the researchers. A similar level of professional com/). Our research with this application found that if students
development was required by, Literacy Navigator, the next used this computer tutor, their ability to summarize was sig-
application we discuss, which also focuses on content-based nificantly improved as compared to matched control students
comprehension instruction. who only used a word processing application to summarize the
same material (Caccamise, Franzke, Eckhoff, & Kintsch, 2007).
Literacy Navigator Summarization is only one comprehension strategy that good
Literacy Navigator (Hampton, 2007), offered by America’s readers use to more deeply comprehend material, but an
Choice, is a teacher-led, instruction program designed to important one.
improve reading comprehension in grades 4-10. It is designed
for students who can adequately decode text, but nevertheless, Future Directions
struggle to comprehend informational text and have problems The National Science Foundation has identified personal-
on state reading tests. This program is based on Kintsch’s ized learning as a 21st century research initiative. As future
Construction Integration (CI) theory of reading comprehension. research continues to affirm content-embedded reading com-
The lessons are organized around a single topic (in this case, prehension programs, we envision a time when not only content
adaptation) and generally progress from easy to more difficult and comprehension training will be integrated, but assessment
content. Each lesson is specifically targeted to demonstrate and and performance accountability will also be a seamless part of
engage students in the active use of reading strategies to build Continued on page 26
The International Dyslexia Association Perspectives on Language and Literacy Spring 2009 25
Comprehension Processes continued from page 25
this process. The integration of these components will bring both Vitale, M. R., & Romance, N. R. (2007). A Knowledge-Based framework for unifying
content-area reading and comprehension and reading comprehension strategies.
efficiency and a higher level of effectiveness in the education In D.S. McNamara. Reading comprehension stragegies: theories, interventions
practices of tomorrow (Caccamise & Snyder, 2005, Caccamise, and technologies. (pp. 73–104). NY: Erlbaum-Taylor and Francis Group.
Snyder and Kintsch, 2008). Teachers will be an indispensible
catalyst and facilitator in making it all happen.
Donna Caccamise A.B. (SDSU), M.A., Ph.D. (Univ. of
References Colorado), Psychology. Dr. Caccamise is the Associate
Best, R. M., Floyd, R. G., & McNamara, D.S. (2004). Understanding the fourth-grade
slump: Comprehension difficulties as a function of reader aptitudes and text Director of the Institute of Cognitive Science, and the
genre. Paper presented at the 85th Annual Meeting of the American Educational Director of Academic Programs for ICS at the University of
Research Association.
Colorado, Boulder. She is cognitive psychologist/cognitive
Caccamise, D., Snyder, L., & Kintsch, E. (2008). Constructivist theory and the situa-
scientist whose research is at the nexus of cognition, and
tion model: Relevance to the future assessment of reading comprehension. In C.
Block & S. Parris, Comprehension instruction. NY, NY: Guilford Press. computer mediated educational interventions. Her recent
Caccamise, D., Franzke, M. Eckhoff, A., & Kintsch, W. (2007) Automated tutor for work focuses on reading comprehension issues and instruc-
teaching summarization and deep comprehension. In Mc Namara, D., ed. tional applications in grades K-14.
Reading Compre. Strategies: Theory, Interventions, and Technologies. Erlbaum.
Caccamise, D., & Snyder, L. (2005) Theory and pedagogical practices of text com-
prehension, Topics in Language Disorders, 25, 5–20.
Lynn Snyder, B.A., M.A., CCC-SLP, Ph.D., is Professor
Duke, N. K. (2000). 3.6 minutes per day: The scarcity of informational texts in first
grade. Reading Research Quarterly, 35, 202–224.
Emerita in the Department of Speech, Language and
Hampton, S. (2007). Literacy navigator. Washington, DC: America’s Choice
Hearing Sciences and Director Emerita of the Center for
(National Center on Education and the Economy). Language and Learning at the University of Colorado at
Kintsch, W. (1998). Comprehension: A paradigm for cognition. New York: Boulder. Her research focuses on reading comprehension in
Cambridge University Press. children and adolescents. She is a Fellow of the American
Organisation for Economic Cooperation and Development, (2007). Report of the Speech-Language-Hearing Association and the International
Progress in International Reading Literacy Study, Programme for International
Academy for Research in Learning Disabilities.
Assessment, November 28, 2007.
Pressley, M. (2000). What should comprehension instruction be the instruction of?
In M.L. Kamil, P.B. Mosenthal, P.D. Pearson & R.Barr (Eds.), Handbook of reading Correspondence may be sent to Donna Caccamise, Ph.D.,
research, (Vol. 3, pp. 545-561). Mahwah, NJ: Erlbaum. Institute of Cognitive Science, University of Colorado at
Snow, C. E. (2002) Reading for understanding: Toward a research and development Boulder, Campus Box UCB 344, Boulder, CO 80309-0344
program in reading comprehension. Santa Monica, CA: RAND. e-mail: [email protected]
Snyder, L., & Caccamise, D. (In preparation) Comprehension Processes for
Expository Text: Building Meaning and Making Sense. In M. Nippold and C. Scott
(Eds.)., NY: Taylor and Francis.
26 Perspectives on Language and Literacy Spring 2009 The International Dyslexia Association
View publication stats