Caietal SSMcommunication
Caietal SSMcommunication
net/publication/230115361
CITATIONS READS
70 3,272
3 authors, including:
Jinfa Cai
University of Delaware
240 PUBLICATIONS 8,081 CITATIONS
SEE PROFILE
All content following this page was uploaded by Jinfa Cai on 12 May 2023.
Assessment of students’ mathematical communication through the use of open-ended tasks and scoring
procedures is addressed, as is the use of open-ended tasks to assess students9 mathematical communica-
tion by providing students opportunities to display their mathematical thinking and reasoning. Also, two
scoring procedures (quantitative holistic scoring procedure and qualitative analytic scoring procedure)
are described for examining students9 communication skills.
Conceivably every mathematics teacher, from kinder- strument [QCAI] (Lane, 1993). QUASAR (Quantita-
garten to graduate school, has had the experience of tive Understanding: Amplifying Student Achievement
asking a student to justify an answer and has had that and Reasoning) is a national project designed to im-
student immediately assume that the answer must be prove mathematics instruction for students attending
wrong. The student reacts in a way that indicates a middle schools (grades 6 - 8) in economically disad-
belief that the teacher is asking for a justification of an vantaged communities (Silver & Stein, 1996). The
error, the student appears to be formulating some quick QCAI is designed to measure middle school student
maneuver to "correct the mistake." Perhaps this hap- outcomes and growth in mathematics and to help
pens because it is so rare for students to provide evaluate attainment of the goals of mathematical in-
explanations in mathematics class, so strange to talk structional programs. The QCAI consists of a set of
about mathematics, and so surprising to justify an- open-ended tasks which ask students to construct their
swers. The fact that the experience described above is responses. The open-ended assessment tasks ask stu-
not unique and that so many teachers arc familiar with dents to show their solution processes and provide
the event helps to put the connection between commu- justifications for their answers. Also these tasks allow
nication and assessment into the forefront of discus- students to display various levels of mathematical
sion among mathematics educators and teachers. In understanding and mathematical communication. The
fact, since communication is essential to learning, authors hope these examples will help the readers to
understanding, and doing mathematics, assessment of become more competent in the assessment of their
student mathematical communication should become students’ mathematical communication.
an integral aspect of mathematics assessment (Na-
tional Council of Teachers in Mathematics [NCTM], Use of Open-ended Tasks for Assessing
1989,1995). As suggested by NCTM, The assessment Mathematical Communication
of students’ ability to communicate mathematics should
provide evidence that they can: For classroom assessment, teachers have various
express mathematical ideas by speaking, writing, sources which form the bases for the development of
demonstrating, and depicting them visually; open-ended tasks. Many recent textbooks and curricu-
understand, interpret, and evaluate mathematical lum materials contain tasks which arc appropriate for
ideas that arc presented in written, oral, or visual assessing communication skills in the mathematics
forms; classroom. Teachers might work together
use mathematical vocabulary, notation, and collaboratively to create and/or locate tasks that will
structure to represent ideas, describe relationships, assess mathematical communication. The National
and model situations (1989, p. 214). CouncnofTeacheisofMathematicsS^wd^r^(NCTM,
In recent years, several educational reform and 1989,1991,1995) are the important sources that pro-
assessment projects have undertaken the issue of the vide rich ideas for tasks that assess students’ math-
assessment of students’ communication skills in math- ematical communication as well as their problem-
ematics. This article addresses the assessment of solving and reasoning skills. It is also possible to
students’ communication skills in mathematics class- rework problems from textbooks so that they become
rooms through the use of open-ended tasks and scoring more open-ended (Butts, 1980). For example, teachers
procedures. Most examples used in this article were can transform some multiple-choice items into open-
drawn from the QUASAR Cognitive Assessment In- ended tasks by asking students to justify their answers.
.OW t^U(^
.OQ^OQQ ^\U.^\ JL.
\ooo ^ ftJut^ of-’ \000 I
^
’
Response 2 Response 3
Figure 1 shows an open-ended release task from the response, the student’s explanation suggested that the
QCAI that assesses students’ conceptual understand- student correctly transformed the decimals into equiva-
ing of decimal place value. lent fractions to explain why .8 is the greatest number
At first glance, the task appears to be a multiple- among the given four decimal numbers. In the second
choice item, but, because students are asked to explain response, although the student correctly circled the .8
their answers, a seemingly ordinary multiple-choice as the number with the greatest value, the answer is
item becomes an informative task that brings math- based on an inappropriate reason. Obviously, this
ematical communication into the assessment arena. student did not understand how the placement of zeros
Students’ explanations on the QCAI revealed various before and after the digit 8 affects the value of the
bases for the justifications and various types of math- decimal number. Most importantly, this response
ematical errors (Cai, Lane, & Jakabcsin, 1996a; shows the power of the open-ended task in assessing
Magone, Cai, Silver, & Wang, 1994; Cai, Magone, student understanding of decimal place value. In fact,
Wang, &Lane, 1996b). For example, students’ expla- if it were a multiple-choice task, once a student chose
nations displayed knowledge of decimal place value, .8 as an answer, it would be assumed that the student
relationships between the decimal numbers and the understands decimal place value as it is assessed by the
decimal point, and fractional equivalencies of the deci- item. However, the second response shows that the
mal numbers. student who chose .8 as the greatest number does not
Figure 1 also shows three middle school student necessarily have sufficient knowledge to support the
responses to the open-ended decimal task. In the first selection. The third response shows a student’s mis-
conception about decimal place value. This student in the graph. For the Average Task, students were
used a "whole number rule" erroneously to explain asked to explain how they found their answers.
why .008000 is the number with the greatest value. It is important to indicate that, for a given task. one
This student appears to be confused about the differ- particular prompt may be more likely to elicit the
ence between the place values of whole numbers and intended mathematical reasoning and communication.
the place values of decimal numbers. It is also important to indicate that task context may
The decimal task illustrated that, even though a also facilitate student communication of mathematical
student may have chosen an answer considered to be thinking in solving open-ended tasks (Lane, 1993;
correct in a multiple-choice setting, the reasoning may Paike & Lane, 1993). Generally, the task context
have been invalid. In other assessments, when students should be familiar to students and should engage them
choose incorrect answers to a multiple-choice task, in the mathematics embedded in the task. The Pattern
they may actually have valid justifications for their Task (see Figure 2) is set in a classroom context where
"incorrect answers." For example, the Third National Miguel is instructed by his teacher to find the fifth
Assessment of Educational Progress (NAEP, 1985) figure in a pattern. Students arc asked to write descrip-
used a multiple-choice version of the following divi- tions for Miguel that show him how to find the fifth
sion-with-remainder (DWR) problem: "An army bus figure. In this task, the situation is friendly; students
holds 36 soldiers. If 1,128 soldiers are being bused to are almost tutoring another student while they solve the
their training site, how many buses arc needed?" In the Pattern Task. hi fact, this task evoked many different
multiple-choice version, only 32 is considered as the solution strategies (Cai, Magone, Wang, & Lane,
correct answer (NAEP, 1985). Recently, Silver and his 1996b). Not only arc many QCAI tasks set in familiar
associates developed an open-ended version of the contexts, but many also elicit multiple solution strat-
problem to examine U.S. students’ (Silver, Shapiro, & egies. For example, students used more than five
Deutsch, 1993) and international students’ (Cai & different strategies to solve the Number Theory Task
Silver, 1995) mathematical thinking and reasoning in (Magone et al., 1994).
the solution of the problem. The analysis of student hi addition to the directions used in the above
responses which were considered to be incorrect in a release tasks, shown in Figure 2, other directions or
multiple-choice version revealed many interesting as- prompts can be used to assess students’ mathematical
pects of students’ thinking. For example, some stu- communication skills (Lane, et al., 1992). Below arc
dents stated the answer could be 31 since the remaining several examples:
12 people could be "squeezed into" the 31 buses. Some Explain how you found your answer,
students even explained that the answer could be either Show how you find your answer;
31 or 32. They said that the answer could be 32 if Explain your answer and give an example;
another bus was ordered for the 12 remaining people; Describe the pattern of numbers;
or the answer could be 31 if 12 buses were chosen to Explain how you found your estimate;
hold one extra person (Cai & Silver, 1995). Write a description to justify your answer,
Show aU your woric;
Appropriate Prompts in Open-ended Tasks Explain your reasoning, and give an example.
Various directions orprompts can be used in open-
ended tasks to facilitate the assessment of students’ Scoring Procedures for Assessing Mathematical Com-
mathematical communication by allowing different munication
mathematical representations to be used (Lane, 1993; Student responses to the QCAI tasks have been
Lane, Paike, & Moskal, 1992). Figure 2 shows four scored using both a quantitative holistic scoring proce-
QCAI release tasks (Number Theory Task, Pattern dure and a qualitative analytical scoring procedure
Task, Average Task, and Graph Interpretation Task) (Cai et al., 1996b; Cai et al., 1996c; Lane, 1993;
which arc designed for middle school students (grades Magone et al., 1994). Both scoring procedures draw
6 - 8)1. Within these four tasks, different directions or on recent advances in cognitive psychology which
prompts were used to evoke students’ mathematical highlight the importance of moving beyond the cor-
communication. For example, in the Number Theory rectness of the answer to a task to examining solution
Task, students were asked to show the woric or solution processes, including mathematical communication,
processes they used to find their numerical answers. solution strategies, and mathematical errors.
For the Graph Interpretation Task, each student was Quantitative Holistic Scoring Procedure. In the
asked to write a story that describes the data presented quantitative holistic procedure, each student’s response
Speed
|mile« per hour)
Pr<j»« PrafMl
2 3 Time
ARif |«t on Projtt 4 M that hw v«r«x« for Write a story about Tony’s walk. In your story, describe what Tony
l to 17?
might have been doing at the different times.
. ExRiaiM l
ancwr OB (h« (rapli.
.
-^^~r’\^aAV7
:5WV»c^s^o<^2p^a.NnQWr
So ’"^^Jan^}^
-|Wi r/
-»i * » » c^
^ understanding of the average concept
Level 3
Thisstudenthasacorrectanswer. The explanation showsan
understanding of the average concept in the context of the
problem, but the explanation is rather vague.
1996c; Magone et al., 1994).
In the qualitative analytical procedure, a student’s
’or^^^cjc/ H.^^f^
Draw your annr«r on the graph.
^Sl^LAAJtt^<y^joA(A <
^/L^U^- t^ ^^<^t/}-)
&? Q^^^^-/.
cr-
Since this sentence is incomplete with regard to the different solution strategies. In the first response, the
location of the added dot, the description is not com- student used the average formula to solve the problem.
pletely clear to the reader. The slight ambiguity in this In particular, this student used arithmetic expressions
example might be due to the level of the student’s to derive the scores for Project 4. In the second
linguistic skill rather than the level of mathematics response, the student used the average formula to solve
skill. For the Pattern Task, an example of a "partially the problem, but the studentused algebraic expressions
complete" description is one that indicates only how to determine the scores forProject4. The students who
the top row of the fifth figure was obtained. Some produced the third and fourth responses both used
students provide procedural descriptions which lack diagrams to explain how they found their answers, hi
connection to the specific details of their solution the third response, the student viewed the average
processes. For example, one student wrote: "I looked score (17) as a leveling basis to "line up" the scores for
at the figures, I guess there is a pattern. Then I followed projects 1,2,3, and 4. Since project 1 has 15 points, an
the pattern and got the fifth figure." additional 2 points are needed to "line up" to the
The QCAI tasks were designed to allow students to average of 17. Project 2 with 18 points has one extra
use multiple representations in theirsolution processes; point. Since project 3 has 16 points, it needs 1 addi-
among these are tables, charts, drawings, mathematical tional point to "line up" to the average. In order to "line
expressions, written text, or any combinations ofthese up" the scores for the four projects, project 4 must be
(Lane, 1993). Figure 6 shows examples of representa- 19 points. In the fourth response, the student plotted
tions that students used in solving the Average Task. the fournumbers (including average) on a number line.
Although these students all had the correct answer The average of 17 was viewed as a midpoint, and there
(19), they used different representations as well as were two numbers (15 and 16) on the left side of the
midpoint and one (18) onthe right side. In order to have to use its vocabulary, notation, and structure to express
"balance," the fourth project should be 19 points. and understand ideas and relationships" (NCTM, 1989,
p. 214). In fact, communication is considered as the
Conclusion means by which teachers and students can share the
processes of learning, understanding, and doing math-
Mathematics educators agree that communication ematics. It is especially importantthat students are able
is a component that is essential to and necessary in to express their thinking and problem-solving pro-
learning, doing, and understanding mathematics since cesses both in written and oral formats. Furthermore,
"communication in mathematics means that one is able theircommunicationmust be clearand completeenough
Figure 6. Examples of mathematical communication modes for solving the average task.
Response 1
Response 2 Response 3
^ »
^
/ Answer: -0. You may draw your
I
\
;
^|
answer on the graph.
»5--M&^i4^X=<7x4’
4^-t-A^ U/<4-
:
^ A\
’-.
4-^ ^x=-<^8
^ \ =
^ A. Whit
ProjKl
12)
mutCt ^Kt
Ihil k«r
AVERAGE
v»r»»» fur
Response 4