Assess 213-8 Selecting and Constructing Test Items and Tasks
Assess 213-8 Selecting and Constructing Test Items and Tasks
Learning Objectives:
After reading this INFORMATION SHEET, YOU MUST be able to:
1. Select and construct appropriate test items and tasks for classroom
assessment.
The previous chapter has familiarized you with the initial process in developing
classroom tests. True to all types of assessment tests, it always starts with a
planning phase that basically answers the question, “What do I test?” and
leads you to the preparation of a test blueprint or a table of specifications
which delineate the essential learning outcomes to be assessed following a
balanced distribution of items across the desired cognitive behaviors. The
present chapter now brings you to answer the second question, “How do I
test?” How do I operationalize assessment of the learning outcomes intended
for a period of study? It now introduces you to a useful menu of test types that
are appropriate to gauge the learning outcomes proposed by the curriculum
standards, how to select them and how to construct them.
Let the groups observed the various tree charts posted on the wall and
compare the outputs in terms of similarities and differences. Agreements can
be arrived at after a discussion of the grouping features used by the different
teams. Guide questions you can ask:
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 1 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Who did you group the different test types?
How will you modify your tree chart to accommodate the other test
formats?
Figure 8.1 illustrates a general tree chart for test types. If there are other
test types that do not appear here, they may be variants of one sub-type.
TEST TYPES
Selection Performance
Supply Type
Type Type
2. Study the sub-types under each general type. What is the distinguishing
feature of each group? What is expected of learners to do in each type?
(Constructed-response) (Selected-response)
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 2 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Essay-Restricted Matching Simulated Performance
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 3 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
specific facts, concepts, correct procedure, steps,
principles, rules or skills or strategies.
theories
Is able to state the Law of supply and Is able to compute the area of a
demand. rectangle.
Comprehension Comprehension
Is able to explain the law of supply Is able to compare the size of two
and demand. given lots in terms of area.
Application: Application:
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 5 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Table 8.4 Alignment of Learning Outcomes and Cognitive Levels
Simple Understanding
Level 5: Evaluating
Level 3: Applying
Critique
Solve
Assess
Apply
Defend
Modify
Justify
Demonstrate
Appraise
Employ
Measure
Calculate
Generate
Level 6: Creating
Plan
Generate
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 6 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Produce
Design
Construct
Compose
Table 8.5 illustrates the relationship between learning outcomes and test
types. It can be observed that test types can be made flexible and versatile to
test different levels of outcomes and not to be limited or exclusive to only one
cognitive level. The arrows suggest that supply or selection type can be used for
both lower-level as well as higher- level outcomes. Knowledge and simple
understanding can be handled by objective supply type – i.e. completion and
short answer items, and objective selection type – i.e. alternate choice, multiple
choice and matching.
Lower-Order: According to the article you just read, what factors contribute to
climate change?
(This is a short answer supply type for a simple comprehension question since
it is based on a specific reading material. Without citing the source for the
response, it could also be a simple recall question.)
Higher-Order: Write an article on how the government and the community can
work together to mitigate the factors causing environmental damage?
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 8 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
the “creating” level, it will call for an extended-essay item. Deeper
understanding is necessary to demonstrate this outcome as it involves
synthesis of previous information and observation derived from multiple
sources.)
A. Volcanic eruption
B. Population explosion
C. Forest denudation
D. Carbon emission
(The correct option is based on a specific material which calls for simple
comprehension.)
Higher-order: Which of the following factors which affect climate change can
be controlled by man?
A. Strong earthquake
B. Volcanic eruption
C. Melting of glaciers
(Selection of the correct option requires analysis of the alternatives given. First,
it calls the identifying those factors affecting climate change and later analyzing
whether man can control it or not. Just being able to do one skill will not be
adequate to select the correct option.)
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 9 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Comparing Describe the similarities and differences
between…
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 10 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
happen if…
What test types are commonly used for these types of thought questions
displaying deep understanding? They lend themselves appropriately to essay
types, either restricted or extended, which require students to engage in
various higher-order thinking processes.
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 11 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
of a learned scientific principle or procedure
in real world
The item types falling under Supply type require the learners to
construct a response to a question or directive. The sub-types however, differ in
terms of the structure of the response needed to answer the item:
1. Completion Type
Table 8.8 illustrates the usual item structure for Completion Type. An
item structure consists of a stimulus which defines the question or problem,
and a response which defines what is to be provided or constructed by the
learner. For a completion item, an incomplete statement with a blank is often
used as stimulus and the response is a constructed word, symbol, numeral or
phrase to complete the statement.
Stimulus Response
a. A four-sided quadrilateral
polygon is called a
______
Spanish
b. The novel, Noli Me
Tangere, was
written by Dr. Jose
Rizal during the
______ colonial
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 12 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
period
Directions: Give a word that has the same meaning as the word inside the
parenthesis.
More than a few people may confuse fine dining with (costly) dining in
restaurants. Well-trained (cooks) at the top of their profession can
make their good (name) in these places. Who the cooks bring
(honor) to these restaurants.
b. The blank should be placed at the end or towards the end of the
incomplete statement. This will provide the reader appropriate and
adequate context before s/he gets to answer the blank and consequently
avoids being perplexed. In Sample B, if the blank is placed at the
beginning like:
During the period, Dr. Jose Rizal wrote the novel, Noli Me
Tangere.
It can possibly call for diverse and ambiguous answers like troubled,
colonial, or earlier, without reading the rest of the statement.
Stimulus Response
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 14 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
(direct question)
Spanish
b. During what
period was Noli Me
Tangere written by
Dr. Jose Rizal?
Similar to completion type, the short answer items can assess learners’
declarative and procedural knowledge that require such thinking processes as
remembering, comprehending, and applying. Writing short-answer items
similarly follow the guidelines in writing completion items. Here are those given
by McMillan (2007, pp.170-171) and they are quite self-explanatory.
2. State the item so that the required answer is brief. Requiring a long
response would not be necessary and it can limit the number of items
students can answer within the allotted period of time.
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 15 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
4. Designate units required for the answer, this frequently occurs when the
constructed response requires a definite unit to be considered correct.
Without designating the unit, a response may be rendered wrong
because of differing mind-set.
Example:
This could be answered in different ways like cost per head, per
dish, per plate, or as a full package.
Improve: How much does the food caterer charge per head?
5. State the item succinctly with words students understand. This is true
for all types of tests. Validity of classroom-based test is at risk when
students cannot answer correctly, not because they do not know, but
could be due to the messy wording of the question.
Poor: As viewed by creatures from the earth, when does the blood
moon appear in the evening?
The two supply types, completion and short answer items, share
common points:
Essay Type
Essay Type likewise belongs to the Supply category for the simple reason
that the required response is to be fully constructed by the students. However,
unlike the completion and short-answer items which are highly structured to
allow the students to organize freely their responses using their own writing
style to answer the question. This format therefore is appropriate for testing
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 16 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
deep understanding and reasoning. Some of the thinking processes to
satisfactorily answer essay questions involve comparison, induction, deduction,
abstracting, analyzing perspectives, decision-making, problem-solving,
constructing support and experimental inquiry (Marzano, et al (1993). They
actually involve higher-order thinking skills.
Stimulus Response
b. A directive
(instructions) Set of related
statements, discourse or
paragraph
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 17 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Samahang Kabataan as an
organization.
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 18 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Suggestions for constructing essay questions are given by Miller, Linn &
Gronlund (2009, p.243):
2. Construct questions that will call forth the skills specified in the
learning standards.
Essay, among the test types, is quite frequently used because of the
seeming ease in its construction, but the least preferred when it comes to
scoring. Its reliability is challenged since its subjective scoring may be affected
by such irrelevant factors as corrector’s mood and biases, student’s
penmanship, length of response and even time of day for scoring. The use of a
scoring guide called rubrics, can significantly reduce subjectivity and more or
less help in “objectifying” scoring of a non-objective type of item.
Organization
Clarity of
Message
Creativity
Total
Over Rating
For judging a specific writing genre like an argument, the rubric shown
in Table 8.12 can be adapted for analytical scoring.
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 20 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
(5pts) (3pts) (2pts) (1pt)
Facts and
opinions
clearly
distinguished
Credibility of
Source
Relevance of
materials used
Use of logic
Total
Overall Rating
Task: Design a plan for an experiment showing the effect of amount of water
on plant growth.
Rubric:
Label Description
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 21 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
There are suggestions also given by Miller, Linn & Gronlund (2009,
p.254) to improve the reliability of scoring responses to essay questions:
2. Use the scoring rubric that is most appropriate. The nature of the
essay question and what is assessed should identify the type of scoring
rubric that should be used. Quite significant too, is the kind of
information that will be communicated by the teacher to the students.
Table 8.13 shows the variety of structure using the alternate form as
suggested by Nitko (2001, p.136).
2. It is transmitted
through body
liquids. T F
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 24 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
3. Avoid long sentences Poor:
Good:
Good:
Good:
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 25 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
when done.) fond of drinking wine
2. Multiple-Choice Items
Stimulus Response
STEM –
b) Incomplete
statement
Letter or numeral of the
OPTIONS – 3 to 5
selected option or the
plausible alternatives
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 26 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
from which to select the chosen distracter
correct option.
Illustrative Items
a. Monarchy
b. Parliamentary
c. Presidential
d. Federal
Among the Asian countries, one which has a government with three branches
is ________.
a. Japan
b. China
c. Philippines
d. Thailand
Stem
1. All the words of the stem should be relevant to the task. It means stating
the problem succinct and clear so students understand what is expected
to be answered.
The constitution is .
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 27 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
A stem worded this way does not make definite the conceptual knowledge being
assessed. One does not know what is being tested. Is it after definition of the
term, its significance or its history? To test whether a stem is effectively worded
is to be able to answer it without the distracters. This stem can be improved by
changing its format to a direct question or adding more information in the
incomplete statement like:
This way, the test writer determines what knowledge competence to focus on
and what appropriate distracters to use.
3. The stem should use a question with only one correct or clearly best
answer. Ambiguity sets in when the stem allows for more than one best
answer. Students will likely base their answers on personal experience
instead of on facts. Consider this example. There could be more than one
best answer here.
Poor:
A. Rice
B. Dried fruits
C. Dairy products
D. Ready-to-wear
Improved:
A. Rice
B. Fish
C. Fruits
D. Vegetables
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 28 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
Distracters
Poor:
What is matter?
Quite interesting are the guidelines by Miller, Linn & Gronlund (2009,
p.212) in making distracters plausible. See Table 8.15.
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 29 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
2. Randomly assign correct answers to alternative positions. Item writers
have a tendency to assign the correct answer to the third alternative as
they run short of incorrect alternatives. Students then who have been
used to taking multiple-choice tests choose wily option C when guessing
for greater chance of being correct. No deliberate order should be
followed in assigning the correct answers (e.g. ABCDABCD or
AACCBBDD) for ease in scoring. As much as possible have an equal
number of correct answers distributed randomly in each of the
distracters.
3. Matching Items
Illustrative Item 1
Column A Column B
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 30 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
2. Declared martial law during his term b. Corazon Aquino
h. Manuel A. Roxas
i. Ferdinand Marcos
Column A Column B
i. Steady-state theory
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 31 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
about how the universe has evolved and Column B lists the names of the
theories. Homogeneity is a basic principle in matching items.
2. Keep the premises always in the first column and the options in the
second column. Since the premises are oftentimes descriptions of
events, illustrations of principles, functions or characteristics, they
appear longer than the options which are most of the times are names,
categories, objects, and parts. Ordering of the two columns this way
saves reading time for the students since they will usually read one long
premise once and select the appropriate match from a list of short words.
If ordered the opposite way, the students will read a short word as the
premise then read through long descriptions to look for the correct
answer. Especially for Sample 2, the students will normally read a
theoretical postulate first and then logically go through the names of the
theories given in Column B. imagine the time spent if the opposite
process is done.
3. Keep the lists in the two columns unequal in number. Basic reason
for this is to avoid guessing. The options in Column B are usually more
than the premises in Column A. if the two lists are equal in number,
students can strategically resort to wise elimination in finding the rest of
the pairs. There are matching items however, when the options are much
less than the premises. This is recommended when testing ability to
classify. For instance, Column A will be a list of 10 animals which are to
be classified and Column B could just be 4 categories of mammals. With
this format, it is important to mention in the test directions that an
option can be used more than once.
5. Keep the number of premises not more than eight (8) as shown in
the two sample items. Fatigue sets in when there are too many items
in a set and again, test validity suffers. If an item writer feels that there
are many concepts to be tested, dividing them into sets is a better
strategy. It is also suggested that a set of matching items should appear
on a page only and not to be carried on to the next page. Frequently
flipping the test papers just to look for appropriate options requires
additional time.
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 32 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba
6. Ambiguous lists should be avoided. This is especially true in the
preparation of options for the second column. There should only be one
option appropriately associated with a premise unless it is unequivocally
mentioned that an option could be used more than once as mentioned in
# 4. This often occurs when matching events and places or events and
names, descriptions and characters. For instance, in a description-
character matching, a premise like “mean to Cinderella” may carelessly
list “stepmother” and “stepsister” as options which are both correct.
Either the premise is improved or one option removed.
Date Developed:
Bachelor of Technical- Bulacan
June 2020
Vocational Teacher Polytechnic Page 33 o33
Date Revised:
Education College
June 2020
Assessment in Learning 1
ASSESS 213
Document No. Developed by:
Revision # 02
40-ASSESS 213 Beverlyn Rose De Alba