About Test Items
About Test Items
Nour-Eddine Laouni
An item is the basic unit of interaction on a test. What we often call a test question is
more properly known as an item, since it may not be worded as an actual question.
The student's feedback is also more properly known as a response rather than an
answer, but we won't get too particular on that point. Items can be written in various
formats, including multiple choice, matching, true/false, short answer, and essay. We
will discuss some of these formats in another article.
Since items are the actual points of interaction of students with the test, item quality is
probably the most recognizable indicator of the overall quality of the test. High
quality test items take time and effort to write, but are essential to a valid test. Items
must test skills and knowledge of the subject at hand, not the student's test taking
skills.
1 A good test item is relevant. It should test the learning objective(s) being
measured; nothing more and nothing less. This may sound obvious, but when a
student who is highly skilled at taking tests scores better on an item than one who is
less skilled, even though he has no more knowledge on the subject, this principle is
probably being violated.
2 A good test item is important. Items must clearly address learning objectives, not
trivia. Memorization of obscure facts is much less important than comprehension of
the concepts being taught. Trivia, on the other hand, should not be confused with
"core" knowledge that is the foundation of a successful education. Examples of
"core", nontrivial knowledge include multiplication facts, common formulas, and
common geographic names.
4 A good test item is unambiguous. If a word has more than one possible definition,
the context in which it is used should leave no reasonable doubt as to which definition
is intended. Directions also should contain no ambiguity. If the student is to circle the
correct answer, he should not be instructed to mark the correct answer.
5 A good test item is straightforward. There should be no trick questions. Tricky
items often turn on the meaning of a single word that is not the focus of the item. This
is often a flaw in true/false items. Use of the words always and never, and opinions
stated as facts are often an unneeded source of confusion to test-takers. If the correct
response hinges on a single word, that word should be clearly emphasized. Humor
should be used with care as well. The personality of an individual teacher may shine
through in the tests he gives his students, but for serious or high-stakes tests, any
attempt at humor can be confusing and distracting.
7 A good test item is independent. Items should not provide clues to the answers of
other items. Sometimes a series of comprehension items all relate to a single reading
passage, or multiple math problems are taken from a single scenario. This approach
simplifies item-writing and can be effective, as long as the individual items are still
independent of each other. On the other hand, if getting the correct answer on Item #2
depends on getting the correct answer on Item #1, then item #2 tells you absolutely
nothing about the skills of the student who missed Item #1. Furthermore, this student
is being penalized twice, in effect, for one mistake.