Professional Documents
Culture Documents
Module 5 Development of Classroom Assessment Tools
Module 5 Development of Classroom Assessment Tools
INTRODUCTION
This module delineates the guidelines to observe in writing the actual test items
for multiple choice, true-false, matching, short answer and essay items. Every teacher
should be aware of the general principles of test construction in order to ensure that the
correct information is used assessment and decision purposes.
LEARNING OUTCOMES
LEARNING CONTENT
Both norm-referenced and criterion-referenced tests fall under the two very
general categories: (a) objective test, and (b) essay tests. Some objective tests
include: the true or false test, multiple choice test and matching type of tests, and
enumeration test. On the other hand, essay tests can be broadly subdivided into
composition tests or definition illustration tests.
Multiple-choice items are preferable to use than other type of items because of
the following reasons:
1. They can measure simple and complex learning outcomes.
2. They can measure a broad range of achievement.
3. They are more objective and can be scored easily.
4. They are appropriate for diagnostic use.
5. They present the task clearly.
1. Present one clearly stated problem in the stem. The stem should clearly state
only one problem.it must not be vague, ambiguous, or too broad. It should be
specific enough that there is no room for misinterpretation.
Example:
BAD: A table of specifications
a. specifies the weaknesses of student performance
b. indicates hoe learning can be improved
c. adequately samples the behavior to be tested*
d. reduces the amount of time to construct the items
BETTER: Why is table of specifications primarily important before
writing any test?
a. It indicates how learning can be improved.
b. It specifies the weakness of student performance.
c. It adequately samples the behavior to be tested.*
d. It reduces the amount of time to construct the items.
The improved stem presents one clear problem that the students will
surely understand. It is specific enough that the question can be answered even
without the options.
2. State the stem in simple, clear language. The stem should be written in simple
language devoid of any difficult word. The sentence structure must be in simple
form. Complex sentence structure should be avoided. Any unnecessary word/s
and irrelevant details in the stem must be eliminated.
Example:
BAD: To measure adequately the learning outcome that is to get
the main idea of a selection without giving chance to
ambiguity, the best type of item to use is
a. Short answer item
b. Completion item
c. Multiple-choice item*
d. Matching item
The stem is wordy and contains a difficult word (ambiguity), unless the
word is introduced and explained during instruction. The stem needs that to be
shortened to make it concise and clear in defining the problem.
BETTER: To measure clearly and precisely the skill of getting the
main idea of a selection, the best type of item to use is
a. Short-answer
b. Completion
c. Matching
d. Multiple-choice*
The reason why the stem should be stated simply and clearly is to
measure the intended learning outcome and not any other skill or competency.
Remember, the item should measure only one intended learning outcome so
that it can be useful in diagnosing a learning difficulty.
3. Make the stem longer than the options. The stem should adequately cover
enough details to make it clear and precise. It is common error to load the
options with too many details so that the alternatives become longer than the
stem. The options should be shorter than the stem. In other words, the stem
should be longer than the options.
Example:
BAD: Objectives are useful when
a. Course content is clearly specified.
b. Student performance is precisely delineated.
c. Teacher behavior is definitely demonstrated.
d. Learning activities are made congruent and observable.
The options are too wordy. Brevity and clarity of expression must be
observed in writing an item. To shorten the options, the stem should contain
enough details to make it clear and definite.
4. Stress the negative word used in the stem. There are instances that the use of
a negative word is important in measuring a particular learning outcome.
Examples of negative words which may be used in the stem are no, not and
except. The negative word used can be emphasized by 1) underling it, 2)
capitalizing it, or 3) placing it at the end of an incomplete statement. Such
emphasis can avoid the negative aspect of a stem being overlooked by a
student.
1. Make sure there is only one correct answer. The teacher should avoid writing
options that may be open to debate or argument. The correct answer must be
unquestionably correct which everybody should agree and accept.
2. Make the options homogeneous. Homogeneous options are those that belong
to one category or classification. If the key is a fruit, the distracters should also
be fruits. Homogeneous options are plausible alternatives. Plausible alternatives
have the possibility to be chosen by the uninformed students.
3. Make all the options grammatically consistent and parallel in form with the stem
of the item. Options should be consistent in tense, article, or grammatical form
with the stem. If the stem calls for a future tense, the key and the distracters
should also be stated in the same tense to make the options parallel in the
form. If the stem calls for a word that begins with a consonant, then the article
“a” should be used. The other options should be words which have initial
consonants in order to make the parallel.
4. Vary the length of the key to avoid giving a clue. Most of the times, the correct
answer tends to be longer than the distracters. To avoid length as a clue, make
the correct answer shorter, sometimes longer, other times of equal length with
the rest of the options. As long as there is no predictable pattern as regards
the length of the key, giving length as a clue is eliminated.
5. Place the position of the correct answer in random order. The positions of the
correct answer should not appear about the same number most of the times.
Randomly assign the key so as to avoid giving a clue.
6. Avoid using “all of the above” as an alternative. Most of the time, the item
writer has difficulty of thinking any option so that “all of the above” is used. If
the option all of the above is the correct answer, any of the two alternatives
detected to be correct by the student can give a clue as to the key. If this
happens, the student need not read the remaining alternatives. The distracters
lose their function in distinguishing a good performer from a poor one.
7. Avoid using two options that have similar meaning. If two options are similar
in the meaning, the student can eliminate them as a possible answer.
Lesson 2: WRITING TRUE-FALSE ITEMS
1. Each statement should include only one idea. The idea should be stated in the
main point of the item rather than on some trivial detail.
Example:
POOR: True False* The true-false item as seen by
Newton takes little time to prepare.
BETTER: True* False The true-false item takes little time to
prepare.
2. Each statement should be short and simple. The item becomes clear when the
statement is short and is expressed in a simple sentence.
Example:
POOR: T* F True-false items provide for adequate
sampling objectives and can be scored rapidly.
BETTER: T* F True-false items provide for adequate
sampling of objectives.
T* F True-false items can be scored rapidly.
The “poor” example has two central ideas. It can be separated into two
statements each of which carries one main idea. The “better” items are
improvement of the “poor” items.
3. Qualifiers such as few, many, seldom, always, never, small, large, and so on
should be avoided. They make the statements vague and indefinite.
Example:
POOR: T F* True-false items are seldom prone to
guessing.
BETTER: T* F True-false items are prone to guessing.
The qualifier “seldom” makes the “poor” example a false item. When
“seldom” is deleted, the item becomes true.
4. Negative statements should be used sparingly. If such statements cannot be
avoided, emphasize the negative word used by underlining it or capitalizing all
the letters in that word. This practice will preclude negative statements to be
read as positive ones.
Example:
POOR: T F* True-false items are NOT prone to guessing.
BETTER: T F* True-false items are not prone to guessing.
The “poor” example uses double negatives. To improve this item, delete
one of the negative words and use capital letters to show emphasis.
7. The number of true and false statements should be equal whenever possible.
Example:
POOR: 1. True 2. True 3. False 4. True 5. True 6. False
BETTER: 1. False 2. True 3. True 4. False 5. True 6. False
The “poor” example has 4 “true” answers and 2 “false” keys. The
“better” example has 3 “true” answers and 3 “false” keys.
1. Be sure that the materials in the test are homogenous. This is the general
principle in all test types but we often find ourselves violating this. In layman’s
term, this means that we should be testing a concept at a time for each item.
In the matching case, we should specify the concept-pair we are trying to test.
Example:
Direction: For each province in column A, find the corresponding capital
in column B. Write the letter corresponding to the capital in the blank provided
for in column A.
Column A Column B
___1. Misamis Occidental a. Marawi City
___2. Agusan del Norte b. Ozamis City
___3. Misamis Oriental c. Butuan City
___4. Lanao del Norte d. Iligan City
___5. Lanao del Sur e. Cagayan de Oro City
2. Use an imperfect match type as much as possible. A perfect match will include
guess-work once the student reads the second to the last pair of concepts.
Even if the student has no idea as to the last pair concepts, he can “guess”
because there are no other matches left.
3. Indicate the basis for matching column A with column B. Use the directions
effectively to explain clearly the basis for matching column A with column B.
The directions should lead to no ambiguity as to the basis for matching.
Remember that the given a pair of concepts there is more than one way of
rationalizing the pairing done.
4. Place all of the items for one matching exercise on the same page. Do not
overwork the students by putting column A on page 2 and on column B beyond
page 1 so that the pair of the concept in columns A page 1, is found on page 2
column B.
3. Leave the blank at the end of the statement. When the blank is placed at the
end of the statement, the students is given a chance to determine what problem
really is. Placing the blank at the start of the statement tends to make the
student confused as what the problem is.
Example:
POOR: _____ are the incorrect alternatives in a multiple-choice
item. (Distracters)
BETTER: The wrong alternatives in a multiple-choice item are called
_____ (distracters).
4. Focus on one important idea instead of trivial detail and leave only one blank.
Example:
POOR: When a teacher wants to _____ the student’s learning
difficulties, the kind of assessment she should use is _____
assessment (identify, diagnostic).
BETTER: When a teacher wants to identify the student’s learning
difficulties, the kind of assessment she should use is _____
assessment (diagnostic).
Essay questions require students to produce their own answers freely. They
measure the ability to organize, integrate, and express ideas. These abilities cannot
be adequately determined or assessed by selection-type items.
The higher order thinking skills (analysis, synthesis, and evaluation) can be
directly measured by essay questions. Essay involves less time to prepare than
selection type items. However, essay questions do not provide adequate sampling of
learning outcomes to be measured. Scoring tends to be subjective, unreliable, and
time consuming. Poor handwriting, misspelled words, and poor grammar tend to lower
scores.
1. State questions that require clear, specific, and narrow task or topic to be
performed. Some sample terms to use that make the task clear and specific are
as follows: compare, describe, explain, summarize, relate, differentiate,
criticize, and appraise. The topic of an essay question must be limited and
narrow.
The problem of solid waste management is quite broad to discuss in an essay
question. It can be narrowed down to recycling as one of the ways to manage
solid waste. Thus an essay question that can be formulated runs like this:
Describe how old magazines and newspapers can be recycled at home.
2. Give enough time limit for answering each essay questions. Enough time to
think and write the answers should be given to students. Only a few essay
questions should be formulated for a given class period. It is not wise to include
so many questions to cover as many desired learning outcomes because there
may not be enough time for the students to finish the test. It is advisable to
include one or two essay questions in the testing period.
3. Require students to answer all questions. It is best to require all students to
respond to the same essay questions for point of comparison and
representativeness. If only a few questions are answered, the problem of
adequate and representative sampling of behaviour becomes evident.
4. Make it clear to students if spelling, punctuation, content, clarity, and style are
to be considered in scoring the essay questions. When these criteria are clear
and specific to students, the item becomes valid.
5. Grade each essay question by the point method, using well-defined criteria. By
using certain criteria as a guide, scoring essay questions becomes less
subjective and more objective.
6. Evaluate all of the students’ responses to one question before going to the next
question. Scoring essay test question-by-question rather than student-by-
student maintains uniform standard for evaluating the answer to each question.
7. Evaluate the answers to essay questions without identifying the student. There
is a tendency to score essay questions based on personal bias. To prevent
knowing the identity of the student, a code number may be assigned to each
student. In this way, answers can be scored more objectively based on their
own merits.
Choose the letter only of the correct answer from the above options.
I. Decide whether the following instructional objectives and test items match. Write
the letter of your choice before the number.
A. MATCH
B. DO NOT MATCH
_______1. Objective: Identify the 4 components of an instructional
objective.
Test Item: Explain the 4 components of an instructional objective.
_______2. Objective: List the main events in a story in chronological order.
Test Item: List the main events in a story in chronological order.
_______3. Objective: Distinguish fact from opinion in a news article.
Test Item: Define fact and opinion.
_______4. Objective: Subtract 4-digit numbers from 5-digit numbers with
regrouping.
Test Item: Subtract 4-digit numbers from 5-digit numbers without
regrouping.
_______5. Objective: Name the capitals of 76 provinces in the country.
Test Item: Name the capitals of 20 cities in the country.
_______6. Objective: Predict outcomes of stories read.
Test Item: Supply the ending of the following stories.
_______7. Objective: Discuss briefly the principle of sowing and reaping.
Test Item: Give two examples of how sowing and reaping can be
illustrated.
_______8. Objective: Draw a familiar scenery in a rural area using any
medium.
Test Item: Draw a scene of a barrio fiesta using cray pas.