Professional Documents
Culture Documents
Unit - 11: Evaluating The Instructional Outcome
Unit - 11: Evaluating The Instructional Outcome
EVALUATING THE
INSTRUCTIONAL OUTCOME
Written By:
Dr. A. R. Saghir
Revised By:
Prof. Mian Muhammad Afzal
OBJECTIVES
509
510
CONTENTS
Page No
1. Evaluation 513
511
512
1. EVALUATION
1.1 Nature and definition
As you must be aware, the present day literature on
education is replete with terms like assessment, evaluation,
measurement and testing, etc. Though there is a noticeable
difference in the meaning of these terms, yet they are
occasionally used interchangeably. Nevertheless, before we
plunge into further discussion about the term “evaluation”, it
seems desirable to have a cursory look at the subtle difference
in them.
The term ‘evaluation’ is a fairly comprehensive one and
includes the other terms in its overall umbrella. In this way,
terms like measurement, assessment, etc. are a part and parcel
of evaluation. According to Ahmann and Glock, educational
measurement is the process that attempts to obtain quantified
representation of the degree to which a student reflects a trait.
The use of a paper and pencil test to discover the scholastic
aptitude or achievement of a student is an illustration of
educational measurement. It is a descriptive term which
concentrates on a particular trait. On the other hand, evaluation
is a more inclusive term than measurement. It is a process in
which a teacher commonly uses information derived from many
sources to arrive at a value judgement. Such information might
be obtained by using measuring instrument as well as other
techniques that do not necessarily yield quantitative results such
as general information questionnaires, direct observations and
teacher pupil interview.
Further, it may also be noted that an evaluation may or
may not be based on measurement data, though appropriate
measurements are often used if they are available. Data from
good measuring instruments can provide a sound basis for good
evaluation.
513
It is further maintained by some writers that educational
measurement includes educational testing. The term test is
fairly simple and widely used. According to Cronbach, it can be
defined as any systematic procedure for observing a person's
behaviour and describing it by means of numerical scale.
Having said a few words about the technical defference
between the terms, let us now concentrate upon the word
“evaluation”. As we have already described, it is quite an
inclusive term as compared to others having more or less
similar meaning. Firstly have a look at the following definitions
of the term evaluation:
514
yields so many other important information to the teachers and
others involved in the instructional process.
515
would help you appreciate the major points in this connection.
David P. Harris, identifies these purposes as under:
1. To determine readiness for instructional
programme: It is a recognised fact that some sort
of screening test help in separating those who are
prepared for an educational programme from those
who are not. You as a teacher of English language
are also surely interested in undertaking similar
useful exercise in your class.
516
6. To evaluate the effectiveness of instructions:
Sometimes tests are used exclusively to assess the
degree of success not of individuals but of
instructional programme itself.
1.4 Activity
517
now and soon after gets. 10/50 or 40/50 marks, the
test is not said to be reliable.
iii. Useability: The test or evaluation instrument should
be useable. In other words, it should be practicable
or administerable. An evaluation instrument may be
highly “good” but if it is not possible to test the
student with that it is good for nothing. For example,
it is not possible to administer a test to assess
students performance which takes eight hours. So
the test designed on these lines is not useable.
iv. Suitability: A test should be suitable to the mental
maturity level and physical readiness of the
students. For example, it is not suitable to ask a
beginner of English to write an essay on ‘Journey to
the Moon’ in this language. Similarly, an advanced
level student may not be asked to tell spellings of
simple words like ‘boy’, ‘girl’ etc.
v. Motivationality: The evaluation tool, test, etc.
designed for the purpose should motivate the
students, teachers and others involved in the
process to accelerate their efforts in achieving the
predetermined objectives of teaching. Any test or
evaluation tool that leaves a negative impact upon
them or frustrates them, is not a good test.
vi. Objectivity: The, evaluation should be designed in
such a way that it comes out to be an objective
instrument for measuring the intended
characteristics. In other words, it should not be
prone to any subjective element or personal baised
opinion of anyone.
vii. Scoreability: A test should be easy to be scored so
that the scorer does not feel exhausted or bored. A
test which is difficult to be scored makes the
evaluator lose his interest in the whole process which
is likely to affect the objectivity of the same.
518
1.6 Self-assessment questions-I
1. What do you understand by evaluation? Differentiate it
from other terms like measurement, research, testing.
2. What are the major purposes served by evaluation? Give
examples in support of your answer.
3. Elaborate the significance of evaluation in education.
4. Encircle; the most appropriate answer:
i. A test is valid if:
a. It can be scored easily.
b. It measures what it should.
c. It can be administered easily.
d. All of the above.
ii. Mr. Ali got 20/50 marks in a test of English
language. The teacher administered the same test
to him just after half an hour. This time Mr. Ali got
40/50 marks. What is the most appropriate
characteristic of the test:
a. The test is not objective.
b. The test is not scoreable.
c. The test is not reliable.
d. The test is not administerable.
iii. Which one of these is the quality of a good test?
a. Validity
b. Reliability
c. Scoreability
d. All of the above
5. Complete the following sentences/statements by filling
the gaps with the most appropriate Words/phrases:
i. _________ is broader than measurement.
ii. Measurement is the _________ aspect of evaluation.
iii. Evaluation tells as to how far we have achieved the
____________ of education.
519
2. TECHNIQUES OF EVALUATION IN LANGUAGE
TEACHING
As has generally been accepted, the main aims of
language teaching are very commonly defined in terms of four
skills, i.e. speaking, understanding speech (or listening), reading
and writing. According to H. G. Widdowson, speaking and
listening are said to relate to language expressed through the
aural medium and reading and writing are said to relate to
language expressed through visual medium.
D. P. Harris has recommended the following techniques
for evaluating different aspects of language learning.
520
composition tests. The learner is required to write
very brief in a highly structured way.
521
2.3 Use of essay type versus objective type tests
522
2.4 Assigning grades
523
task of the teacher easier, we may suggest a sort of a checklist
as given below. By having a glance at this chart you can
instantly come to know the aspects of learning English in which
some of the students need your special attention.
2.5 Conclusion
The above list of techniques of evaluating students'
performance in oral and written English is not exhaustive. Since
the process of evaluating and assessing students performance in
spoken as well as written English has vide spectrum, so should
be the number and variety of techniques for assessment
purposes. As understood in this way and also keeping in view
the multifarious limitations in our educational institutions, the
English teacher may also make, conceive and design certain
other techniques for evaluating students' performance in spoken
as well as written English. Though these techniques and
procedures are not that formal and structured as the ones you
have just gone through, yet their significance cannot be
questioned. They do provide very valuable information to the
524
teacher on the basis of which he can come to appreciate the
students' performance. These techniques include the following:
1. Statement of standards
2. Models
3. Score cards
4. Questionnaires
5. Attitude scales
6. Progress charts
7. Meetings with students
8. Puplis' folders
9. Teachers logs
2.6 Activity
4.
5.
525
2.7 Self-assessment questions-2
c. Writing
d. Both (a) and (b)
a. Written translation
b. Dictation
c. Multiple-choice items.
d. Loud reading
526
b. Creative writing
c. Mechanics of writing
d. All of the above
527
Petty and Jensen have rightly pointed that self-evaluation
based on standards that children set themselves, should be an
important part of the evaluation. For example, a class might
adopt a list of “rules” for giving; an oral report similar to the
following one and use it as the basis for judging the
effectiveness of their reports:
528
Finally, teachers can check students' self-evaluation by
using a checklist that may correspond to the one we have
already given in one of the previous sections of this unit.
529
3.4 To make the objectives of evaluation clear to the
students
We have repeatedly mentioned in this unit the fact that
evaluation has, always to be based on the pre-determined
objectives of language teaching. So in order to ensure a
purposeful- evaluation and improvement in students learning, it
is highly essential to make the students clear about objectives
against which they are going to be tested and evaluated. This
would put the students in a situation they would ask themselves
the questions like the following:
530
preferably come later and not earlier than the
announced dates.
531
4. Try to arrange the evaluation experiences/activities
in such a manner that they lead to the feelings of
maximum success on the part of the students.
3.8 Activity
Since evaluation occupies a significant place in the
instructional process, make sure that your evaluation of
students’ performance in oral and written English takes care of
different aspects of the evaluation process as well as the
content. Follow the example given in the checklist and complete
the rest of it to the extent you can.
S.No. Points Yes No
Example:
1. Is the test objective?
2. Is it administerable?
3. Does it motivate the students?
Is it suitable for evaluating
students' intonation?
532
2. Why is it essential to relate instructional outcomes with
the objectives of teaching English? Give examples in
support of your answer.
3. Discuss with examples the major considerations that may
be taken into account for improving students learning
through the use of evaluation.
4. Encircle TRUE or FALSE with reference to each of the
statements given below:
i. Cognitive domain of objectives refer to
attitudes and values. True/False
533
4. ANSWERS TO THE SELF–ASSESSMENT QUESTIONS
Exercise–1
Saq: 1–3, Please compare your answers with the relevant
sections of the unit
Q: 4. i. B ii. c iii. d
Q: 5. i. Evaluation ii. Quantitative iii. Objectives
Exercise–2
Q: 1–4. Please compare your answers with the relevant
section of the unit
Q: 5. i. c ii. b iii. a iv. a
Exercise–3
Q: 1–3. Please compare your answers with the relevant
sections of the unit.
Q: 4. i. F ii. T iii. F iv. F
v. F vi. T vii. F viii. F
ix. T x. T
534
5. BIBLIOGRAPHY
Ahmann, J. S. and Glock, M. D: Evaluating student progress:
Principles of Tests and Measurements, Allyn and Bacon, Inc.
Boston: (1981)
535
Stern, H. H (1984): Fundamental Concepts of Language
Teaching, Oxford University Press, Oxford:
Thorndike R L. and Hagen, E. (1969): Measurement and
Evaluation in Psychology and Education, John Wily & Sons, Inc.
New York:
Widdowson, H. G (1979): Teaching Language as
Communication, Oxford University Press, London:
536