Professional Documents
Culture Documents
Unit 15 Developing Valid Grading Procedures: Structure
Unit 15 Developing Valid Grading Procedures: Structure
Unit 15 Developing Valid Grading Procedures: Structure
15.1 Introduction
15.2 Objectives
15.3 Limitations of Marking System
15.4 What is Grading?
15.5 Direct and Indirect Grading
15.6 Absolute Grading
15.6.1 ~im~tations of Absolute Grading
15.6.2 Utility of Absolute Grading: Criterion Referenced Grading
15.7 Relative Giading
I
15.7.1 Grading on the Curve: Norm Referenced Grading
15.7.2 Merits of Relative Grading
15.7.3 Limitations of Relative Grading
15.8 Grading Students' Performance in Different Types of Questions?
15.8.1 Grading Performance in Objective-type Questions (Fixed Response
Questions)
15.8.2 Grading Performance in Free Response Questions
15.9 Calculating Overall Grades in a Subject
15.10 Comparison of Overall Performance
15.11 LetUsSumUp
~ 15.12
15.13
15.14
Unit-end Exercises
Answers to Check Your Progress
Suggested Readings
15.1 INTRODUCTION
Assigning numerical marks to students suffers fiom various types of flaws and
need reforms. One of the reforms suggested is to use grading system instead of
marking system. In this unit we will discuss the concept of assigning grades in
place of numerical marks to answer Scripts. You will also be able to understand
the relative advantage of grading system over marking system. The meaning
and types of grading will be explained to you. As a teacher you have to assess
your students for various purposes like for certification or promotion, for
judging their learning achievement in terms of both cognitive and non-
cognitive domains. How can grades be awarded in these situations? The unit
will not only provide an answer to this question but also explain the
mechanism of awarding grades and their interpretations in various situations.
Student Performance:
Interpretation 15.2 OBJECTIVES
differentiate and use the grading system in criterion referenced and norm-
- referenced testing,
compare overall performance of students in different subjects by
calculating GPA.
Our natural perception about quality of any thing is qualitative rather than
quantitative and it is often represented in terms of adjectives like good,
bad, excellent etc. rather than 32 and 33.
Many of the human traits cannot and should not be measured in
quantitative terms and therefore all learning outcomes cannot be assessed
by adopting marking system.
Though marks are considered as absolute and precise measure of a
student's performance but in reality they are merely an estimation of a
student's performance because of error of measurement due to variations in
examiners and examinees. Let us elaborate this point further.
Marks obtaiced in different years in the same courses of study are also
not the true measure of students' level of achievement or proficiency in
the course because of the varying standard of question papers in
different years. In many of the public examinations there is a provision
of grace marks. Grace marks are arbitrarily decided quantum of marks
which can be distributed to one or more subjects to change the status of
a student with the addition of marks (from fail to compartment, from
compartment to pass and so on). Thus, grace marks benefit the border
line cases by changing their status. This has been called as
'contamination of marks' and this reduces them to the figures, which
are fake, fabricated and false (Srivastava, 1999).
t
15.4 WHAT IS GRADING?
Now you know that grading is also a way of reporting students' achievement.
There are different domains of learning and hence there may be different
purposes of evaluation. Accordingly different methods are adopted for
assigning grades. In this section, you will become familiar with various
methods of grading.
Direct grading: There are some occasions when it is neither desirable nor
feasible to measure learning performance in terms of quantitative measures and
hence assessment is made qualitatively. For example, in many of the
nonscholastic areas, learning outcome in terms of attitudes, values, interests,
etc. may not be assessed precisely in quantitative terms and thus it is desirable
for a teacher to assess these qualitatively using observations and experiences
gathered through interaction with the students. If the assessment is reported by
assigning letter grades, the method is known as direct grading. Thus when a
student's performance (in an activity or in response to a question) is assessed
qualitatively by the evaluator through assigning letter grades like A for
'outstanding', B for 'very good', C for 'good', D for 'satisfactory' and F,for
'unsatisfactory', the method is known as 'direct grading'. This method can be
used for grading both cognitive and noncognitive learning outcomes. But it is
normally used when the number of questions or testing situations are few and
the number of examinees are also few. The method is preferred for assessment
of noncognitive learning outcomes. The merits of direct grading are: (i) it
minimizes the interexaminer variability; and (ii) it is easier to use when
compared with other methods of grading. However, direct grading lacks
objectivity and precision and also diagnostic value.
Here the categories are made on the basis of the existing conventional standard
which is generally followed in our public examinations and the criterion for
making such categories is arbitrary. In this example five categories are made,
but one can make any desired number of categories provided that each grade is
associated with a predefined standard. This is explained in the followirlg
example in which we have nine categories starting from outstanding to
unsatisfactory using letter grades A,B.. ... ... ....., H, I:
In these two examples you might have noted that the categories are predefined
(as given under the heading description) and each grade is associated with
specific predefined standard.
Inspite of the limitations of absolute grading, the system has certain merits
which are described as under:
(i) The procedure of assigning absolute grades is quite simple and straight
forward.
(ii) It reflects the individual performance in a particular subject without any
reference to the group helshe belongs
After following these steps, the students' performance may be assigned letter
I
grades in terms of the degree to which the objectives have been attained as
illustrated below:
t
Letter Grade Specification
i
I
A Outstanding: Student who has mastered all the major
and minor objectives of the course.
B Very Good: Student who has mastered all the major and
most of the minor objectives.
In the first two illustrations, the categories are made on the basis of a range of
fixed percentage of scores and each category is assigned a specific letter grade.
However these percentages do not necessarily refer to the percent of mastery
and therefore, to adopt absolute grading for criterion referenced evaluation the
categories must be made on the basis of predefined performance standard in
t-s of achievement of learning outcomes as shown in the third illustration.
b) Compare your answers with those given at the end of the unit.
By now you have learnt that the purpose of evaluation is manifold. First,
through evaluation we can assess the student's level of performance in terms of
mastery in the content or domain of behaviour as discussed in the preceding
section. Second, the purpose of evaluation is also to provide the relative
performance of a stuclent in a group to which helshe belongs. In this
competitive world most of our decisions are based on the relative position of a
student in terms of hislher level of achievement in relation to others. This type
of evaluation is often known as norm referenced evaluation. In this evaluation,
we rank the student in a group on the basis of hisher relative level of
achievement. The grades, generally kn&n as relative grades or norm
referenced grades may be assigned in such a situation. This grading is very
different from absolute grading. Relative grading or norm referenced grading is
the process of-assigning letter grades to students on the basis of ranking them
on their relative level of achievement in a particular group. For this method of
grading a decision is made in advance about approximately what percentage or
proportion of students would be awarded a particular letter grade on the basis Developing Valid Grading
of their relative performance. Procedures
For example, a decision may be made that top 10% to 20% of the students will
be assigned 'A' grade and so on, as given below:
The most common method of grading is that of assigning grades on the basis
of a normal curve. That is why this type of grading is often called as grading
on the curve. The normal curve has certain characteristics as follows:
The curve is symmetrical around its vertical axis called ordinate and is
asymptotic (expends from - oo to + oo) .
For the same distance above and below the mean, same percentage of cases
lie and it is always fixed provided that the distance is measured in standard
deviation unit.
Keeping in view the above two characteristics we may divide the curve into a .
Similarly the curve may be divided into seven or nine parts. The grade-wise
distribution of cases for nine point grade system is illustrated below:
1.75 o tom 4%
1.25 o to 1.75 o 7%
0.75 o to 1.25 o 12%
0.25 o to 0.75 o 17%
- 1.750 to- 1 . 2 5 ~ 7% H 1
' - m to- 1.750 4% I 0
You might have understood fiom the above two illustrations that in the method
of grading on the curve, a fixed percentage of subjects depending upon their
relative performance in a test, is awarded a particular grade. For example, on a
9 point grading those 4% of the total students who score highest marks will be
awarded 'A' whereas in case of 5 point grading 7% of students scoring highest
marks will be assigned grade 'A'. It is evident fiom these illustrations that the
grade obtained by a student does net depend on his own performance in
absolute term but it also depends on the relative performance of others who are
in the same groups. Relative grading, like any other grading, has certain.merits
and limitations.
15.7.2 Merits of Relative Grading
Relative grading has many merits. The important merits are is follows:
(i) Relative system is based on the assumption that achievement (true
measure) is normally distributed and a grade assigned to a particular
student reflects hisher position in the group in terms of hidher level of
achievement. In one subject helshe may be wsigned D after obtaining 35
marks where as in other subject helshe may be assigned E for scoring the
same and therefore no grade signifies the hilure of a student. Thus the
negative effect of pass and fail is completely eliminated by adopting this Developing Valid Grading
grading system. Procedures
(iij As mentioned earlier this grading provides the relative position of different
students in a group, that is why it can be used for comparative judgement
as required in norms referenced testing.
1 (iii)Difficulty level of the test does not effect this type of grading because it is
based on the judgement of comparative performance.
(iv) Since this grading is on the normal curve, comparability across the
cumcular areas is easily possible.
!
(v) Undue emphasis on raw score is minimized.
(vi) Inter examiner variations are also minimized through this grading.
This grading like other gradings also has some limitations. These are:
b) Compare your answers with those given at the end of the unit.
As you know, there are varieties of questions. Some are objective type
questions which have fixed response whlle some others are fiee response
questions which can be further classified into essay type questions and short
answer type questions. The performance in these types of questions is graded
Student Performance:
Interpretation directly in different ways. In the following paragraphs you will learn the
procedure of grading the performance in different types of questions.
When the question is objective type it has only two types of responses, one is
wholly correct where as all others are completely wrong. Thus it can be graded
only on two point scale: 1 for correct response and 0 (zero) for wrong
response. The combined grade in a test of such questions may be calculated by
using the following formula on a nine-point scale where scale value range from
0 to 8.
Suppose, in a test there are 20 objective type questions. Out of these 15 are
correctly attempted by a student. The combined grade will be:
15
Combined Grade Value (point) :-x 8 = 6
20
Grade A B C D E F G H I
Grade Value 8 7 6 5 4 3 2 1 0
Free response questions may be essay type questions and short answer type
questions. The grading procedure and calculation of combined grade in the two
types of questions are different and therefore explained separately.
The combined grade in essay type questions may be calculated by using the
following formula:
Sum of the numerical values of the grades in different essay type questions
Combined Grade :
The total number of essay type questionss
Suppose there are five essay type questions and a students gets By C, Developing Valid Grading
D, E, and A, on a nine-point scale (scale value 0-8) in these questions. Then Procedures
I
the grade value for these five grades are 7,6,5,4 and 8 respectively.
7 + 6 + 5 + 4 + 8 30
Combined grade = =-=6
5
i 6 is the grade value for the grade 'C'. So the combined grade will be 'C'
Outstanding
Very Good
Average
Marginal
Poor
To find out the combined grade in short answer type questions the following
formula may be used. The combined grade is expressed on a nine-point scale
having 0-8 numerical grade value.
1 Suppose if there are 10 short answer questions and they are graded as ByA, C,
i D, C, E, ByBy C, and E, their corresponding numerical grade value on a five-
I
point scale (0-4) will be 3,4, 2, 1 , 2 , 0 , 3 , 3 , 2 , and 0, respectively.
3+4+2+1+2+0+3+3+2+0 x2
Therefore the combined grade value :
10
You have already seen that 'E' is the grade for the numerical grade value 4 on
a nine-point scale (0-8). Therefore the student will get a grade 'E' on a nine
point scale in the test having 10 short answer type questions.
Essay type
Short answer type 10 E '4
Objective type 20 C 6
The overall grade obtained by the student in the question paper can be
calculated by using the following formula:
In the above example we have three different types of questions and their grade
values are given. Now let us apply the above formula.
Overall grade =
6+4+6
- -
16
=-=5.33=5
Let us try to understand the method of calculating GPA with the help of
following illustration:
Grade A B C D E F G H I
Grade Value 8 7 6 5 4 3 2 1 0
8+7+8+7+7 37
GPAof Y = - -= 7.4
-
5 5
Since the GPA obtained by Y is greater than that obtained by X, the overall
performance of Y is better than that of X. You can compare this way the
overall performance of any number of students.
1. Take the scores obtained by all the students of class IX in last year annual
examination in the subject you are teaching and convert them in grades by
taking nine-point scale on the curve.
2. Prepqre an observation schedule to asses the disciplinary behaviours or
good manner of students in a class. Grade the students' performance and
prepare a report.
3. Discuss the limitations of adopting grading on the curve for reporting
students' performance.
4. Why do we often prefer five-point grading scale over nine-point scale to
report performance in noncognitive area?
Developing Valid Grading
15.13 ANSWERS TO CHECK YOUR PROGRESS Procedures
1. A. Though aggregate scores of both the students are same, yet their
performance in the two subjects is not the same.
I
!
,
their performance is not the same in the two subjects.
C. Grades are the means of reporting a student's performance1
achievement. It is neckssary that grading symbols used should be
clearly spelt out and defined so that they are uniformly understood by
I all concerned - teachers, students, parents, etc. and are adhered to by
I
each examiner.
(i) It enables the student to know hisher strengths and weaknesses, thus
serving the diagnostic purpose.
(ii) It is based on face value of measured scores and therefore ignores the
errors of measurement creeping in due to various types of subjectivity.
(iii) Cutoffs for different categories are arbitrarily decided and are not
based on any scientific procedure.
1. Overall grade = D
Student GPA