Professional Documents
Culture Documents
Prof Kuhns Repot Final
Prof Kuhns Repot Final
By
J.S.Ditshego
Bed Hons
2008
Report on test and item analysis
Bed
Hons
2008
Computer Integration
ii
Acknowledgements
iii
Descriptive abstract
iv
Table of content
No Content Page
List of tables vi
List of figures Vii
1 Introduction 1
2 Purpose of the report 1
3 Procedure 1
4 Test analysis 2
4.1 Descriptive statistics 2
4.2 Frequency graphs 3
4.2.1 Grouped frequency table 3
4.2.2 Cumulative frequency 3
4.2.3 Frequency histogram 4
4.2.4 Frequency polygon 5
4.2.5 Cumulative frequency graph 6
4.3 Reliability coefficient of a test 6
5 Item analysis 8
5.1 Difficulty and discrimination of a set of 8
test scores
6 Conclusion 12
7 References 13
8 Appendices 14
8.1 Appendix A 14
8.2 Appendix B 15
8.3 Appendix C 16
List of Tables
v
Table 4 Coefficient of reliability 7
List of figures
vi
Terminology List
Term Definition
Mean Define as the average of scores
Mode It is the score that occurs most frequently
Median It is the score that divide the distribution
into two halves
Reliability coefficient Defined as the extent to which the test is
likely to give consistent scores (Borich &
Kubiszyn ).
vii
STEDV It s the value that include all the scores in
a distribution. It as an estimate of
variability, and includes the mean in the
distribution.
Descriptive statistics Describe basic features of data
Item analysis Described as statistical analysis which
shows the effectiveness of individual test
items (Borich & Kubiszyn).
1 Introduction
viii
(Refer to Appendix B).The quality of individual test items/ question is
assessed by comparing student’s item responses to their total scores.
The summary of the performance of the test is shown in (Appendix
A).
3 Procedures
The spread sheet was used to collate from twenty students. Twenty-
five multiple choice test items were administered to twenty students.
Microsoft Excel was used to calculate scores. The scores were used to
calculate mean, median mode and standard deviation. These values
were used to get a normal distribution graph. Three graphs were
drawn using Microsoft Excel. Reliability coefficient was calculated
using kuder-Richardson equation (i.e. K20).Difficulty index (p) and
discrimination index were also calculated using questions and results
from the test.
4 Test analysis
ix
Table 1: Descriptive statistics
Mean 65
Mode 65
Median 65
STEDV2 479.57
STEDV 21.90
The table shows that the mean, median and mode are the same
hence it is a normal distribution curve. The rational here is that if the
distribution is truly normal, the mean, median, and mode are all
equal to each other i.e. (bell-shaped) as referenced in Figure 1
x
The highest score and the lowest score are used to find the range.
The number of intervals is a choice. The size of the interval is from
eighty (range) divided by ten (number of intervals).
L (Lowest value) 20
Range 80
Number of intervals 10
Size of interval 8
16 23 16-23 19.5 1 1
24 31 24-31 27.5 2 3
32 39 32-39 35.5 0 3
xi
40 47 40-47 43.5 2 5
48 55 48-55 51.5 3 8
56 63 56-63 59.5 2 10
64 71 64-71 67.5 6 16
72 79 72-79 75.5 1 17
80 87 80-87 83.5 3 20
88 95 88-95 91.5 3 23
xii
Frequency histogram
cy 7
n 6
e 5
u 4
q 3
e 2
Fr 1
0
23 31 39 47 55 63 71 79 87 95 103
16 24 32 40 48 56 64 72 80 88 96
Interval
Frequency Polygon
7
6
5
Frequency
4
3
2
1
0
1
Middle values
xiii
Cumulative frequency is drawn by using cumulative frequency values
and upper values. Cumulative frequency graph is shown in Figure 5.
30
25
Frequency
Cumulative 20
15
10
5
0
3
39
71
23
55
87
10
Upper values
xiv
KR20 = (k/k-1) (1-∑pq/∂2)
Where:
K=No of items
p=Proportion that passed
q=Proportion that failed
∂2=Variance
The values used to calculate KR20 are referenced in Table 4.
K 20
K-1 19
Total pq 3.83
(SD)2 479.6
KR20 1.03
It is evident from the table that the value of KR20 is 1.04; this implies
that the test has a perfect reliability.
5 Item analysis
xv
Item analysis is described as statistical analysis which shows the
effectiveness of individual test items (Borich & Kubiszyn).
The questions and the results from the test were used to describe
the difficulty of each question and the corresponding discrimination
index as referenced in Table 5
xvi
Difficulty index
#Questions #Correct #Answered p
Q14 21 25 0.84
Q15 20 25 0.80
Q16 22 24 0.92
Q17 15 24 0.63
Q18 8 24 0.33
Q19 13 25 0.52
Q20 16 25 0.64
xvii
Questions Proportions Interpretation Reason
Q6 0.68 Acceptable Fine
Q7 0.44 Acceptable Fine
Q8 0.52 Acceptable Fine
Q9 0.52 Acceptable Fine
Q10 0.33 Acceptable Fine
Q11 0.92 Unacceptable Too easy
Q12 0.76 Unacceptable Too easy
Q13 0.60 Acceptable Fine
Q14 0.84 Unacceptable Too easy
Q15 0.80 Acceptable Fine
Q16 0.92 Unacceptable Too easy
Q17 0.63 Acceptable Fine
Q18 0.33 Acceptable Fine
Q19 0.52 Acceptable Fine
Q20 0.64 Acceptable Fine
xviii
The discrimination index is used to ability of test items to
distinguish between the lower and the upper group of students
taking the test as shown in Table 7
Level Value
Upper 15
Lower 10
Discrimination index
#U #L D
15 6 0.60
15 7 0.53
14 3 0.73
8 4 0.26
15 6 0.60
12 5 0.46
9 2 0.46
10 2 0.53
xix
Table 8: Discrimination index (D) (continued)
Discrimination index
10 3 0.46
8 0 0.53
14 9 0.33
14 5 0.60
12 3 0.60
15 6 0.60
14 6 0.53
15 7 0.53
12 3 0.60
5 3 0.13
12 1 0.92
11 5 0.40
5 Conclusion
The value of KR20 is 1.04; this implies that the test is reliable.
Students who answered a gives question correctly is likely to
answer other questions correctly. The other implication is that
should another test be administered using similar items, the relative
scores of students would show very little change.
7. References
xx
1 A Guide to interpreting the item Analysis
Report.(2004).Retrieved April 01 2008, from
http://www.asu.edu/uts/InterplAS.pdf
xxi
8 Appendices
8.1 Appendix A
xxii
Key C B D D B C D A C B A C B D A A C D B C
St
No Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 Q19 Q20
1 C B B A C D A D D A D A A A A C B D B
2 C B D D B D A A C B A C B D A A C D B C
3 C B D D B C D A C B A C B D A A C B D C
4 C B D B B C B A C B A C A D C A C B C C
5 C B D C B C B A C D A C B D A A A B B C
6 C A D D C C A D C D A C A D A A A B D C
7 B B A B B C B B D D A C B D C A A D D C
8 C B D B B C B D B C A C B D A A C A B A
9 C B D A B C D D B D A C B D A A C B D A
10 C B B A B C D C D C A B A D D A C D B C
11 C B D D B C D A C B A C B D A A C D B C
12 C B D D B C D D D A A C A D A A C B B D
13 C B D A B C D A C B A C B D A A A B B C
14 C B D A B C D A C B A C B D A A A B C
15 C B D D B B A A B D A C D A A C B B D D
16 C B D D B C D A C B A C B D A A C D B C
17 B B C C B A D D C A D B D A C A D
18 C B B D B A D D D D A C A D A A C B B C
19 D C A D B A B A D C C D A A D B B B A B
20 C B D D B C D A C A C D B D A A C D B C
21 C A D D C C A D C D A C A D A A A B D C
22 B B A B B C B B D D A C B D C A A D D C
23 C B D B B C B D B C A C B D A A C A B A
24 C B B A C D A D D A D A A A A C B D B
25 C B D D B D A A C B A C B D A A C D B C
8.3 Appendix C
Key C B D D B C D A C B A C B D A A C D B C
St
No Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 Q19 Q20 Total %
25 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 18 100
24 1 1 0 0 0 0 0 0 0 1 0 0 0 1 1 1 0 0 0 6 100
23 1 1 1 0 1 1 0 0 0 0 1 1 1 1 1 1 1 0 1 1 13 90
22 0 1 1 0 1 1 0 0 0 0 1 1 1 1 0 1 0 1 0 0 10 90
21 1 0 1 1 0 1 0 0 0 0 1 1 0 1 1 1 0 0 0 1 11 90
20 1 1 0 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 17 85
19 0 0 1 1 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 4 85
18 1 1 1 1 1 0 1 1 0 0 1 1 0 1 1 1 1 0 1 1 13 85
17 0 1 0 0 1 0 1 1 1 1 0 1 1 1 0 0 0 8 75
16 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 20 70
15 1 1 0 1 1 0 1 0 0 0 1 1 0 0 1 0 0 0 0 0 9 70
14 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 17 65
13 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 0 0 1 1 17 65
12 1 1 1 1 1 1 1 1 0 0 1 1 0 1 1 1 1 0 1 0 14 65
11 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 20 65
10 1 1 0 0 1 1 1 0 0 0 1 0 0 1 0 1 1 1 1 1 12 60
9 1 1 1 0 1 1 1 0 0 0 1 1 1 1 1 1 1 0 0 0 13 55
8 1 1 1 0 1 1 0 0 0 0 1 1 1 1 1 1 1 0 1 0 13 55
7 0 1 0 0 1 1 0 0 0 0 1 1 1 1 0 1 0 1 0 1 10 50
6 1 0 1 1 0 1 0 1 1 0 1 1 0 1 1 1 0 0 0 1 11 50
5 1 1 1 0 1 1 0 1 1 0 1 1 1 1 1 1 0 0 1 1 15 45
4 1 1 1 0 1 1 0 1 1 1 1 1 0 1 0 1 1 0 0 1 14 40
3 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 1 18 30
2 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 18 30
1 1 1 0 0 0 0 0 1 0 0 1 0 0 0 1 1 1 0 0 0 6 20