Lesson 6 Application

An English teacher administered a spelling test to 15 students. The spelling test

is composed of 10 items. Each item is encoded, wherein a correct answer is marked as
“1”, and the incorrect answer is marked “0”. The grade in English is also provided in the
column. The first five are words with two stresses, and the next five are words with a
singles stress. The recording is indicated in the table.

Your task is to determine whether the spelling test is reliable and valid using the
data to determine the following: (1) split half, (2) Cronbach’s alpha, (3) predictive validity
with the English grade, (4) convergent validity of between words with single and two
stresses, and (5) difficulty index of each item.

Student Item 1 Item 2 Item 3 Item 4 Item 5 Item 6 Item 7 Item 8 Item 9 Item Englis
No. 10 h
Grade

1 1 0 0 1 1 1 0 1 1 0 80

2 0 0 0 1 1 1 1 1 0 0 81

3 1 1 0 0 1 0 1 0 1 1 83

4 0 1 0 0 1 1 1 1 1 0 85

5 0 1 1 0 1 1 1 0 1 1 84

6 1 0 1 0 1 1 1 1 1 1 89

7 1 0 1 1 1 1 1 1 0 1 87

8 1 1 1 0 1 1 1 1 1 1 87

9 1 1 1 1 1 1 1 1 0 1 89

10 1 1 1 1 0 0 1 1 1 1 90

11 0 1 1 1 0 1 1 1 1 0 90

12 1 0 1 1 1 1 1 1 1 1 87

13 1 1 1 1 1 1 1 0 1 1 88

14 1 1 0 1 1 1 1 1 1 1 88
 15 1 1 1 1 1 0 1 1 0 1 85

ODD EVEN
X Y X^2 Y^2 XY
80 81
80
6 36 6400 86
83 85
81
5 25 6561 86
84 89
83
6 36 6889 89
87 87
85
6 36 7225 91
89 90
84
7 49 7056 91
90 87
89
8 64 7921 97
88 88
87
8 64 7569 95
85
87
9 81 7569 96
Split 0.750497
Half
89

9 81 7921 98
90
8 64 8100 98
90
7 49 8100 97
87
9 81 7569 96
9 88 81 7744 97
9 88 81 7744 97
8 85 64 7225 93
11159
114 1293 892 3 1407
Pearson
0.731066
R
 ANOVA
Source of
Variation SS df MS F P-value F crit
Rows 16.12143 13 1.24011 1.455816 0.144741 1.804692
Columns 92898.64 9 10322.07 12117.5 2.7E-169 1.960818
Error 99.66429 117 0.851832

Total 93014.42 139

Cronbach’s
0.3131
Alpha

Item
Student No. Item 1 Item 2 Item 3 Item 4 Item 5 Item 6 Item 7 Item 8 Item 9
10
14 1 1 0 1 1 1 1 1 1 1
13 1 1 1 1 1 1 1 0 1 1
12 1 0 1 1 1 1 1 1 1 1
9 1 1 1 1 1 1 1 1 0 1
Score 4 3 3 4 4 4 4 3 3 4
Proportion of
the High Group 1 0.75 0.75 1 1 1 1 0.75 0.75 1

Lower 27% of the Class

1 1 0 0 1 1 1 0 1 1 0
4 0 1 0 0 1 1 1 1 1 0
3 1 1 0 0 1 0 1 0 1 1
2 0 0 0 1 1 1 1 1 0 0
Score 2 2 0 2 4 3 3 3 3 1
Proportion of
the Low Group 0.5 0.5 0 0.5 1 0.75 0.75 0.75 0.75 0.25

Item Difficulty 0.75 0.625 0.375 0.75 1 0.875 0.875 0.75 0.75 0.625
Discrimination
Index 0.5 0.25 0.75 0.5 0 0.25 0.25 0 0 0.75

Predictive Validity: The assessment is valid because accurately predicted the future
grades of the students. The higher 27% of the assessment takers got higher grades in
their English subject. Whereas the lower 27% of the test takers are also the students
that got the lowest grades in this subject.

Convergent Validity: The assessment is valid because both single and two stressed
words are measuring the same construct, which is the learner's ability to spell the words
correctly. This is further supported by the fact that learners' performance has shown,
through their scores, that they can spell both single and two-stressed words.