LANGUAGE TESTING AND EVALUATION

ITEM ANALYSIS ( FACILITY VALUE, INDEX OF DESCRIMINATION,

REALIABILTY AND VALIDITY)

BY:

AGNIA SRI WIDIASTUTI

A1M219023

CLASS A

ENGLISH EDUCATION DEPARTMENT

FACULTY OF TEACHER TRAINING AND EDUCATION

HALU OLEO UNIVERSITY

2021
QUESTION TEST REPORT

1. The purpose of making questions test :

The test of these questions was carried out to test the facility value, the index of
discrimination, reliability and validity of these questions. These questions are designed to test
the grammar and reading skills of university level students.

2. Data collection :

The questions were made up of 50 multiple choice questions and their distractors.

Questions link : https://forms.gle/LEZVLi5sVtrbjHBR9

The respondents consisted of 30 students from various universities, majors and semester.
27 respondents from Halu Oleo University, 1 respondent from Poltekkes Kemenkes Kendari,
1 respondent from Politeknik Negeri Jember, and 1 respondent from Universitas Negeri
Jakarta.
 The test was carried out on December, 17-18, 2021. The test was carried out using a
google form and was carried out online by distributing a google form link to each
respondents via Whatsapp.

3. Test result :

 Index of difficulty (facility value)

R
FV = N

Questions:

13 27
1. FV = = 0,4 2. FV = = 0,9
30 30
 0 25
3. FV = =0 19. FV = = 0,8
30 30

15 27
4. FV = = 0,5 20. FV = = 0,9
30 30

21 19
5. FV = = 0,7 21. FV = = 0,6
30 30

17 23
6. FV = = 0,5 22. FV = = 0,7
30 30

24 15
7. FV = = 0,8 23. FV = = 0,5
30 30

11 25
8. FV = = 0,3 24. FV = = 0,8
30 30

19 24
9. FV = = 0,6 25. FV = = 0,8
30 30

16 10
10. FV = = 0,5 26. FV = = 0,3
30 30

24 5
11. FV = = 0,8 27. FV = = 0,1
30 30

13 27
12. FV = = 0,4 28. FV = = 0,9
30 30

17 9
13. FV = = 0,5 29. FV = = 0,3
30 30

8 20
14. FV = = 0,2 30. FV = = 0,6
30 30

17 14
15. FV = = 0,5 31. FV = = 0,4
30 30

20 17
16. FV = = 0,6 32. FV = = 0,5
30 30

22 7
17. FV = = 0,7 33. FV = = 0,2
30 30

8 16
18. FV = = 0,2 34. FV = = 0,5
30 30
 12 6
35. FV = = 0,4 43. FV = = 0,2
30 30

10 10
36. FV = = 0,3 44. FV = = 0,3
30 30

14 13
37. FV = = 0,4 45. FV = = 0,4
30 30

14 19
38. FV = = 0,4 46. FV = = 0,6
30 30

25 11
39. FV = = 0,8 47. FV = = 0,3
30 30

18 17
40. FV = = 0,6 48. FV = = 0,5
30 30

15 15
41. FV = = 0,5 49. FV = = 0,5
30 30

16 8
42. FV = = 0,5 50. FV = = 0,2
30 30

The results shows how easy or difficult the particular item proved in test. Here, I use FV
of 0,3 -0,7. From the data above, it can be seen that there were 16 questions that were
eliminated where these questions did not meet the existing standards. The eliminated
questions are question number 2, 3, 7, 11, 14, 18, 19, 20, 24, 25, 27, 28, 33, 39, 43, and 50.
So, from this stage the number of questions is 34 questions left of 50 questions.

 The index of descrimination

First of all, I determined the standard correct answer value for the upper and lower groups.
Then, I checked each respondent's answer and divided the number of respondents into upper
and lower groups according to the number of correct answers.

The number of correct answers : 1 – 24 = Lower group.

25 – 50 = Upper group.

From this determination, the lower and upper groups were formed, each consisting of 15
respondents

The result shows :

The index of descrimination :

Correct upper−Correct lower

D=
n(for one group , different¿ N total)
Questions :

9−4 12−8
1. D = = 0,3 30. D = = 0,2
15 15
10−5 11−2
4. D = = 0,3 31. D = = 0,6
15 15
13−8 12−5
5. D = = 0,3 32. D = = 0,4
15 15
12−5 10−5
6. D = = 0,4 34. D = = 0,3
15 15
10−1 10−2
8. D = = 0,6 35. D = = 0,5
15 15
10−9 7−3
9. D = = 0,07 36. D = = 0,2
15 15
10−6 9−4
10. D = = 0,2 37. D = = 0,3
15 15
9−4 11−3
12. D = = 0,3 38. D = = 0,5
15 15
12−5 12−7
13. D = = 0,4 40. D = = 0,3
15 15
11−6 11−5
15. D = = 0,3 41. D = = 0,4
15 15
12−8 10−6
16. D = = 0,2 42. D = = 0,2
15 15
14−5 7−2
17. D = = 0,6 44. D = = 0,3
15 15
8−11 10−3
21. D = = - 0,2 45. D = = 0,4
15 15
14−9 13−6
22. D = = 0,3 46. D = = 0,4
15 15
9−6 6−5
23. D = = 0,2 47. D = = 0,06
15 15
6−3 12−5
26. D = = 0,2 48. D = = 0,4
15 15
7−2
29. D = = 0,3
15
 8−5
49. D = = 0,2
15

From the data above, there are 11 questions that do not match the standards set (0.3 - 1),
namely question number 9, 10, 16, 21, 23, 26, 30, 36, 42, 47, and 49. So, from this stage the
number of questions is 23 questions left of 34 questions.

 Reliability and validity

To test the reliability and validity I use IBM SPSS Statistics Data application. A total of
23 questions have been tested.
And the result are :
 From the picture above, the reliability results do not match to the standard (0.7). So from
the picture below, I deleted questions that could reduce the results that have been obtained to
reach the standard by eliminating Question 8.

So the result is as follows bellow.

 Then, I eliminated 3 questions to achieve a score close to the standard, namely Question 5,
35, and 17. And the result is :
 From the results above, it turns out that it has not yet reached the standard, but it has
begun to approach. So, I removed Question 13 to get a value closer to the standard. And the
result is:
 The results show that the values obtained are not up to the standard but by eliminating
Question 31 the standard results (0.7) can be obtained. And the result is :
 It can be seen from the picture above, by eliminating a total of 6 questions, you can get a
value that matches the standard, namely 0.780. So, in testing reliability there are 17 questions
left from 23 questions.

To see the validity, I use table R.

From the table above is obtained : df = N-2 = 30 – 2 = 28. So the value obtained based on
the significant level of testing 0.05 which has been determined is 0,3061. So, from the picture
below :
 All of the remaining 17 questions can be declared valid, because the values obtained in
Std. Deviation is not below the value of 0.3061 which means that the questions are said to be
valid. So, the final results obtained from all the test series above are of the 50 questions
provided and tested, only 17 questions that meet all item analysis testing standards, namely
only questions number 1, 4, 6, 12, 15, 22, 29, 32, 34, 37, 38, 40, 41, 44, 45, 46 and 48.