www.assess.

com
Instructions for the Classical Item and Test Analysis Spreadsheet (CITAS
1. Paste your data (ABCDE) in the blue data range on the "Input" tab
2. Paste your keys (ABCDE) in the orange keys range in the top row of the "Inpu
3. Output will automatically populate on the "Output" and "Response counts" ta

Note: The "Calculations" tab is calculations only, and is locked/hidden to preserv

CITAS is limited to 100 items and 100 people. For larger data sets and
Iteman is a classical analysis program designed to produce detailed psychometr
www.assess.com/iteman
Xcalibre is similar to Iteman, except that it also provides item response theory (I
www.assess.com/xcalibre
Want to move to the cloud? FastTest is our comprehensive ecosystem for develo
www.assess.com/results-and-reports

Disclaimer: CITAS is for educational purposes only. ASC is not liable for any use or misuse of the software.
 adsheet (CITAS)

row of the "Input" tab

ponse counts" tabs

idden to preserve accuracy

data sets and more functionality, please visit the webpages for Iteman and Xc
ailed psychometric reports.

sponse theory (IRT) calibration.

ystem for developing, delivering, and analyzing tests. It also includes a detailed classica

e of the software.
Iteman and Xcalibre.

detailed classical analysis report, integrated directly with your results.

 Keys:
Item responses:
PersonScore ID 1 2 3 4 5 6 7 8 9###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
 88
89
90
91
92
93
94
95
96
97
98
99
100
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###
###51 52 53 54 55 56
57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85
86 87 88 89 90 91 92 93 94 95 96 97 98 99###
 Keys:
Item responses:
Person ID Score 1 2 3 4 5 6 7 8 9 10 11 12 13
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
 88
89
90
91
92
93
94
95
96
97
98
99
100

P:
Rpbis:
Sum corr:
Sum incorr:
Num corr:
Num Incorr:
Mean corr:
Mean incorr:
Min corr: 0 0 0 0 0 0 0 0 0 0 0 0 0
Max incorr: 0 0 0 0 0 0 0 0 0 0 0 0 0
Var:
=D105=E105
=F105
=G105
=H105
=I105
=J105
=K105
=L105
=M105
=N105
=O105
=P105

Item
Key
A
B
Option N C
D
E

A
B
Option P C
D
E

A
B
Rpbis C
D
 E
Group
Test statistics 5 0 0
Examinees: 0 10 0 0
Items: 0 15 0 0
Mean: ### 20 0 0
SD: ### 25 0 0
Variance: ### 30 0 0
Min: 0 35 0 0
Max: 0 40 0 0
KR-20: ### 45 0 0
SEM: ### 50 0 0
55 0 0
Item statistics 60 0 0
Mean P: ### 65 0 0
Min P: 0.00 70 0 0
Max P: 0.00 75 0 0
Mean Rpbis:### 80 0 0
Min Rpbis: 0.00 85 0 0
Max Rpbis: 0.00 90 0 0
Dummy variable for A 95 0 0
Used for option Rpbis 100 0 0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
 69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Dummy variable for B
Used for option Rpbis
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
 57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Dummy variable for C
Used for option Rpbis
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
 90
91
92
93
94
95
96
97
98
99
100
Dummy variable for D
Used for option Rpbis
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
 78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Dummy variable for E
Used for option Rpbis
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
 66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

=Q105
=R105
=S105
=T105
=U105
=V105
=W105
=X105
=Y105
=Z105
=AA105
=AB105
=AC105
=AD105
=AE105
=AF105
=AG105
=AH105
=AI105
33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

=AJ105
=AK105
=AL105
=AM105
=AN105
=AO105
=AP105
=AQ105
=AR105
=AS105
=AT105
=AU105
=AV105
=AW105
=AX105
=AY105
=AZ105
=BA105
51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68
 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

=BB105=BC105
=BD105
=BE105
=BF105
=BG105
=BH105
=BI105
=BJ105
=BK105
=BL105
=BM105
=BN105
=BO105
=BP105
=BQ105
=BR105
=BS105
69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87
 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

=BT105
=BU105
=BV105
=BW105
=BX105
=BY105
=BZ105
=CA105
=CB105
=CC105
=CD105
=CE105
=CF105
=CG105
=CH105
=CI105
=CJ105
=CK105
=CL105
88 89 90 91 92 93 94 95 96 97 98 99 100
 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0

=CM105
=CN105
=CO105
=CP105
=CQ105
=CR105
=CS105
=CT105
=CU105
=CV105
=CW105
=CX105
=CY105
 Person scores Item Statistics Numbe Number Mean
Perso r incorre score
n ID Score Item P Rpbis correct ct correct
1 1
2 2
3 3
4 4
5 5
6 6
7 7
8 8
9 9
10 10
11 11
12 12
13 13
14 14
15 15
16 16
17 17
18 18
19 19
20 20
21 21
22 22
23 23
24 24
25 25
26 26
27 27
28 28
29 29
30 30
31 31
32 32
33 33
34 34
35 35
36 36
37 37
38 38
39 39
40 40
41 41
42 42
43 43
44 44
45 45
46 46
47 47
48 48
49 49
50 50
51 51
52 52
53 53
54 54
55 55
56 56
57 57
58 58
59 59
60 60
61 61
62 62
63 63
64 64
65 65
66 66
67 67
68 68
69 69
70 70
71 71
72 72
73 73
74 74
75 75
76 76
77 77
78 78
79 79
80 80
81 81
82 82
83 83
84 84
85 85
86 86
87 87
 88 88
89 89
90 90
91 91
92 92
93 93
94 94
95 95
96 96
97 97
98 98
99 99
100 100
 Mean Summary
score
incorrect Statistic Value Cells with a red triangle have a comm
Test statistics
Examinees: 0
Score Distribution
Items: 0
Mean: #DIV/0! 1

SD: #DIV/0! 0.9

Variance: #DIV/0!
0.8
Min: 0
Max: 0 0.7
KR-20: #DIV/0! 0.6
SEM: #DIV/0!
0.5

Item statistics 0.4

Mean P: #DIV/0!
0.3
Min P: 0.00
Max P: 0.00 0.2
Mean Rpbis:#DIV/0! 0.1
Min Rpbis: 0.00
Max Rpbis: 0.00 0
5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95
iangle have a comment that describes the output.

5 70 75 80 85 90 95 100
 Item 1 2 3 4 5 6 7 8 9 10 11 12 13 14
Key
Option N
A
B
C
D
E

Option P
A
B
C
D
E

Option Rpbis
A
B
C
D
E

CITAS is limited to 100 items and 100 people. For larger data sets and more functionality,
Iteman is a classical analysis program designed to produce detailed psychometric reports.
www.assess.com/iteman
Xcalibre is similar to Iteman, except that it also provides item response theory (IRT) calibration.
www.assess.com/xcalibre

How to interpret these results?

If most students choose the correct option, the item is easy.
If few students choose the correct option, the item is difficult.
However, just because few students choose the correct option does not mean it is a bad item.
Instead, examine the Rpbis. Is it still positive? That means smarter students are selecting the key.
Then the item is still a good item.
 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

d more functionality, p
tric reports.

(IRT) calibration.

t is a bad item.
are selecting the key.
31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46
47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62
63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78
79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94
95 96 97 98 99 100