Fictitious Ratings on a 20- Item Scale by Seven Experts: Items Rated 3

Item Expert 1Expert 2Expert 3Expert 4Expert 5Expert 6Expert 7

1 0 1 1 1 1 1 1
2 1 1 1 0 1 1 1
3 1 0 1 1 1 1 1
4 1 1 1 1 1 1 1
5 1 1 0 1 1 1 1
6 1 1 1 1 0 1 1
7 1 1 1 1 1 1 1
8 1 1 1 1 1 1 0
9 1 1 1 1 1 1 1
10 0 1 1 1 1 1 1
11 1 0 1 1 1 1 1
12 1 1 1 1 1 1 1
13 1 1 0 1 1 1 1
14 1 1 1 0 1 1 1
15 1 1 1 1 0 1 1
16 1 1 1 1 1 0 1
17 1 1 1 1 1 1 0
18 1 1 1 1 1 1 1
19 1 1 1 1 1 1 1
20 1 1 1 1 1 0 1

Proportion
Relevant Mean Expert Proportion
ven Experts: Items Rated 3 or 4 on a 4-Point Scale

Number in Agreement Item CVI

6 0.86
6 0.86
6 0.86
7 1.00
6 0.86
6 0.86
7 1.00
6 0.86
7 1.00
6 0.86
6 0.86
7 1.00
6 0.86
6 0.86
6 0.86
6 0.86
6 0.86
7 1.00
7 1.00
6 0.86
Mean I-CVI 0.90
S-CVI/UA
Mean Expert Proportion
Fictitious Ratings on a 20- Item Scale by Three Experts: Items Rated 3 o

Item Expert 1Expert 2Expert 3 Number in Agreement Item CVI

1 1 1 1 1.00
2 1 1 1 1.00
3 1 1 1 1.00
4 1 1 1 1.00
5 1 1 1 1.00
6 1 1 1 1.00
7 1 1 1 1.00
8 1 1 1 1.00
9 1 1 1 1.00
10 0 1 1 0.67
11 1 1 1 1.00
12 1 1 1 1.00
13 1 1 0 0.67
14 1 1 1 1.00
15 1 1 1 1.00
16 1 1 1 1.00
17 1 1 0 0.67
18 1 1 1 1.00
19 1 1 1 1.00
20 1 1 1 1.00
Mean I-CVI 1.00
Proportion S-CVI/UA
Relevant Mean Expert Proportion
: Items Rated 3 or 4 on a 4-Point Scale
Fictitious Ratings on a 20- Item Scale by Three Experts: Items Rated 3 o

Item Expert 1Expert 2Expert 3Expert 4Expert 5Expert 6 Number in Agreement

1 1 1 1 1 1 0 5
2 1 1 1 1 1 1 6
3 1 1 1 1 1 1 6
4 1 1 1 1 1 1 6
5 1 1 1 1 1 1 6
6 1 1 1 1 1 1 6
7 1 1 1 1 1 1 6
8 1 1 1 0 1 1 5
9 1 1 1 1 0 1 6
Mean I-CVI
Proportion S-CVI/UA
Relevant Mean Expert Proportion
s: Items Rated 3 or 4 on a 4-Point Scale

Item CVI

0.83
1.00
1.00
1.00
1.00
1.00
1.00
0.83
0.83
0.94 ACCEPTABLE
0.78
roportion