MSA Worksheet

You might also like

Download as xls, pdf, or txt
Download as xls, pdf, or txt
You are on page 1of 18

Measurement Systems Analysis - Summary Report

Gage Name: #VALUE! Gage Number: #VALUE!

Characteristic: Hole Depth Gage Type: #VALUE!

ange of Dimension:

Gage R&R

Date Performed: ? % RR of Tolerance 86.2% Gage system may be acceptable b

Performed By: ?

Bias

Date Performed: 0 Bias: #DIV/0! #DIV/0!

Performed By: 0

Linearity

Date Performed: 30-Dec-99 Slope (a): #DIV/0! #DIV/0!

Performed By: 0 Intercept (b): #DIV/0! #DIV/0!

Goodness of Fit: #DIV/0! #DIV/0!

Stability

Date Started: 30-Dec-99 Gage was stable for 20 days.

Performed By: 0 Gage was NOT stable for 20 days.

Conclusion: Gage is acceptable for all parameters.

Gage is NOT Acceptable for all parameters and will not be used.

Gage is NOT Acceptable for all parameters but will be used for the following reasons.

Form 827 Rev. A 08-Jul-03


Measurement Systems Analysis - Gage R&R Study
Part Number and Name: XX-XXX-XX Gage Name: Digital Depth Micrometer Date Measured: ?
Characteristic: Hole Depth Gage Number: XXXX Performed By: ?
USL 0.314 Gage Type: Depth Micrometer
LSL 0.308

Part
Appraiser/Trial # 1 2 3 4 5 6 7 8 9 10
Appraiser A Trial 1 0.3097 0.3078 0.3076 0.3087 0.3074 0.3074 0.3079 0.3084 0.3069 0.3077
(Name) Trial 2 0.3096 0.3076 0.3076 0.3087 0.3088 0.3086 0.3094 0.3085 0.3088 0.3063
(Title / Function) Trial 3 0.3091 0.3084 0.3084 0.3083 0.3092 0.3068 0.3079 0.308 0.3095 0.3087
Average A 0.3095 0.3079 0.3079 0.3086 0.3085 0.3076 0.3084 0.3083 0.3084 0.3076 0.3083 Xbar A
Range A 0.0006 0.0008 0.0008 0.0004 0.0018 0.0018 0.0015 0.0005 0.0026 0.0024 0.0013 Rbar A

Appraiser B Trial 1 0.3086 0.3096 0.3081 0.3099 0.3076 0.307 0.3095 0.3065 0.3106 0.3069
(Name) Trial 2 0.3086 0.3076 0.3076 0.3092 0.3087 0.3086 0.3097 0.3075 0.3088 0.3075
(Title / Function) Trial 3 0.3086 0.308 0.3086 0.3083 0.3094 0.3091 0.3102 0.3077 0.3094 0.3067
Average B 0.3086 0.3084 0.3081 0.3091 0.3086 0.3082 0.3098 0.3072 0.3096 0.3070 0.3085 Xbar B
Range B 0.0000 0.0020 0.0010 0.0016 0.0018 0.0021 0.0007 0.0012 0.0018 0.0008 0.0013 Rbar B

Appraiser C Trial 1 0.3088 0.3091 0.3088 0.3088 0.309 0.3071 .3079. 0.3077 0.307 0.3075
(Name) Trial 2 0.307 0.3083 0.3086 0.3074 0.309 0.3075 0.3089 0.3087 0.3086 0.3074
(Title / Function) Trial 3 0.3089 0.3079 0.309 0.3092 0.3087 0.3087 0.3072 0.3087 0.3091 0.3075
Average C 0.3082 0.3084 0.3088 0.3085 0.3089 0.3078 0.3081 0.3084 0.3082 0.3075 0.3083 Xbar C
Range C 0.0019 0.0012 0.0004 0.0018 0.0003 0.0016 0.0017 0.0010 0.0021 0.0001 0.0012 Rbar C
UCL 0.0033 0.0033 0.0033 0.0033 0.0033 0.0033 0.0033 0.0033 0.0033 0.0033
LCL 0 0 0 0 0 0 0 0 0 0
Part Average 0.3088 0.3083 0.3083 0.3087 0.3086 0.3079 0.3088 0.3080 0.3087 0.3074 0.0014 RP (Range of Part Averages)
K3(Constant) 0.7071 0.5231 0.4467 0.403 0.3742 0.3534 0.3375 0.3249 0.3146

Average of 3 Ranges 0.0013 Constants


XbarDiff 0.0002 5 Trials 4 Trials 3 Trials 2 Trials # Trials UCL represents the limit of the individual R's
UCL 0.0032938 2.11 2.28 2.58 3.27 D4 Circle those beyond the limit.
LCL 0 0 0 0 0 D3 Identify and correct causes
Repeatability(EV) 0.0008 0.5908 0.8862 K1 LCL = 0 D3=0 for up to 7 trials
Reproducibility(AV) 0.0000 0.7071 0.5231 K2
Gage R & R 0.0008 2 Ops 3 Ops
Tolerance 0.006
Part Variation 0.0004 # Parts #Trials
Total Variation 0.0009 10 3
NDC 1

% of Total % of
Variation Tolerance
% EV 86.18% 12.57%
% AV 0.00% 0.00%
% Gage R & R 86.18% 12.57%
% PV 50.72% 7.40%

Conclusion: Gage system may be acceptable based on importance of application and cost

Instructions: Just enter your measurement data in Cells C11:L13, C17:L19, C23:L25
The template will automatically calculate all of the values based on your data

Form 827 Rev. A 08-Jul-03


Stacked Average Chart

0.3500

0.3000

Average
0.2500

0.2000

0.1500

0.1000

0.0500

0.0000
1 2 3 4 5 6 7 8 9 10
Part Reading
Appraiser A Appraiser B Appraiser C UCL LCL

Form 827 Rev. A 08-Jul-03


Measurement Systems Analysis - Gage R&R Study
Part Number and Name: Gage Name: Date Measured: 8-May-03
Characteristic: Gage Number: Performed By: ?
USL 2 Gage Type:
LSL 1

Part
Appraiser/Trial # 1 2 3 4 5 6 7 8 9 10
Appraiser A Trial 1 0.29 -0.56 1.34 0.47 -0.8 0.02 0.59 -0.31 2.26 -1.36
Trial 2 0.41 -0.68 1.17 0.5 -0.92 -0.11 0.75 -0.2 1.99 -1.25
Trial 3 0.64 -0.58 1.27 0.64 -0.84 -0.21 0.66 -0.17 2.01 -1.31
Average A 0.4467 -0.6067 1.2600 0.5367 -0.8533 -0.1000 0.6667 -0.2267 2.0867 -1.3067 0.1903 Xbar A
Range A 0.3500 0.1200 0.1700 0.1700 0.1200 0.2300 0.1600 0.1400 0.2700 0.1100 0.1840 Rbar A

Appraiser B Trial 1 0.08 -0.47 1.19 0.01 -0.56 -0.2 0.47 -0.63 1.8 -1.68
Trial 2 0.25 -1.22 0.94 1.03 -1.2 0.22 0.55 0.08 2.12 -1.62
Trial 3 0.07 -0.68 1.34 0.2 -1.28 0.06 0.83 -0.34 2.19 -1.5
Average B 0.1333 -0.7900 1.1567 0.4133 -1.0133 0.0267 0.6167 -0.2967 2.0367 -1.6000 0.0683 Xbar B
Range B 0.1800 0.7500 0.4000 1.0200 0.7200 0.4200 0.3600 0.7100 0.3900 0.1800 0.5130 Rbar B

Appraiser C Trial 1 0.04 -1.38 0.88 0.14 -1.46 -0.29 0.02 -0.46 1.77 -1.49
Trial 2 -0.11 -1.13 1.09 0.2 -1.07 -0.67 0.01 -0.56 1.45 -1.77
Trial 3 -0.15 -0.96 0.67 0.11 -1.45 -0.49 0.21 -0.49 1.87 -2.16
Average C -0.0733 -1.1567 0.8800 0.1500 -1.3267 -0.4833 0.0800 -0.5033 1.6967 -1.8067 -0.2543 Xbar C
Range C 0.1900 0.4200 0.4200 0.0900 0.3900 0.3800 0.2000 0.1000 0.4200 0.6700 0.3280 Rbar C

Part Average 0.1689 -0.8511 1.0989 0.3667 -1.0644 -0.1856 0.4544 -0.3422 1.9400 -1.5711 3.5111 RP (Range of Part Averages)
K3(Constant) 0.7071 0.5231 0.4467 0.403 0.3742 0.3534 0.3375 0.3249 0.3146
UCL 0.8815 0.8815 0.8815 0.8815 0.8815 0.8815 0.8815 0.8815 0.8815 0.8815
LCL 0 0 0 0 0 0 0 0 0 0

Form xxx Rev. A 08-Jul-03


Average of 3 Ranges 0.3417 Constants
XbarDiff 0.4447 5 Trials 4 Trials 3 Trials 2 Trials # Trials UCL represents the limit of the individual R's
UCL 0.8815 2.11 2.28 2.58 3.27 D4 Circle those beyond the limit.
LCL 0 0 0 0 0 D3 Identify and correct causes
Repeatability(EV) 0.2019 0.5908 0.8862 K1 LCL = 0 D3=0 for up to 7 trials
Reproducibility(AV) 0.2297 0.7071 0.5231 K2
Gage R & R 0.3058 2 Ops 3 Ops
Tolerance 1
Part Variation 1.1046 # Parts #Trials
Total Variation 1.1461 10 3
NDC 5

% of Total % of
Variation Tolerance
% EV 17.61% 20.19%
% AV 20.04% 22.97%
% Gage R & R 26.68% 30.58%
% PV 96.38% 110.46%

Conclusion: Gage system needs improvement

Instructions: Just enter your measurement data in Cells C11:L13, C17:L19, C23:L25
The template will automatically calculate all of the values based on your data

Form xxx Rev. A 08-Jul-03


Measurement Systems Analysis - Bias Worksheet

Note 1: If you perform a complete Linearity Study, you do not have to do this Bias study.

Note 2: This analysis is only valid for 15 repeated readings on 1 sample. Otherwise, see your Quality Manager for assistance.

Part Number and Name: Gage Name: Date Performed:

Characteristic: Gage Number: Performed By:

Gage Type:

Reference Value: (NIST traceable standard or as measured using master method, I.e. CMM )

Sample Measurements:

10

11

12

13

14

15

Sample Average: #DIV/0!

Bias = #DIV/0! #DIV/0!

σ repeatability = 0.00000

σ bias = 0.00000

t= #DIV/0!

Significant t value (2-tailed) = 2.206

lower conf. limit = #DIV/0!

upper conf. limit = #DIV/0!

Form 827 Rev. A 08-Jul-03


Measurement Systems Analysis - Bias Worksheet

Note 1: If you perform a complete Linearity Study, you do not have to do this Bias study.

Note 2: This analysis is only valid for 15 repeated readings on 1 sample. Otherwise, see your Quality Manager for assistance.

Part Number and Name: Gage Name: Date Performed:

Characteristic: Gage Number: Performed By:

Gage Type:

Reference Value: 6.0000 (NIST traceable standard or as measured using master method, I.e. CMM )

Sample Measurements:

1 5.8000

2 5.7000

3 5.9000

4 5.9000

5 6.0000

6 6.1000

7 6.0000

8 6.1000

9 6.4000

10 6.3000

11 6.0000

12 6.1000

13 6.2000

14 5.6000

15 6.0000

Sample Average: 6.0067

Bias = 0.0067 Bias is Acceptable

σ repeatability = 0.22514

σ bias = 0.05813

t = 0.114683

Significant t value (2-tailed) = 2.206

lower conf. limit = -0.1167

upper conf. limit = 0.1320

Form 827 Rev. A 08-Jul-03


Measurement Systems Analysis - Linearity

Note: This analysis is only valid for studies of 5 parts measured 12 times each. Otherwise see your Quality Manager.

art Number & Name: Gage Name: Date Performed:


Characteristic: Gage Number: Performed By:
Specification: Gage Type:

Part Ref. Values: 1 2 3 4 5


g= 0

Trials: 1
m= 12 2
3
4
5
6
7
8
9
10
11
12

Sample Average: 0.0000 0.0000 0.0000 0.0000 0.0000

1 0.0000 0.0000 0.0000 0.0000 0.0000


2 0.0000 0.0000 0.0000 0.0000 0.0000
3 0.0000 0.0000 0.0000 0.0000 0.0000
4 0.0000 0.0000 0.0000 0.0000 0.0000
5 0.0000 0.0000 0.0000 0.0000 0.0000
6 0.0000 0.0000 0.0000 0.0000 0.0000
7 0.0000 0.0000 0.0000 0.0000 0.0000
8 0.0000 0.0000 0.0000 0.0000 0.0000
9 0.0000 0.0000 0.0000 0.0000 0.0000
10 0.0000 0.0000 0.0000 0.0000 0.0000
11 0.0000 0.0000 0.0000 0.0000 0.0000
12 0.0000 0.0000 0.0000 0.0000 0.0000

Bias Average: 0.0000 0.0000 0.0000 0.0000 0.0000

Range: 0.0000 0.0000 0.0000 0.0000 0.0000

Slope (a): #DIV/0! ###


Intercept (b): #DIV/0! ###
Goodness of Fit: #DIV/0! ###

f(x) = NaN x + NaN


R² = 0 Linearity Plot
1.0000
0.9000
0.8000
0.7000
0.6000
0.5000
0.4000
0.3000
0.2000
0.1000
0.0000
0.0000 0.1000 0.2000 0.3000 0.4000 0.5000 0.6000 0.7000 0.8000 0.9000 1.0000

Form 827 Rev. A 08-Jul-03


Measurement Systems Analysis - Linearity

Note: This analysis is only valid for studies of 5 parts measured 12 times each. Otherwise see your Quality Manager.

art Number & Name: Gage Name: Date Performed:


Characteristic: Gage Number: Performed By:
Specification: Gage Type:

Part Ref. Values: 1 2 3 4 5


g= 5 2.0000 4.0000 6.0000 8.0000 10.0000

Trials: 1 2.7000 5.1000 5.8000 7.6000 9.1000


m= 12 2 2.5000 3.9000 5.7000 7.7000 9.3000
3 2.4000 4.2000 5.9000 7.8000 9.5000
4 2.5000 5.0000 5.9000 7.7000 9.3000
5 2.7000 3.8000 6.0000 7.8000 9.4000
6 2.3000 3.9000 6.1000 7.8000 9.5000
7 2.5000 3.9000 6.0000 7.8000 9.5000
8 2.5000 3.9000 6.1000 7.7000 9.5000
9 2.4000 3.9000 6.4000 7.8000 9.6000
10 2.4000 4.0000 6.3000 7.5000 9.2000
11 2.6000 4.1000 6.0000 7.6000 9.3000
12 2.4000 3.8000 6.1000 7.7000 9.4000

Sample Average: 2.4917 4.1250 6.0250 7.7083 9.3833

1 0.7000 1.1000 -0.2000 -0.4000 -0.9000


2 0.5000 -0.1000 -0.3000 -0.3000 -0.7000
3 0.4000 0.2000 -0.1000 -0.2000 -0.5000
4 0.5000 1.0000 -0.1000 -0.3000 -0.7000
5 0.7000 -0.2000 0.0000 -0.2000 -0.6000
6 0.3000 -0.1000 0.1000 -0.2000 -0.5000
7 0.5000 -0.1000 0.0000 -0.2000 -0.5000
8 0.5000 -0.1000 0.1000 -0.3000 -0.5000
9 0.4000 -0.1000 0.4000 -0.2000 -0.4000
10 0.4000 0.0000 0.3000 -0.5000 -0.8000
11 0.6000 0.1000 0.0000 -0.4000 -0.7000
12 0.4000 -0.2000 0.1000 -0.3000 -0.6000

Bias Average: 0.4917 0.1250 0.0250 -0.2917 -0.6167

Range: 0.4000 1.3000 0.7000 0.3000 0.5000

Slope (a): -0.13167 Slope is NOT Acceptable


Intercept (b): 0.73667 Intercept is NOT Acceptable
Goodness of Fit: 0.7143 Goodness of Fit is NOT Acceptable

Linearity Plot
1.5000

1.0000

0.5000
f(x) = − 0.131666666666667 x + 0.736666666666667
0.0000 R² = 0.714318415932242
0 0 0 0 0 0 0 0 0 0 0
-0.5000
0 00 0 00 0 00 0 00 0 00 0 00 0 00 0 00 0 00 0 00 0 00
1. 2. 3. 4. 5. 6. 7. 8. 9. 10
.
11
.
-1.0000

-1.5000 Reference Value

Form 827 Rev. A 08-Jul-03


-1.5000 Reference Value

Form 827 Rev. A 08-Jul-03


Measurement Systems Analysis - Stability Study

Part Number and Name: Gage Name: Date Started:

Characteristic: Gage Number: Performed By:

Specification: Gage Type:

Sample #: Day #1 Day #2 Day #3 Day # 4 Day # 5 Day #6 Day #7 Day #8 Day #9 Day #10 Day #11 Day #12 Day #13 Day #14 Day #15 Day #16 Day #17 Day #18 Day #19 Day #20

Xbar

Range(Max-Min)

Xdoublebar(Grand Average)
Rbar (Average Range)
UCL(Range Chart)
LCL(Range Chart) 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000
UCL (Xbar Chart)
LCL(Xbar Chart)

Conclusion: Gage was stable for 20 days.


Gage was NOT stable for 20 days.

Form 827 Rev. A 08-Jul-03


X Bar Chart For Stability
12

Sample Mean
10

Sample Av-
0 erages
Day #1 Day #2 Day #3 Day # Day # Day #6 Day #7 Day #8 Day #9 Day Day Day Day Day Day Day Day Day Day Day
4 5 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 UCL

Days LCL

Range Chart For Stability


Sample Range

0.9

0.8

0.7

0.6

0.5

0.4

0.3

0.2

0.1

0 Sample
Day #1 Day #2 Day #3 Day # Day # Day #6 Day #7 Day #8 Day #9 Day Day Day Day Day Day Day Day Day Day Day Ranges
4 5 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20
UCL

Days LCL

Form 827 Rev. A 08-Jul-03


Measurement Systems Analysis - Stability Study

Part Number and Name: Gage Name: Date Started:

Characteristic: Gage Number: Performed By:

Specification: Gage Type:

Sample #: Day #1 Day #2 Day #3 Day # 4 Day # 5 Day #6 Day #7 Day #8 Day #9 Day #10 Day #11 Day #12 Day #13 Day #14 Day #15 Day #16 Day #17 Day #18 Day #19 Day #20

1 48.600 48.400 48.800 48.900 48.500 48.500 48.400 48.700 47.800 47.900 48.100 48.200 48.100 48.300 48.000 47.900 48.100 48.300 48.100 48.000

2 48.700 48.800 47.900 50.100 49.000 49.000 48.200 48.000 48.600 48.300 48.600 48.500 48.700 48.900 48.700 48.300 48.400 48.600 48.600 48.600

3 48.300 48.000 48.000 49.200 49.000 49.000 48.300 47.700 48.700 48.400 48.700 48.900 48.500 48.600 48.600 48.700 48.700 48.500 48.700 48.700

4 48.600 48.400 48.800 48.900 48.500 48.500 48.400 48.700 47.800 47.900 48.100 48.200 48.100 48.300 48.000 47.900 48.100 48.300 48.100 48.000

5 48.700 48.800 47.900 50.100 49.000 49.000 48.300 48.000 48.600 48.300 48.600 48.500 48.700 48.900 48.700 48.300 48.400 48.600 48.600 48.600

Xbar 48.58 48.48 48.28 49.44 48.8 48.8 48.32 48.22 48.3 48.16 48.42 48.46 48.42 48.6 48.4 48.22 48.34 48.46 48.42 48.38

Range(Max-Min) 0.4 0.8 0.9 1.2 0.5 0.5 0.2 1 0.9 0.5 0.6 0.7 0.6 0.6 0.7 0.8 0.6 0.3 0.6 0.7

Xdoublebar(Grand Average) 48.475


Rbar (Average Range) 0.655
UCL(Range Chart) 1.68 1.6834 1.6834 1.6834 1.6834 1.6834 1.6834 1.6834 1.68335 1.6834 1.68335 1.68335 1.6834 1.68335 1.6834 1.68335 1.68335 1.68335 1.68335 1.68335
LCL(Range Chart) 0.000 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UCL (Xbar Chart) 48.855 48.855 48.855 48.855 48.855 48.855 48.855 48.855 48.8549 48.855 48.8549 48.8549 48.855 48.8549 48.855 48.8549 48.8549 48.8549 48.8549 48.8549
LCL(Xbar Chart) 48.095 48.095 48.095 48.095 48.095 48.095 48.095 48.095 48.0951 48.095 48.0951 48.0951 48.095 48.0951 48.095 48.0951 48.0951 48.0951 48.0951 48.0951

Gage was stable for 20 days.


Conclusion:
✘ Gage was NOT stable for 20 days.

Form 827 Rev. A 08-Jul-03


Sample Mean
X Bar Chart For Stability
50

49.5

49

48.5

48

47.5
Sample
47 Aver-
Day #1 Day #2 Day #3 Day # Day # Day #6 Day #7 Day #8 Day #9 Day Day Day Day Day Day Day Day Day Day Day
4 5 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 ages
Days UCL

Range Chart For Stability


Sample Range

1.8
1.6
1.4
1.2
1
0.8
0.6
0.4
Sample
0.2
Ranges
0
Day #1 Day #2 Day #3 Day # Day # Day #6 Day #7 Day #8 Day #9 Day Day Day Day Day Day Day Day Day Day Day UCL
4 5 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20
Days LCL

Form 827 Rev. A 08-Jul-03


Part Number & Name: Gage Name
Characteristic: Gate Number
Specification: Gage Type
Date: Performed By:

Sample No A-1 A-2 A-3 B-1 B-2 B-3 C-1 C-2 C-3 Reference Decision
1
2
3
4
5
6
7
8
9
10
11 Po(A*B)
12 Pe(A*B)
13
14
15
16
17
18
19
20
21
22
23
24 Po(B*C)
25 Pe(B*C)
26
27
28
29
30
31
32
33
34
35
36
37 Po(A*C)
38 Pe(A*C)
39
40
41
42
43
44
45
46
47
48
49
50

Key : G = Good
B = Bad

Form 827 Rev. A 08-Jul-03


A*B A* Ref Decision
B Ref Decision
Total Total
G Count B Count G Count B Count
G Count G Count
Expected Count Expected Count
A A
B Count B Count
Expected count Expected count
Count Count
Total Total
Expected Count Expected Count

Po(A*B) Po(A* Ref)


Pe(A*B) Pe(A* Ref)

B*C B* Ref Decision


C Ref Decision
Total Total
G Count B Count G Count B Count
G Count G Count
Expected Count Expected Count
B B
B Count B Count
Expected count Expected count
Count Count
Total Total
Expected Count Expected Count

Po(B*C) Po(B* Ref)


Pe(B*C) Pe(B* Ref)

A*C C* Ref Decision


C Total Ref Decision Total
G Count B Count G Count B Count
A G Count G Count
Expected Count Expected Count
C
B Count B Count
Expected count Expected count
Count Count
Total Total
Expected Count Expected Count

Po(A*C) Po(C* Ref)


Pe(A*C) Pe(C* Ref)

Kappa = (Po-Pe)/(1-Pe)

Degree of agreement between operators Degree of agreement between operators & Ref Decision

Kappa A B C Kappa A B C
A - Ref Decision
B -
C -

Note: Kappa measures the agreement between the two raters when both are rating same object. Its value ranges from
0 to 1. A value of 1 indicates perfect agreement while value of 0 indicates that agreement is no better than chance. A
general rule of thumb is that values of Kappa greater than 0.75 indicate good to excellent agreement while values
less than 0.40 indicate poor agreement. Reference AIAG MSA Manual, Third Edition
Form 827 Rev. A 08-Jul-03
Part Number & Name 90-0-33745 Handle Measurement SystemManual Visual Inspection
Characteristic Scratches, Marks, Spots Date 7/5/2003
Performed By Shailesh Patel & Peter Barlow

Sample No A-1 A-2 A-3 B-1 B-2 B-3 C-1 C-2 C-3 Reference Decision
1 G G G G G G G
2 G G G G G G G
3 G G G G G G G
4 G G G G G G G
5 G G G G G G G
6 G G G G G G G
7 G G G G G G G
8 G G G G G G G
9 B B B B B B B
10 B B B B B B B
11 G G G G G G G Po(A*B)
12 G G G G G G G Pe(A*B)
13 G G G G G G G
14 G G G G G G G
15 G G G G G G G
16 B B B B B B B
17 G G G G G G G
18 G B G G G G G
19 G G G G G G G
20 G G G G G G G
21 G G G G G G G
22 G G G G G G G
23 G G G G G G G
24 G G G G G G G Po(B*C)
25 G G B G G G G Pe(B*C)
26 G G G G G G G
27 G G G G G G G
28 B G G G G G G
29 B G G G G G G
30 G G G G G G G
31 G G G G G G G
32 B B B B B B B
33 G G G G G G G
34 G G G G G G G
35 G G G G G G G
36 G G G G G G G
37 B B B B B B B Po(A*C)
38 B B B B B B B Pe(A*C)
39 B B G G G G G
40 B G B G G G G
41 G B G G G G G
42 G G G G G G G
43 G G G G G G G
44 G G G G G G G
45 B B B B B B B
46 G G G G G G G
47 G G G G G G G
48 B B B B B B B
49 G G G G G G G
50 G G G G G G G

Key : G = Good
B = Bad

Form 827 Rev. A 08-Jul-03


A*B A* Ref Decision
B Ref Decision
Total Total
G Count B Count G Count B Count
G Count 76 1 77 G Count 77 0 77
Expected Count 63.9 13.1 77.0 Expected Count 64.7 12.3 77.0
A A
B Count 7 16 23 B Count 7 16 23
Expected count 19.1 3.9 23.0 Expected count 19.3 3.7 23.0
Count 83 17 100 Count 84 16 100
Total Total
Expected Count 83.0 17.0 100.0 Expected Count 84.0 16.0 100.0

Po(A*B) 0.92 Po(A* Ref) 0.93


Pe(A*B) 0.68 Pe(A* Ref) 0.68

B*C B* Ref Decision


C Ref Decision
Total Total
G Count B Count G Count B Count
G Count 82 0 82 G Count 82 0 82
Expected Count 68.9 13.1 82.0 Expected Count 68.9 13.1 82.0
B B
B Count 2 16 18 B Count 2 16 18
Expected count 15.1 2.9 18.0 Expected count 15.1 2.9 18.0
Count 84 16 100 Count 84 16 100
Total Total
Expected Count 84.0 16.0 100.0 Expected Count 84.0 16.0 100.0

Po(B*C) 0.98 Po(B* Ref) 0.98


Pe(B*C) 0.72 Pe(B* Ref) 0.72

A*C C* Ref Decision


C Total Ref Decision Total
G Count B Count G Count B Count
A G Count 77 0 77 G Count 84 0 84
Expected Count 64.7 12.3 77.0 Expected Count 70.6 13.4 84.0
C
B Count 7 16 23 B Count 0 16 16
Expected count 19.3 3.7 23.0 Expected count 13.4 2.6 16.0
Count 84 16 100 Count 84 16 100
Total Total
Expected Count 84.0 16.0 100.0 Expected Count 84.0 16.0 100.0

Po(A*C) 0.93 Po(C* Ref) 1


Pe(A*C) 0.68 Pe(C* Ref) 0.73

Kappa = (Po-Pe)/(1-Pe)

Degree of agreement between operators Degree of agreement between operators & Ref Decision

Kappa A B C Kappa A B C
A - 0.75 0.78 Ref Decision 0.78 0.93 1.00
B 0.75 - 0.93
C 0.78 0.93 -

Note: Kappa measures the agreement between the two raters when both are rating same object. Its value ranges
from 0 to 1. A value of 1 indicates perfect agreement while value of 0 indicates that agreement is no better than
chance. A general rule of thumb is that values of Kappa greater than 0.75 indicate good to excellent agreement
while values less than 0.40 indicate poor agreement. Reference AIAG MSA Manual, Third Edition

Form 827 Rev. A 08-Jul-03

You might also like