Professional Documents
Culture Documents
ANSIZ540.3 Training Slide
ANSIZ540.3 Training Slide
3
Requirements for the Calibration of
Measuring and Test Equipment
Sub Clause 5.3 Assessor Training
Steve Doty, NSWC Corona, 171 Committee Chair, Working Group One Chair
Del Caldwell, CCG, 171 Working Group One Co-Chair
Dennis Jackson, NSWC Corona, 171 Committee Member
NCSL INTERNATIONAL
NCSL INTERNATIONAL
Overview
O
NCSL INTERNATIONAL
Themes
O
The error in estimating the UUT bias is called the calibration process
error
A false accept occurs when the UUT bias is out of tolerance, but the
estimate of the UUT bias (the deviation) is not
NCSL INTERNATIONAL
Test
Instrument
Measures
Measurement
Source
Measures
Voltmeter
10.0 Volt
Source
Measurement = 10.1 v
Measurement = True Value + Error
=
10.0 v + 0.1 v
Error = Measurement True Value
=
10.1 v
10.0 v
=
0.1 v
NCSL INTERNATIONAL
Measurement Uncertainty
Repeatability
Resolution
Reproducibility
Environment
Location
Operators
Correction Factors
Calibration Certificate
NCSL INTERNATIONAL
Measurement
Measurement
Source
Measurement
Calibration
Standard
(CALSTD)
10
Measurement
Measurement
Source
Measurement
Calibration
Standard
(CALSTD)
11
Measurement
Measurement
Source
Measurement
Calibration
Standard
(CALSTD)
Deviation = 0.09 V
= UUT Measurement CALSTD Measurement
= UUT Bias + Calibration Process Error
= 0.11 V
+
(- 0.02 V)
NCSL INTERNATIONAL
12
Calibration Process
Uncertainty
13
Calibration Process
Uncertainty Budget
O
Calibration Standard
Repeatability (UUT and CALSTD)
Resolution
Reproducibility
Calibration Certificate
14
Calibration Scenarios
UUT
Measures
(Measuring Device)
(Measurement Source)
(Measurement Source)
Indictated Value: x
True Output Value: T
Measured Value: y
UUT
CALSTD
CALSTD
Measures
(Measuring Device)
Indictated Value: y
True Output Value: T
Measured Value: x
NCSL INTERNATIONAL
15
Calibration Scenarios
3
UUT
Measures
Artifact
Measures
CALSTD
(Measuring Device)
(Measurement Source)
(Measuring Device)
Measured Value: y
Measured Value: x
4
UUT
(Measurement Source)
Indicated Value: y
True Output Value:
Measures
Comparator
(Measuring Device)
Measured Value: z
Ty
NCSL INTERNATIONAL
Measures
CALSTD
(Measurement Source)
Indicated Value: x
True Output Value:
Tx
16
Summary
O
O
O
O
O
NCSL INTERNATIONAL
17
True In Tolerance
UUT Bias
18
UUT Bias
19
Observed In Tolerance
(Calibration Testing in Practice)
Deviation
The Deviation is the observed difference between the UUT and the CALSTD
NCSL INTERNATIONAL
20
False Accepts
Deviation
Cal
Proc
Error
UUT Bias
-L
21
Cal
Proc
Error
UUT Bias
-L
22
Inputs Needed to
Calculate PFA
Probability of False Accept (PFA):
PFA = Pr( [Observed In Tolerance] and [True Out Of Tolerance] )
= Pr( [-L < Deviation < L]
23
PFA Examples
PFA =
NCSL INTERNATIONAL
24
PFA Tool
NCSL INTERNATIONAL
25
Summary
O
26
27
NCSL INTERNATIONAL
28
Information Requirements
PFA Estimation
Information Requirements
Method
Test Point
Population
M&TE
Population
Acceptance
Subpopulation
Bayesian
M&TE
M&TE
Test
Acceptance
Tolerances
Limits
M&TE
M&TE
Calibration
Test Point
Overall
Process
Measurement
Measurement
Measurement
Reliability
Reliability
Uncertainty
X
(if used)
X
(if used)
X
(if used)
NCSL INTERNATIONAL
29
30
NCSL INTERNATIONAL
31
32
NCSL INTERNATIONAL
33
34
NCSL INTERNATIONAL
35
36
NCSL INTERNATIONAL
37
38
39
Altering PFA
O
NCSL INTERNATIONAL
40
Guard Bands
Deviation
Cal
Proc
Error
UUT Bias
Acceptance
-L
-A
41
NCSL INTERNATIONAL
42
Information Requirements
Guard Band Methods
Information Requirements
Method
M&TE
M&TE
Calibration
Test Point
Overall
Process
Measurement
Measurement
Measurement
Reliability
Reliability
Uncertainty
(X)
(X)
M&TE
Test
Tolerances
Test Point
Population
M&TE
Population
Acceptance
Subpopulation
Bayesian
Expanded
Uncertainty
TUR
NCSL INTERNATIONAL
43
Use uncertainty information on the Calibration Process and the UUT test
point population data to calculate the probability of a false accept (PFA)
Choose a guard band which gives an acceptably low PFA
Error Distribution
for Cal Process
Error Distribution
for UUT Bias
Cal Proc
Error
Deviation
UUT Bias
Acceptance
-L
-A
0
NCSL INTERNATIONAL
L
44
45
46
Test Steps
M&TE
Calibration Tests
ICP
NCSL INTERNATIONAL
47
48
49
50
NCSL INTERNATIONAL
51
52
53
Deviation
UUT Bias
Acceptance
-L
-A
0
NCSL INTERNATIONAL
L
54
55
NCSL INTERNATIONAL
56
Deviation
Cal Proc
Error
UUT Bias
Acceptance
-L
-A
0
NCSL INTERNATIONAL
L
57
NCSL INTERNATIONAL
58
NCSL INTERNATIONAL
59
The TUR is obtained from the calibration process uncertainty and the
tolerance limits
For a given TUR, a guard band can be chosen which meets the PFA
requirement for any measurement reliability value
The guard band is a function of the TUR and the tolerance limits
(0.38log(TUR)0.54)
]
60
NCSL INTERNATIONAL
61
NCSL INTERNATIONAL
62
63
64
NCSL INTERNATIONAL
65
10.1 volts
9.9 volts
=
=
=
=
+0.025 volts
0.025 volts
NCSL INTERNATIONAL
66
The 4:1 requirement for the TAR is the same as for the
TUR.
Since the calibrator specifications are based on
calibrator uncertainties rather than calibration process
uncertainties, TAR and TUR can be very different
NCSL INTERNATIONAL
67
10.1 volts
9.9 volts
=
=
=
=
10.025 volts
9.975 volts
NCSL INTERNATIONAL
68
TAR vs TUR
O
69
Summary
O
NCSL INTERNATIONAL
70