Professional Documents
Culture Documents
Quality Assurance of Automated Measuring Systems: Infomil
Quality Assurance of Automated Measuring Systems: Infomil
Quality Assurance of Automated Measuring Systems: Infomil
Quality assurance
of automated
measuring systems
Continuous measurements
This factsheet is part of the L40 series “Measurement of The right factsheet?
air emissions”. L40 consists of a manual that deals with In the factsheets a distinction is made between
periodic measurements and continuous
the background of the measurement of air emissions measurements with automated measuring
systems. This factsheet focuses on the assessment
and a series of factsheets that per component of the quality assurance of automated measuring
systems within the framework of the NEN-EN 14181
consider the specific quality-determining aspects of standard. When this standard is not prescribed, the
factsheet on continuous measurements for the
the measurement in question. These main quality component in question applies. Note that for the
assessment of parallel measurements within the
aspects can be found in the checklists on p. 7 and 8. framework of NEN-EN 14181 you are referred to the
factsheet on the periodic measurement in
The factsheets and the manual serve to support question.
the competent authority. You can use them in the If you have any questions concerning this factsheet,
please surf to website www.infomil.nl. You can also
assessment of the quality of air measurements. contact the helpdesk, telephone +31 (0)70 373 55 75,
e-mail helpdesk@infomil.nl. You can find the opening
hours on the website.
L40-7C Quality assurance of automated measuring systems - InfoMil - October 2005
Background Principle
QAL3
QAL1 QAL2
AST
2
L40-7C Quality assurance of automated measuring systems - InfoMil - October 2005
QAL1 is a once-only procedure where it is Operation-specific conditions for a CEMS: percentage of the emission limit value or year
evaluated whether a measuring system • Size of process variations (influencing of average concentration, expressed as 95%
(sampling and analysis system) can meet the concentration profiles) confidence interval. The uncertainty
uncertainty requirement as specified in the law • Level / variation in concentration of disturbing determined in QAL1, expressed as standard
and regulations. The procedure is laid down in components deviation (s), must therefore be multiplied by a
NEN-EN-ISO 14956: Air Quality – Evaluation of • Level / variation in ambient temperature and factor 2 (formally 1.96) to make a comparison
the suitability of a measurement procedure by pressure possible.
comparison with a required measurement • Variation in mains voltage
uncertainty. This procedure is generally carried • Quality of control gasses 6 During QAL3 it will be checked with the aid of
out by the manufacturer or supplier of the control gasses (or an alternative procedure for
measuring equipment within the framework of Examples of relevant uncertainty sources for a PEMS) whether during the year the measuring
certification or type approval. PEMS are: instrument meets the set uncertainty
• The uncertainty of the instruments used to requirement. The criteria for this procedure are
On the basis of the technical characteristics of measure the input data for the model determined during QAL1 (see QAL3/2).
the measuring system and the conditions • The uncertainty of the model
under which the measuring system will • For gas turbines, the uncertainty due to the 7 The response time of a measuring system is
operate, an estimate is made of the uncertainty deviating air conditions with respect to the determined by various factors, such as the
of the measurement result. The outcome of the conditions when the model was set up residence time of the sample and the electronic
estimate is tested against the specified time constant of the measuring system.
uncertainty requirement. First, all uncertainty 2 The sampling is often an important source of The influence of the response time on the
sources are identified, the size of the measurement uncertainty. When the measurement result is dependent on the speed
uncertainty quantified per source, and measurement body that performs the QAL2 at with the concentration changes take place in
then all individual uncertainties are combined procedure does not detect any significant the process and the smallest averaging time
to form the total uncertainty.. concentration differences across the cross- over which a measurement value must be
section of the stack (concentration profile), the given. According to NEN-EN-ISO 14956, the
influence of this source is negligible. When response time must be smaller than 25% of the
there is a constant concentration profile, this is, shortest time period over which, in accordance
Main quality aspects in principle, corrected by the calibration (QAL2). with the law and regulations, an average
Changes of the concentration profile over time, concentration must be determined. For highly
1 The QAL1 report must show whether the used for example due to variation in operation, are, dynamic processes, 10% should be used.
measuring instrument can provide suitable however, not corrected and must therefore be
measurement results under all normally included as an uncertainty source in QAL1.
occurring operating conditions. The QAL1
report therefore contains, in addition to an 3 With the procedure in accordance with NEN-EN-
overview of the relevant uncertainty sources ISO 14956, the measurement uncertainty of
(linked to the performance characteristics of measurement values is obtained without a
the measuring instrument) insight into the possible conversion to standard conditions
variations that can occur in the operating being taken into account. When a conversion is
conditions. In principle, the procedure is carried required, it must be included in the QAL1
out at a test value that corresponds with the procedure. This is, for example, the case in BEES
emission limit value. Within the framework of A, where the uncertainty requirement is related
NOx emissions trading, however, the year to the emission limit value at standard
average NOx concentration is used as test value. conditions (concentrations at T=273 K, P=101.3
kPa, in dry flue gas and possibly at standard
Examples of relevant uncertainty sources for a oxygen percentage). The determination of the
CEMS are: additional measurement data (temperature,
• Representativeness of sampling pressure, moisture and oxygen content) are
(possible concentration profiles) then possible sources of uncertainty.
• Influence of sample transport and conditioning
(possible loss of component) 4 Data on the performance characteristics of the
• Repeatability or reproducibility measuring instrument can be based on the
at zero concentration manufacturer’s specifications or on tests within
• Repeatability or reproducibility the framework of type approval, such as the
at test value TÜV quality mark in Germany and the MCERTS
• Drift quality mark in Great Britain. These information
• Deviation from linearity sources will usually contain no data on the
• Influence of interfering components operating conditions under which the
• Influence of ambient temperature and pressure measuring instrument must function.
• Influence of mains voltage variation
• Influence of uncertainty of control gasses that 5 The total uncertainty of the measuring
are used during QAL3 instrument, such as is established during QAL1,
• Uncertainty in the determinations of T, P, must be tested against the uncertainty
moisture and oxygen content (for the requirement as specified in the law and
conversion to standard conditions) regulations. This requirement is given as a
L40-7C Quality assurance of automated measuring systems - InfoMil - October 2005
QAL2 gives the procedures for the periodic reference method for the component in response time of the automated measuring
calibration and validation of the automated question (SRM, see QAL2/5). The measurements system. In general, the sampling time is equal
measuring system after it has been installed must be distributed evenly over at least three to the shortest averaging period for which an
and functional tests have been performed (see working days. The three working days need not emission limit value has been set. The time
AST). The calibration takes place through a be consecutive, but must lie within a period between the start of 2 consecutive
series of minimally 15 parallel measurements of four weeks. It is recommended during the measurements should be at least 1 hour.
that are performed simultaneously with the calibration to vary the concentration of the
automated measuring system and by a component in question as much as possible 8 The results of the automated measuring system
measurement body with the standard within the normally occurring operating and of the measurement body by means of the
reference method (SRM) for the component in conditions. This will prevent that later too many SRM must be expressed in the same units and
question. The relation between the measure- measurement values will fall outside the valid under the same conditions in order to avoid
ment results of the automated measuring calibration range and hence make a new QAL2 double conversions and other calculation
system and of the SRM is recorded in a necessary (see QAL2/9 and 11). errors. On the basis of the results of the parallel
calibration function and this function is used to measurements, a calibration function y = a + bx
correct the measurement values of the 4 The law and regulations can specify that a is established in accordance with the procedure
automated measuring system. The measure- measurement body must be accredited on the in NEN-EN 14181. Here x is the “bare” read-out
ment values are also subjected to a so-called basis of NEN-EN-ISO/IEC 17025 or 17020 or that and y the calibrated measurement value of the
variability test. it must apply these standards in a demonstrable automated measuring system. Data from
way. The standards contain the requirements previous calibrations may not be used for
The standard describes the calibration without that a measurement body must meet when it establishing a new calibration function.
considering a possible conversion to standard wants to demonstrate that it works in The calibration function must be used to
conditions. When a conversion is required, it is accordance with a quality system, is technically determine the emission concentrations. This
recommended to include it in the calibration. competent and is able to provide technically- generally means that the values of a and b from
This is, for example, the case in BEES A, where valid results. In the Netherlands, accreditation the calibration function must be taken over in
the emission limit values are given at standard takes place by the Council for Accreditation the programme that is used to calculate the
conditions (concentrations at T=273 K, P=101.3 (Raad voor Accreditatie, RvA). Accreditation by emission concentrations. Here the earlier used
kPa, in dry flue gas and possibly at standard comparable foreign agencies is also recognised. values of a and b must be dealt with correctly
oxygen percentage). In this way, any errors in Please note, the accreditation is related to a (do not perform a double correction!).
data processing procedures, such as scope. The scope states for which type of
calculations in relation to corrections for measurement the accreditation is valid. 9 The calibration function is valid within a certain
moisture content and oxygen content, are concentration range that runs from zero to the
included in the calibration. 5 The standard reference methods (SRM) for maximum calibrated concentration of the
performing parallel measurements are often automated measuring system plus 10% of this
In situations where the measurement values prescribed in the law and regulations. maximum value. Measurement values outside
lie far below the emission limit value, the The InfoMil site gives an overview of these the valid calibration range are permitted to a
performance of a full calibration is less useful. measurement methods. With the aid of the limited extent (see QAL2/11 and QAL3/3).
It can be performed in a limited way (see, for factsheet on the periodic measurement for the
example, NEN-EN 13284-2 and NEN-EN 14884). component in question it can be checked 10 The dispersion of the values of the automated
whether these measurements are performed measuring system with respect to the
by the measurement body in accordance with calibration function is called the variability.
the measurement standard. Any conversion The variability is tested against the uncertainty
Main quality aspects measurements must also be performed with requirement as specified in the law and
the SRM in question. regulations.
1 According to NEN-EN 14181, QAL2 must be
performed minimally every five years or with a 6 The parallel measurements with the SRM must 11 When there are clearly distinguishable types of
frequency as prescribed in the law and be performed including sampling. This means operations that lead to a clearly different flue
regulations. BEES A, Bva and the Decree on that the measurement body performing the gas concentration (e.g. due to varying fuels),
emissions trading prescribe once every three SRM measurements must itself draw a a separate QAL2 must be performed for each
years. Apart from certain functional tests, representative sample from the stack and may type of operation. Furthermore, QAL2 must be
the systematics is the same for CEMS and PEMS. not use the company’s sampling system. In this repeated when it appears that too many
way, any concentration profile can be identified measurement values fall outside the valid
2 Prior to calibration it must be examined and corrected. In practice, the measurement calibration range (see QAL3/3). Measurement
whether the measuring system is installed facilities are not always adequate to make the values outside the valid calibration range have
properly and operates normally. The results of above possible. If this is the case, arrangements an insufficiently-assured quality and are invalid
these functional tests (see AST for an overview) must be made with the operator concerning within that framework. However, these values
must be documented. In case of deviations necessary modifications. are not excluded from testing against the
that can affect the quality of the measurement emission limit value.
data, the operator must undertake corrective 7 The automated measuring system and the
and preventive actions. measurement body that performs the SRM
must record average observations at precisely
3 During calibration, minimally 15 parallel the same time intervals. The sampling time for
measurements are performed with the each parallel measurement should minimally
measuring system and with the standard be half an hour or minimally four times the
4
L40-7C Quality assurance of automated measuring systems - InfoMil - October 2005
QAL3 describes the ongoing quality control Main quality aspects (span). These rejection criteria follow from
that is performed by the operator in order to QAL1. Here only a part is used of all data that is
demonstrate that the automated measuring 1 The frequency of the QAL3 checks must be applied for the calculation of the total
system continues to operate within the aligned to the period over which the drift is measurement uncertainty. Because no real
specified uncertainty requirement. According specified in QAL1. Because it concerns an samples are involved during QAL3 but control
to the standard this is done by means of ongoing quality control, once per two weeks is gasses, the influence of the sampling and
periodic zero and span checks, tests where an a minimum frequency. interfering components, for example, can be
inert zero gas and a control gas with a known disregarded.
concentration of the component in question CEMS are checked by providing a zero gas
(the span gas) are provided to the measuring (without the component in question) and a PEMS checks (REFBO or MIP) are recorded in a
system The response of the measuring system control gas (with known concentration of the similar way. Shewart or CUMSUM charts are
is recorded with the aid of a control chart and component in question). This procedure is examples of control charts. Both types of charts
the results are subjected to a certain criterion. known as a zero and span check. The indicate when the deviations are of such a size
In this way, deviations in drift and/or precision concentration of the control gas should be that maintenance of the measuring system is
of the measuring system with respect to the around 80% of the measuring range. Each necessary. The advantage of the CUSUM chart
situation during QAL1 can be detected. control gas bottle must be provided with an is, however, that drift and precision are
Adjustments of the zero value and/or span analysis certificate. evaluated separately. When only the drift shows
value by the operator or maintenance of the an improper deviation, an adjustment of the
measuring system (e.g. by the supplier) may be In a PEMS, tests with a control gas are by zero value and/or the span value can be made
necessary due to the results definition not possible. In some in-situ by the operator.
of the evaluation. measuring systems, the providing of a zero and
control gas is also difficult. In the 3 Part of the ongoing quality control is that the
documentation for the implementation of operator checks on a weekly basis how many
NEN-EN 14181 within the framework of NOX measurement values fall outside the valid
emissions trading (see More information) two calibration range. In the following cases,
alternative methods are worked out for such QAL2 should be repeated within 6 months:
situations. In the inspection on the basis of a • When per week for a period of more than five
reference situation of the operating conditions weeks over 5% of the measurement values lie
(REFBO), an operating situation is defined that is outside the valid range of the calibration
expected to occur with great regularity during function.
the year. The characteristic operation • When in a week over 40% of the measurement
parameters of the REFBO are recorded. values lie outside the valid range of the
Each time that a QAL3 procedure is performed calibration function (see QAL2/9 and 11).
it is established whether the REFBO occurred
over the past period and which NOX
concentration was then ascertained by the
automated measuring system. Care must be
taken that the parameters used to define the
REFBO do not occur as parameters in the
measuring system. In the other method, the
model input parameters (MIP) are checked. In
this method, the value of the input parameters
of the model is compared with the value of
another, independent parameter. This
independent parameter is related to the input
parameter, but is not part of the calculations
with the model. Generally flow rate
measurements, temperature measurements
and other process measurements are
performed in duplicate, which provides the
possibility to check the input parameters of the
PEMS by comparison with an independent
measuring instrument.
5
L40-7C Quality assurance of automated measuring systems - InfoMil - October 2005
AST The AST gives the procedure for the Functional tests Extractive In-situ
annual inspection to determine whether the Part / aspect CEMS2) CEMS3)
automated measuring system is still operating Alignment and cleanliness (visual inspection) x
within the specified uncertainty requirement Sampling system (visual inspection) x
as demonstrated during the QAL2 procedure Documentation and reports x x
and whether the calibration function is still (logs, maintenance reports, QAL3 documentation, etc.)
valid. Serviceability (safe working environment, good access to AMS, etc.) x x
Leak test x
During the AST, an extensive set of functional Zero and span check x x
tests are carried out that, on the one hand, is Linearity 4) 4)
focused on the condition of the equipment Influence of interfering components 4) 4)
and, on the other, on the procedural aspects Zero and span drift (audit QAL3 data) 4) 4)
and the results of the ongoing quality control Response time x x
of the previous year. The standard specifies
Report of the functional tests x x
that the functional tests must be performed by
an experienced testing laboratory. In view of
Functional tests PEMS
the nature of these tests it is likely that several
Part/aspect
types of organisations will be involved in
Instrument-specific tests x
performing the tests: calibration laboratories,
Documentation and reports x
measurement bodies for emission
(logs, maintenance reports, QAL3 documentation, etc.)
measurements, maintenance organisations,
Serviceability x
suppliers and inspection organisations. It is
(safe working environment, good access to measuring instruments, etc.)
therefore recommended to draw up a
performance plan. REFBO or MIP checks (audit QAL3 data) 4)
Report x
In addition, a limited series of minimally five 2)
AMS with a sampling system with which a representative flue gas sample is drawn,
parallel measurements are performed with the which is then analysed outside the stack.
automated measuring system and by a 3)
AMS with which the flue gas composition is measured directly in the stack.
measurement body with the standard 4)
This test is performed exclusively during the AST.
reference method (SRM) for the component in
question. The results of these measurements
are subjected to a variability test and a test on
the validity of the calibration function.
Main quality aspects 4-7 See Quality-determining factors QAL2. More information
QAL1 procedure NEN-EN-ISO 14956
1 The AST is carried out annually in the period 8 The dispersion of the values of the automated Quality assurance NEN-EN-ISO/IEC
between two QAL2 procedures. Apart from measuring system in relation to the calibration measurement body / 17025 or 17020
certain functional tests, the systematics is the function is called the variability. The variability laboratory
same for CEMS and PEMS. is tested against the uncertainty requirement as NEN-EN 14181 Website Netherlands
specified in the law and regulations. The AST Implementation within Emission Authority
2 Prior to the parallel measurements it must be also includes a test of the validity of the the framework of NOx (NEa)
determined whether the measuring system is calibration function. The results of the AST emissions trading;
installed properly and operates normally. measurements may be used to extend the valid Background document,
The results of the functional test must be calibration range. If one or both of the above- factsheets and
documented. In case of deviations that can mentioned tests are negative, the causes must calculation sheets
have an effect on the quality of the measure- be identified and rectified. New parallel Standard reference www.infomil.nl
ment data, the operator must undertake measurements in accordance with the QAL2 methods (SRM)
corrective and preventive actions. procedure must then be performed within six Background InfoMil publication
Recommendations as a result of deviations months. information “Measurement of air
detected earlier must have been adopted or emissions” (L40)
implemented. These recommendations can be
found in the conclusions of the latest AST or
QAL2 report.
6
L40-7C Quality assurance of automated measuring systems - InfoMil - October 2005
7
Checklist for quality When one of the questions in the checklists is
assurance of automated answered negatively and no satisfactory reasons
measuring systems cont. are given for the deviation, then corrective
measures are necessary for obtaining a reliable
measurement result.
in charge of
Although this publication has been prepared with the greatest possible care, SenterNovem cannot
accept any liability for any errors it may contain. With regard to SenterNovem publications which
provide information about subsidy schemes, the assessment of subsidy applications takes place solely
on the basis of the official publication of the relevant decree in the Netherlands Government Gazette
(Staatscourant).