Professional Documents
Culture Documents
De Vicente 2020 Meas. Sci. Technol. 31 0440041
De Vicente 2020 Meas. Sci. Technol. 31 0440041
De Vicente 2020 Meas. Sci. Technol. 31 0440041
net/publication/338510711
CITATIONS READS
7 141
9 authors, including:
Some of the authors of this publication are also working on these related projects:
Point-of-care device based on KETs for diagnosis of food allergies (ALLERSCREENING) View project
All content following this page was uploaded by Jesús de Vicente y Oliva on 30 August 2022.
E-mail: alvaro.lavin@upm.es
Abstract
This work describes a procedure to obtain the limit of detection (LoD) of a biosensor device
from a set of measurements that we call immunoassays, which consists of testing the device’s
response to different concentrations of the molecule, which has to be detected throughout its
working range. The procedure, based on the recommendations of international organizations,
provides general expressions to estimate the uncertainty throughout its working range and the
LoD. In the metrological model, the contributions to the uncertainty, due to the determination
of the parameters of the calibration curve, the resolution, the lack of repeatability and others
are taken into account. The model is applied to experimental data from the calibration of
a biosensor. Using iterative weighted least squares techniques, a general logistic function
(6-parameters) has been fitted and used as a calibration curve. The example studied shows
that the lack of repeatability is not always the most important contribution to the LoD. The
final expression of the LoD is equivalent to that of the expanded uncertainty (for a coverage
probability of 99.9%) assigned to the concentration when c ∼ = 0 . This result permits seeing the
LoD as the smallest concentration c measured with the device, whereby uncertainty interval
[c − U99.9% (c) , c + U99.9% (c)] does not include negative values.
2
Meas. Sci. Technol. 31 (2020) 044004 J de Vicente et al
between ai parameters is not negligible; in contrast, this cor- where we √have used the standard deviation of the mean
relation is usually very strong. u (δyr ) = sr / N for the estimation of the uncertainty associ-
The most common calibration curves in the field of biosen- ated with the lack of repeatability where N is the number of
√
sors for adjusting immunoassays are shown below: y repre- repeated measures; the expression u (δyR ) = uR = R/ 12 for
sents the output signal provided by the sensor and lower case the uncertainty component associated with the resolution R of
c is the concentration of the analyte that is being measured: our measuring system assuming a uniform distribution along
Linear: the interval [−R/2, +R/2] (JCGM 2008a, Ellison et al 2012);
y (c) = a · c + b = a1 + a2 · c
(2) parameters fi are the sensitivity coefficients fi = ∂f /∂ai and
uf (y) represent the uncertainty component due to the calibra-
Polynomial: tion. Please note that correlation coefficients r(ai , aj ) have to
y(c) = a1 + a2 · c + · · · + an · cn−1
(3) be taken into account because they are generally not null as
we will show during the numerical example.
Sigmoidal (4-parameter or 5-parameter logistic function) In the linear case (expression 2) we obtain:
(Findlay and Dillard 2007, Xiang et al 2018). For example,
the 5PL would be: u2y = u2 (y) = u2 (b) + c2 · u2 (a)
A−D a 1 − a4 R2 s2
y=D+ = a4 + + 2c · r (a, b) · u (a) u (b) + + r + u2res (10)
(4) c B G [1 +
a a
( ac3 ) 2 ] 5 12 N
[1 + ( C ) ]
Generalized logistic function (6-parameters) (Richards At c = 0, y0 = f (c = 0) and the uncertainty of the signal
1959): output is:
K−A a 1 − a4 R2 s2
y=A+ (11) u2 (y0 ) = u2 (b) + + r + u2res
(5) 1 = a4 + 1/a 12 N
[C + Qe ]
−Bc ν [a5 + a3 e−a2 c ] 6
The critical value CCα can be calculated as follows:
No matter the type of calibration curve chosen, this could
be expressed as follows: yα = y0 + kα · u(y0 ) and CCα = f −1 (yα )
y = f (c, a1 , a2 , · · · , an )
(6) In a similar way, the LoD concentration (cLoD = CCβ) can
be estimated using the following formula:
In our metrological model, the estimated value for y , sup-
posing we have an estimation for the concentration c as it yα = yβ − kβ · u(yβ ) and cLoD = CCβ = f −1 (yβ )
happens during the calibration process, is obtained adding the
In the general case, evaluating CCβ = f −1 (yβ ) could be
following corrections to the previous estimation of the cali-
cumbersome. But the distance between y0 and yβ is usually
bration curve:
small enough to permit the linearization of the calibration
• δ yR due to sensor/instrument resolution. curve in this interval. So, it would be possible to replace
• δ yr due to sensor/instrument repeatability sr . If heteroce- the original non-linear calibration curve with the linearized
dasticity is significant, a function sr = sr (c) is assumed to version, y(c) = a · c + b being a = ∂f /∂c at c = 0 and
be known. b = f (c = 0) = y0 , where a is the slope of the calibration
• δ yres due to other uncertainty sources (environment, curve (the sensitivity) in the vicinity of the zero concentra-
reproducibility, drift, bias, stability, etc…) with uncer- tion and b the value of the calibration curve at zero concen-
tainty u(δyres ) = ures. tration. Using this approximated linear calibration curve we
obtain:
It would be supposed that all these corrections have null
mean but, probably, not null uncertainties u(δyi ). yα = b + kα · u(y0 )
Thus, the model function used to estimate uncertainty
during the calibration according to ISO-GUM (JCGM 2008a) yβ = yα + kβ · u (yβ ) = b + kα · u(y0 ) + kβ · u (yβ )
is the following:
y = f (c, a1 , a2 , · · · , an ) + δyR + δyr + δyres
(8) yβ − b kα · u(y0 ) + kβ · u (yβ )
CCβ = f −1 (yβ ) = =
a a
Propagating uncertainties using the mainstream GUM pro-
cedure (JCGM 2008a, Ellison et al 2012) in this model func- As yβ is assumed to be close to y0, then it is possible to
tion gives the following result (expression 9): approximate u(yβ ) ∼
= u(y0 ) and taking into account that
kα = kβ ∼
= 1.65, we obtain the following expression (12):
R2 s2 »
u2y = u2 (y) = u2f (y) + + r + u2res (9) s2
12 N u(y0 )
2
u2 (b) + R12 + Nr + u2res
cLoD = CCβ = 3.30 = 3.30
n n−1 n a a
where u2f (y) = i=1 fi2 u2 (ai ) + 2 i=1 j=i+1 fi fj · r(ai , aj ) · u(ai )u(aj ) (12)
3
Meas. Sci. Technol. 31 (2020) 044004 J de Vicente et al
where u (b) is the only uncertainty component coming from Table 1. Calibration data.
calibration. Special care must be taken to avoid forgetting Concentration Output Repeatability
other uncertainty sources: resolution, repeatability and others ci Signal yi si min(yij ) max(yij )
included in ures (environment, reproducibility, stability, drift, (µg ml )−1
(nm) (nm) (nm) (nm)
etc…). If we do not consider ures and the resolution uncer-
tainty component and we assume that parameter b of the cali- 1 0.09 0.05 0.00 0.15
bration curve is determined without uncertainty, expression 2.5 0.33 0.18 0.03 0.52
12 becomes expression (1), which ended the first section of 5 0.53 0.14 0.35 0.72
7.5 0.75 0.16 0.51 0.90
this article. Recently, our group pointed out the importance of
10 1.22 0.23 0.85 1.43
the term of uncertainty associated with the resolution R2 /12
15 2.01 0.18 1.71 2.22
to guarantee that the uncertainty of the signal is at least of the 20 3.16 0.32 2.60 3.40
order of magnitude of the resolution and, therefore, the LoD 30 3.73 0.40 3.14 4.18
is consistent with this fact (Lavín et al 2018). 50 4.39 0.39 3.73 4.82
70 5.05 0.22 4.77 5.38
100 5.61 0.30 5.05 6.14
3. Uncertainty throughout the working range
where gi = ∂g/∂ai .and gy = ∂g/∂y. Figure 2. Observed repeatability si versus concentration c .
As we are only interested in the interval between c = 0
and the LoD, we can use instead, the linearized version of Å 2 ã
1 s R2 u2 (b)
the calibration curve. Then, in the linear case, the new model (17) = 2· r +
u2 (c) ∼ + u2res +
function is: a N 12 a2
»2
(y − δyR − δyres ) − b sr R2 2 2
(15) c= (18) N + 12 + ures + u (b)
a u (c) =
a
And the estimation u(c) of the uncertainty of the measured
If we choose a coverage probability of 99.9% the cov-
concentration would be:
erage factor (assuming normality) is k99.9% = 3.30 . So, the
Å 2 ã
1 sr R2 u2 (b) expanded uncertainty near the origin (c = 0) would be:
u2 (c) = · + + u 2
res +
a2 N 12 a2 »2
Å ã2 Å ãÅ ã sr 2
b−y b−y 1 + R12 + u2res + u2 (b)
+ u2
(a) + 2 − r (a, b) u (a) u(b) U99.9% (c) = k99.9% · u (c) = 3.30 N
a2 a2 a a
(16)
When working near the origin (c ∼
= 0, y ∼
= b), previous Therefore, U99.9% (c) near the origin is equal to the LoD
expression can be simplified: (when choosing α = β = 5%):
4
Meas. Sci. Technol. 31 (2020) 044004 J de Vicente et al
Value Uncertainty
Parameter ai u(ai ) Matrix of correlation coefficients r(ai , aj )
a1 K 0.0064 0.0046 1 +0.20 +0.11 +0.32 −0.18 −0.27
a2 B 0.079 0.011 +0.20 1 +0.55 +0.73 −0.52 −0.58
a3 Q 0.034 19 0.003 71 +0.11 +0.55 1 +0.52 −0.80 +0.11
a4 A −0.33 0.16 +0.32 +0.73 +0.52 1 −0.76 −0.70
a5 C 0.965 53 0.004 29 −0.18 −0.52 −0.80 −0.76 1 +0.15
a6 ν 0.012 613 0.001 410 −0.27 −0.58 +0.11 −0.70 +0.15 1
b f 0 0.014 0.048 1 −0.32
a f c 0.075 0.016 −0.32 1
U99.9% (c ≈ 0) = cLoD
(19) The point where straight lines sr (c) = 0.34 nm and
sr (c) ∼
= (0.049 + 0.0126 · c [µg ml−1 ]) nm intersect is
c = 23 µg ml−1 (see figure 2, dotted red lines). Therefore,
4. Experimental example the final result for the whole range 0–100 µg ml−1 would be:
ß
c < 23 µg ml−1 (0.049 + 0.0126 · c [µg ml−1 ]) nm
Table 1 shows experimental results from a biochip calibration sr (c) =
c 23 µg ml−1 0.34 nm
(Hernández et al 2016). This biochip, formed by six BICELLs
(Biophotonic Sensing Cells), (Holgado et al 2010) is going to Back to the estimation of the calibration curve, we have used
be used as an antibody-based (anti-IgG) label-free biosensor. an iterative weighted least squares procedure to fit a general
The calibration has been performed over m = 11 calibration logistic function (6-parameters) to the points (ci , yi ) . Weights
points from c1 = 1 µg ml−1 to c11 = 100 µg ml−1 where uncer- have been chosen inversely proportional to observed repeat-
tainties are negligible against other uncertainty sources. The abilities si. The uncertainty propagation has been performed
output signal yi is the resonant dip shift, expressed in nm, using Monte-Carlo simulation (JCGM 2008b). The fitting
observed when the sensor is exposed to antibody concentra- results are presented in table 2, where f0 and fc represent the
tions ci . The readout instrument resolution is R = 0.12 nm. parameters b = f (c = 0) and a = ∂f /∂c at c = 0 of the lin-
Values yi = j yij /6 represent the average output over six earized calibration curve y = b + a · c . Figure 3 represents
BICELL readouts, and yij and si represent the observed the fitted calibration curve (red line) with uncertainty bands
repeatability at this calibration point. ±k99.9% · uf (green lines) and calibration data (blue circles
If we plot observed repeatabilities si versus concentration c and error bars). Remember that uf represents the uncertainty
(see figure 2) we can observe that, for lower concentrations, repeat- contribution coming from calibration, see expression (9).
ability increases with concentration. But for c 30 µg ml−1, Introducing results from table 2 in the expression of the
observed repeatabilities si pass the Hartley’s test (Hartley LoD (expression 12) we obtain:
1950) indicating that repeatability remains constant over »
30 µg ml−1. In this range (30–100 µg ml−1) we have estimated 2 s2
u2 (b) + R12 + Nr + u2res
the repeatability using the root mean square of si: cLoD = 3.30 = 3.30
a
2 (0.12 nm)2 2
sr c 30 µg ml−1 = s2i = 0.34 nm (0.048 nm) + 12 + (0.0493 nm) +0
ci 30 µg ml−1
= 2.9 µg ml−1
0.075 µg ml−1 × nm−1
For concentrations lower than 30 µg ml−1 we have supposed
where we have supposed that:
that repeatability increases linearly with concentration:
• we repeat the measurement three times ( N = 3);
sr (c) ∼
= as · c + bs
• the repeatability sr is close to sr (c = 0) = 0.049nm;
In order to estimate parameters as , bs we have used a weighted • the uncertainty component ures is negligible in comparison
least squares procedure with weights inversely proportional to with the previous ones.
observed repeatabilities si as described in section 5.3.2 of ISO
But in c = 2.9 µg ml−1 the repeatability is sr (c) ∼
= (0.049+
11843-2 (ISO 2000). The final result is:
0.0126 · 2.9) = 0.085 nm, which is a value significantly higher
sr (c) ∼
= (0.049 + 0.0126 · c [µg ml−1 ]) nm than sr (c = 0) = 0.049 nm. Therefore we have to reevaluate
cLoD using, in this case, the value of sr (c) at the center of the
Now, the normalized repeatibilities s i = sr (ci )/si pass the
interval 0–2.9 µg mL−1:
Hartley’s test, indicating that the estimated function sr (c) Å ã
explain satisfactorily the variation of the repeatability along 1 g ∼
sr c = · 2.9 µ = (0.049 + 0.0126 · 1.45) = 0.067 nm
the range 0–30 µg ml−1. 2 ml
5
Meas. Sci. Technol. 31 (2020) 044004 J de Vicente et al
Figure 3. Calibration curve. Figure 6. Distribution of measured concentration c at LoD
(3.1 µg ml−1).
6
Meas. Sci. Technol. 31 (2020) 044004 J de Vicente et al
Acknowledgments
7
Meas. Sci. Technol. 31 (2020) 044004 J de Vicente et al
Hartley H O 1950 The maximum f-ratio as a short-cut test Lavín A, de Vicente J, Holgado M, Laguna M F, Casquel R,
for heterogeneity of variance biometrika Biometrika Santamaría B, Maigler M V, López Hernández A and
37 308–12 Ramirez Y 2018 On the determination of uncertainty and limit
Holgado M, Barrios, C A, Ortega F J, Sanza F J, Casquel R, of detection in label-free biosensors Sensors 18 38
Laguna M F, Bañuls M J, López-Romero D, Puchades R Long G L and Winefordner J D 1983 Limit of detection: a closer
and Maquieira A 2010 Label free biosensing by means of look al the IUPAC definition Anal. Chem. 57 712A–24A
periodic lattices of high aspect ratio SU-8 nanopillars Biosens. Look H P and Wentzell D P 2012 Detection limits of chemical
Bioelectron. 25 2553–8 sensors: applications and misapplications Sens. Actuator B
ISO 11843-1 1997 Technical Committee ISO/TC 69 Subcommittee Chem. 172 157–63
SC6 Capability of Detection: Part 1: Terms and Definitions Magnusson B and Ornemark U (ed) 2014 Eurachem Guide:The
(ISO: Geneva) Fitness for Purpose of Analytical Methods—a Laboratory
ISO 11843-2 2000 ISO Technical Committee ISO/TC 69 Guide to Method Validation and Related Topics 2nd edn
Subcommittee SC6 Capability of Detection: Part 2: (www.eurachem.org)
Methodology in the Linear Calibration Case Richards F J 1959 A flexible growth function for empirical use
(ISO: Geneva) J. Exp. Bot. 10 290 300
IUPAC 1997 Compendium of Chemical Terminology, 2nd ed. the Sang S, Wang J, Feng Q, Wei Y, Ji J and Zheng W 2015 Progress
‘Gold Book’ (Blackwell Scientific Publications: Oxford) of new label-free techniques for biosensors: a review Crit. Rev.
JCGM/BIPM 2008a Evaluation of Measurement Data—Guide to Biotechnol. 36 465–81
the Expression of Uncertainty in Measurement. JCGM 100 Sit V and Poulin-Costello M 1994 Biometrics Information,
(https://www.bipm.org/en/publications/guides/) Handbook nº 4: Catalog for Curve Fitting (https://www.for.
JCGM/BIPM 2008b Evaluation of Measurement Data— gov.bc.ca/hfd/pubs/docs/bio/bio04.pdf)
Supplement 1 to the “Guide to the Expression of Uncertainty Xiang Y, Donley J, Seletskaia E, Shingare S, Kamerud J and
in Measurement”—Propagation of Distributions Using a Girovits B 2018 A simple approach to determine a curve fitting
Monte Carlo Method. JCGM 101 (https://www.bipm.org/en/ model with a correct weighting function for calibration curves in
publications/guides/) quantitative ligand binding assays AAPS J. 20 45
JCGM/BIPM 2012 International Vocabulary of Metrology—Basic Zanchetta G, Lanfranco R, Giavazzi F, Bellini T and Buscaglia M
and General Concepts and Associated Terms. JCGM 200 2017 Emerging applications of label-free optical biosensors
(https://www.bipm.org/en/publications/guides/) Nanophotonics 6 627–45