Professional Documents
Culture Documents
Report No Report No Report No Report No. 925 925
Report No Report No Report No Report No. 925 925
No. 925
Round No.
o. 182
August 2015
Acknowledgments
PTA wishes to gratefully acknowledge the technical assistance provided for this program by
Dr M Buckley
Buckley-Smith
Smith and Mrs R Ryan,
Ryan, Global Proficiency Ltd (New Zealand). Also our thanks
go to Global Proficiency Ltd (New Zealand) and to Global Proficiency Pty Ltd (Australia) for
the supply and distribution of the samples.
PO Box
Box 7507 SILVERWATER NSW 2128,
2128, Australia
SD 9.17.09
CONTENTS
1. Foreword ............................................................................................................................ 1
2. Program Features and Design ........................................................................................... 1
3. Statistical Format ............................................................................................................... 2
4. PTA and Technical Advisers' Comments........................................................................... 4
5. Outlier Results ................................................................................................................. 25
6. References ...................................................................................................................... 25
Total Solids............................................................................................................................ A1
Total Suspended Solids ........................................................................................................ A7
Total Dissolved Solids ......................................................................................................... A13
APPENDIX C – Documentation
SD 9.17.09
1
1. Foreword
The exercise was conducted in June 2015 by Proficiency Testing Australia (PTA).
The main aim of the program was to assess laboratories’ abilities to competently
perform the prescribed analyses.
The Program Coordinator was Mrs D Mihaila and the Technical Advisers were
Dr M Buckley-Smith and Mrs R Ryan, Global Proficiency Ltd (New Zealand). This
report was authorised by Mrs F Watton, PTA Quality – Business Development
Manager.
2.1 Each laboratory was randomly allocated a unique code number for the program to
ensure confidentiality of results. Reference to each laboratory in this report is by code
number only. Please note that a number of laboratories reported more than one set of
results and, therefore, their code numbers (with letter) could appear several times in
the same data set.
2.2 Laboratories were provided with the "Instructions to Participants" and "Results Sheet"
(see Appendix C). Laboratories were requested to perform the tests according to their
routine methods.
2.3 Participants were provided with two plastic bottles (labelled PTA 1 and PTA 2)
containing water samples for the analysis of Total Solids, Total Suspended Solids and
Total Dissolved Solids.
Of these 46 laboratories, one was unable to submit results by the due date.
2.5 Results (as reported by participants) with corresponding summary statistics (i.e.
number of results, median, normalised interquartile range, uncertainty of the median,
robust coefficient of variation, minimum, maximum and range) are presented in
Appendix A (for each sample and for each of the analyses performed).
2.6 A robust statistical approach, using z-scores, was utilised to assess laboratories’
testing performance (see Section 3). Robust z-scores and ordered z-score charts
relevant to each test are presented in Appendix A.
SD 9.17.09
2
The document entitled Guide to Proficiency Testing Australia, 2014 (reference [1])
defines the statistical terms and details the statistical procedures referred to in this
report.
2.7 A tabulated listing of laboratories (by code number) identified as having outlier results
can be found on page 25.
2.8 Prior to sample distribution, a number of randomly selected samples were analysed
for homogeneity and stability. Based on the results of this testing (see Appendix B) it
was considered that the samples utilised for this program were homogeneous and
stable. As such, any results later identified as outliers could not be attributed to any
notable sample variability.
3. Statistical Format
Each determination was examined for outliers with all methods pooled. The table on
page 25 summarises the outlier results detected.
The tables in Appendix A contain the results returned by each laboratory, including
the code number for the method used and the robust z-score calculated for each
result.
Results have been entered exactly as reported by participants. That is, laboratories
which did not report results to the precision (i.e. number of significant figures)
requested on the Results Sheet have not been rounded to the requested precision
before being included in the statistical analysis.
SD 9.17.09
3
A list of summary statistics appears at the bottom of each of the results tables and
consists of:
For normally distributed data, the uncertainty of the median is approximated by:
2 √
= number of results.
Please see reference [1] for further details on these robust summary statistics.
These charts contain solid lines at +3.0 and -3.0, so that outliers are clearly
identifiable as those laboratories whose "bar" extends beyond these "cut-off" lines.
The y-axis of these charts has been limited, so very large z-scores appear to extend
beyond the chart boundary.
SD 9.17.09
4
Consensus values (median) derived from participants’ results are used in this
program. These values are not metrologically traceable to an external reference.
Solutions were stable and homogeneous, and medians obtained from this proficiency
round were in consistent agreement with the expected levels (dope concentration), as
shown in Table 1.
As the assigned value for each analyte in this program is the median of the results
submitted by the participants, the uncertainty of the median for each analyte has
been calculated and is presented in Table 1 below.
Table 1. Comparison of expected levels (dope concentration) and proficiency medians. The
values of the calculated uncertainty of the median are also presented.
Dope Uncertainty
Median
Analyte Sample Concentration of the Median
(mg/L)
(mg/L) (mg/L)
Overall, the performance of participants in this round was good, with robust CVs
below 10% for all analytes.
SD 9.17.09
5
Table 2 compares the Total Solids medians and robust CVs from this round to those
obtained in previous PTA rounds. The CVs for Total Solids were similar or better
than seen in previous rounds.
Table 2. Comparison of current round variability and proficiency medians of Total Solids
testing with the results of the previous two rounds.
Median
Round Sample Robust CV (%) Participants
(mg/L)
PTA 1 541.0 2.6 33
This study
PTA 2 358.0 4.1 33
PTA 1 275.0 6.2 41
Report 892
PTA 2 435.0 4.0 42
PTA 1 371.0 6.2 49
Report 830
PTA 2 266.0 8.1 49
Bias / Accuracy
The Total Solids testing was successfully performed, with satisfactory results (|z-
score| ≤ 2.0) ranging between 513 – 569 mg/L for sample PTA 1 and 329 – 387 mg/L
for sample PTA 2.
Out of 33 participants, three questionable results (2.0 < |z-score| < 3.0) were reported
for sample PTA 1 (laboratories 286, 551 and 633) and two questionable results were
reported for sample PTA 2 (laboratories 551 and 634).
Four outlier results (|z-score| ≥ 3.0) were obtained for sample PTA 1, requiring follow-
up action by laboratories 272, 464, 499 and 568. Five outlier results were obtained for
sample PTA 2, requiring follow-up action by laboratories 272, 303, 464, 499 and 568.
The most likely source of error, causing low bias when testing these proficiency
samples, is incomplete transfer of the entire contents of the bottle into the volumetric
flask, with rinsing as per the instructions to participants. It is important to rinse the
sides of the bottle, the cap, the funnel and the stem of the funnel. Once the entire
sample has been transferred, the vessel should be brought to volume and mixed
thoroughly. Vigorous shaking for at least thirty seconds will mix the sample, but a
magnetic stir bar for 5-10 min will ensure a more homogeneous sample.
The Total Solids data set formed an approximately normal distribution with no
substantial bias attributable to any one method (Figures 1 and 2). The method most
frequently used for Total Solids analysis was APHA 2540 B (Total Solids Dried at
103-105ºC - method code 1), which was used by approximately 64% of participants.
SD 9.17.09
6
24
APHA 2540 B
US EPA 0160.3
20 Calculation
Other
Not specified
16
Frequency
12
0
350 375 400 425 450 475 500 525 550 575 600 625 650 675
Results (mg/L)
Figure 1. Spread of results for Total Solids testing of sample PTA 1, with a median of 541.0
mg/L.
24
APHA 2540 B
US EPA 0160.3
20 Calculation
Other
Not specified
16
Frequency
12
0
160 190 220 250 280 310 340 370 400 430 460 490 520 550
Results (mg/L)
Figure 2. Spread of results for Total Solids testing of sample PTA 2, with a median of 358.0
mg/L.
SD 9.17.09
7
4
APHA 2540 B
Calculation
Other
Not Specified
3
Frequency
0
0 7.5 15 22.5 30 37.5 45 52.5 60 67.5 75 82.5 90 97.5
Measurement Uncertainty (mg/L)
Figure 3. MU for Total Solids testing of sample PTA 1, as reported by participants, compared
with 95% confidence interval for overall reproducibility, ± 29.5 mg/L in this round, shown as a
dashed line.
The range of MU for Total Solids was expected to be between 6.1 – 42.3 mg/L (1.1%
- 7.8%) for sample PTA 1 and between 6.5 – 44.5 mg/L (1.8% - 12.4%) for sample
PTA 2, based on minimum / maximum uncertainty criteria (umin and umax) described in
ISO 13528:2015 [2]. Laboratories 323a, 382 and 551 may wish to re-examine their
measurement uncertainty for Total Solids testing, as their MU was smaller than the
uncertainty of the assigned value (95% CI) for one or more of the samples tested. It is
possible that these laboratories have underestimated their MU, particularly in light of
the variability expected in natural water samples.
It should be noted, however, that the umin and umax are informative indicators only and
can not be solely used to validate or invalidate the MUs reported.
Of slightly less concern were the laboratories who reported MU that were larger than
three times the normalised interquartile range, 3NIQR (Umax), however this can be
explained by the unusually tight homogeneity of these artificial solids samples
compared to a natural sample which would be expected to have more variability.
SD 9.17.09
8
6
APHA 2540 B
Calculation
5 Other
Not specified
4
Frequency
0
0 7.5 15 22.5 30 37.5 45 52.5 60 67.5 75 82.5 90 97.5
Measurement Uncertainty (mg/L)
Figure 4. MU for Total Solids testing of sample PTA 2, as reported by participants, compared
with 95% confidence interval for overall reproducibility, ± 25.8 mg/L in this round, shown as a
dashed line.
A t-test of all the results (outliers removed), indicated that the overall reproducibility
for Total Solids testing was 541.0 ± 29.5 mg/L (5.5%) for sample PTA 1 and 358.0 ±
25.8 mg/L (7.2%) for sample PTA 2 (95% CI). Over the last six PTA rounds (Reports
925, 892, 830, 767, 741, 698), where samples presented ranged between 262 mg/L –
600 mg/L Total Solids, the average reproducibility was 15%. This is a good
approximate MU and laboratories starting out calculating their MU can compare their
values against this PTA estimation.
SD 9.17.09
SD 9.17.09
700
650
550
Results (m g/L)
500
9
450
400
350
300
323 a
329 b
126
144
214
271
272
286
382
398
410
430
499
519
542
545
551
563
568
588
633
634
660
Laboratory Code
Figure 5. Total Solids - Results of sample PTA 1, including MU, compared to the median.
SD 9.17.09
550
500
400
10
350
300
250
200
323 a
329 b
126
144
214
271
272
286
382
398
410
430
499
519
542
545
551
563
568
588
633
634
660
Laboratory Code
Figure 6. Total Solids - Results of sample PTA 2, including MU, compared to the median.
11
Table 3 compares the Total Suspended Solids medians and robust CVs from this
round to those obtained in previous PTA rounds. The variability of results in this round
was similar to those seen in previous rounds.
Table 3. Comparison of current round variability and proficiency median of Total Suspended
Solids testing with the results of the previous two rounds.
Median
Round Sample Robust CV (%) Participants
(mg/L)
PTA 1 45.50 9.8 45
This study
PTA 2 97.60 6.1 45
PTA 1 66.00 6.1 54
Report 892
PTA 2 82.00 6.3 55
PTA 1 70.00 9.3 68
Report 830
PTA 2 48.00 9.3 68
Bias / Accuracy
The Total Suspended Solids testing was successfully performed, with satisfactory
results (|z-score| ≤ 2.0) ranging between 36.7 – 54.3 mg/L for sample PTA 1 and 85.8
– 109.4 mg/L for sample PTA 2.
Out of 45 participants, two questionable results (2.0 < |z-score| < 3.0) were reported
for sample PTA 1 (laboratories 688 and 699) and two questionable results were
reported for sample PTA 2 (laboratories 329b and 590).
Six outlier results (|z-score| ≥ 3.0) were obtained for sample PTA 1, requiring follow-
up action by laboratories 329b, 410, 475, 545, 551 and 572. Two outlier results were
obtained for sample PTA 2, requiring follow-up action by laboratories 475 and 634.
For those laboratories having difficulties with their Total Suspended Solids testing,
APHA [3] recommends method blanks using the dilution water and duplicate analyses
to be carried out. Duplicate determinations should agree within 5% of their average
weight. If the technique used by laboratories involves pipetting a measured volume
onto the seated glass-fibre filter, APHA [3] recommends pipetting from the
approximate midpoint of the container but not in the vortex created by the magnetic
stirrer, to get a more homogeneous sample. Subsampling is a major source of error in
this testing.
Laboratories whose results biased low on the suspended solids test and high on the
dissolved solids test may have used a filter with pores that were larger than those
used by other laboratories, allowing a greater proportion of the finer solids particles to
pass through the filter. Filter pore sizes used by laboratories ranged between 0.45 –
2.0 µm and the median was 1.2 µm. Nearly half of laboratories who stated their filter
brand were using Whatman. Others included Advantec, Merck Millipore,
MicroScience, Pall and Sartorius filters.
The Total Suspended Solids data set formed an approximately normal distribution
with no substantial bias attributable to any one method (Figures 7 and 8). The method
SD 9.17.09
12
most frequently used for Total Suspended Solids analysis was APHA 2540 D (Total
Suspended Solids Dried at 103-105ºC - method code 5), which was used by
approximately 80% of participants.
24
APHA 2540 D
US EPA 0160.2
20 Other
Not specified
16
Frequency
12
0
3 8 13 18 23 28 33 38 43 48 53 58 63 68
Results (mg/L)
Figure 7. Spread of results for Total Suspended Solids testing of sample PTA 1, with a median
of 45.50 mg/L.
24
APHA 2540 D
US EPA 0160.2
20 Other
Not specified
16
Frequency
12
0
40 47.5 55 62.5 70 77.5 85 92.5 100 107.5 115 122.5 130 137.5
Results (mg/L)
Figure 8. Spread of results for Total Suspended Solids testing of sample PTA 2, with a median
of 97.60 mg/L.
SD 9.17.09
13
7
APHA 2540 D
Other
6
Not specified
5
Frequency
0
0 1 2 3 4 5 6 7 8 9 10 11 12 13
Measurement Uncertainty (mg/L)
Figure 9. MU for Total Suspended Solids testing of sample PTA 1, as reported by participants,
compared with 95% confidence interval for overall reproducibility, ± 8.43 mg/L in this round,
shown as a dashed line.
The range of MU for Total Suspended Solids was expected to be between 1.7 – 13.3
mg/L (3.6% - 29.3%) for sample PTA 1 and between 2.2 – 17.8 mg/L (2.3% - 18.2%)
for sample PTA 2, based on minimum / maximum uncertainty criteria (umin and umax)
described in ISO 13528:2015 [2]. Laboratories 274, 382, 412, 498, 499, 519, 551 and
674 may wish to re-examine their measurement uncertainty for Total Suspended
Solids testing, as their MU was smaller than the uncertainty of the assigned value
(95% CI) for one or more of the samples tested. It is possible that these laboratories
have underestimated their MU. An MU of less than 3.6% for sample PTA 1 and less
than 2.3% for sample PTA 2 is unlikely to be appropriate for natural waters samples
and may have been calculated from repeatability standard deviations (SDr) rather
than reproducibility (SDR). The SDR accounts for much more of the variability inherent
in this test.
It should be noted, however, that the umin and umax are informative indicators only and
can not be solely used to validate or invalidate the MUs reported.
Laboratory 310 reported an MU of ±70 mg/L, which was much greater than three
times the normalised interquartile range, 3NIQR (the recommended Umax) and
requires investigation by this laboratory, although it may have simply been a
transcription error.
SD 9.17.09
14
9
APHA 2540 D
8 Other
Not specified
7
6
Frequency
0
0 2 4 6 8 10 12 14 16 18 20 22 24 < 26
Measurement Uncertainty (mg/L)
Figure 10. MU for Total Suspended Solids testing of sample PTA 2, as reported by
participants, compared with 95% confidence interval for overall reproducibility, ± 11.83 mg/L in
this round, shown as a dashed line.
A t-test of all the results (outliers removed), indicated that the overall reproducibility
for Total Suspended Solids testing was 45.50 ± 8.43 mg/L (18.5%) for sample PTA 1
and 97.60 ± 11.83 mg/L (12.1%) for sample PTA 2 (95% CI). Over the last six PTA
rounds (Reports 925, 892, 830, 767, 698, 621), where samples presented ranged
between 42 mg/L – 251 mg/L Total Suspended Solids, the average reproducibility
was 22%. This is a good approximate MU and laboratories starting out calculating
their MU can compare their values against this PTA estimation.
SD 9.17.09
SD 9.17.09
80
60
Results (m g/L)
50
15
40
30
20
10
323 a
329 b
126
128
144
214
235
271
272
274
286
303
310
319
375
382
398
410
412
430
475
498
499
519
542
545
551
563
568
588
633
634
660
674
Laboratory Code
Figure 11. Total Suspended Solids - Results of sample PTA 1, including MU, compared to the median.
SD 9.17.09
180
120
110
100
16
90
80
70
60
50
40
30
323 a
329 b
126
128
144
214
235
271
272
274
286
303
310
319
375
382
398
410
412
430
475
498
499
519
542
545
551
563
568
588
633
634
660
674
Laboratory Code
Figure 12. Total Suspended Solids - Results of sample PTA 2, including MU, compared to the median.
17
Table 4 compares the Total Dissolved Solids medians and robust CVs from this round
to those obtained in previous PTA rounds. The variability of results this round was
comparable to those seen in previous rounds.
Table 4. Comparison of current round variability and proficiency median of Total Dissolved
Solids testing with the results of the previous two rounds.
Median
Round Sample Robust CV (%) Participants
(mg/L)
PTA 1 498.0 4.5 37
This study
PTA 2 260.0 7.7 37
PTA 1 208.0 6.3 48
Report 892
PTA 2 356.0 6.3 48
PTA 1 304.0 7.2 55
Report 830
PTA 2 220.0 8.4 55
Bias / Accuracy
The Total Dissolved Solids testing was successfully performed, with satisfactory
results (|z-score| ≤ 2.0) ranging between 454 – 542 mg/L for sample PTA 1 and 220 –
300 mg/L for sample PTA 2.
Out of 37 participants, five questionable results (2.0 < |z-score| < 3.0) were reported
for sample PTA 1 (laboratories 128, 464, 551, 568 and 572) and one questionable
result was reported for sample PTA 2 (laboratory 412).
Two outlier results (|z-score| ≥ 3.0) were obtained for sample PTA 1, requiring follow-
up action by laboratories 272 and 499. Four outlier results (|z-score| ≥ 3.0) were
obtained for sample PTA 2, requiring follow-up action by laboratories 272, 464, 499
and 568.
For laboratories having difficulties with their Total Dissolved Solids testing, it is
important to recognise that the drying time required in the method is sensitive to the
composition of the sample. Samples with a high mineral concentration can absorb
moisture and will require an extended drying time, and must be weighed quickly to
ensure that moisture from the air does not affect the result (i.e. storing in a desiccator
until the sample reaches room temperature prior to weighing). Adding successive
aliquots of the sample until a final yield of between 2.5 – 200mg of dried residue is
achieved and repeating the cycle of drying, cooling, desiccating and weighing until a
constant weight is obtained or until the weight change is less than 4% of the previous
weight; will help to improve the accuracy and precision of test results.
The Total Dissolved Solids data set formed an approximately normal distribution with
no substantial bias attributable to any one method (Figures 13 and 14). The method
most frequently used for Total Dissolved Solids analysis was APHA 2540 C (Total
Dissolved Solids Dried at 180ºC - method code 8), which was used by approximately
73% of participants.
SD 9.17.09
18
16
APHA 2540 C
US EPA 0160.1
14
Calculation
Conductivity
12
Other
Not specified
10
Frequency
0
305 330 355 380 405 430 455 480 505 530 555 580 605 630
Results (mg/L)
Figure 13. Spread of results for Total Dissolved Solids testing of sample PTA 1, with a median
of 498.0 mg/L.
20
APHA 2540 C
US EPA 0160.1
Calculation
16
Conductivity
Other
Not specified
12
Frequency
0
75 100 125 150 175 200 225 250 275 300 325 350 375 400
Results (mg/L)
Figure 14. Spread of results for Total Dissolved Solids testing of sample PTA 2, with a median
of 260.0 mg/L.
SD 9.17.09
19
5
APHA 2540 C
Calculation
Conductivity
4 Other
Not specified
3
Frequency
0
0 7.5 15 22.5 30 37.5 45 52.5 60 67.5 75 82.5 90 97.5
Measurement Uncertainty (mg/L)
Figure 15. MU for Total Dissolved Solids testing of sample PTA 1, as reported by participants,
compared with 95% confidence interval for overall reproducibility, ± 53.8 mg/L in this round,
shown as a dashed line.
The range of MU for Total Dissolved Solids was expected to be between 9.1 – 66.7
mg/L (1.8% - 13.4%) for sample PTA 1 and between 8.2 – 60.0 mg/L (3.2% - 23.1%)
for sample PTA 2, based on minimum / maximum uncertainty criteria (umin and umax)
described in ISO 13528:2015 [2]. Laboratories 272, 310, 323a, 382, 412, 519, 545
and 551 may wish to re-examine their measurement uncertainty for Total Dissolved
Solids testing, as their MU was smaller than the uncertainty of the assigned value
(95% CI) for one or more of the samples tested. It is possible that these laboratories
have underestimated their MU, particularly in light of the variability expected in natural
water samples.
It should be noted, however, that the umin and umax are informative indicators only and
can not be solely used to validate or invalidate the MUs reported.
Of slightly less concern were the laboratories who reported MU larger than three
times the normalised interquartile range, 3NIQR (Umax), (Laboratories 286, 398, 633,
660), however this can be explained by the unusually tight homogeneity of these
artificial solids samples compared to a natural sample, which would be expected to
have more variability. Only laboratory 660 reported an unusually high fixed MU (90.0
mg/L) and may wish to re-examine their measurement uncertainty calculations
(Figure 16). Most laboratories used MU values proportional to their results.
SD 9.17.09
20
10
APHA 2540 C
9 Calculation
Conductivity
8
Other
7 Not specified
6
Frequency
0
0 7.5 15 22.5 30 37.5 45 52.5 60 67.5 75 82.5 90 97.5
Measurement Uncertainty (mg/L)
Figure 16. MU for Total Dissolved Solids testing of sample PTA 2, as reported by participants,
compared with 95% confidence interval for overall reproducibility, ± 34.3 mg/L in this round,
shown as a dashed line.
A t-test of all the results (outliers removed), indicated that the overall reproducibility
for Total Dissolved Solids testing was 498.0 ± 53.8 mg/L (10.8%) for sample PTA 1
and 260.0 ± 34.3 mg/L (13.2%) for sample PTA 2 (95% CI). Over the last six PTA
rounds (Reports 925, 892, 830, 767, 741, 698), where samples presented ranged
between 199 mg/L – 498 mg/L Total Dissolved Solids, the average reproducibility was
19%. This is a good approximate MU and laboratories starting out calculating their
MU can compare their values against this PTA estimation.
SD 9.17.09
SD 9.17.09
650
550
Results (m g/L)
500
21
450
400
350
300
323 a
329 b
126
128
144
214
271
272
274
286
310
375
382
398
410
412
430
499
519
542
545
551
563
568
588
633
660
Laboratory Code
Figure 17. Total Dissolved Solids - Results of sample PTA 1, including MU, compared to the median.
SD 9.17.09
400
300
Results (m g/L)
250
22
200
150
100
323 a
329 b
126
128
144
214
271
272
274
286
310
375
382
398
410
412
430
499
519
542
545
551
563
568
588
633
660
Laboratory Code
Figure 18. Total Dissolved Solids - Results of sample PTA 2, including MU, compared to the median.
23
In order for methods to be grouped for analysis, PTA requires at least 11 sets of
results from the same method group. For methods other than those presented below,
there were less than 11 results submitted for each method, therefore reliable
conclusions cannot be drawn from analysing them separately on this occasion.
The method APHA 2540 B (Total Solids Dried at 103-105ºC - method code 1) was
most frequently employed for Total Solids analysis, with 21 out of 33 participants
indicating the use of this method.
Table 5 below presents the median, uncertainty of the medians and robust CVs for
Total Solids results obtained by this method in round 182.
Table 5. Variability and proficiency medians of Total Solids results obtained by method
APHA 2540 B.
Median ±
Robust
Analyte Sample Participants Uncertainty of the Median
CV (%)
(mg/L)
PTA 1 21 541.0 ± 3.4 2.3
Total Solids
PTA 2 21 356.0 ± 2.4 2.5
The robust CVs obtained using this method were smaller, for both PTA 1 and PTA 2
samples, than those the general population of methods was able to achieve (CVPTA1 =
2.6%, CVPTA2 = 4.1%).
The method APHA 2540 D (Total Suspended Solids Dried at 103-105ºC - method
code 5) was most frequently employed for Total Suspended Solids analysis, with 36.
out of 45 participants indicating the use of this method.
Table 6 below presents the median, uncertainty of the median and robust CV for
Total Suspended Solids results obtained by this method in round 182.
Table 6. Variability and proficiency medians of Total Suspended Solids results obtained by
method APHA 2540 D.
Median ±
Robust
Analyte Sample Participants Uncertainty of the Median
CV (%)
(mg/L)
Total PTA 1 36 46.25 ± 1.00 10.3
Suspended
Solids PTA 2 36 97.80 ± 1.29 6.3
The robust CVs obtained using this method were slightly larger, for both PTA 1 and
PTA 2 samples, than those the general population of methods was able to achieve
SD 9.17.09
24
(CVPTA1 = 9.8%, CVPTA2 = 6.1%), however, these CVs were better than those
published in APHA (242 mg/L, CV=10%; and 15 mg/L, CV=33%).
The method APHA 2540 C (Total Dissolved Solids Dried at 180ºC - method code 8)
was most frequently employed for Total Dissolved Solids analysis, with 27 out of 37
participants indicating the use of this method.
Table 7 below presents the median, uncertainty of the median and robust CV for
Total Suspended Solids results obtained by this method in round 182. The robust
CVs obtained using this method were equal to or better than those the general
population of methods was able to achieve (CVPTA1 = 4.5%, CVPTA2 = 7.7%).
Table 7. Variability and proficiency medians of Total Dissolved Solids results obtained by
method APHA 2540 C.
Median ±
Robust
Analyte Sample Participants Uncertainty of the Median
CV (%)
(mg/L)
Total PTA 1 27 489.0 ± 5.3 4.5
Suspended
Solids PTA 2 27 260.0 ± 4.0 6.4
SD 9.17.09
25
5. Outlier Results
Laboratories reporting results that have been identified as outliers are listed in
Table 8 below.
272 § § § §
303 §
329b §
410 §
464 § § §
475 § §
499 § § § §
545 §
551 §
568 § § §
572 §
634 §
Note:
1. A “§” indicates the occurrence of a z-score outlier result (i.e. those results for which
|z-score| ≥ 3.0).
6. References
[1] Guide to Proficiency Testing Australia, 2014 (This document can be found on
the PTA website, www.pta.asn.au).
[3] Standard Methods For the Examination of Water and Wastewater, 2012.
Published by APHA, AWWA, WEF (22nd Edition).
SD 9.17.09
APPENDIX A
Total Solids............................................................................................................................ A1
Total Suspended Solids ........................................................................................................ A7
Total Dissolved Solids ......................................................................................................... A13
SD 9.17.09
Total Solids Results
SD 9.17.09
A1
Total Solids
Results by Laboratory Code
Sample PTA 1
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
SD 9.17.09
A2
Sample PTA 1
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
No of Results: 33
Median: 541.0
Normalised
14.1
IQR:
Uncertainty of
3.1
the Median:
Robust CV: 2.6%
Minimum: 375
Maximum: 643
Range: 268
SD 9.17.09
Total Solids - Sample PTA 1 - Robust Z-Scores
5
4
3
2
1
z-score
519
688
126
430
699
382
362
329b
274
271
286
633
-3
-4
464
-5
272
lab code
A3
Robust Z-Scores
5
4
3
2
1
z-score
0
-1
-2
-3
-4
-5
lab code
SD 9.17.09
A4
Total Solids
Results by Laboratory Code
Sample PTA 2
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
SD 9.17.09
A5
Sample PTA 2
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
No of Results: 33
Median: 358.0
Normalised
14.8
IQR:
Uncertainty of
3.2
the Median:
Robust CV: 4.1%
Minimum: 176
Maximum: 503
Range: 327
SD 9.17.09
Total Solids - Sample PTA 2 - Robust Z-Scores
5
4
3
2
1
z-score
214
545
126
475
430
660
382
329b
633
286
410
271
-3
-4
-5
464
272
lab code
A6
Robust Z-Scores
5
4
3
2
1
z-score
0
-1
-2
-3
-4
-5
lab code
SD 9.17.09
Total Suspended Solids Results
SD 9.17.09
A7
Sample PTA 1
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
117 50 # 1.01 5
126 42.8 ± 6 -0.61 5
128 47 ± 4.70 0.34 5
144 44.3 ± 1.9 -0.27 5
196 43 # -0.56 6
214 43.5 ± 2.4 -0.45 5
235 48.3 ± 4 0.63 5
243 48 # 0.56 #
271 41.6 ± 4.4 -0.88 7
272 51.1 ± 3 1.26 5
274 46.5 ± 1.54 0.22 5
286 50.0 ± 7.50 1.01 5
303 42.3 ± 12.00 -0.72 5
310 49.5 ± 3.91 0.90 5
319 49.0 ± 8.2 0.79 7
323a 43.5 ± 2.34 -0.45 #
329b 25 ± 3 -4.61 § 5
362 52.0 # 1.46 5
375 43.5 ± 2.2 -0.45 5
382 47.8 ± 1 0.52 5
398 43.3 ± 6.50 -0.49 5
410 60 ± 10 3.26 § 5
412 37 ± 5.0% -1.91 5
430 45 ± 8 -0.11 7
464 47 # 0.34 5
474 44.7 # -0.18 7
475 26.5 ± 8.0 -4.27 § 5
SD 9.17.09
A8
Sample PTA 1
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
498 44 ± 4 -0.34 #
499 38.5 ± 1.2 -1.57 5
517 50.3 # 1.08 5
519 49.7 ± 3.42 0.94 5
542 51.2 ± 4.9 1.28 5
545 29.5 ± 2.4 -3.60 § 5
551 11.0 ± 2% -7.76 § 5
563 49 ± 5 0.79 5
568 44.0 ± 7 -0.34 5
572 31.8 # -3.08 § 5
588 45 ± 8 -0.11 5
590 46.0 # 0.11 5
633 47.0 ± 7.05 0.34 5
634 48.0 ± 10 0.56 5
660 45.5 ± 2.00 0.00 5
674 47.0 ± 1.5 0.34 5
688 34.0 # -2.59 5
699 55 # 2.14 7
No of Results: 45
Median: 45.50
Normalised
4.45
IQR:
Uncertainty of
0.83
the Median:
Robust CV: 9.8%
Minimum: 11.0
Maximum: 60
Range: 49.0
SD 9.17.09
Total Suspended Solids - Sample PTA 1 - Robust Z-Scores
5
4
3
2
430
588
474
144
498
568
-1
214
323a
375
398
196
126
303
271
499
412
-3
688
-4 572
545
475
-5
329b
551
lab code
A9
Robust Z-Scores
5
4
3
2
1
z-score
0
-1
-2
-3
-4
-5
lab code
SD 9.17.09
A10
Sample PTA 2
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
SD 9.17.09
A11
Sample PTA 2
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
498 99 ± 1 0.24 #
499 91 ± 3 -1.11 5
517 94.9 # -0.46 5
519 102 ± 1.20 0.74 5
542 107 ± 10 1.59 5
545 86.5 ± 2.4 -1.87 5
551 93.0 ± 2% -0.78 5
563 101 ± 5 0.57 5
568 98.0 ± 15 0.07 5
572 94.2 # -0.57 5
588 96 ± 17 -0.27 5
590 110 # 2.09 5
633 91.0 ± 13.6 -1.11 5
634 73.2 ± 10 -4.11 § 5
660 100 ± 10.0 0.40 5
674 101 ± 3 0.57 5
688 87.0 # -1.79 5
699 95 # -0.44 7
No of Results: 45
Median: 97.60
Normalised
5.93
IQR:
Uncertainty of
1.11
the Median:
Robust CV: 6.1%
Minimum: 42.0
Maximum: 110
Range: 68.0
SD 9.17.09
Total Suspended Solids - Sample PTA 2 - Robust Z-Scores
5
4
3
2
235
588
126
271
-1
412
430
699
517
572
214
196
551
398
323a
633
-2
688
545
-3
329b
-4
634
-5
475
lab code
A12
Robust Z-Scores
5
4
3
2
1
z-score
0
-1
-2
-3
-4
-5
lab code
SD 9.17.09
Total Dissolved Solids Results
SD 9.17.09
A13
Sample PTA 1
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
SD 9.17.09
A14
Sample PTA 1
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
No of Results: 37
Median: 498.0
Normalised
22.2
IQR:
Uncertainty of
4.6
the Median:
Robust CV: 4.5%
Minimum: 324
Maximum: 604
Range: 280
SD 9.17.09
Total Dissolved Solids - Sample PTA 1 - Robust Z-Scores
5
4
3
2
475
243
-1
519
545
126
398
274
271
117
362
382
286
-2
588
633
464
-3
572
-4
-5
272
lab code
A15
Robust Z-Scores
5
4
3
2
1
z-score
0
-1
-2
-3
-4
-5
lab code
SD 9.17.09
A16
Sample PTA 2
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
SD 9.17.09
A17
Sample PTA 2
Lab
Code Result ± MU1 Robust Method
(mg/L) z-score2 Code3
No of Results: 37
Median: 260.0
Normalised
20.0
IQR:
Uncertainty of
4.1
the Median:
Robust CV: 7.7%
Minimum: 78
Maximum: 328
Range: 250
SD 9.17.09
Total Dissolved Solids - Sample PTA 2 - Robust Z-Scores
5
4
3
2
243
1
z-score
519
572
310
475
126
633
-1
542
410
563
271
382
286
588
214
272
lab code
A18
Robust Z-Scores
5
4
3
2
1
z-score
0
-1
-2
-3
-4
-5
lab code
SD 9.17.09
APPENDIX B
SD 9.17.09
B1
Samples for this program were obtained from Global Proficiency Ltd, New Zealand. As such,
all samples are subjected to rigorous quality control and homogeneity / stability testing.
Samples were manufactured from two solutions which formed a precipitate in the bottle.
These were dispensed with an accuracy of 0.75% for PTA 1 and 0.70% for PTA 2 (99% CI).
A random selection of ten samples was chosen from samples PTA 1 for homogeneity and
stability testing. Seven of these were stored chilled and the remaining three were subjected
to 35ºC for three days for an accelerated ageing stability trial. The samples were then
analysed by Hill Laboratories, New Zealand. The testing of Total Suspended Solids was
performed using: filtration through Whatman 934 AH, Advantec GC-50 or equivalent filters
(nominal pore size 1.2 - 1.5µm) and gravimetric determination (APHA 2540 D 22nd ed.
2012). The testing of Total Dissolved Solids was performed using filtration through GF/C
filters (1.2 µm) and gravimetric determination (APHA 2540 C 22nd ed. 2012 modified: drying
temperature of 103 - 105°C was used rather than180 ± 2°C). The Total Solids content was
determined by calculation from the Total Suspended Solids and Total Dissolved Solids
measurements.
All stability samples showed no increased variability when compared to the chilled samples.
Samples PTA 2 were also tested to confirm the levels were within the expected range.
Homogeneity and stability samples were treated in the same manner as for the PTA 1
samples. Based on identical manufacturing procedure and sample handling, homogeneity
and stability characteristics were assumed to be similar to samples PTA 1.
From statistical analyses based on the results of this testing and rigorous quality control, it
was considered that all samples were sufficiently homogeneous and stable, so that any
results later identified as outliers should not be attributed to any notable sample variability.
The results of homogeneity and stability testing are presented in Table B1 below. Please
note that the mean results for these tests are not intended to be used as reference values.
SD 9.17.09
APPENDIX C
Documentation
SD 9.17.09
C1
Total Solids (TS), Total Suspended Solids (TSS), Total Dissolved Solids (TDS)
INSTRUCTIONS TO PARTICIPANTS
**Please record (on the Results Sheet) the approximate temperature of the samples upon
receipt**
Please note the following before commencing the analysis of the samples.
1. Samples
i) Two plastic bottles labelled PTA 1 and PTA 2, supplied by Global Proficiency Ltd. The
bottles contain 20 mL of artificial waste water concentrates for analysis of total solids, total
suspended solids and total dissolved solids.
ii) Each bottle will require dilution in reagent grade water. Please follow the Sample Preparation
section below.
Please Note: Where possible, proficiency testing samples should be treated as a routine
laboratory sample.
2. Sample Preparation
v) Quantitatively transfer the entire contents from the bottle into the flask, rinse the sides of the
bottle with reagent grade water and include this in the flask.
SD 9.17.09
C2
3. Tests Requested
For the samples prepared from the two bottles PTA 1 and PTA 2:
If unable to perform the above please note this on your Results Sheet.
4. Safety
5. Reporting
6. Testing should commence as soon as possible after receiving the samples and results reported
NO LATER THAN 10 JULY 2015 to:
Delfina Mihaila
Proficiency Testing Australia
PO Box 7507
SILVERWATER NSW 2128
AUSTRALIA
Phone: +612 9736 8397
Fax: +612 9743 6664
Email: dmihaila@pta.asn.au
7. For this program your laboratory has been allocated the code number shown on the attached
Results Sheet. All reference to your laboratory in reports associated with the program will be
through this code number, thus ensuring the confidentiality of your results.
SD 9.17.09
C3
METHOD
ANALYSIS METHOD DESCRIPTION CODE
REFERENCE
Total Solids APHA SM 2540 B. Total Solids Dried at 103–105°C 1
US EPA
0160.3 Residue, Total. Dried at 103–105°C 2
Conductivity 11
i) APHA SM APHA “Standard Methods for the Examination of Water and Wastewater” (18,
19, 20, 21 and 22 Edition).
ii) USEPA U.S Environmental Protection Agency,
http://www.epa.gov/osa/fem/methcollectns.htm.
SD 9.17.09
C4
Total Solids (TS), Total Suspended Solids (TSS), Total Dissolved Solids (TDS)
JUNE, 2015
RESULTS SHEET
(mg/L)
Laboratory
«Code»
Code
Please note: Where possible, proficiency testing samples should be treated as a routine laboratory
sample.
SD 9.17.09
- End of Report -
SD 9.17.09