Professional Documents
Culture Documents
An Introduction To The Theory of Sampling: An Essential Part of Total Quality Management
An Introduction To The Theory of Sampling: An Essential Part of Total Quality Management
1.01.1 Introduction 2
1.01.2 Scope 2
1.01.3 Definitions and Notations 3
1.01.4 Dividing a Complex Problem into its Basic Components 3
1.01.4.1 Dividing the Small-Scale Variability 3
1.01.4.2 Optimization of Sampling Protocols 3
1.01.4.2.1 The in situ nugget effect 3
1.01.4.2.2 The fundamental sampling error 4
1.01.4.2.3 The grouping and segregation error 4
1.01.4.3 The Practical Implementation of the Sampling Protocol 5
1.01.4.3.1 The increment delimitation error 5
1.01.4.3.2 The increment extraction error 5
1.01.4.3.3 The weighting error 5
1.01.4.4 The Preservation of Samples Integrity 5
1.01.4.4.1 Sample preparation errors 5
1.01.5 Exercises Challenging the Reader 6
1.01.5.1 Exercise #1: A Worldwide Problem for Ore Grade Control in Open Pits: Blasthole
Sampling 6
1.01.5.2 Exercise #2: Correctness of Straight-Path Cross-Stream Sampling Systems 7
1.01.5.3 Exercise #3: Correctness of Rotating Vezin Cross-Stream Sampling Systems 7
1.01.5.4 Exercise #4: Correctness of Hammer Cross-Belt Samplers 7
1.01.6 The Critical Importance of Sampling Courses 9
1.01.6.1 Case #1: A Bad Protocol for Blastholes Followed by an Incorrect Implementation 9
1.01.6.2 Case #2: An Incorrect Sampling System for the Final Tail of a Flotation Plant 9
1.01.7 The Enemies and Their Link to Geostatistics 10
1.01.7.1 Important Remark 10
1.01.8 Large-Scale Variability 10
1.01.8.1 Definition of the Variogram 10
1.01.8.1.1 Selection of a given process parameter of interest 11
1.01.8.1.2 Heterogeneity affecting the given process parameter of interest 11
1.01.8.1.3 Measuring heterogeneity variability with the variogram 11
1.01.8.2 Extrapolation of the Variogram to Time or Distance Zero 12
1.01.8.3 The Importance of Large-Scale Variability 12
1.01.8.3.1 Variability issues during exploration 12
1.01.8.3.2 Variability issues during mining 13
1.01.8.3.3 Variability issues within a processing plant 13
1.01.8.3.4 Variability issues during trade with customers 13
1.01.9 Conclusions 13
1.01.10 Recommendations 13
References 15
1
2 An Introduction to the Theory of Sampling: An Essential Part of Total Quality Management
1.01.1 Introduction
Considering the example of the mining industry, out of many other possible examples, the key to total quality
management (TQM) is to optimize the recovery of natural resources and make quality products to satisfy
users on several fronts such as reliability, effectiveness, and minimal cost: it cannot and will not be done
without a thorough understanding of theory of sampling (TOS). As TOS is not taught at universities, the
resulting economic losses are plaguing the industry. Management decisions are based on precise and accurate
sampling. It is of utmost importance to communicate the benefits of correct sampling to management, to a
board of directors, to shareholders, to geologists, to drillers, to miners, to metallurgists, to chemists, to sales
people, environmentalists, geostatisticians, and to statisticians. It is the only way to get necessary cash flow,
more profit, and added share value. If stakeholders cannot see the value of correct sampling, it is the
company’s responsibility to show them through education of the management team. Training of key
personnel such as geologists, drillers, miners, metallurgists, chemists, and environmentalists is essential to
obtain results. They all must monitor and verify the quality of data, so that geostatisticians and even
conventional statisticians can perform reliable, believable risk assessments, to enable the management to
make ultimately crucial financial decisions.
1.01.2 Scope
The acquisition of a reliable database is always a valuable asset to a company. However, for such a success to
happen, a correct and balanced strategy is needed, which is illustrated as a three-legged table in Figure 1. If one
leg of the table is weak the entire table may collapse. Usually, the weakest leg is a style of management that does
not sufficiently support good sampling practices, though it is the only way to allow statisticians to do their work
in understanding variability in the deposit or in processes, and subsequently advise management for wise
courses of action. However, implementing correct sampling is easier said than done. Similar to safety issues for
which companies spend millions of dollars, it must be internally standardized through correctness, internal
guidelines, sustained training, and enforcement auditing. It must also be monitored for its added value through
improved natural resources recovery, improved conciliation between economic units (e.g., mine, mill, smelter,
and refinery), and added stakeholder value.
The collection of samples has only one objective in mind: understanding variability on a large
scale. Unfortunately, for practical reasons a sample is often made of a relatively small amount of material.
Therefore, as it is collected, another type of unwanted variability is always introduced, which is a
Company $ benefits,
added stakeholder value,
and market perception
small-scale variability that may often overwhelm the large-scale variability that is important to measure.
Many people often do not realize that the variability they are looking at has little to do with the variability
they want to measure; it is essential to make the difference as clear as possible, and this is the true, in-
depth objective of TOS.
The length of this paper being limited, for definitions and notations, the reader is referred to textbooks from
various authors listed in References.
The strength of the TOS is the use of a logical Cartesian approach, which divides small- and large-scale
variability into basic components that can be further analyzed one by one. If everyone understood that basic
concept they would not struggle to understand TOS. It does not matter how deep anyone goes into the
mathematics of TOS; if this basic Cartesian concept is not understood, it will result in confusion, ineffective-
ness, and failure to reach economic objectives, which is a common observation in many industries around the
world today.
are available in the same given area. Too often, large mistakes are repeated over and over because too few data
points belonging to a skewed distribution are available in a given area.
2
S ME = ΣS
n
2
DEn + ΣS
n
2
EEn + ΣS
n
2
WEn + ΣS
n
2
PEn
Figure 2 Expanding the materialization error to include all errors introduced by the practical implementation of the sampling
protocol.
of a sampling protocol. PE can be the result of contamination, losses, alteration of physical or chemical
composition, human errors, ignorance, carelessness, fraud, or sabotage.
The mean of PE is not zero; therefore, these errors are dangerous bias generators. The variance of PE can be
2
quite large as it depends on many nonselective factors. Finally, the variance SME of the ME can be written as
illustrated in Figure 2.
The components of the ME are not well known by manufacturers of sampling equipment, or perhaps, a more
accurate statement would be to say they do not make a clear difference between these four independent errors.
This problem is also perpetuated by standards on sampling, most of which are obsolete, and reluctant to endorse
the TOS. Furthermore, these standards usually do not distinctly address the difference between errors generated
by the selective process (i.e., DE, EE, and WE) and those generated by the nonselective process (i.e., PE).
The key to understanding problems created by these four errors can be summarized by the following
statement: all the constituents of the lot to be sampled must be given an equal probability p of being selected and
preserved as part of the sample, which leads to the notion of equiprobabilistic sampling, which in turn leads to
the notion of correct sampling systems. Not respecting this cardinal rule almost always results in the presence
of sampling biases that cannot be accounted for and totally ruins the previous efforts made to optimize the
sampling protocol. The correctness or incorrectness of a sampling system is a structural property. If the
sampling system is not correct by design (i.e., structure), devastating effects will result, regardless of results
from bias tests that would at times tend to prove otherwise.
Solutions for the following exercises are beyond the scope of this paper, but they are well addressed in other
documents from the author listed in References.
1.01.5.1 Exercise #1: A Worldwide Problem for Ore Grade Control in Open Pits: Blasthole
Sampling
Figure 3 illustrates seven areas in sampling blastholes. Each area can be the object of major deviations from
sampling correctness. At each of these areas name the possible sampling error that may take place (e.g., DE,
EE, WE, or PE). The reader has 20 min to sort them by name and to provide a solution. If it cannot be done,
further training in sampling methodology is highly recommended.6 Biases taking place from blasthole drilling
cost mining companies a fortune every year. Usually and unfortunately it is a well-hidden cost. Assuming DE,
EE, WE, and PE are well taken care of, which is a huge assumption, geostatistical simulations using results
from duplicate field samples can have access to some extent to such worrisome costs, and actually it would be
advisable for geostatisticians to address such potential financial losses in feasibility studies if they had a deep
knowledge of TOS. Someone may ask why do this if DE, EE, WE, and PE have been taken care of. Make no
mistake, conciliation problems are not only the result of sampling errors introducing biases, they are also the
result of unreasonable variances affecting the in situ Nugget effect, FSE, and GSE, and these indeed can have
their effects simulated. But, nobody can make a simulation of economic losses generated by the bias
generators DE, EE, WE, and PE.
An Introduction to the Theory of Sampling: An Essential Part of Total Quality Management 7
E
D Segregation
G
A Former sub-drill
Ideal
sample
B
Actual
sample
C Current sub-drill
1
11
3
7
5
4
2
9
10
6
2 3
9
Falling stream
4 5
7
10
11 8
1 4
2
difficulties may arise and generate sampling biases. At each of these areas name the possible sampling error that
may take place (e.g., DE, EE, WE, or PE). The reader has 20 min to sort them by name and to provide a solution.
If it cannot be done, further training in sampling methodology is highly recommended.7 Biases taking place at
these sampling points can be financially devastating.
All possible problems created by each point addressed in the above four exercises should be solved within
minutes. Yet, because of a massive ignorance of TOS, these problems are the object of unnecessary doubts and
arguments, time-consuming meetings, endless debates with manufacturers and engineering firms, and very
expensive bias tests followed by doubtful statistics. Someone may wonder why doubtful statistics are used to
interpret bias tests. The reason has something to do with a subtle property of segregation. Biases in sampling are
the result of one form or another of segregation. However, the prime property of segregation is being a transient
phenomenon changing all the time. Too many people think of a sampling bias as a constant bias as often
observed for analytical biases. There is no such thing as a constant bias in sampling. A sample can be biased one
way today, another way tomorrow, and can remain unbiased for a while. Therefore, a bias test for a sampling
system can only declare there is indeed a bias; however, it cannot state that there is no bias. Furthermore, it is
almost common practice to make a sampling bias test by comparing two bad samples.
Each point addressed in the above exercises can lead to devastating money losses for the unaware company.
Let us review a few well-documented cases that were presented at WCSB1 (World Conference on Sampling
and Blending1) in Denmark in 2003.
1.01.6.1 Case #1: A Bad Protocol for Blastholes Followed by an Incorrect Implementation
Over a 10-year period a loss of US$134 000 000 was the result of a bad sampling and subsampling protocol used
in a copper mine in Chile.8 The increase in the recovery of natural resources could be measured only after a
better protocol was implemented for several consecutive months.
1.01.6.2 Case #2: An Incorrect Sampling System for the Final Tail of a Flotation Plant
Over a period of 20 years at a large copper mine in Chile, a stunning loss of US$2 000 000 000 was the result of
using a flawed sampling system for the Final Tail of a copper–molybdenum flotation plant.8 Another company
that treated the tailings for that period of time was quite prosperous. The first reaction of management after a
flawless sampling station was installed was denial.
10 An Introduction to the Theory of Sampling: An Essential Part of Total Quality Management
A book could be written about many other examples around the world, but usually companies are very silent
about such a catastrophic economic outcome. This is where confidentiality agreements become convenient.
There is no doubt denial can become a form of fraud.
François-Bongarçon rightly said in 2003 that ‘‘TOS and geostatistics are inseparable’’. So far, we made a list of
the enemies responsible for slowly inflating one of the most annoying sources of variability plaguing geosta-
tistics. When calculating a variogram, it is often observed that as the distance between samples becomes
practically nil a certain amount of variability remains, which is random and discontinuous in nature; it is called
V[j ¼ 0], j being the lag between samples. For simplicity, we chose to call it V[0]. Figure 7 makes a summary of
2
them, expressed as variances, and the variance SHE 1
refers to the partial variance introduced by the protocol. It
is indeed annoying when an exploration or ore-grade control database is affected by a certain amount of
variability that cannot be explained by the structural properties of the deposit. It is indeed annoying when a
process control database is affected by a certain amount of variability that cannot be explained by what is
happening in the process. It is indeed annoying when an expensive environmental assessment database is
affected by a certain amount of variability that cannot be explained by what is happening in the environment.
The study of the total variability in any lot to be sampled can be broken up into several components, and the
variogram helps us take a close look at each of these components. This is well done in geostatistics9 for the study
of mineral deposits, and in chronostatistics10,11 for the study of variability in a process.
ΣS 2
DEn
n
ΣS 2
WEn
ΣS ΣS
n
2 2
FSEn GSEn
n n
2
S HE1 V[0] ΣS n
2
AEn
2
S NE ΣS 2
PEn
ΣS n
2
EEn
n
Figure 7 V[0] can be inflated by many factors; they are the enemies in sampling and they quickly add up.
An Introduction to the Theory of Sampling: An Essential Part of Total Quality Management 11
reasonably constant through time if the variogram is used to study a parameter within a process. This limitation
suggests taking precautions when selecting a series of chronological data, such as making reasonably sure along
the selected chronology that no important changes have been applied to the process in the way it works. As
such, it is likely that the suggested applications lose power when the basic sampling interval in the selected
chronology is too long (e.g., days, weeks, or months). Aware of this limitation, the practitioner can use common
sense not to mix data that do not belong to each other.
Such average difference converges toward zero; therefore, the squared difference should be used instead.
Furthermore, differences account for variability twice; therefore, the convention has been taken to calculate the
semi-variogram, leading to the following formula used for an absolute variogram:
1 X 2
V ½j ¼ fmþj – fm ð4Þ
2½N – j m
A relative, dimensionless variogram could be calculated as well, making it easier to compare variograms from
different experiments:
1 X 2
V ½j ¼ 2 fmþj – fm ð5Þ
2½N – j fL m
12 An Introduction to the Theory of Sampling: An Essential Part of Total Quality Management
The study of many variograms shows that they are usually made of four major components:
V ½j ¼ VA ½j þ VB ½j þ VC ½j þ VD ½j ð6Þ
where:
VA[j] is a very short-range term, random, and discontinuous. At the limit, when j ¼ 0, this leads to a very
important term in chronostatistics called V[j ¼ 0], simplified in further discussions to V[0], which is the
variability from sampling, subsampling, and measurement that does not exist in the process.
VB[j] is a long-range term, usually nonrandom, and continuous. This variability is the one that needs to be
controlled or tamed in a process.
VC[j] is a periodic term, continuous, tied to ways people work or to ways some process machines work. This is
a source of variability usually poorly understood, leading to process overcorrections, and therefore losses of
process efficiency. The economic impact of this source of variability, if misunderstood, is enormous.
VD[j] is a random residual variability tied to the variogram precision when the variance V[j] is calculated with
too few pairs N–j. VD[j] tends toward zero when the number of pairs increases. It is not a good practice to
calculate any point on a variogram with less than 20 pairs. Actually, 30 pairs or more is strongly recommended.
1.01.9 Conclusions
There is no such a thing as continuous improvement without a clear understanding of TOS followed by a
strong commitment to correct sampling practices. Many statisticians believe that interleaved sampling can solve
everything if followed by a careful statistical analysis of the results. There is nothing wrong in their approach;
however, there are two possible outcomes:
1. The variance analysis shows that there is no problem and all parties involved may feel comfortable enough.
2. The variance analysis shows that there is a problem. Now, without a clear understanding of TOS it is very
unlikely they will find the causes and cure them effectively in the most economic way. The strategy that is
suggested in TOS by dividing the complex problem into its basic components is the inescapable way to reach
solutions quickly and effectively.
1.01.10 Recommendations
The objective of this paper is only to help people looking at TOS for the first time to get organized. It is well
known that newcomers often get discouraged as the way TOS is frequently presented can be intimidating. If the
reader gets well organized, looking at the challenge with a clear Cartesian spirit, TOS is actually a lot simpler
than what people may think.12,13 Follow the strategy illustrated in Figure 8 and quick progress is likely to
occur. With emphasis on causes of sampling problems, the difficult climb to continuous improvement may take
place. With emphasis on effects of sampling problems, as it is often the case, there is no progress possible.
After a commitment has been taken for continuous improvement, it is still necessary to create a road map so
that economic benefits can quickly be measured. A typical road map is illustrated in Figure 9.
14 An Introduction to the Theory of Sampling: An Essential Part of Total Quality Management
If cause eliminated:
standardize Short courses,
If cause not workshops,
eliminated: and training
re-analyze
Continuous improvement of
mining process
with emphasis on causes of
problems
Identification of structural
sampling problems
and continuous improvement
of mining process
Compulsory
Accountability
actions
References
1. Gy, P. Sampling of Particulate Materials, Theory and Practice. Developments in Geomathematics; Elsevier Scientific Publishing:
Amsterdam, 1979 and 1983; Vol. 4.
2. Gy, P. Heterogeneite – Echantillonnage – Homogeneisation: Ensemble coherent de theories; Masson Editeur: Paris; 1988, ISBN:
2-225-81313-2. ISSN: 0765-0221.
3. Gy, P. Sampling of Heterogeneous and Dynamic Material Systems: Theories of Heterogeneity, Sampling and Homogenizing;
Elsevier: Amsterdam, 1992.
4. Pitard, F. Pierre Gy’s Sampling Theory and Sampling Practice, 2nd ed.; CRC Press: Boca Raton, FL, 1993.
5. Pitard, F. Effects of Residual Variances on the Estimation of the Variance of the Fundamental Error. Chemometr. Intell. Lab. 2004,
74(1), 149–164. In the text, specifically referred to equations (2), (3), (4), (5).
6. Pitard, F. Blasthole Sampling for Grade Control: The Many Problems and Solutions. Sampling 2008, The Australasian Institute of
Mining and Metallurgy, Perth, Australia, 2008; May 27–28, 2008.
7. Pitard, F. Sampling Correctness – A Comprehensive Guideline. Second World Conference on Sampling and Blending 2005,
Publication Series No 4/2005; The Australian Institute of Mining and Metallurgy, 2005; ISBN: 1-920-80628-8.
8. Carrasco, P.; Carrasco, P.; Jara, E.; The Economic Impact of Correct Sampling and Analysis Practices in the Copper Mining
Industry. Chemometr. Intell. Lab. 2004, 74(1), 209–231.
9. François-Bongarçon, D.; Theory of Sampling and Geostatistics: An Intimate Link. Chemometr. Intell. Lab. 2004, 74(1), 143–148.
10. Pitard, F. Practical Statistical Tools for Managers, Metallurgical Plant Design and Operating Strategies Conference,Sydney April
15–16, The Australasian Institute of Mining and Metallurgy, Sydney, April 15–16, 2002.
11. Pitard, F. Chronostatistics – A Powerful, Pragmatic, New Science for Metallurgists. Metallurgical Plant Design and Operating
Strategies (MetPlant 2006), The Australasian Institute of Mining and Metallurgy, Perth, W.A. September 18–19, 2006.
12. Esbensen, K. H.; Minkkinen, P. Guest Editors. In Chemometrics and Intelligent Laboratory Systems, Vol. 74, 1, 2004, Special
issue: 50 years of Pierre Gy’s Theory of Sampling, Proceedings First World Conference on Sampling and Blending (WCSB1).
Tutorials on Sampling: Theory and Practice.
13. Lars, P. Pierre Gy’s Theory of Sampling (TOS) – In Practice: Laboratory and Industrial Didactics Including a First Foray into Image
Analytical Sampling, Phd Thesis, ACABS Research Group, Aalborg University Esbjerg, Niels Bohrs Vej 8, Dk-67000 Esbjerg,
Denmark, 2005.
16 An Introduction to the Theory of Sampling: An Essential Part of Total Quality Management
Biographical Sketch
Mr. Francis F. Pitard is a consulting expert in Sampling, Statistical Process Control, and
Total Quality Management for 23 years. He is President of Francis Pitard Sampling
Consultants (www.fpscsampling.com) and Technical Director of Mineral Stats Inc.
(www.mineralstats.com) in Broomfield, CO, USA. He provides consulting services in many
countries. Mr. Pitard has 6 years of experience with the French Atomic Energy Commission
and 15 years with Amax Extractive R&D. He has taught Sampling Theory, SPC, and TQM
to approximately 6000 people and to more than 275 companies around the world through
Continuing Education Offices of the Colorado School of Mines, for the Australian Mineral
Foundation, for the Mining Department of the Universidad de Chile, and the University of
Witwatersrand. He has degrees in chemistry from the Gay-Lussac Institute in Paris and from
the Academy of Paris.