Professional Documents
Culture Documents
Benchmarking A Process For Learning - Robert CAmp 10 Steps
Benchmarking A Process For Learning - Robert CAmp 10 Steps
Benchmarking A Process For Learning - Robert CAmp 10 Steps
net/publication/234698095
CITATIONS READS
6 1,284
1 author:
Michael Cole
ANU College of Health & Medicine
5 PUBLICATIONS 30 CITATIONS
SEE PROFILE
All content following this page was uploaded by Michael Cole on 28 May 2014.
Introduction
Benchmarking is a commonly used term and an integral part of the modern
lexicon of evaluation; in spite of this, a recent review of the literature by
the author revealed a great deal of confusion about what is actually meant
by benchmarking. Originally it was conceived as a continuous quality
improvement process, in which an organisation striving for best practice
compares its performance with another in an effort to learn and progress.
However, it seems it is often operationalised now as a simple ranking process.
Nevertheless, its greatest potential remains as a vehicle for the sharing and
transfer of best-practice knowledge, along with its tangible contribution to
the development of learning organisations ‘… that can analyse, reflect, learn
and change based on experience’ (Bhutta & Huq 1999, p. 256).
The purposes of this exploration are to determine from the literature: how
the terminology of benchmarking is being used and to untangle some of the
confusion surrounding the concept; to synthesise a concise definition that
is inclusive and has utility; to examine and compare various approaches in
the current theory and application of benchmarking; and finally, to elucidate
the features that are most likely to fulfil the promise of continuous quality
improvement and organisational learning outcomes.
standard, which simply add to the jargon rather attractive to partnerships, rather than the more
than our clarity or understanding. resource-intensive and time-consuming processes
of reflection and development.’ The true irony, as
will be described later in this article, is that when
A ‘benchmark’ or ‘benchmarking’ understood and implemented as a whole, the
It is important to make the distinction between Benchmarking process is indeed a time-consuming,
the establishment of a point of reference and reflective practice that promotes development.
undertaking a comprehensive continuous quality The comparative analysis of performance is
improvement process. This distinction is frequently sometimes also confused with true Benchmarking.
lacking in the literature, where too often the On this point Fine and Snyder (1999) clarify that
establishment of a benchmark is presented as performance measurement is one of the first steps
though a complete benchmarking process has been in the quality improvement process involving the
undertaken. To assist the reader in following the definition, selection and application of performance
discussion, as well as to emphasise the distinction indicators, whereas Benchmarking is a continuous
between a benchmark as a point of reference and process including implementation of reforms,
Benchmarking as a distinct formalised model evaluation of outcomes and review of the previous
of quality improvement, henceforth the term performance indicators or benchmarks.
‘Benchmarking’ will be capitalised in this article. In his bluntly titled article ‘Measurement
More than a quarter of the publications reviewed benchmarks or “real” benchmarking?’, Alstete (2008,
simply discussed Benchmarking as the establishment p. 79) throws down the gauntlet and expounds
of performance indicators or Benchmarking targets. unambiguously that ‘… organizations of all types
In addition, some authors limited their description today are concerned with comparing performance
of Benchmarking to the stage of ranking their firm for internal assessment, publicity and marketing
with competitors (Dawkins, Feeny & Harris 2007). purposes, and perhaps pride. True benchmarking …
Others equated Benchmarking only with the [is] … focused on specific process improvements and
process of comparative or gap analysis (Kumar increased organizational effectiveness’.
et al. 2008). In respect to customer service for The remarkable variation in the definitions
example, Bordley (2001) states that the benchmark and descriptions of Benchmarking evident in the
is simply customers’ product expectations, and literature, could be conceptualised as a linear
describes determining the gap between customers’ progression of increasing comprehensiveness
perceptions of the actual product and their advancing through the stages of Benchmarking; that
expectation as effectively being Benchmarking. is, from the definition of performance indicators to
Meanwhile Halliday, Asthana and Richardson the description of an institutionalised continuous
(2004, p. 286) refer to Benchmarking disparagingly quality improvement process. This could be
as a simple ‘health check’. They then go on to say, represented visually (Figure 1) with the various terms
‘Ironically, it is the least satisfactory dimension, used to define and describe Benchmarking taken from
the ability to benchmark, that is often the most the literature and presented on a continuum.
Figure 1: Visually depicts with the various terms used to define and describe Benchmarking
presented as a continuum
Establishment of performance indicators
Definition of performance indicators
Implementation of reforms
Performance comparison
Setting targets
Gap analysis
organisation
QUALITY
Even better practice
Action plan
TIME
flows within its operating environment. This A more recent analysis (Zairi & Whymark
enhances identification of customer requirements, 2000b) of the continuing development of
development of accurate measures of productivity Benchmarking at Xerox did not increase the number
and the establishment of effective goals and objectives of steps, but did add a fifth phase, Maturity, in
(Bank 2000). Identifying that someone has solved which the company has attained a leadership
a problem and obtaining ideas from those who are position and Benchmarking has become an essential
getting superior results also motivates higher levels of and embedded continuing process. The researchers
performance (Anderson & Fagerhaug 2000). Bank also described the objectives of each phase. Their
(2000) puts it very simply and powerfully when he analysis and discussion has been reproduced for ease
says the purpose of Benchmarking is to be better than of examination in Table 1.
the best competitor. Over time, the original 10-step process
established by Camp at Xerox appears to have
been abbreviated. Most of the authors in the
Models and processes literature reviewed referred to models developed by
The Benchmarking model developed at Xerox previous researchers, usually one of various five-step
(Camp 1993) had four phases: Planning, Analysis, models developed in the early to mid 1990s. The
Integration and Action. Within these four phases the most commonly cited five-step model was that of
model listed a sequence of 10 essential steps: Spendolini (1992, cited in Shen, Tan & Xie 2000;
1 Identify what is to be benchmarked. Anand & Kodali 2008; Bowerman et al. 2002;
Denkena, Apitz & Liedtke 2006).
2 Identify comparative companies. Of those authors who proposed their own
3 Determine data collection method and collect adaptation or formulation, various interpretations
data. were presented ranging from Watson’s (2005) three-
step process, which concluded with a comparative
4 Determine current performance levels. analysis, through to Owen’s (2006) eight-step
5 Project future performance levels. model, which firmly imbeds a practice of continuous
quality improvement within the organisation.
6 Communicate benchmark findings and gain A comparison of the steps in various models is
acceptance. presented in Table 2. At times authors truncated
7 Establish functional goals. the steps in the Benchmarking process and in some
circumstances they compressed steps together.
8 Develop action plans. Meszaros and Benson (2003), for example, present
9 Implement specific actions and monitor progress. a four-step Benchmarking process in which they
actually compressed two distinctly disparate
10 Recalibrate benchmarks. activities ‘compare and contrast data’ and ‘plan
Table 1: Benchmarking at Xerox as a five-phase model with objectives of each phase described
Phase Objectives
1 Planning The objective of this phase is to prepare a plan for Benchmarking.
2 Analysis This phase will assist companies to understand competitors’ strengths and assess their
performance against these strengths.
3 Integration The objective of this phase is to use the data gathered to define the goals necessary to gain
or maintain superiority and to incorporate these goals into the company’s formal planning
process.
4 Action During this stage, the strategies and action plan established through the Benchmarking
process are implemented and periodically assessed (recalibrated) with reports of the
company’s progress in achieving them.
5 Maturity The objective of this is to determine when the company has attained a leadership position
and to assess whether Benchmarking has become an essential, ongoing element of its
management process.
Reference Watson 2005 Meszaros & Smith 2006 Bhutta & Huq Bank 2000 Evans 2008 Bhutta. & Huq Maire, Bronet & Ammons 1999 Reider 2000 Owen 2006
Benson 2003 1999 1999 Pillet 2008
Sector HVAC University Human resources Manufacturing Management and Business Kodak Small to Public Management and General
12
engineering business manufacturing— medium-size administration business
case study enterprises
Number of 3 4 4 5 5 5 6 6 7 7 9
steps
Stage Plan Plan Plan Plan Plan Plan Plan Plan Plan Plan Plan
Step 1 Defining Plan the study— Planning— Determine what Decide what is to Identify the area What to Plan—determine Decide on what Identification of Identification
parameters use consensus investigation, to benchmark be benchmarked: of operation to be benchmark critical processes process to core issues and of the area of
to select similar measurement products, benchmarked to compare, benchmark critical areas for operation to be
REFEREED ARTICLE
Reference Watson 2005 Meszaros & Smith 2006 Bhutta & Huq Bank 2000 Evans 2008 Bhutta. & Huq Maire, Bronet & Ammons 1999 Reider 2000 Owen 2006
Benson 2003 1999 1999 Pillet 2008
Sector HVAC engineering University Human resources Manufacturing Management and Business Kodak Small to Public Management and General
business manufacturing medium-size administration business
—case study enterprises
Number of 3 4 4 5 5 5 6 6 7 7 9
steps
continued from previous page
Stage Implement Collect and Implement Collect and Implement Implement Collect and Plan
analyse analyse analyse
Step 5 Adapt and Develop an Define and take Gap analysis Adapt— Adapt and Analysing and Communicate
improve action plan. Use actions to meet understand new implement ‘best interpreting the best-practice
analysed data or exceed the practices and practices’ information dimensions in
to set company best performance adapt them to the organisation to
goals to achieve new context gain acceptance
superiority
Stage Review Review and Review Implement Implement
institutionalise
Step 6 Feedback and Improve— Monitor and A plan is properly Development and
review implement and revise developed and implementation
follow up the best practice of plans to
implementation implemented achieve these
of these practices levels
Stage Review Review and Review
institutionalise
13
REFEREED ARTICLE
new goals for following year’ into their third Figure 3: Anand & Kodali’s (2008) 12-phase
step. Predominantly though, the explanation for conceptual model of Benchmarking
the difference in number of steps is quite simple,
and again goes back to the authors’ understanding 1 Team formation
and definition of Benchmarking. A number of them
operated under the assumption that Benchmarking 2 Subject Identification
meant either: the establishment of performance 3 Customer validation
indicators, a comparative/gap analysis, or a ranking
exercise, and so simply stopped describing the process 4 Management validation
at those points. Some also presented Benchmarking 5 Self-analysis
as a single event rather than a continuous process and
so, even though they described it through to 6 Partner selection
planning and implementation, they left off any 7 Pre-benchmarking activities
recalibration of benchmarks or further review of the
Benchmarking process. 8 Benchmarking
Ultimately, it is when Benchmarking has 9 Gap analysis
become institutionalised as a continuous quality
improvement process that it can achieve its 10 Action plans
potential in contributing to the development of a 11 Implementation
learning organisation. In this situation it could be
viewed as an example of a practical participatory 12 Continuous improvement
evaluation approach (Cousins & Earl 1995, cited
in Alkin 2004).
Conclusions
Table 2 lists the publication, reference,
sector if specified, and the steps described in the The theory and practice of Benchmarking has grown
Benchmarking process. The various models reviewed rapidly and organically over the past decade.
were analysed for component stages, these were As a result, there is a great deal of diversity in
then synthesised to produce common stages in the approaches, along with confusion in the terminology
Benchmarking processes. All steps in each model used by organisations and researchers to discuss
were then classified according to the following Benchmarking.
stages: As it continues to progress, one of the challenges
Benchmarking faces is whether or not it can
■■ planning the Benchmarking process
evolve and adapt in diverse contexts, yet maintain
■■ the collection and analysis of data a common language that facilitates the transfer
of research findings and promotes professional
■■ implementation of the adapted practice
development and organisational learning. More
■■ review of the new practice precise terminology should be promoted by
management leaders, educators and researchers.
■■ institutionalisation of the Benchmarking process
It seems that the evolution of Benchmarking has
itself.
now passed the point where the development of a
Anand and Kodali (2008) reviewed the best unifying model or common theory of Benchmarking
practices in Benchmarking and proposed a is possible. However, an examination of the various
model that consists of 12 phases and includes 54 models illustrates that a comprehensive process
steps (see Figure 3). While they claim that this can and must be used if one is to undertake an
was a Benchmarking exercise on Benchmarking authentic Benchmarking exercise that will result in
practice, they did not implement it and so by improvement in both quality and learning outcomes.
definition it was not a true Benchmarking process. A key question is whether Benchmarking will
However, they candidly acknowledged that ‘… come to be used mechanically to raise higher targets
one of the limitations of the model is that it is that drive management and staff to report against.
highly conceptual and has not been validated Or will it maintain its integrity as a holistic approach
by implementing it in industries to assess its to evaluation that can be a pathway towards
effectiveness.’ (p. 282). The model was not included collaborative continuous improvement and the
in Table 2 for this reason, but this not intended to development of a true learning organisation.
imply that it does not have merit, and in fact it does Ultimately, it has potential as a vehicle for
warrant testing in the field. objective feedback, challenging mental models,
Under each phase, several detailed steps are encouraging reflective practice and ensuring
described. While its meticulous detail could be continuous improvements that all contribute to the
considered too prescriptive by veteran evaluators development of learning organisations. Senge (1990,
experienced in Benchmarking, conversely its p. 3) envisioned organisations ‘… where people
inclusiveness would make it easy for a novice continually expand their capacity to create the results
practitioner from virtually any field to saunter they truly desire, where new and expansive patterns
through the Benchmarking process, confident of thinking are nurtured, where collective aspiration
that they had not missed any critical component in is set free, and where people are continually learning
the sequence. how to learn together’.