Download as pdf or txt
Download as pdf or txt
You are on page 1of 104

Interest Group in

Coaching Psychology

International Coaching
Psychology Review
Volume 10 No. 2 September 2015

ISSN: 1750-2764
International Coaching Psychology Review
Editorial Board
Co-ordinating Editors
United Kingdom: Stephen Palmer, PhD, Coaching Psychology Unit, Department of Psychology, City University London,
Northampton Square, London, UK.
Australia: Sandy Gordon, PhD, University of Western Australia, Perth, Australia.
Co-Editors
Michael Cavanagh, PhD, Coaching Psychology Unit, School of Psychology, Sydney University, Australia.
Anthony M. Grant, PhD, Coaching Psychology Unit, School of Psychology, Sydney University, Australia.
Travis Kemp, PhD, International Graduate School of Business, University of South Australia, Australia.
David Lane, PhD, Middlesex University, London, UK.
Alex Linley, PhD, School of Psychology, University of Leicester, UK.
Alison Whybrow, PhD, Coaching Psychology Unit, City University London, UK.
Subscriptions
International Coaching Psychology Review (ICPR) is published in March and September. It is distributed free of charge to members of
the British Psychological Society Special Group in Coaching Psychology and the Australian Psychological Society Interest Group in
Coaching Psychology members. It is available to non-members (Individuals £50 per volume; Institutions £60 per volume; single copies
£25) from: The British Psychological Society, SGCP, St. Andrews House, 48 Princess Road East, Leicester LE1 7DR. UK.
Abstracting and indexing: The ICPR is abstracted in psycINFO, Applied Social Sciences Index and Abstracts and Google Scholar.
The ICPR is included Cabell's Directory of Publishing Opportunities in Educational Psychology and Administration and Cabell's
Directory of Publishing Opportunities in Educational Curriculum and Methods.
International Editorial Board Stephen Joseph, PhD, University of Warwick, UK.
Hilary Armstrong, PhD, Institute of Executive Coaching, Carol Kauffman, PhD, Harvard Medical School, USA.
Sydney, Australia. Roy Moodley, PhD, University of Toronto, Canada.
Paul Atkins, PhD, Australian National University, Richard Nelson-Jones, PhD, Cognitive Humanistic Institute,
Canberra, Australia. Thailand.
Tatiana Bachkirova, PhD, Oxford Brookes University, UK. Lindsay Oades, PhD, University of Wollongong, Australia.
John Bennett, PhD, Queen’s University of Charlotte, Jonathan Passmore, PhD, Evora University, Portugal.
North Carolina, USA. James Pawelski, PhD, Positive Psychology Center,
Michael Carroll, PhD, University of Bristol, UK. University of Pennsylvania, USA.
Ian Cockerill, PhD, University of Birmingham, UK. Gordon Spence, PhD, University of Wollongong, NSW Australia.
Cary Cooper, PhD, Manchester Business School, UK. Ernesto Spinelli, PhD, Regent’s College, UK.
Sarah Corrie, PhD, Middlesex University, Catherine Steele PhD, University of Worcester, UK.
London, UK. Reinhard Stelter, PhD, Coaching Psychology Unit,
Paula Cruise, PhD, University of Cambridge, UK. University of Copenhagen, Denmark.
Susan David, PhD, Melbourne University, Australia. Lewis R. Stern, PhD, Harvard University Medical School, USA.
Suzy Green, PhD, University of Wollongong, NSW Australia. Dianne Stober, PhD, Fielding University, USA.
Kate Hefferon PhD, University of East London, UK. Mary Watts, PhD, City University, London, UK.

Notes for Contributors


The ICPR is an international publication with a focus on the theory, practice and research in the field of coaching psychology.
Submission of academic articles, systematic reviews and other research reports which support evidence-based practice are welcomed.
The ICPR may also publish conference reports and papers given at the British Psychological Society Special Group in Coaching
Psychology (BPS SGCP) and Australian Psychological Society Interest Group in Coaching Psychology (APS IGCP) conferences, notices
and items of news relevant to the International Coaching Psychology Community.
Case studies and book reviews will be considered. The ICPR is published by the BPS SGCP in association with the APS IGCP.
1. Circulation
The circulation of the ICPR is worldwide. It is available in hardcopy and PDF format. Papers are invited and encouraged from authors
throughout the world. It is available free in paper and PDF format to members of the BPS SGCP, and free in PDF format to APS IGCP
members as a part of their annual membership.
2. Length
Papers should normally be no more than 6000 words, although the Co-Editors retain discretion to publish papers beyond this length
in cases where the clear and concise expression of the scientific content requires greater length.
3. Reviewing
The publication operates a policy of anonymous peer review. Papers will normally be scrutinised and commented on by at least two
independent expert referees (in addition to the relevant Co-Editor) although the Co-Editor may process a paper at his or her
discretion. The referees will not be aware of the identity of the author. All information about authorship including personal
acknowledgements and institutional affiliations should be confined to the title page (and the text should be free of such clues as
identifiable self-citations, e.g. ‘In our earlier work…’).

Continued on inside back cover.


The British Psychological Society
Special Group in Coaching Psychology

The Australian Psychological Society Ltd


Interest Group in Coaching Psychology

International
Coaching Psychology Review
k
Volume 10 No. 2 September 2015

k
SGCP 5th European Coaching
Psychology Conference 2015
Breaking New Ground
Thursday 10th and Friday 11th December 2015
at the Holiday Inn London Bloomsbury
This Conference will inspire collaborations in research evidence,
professional accreditation and training routes. It will provide a platform for
setting the aspirations and agenda for both coaching and coaching
psychology for the coming years.
Keynote Speakers
Dr Tatiana Bachkirova
Dr Suzy Green
Prof Roger Steare
Dr Helen Turnbull
There will be two days of impressive Speakers, exciting and new Topics
and a broad range of Master classes, Skills Workshops and Scientific
Papers covering the following themes:
Leadership, Executive and Business Coaching
Positive Psychology Coaching (including resilience)
Tools & Techniques in Coaching Psychology including CPD & Peer Practice
Coaching Psychology Research Network, including international
collaborations, international developments, new research, new
researchers and new developments

This event is organised by the BPS Special Group in Coaching Psychology and administered by
KC Jones conference&events Ltd, 01332 224501

Please visit www.sgcp.eu for further information

114 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Contents
116 Editorial: 10 years, 10 volumes of the International Coaching Psychology Review
Stephen Palmer & Sandy Gordon
Papers
118 Who sees change after leadership coaching? An analysis of impact by rater level
and self-other alignment on multi-source feedback.
Doug MacKie
131 Authentic Leaders are… conscious, competent, confident, and congruent:
A Grounded Theory of Group Coaching and Authentic Leadership Development
Tony Fusco, Siobhain O’Riordan & Stephen Palmer
149 Walking a mile in an executive’s shoes: The influence of shared client-coach
experience on goal achievement
Alex T. Chinn, James P. Richmond & John L. Bennett
161 Using Clean Language to explore the subjectivity of coachees’ experience
and outcomes
Susie Linder-Pelz & James Lawley
175 Evaluating a coaching and mentoring programme: Challenges and solutions
Tatiana Bachkirova, Linet Arthur & Emma Reading
190 Teachers’ experiences of an introductory coaching training workshop in Scotland:
An interpretative phenomenological analysis
Margaret Barr & Christian van Nieuwerburgh
Reports
205 Special Group in Coaching Psychology News
Dasha Grajfoner
207 Interest Group in Coaching Psychology News
Nic Eddy

210 International Coaching Psychology Review – Volume index 2015

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 115


© The British Psychological Society – ISSN: 1750-2764
Editorial: 10 years, 10 volumes of the
International Coaching Psychology Review
Stephen Palmer & Sandy Gordon

D
OUG MACKIE asks ‘Who sees change cations for coaching psychologists related to
after leadership coaching? An analysis pacing and timing of coaching sessions.
of impact by rater level and self-other In the next paper, Tatiana Bachkirova,
alignment on multi-source feedback’. Using Linet Arthur and Emma Reading illustrate
multisource feedback from 31 executives an independently conducted research study
and senior managers from a large not-for- to develop appropriate measures and evalu-
profit organisation, he assesses the effective- ate the coaching/mentoring programme
ness of strength-based coaching and that had been running for over five years.
self-other rater alignment on leadership They also explore specific challenges in the
outcomes after six sessions of coaching. evaluation of a large-scale coaching pro-
Our second article also focuses on lead- gramme and to suggest new solutions. They
ership. In this paper Tony Fusco, Siobhain argue for the development of additional
O’Riordan and Stephen Palmer explore and methods in outcome research on coaching
bring together Group Coaching and Authen- programmes that are aligned with the main
tic Leadership Development (ALD). principles and philosophy of coaching as a
A Grounded Theory approach was used in practice.
this study. The authors put forward an In our last paper the researchers,
underpinning theory of Group Coaching Margaret Barr and Christian van Nieuwer-
and ALD and introduce a model of authen- burgh, use an interpretative phenomeno-
tic leadership based on the core concepts of logical analysis to explore five teachers’
conscious, competent, confident and experiences of an introductory coaching
congruent leadership. training workshop in Scotland. In the study
In ‘Walking a mile in an executive’s the participants reported that collaborating
shoes: The influence of shared client-coach with others and having time for reflection
experience on goal achievement’ Alex enhanced their learning. It is interesting to
Chinn, James Richmond, and John Bennett note that in Scotland new professional
discuss survey data from 206 target organisa- update procedures require school leaders to
tions, coaches in their network, and their use coaching skills.
coaching clients. Specifically, they determine As usual we finish with reports from the
whether using shared professional and BPS SGCP Chair and APS IGCP Convenor.
industry experience to match coaches and With my colleagues in the UK and
clients by coaches, clients, HR partners and Australia, I (SP) have been co-editing the
third-party coach-client matching services, International Coaching Psychology Review
maximises goal achievement. (ICPR) for 10 years. In other words,
Susie Linder-Pelz and James Lawley 10 volumes. Recently it occurred to me that
report on ‘Using Clean Language to explore this seems like an ideal time to step down
the subjectivity of coachees’ experience and from the role as the UK Co-ordinating
outcomes’. Employing a Clean Language Editor. When the BPS Special Group in
phenomenological approach their thematic Coaching Psychology was launched in 2004,
analyses reveals both favourable and we had aspirational goals, although some of
unfavourable evaluations and several impli- them could be more accurately described as

116 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


© The British Psychological Society – ISSN: 1750-2764
Editorial: 10 years, 10 volumes of the International Coaching Psychology Review

fuzzy goals. But we all knew that we wanted As several colleagues have already acknowl-
to develop the new discipline and profession edged Stephen has made an indelible mark
of coaching psychology. And this leads me to on the development of the coaching psychol-
my next point. Research is of paramount ogy industry. For many years his passion and
importance in developing a new scientific leadership have been evident both locally
field, yet back in 2004, we lacked suitable and internationally and I’m sure will
journals to publish coaching-related continue. I (SG) wish to take this opportu-
research papers. With the go-ahead and nity to formally thank him personally for his
support of both the BPS SGCP and APS kind support and assistance with co-ordinat-
IGCP committees, we set up the ICPR, the ing editorial business and I promise, on
first international peer-reviewed publication behalf of ICPR readers, that I will ensure he
for coaching psychology. Over the past remains ever active as a member of the
decade we have seen a rise in the quality of Editorial Board.
the papers and research areas investigated.
I thank my Co-Editors, Anthony Grant, Correspondence
Travis Kemp, David Lane, Alex Linley and Stephen Palmer
Alison Whybrow for their hard work on the Coaching Psychology Unit,
publication since 2006 and in particular, the Department of Psychology,
Australian Co-ordinating Editors, Michael City University London,
Cavanagh and more recently, Sandy Gordon. Northampton Square,
However, the ICPR would not exist if it was London, UK.
not for the authors and also the reviewers. Email: s.palmer-1@city.ac.uk
During this period, Martin Reeves in the BPS
office has patiently typeset so many articles Sandy Gordon
on our behalf, and Tracy White, our editorial The University of Western Australia,
assistant, has supported us on a day-to-day Perth, Australia.
basis. This month, Alex is also stepping down Email: sandy.gordon@uwa.edu.au
as an ICPR Co-Editor.
To conclude, my thanks goes to every- Websites
body who has been involved in ensuring SGCP 5th European Coaching Psychology
ICPR gets published. I look forward to seeing Conference 2015:
SGCP and IGCP colleagues at the next SGCP www.sgcp.eu
5th European Coaching Psychology Confer-
ence 2015 in December. The theme is The International Congress of Coaching
‘Breaking New Ground’. A great way to end Psychology events:
the year. www.coachingpsychologycongress.org

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 117


Who sees change after leadership
coaching? An analysis of impact by
rater level and self-other alignment
on multi-source feedback
Doug MacKie

Objectives: The objective of this research was to investigate the use of multi-source feedback in assessing the
effectiveness of a strength-based coaching methodology in enhancing elements of the full range leadership
model. It also investigated the effects of self-other rater alignment on leadership outcomes after coaching.
Design: A between-subject non-equivalent control group design was used to explore the impact of strength-
based coaching on transformational leadership behaviours measured in a 360-degree feedback process.
Thirty-one executives and senior managers from a large not-for-profit organisation were non-randomly
assigned to either a coaching or waitlist cohort.
Methods: The coaching cohort received six sessions of leadership coaching involving feedback on leadership
and strengths, goal setting and strengths development. After six sessions of coaching over three months,
cohorts then switched roles.
Results: The results showed that participants experienced statistically significant increases in their
transformational leadership behaviour after coaching and this difference was perceived differentially at all
levels within the organisation but not by the participants themselves. Raters at higher levels in the
organisation were the most sensitive to change. The results also showed that self-other rater alignment was
a significant factor in self-ratings of change over time with those participants who initially over-rated
themselves, reducing their ratings over time as a consequence.
Conclusion: The results suggest that changes in coachee transformational leadership behaviour after
leadership coaching are perceived differentially by rater level within an organisation and that self-other rater
alignment is an important moderator of self-ratings over time.
Keywords: leadership coaching; strength-based; rater level; multi-source feedback; self-other alignment.

E
VIDENCE IS GROWING for the effec- methodologies are near ubiquitous in lead-
tiveness of executive coaching in organ- ership development programmemes includ-
isations and yet much of the research ing coaching approaches and yet they are
shows an over-reliance of self-report primarily used for assessment and awareness
measures rather than investigating the raising purposes rather than as formative
impact more broadly on managers, peers outcome criteria to assess change after
and direct reports within the organisation, leadership development interventions
(MacKie, 2014; Page & de Haan, 2014). (Kochanowski, Seifert & Yukl, 2010; Nowack
Multi-source feedback (MSF) or 360-degree & Mashihi, 2012).
feedback provides the opportunity to exam- There are several reasons why MSF within
ine the impact of executive coaching more a leadership framework are desirable
broadly in the organisation and to extend dependent variables in leadership coaching
the analysis of impact beyond the level of outcome studies. Self-reports are an unreli-
self-report. Multi-source feedback or 360 able indicator of change, especially when the

118 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


© The British Psychological Society – ISSN: 1750-2764
Who sees change after leadership coaching?

rater is least skilled in that area, (Kruger & like team work are not easily amenable to
Dunning, 1999) and are prone to leniency objective measurement, (Murphy, 2008).
bias (Fleenor, Smither, Atwater et al., 2010). It is important to recognise that even
Secondly leadership coaching by definition, without subsequent leadership coaching,
requires an impact beyond the self-report of MSF is an intervention in itself, especially if
the coachee as the purpose of modifying formally debriefed with the participant
their behaviour is to have a more transfor- (Neiminen et al., 2013). In a meta-analysis of
mative impact on those around them in an 24 longitudinal studies, small but significant
organisation (Kochanowski, Seifert & Yukl, effect sizes in performance were found after
2010). Indeed there is significant evidence MSF as observed by supervisors and the
linking perceived changes in leader participant’s direct reports (d=0.15), peers
behaviour with enhanced engagement and (d=0.05) but not self-ratings (d=–0.04),
discretionary effort in followers, resulting in (Smither, London & Reilly, 2005). There is
enhanced business-unit outcomes, (Avolio, also some evidence to suggest that raters at
2011; Harter, Schmidt & Hayes, 2002). Prior different levels focus on different aspects of
research has also found that significant the leader with supervisor ratings being
changes in transformational leadership after more closely correlated with external
coaching have been perceived by other performance criteria (Atkins & Wood, 2002)
raters with the same organisation but these whilst direct reports (those reporting
studies have not reported changes by rater directly into the participant), focus on more
level, (Cerni, Curtis & Colmar, 2010; O’Con- interpersonal and relational criteria
nor & Cavanagh, 2013). Transformational (Nowack, 2009).
leadership is one of the most researched Another critical issue in the application
leadership theories over the last 30 years and of MSF to the evaluation of leadership
has established significant correlations coaching interventions is the issue of self-
between increases in transformational lead- other agreement (SOA) (Fleenor et al.,
ership and objective performance outcomes 2010). Given the challenges of self-report
including financial performance, job satis- data, it is not surprising to find that there are
faction, follower satisfaction, and organisa- typically modest correlations between self
tional commitment (Avolio, 2011). and other ratings in the existing literature,
Finally, multi-source leadership ratings (Fleenor et al., 2010, Nowack & Mashihi,
can provide a reliable and valid outcome 2012). However, within these discrepancies,
measure that can be compared across stud- there are a variety of interesting sub-groups.
ies, a key criterion if different coaching Individuals who overrate themselves
methodologies are to be compared and compared to other raters are seen to be
contrasted, (MacKie, 2014). Evidence for the potentially at risk of derailing (ie. failing to
validity of other-ratings has been demon- reach their career apogee) and may be less
strated in prior research. Atkins and Wood receptive to feedback, (Woo et al., 2008) but
(2002) used assessment centre ratings as the the gap between self and others can also act
objective and independent performance as a motivator to change, (Atwater & Brett,
criteria and found that other-raters derived 2005). Individuals who under-rate them-
from MSF significantly predicted perform- selves when compared to others are poten-
ance on the assessment centre, as did line tially self-critical and perfectionistic and can
manager ratings alone. However, it is impor- be demotivated by the realisation that others
tant to remember that in leadership assess- perceive them to be more effective than they
ment, as in so many job performance see themselves, (Nowack & Mashihi, 2012).
criteria, there is no ‘objective’ measure of These somewhat contradictory findings in
performance primarily due to criterion defi- the SOA literature suggest the impact of
ciency, that is aspects of job performance misalignment of self-other ratings on coach-

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 119


Doug MacKie

ing outcomes would be a useful hypothesis of managers. Thirty managers were


to explore further. randomly assigned to either workshop alone
Finally there is a developing body or workshop plus telephone coaching. Feed-
evidence of that has specifically examined back was based on the manager’s boss and at
perceived changes in MSF after coaching least three direct reports. The results showed
interventions. Luthans and Petersen (2003) that the coaching group demonstrated a
investigated the effects of feedback plus significant increase on the control group in
coaching on a group of 27 managers and 67 only one of the four influencing tactics
employees. The study specifically aimed to assessed (collaboration). However only the
reduce the self-other discrepancies in MSF. subordinate data was used in the compara-
At Time 1 there were significant differences tive analysis so the impact on different raters
in the self-other ratings (with self being levels (e.g. boss, peer or self) remained
higher) on behavioural and interpersonal unknown. In a study of 469 middle
competency and personal responsibility. managers, Neiman et al. (2013) used a quasi-
However, these discrepancies had all disap- experimental design to compare the impact
peared at Time 2 after the coaching process. of MSF alone and MSF plus five sessions of
Interestingly the self-ratings had not dimin- executive coaching. The results suggested
ished over time but the other ratings had that while both groups improved equally
caught up at Time 2. Unfortunately all other when rated by direct reports, peers and
raters were combined into one category so it supervisors, only managers who had received
was not possible to ascertain the differences the coaching improved on self-ratings of
by organisational level. The results also leadership behaviour and effectiveness.
suggested an improvement in manager and In conclusion, whilst there is growing
employee satisfaction and commitment at evidence for the effectiveness of executive
Time 2. coaching in organisations, the level of that
Smither et al. (2003) examined whether impact remains unclear. MSF provides an
coaching could improve the effect of 360- opportunity to extend the evaluation of
degree feedback in enhancing performance. executive coaching beyond the reliance on
Of 1202 senior managers who received 360- self-report and assess its broader impact in
degree feedback, 404 were selected for the organisation. In addition the issue of self-
subsequent coaching. Those who partici- other alignment has potentially significant
pated in coaching were reported to set more implications for coaching evaluation given
specific goals, solicit more ideas and improve that positive discrepancies may suppress the
more in terms of others’ ratings. However coaching effect as the coachees adjust their
despite some positive changes in goal setting ratings to align more with other raters. Multi-
and performance (Effect size, d=0.17) as rater assessment based on reliable and valid
measured by supervisor and direct report leadership constructs provides the opportu-
ratings (self reports were not analysed and nity to track the impact of executive coach-
peer ratings were not significant) in a repeat ing as its effects cascade through the
360 feedback process, only 30 per cent of the organisation.
original participants participated in the
coaching and the selection criteria for their Rationale and aims
inclusion was mixed (some were required to The limited number of studies that have
participate by their managers) making the examined the impact of leadership coaching
results prone to selection effects and difficult interventions by level and considered the
to generalise. impact of SOA have demonstrated inconsis-
Kochanowski, Seifert and Yukl (2010) tent results and drawn different inferences
investigated the effective of a feedback work- making conclusions about effectiveness diffi-
shop plus coaching on the influencing skills cult to generalise. This study aims to address

120 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Who sees change after leadership coaching?

these issues in coaching research by specifi- Method


cally investigating the impact of perceived Participants
coaching outcomes by the level of raters A total of 31 senior managers (14 male, 17
within an organisation and investigating the female) were recruited from the same organ-
impact on outcomes of self-other alignment isation in the not-for-profit (NFP) sector.
(SOA). They were all senior managers and leaders in
The dependent variable used to assess the Australian arm of a multi-national not-for-
outcomes was the full range leadership profit (NFP) organisation. The average age
model (FRLM) that includes transforma- was 45 years (range 31 to 62 years). This
tional, transactional and laissez-faire represented all available senior mangers from
elements of leadership. This leadership the top two levels in the organisation and
outcome provides 360-degree feedback on included the executive director and the lead-
changes in leadership behaviour throughout ership team. A total of 37 individuals were
the organisation and moves the assessment of invited to participate but six were unable to
coaching outcomes beyond the reliance on participate due to overseas postings and
self-report measures. By focusing on a maternity leave. Having managerial responsi-
specific strength-based coaching methodol- bility for a number of direct reports was a
ogy, using a reliable and valid measure of prerequisite of participating in the study. The
transactional and transformational leader- participants were then divided into two
ship as the dependent variable and assessing groups – the coaching first group (Cohort 1),
outcomes by way of a 360-degree feedback and the waitlist first group (Cohort 2). The
methodology, this study aims investigate the process of group allocation was not random
level at which change in leadership as it depended on the availability of the partic-
behaviours after coaching is perceived within ipants and the preferences of the organisa-
the organisation and the impact of SOA on tion. All participants gave their written
leadership outcome ratings after coaching. informed consent to participate in the study.

Hypotheses Raters
The following specific research questions Raters were all drawn from the same organi-
will be addressed in an attempt to address sation as the participants. They were a
the aims of the study. mixture of line managers, peers, direct
1. Changes in transformational leadership reports and others in the organisation who
behaviour observed after participation in did not fit into the first three categories.
a coaching process will be perceived Each participant had an average of 9.8, 9.7
differentially throughout the organisa- and 9.6 raters at the three time points
tion. The perception of change in lead- respectively. Rater consistency across time
ership behaviours will vary by the level of was high with 92.5 per cent and 88.8 per cent
the rater with line managers and direct of the original raters also responding at
reports reporting most change followed Time 2 and Time 3. There was no significant
by peers and self-reports. difference between the ratings of original
2. Self-other agreement at Time 1 will and original plus new raters at Time 2 and 3
impact subsequent self-ratings of trans- on transformational leadership, hence the
formational leadership. Participants who full compliment of raters was used in the
over-estimate their MSF ratings as analysis. (See MacKie, 2014, for a full
compared to all others will show a description of the rater consistency data.)
tendency to reduce their ratings over
time. Participants who underestimate Research design
their ratings compared to all others will The study utilised a non-equivalent control
increase their ratings over time. group design with two cohorts; a Coaching

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 121


Doug MacKie

first group (Cohort 1) and a Waitlist first provided the format for strengths develop-
group (Cohort 2). While cohort 1 was ment through the sessional rating of
engaged in the coaching, Cohort 2 acted as strengths awareness, alignment, pairing and
the control group. Cohorts then switch roles utilisation. Each coach provided leadership
at the mid-point (Time 2). However, because coaching to between one to two participants
Cohort 1 had had the coaching intervention per cohort.
at this stage, it was not able to act as an inde-
pendent control group for Cohort 2. Each Procedure
participant received six sessions (nine hours) Strength-based protocol. Each coachee
of strength-based leadership coaching. The received six 90-minute coaching sessions that
dependent variable was the multi-source followed a format articulated in their coach-
feedback on participant’s transformational ing manual. Initially coaches began with a
leadership behaviour provided by the MLQ strength-based interview followed by feed-
360. Each participant had an average of 9.8 back for the coachee on their MLQ 360
raters from above, peer, direct report and report (Bass & Avolio, 1997) and Realise 2
other levels within the organisation. Inventory (Linley, Willars & Biswas-Diener,
2010). The strength-based interview focused
Coaches on their peak experiences and what ener-
A total of 11 coaches provided their services gised them about their work. The Realise 2
pro-bono for the research. They were highly questionnaire provided feedback on what
experienced practitioners who were mainly energised them, where they felt competent
recruited from the local executive education and where they had the opportunity to apply
department of a prestigious business school their strengths. This led to structured feed-
and had been preselected for both psycho- back on their realised strengths (those that
logical mindedness and business acumen. were known and utilised), unrealised
All coaches were self-employed practitioners strengths (those that were known but under-
who earned a significant part of their utilised), learned behaviours (those that
income from providing executive coaching were competent but not energising) and
services to corporate entities. On average weaknesses (where both competence and
they had 12 years of experience providing energy were low). The MLQ 360 provided
executive coaching in organisations and had qualitative and quantitative multi-rater feed-
been working in organisations for an average back on their scores on the full range lead-
of 28 years. The majority (70 per cent) were ership model (FRLM) that included
qualified at Masters level or above and were transformational, transactional and laissez-
registered practising psychologists. Each faire leadership styles. Coachees were then
coach was trained in the author’s strength- required to select three goals they would like
based methodology by way of a half-day train- to focus on during the coaching; a realised
ing programmeme. This process described strength, an unrealised strength and a
the underlying rationale for strength-based learned behaviour or weakness. These goals
approaches to leadership and provided a were focused on issues that the coachee was
structured strength-based coaching manual motivated in addressing and also that had
for the coach to follow. The induction partic- relevance for the business. Coachees then
ularly focused on the identification of tracked their progress on these goals for the
strengths through interview data, MLQ 360- remaining five sessions and committed to
degree feedback and the Realise 2 inventory actions designed to help their goal attain-
(Linely & Stoker, 2012). The Realise 2 four ment. Coachees also tracked their progress
quadrant model was also used to give the on a sessional basis by reflecting on and
coaches a format for setting strength-based rating their strength awareness, alignment,
development goals. The induction also pairing and utilisation in their coaching

122 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Who sees change after leadership coaching?

manual. This study also utilised a measure of changes in the dependent variable (DV)
protocol and manual adherence to investi- over time and between group differences in
gate the link between adherence to the terms of rate of change on the DV. The five
strength-based approach and subsequent transformational leadership sub-scales as
changes in transformational leadership measured by all raters, were aggregated into
behaviour. (See MacKie, 2014 for further one combined transformational leadership
elaboration.) score, the MLQ 5I (Bass & Avolio, 1997) to
provide an overall index of change. These
Measures ratings were then divided into mean self-
Each participant received the Multi-Factor ratings for average transformational leader-
Leadership Questionnaire. The MLQ 360 (Bass ship and mean other-ratings for composite
& Avolio, 1997) is a 49-item questionnaire transformational leadership scores by time
that measures nine elements of the full to examine the impact of SOA on outcomes.
range leadership model (FRLM) namely
idealised influence attributes (e.g. Display a Results
sense of power and confidence), idealised Hypothesis 1: Changes in transformational
influence behaviour (e.g. Talk about my leadership behaviour observed after partici-
most important values and beliefs), inspira- pation in a coaching process will be
tional motivation (e.g. Articulate a perceived differentially throughout the
compelling vision of the future), intellectual organisation. The perception of change in
stimulation (e.g. Seek different perspectives leadership behaviours will vary by the level of
when solving problems), individualised the rater with line managers and direct
consideration (e.g. Help others to develop reports reporting most change followed by
their strengths), contingent reward (e.g. peers and self-reports.
Provide others with assistance in exchange There were no significant differences
for their efforts), management by exception between the two groups at Time 1 on the
active (e.g. Keep track of all mistakes), MLQ 5I composite score at any rater level.
management by exception passive (e.g. Fail The key component of this hypothesis was
to interfere until things become serious) and that changes in transformational leadership
laissez-faire (e.g. Avoid making decisions). would be observed differentially beyond the
The inventory also has three measures of level of self-report. Consequently an analysis
leadership outcomes; extra effort (e.g. by level of rater was conducted to see who
Heighten others’ desire to succeed), effec- observes the changes in participant leader-
tiveness (e.g. Lead a group that is effective) ship behaviour and whether the organisa-
and satisfaction (e.g. Work with others in a tional level of the observing rater is a
satisfactory way) (Bass & Avolio, 1997). The significant factor in observing changes in
MLQ360 measures all items on a five-point leadership behaviour.
Likert scale from ‘not at all’ to ‘frequently if A repeated measures ANOVA was
not always’. Cronbach’s alpha for the main performed to examine the impact on coach-
transformational leadership factor has been ing on mean transformational leadership
reported as 0.85 (Antonakis et al., 2003) and scores over time by rater level. Table 1 clearly
criterion validities vary for satisfaction illustrates that in both cohorts the greatest
(0.71), effectiveness (0.64) and performance significant change and effect size was achieved
(0.27) (Judge & Piccolo, 2004). by the higher-level raters. This suggests that
those raters working above the participant in
Data analysis the organisation, for example, their line
Repeated measures ANOVAs (Tabachnick & manager, were seeing the greatest change in
Fidell, 2007) were calculated using SPSS that the participants in terms of transformational
allowed analysis of both within-subject leadership behaviour after their leadership

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 123


Doug MacKie

coaching. For both cohorts, the peer and Figure 1 shows that C1 participants began
direct report level perceived significant with a significantly higher rating than the
change in participant’s transformational lead- combined all other rater group. This
ership behaviour at the p<0.05 level. For the discrepancy then reduces at Time 2 possibly
lower level, both groups reported significantly as a function of increased awareness of the
higher ratings on transformational leadership discrepancy during the feedback process.
after participant coaching (Table 1). This may explain why the participant scores
It is important to note that there were no have decreased after coaching while all other
significant positive changes over time in the raters level scores have increased. This
participants own perceptions of their trans- elevated self-rating was only apparent in
formational leadership behaviour although Cohort 1 and was not apparent in Cohort 2.
there was a positive but non-significant trend Receiving the feedback at Time 1 that all
in Cohort 2. In Cohort 1 the self-ratings actu- other raters view their MLQ scores at a lower
ally declined over time despite all other- level, appears to have driven down the subse-
raters reporting a positive increase in quent MLQ self–ratings even during the
transformational leadership behaviour. This coaching process where all other rater levels
may be due to the lack of SOA at T1 for are reporting an increase in transforma-
Cohort 1, a hypothesis more fully explored tional leadership behaviour. At Time 3, the
in the next section. An analysis of the five Self-other discrepancy for Cohort 1 has gone
individual components of transformational the other way with participants significantly
leadership revealed that the only significant underestimating their transformational lead-
decline in self-ratings was in inspirational ership scores when compared to all other
motivation (IM) in Cohort 1 (F(1,29)=4.781, raters.
p=0.040, partial η2=0.179). Figure 1 shows that in contrast to
Cohort1, Cohort 2 began with participant
Hypothesis 2: Self-other agreement at Time MLQ ratings much more aligned to all other
1 will impact subsequent self-ratings of trans- raters. Their ratings do not significantly
formational leadership. Participants who change between T1 and T2 as they have not
over-estimate their MSF ratings as compared yet had the MLQ feedback that is embedded
to all others will show a tendency to reduce in the coaching. At Time 3 after the comple-
their ratings over time. Participants who tion of the coaching, their mean MLQ5I
underestimate their ratings compared to all transformational leadership scores remain
others will increase their rating over time. aligned with all other raters. The results
In order to examine the impact of self- from Cohort 2 suggest that beginning the
other alignment on outcomes, a mean other coaching process with a strong SOA is crucial
rater composite score was calculated. The in maintaining this over time. Despite this
results in Table 2 demonstrate that for C1, alignment, however, the self-ratings in
there was a significant difference in self-other Cohort 2 did not show significant change
ratings at Time 1 with participants signifi- over time unlike the combined all-other
cantly over-rating themselves compared to all transformational leadership ratings.
other raters. This discrepancy then disap-
peared at T2 when they appeared much Discussion
more aligned and then reappeared in the The results demonstrated three significant
other direction at Time 3 with participants findings in the utlilisation of MSF to evaluate
continuing to decrease their self-ratings even outcomes in leadership coaching. Firstly
after the coaching intervention. For Cohort there was no significant change in the partic-
2, there was no initial misalignment between ipants’ ratings of transformational leader-
self-other ratings and both ratings showed ship after the coaching intervention.
good alignment over the three time points. Secondly the change in other-ratings of

124 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Who sees change after leadership coaching?

Table 1: Changes in Mean Transformational MLQ rater scores for Cohort 1 and 2
across Time 1 and Time 3 by rater level.
Time 1 Time 3
MLQ rater M SD M SD F df p Partial
level η2
Cohort 1 Coaching First
Self (N=14) 2.92 0.37 2.72 0.41 1.503 1,24 .233 .064
Higher (N=16) 2.64 0.72 3.17 0.60 4.694 1,30 .039 .144
Peer (N=49) 2.55 0.66 2.92 0.63 5.666 1,76 .020 .071
Lower (N=56) 2.61 0.75 2.97 0.48 6.452 1,90 .013 .068
Other (N=9) 2.69 0.94 2.80 0.61 0.165 1,17 .795 .005
Cohort 2 Waitlist First
Self (N=17) 2.90 0.46 3.05 0.46 0.761 1,31 .390 .026
Higher (N=22) 2.81 0.55 3.35 0.54 8.685 1,37 .006 .199
Peer (N=51) 2.70 0.62 3.10 0.47 12.937 1,100 .001 .117
Lower (N=67) 2.80 0.78 3.11 0.54 5.691 1,117 .019 .047
Other (N=12) 2.57 0.93 2.87 0.094 1,13 .765 .008
Note: Repeated Measures ANOVA Within Group Comparison of MLQ5I means between Waitlist first group and Coaching
first group at Time 1 and Time 3 by rater level. Higher=line manager and lower=direct reports.

Table 2: Self-Other Alignment in Mean Transformational MLQ rater scores for


Cohort 1 and 2 across three time points.
Self Other
MLQ rater M SD M SD F df p Partial
level η2
Cohort 1 Coaching First
Time 1 2.93 0.38 2.60 0.30 15.30 1,14 .002 .541
Time 2 2.83 0.43 2.82 0.32 0.02 1,13 .883 .002
Time 3 2.72 0.41 2.98 0.25 10.66 1,10 .010 .542
Cohort 2 Waitlist First
Time 1 2.90 0.47 2.75 0.37 1.17 1,17 .294 .069
Time 2 2.86 0.51 2.87 0.43 1.283 1,16 .941 .000
Time 3 3.05 0.46 3.12 0.26 0.33 1,13 .135 .025
Note: Repeated Measures ANOVA Within Group Comparison of MLQ5I means between Waitlist first group and Coaching
first group at Time 1, Time 2 and Time 3 by rater level. Self=participant, other=all other raters combined.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 125


Doug MacKie

Figure 1: Self-Other Alignment in Mean MLQ5I Transformational Leadership scores


over time for Cohorts 1 and 2.

transformational leadership scores after increase in time for Cohort 2. Their self-
leadership are differentially perceived with ratings on transformational leadership
those higher in the organisation being most remained very consistent between time one
sensitive to change. Finally participants who and two while they were acting as the control
initially overestimate their leadership scores group for Cohort 1. After the coaching had
when compared to all other raters, appear to been received at Time 3, their self-ratings
subsequently reduce their scores in an did increase in line with all other levels
attempt to realign with other raters. This rating their behaviour. Given that the major-
effect may be partially responsible for the ity of outcome studies employ only self-
lack of significant difference in the self- report measures, it is interesting to speculate
ratings of participants over time. how many studies may have shown a signifi-
The lack of changes in self-ratings of cant other-rating change had that data been
leadership behaviour after leadership coach- available. This finding also confirms that self-
ing is unusual and at odds with many of the ratings alone may be an unreliable indicator
previous findings in this area (Grant et al., of change (Kruger & Dunning, 1993) and
2010; Theeboom et al., 2014). There was a prone to under-estimation (Fleenor et al.,
non-significant decline in scores over time 2010). There is related evidence to suggest
for Cohort 1 and a small non-significant that 360 feedback can have the effect of

126 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Who sees change after leadership coaching?

lowering subsequent levels of self-rating as time one and two while they were acting as
the participant’s awareness is raised about the control group for Cohort 1. Again in
how others view them but only if participants Cohort 2, the line manager raters showed
initially overrate their leadership abilities the greatest effect size in their ratings of
(Atwater et al., 2000). Other researchers changes in transformational leadership in
have confirmed that when individuals over- the participants over time. Given that both
rate their leadership behaviour, subsequent Cohorts demonstrated that the line manger
ratings can decrease as a function of greater raters saw the greatest amount of change
insight and feedback (Luthans & Petersen, over time, this seems to be a reliable finding.
2003). This suggests that the other-rater As almost all the managers were also partici-
alignment effect is more powerful that the pants in the coaching research, they could
self-perceived changes after coaching. be especially attuned to the type of changes
However, there were significant differ- in transformational leadership behaviour
ences in how raters at different levels viewed that the participants were being rated on.
the changes in coachee leadership Peers and direct reports also reported signif-
behaviour over time. There were also some icant levels of change in transformational
between cohort differences of note that are leadership but again the effect size was not as
worth exploring. Cohort 1 (Coaching first) great as that of the higher group. Given that
began with a higher self-rating compared self-ratings are prone to a variety of self-serv-
with their manager, peers, direct reports and ing biases that can both promote an inflated
other raters. As outlined above, the self- sense of self-performance and restrict access
ratings of transformational leadership to corrective feedback (Dunning et al.,
behaviour came down after the coaching 2003), this further emphasises the impor-
whilst all other levels of raters increased their tance of the trends in the other rater data.
ratings. The other finding of note in Cohort The third critical finding is that self-other
1 was that the change in rater’s responses misalignment in ratings at Time 1 (in this
over time was differentially perceived with case overestimation in Cohort 1) appears to
change most apparent within raters at the trigger an attempt by the participant to
higher organisational level. Both peers and realign their scores with all others. This
direct reports saw significant positive effect seems more powerful than the coach-
changes over time in the levels of participant ing effect and has the impact of driving
transformational leadership but the effect down self-ratings over time. This is consistent
size was lower than in the higher level. This with a general trend in multi-source feed-
is an unusual finding as previous research back that participant self-ratings become
has suggested that direct reports are the more accurate (that is more aligned with the
most sensitive to change both for their prox- ratings of others) over time as their aware-
imity to the participant and because their ness of the ratings of others increases, (Atwa-
data is based on multiple rather than single ter et al., 2000; Atwater, Brett & Charles,
observations (Atkins & Wood, 2002). An 2007). However, in this case for Cohort 1
alternative explanation is that different rater they are most aligned with other raters at
levels are rating different qualities in the Time 2 and then diverge in the opposite
participant with higher raters rating direction at Time 3 as they continue to
performance criteria whilst direct reports underestimate their scores when compared
are rating relational factors (Nowack, 2009). to all others, possibly due to overcompensat-
The second cohort (waitlist first) did not ing for their initial over-estimation at Time 1.
have such an obvious discrepancy between
self and other raters on the MLQ at Time 1. Practical implications
Their self-ratings on transformational lead- There are a number of practical implications
ership remained very consistent between that can be derived from this study. Firstly it

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 127


Doug MacKie

again questions the veracity of self-report Cohort 2 were 131 and 152 respectively.
and strongly suggests future coaching Thirdly, the absence of a definitive analytical
outcome studies should employ a multi-rater technique in the literature to assess the
format to assess change. Secondly it suggests impact of SOA, (Fleenor et al., 2010) may
that change is perceived differentially by have limited further analysis of the impact of
level within the organisation with those this discrepancy on Cohort 1. Finally the fact
higher in the organisation being especially that the coaching was provided pro bono,
sensitive to change, particularly if those could have impacted negatively on the
raters are also participants in the coaching commitment of the coaches to the coaching
programme This again confirms the impor- process. These effect sizes may, therefor,e be
tance of line manager support and aware- an underestimate of the potential changes
ness of the coaching process and the goals possible. However, this issue may be counter-
therein. Finally this study suggests that the acted by possible positive effects of the
impact of overestimating self-scores when coaches’ participation in the author’s
compared to all others may have the conse- strength-based coaching methodology induc-
quence of driving down scores over time and tion programme. The fact that this study was
this effect may mask the impact of the coach- conducted in a NFP organisation may limit its
ing process that is perceived by other raters. generalisability but the organisation did have
a standard corporate structure and HR
Limitation of the study processes and despite being an NFP, there was
The study employed a non-equivalent a very strong focus on financial accountability
between-subjects controlled design that and evaluating return on investment.
utilised a control group to assess the impact
of a leadership coaching intervention on Conclusion
transformational leadership behaviours. It MSF is increasingly utilised in the evaluation
was not possible to randomly assign subjects of leadership and executive coaching. This
to each cohort as the availability of partici- study confirms its validity as a critical
pants as the logistical needs of the organisa- outcome measure by illustrating that self-
tion took precedence. Despite this report may not always be sensitive to change,
non-randomisation, however, there was no change is perceived differentially within the
significant difference between the two host organisation with different stakeholder
cohorts at Time 1 suggesting the allocation groups reporting different perceptions of
of participants did not unduly influence the change over time and that misaligned SOA
study. However, the between-subjects design can subsequently inhibit leadership self-
only allowed the first Cohort to be fully ratings especially in the case of those who
controlled as at Time 2 when the two cohorts initially over-estimate their leadership capac-
crossed over, cohort one had already had the ity. It confirms the need for coaching
intervention and could no longer function outcome research to focus beyond self-report
as an independent control group. to include the level at which others perceive
Secondly, the participant sample size was change (Barling, 2014). Future coaching
relatively small and the loss of 15 per cent of research needs to routinely incorporate MSF
the participants who dropped out during the as an outcome criterion and analyse results
course of the study, could reduce the general- by level within the organisation to confirm
isability of the study. A larger participant the novel finding that higher raters are more
sample size would help to address this issue sensitive to change. The issue of SOA could
and permit further investigation of the influ- be further explored with the incorporation
ence of coachee variables in coaching of a performance criteria independent of the
outcomes. However, it is worth noting that the multi-rater data to test the effects of poor
total number of other raters for Cohort 1 and SOA on participant performance.

128 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Who sees change after leadership coaching?

The Author Correspondence


Dr Doug MacKie Dr Doug MacKie
CSA Consulting, Email Doug@csaconsulting.biz
320 Adelaide Street,
Brisbane, Australia.

References
Antonakis, J., Avolio, B.J. & Sivasubramaniam, N. Judge, T.A. & Piccolo, R.F. (2004). Transformational
(2003). Context and leadership: An examination and transactional leadership: A meta-analytic test
of the nine-factor full-range leadership theory of their relative validity. Journal of Applied Psychol-
using the Multifactor Leadership Questionnaire. ogy, 89, 755–767.
The Leadership Quarterly, 14, 261–295. Kochanowski, S., Seifert, C.F. & Yukl, G. (2010).
Atkins, P.W. & Wood, R.E. (2002). Self-versus others’ Using coaching to enhance the effects of
ratings as predictors of assessment center ratings: behavioural feedback to managers. Journal of
Validation evidence for 360-degree feedback Leadership & Organisational Studies, 17(4),
programmes. Personnel Psychology, 55, 871–904. 363–369.
Atwater, L.E., Brett, J.F. & Charles, A.C. (2007). Multi- Kruger, J. & Dunning, D. (1999). Unskilled and
source feedback: Lessons learned and implica- unaware of it: How difficulties in recognising
tions for practice. Human Resource Management, one’s own incompetence lead to inflated self–
46(2), 285–307. assessments. Journal of Personality and Social
Atwater, L.E. & Brett, J.F. (2005). Antecedents and Psychology, 77, 1121–1134.
consequences of reactions to developmental Linley, A., Willars, J. & Biswas-Diener, R. (2010).
360-feedback. Journal of Vocational Behaviour, The strengths book. Coventry: CAPP Press.
66(3), 532–548. Linley, A. & Stoker, H. (2012). Technical manual and
Atwater, L.E., Waldman, D.A., Atwater, D. & Cartier, statistical properties for Realise2. Coventry: Centre
P. (2000). An upward feedback field experiment: of Applied Positive Psychology.
Supervisors’ cynicism, reactions, and commit- Luthans, F. & Peterson, S.J. (2003). 360-degree feed-
ment to subordinates. Personnel Psychology, 53, back with systematic coaching: Empirical analysis
275–297. suggests a winning combination. Human Resource
Avolio, B.J. (2011) Full range leadership development Management, 42, 243–256.
(2nd ed.). London: Sage. MacKie, D.J. (2014). The effectiveness of strength-
Barling, J. (2014). The science of leadership: Lessons from based executive coaching in enhancing full
research for organisational leaders. Oxford: Oxford range leadership development. A controlled
University Press. study. Consulting Psychology Journal. Practice and
Bass, B.M. & Avolio, B.J. (1997). Full range leadership Research, 66, 118–137.
development: Manual for the Multifactor Leadership Murphy, K.R. (2008). Explaining the weak relation-
Questionnaire. Palo Alto, CA: Mind Garden Inc. ship between job performance and ratings of job
Dunning, D., Johnson, K., Ehrlinger, J. & Kruger, J. performance. Industrial and Organisational
(2003). Why people fail to recognise their own Psychology, 1(2), 148–160.
incompetence. Current Directions in Psychological Nieminen, L.R., Smerek, R., Kotrba, L. & Denison, D.
Science, 12, 83–87. (2013). What does an executive coaching inter-
Fleenor, J.W., Smither, J.W., Atwater, L.E., Braddy, vention add beyond facilitated multi-source feed-
P.W. & Sturm, R.E. (2010). Self-other rating back? Effects on leader self-ratings and perceived
agreement in leadership: A review. The Leadership effectiveness. Human Resource Development Quar-
Quarterly, 21(6), 1005–1034. terly, 24(2), 145–176.
Grant, A.M., Passmore, J., Cavanagh, M.J. & Parker, Nowack, K.M. & Mashihi, S. (2012). Evidence-based
H.M. (2010). The state of play in coaching today: answers to 15 questions about leveraging 360-
A comprehensive review of the field. International degree feedback. Consulting Psychology Journal:
Review of Industrial and Organisational Psychology, Practice and Research, 64(3), 157.
25, 125–167. Nowack, K.M. (2009). Leveraging multi-rater feed-
Harter, J.K., Schmidt, F.L. & Hayes, T.L. (2002). back to facilitate successful behavioural change.
Business-unit-level relationship between Consulting Psychology Journal: Practice and Research,
employee satisfaction, employee engagement, 61(4), 280.
and business outcomes: A meta-analysis. Journal Page, N. & de Haan, E. (2014). Does executive coach-
of Applied Psychology, 87(2), 268. ing work? The Psychologist, 27(8), 582–586.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 129


Doug MacKie

Smither, J.W., London, M., Flautt, R., Vargas, Y. & Theeboom, T., Beersma, B. & van Vianen, A.E.
Kucine, I. (2003). Can working with an executive (2014). Does coaching work? A meta-analysis on
coach improve multi-source feedback ratings the effects of coaching on individual level
over time? A quasi-experimental field study. outcomes in an organisational context. The Jour-
Personnel Psychology, 56, 23. nal of Positive Psychology, 9(1), 1–18.
Smither, J.W., London, M. & Reilly, R.R. (2005). Does Woo, S.E., Woo, S.E., Sims, C.S., Rupp, D.E. &
performance improve following multi-source Gibbons, A.M. (2008). Development engage-
feedback? A theoretical model, meta-analysis, ment within and following developmental assess-
and review of empirical findings. Personnel ment centers: Considering feedback favorability
Psychology, 58(1), 33–66. and self-assessor agreement. Personnel Psychology,
Tabachnick, B.G. & Fidell, L.S. (2007). Using multi- 61(4), 727–759.
variate statistics (6th ed.). London: Pearson.

Special Group in Coaching Psychology (SGCP)


UK Co-ordinating Editor for the
International Coaching Psychology
Review (ICPR)
Editor for The Coaching
Psychologist (TCP)
The SGCP is seeking to appoint at least two Chartered Members of the
British Psychological Society who are Coaching Psychologists with a PhD
or Professional Doctorate and have experience in both research and
practice to take on the role of UK Co-ordinating Editor for the ICPR and
Editor of TCP from 1 December 2015. Both publications focus on the
theory, practice and research in the field of coaching psychology. The role
of the Editor involves managing and developing the publications in line
with the SGCP strategic plan. The roles will start on 1 November 2015
with a shadowing period, before fully taking over the role on
1 December 2015.
For further information and a Statement of Interest form,
please contact Annjanette Wells, Member Network Manager, at
Annjanette.Wells@bps.org.uk or call 0116 252 9515 between
10.00 am and 3.00 pm.
Completed forms and documentation should be received by
Friday 2 October 2015.

130 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious,
Competent, Confident, and Congruent:
A Grounded Theory of Group Coaching
and Authentic Leadership Development
Tony Fusco, Siobhain O’Riordan & Stephen Palmer

Introduction: This paper explores and merges two important fields of coaching; Group Coaching and
Authentic Leadership Development (ALD). It develops a theory of group coaching and builds this into a
conceptual and evidence-based method of ALD.
Design: Four authentic leadership coaching groups were conducted over an 18-month period. Each group
consisted of five or six senior leaders and were run once a month over a three-month period. After a three-
month gap, recorded semi-structured interviews were conducted with all participants to capture the learning
and behaviour change that these leaders had experienced as a result of the group-coaching programme.
Results: A Grounded Theory approach was applied to the analysis of monthly diary and final interview data
which resulted in a two-part theory. Firstly, how the process of a group-coaching approach to ALD works, and
secondly, what the output of this approach is in terms of individual leadership. A model was developed
comprising four core concepts of authentic leadership along with seven sub-categories of key leadership skills.
Conclusion: This research brings together the two key areas of group coaching and leadership development
and contributes to the field of leadership coaching by offering both a model and a method of ALD.
It offers an underpinning theory of each and introduces a model of authentic leadership based on the core
concepts of conscious, competent, confident and congruent leadership.
Keywords: leadership coaching; group coaching; coaching psychology; leadership development; authentic
leadership; executive coaching; grounded theory.

Why the need for Authentic Leadership in the 21st century?

E
ACH ERA has its own leadership theory scandal and more recently, in 2008, the
that develops in response to the needs financial services firm Lehman Brothers
of the time and the interests of both went bankrupt after hiding $50bn of toxic
practitioners and researchers, and the lead- loans. Once again aided by their auditors
ership theory of our epoch is Authentic Ernst Young, this resulted in the biggest
Leadership (Avolio & Walumbwa, 2014). To bankruptcy in US history (www.accounting-
get some sense of why this may be, we need degree.org). These high profile examples of
only to briefly review some 21st century corporate management may well have
business governance so far. contributed to the keen interest now being
The high profile corporate scandals taken in Authentic Leadership, by both prac-
started in 2001 with Enron’s joint CEO’s titioners (George & Simms, 2007) and
taking the corporation to bankruptcy with a researchers (Avolio, Luthans & Walumbwa,
shareholder loss of $74bn. Their accounting 2004).
firm Arthur Anderson was also found guilty This interest has led to scientific develop-
of misrepresentation which led to the loss of ment of the construct of Authenticity
85,000 of their own jobs. A year later the tele- (Kernis & Goldman, 2006, and Avolio et al.,
coms giant WorldCom inflated company 2004) but as yet there has been no research
assets leading to 30,000 job losses and an into understanding how leaders develop
$180bn loss. The following year saw the Tyco authenticity or authentic leadership. That

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 131


© The British Psychological Society – ISSN: 1750-2764
Tony Fusco, Siobhain O’Riordan & Stephen Palmer

was the aim of the research reported here. models of Authentic Leadership that were to
Firstly, we set out to develop a theory of how come, and today many of the current defini-
authentic leadership is developed, and tions of Authentic Leadership have their
secondly, to understand in what way that roots in this work.
translated into leadership skill. Firstly, let us
consider the roots of the concept of authen- Authentic Leadership?
ticity and how this relates to authentic lead- Avolio, Luthans and Walumbwa (2004)
ership. describe Authentic Leaders as ‘individuals
who know who they are and what they think and
Authenticity are perceived by others as being aware of their own
The word itself authentes or authento trans- values, moral perspective, knowledge and
lates into variations around the theme of strengths’ (p.4). Walumbwa et al. (2008)
being self-made reflected in the definition define authentic leadership as ‘a pattern of
given to it by various Western philosophers. leader behaviour… of greater self-awareness, an
Kierkegaard (1846), for example, talked internalised moral perspective, balanced processing
about being the true-self one was meant to be of information, and relational transparency’
and not following the lead of the crowd. (p.94). This second definition builds on the
Heidegger (1927) of not living immersed in Kernis model of Authenticity described
the ‘They’ and Sartre (1966) described it as above and was developed by Walumbwa and
the absence of self-deception. More recently, associates (2008) as a four-component
Brumbaugh (1971) describes authenticity as model of Authentic Leadership as a higher-
the ability to make individual choices and to order, multidimensional construct. This was
take responsibility for them and Harter then validated and operationalised through
(2002) as owning one’s own experience of their Authentic Leadership Questionnaire.
thoughts, emotions and beliefs. Here one
can see the seeds of the definition by Kernis The need for a research-based approach
(2003) that paved the way for the recent to the development of Authentic
scholarly work on authenticity, and who Leadership
describes it as ‘the unobstructed operation of There is a growing body of research clearly
one’s true or core self’ (p.1). It was Kernis and demonstrating the organisational benefits of
Goldman (2006) who developed a multi- Authentic Leadership (Table 1). Ratings of
component construct of Authenticity which Authentic Leadership have been shown to
in turn laid the foundation for the models of positively relate to a broad range of vital
Authentic Leadership we discuss later. They business factors, for example organisational
argue that authenticity is made up of four climate and commitment, communication
related but separate components: awareness; and knowledge sharing, job-satisfaction and
unbiased processing; behaviour; and relational work engagement, even individual, team and
orientation. Awareness – relating to the self- overall company performance and produc-
knowledge of one’s own emotions, cogni- tivity. This growing research evidence under-
tions, beliefs and motives. Unbiased processing scores the importance of understanding how
– meaning accuracy and objectivity with we develop Authentic Leadership and indi-
regards positive and negative self-relevant cate the importance of providing an
information. Behaviour – based on the previ- evidence-based method of Authentic Lead-
ous two and, therefore, genuinely self- ership Development (ALD). This research
congruent, and a Relational orientation – represents one such attempt. But before
characterised by openness, honesty and discussing a scientific approach to ALD
sincerity in one’s relations with others. This specifically, let us consider the science of the
framework laid the conceptual foundation leadership development market more gener-
for the scientifically developed and validated ally.

132 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

Table 1: Authentic Leadership outcome research.

Authors Focus of Research


Clapp-Smith, Vogelgesang & Avey (2009) Trust in leadership
Wong & Cummings (2009) Trust in leadership
Walumbwa, Hartnell & Christensen (2011) Communication climate and knowledge sharing
Jensen & Luthans (2006) Follower job-satisfaction and organisational
commitment
Giallonardo, Wong & Iwasiw (2010) Follower citizenship and work engagement
Wong, Laschnger & Cummings (2010) Follower citizenship and work engagement
Wong & Cummings (2009) Follower job performance
Walumbwa, Luthans, Avey & Oke (2011b) Group creativity
Hannah, Walumbwa & Fry (2011) Team productivity
Toor & Ofori (2009) Psychological well-being
Hmieleski, Cole & Baron (2011) Overall company performance

It is estimated the US spend over $10bn when investing in their own leadership
a year on leadership development development. He also considers however,
(O’Leonard, 2010). However, there exists that leadership development being one of
very little research into the field of leader- the least researched areas within the science
ship development (Avoilio & Luthans, 2006; of leadership, actually offers the field an
Day, 2009) and even less into ALD specifi- opportunity ‘…this omission is a huge opportu-
cally (Avolio, 2014). Day, Harrison and nity for creating and validating what we have
Hapin (2000) note that most leadership called authentic leadership development models
development research does not actually and methods’ (p.722). Concluding that lead-
investigate whether the leader changes in ership development interventions based on
terms of their thinking about leadership or well-validated models and methods will
their style of leadership. Yukl (2006) also provide a more authentic basis for develop-
criticises the field for a lack of interventions ing authentic leaders.
actually based on a theory-led process of We believe the research presented in this
leadership development. It is curious that paper offers such an authentic basis for lead-
such a large market has grown historically on ership development in that it represents the
such little theoretical or empirical evidence. first attempt to develop an evidence-based
Avolio (2009) believes this area to be one and empirically supported model and
of the most important frontiers in both the method of ALD.
science and practice of leadership. He says
‘the way we are currently developing leaders in Method
most organisations is typically accidental, by luck The research method used in this study was
and happenstance’ (p.722). He calls for scien- Grounded Theory (Glaser & Strauss, 1967)
tists involved in the field of leadership devel- which was chosen because the aim of the
opment to work with leaders to help them research was to develop a conceptual model
become more practitioner-scientists. That is, of ALD. Glaser and Strauss developed
to understand what constitutes research- Grounded Theory as an approach to gener-
driven and evidenced-based practice, allow- ate new theory as opposed to the more typi-
ing them to make more discerning choices cal scientific approach designed to test

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 133


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

existing theory. Although a qualitative values and beliefs and how these in turn
method of research, the original method of translate into their leadership principles and
Grounded Theory developed by Glaser and philosophy. After presenting their ‘story’
Strauss rests firmly on a positivist epistemol- they are then asked questions by each group
ogy. The assumption is that sociological and member in turn who have been given rudi-
psychological relationships exist objectively mentary tuition in the principle of coaching,
in the world and are waiting to be discovered that is, open questions, challenges, observa-
through the systematic investigation of data. tions and feedback being permissible but not
An investigation that involves the systematic advice-giving. The role of the group is to
coding and categorising of the data and help deepen the individuals thinking about
identifying causal relationships between their leadership career to date and the
them, allowing new theories to emerge lessons they have derived from it.
directly from that data rather than trying to
force extant theory onto it. There is Day 2: The Present
currently very little evidence base in the liter- Between the first and second day each indi-
ature about either group coaching or actual vidual receives a personality profile that gives
methods of ALD so the aim of this research them an insight into their Temperament and
was to bring the two together in a systematic how this informs their leadership approach;
manner and to try and understand both the Tactical, Logistical, Strategic or Diplomatic
process and the outcome of this form of (Keirsey, 1998). They present a synopsis of
ALD. It was for this reason that the their reports to the group sharing examples
Grounded Theory method was deemed from their leadership practice. Once again
appropriate for this research. It should be the coaching by the group is designed to
noted however, that where data was clearly help the individual reflect on their leader-
and consistently pointing towards an existing ship through this conceptual lens and raise
concept or idea we included this to help with their awareness of their strengths, weak-
theoretical coding, for example, the ideas of nesses, blind-spots, etc.
Group Cohesion (Yalom, 1995) and Psycho-
logical Safety (Schein, 1993). This is a tech- Day 3: The Future
nique endorsed by Glaser (2005) at the Before day three each person is asked to
advanced coding stage as it can add explana- undertake a behavioural task or experiment
tory power and assist in theoretical integra- that will help their growth as a leader based
tion (Birks & Mills, 2011). on the discoveries of day one and two. Once
again they are coached through this experi-
Procedure ence by the group. Finally they are asked to
The coaching approach used in this research synthesis everything they have learnt and are
was a group coaching format where selected asked to consider how they want the future
senior leaders came together to form an of their leadership to look, what they want to
Authentic Leadership Coaching Group facil- achieve and what legacy they want to build.
itated by the author. The format of the The groups convened one day a month
coaching was as follows. over a three-month period and the data
presented in this report is based on the
Day 1: The Past output of four groups run over an 18 month
After introductions and group contracting period, with a total of 21 participants. The
each participant is asked to draw an in-depth data comes from two sources. Firstly, a
lifeline detailing the significant events that monthly Reflective Log that was sent to each
they believe formed and informed their lives participant within one week of day one, two
to date. They are asked to share how they and three respectively. These were unstruc-
believed these events had shaped their tured and participants were asked to record

134 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

their personal experience of each day. they may have experienced during their
Secondly, recorded interviews took place careers.
three months after the last session. These
were semi-structured interviews based on Results
three levels of evaluation often used in Figure 1 illustrates the conceptual model
corporate Management and Leadership that emerged from this research. The model
development interventions: 1 – Learning; is split into two sections, the process and the
2 – Behaviour Change; and 3 – Performance outcome, and data analysis from each will be
Improvement (Kirkpatrick, 1975). looked at in turn as it came from different
sources, the Reflective Logs and the
Participants recorded interviews.
Purpose sampling was used to select poten-
tial participants, all of whom were inter- The process
viewed by the author prior to being invited The Reflective Logs were analysed as soon as
to join a group. Inclusion criteria for partici- they were received a week after each session.
pation in a group included: Log instructions were kept unstructured so
l A motivation to explore themselves and as not to lead the participants reporting in
their personal approach to leadership. any particular direction, that is, they were
l The ability to access and articulate their asked simply to report on any personal
own inner thoughts and emotions. insights or observations they made during
l The ability to offer others sensitive and the session. As each line was then coded it
constructive feedback. became apparent these real-time logs were
l The ability to accept feedback from producing an on-going narrative of how the
others constructively. group work was evolving for the participants.
The sample population were all senior lead- What the key factors were for them and how
ers from within private and public organisa- they were reacting to them. For example, it
tions and they had all worked with the became apparent very early on that the
author previously as either a coaching client social structure of the group was a positive
or a leadership training delegate. On this thing as illustrated by emerging codes such
basis they were assessed and deemed appro- as, positive anticipation and the witnessing of self
priate candidates for the intense nature of and others. These were in turn abstracted into
the work that small group coaching entails. a category of – Group Cohesion. This cohe-
A wide variety of sectors and industries were sion in turn led to a feeling of personal secu-
represented including; Energy, Manufactur- rity that enabled participants to actively
ing, Finance, Professional Services, Health engage in the process, as demonstrated by
and Social Care. Typical leadership roles the emergent codes of emotional support and
held by participants included; Chief Execu- normalising, which contributed to a second
tive, Managing Director, Head of Engineer- process category of – Psychological Safety.
ing, Head of Safety, Head of Quality, Head of These conditions then allowed participants
Commercial Services, IT Director, HR Direc- to undertake the self-exploration and learn-
tor, Area Manager and Business Manager. ing that was key to the group coaching and
N=21: Male=12, Female=9. Age: 37 to 56. illustrated by such codes as: exploring motiva-
All of these were robust and healthy indi- tions; emotional exploration; unexpected self-learn-
viduals who were given a full briefing as to ing; expanding awareness; taking stock; and
what to expect in a group coaching format, taking control. These codes then became the
which had the requisite British Psychological categories of; Self-Reflection and Self-Explo-
Society ethical approval, and the fundamen- ration; Self-Learning and Re-Learning; Self-
tal differences they were to expect from the Reappraisal and Realignment.
more usual forms of leadership development

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 135


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

Figure 1: Model of Authentic Leadership Development.

136 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

The process of change with the result that each group gelled very
The active processes involved in change quickly which was imperative in this time
within the group coaching process appeared limited intervention. Most important of all,
to be split into two categories of: Group this sense of cohesion facilitated the next key
Conditions; and Group Process. Group Condi- step in the overall process, and our next cate-
tions in turn consist of two sub-categories; gory of Psychological Safety.
Group Cohesion and Psychological Safety, as
illustrated in Figure 2. In-vivo examples:
P3 – ‘The easy going format generated good team
Group Cohesion spirit from the outset. The highly participative
Properties: Positive Anticipation/Positive sessions worked well and enabled people to ‘bed in’
Experience/Being Witnessed/Witnessing Others to the event.’
Group Cohesion seemed to be the P2 – ‘Yet again, the group session was incredibly
bedrock upon which all further individual supportive, enlightening and very encouraging.
and group work was to take place. This has This, in itself, is one of the tremendous features of
already been recognised as an important the programme.’
component of successful group-psychother- P11 – ‘Great to meet, gain understanding of,
apy (Burlingame, Fuhriman & Johnson build a level of trust and achieve a degree of cama-
2001; Drescher, Burlingame & Fuhriman, raderie within the group.’
2012; Yalom, 1995). It seems likely that this
condition was successfully and consistently Psychological Safety
fostered by the use of purposive sampling. In Properties: Emotional Support/Feeling Safe/
almost complete contrast to Randomised Normalising
Sampling, this method selects participants If cohesion is the group’s bedrock then
on quite explicit inclusion criteria explained psychological safety is the individuals. Again,
in the Procedure section above. What might this phenomena is already accepted as an
be considered as an inherent bias in this important factor within group therapy
method of subject selection actually (Rogers, 1951), but we are now also coming
contributes to its efficiency (Tongco, 2007), to understand its potential importance in

Figure 2: Group Conditions.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 137


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

group coaching as well (Fusco, O’Riordan & Self-Reflection and Self-Exploration


Palmer, 2014). From the examples below we Properties: Questioning oneself/Exploring
get a sense of what this actually means to Motivation/Emotional Exploration
participants. The first stage of the group process is that it
facilitates an individual’s introspection. If
In-vivo examples: group-cohesion and psychological safety
P9 – ‘Felt ‘safe’ in divulging my life story. I soon have been successfully established it appears
realised we were all in the same boat and quickly the individuals are then prepared, willing
felt comfortable and easily able to be open.’ and able, to undertake deep reflective think-
P17 – ‘I felt that the participants worked well ing. This is best illustrated by some in-vivo
together and we soon felt happy sharing our data.
thoughts and views.’
P4 – ‘I think the group itself gelled very well and, In-vivo examples:
therefore, it gives, for me, a comfortable environ- P8 – ‘On reflection I find myself asking the ques-
ment to be honest and explore.’ tion ‘Who am I?’This is drawing upon my new
found self-awareness and looking inwards and
The Group Process searching for values, meaning and self-identity.’
Strictly speaking this is the sum of the partic- P22 – ‘I look forward very much to the next session
ipant’s individual process, so we abstract it as a way of thinking a bit deeper about some of my
out and talk of it as an overarching group- past professional and personal experiences.’
process. These three properties of the group P19 – ‘Had a strong but very positive sense of
process are all interlinked and appear to being in uncharted territory.’
represent a hierarchical process as described
below and outlined in Figure 3.

Figure 3: Group Process and Group Conditions.

138 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

Self-Learning and Re-Learning In-vivo examples:


Properties: Self-Understanding/Unexpected Self- P20 – ‘Being part of this Group is proving to be
learning/Expanding Awareness very inspiring and motivating. It’s influencing the
Following reflection and exploration come way I approach, not just leadership but many
varying degrees of furthered self-insight and aspects of my life.’
learning. This can take many forms includ- P10 – ‘The process of investigating my own
ing intra-personal learning, both cognitive values, personality traits and temperament, and
and emotional, and inter-personal learning, then directly linking these to a personal reference
both behavioural and relational. Some of for authentic behaviour, has had a deeply motivat-
these insights appear genuinely new to an ing influence on me.’
individual and some appear as if they are P6 – ‘It encourages you to focus on your own
being re-learnt having been once forgotten authenticity and gives you courage and confidence
or otherwise put from everyday conscious to think and do things in your own way. It’s
thought. Again, we get an insight into this having a profound and constant effect on my
learning from in-vivo data. everyday thoughts and approach to life.’

In-vivo examples: Authentic Self-Development


P5 – ‘A strange but clear realisation that either, This research seems to demonstrate that
I’ve changed or been trying to fit into a style that Authentic Self-Development is either a
perhaps wasn’t really me. Very enlightening to necessary precursor or an integral element
realise how comfortable your own authentic style of Authentic Leadership Development. This
can be. Feels a bit like re-learning a language you would seem to make sense as to be true to
once knew.’ oneself in the pursuit of leadership, would of
P14 – ‘After the first day I had a long think about course mean having a genuine understand-
me as a person not just as a manager. However it ing of that true self. The road to such under-
did make me realise that how I am as a manager standing can take many forms but the group
is very much also mirrored in how I am as a coaching described here seems to be one
person.’ particularly potent approach. This is possibly
because identity is often considered to be
Self-Reappraisal and Realignment something that we find reflected back to us
Properties: Self-Management/Taking Stock/ from others, or that we find in comparison
Taking Control and contrast to others. This is something we
The final group process and one that seems explore further in the Discussion.
predicated upon the previous two is a signif-
icant internal shift that seems to represent a The outcome of change
‘self-recalibration’. This takes place first The second part to the model focusses on
internally as an adjustment to how individu- seven key outcomes that emerged and the
als see the world and themselves within it, four Core Concepts of our proposed model of
which is then invariably followed by external Authentic Leadership that encapsulates them.
and overt changes. These cover a broad Recorded semi-structured interviews
spectrum of behavioural and relational were undertaken with each participant three
changes but they represent a natural change months after the last group session to assess
based upon the reflection and learning that the outcome of the group coaching. The
has taken place prior to this stage. So what interviews were based around three levels of
individuals appear to achieve is significant evaluation typically used in corporate learn-
and enduring psychological, emotional and ing and development that evaluate; Learn-
behavioural development that remains long ing, Behaviour Change and Performance
after the group-intervention has concluded. Improvement. The rationale for using this as

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 139


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

Figure 4: Authentic Self-Development.

a form of evaluation is that it focusses the Category 2 – Management Mindfulness –


interviewee on linking their learning from considered and deliberate execution of manage-
the group coaching to actual behaviour ment duties. This category indicates a more
change and linking this in turn to improved thoughtful approach to the functional task
performance or business benefit. Within of management. One example might be
each of these three categories interviewees thinking more carefully about a task of dele-
reported on anything they considered rele- gation. Not just what to delegate, but to who
vant. Transcription and coding of the inter- and why and how?
views generated seven categories that are P18 – ‘I’ve created an atmosphere and a situation
presented and defined below. We have where I’m able to do a much better quality of think-
chosen to give each category a definition ing and delivering that part of my job. So the
based on its main properties to make them fundamental quality of thought process and
more descriptive and theoretically dense. output is just better.’
P8 – ‘I’m not sure how much my behaviour has
Category 1 – Self-Understanding and Self- changed yet but certainly how I go about things in
Management – self-awareness that fosters greater my head has changed, so I would hope in the
self-control and mastery. This category indicates coming months and years people will be able to see
increased cognitive, emotional and motiva- this in improved performance.’
tional awareness. It also includes an increase
in the effective self-regulation in each of Category 3 – Understanding of Others –
these domains that such understanding can appreciation and understanding of the styles and
engender, for example, gaining greater behaviours of others. This category indicates a
insight into established behaviour patterns greater understanding of a leader’s interper-
or potential alternatives. sonal domain. This may include colleagues
P12 – ‘I think there have been some significant and clients but is particularly pertinent to
changes really which I don’t think will change the people they lead.
because it hit deeper. It feels very personal and it P13 – ‘It dawned on me that there is a place for all
showed me something personal about me and how of those different styles and that one is not neces-
I lead.’ sarily better than the other. I guess in the past I
P3 – ‘I think I feel more confident about my own made the assumption that everyone functions in a
ability and more calm. I can’t really think of a pretty similar way.’
better word to describe it, but less worried and more P22 – ‘I now recognise that a breadth of humanity
in control I guess.’ can be successful in managing information or

140 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

Figure 5: Sub-Categories.

delivering outcomes. I knew this hypothetically but teaching new management skills as such, it
to be confronted with it with other people was appears the process of deep self-reflection
another thing altogether.’ removes intrinsic blockers that in turn
enables an individual to engage more fully
Category 4 – Flexible and Effective Interac- and effectively in their work.
tions with Others – ability to adapt to the styles P9 – ‘Looking back I thought I was doing a
and behaviours of others. This category is the phenomenal job before but I think this has now
operationalising of the previous category. It taken things to a completely different level and has
is when an individual takes new understand- been hugely beneficial for me and those around me.’
ing of their interpersonal domain and uses P1 – ‘My boss has talked about me being her
this to inform new and more effective ways of successor and actually, now from a behavioural
communicating and relating to others. change point of view, I kind of see that as a
P15 – ‘I’m trying to change the way I interact with distinct possibility. I still think there’s a number of
people, a bit less phone and a bit more going out. hurdles that would have to be overcome but I don’t
I’m trying to invite people to talk to me on an see them now as absolute blockers. Actually, now I
emotional level if that’s what’s important to them.’ see them just as hurdles that can be got over by my
P8 – ‘I now understand that relationships are the own performance.’
glue that holds people together and are instrumen-
tal in creating a shared purpose.’ Category 6 – Leadership Confidence and
Clarity – confident and focussed leadership. This
Category 5 – Leadership Capacity & Proac- category indicates a more purposeful
tivity – active and resilient approach to leadership approach to the role of leadership itself,
responsibilities. This category indicates an when individuals are beginning to look less
increase in an individual’s ability to manage at the technical management aspects of their
their workload and also an increase in role and more assuredly at the point and
resilience as they do so. Without actually purpose of their own leadership.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 141


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

P16 – ‘I’m much clearer of why I’m doing what Self-understanding and Management Mind-
I’m doing. I am much, much clearer on what fulness. Competent leadership would involve
I need to do to be successful in the leadership role Effective Interactions with Others and Lead-
I’m doing, both in terms of my own team and also ership Capacity and Proactivity. Congruent
in terms of support to my own leadership team.’ leadership would include Self-understand-
P12 – ‘I’m much clearer on personal leadership ing and Self-management and Confident
and responsibility than I ever was before which leadership would include Leadership Confi-
makes it much easier to enjoy the positive and more dence and Clarity but also Strategic Leader-
challenging aspects of the day’s work.’ ship. These can be summarised as a:
Competent leader that is skilled and abled; a
Category 7 – Strategic Orientation – broad Confident leader that is assertive and self-
and long-term focus on strategic leadership goals. assured; a Conscious leader that is deliberate
This category indicates an increased capacity and intentional; and a Congruent leader
to turn the previous category into strategic that is clear and consistent.
action. It is taking an increase in leadership
confidence and clarity of purpose and trans- Discussion
lating it into important long-term goals. The The theory of ALD group coaching
group coaching offers no training in strate- described above offer us two main areas for
gic thinking or planning but, as with the discussion. Firstly, we will discuss the process
others categories this is one that emerges of change facilitated by the group coaching
clearly and consistently. and secondly the output of change achieved
P14 – ‘I think how I manage my staff now is by this coaching format.
better… which means I have a lot more time to do
the corporate stuff that I avoided a bit. It all frees The process of change
me up to do the strategic stuff, spending time doing In conducting this research with four groups
the looking-up stuff rather than the organising- over 18 months it is our view that the effec-
down stuff.’ tiveness of the group coaching approach to
P6 – ‘I started to form the new team of which I am ALD is due, in large part, to the opportunity
a member and said – let’s really get the strategy it affords participants to work on the devel-
right in terms of what we are here to do. Let’s get opment of an authentic self within a social
the programme and schedule of activities right so context. Firstly, we argue that if an individ-
we know what steps we’re going to take to deliver ual’s goal is to be an authentic leader it is
that strategy and then let’s put in place the right safe to presume this must be predicated
machinery, behaviours and culture to deliver those upon an authentic self. Secondly, if this self is
activities to drive that strategy.’ formed in contrast and comparison to others,
as argued in social psychology, it is its social
Developing and synthesising the above cate- structure that makes the group coaching
gories it became apparent that they relate to process unique. This is certainly an aspect
each other in various ways. For example, an the participants appear to value according to
increased understanding of others can help such feedback as – ‘you learn about yourself
an individual interact more effectively with from others’, ‘there’s a significant impact from
them. An increase in leadership clarity and learning about others impressions of you’, ‘I felt
confidence can in turn improve strategic validated by the other participants’ and ‘others
leadership. On this basis we propose a made me believe I was worthy as a leader’.
further level of abstraction to just four core The scientific study of the ‘self’ began
concepts within Authentic Leadership, with James (1890) who introduced two key
presented in Figure 6. For example, a different aspects of the self; both as subject
Conscious approach to leadership we and object, self-as-knower and self-as-known.
suggest would include both sub-categories of This refers to the unique human capacity for

142 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

Figure 6: Core Concepts of Authentic Leadership.

reflexive thinking allowing a person to take neously, that represent its unique active
their own self as the object of conscious ingredient. If it is the case that self-construc-
thought and attention. This may be some- tion is wholly or partially rooted within inter-
thing fundamental to the success of almost personal processes (Hoyle, 1999; Markus &
any form of self-development, but the appar- Cross 1990), then it would follow that the
ent efficacy of the group coaching approach self-reappraisal and realignment that takes
to authentic self-development suggests there place within ALD group coaching is also
is something in it that adds to this process of facilitated by this interpersonal context.
self-reflection. Something that is an added Mischel and Morf (2003) suggest that
feature or facet present within the group construction of the self-system takes place as
format over and above the more usual dyad a person interacts with their social world and
coaching. One possible theory we propose is that during this life-long process ‘…identity,
that this form of coaching affords partici- self-relevant goals, values…are built, maintained,
pants the opportunity to work in parallel promoted and protected’ (p.29). Such identity,
with both their intra-personal self and their goals and values are, of course, all key
inter-personal self. elements in the development of both an
A contemporary and emerging explana- authentic self and an authentic leader.
tion of the concept of self, one that seems to Along with James other Social theorists
be generating some consensus, is that the self have introduced ideas that may provide
operates at two simultaneous levels and is further insight into the social functioning of
both an organised dynamic cognitive-affective- the coaching group. For example, the theory
action system and an interpersonal self-construc- of Symbolic Interactionism (George Mead
tion system (Mischel & Morf, 2003, p.23). This 1934), argues ‘…it is at the level of human inter-
would support the idea that it is the group action and interpersonal relationships that the
participant’s ability to operate in both of fabrication of the self arises’ (Elliot, 2008, p.29).
these domains, interchangeably and simulta- The idea is that the self is fluid not fixed and

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 143


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

is a project that the individual actively builds them as individual leaders. It is an opportu-
and develops throughout their biographical nity rarely afforded in most leadership devel-
trajectory in the social and interpersonal opment interventions. To reflect on and
context in which it is embedded. If the self is discuss, their past, present and future
not fixed and is actively constructed within a domains in a focussed and facilitated envi-
social context, then the coaching group may ronment often has profound impact. This
be a particularly fertile environment for such may well also be the case in a two-way conver-
personal change and development to occur, sation with a companion, colleague or
where an authentic sense of self can be coach, but if we do indeed find ourselves,
explored, reappraised and realigned. even partially, in comparison and contrast to
Another idea of potential use is the others, then to have these discussions in the
concept of the reflected-self introduced by presence of others can be quite literally self-
Cooley (1902), who coined the term ‘the changing.
looking-glass self’. Cooley also believed that
the self develops in the social environment The outcome of change
in which it is embedded. He argued that the The tangible performance-based output
whole concept of self cannot be separated generated by the group coaching is cate-
from social influences and that the self is gorised under our four proposed core
actually built by assimilating and reflecting concepts of Authentic Leadership;
the appraisals of others. In Cooley’s view, a Conscious, Competent, Confident and
person incorporates into their own self- Congruent. Within each of these are seven
concept, the observations they make of other categories which we shall review here. The
peoples view of them, and they develop a self first consistent and emergent category we
that is congruent with those views. Should look at is Strategic Orientation which reflects
this be the case, then this would further the increased capacity for strategic leader-
explain why the social and interpersonal ship reported by many participants. This,
nature of the coaching-group helps partici- despite the fact that at no point in the
pants re-evaluate and re-calibrate their self- process, were participants exposed to any
concepts. teachings in strategy or strategic thinking.
The structure and format of the group We have observed that, rather than skill
coaching encourages a breadth and depth of development, it seems that the group coach-
personal feedback absent from most leader- ing effectiveness lies in its ability to remove
ship development training including one-to- obstacles to actual skill deployment. This
one coaching. As Yalom (1995) asserts about supports the fundamental coaching tenet
group psychotherapy, it is one thing to try that insights, skills and solutions very much
and deny the group leaders feedback, as they reside in the individual and it is a case of
are the ‘hired help’, but it is very difficult to helping them access these resources. This is
deny direct feedback from a group of peers also witnessed in the next category of Leader-
that have no other agenda than to help you ship Capacity and Proactivity. The process
increase your own self-learning and aware- seems somehow to increase an individual’s
ness. In Cooley’s terms, it must be extremely reserves and resilience. Many participants
difficult to sit opposite five other looking report taking on much more work yet feeling
glasses and deny their reflections, particu- even more positive and in control at the
larly if they are coherent and consistent. same time. We suggest that this category is
Consistent feedback on the process predicated on the category of Leadership
clearly indicates that group participants Confidence and Clarity. Participants report
greatly value the opportunity to sit down and considerable surges in confidence as a result
discuss, on a deeply personal level, matters of the group work. They feel confident to
that have a relevance and resonance with take on increased responsibilities and

144 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

appear to do so with a much greater clarity is relative and not absolute and, therefore,
of the purpose of their leadership role. This assume it is something that can be devel-
is related to the category of Management oped. Thirdly, we assumed that coaching,
Mindfulness in that it appears to engender a and specifically group coaching, might be
more focussed and deliberate approach to one possible way to achieve this growth in
their management duties generally. The personal and authentic leadership. Although
process also seems to achieve change that the research was designed and undertaken
positively impacts on how individuals work with all of these assumptions in the back-
with their colleagues, in terms of Increased ground, it is important to state that the work
Effective and Flexible Interactions and an in the foreground was clear of assumptions
Improved Understanding of Others. They on what may be found. Indeed, this is why a
report having much greater understanding Grounded Theory approach was chosen, to
of colleague’s behaviours and motives which discover only theory that both emerged from
in turn gives them more tolerance and flexi- and was grounded in the data (Willig, 2008).
bility in dealing with them. Finally, we come There was no idea if group coaching would
to the category of Self-Understanding and Self- actually help develop authentic leaders and
Management that perhaps underpins all of if it did, there was no idea of how it would,
the above and bring us back to the ancient but we believed from a positivist stance that
admonition suggested to guide Authentic if it did, Grounded Theory would uncover
Leadership Development – ‘know thyself’. both the what, and the how.
This reflects the depth of self-relevant work Two limitations that could be addressed
described above and the increases in effec- are the use of sampling and generalisability.
tive self-regulation which this allows. All of The intense nature of small group coaching
these categories manifest in different means it is not a suitable method of develop-
constellations and to different degree within ment for everyone. In large classroom style
each individual. However, the seven cate- leadership programmes a delegate can
gories account for all of the behaviour participate as much or as little as they wish.
change and performance improvement that This is not the case in small group coaching
resulted in the 21 leaders participating in the where each participant has to engage in the
group coaching and can be encapsulated in process in a full and frank manner. If one
our proposed over-arching model of Authen- individual refuses to participate, this would
tic Leadership, that is; Conscious, Compe- inevitably have an adverse impact on the
tent, Confident and Congruent leadership. work the rest of the group can do and the
whole process would break down. This
Assumptions, limitations and means participants have to be chosen in a
recommendations careful and considered manner which in
If what you discover depends very much on turn makes generalisability all but impossi-
what you are looking for (Dey, 1999), it is ble. However, this does mean the group’s
important in the name of researcher reflex- eventual composition creates the two funda-
ivity to make explicit some of the assump- mental group conditions that form the foun-
tions that guided this research. A first dation of our entire model – Psychological
assumption is that Authentic Leadership is Safety and Group Cohesion. However, one
indeed a noble goal. That a leader, who has recommendation for future studies might be
a clearer understanding of their inner self, to attempt a randomised control study, to
will lead more effectively. They will have assess the impact of an open group format
increased clarity and conviction which will versus an invite-only format. This would help
positively influence their leadership. identify and better understand the contra-
Secondly, and in agreement with Erikson indicators to inclusion in a group and the
(1959), we believe that personal authenticity impact these have. Another recommenda-

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 145


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

tion for future research may be to investigate The Authors


further any hierarchical relationship or Tony Fusco, Siobhain O’Riordan &
mediating factors between the seven cate- Stephen Palmer
gories of performance improvement. This Coaching Psychology Unit,
may help both individual leaders and spon- City University,
soring organisations make better informed London.
decisions about participation.
Correspondence
Conclusion Tony Fusco
The research presented here we believe 2 The Tudor,
represents the first attempt at an evidenced Wells Road,
based approach to ALD, offering both a Great Malvern,
model and a method of ALD and an Worcestershire, WR14 4RH.
explanatory theory of both. As such, we Email: tony@3dleadership.co.uk
think it represents a valuable contribution to
both the field of leadership coaching and
group coaching. Through Grounded Theory
we were able to understand better the group
coaching process and develop four overarch-
ing concepts of Authentic Leadership;
Conscious, Competent, Confident and
Congruent. We suggest it is possibly the
parallel process that holds the key to the
effectiveness of the group format, enabling
the participants to work at both the intra and
inter personal levels of experience, exploring
and developing their self-concept in the
social context that is unique to this form of
coaching. Finally, by introducing social
theory, such as the concept of the social-self
and the reflected-self, we are better able to
understand how this relatively new form of
coaching is uniquely placed to develop
Authentic Leadership.

146 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Authentic Leaders are… Conscious, Competent, Confident and Congruent

References
Avolio, B.J. (2010). Pursuing authentic leadership Giallonardo, L.M., Wong, C.A. & Iwasiw, C.L. (2010).
development. In N. Nohria & R. Khurana, (Eds.), Authentic leadership of preceptors: Predictor of
Handbook of leadership theory and practice new graduate nurses’ work engagement and job
(pp.739–768). Cambridge: Harvard Business satisfaction. Journal of Nursing Management, 18,
School Publishing Corporation, 993–1003.
Avolio, B.J., Luthans. F. & Walumbwa, F.O. (2004). Glaser, B.G. & Strauss, A.L. (1967). The discovery of
Authentic Leadership: Theory building for veritable grounded theory: Strategies for qualitative research.
and sustained performance. Lincoln, NE: Gallup New York: Aldine.
Leadership Institute. Glaser, B.G. (2005). The grounded theory perspective III:
Avolio, B.J. & Luthans. F. (2006). High impact leader: Theoretical coding. Mill Valley, CA: Sociology Press.
Moments matter in authentic leadership development. Hannah, S.T., Walumbwa, F.O. & Fry, J. (2011). Lead-
New York: McGraw-Hill. ership in action teams: Team leader and
Avolio, B.J. & Walumbwa, F.O. (2014). Authentic members authenticity, authenticity strength and
leadership theory, research and practise: Steps performance outcomes. Personnel Psychology, 64,
taken and steps that remain. In D.V. Day (Ed.), 771–801.
The Oxford handbook of leadership & organisations. Harter, J.K., Schmidt, F.L. & Hayes, T.L. (2002).
New York: Oxford University Press. Business-unit-level relationship between
Birks, M. & Mills, J. (2001). Grounded theory: A practi- employee satisfaction, employee engagement
cal guide. London: Sage. and business outcomes: A meta-analysis. Journal
Brumbaugh, R.B. (1971). Authenticity and theories of Applied Psychology, 87, 268–279.
of administrative behaviour. Administrative Science Heidegger, M. (1927). Being and time. Translation of
Quarterly, 16, 108–112. J. Macquarrie & E.S. Robinson (1962), Sein und
Burlingame, G., Fuhriman, A. & Johnson, J. (2001). Zeit. New York: Harper & Row.
Cohesion in group psychotherapy. Psychotherapy, Hmieleski, K.M., Cole, M.S. & Baron, R.A. (2011).
38(4), 373–379. Shared authentic leadership and new venture
Clapp-Smith, R., Vogelgesand, G.R. & Avey, J. B. performance. Journal of Management, 38,
(2009). Authentic leadership and positive 1476–1499.
psychological capital: The mediating role of trust Hoyle, R.H., Kernis, M.H., Leary, M.R. & Baldwin,
at the group level of analysis. Journal of Leadership M.W. (1990). Selfhood: Identity, esteem, regulation.
& Organisational Studies, 15, 227–240. Boulder, CO: Westview Press.
Cooley, C.H. (1902). Human nature and the social order. James, W. (1890). The principles of psychology.
New York: Scribner’s. Cambridge, MA: Harvard University Press.
Day, D.V. (2000). Leadership development: A review Jensen, S.M. & Luthans, F. (2006). Entrepreneurs as
in context. Leadership Quarterly, 11, 581–613. authentic leaders: Impact on employees’ atti-
Day, D.V., Harrison, M.M. & Hapin, S.M. (2009). tudes. Leadership & Organisation Development Jour-
Integrative approach to leader development: Connecting nal, 27(8), 646–666.
adult development, identity and expertise. New York: Keirsey, D. (1998). Please understand me II: Tempera-
Taylor & Francis Group, LLC. ment, character, intelligence. Del Mar, CA:
Dey, I. (1999). Grounding grounded theory: Guidelines for Prometheus Nemesis Book Company.
qualitative inquiry. London: Academic Press. Kierkegaard, S. (1946). The present age (trans.
Drescher, S., Burlingame, G. & Fuhriman, A. (2012). A. Dru, 1962). New York: Harper & Row.
Cohesion: An odyssey in empirical understand- Kirkpatrick, D.L. (1975). Evaluating training programs.
ing. Small Group Research Journal, 43, 4. San Francisco Tata: Tata McGraw-Hill Education.
Elliot, A. (2010). Concepts of the self. Cambridge: Polity Kernis, M. H. (2003). Towards a conceptualisation of
Press. optimal self-esteem. Psychological Inquiry, 14,
Erikson, E.H. (1956). The problem of ego identity. 1–26.
Journal of the American Psychoanalytic Association, 4, Kernis, M.H. & Goldman, B.M. (2006). A multi-
56–121. component conceptualisation of authenticity:
Fusco, T., O’Riordan, S. & Palmer, S. (2014). Human- Theory and research. In M.P. Zanna (Ed.),
istic authentic leadership development. Coaching Advances in Experimental Social Psychology, 38,
Psychology International, 7(1), 11–16. 283–357. San Diego: Academic Press.
George, W. (2003). Authentic leadership: Rediscovering Luthans, F. & Avolio, B.J. (2003). Authentic leader-
the secrets to creating lasting value. San Francisco: ship development. In K.S. Cameron, J.E. Dutton
Jossey Bass. & R.E. Quinn (Eds.), Positive organisational schol-
George, W. & Simms, P. (2007). True North: Discover arship (pp.241–258). San Francisco: Berrett-
your authentic leadership. San Francisco: Jossey Koehler.
Bass.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 147


Tony Fusco, Siobhain O’Riordan & Stephen Palmer

Markus, H. & Cross, S. (1990). The interpersonal self. Walumbwa, F.O., Avolio, B.J., Gardener, W.L., Werns-
In L.A. Pervin (Ed.), Handbook of personality: ing, T.S. & Peterson, S.J. (2008). Authentic lead-
Theory and research. New York: Guilford Press. ership: Development and validation of a theory
Mead, G.H. (1934). Mind, self and society: From the based measure? Journal of Management, 34–89.
standpoint of a social behaviourist. Chicago: Univer- Walumbwa, F.O., Hartnell, A.L., Ayree, S. & Chris-
sity of Chicago Press. tensen, C.A. (2011). Fostering creativity in work
Mischel, W. & Morf, C.C. (2003). The self as a psycho- groups: Authentic leadership, communication climate,
social dynamic processing system: A meta- and knowledge sharing. Paper presented at the
perspective on a century of the self in psychology. Academy of Management Annual Meetings.
In M.R. Leary & J.P. Tangney (Eds.), Handbook of San Antonio, TX.
self and identity (p.23). New York: Guilford Press. Walumbwa, F.O., Luthans, F., Avey, J. & Oke, A.
O’Leonard, K. (2010). The corporate learning factbook (2011b). Authentically leading groups: The
2009: Benchmarks, trends and analysis of the US mediating role of positivity and trust. Journal of
training market. Oaklands, CA: Bersin & Associ- Organisational Behaviour, 32, 24–43.
ates. Willig, C. (2008). Introducing qualitative research in
Rogers, C. (1951). Client-centred therapy. London: psychology. New York: McGraw Hill, Open Univer-
Constable & Co. Ltd. sity Press.
Satre, J.P. (1966). The age of reason. New York: Wong, C.A. & Cummings, G.G. (2009). The influence
A.A. Knopf. of authentic leadership behaviours on trust and
Schein, E.H. (1993). How can organisations learn work outcomes of health care staff. Journal of
faster? The challenge of entering the green Leadership Studies, 3, 6–23.
room. Sloan Management Review, 34(2), 85–92. Wong, C.A., Laschnger, H.K.S. & Cummings, G.G.
Tice, D.M. & Wallace, H.M. (2003). The reflected (2010). Authentic leadership and nurses’ voice
self: Creating yourself as (you think) others see behaviour and perceptions of care quality.
you. In M.R. Leary & J.P. Tangney (Eds.), Hand- Journal of Nursing Management, 18, 889–900.
book of self and identity (p.91). New York: Guilford Yalom, I.D. (1995). The theory and practice of group
Press. psychotherapy. New York: Basic Books.
Toor, S.-u.-R., Ofori, G. & Arain, F.M. (2009). Authen-
tic leadership style and its implications in project
management. Business Review, 2(1), 31–55.

148 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Walking a mile in an executive’s shoes:
The influence of shared client-coach
experience on goal achievement
Alex T. Chinn, James P. Richmond & John L. Bennett

Objectives: To evaluate the relationship between shared industry or professional experience and client goal
achievement.
Design: An exploratory, quantitative approach was taken to survey the degree to which shared experience
influenced the client’s coach selection decision and the impact on client goal achievement.
Results: Findings suggest no correlation between the coach’s professional or industry experience as client
selection factors and the degree of client goal achievement.
Conclusions: Matching based upon shared subject matter expertise may prematurely eliminate coaches who
might have been an ideal fit.
Keywords: coaching; client; matching; goal achievement; professional experience; industry experience;
selection criteria.

E
XECUTIVE COACHING is an emerg- then select coaches they believe will be a
ing profession, and quickly growing as a good match. They often set the selection
big business. The International Coach- criteria and manage the appropriation of
ing Federation (ICF) (2012) reported that coaching services for an organisation by
corporations are, in fact, investing almost $2 selecting three or four prospective coaches
billion a year in coaching services globally. and presenting them to their executive
An increasing number of businesses are client for a final selection. Executives
using coaches to help in areas that include commonly select coaches by considering
talent management, leadership, executive factors such as executive experience, gender,
presence and transition development. nationality, credentials, certification, refer-
Since coaching services typically require rals, industry or professional experience,
a significant investment, organisations now academic accreditation and subject matter
spend significantly more time matching expertise(Blake-Beard et al., 2011; Gray,
their executive clients with coaches based on Ekinci & Goregaokar, 2011a, 2011b).
various selection criteria. These organisa- Numerous research studies on executive
tions believe that getting the appropriate coaching consider the selection criteria used
coach-client match at the beginning of the to match coaches to their clients (Baron &
coaching engagement increases the likeli- Morin, 2009; Gray et al., 2011a, 2011b; Stew-
hood of achieving client goals. Corporate art et al., 2008). Matching executives to
Human Resources (HR) partners are tasked coaches is intrinsically difficult, since there
with developing standardised coach-client are so many variables to consider when
matching criteria to select the best coaches selecting a coach for a specific need. Match-
for their clients based on criteria they ing appropriately and establishing a mean-
consider important for success. These HR ingful relationship between client and
partners may or may not be coaches them- coach-practitioner is critical to achieving
selves, and their coaching experience and successful outcomes. Interestingly, these
training varies. Typically executives in the existing studies appear to contain deficien-
organisations approach HR partners with cies or do not consider the impact various
specific coaching needs. The HR partners selection criteria have on a client’s goal

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 149


© The British Psychological Society – ISSN: 1750-2764
Alex T. Chinn, James P. Richmond & John L. Bennett

achievement. There appears to be a lack of ture review of over 35 peer-reviewed periodi-


research pointing to why various selection cals and several texts informing the three
criteria are chosen and ultimately how the frameworks that emerged to enlighten this
effectiveness of those criteria is assessed study. These frameworks included: (a)
against outcomes, if assessed at all. Coaching Distinctions and Definitions; (b)
We believe that coaching consumers’ Non-Subject Matter Expertise and Subject
beliefs of how to match executives with Matter Expertise Continuum; and (c) Goal
coaches differ based on where they land on Achievement Predictors. The third section
a continuum. At one end of the continuum presents the methodology, including selec-
is the non-subject-matter-expertise position, and tion of participants, instrumentation, data
at the other end is the subject-matter-expertise collection and analysis. The fourth and fifth
position. To define these two terms, the non- sections present the study’s findings and the
subject-matter-expertise position holds that discussions of those findings, including
competent coaches can help clients achieve implications for further research and conclu-
their goals regardless of the coach’s back- sions.
ground, gender, credentials, and profes-
sional or industry affiliation. On the Literature review
opposite end of the spectrum, someone Corporate coaching practice leaders believe
taking the subject-matter-expertise position that if they optimally match their executives
believes that to effectively help a client, the with coaches, their efforts will generate
coach must have direct knowledge of a successful outcomes. A systematic approach
particular subject pertaining to the client’s to the literature review was taken, utilising a
field of expertise. The validity of holding a snowballing approach (Creswell, 2013;
position on either end of the continuum Maxwell, 2005). First, keywords were identi-
remains largely unknown because of the lack fied to use as search terms to query the rele-
of empirical studies. vant journal publication databases. Once a
According to Underhill et al. (2013), the publication germane to the study’s central
primary coach-client selection criteria organ- themes was discovered, it was included in the
isations currently use to match coaches and literature review and further research was
clients include the coaches’ experience and conducted using the publication’s refer-
skills, ability to build rapport and trust, expe- ences until the theme was exhausted. The
rience with specific leadership challenges, timeframe examined ranged from 2000 to
congruence with the company’s culture and present. Three frameworks emerged from
business experience. Studies such as this one the literature review: (a) Coaching Distinc-
help clarify criteria clients use to select tions and Definitions; (b) Non-Subject
coaches. In addition, the study raises ques- Matter Expertise and Subject Matter Expert-
tions about the relationship between selec- ise Continuum; and (c) Goal Achievement
tion criteria and goal achievement. The Predictors.
existing literature has a paucity of empirical
data regarding the actual relationship Coaching Distinctions and Definitions
between specific coach-client selection crite- Clients who say they want coaching and
ria and goal achievement. We sought to select coaches to help them achieve their
better understand the impact professional goals may, in fact, want consulting or a
and industry experience as selection criteria combination of coaching and consulting.
had on goal achievement, if any. A number of authors have provided ‘notable
This research study is presented in five definitions on executive coaching’ (Bennett
sections. The first section introduces the & Bush, 2014, p.14). The definitions of
context, purpose and significance of the coaching vary greatly based upon the source.
study. The second section presents the litera- According to the ICF, there is a clear distinc-

150 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Walking a mile in an executive’s shoes

tion among coaching, consulting, mentoring (p.154). The coach must be experienced in
and counseling (ICF, 2008). Some coaching the client’s business in order to successfully
definitions lean more towards the coach’s coach the client. As this position sees execu-
adopting a subject-matter-expertise-oriented tive coaching as merely a component within
stance, whereas other coaching definitions a larger, consultative intervention and that a
lean more towards a non-directive, non- coach must lead, Stern’s concept of coaching
subject-matter expertise approach. The defi- also falls on the subject-matter-expertise end
nition of coaching for this research utilises of the continuum.
the ICF’s (2008) concept of ‘partnering with Yet other researchers suggest that coach-
clients in a thought-provoking and creative ing skills alone are enough to meaningfully
process that inspires them to maximise their impact outcomes. Ellinger, Hamlin and Beat-
personal and professional potential’ (p.1). tie (2008) conducted a meta-analysis of 36
The definition of consulting for this research definitions of coaching to ultimately evolve a
utilises Bennett and Bush’s (2014) definition unified definition that defined coaching as a
of consulting: ‘A helping relationship that helping, non-directive, facilitative or collabo-
can be formal or informal and is established rative process. Witherspoon and White
for the purpose of providing expertise, skills, (1996) described coaching as ‘facilitating
and/or a process for the client’ (p.367). The (literally, ‘to make easy’) more than to
definition for coach-client match is the pairing instruct’ (p.125). Witherspoon does not
of a coach to client for the purposes of a appear to suggest that subject matter expert-
coaching engagement. The definition for ise a necessary or desirable attribute.
professional experience is specific and unique
experience that pertains only to a group of The Non-Subject Matter Expertise and Subject
individuals who make a living plying the Matter Expertise Continuum
same trade or craft, for example, attorneys, As noted earlier, we believe that coaching
doctors, Certified Public Accountants. In consumers differ in their beliefs of how to
contrast, the definition of industry experience match executives with coaches based on
is broader, which refers to experience where they land on a continuum between
pertaining to a group of individuals in the non-subject-matter-expertise and subject-matter-
same general area of work, for example, expertise positions. On one end of the contin-
health care, education, banking and finance. uum, the non-subject-matter-expertise
Some researchers suggest that coaching position is a purist perspective that maintains
skills are not enough and that certain non- that coaches do not need to share their
coaching experience is necessary to thrive in client’s subject knowledge expertise to facili-
coaching today. McLean (2012) defined a tate goal achievement. Although central to
coach as ‘a trusted role model, advisor, wise consulting, the non-subject-matter-expertise
person, friend, mensch, steward or guide position posits that direct experience in that
who works with emerging human and organ- same discipline, field or industry is unlikely
isational forces to tap new energy purpose, to be a necessary requirement for a coach to
shape new visions and plans and to generate be effective. This position may even suggest
desired results’ (p.4). McLean (2012) that similar experience may at times be
suggests coaches may also need subject counterproductive. Jarvis (2004) argued that
matter expertise, familiarity with the client’s it is not necessary for coaches to have the
industry and systems thinking. Stern (2004) same subject matter expertise as the client:
described coaching as a method that entails ‘While the coach should have a sound knowl-
working with executives one-on-one ‘to help edge of business, their real contribution is
them learn how to manage and lead and to their ability to help individuals learn and
assist them to establish, structure, plan for, develop’ (p.33). Jarvis (2004) further stated
and lead the executives’ organisation’ that some commentators think hiring

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 151


Alex T. Chinn, James P. Richmond & John L. Bennett

a coach with specific experience can be to be effective in helping clients achieve


counterproductive, because the client loses their goals.
the advantage of having someone who is Researchers on each end of the contin-
neutral and objective. Grant (2005) uum have strong opinions as to whether or
suggested that ‘although the coach needs not subject matter expertise is needed in
expertise in facilitating learning through coaching to successfully achieve outcomes.
coaching, the coach does not necessarily However, the debate will continue and addi-
need a high degree of personal experience tional research will be needed.
in the client’s chosen area of learning’ (p.2).
Grant emphasised coaching is about helping Goal Achievement Predictors
clients create change so they can reach their The literature examines a number of factors
potential. Riddle, Zan and Kuzmycz (2009) currently used in an attempt to predict
suggested that to be effective, coaches do not coaching success. De Haan et al. (2013)
need to have walked in the same shoes as the identified ‘active ingredients’ in predicting
executives. By having done so, coaches could coaching effectiveness, suggesting the over-
be tempted to use a more directive approach all working alliance, client self-efficacy,
in providing a solution based upon previous coaching techniques and the strength of the
experience rather than facilitating clients in coaching relationship. Grant (2014) found
devising their own solutions. Riddle et al. that the most powerful predictor of coaching
(2009) argued that ‘there is still no evidence success was a ‘goal-focused coach-client rela-
showing that a coach’s background and tionship’ followed by ‘autonomy support’,
experience are substantially related to that and the extent to which the coaching rela-
coach’s effectiveness’ (p.21). tionship was similar to an ‘ideal coach-client
At the other end of the continuum, the relationship’ (pp.26–27).
subject-matter-expertise position maintains Results show that when the coach-client
that a coach needs to have subject knowl- matching criteria is based on ‘professional
edge similar to the client’s to facilitate goal background, including education and
achievement. Many researchers value the professional training’, the relationship does
coach’s having significant expertise in the not mediate superior client outcomes
client’s industry. Kombarakaran et al. (2008) (Boyce, Jackson & Neal, 2010, p.6). Boyce et
reported that clients considered their al. (2010) did not elaborate as to what is
‘coaches were highly knowledgeable about meant by past work experience and profes-
the company culture and business (86 per sional training, and it is unclear if they are
cent)’, and indicated the clients were operationally defining those items to include
pleased with their coaches, in part, due to professional and industry experience.
this factor (p.87). However, no mention was McGovern et al. (2001) identified several
made as to what impact this factor had on factors impacting coaching effectiveness: the
goal achievement. According to Underhill et quality of the coach-client relationship, ‘the
al. (2013), one of the top 10 most important structure of the process’, ‘regularly sched-
criteria in selecting a coach was experience uled meetings’, the ‘flexibility of meetings’,
in the client’s industry. According to Kauff- role playing, off-site meetings, ‘quality of
mann and Coutu (2009), some coaches feedback’, ‘quality of assessment’, ‘partici-
believe ‘experience working in a similar pant’s commitment’, manager support and
setting’ and ‘experience coaching in a simi- the coach’s sitting in on the client’s staff
lar setting’ are important when purchasing meetings (pp.4–6). However, how the coach’s
coaching services (p.19). Finally, Stevens subject matter expertise, or lack thereof,
(2005) proposed that coaches need to have affected coaching outcomes was absent.
some conceptual understanding of the Scoular and Linley (2006) used personal-
clients’ industries and professional context ity to predict goal achievement, reporting

152 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Walking a mile in an executive’s shoes

that different coach-client Myers-Briggs Type client goal achievement. Also examined was
Indicator (MBTI) temperaments produced a the extent to which clients consider coaches’
statistically significant higher outcome score professional and industry expertise when
for the coaching client, that is, the coach’s making a decision as to who should coach
temperament profile (SP, SJ, NJ or NT) them, as well as whether expertise affected
differed from the client’s. Stewart et al. coaching outcomes.
(2008) used the Five Factor Model to This study included a continuum in
explore the relationship between personality which the non-subject-matter-expertise posi-
and the application of learning from coach- tion maintains that a coach does not need to
ing to the workplace. They found that share the client’s professional or industry
‘despite being significant, the magnitude of experience in order to facilitate client goal
the observed correlations between personal- achievement. Conversely, the subject-matter-
ity and coaching success were relatively low’ expertise position maintains that a coach
(p.39). Stewart et al. (2008) suggested that does need to share the client’s professional
factors other than personality, such as the or industry experience in order to facilitate
client, coach, and work environment factors, client goal achievement. In this study, we
may play a greater role in coaching success. explore two hypotheses.
Stewart et al. (2008) also suggested that
personality may play a moderating role on Hypothesis 1: Professional experience
these factors and cautioned against match- H0: There is no correlation between the
ing based upon personality until further coach’s professional experience, as a client
research is conducted. However, this posi- selection factor, and the degree of client goal
tion conflicts with the findings of Thompson achievement.
et al. (2008); ‘Matching the right coach to H1: There is a correlation between the
the right client is associated with higher coach’s professional experience, as a client
success rates. Matching people according to selection factor, and the degree of client goal
expertise and personality seem to be both achievement.
the best and most commonly used strategies’
(p.24). Hypothesis 2: Industry experience
Apart from personality, in the closely H0: There is no correlation between the
related field of mentoring, other researchers coach’s industry experience, as a client selec-
examined the impact of shared race between tion factor, and the degree of client goal
client and coach. Blake-Beard et al. (2011) achievement.
examined the impact that shared mentor H1: There is a correlation between the
and protégé race and gender had on coach’s industry experience, as a client selec-
academic outcomes and found that these tion factor, and the degree of client goal
factors did not affect academic outcomes. achievement.
As shown, there is a great deal of litera-
ture related to selection criteria as a predic- We created a cross-sectional instrument
tor of successful coaching outcomes. compromised of 14 survey questions, based
However, none directly linked shared coach- upon our hypotheses and demographic crite-
client professional or industry experience to ria. The survey included three continuous
goal achievement. questions (Likert scale of 5 to 1) and 11 cate-
gorical (multiple-choice, radio button and
Methodology Y/N) questions, which was piloted to ensure
This quantitative study examined the rela- face validity. Since we believed coaches would
tionship between the coach’s professional be biased towards the non-subject-matter-
experience and the coach’s industry experi- expertise position, a question was included to
ence, as selection factors, and the degree of differentiate coaches from non-coaches in

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 153


Alex T. Chinn, James P. Richmond & John L. Bennett

order to test this assumption. Goal achieve- was placed on shared professional experi-
ment was not specifically defined, as we were ence (56 per cent) as selection criteria as
more concerned with whether or not a link opposed to industry experience (33 per
between selection criteria and goal achieve- cent).
ment existed, rather than what types of goals This survey found that 84 per cent of the
were achieved. The survey population respondents had worked with an external
comprised respondents aged 21 or older who coach. When working with an external
were recipients of coaching, or coaches who coach, the assumption is that a client must
had received coaching. Each respondent was make selection criteria decisions to find the
required to have achieved goals as a result of best match. Eighty-two per cent of the
the coaching. respondents selected their coaches as
We sent invitational emails to target opposed to having coaches assigned to them.
organisations, to coaches in our network, By selecting their coaches, the clients had to
and to our coaching clients. Subsequently, entertain selection criteria, whether at a
the target organisations sent invitations on conscious or subconscious level. Bluckert
our behalf to their coaches, who in turn (2006) suggests an important Gestalt
invited their clients to participate. The invi- concept known as Creative Adjustment, in
tation included a link to SurveyMonkey® which a person tries to do her best, no
allowing participants to respond anony- matter what the circumstances, to meet her
mously. needs, overcome challenges and reach her
The survey generated 215 responses objectives. Clients choose their coaches
during a three-week collection period in based upon their definition of coaching,
2014, with 206 responses meeting all the their agenda and where they fall on the Non-
study criteria. We analysed the data using Subject Matter Expertise and Subject Matter
Microsoft Excel and Minitab. Cronbach’s Expertise Continuum.
Alpha was calculated to determine internal Respondents were asked if professional
consistency of the survey. Following this or industry experience were selection
calculation, the research hypotheses were factors, and to what degree, to provide flexi-
tested using correlation analyses, and then bility in instances where professional or
we performed Effect Size analyses based industry experience was not a significant
upon industry demographics. factor. This approach allowed for the possi-
bility that a client purposely selected a coach,
Findings largely due to that coach not sharing the
A literature review of relevant research into same professional/industry experience.The
coach-client matching and selection factors findings show there was no correlation
identified a gap. This quantitative research between the degree to which the coach’s
study investigated the relationship between professional experience influenced the
the coach’s professional experience and the client’s decision to work with the coach and
coach’s industry experience, as client selec- client goal achievement. Twenty per cent of
tion factors, and the degree of client goal the respondents answered that the coach’s
achievement. A summary of the pertinent professional experience was not a factor in
demographic survey results can be found in their decision to select that coach; however,
Table 1. Caucasian males and females over in terms of goal achievement, the responses
the age of 41 were the dominant respon- ranged from ‘to some degree’ to ‘to a very
dents in the survey results. A majority of the large degree’. In contrast, 18 per cent of the
respondents selected their coach as opposed respondents answered that their coach’s
to being assigned a coach, chose to work professional experience influenced their
with an external coach, and had previously decision to work with that coach ‘to some
worked with a coach. Slightly more emphasis degree’, and their goal achievement ranged

154 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Walking a mile in an executive’s shoes

Table 1: Demographic responses to survey.

Question Response 1 Response 2 Response 3 Response 4 Response 5 Response 6


Last time received 3 months or 3 to 6 months 6 months to a 1 to 3 years >3 years (17%)
coaching? less (37%) (9%) year (11%) (26%)
First time working with a Not first time First time
coach? working with a working with a
coach (62%) coach (38%)
External vs. Internal External Coach Internal Coach
Coach? (84%) (16%)
Selected Coach or Selected their Coach assigned
Assigned a coach? coach (82%) (18%)
Professional experience a Professional Professional
factor in selection experience a experience not
decision? factor (56%) a factor (44%)
Degree Professional To no degree To a little To some degree To a large To a very large
experience factored into (21%) degree (4%) (20%) degree (32%) degree (12%)
coach selection decision?
Industry experience a Industry Industry
factor in selection experience a experience not
decision? factor (33%) a factor (67%)
Degree Industry To no degree To a little To some degree To a large To a very large
experience factored into (41%) degree (9%) (20%) degree (18%) degree (12%)
coach selection decision?
Degree coaching goals To no degree To a little To some degree To a large To no degree
achieved? (1%) degree (3%) (24%) degree (47%) (1%)
Top 5 industries Health care Education Banking and Other (16%) Consulting
(9%) (10%) Finance (12%) (23%)
Gender Male (48%) Female (51%) Chose not to
answer 1%)
Age 21–30 (4%) 31–40 (18%) 41–50 (33%) 51–60 (29%) 61–70 (14%) >70 (1%)
Race Chose not to Hispanic (2%) Asian (3%) Black or White (86%)
answer (2%) African
American (6%)
Are you a coach? Yes (47%) No (53%)

from ‘to some degree’ to ‘to a very large Table 2. The results are no different for both
degree’. Further, a combined 29 per cent professional and industry experience. A simi-
answered that the coach’s professional expe- lar result was found when Chi-square tests
rience influenced their decision to work with were performed. Results showed there was
that coach either ‘to a large degree’ or ‘to a no relationship between the degree the
very large degree’, and their responses to coach’s professional experience as a factor
goal achievement ranged from ‘to some in selecting the coach and the degree of
degree’ to ‘to a very large degree’. Refer to goal achievement (p=0.671). The second

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 155


Alex T. Chinn, James P. Richmond & John L. Bennett

Chi-square test showed there was no rela- Correlation analyses


tionship between the degree the coach’s Testing Hypothesis 1: Professional experience
industry experience as a factor in selecting Hypothesis number one was not supported.
the coach and the degree of goal achieve- At a significance level 0.05, the Pearson
ment (p=0.349). The results in Table 2 would Correlation was –0.038 and p=.603, failing to
suggest that regardless of the degree to reject the null hypothesis. Therefore, there
which the coach’s shared professional expe- was no statistically significant correlation
rience was a factor in the client’s coach selec- between the degree to which the coach’s
tion decision, the client achieved her goals. professional experience influenced the
At a macro level, there appears to be no client’s decision to work with the coach and
correlation between the degree to which the client’s goal achievement.
coach’s professional experience influenced
the client’s decision to work with the coach Testing Hypothesis 2: Industry experience
and client goal achievement. However, by Hypothesis number two was not supported.
stratifying the data into subsets, the data At a significance level 0.05, the Pearson
would suggest that in some cases, to some Correlation was –0.020 and p=.791, failing to
clients, the coach’s professional experience reject the null hypothesis. Therefore, there
did influence the client in selecting the was no statistically significant correlation
coach. This finding suggests there could be between the degree to which the coach’s
some connection to goal achievement. industry experience influenced the client’s
To determine Cronbach’s Alpha, multi- decision to work with the coach and client’s
item scale questions 6, 8, and 9 were used, goal achievement.
with the 5 item multi-item scale ranging from A stratification of the data was performed
‘1 – To no degree’, ‘2 – To a little degree’, ‘3 for shared professional experience. For
– To a small degree’, ‘4 – To a large degree’, respondents who answered ‘yes’ their
and ‘5 – To a very large degree’. Cronbach’s coach’s professional experience was a factor
Alpha, a measure of internal consistency and in their coach selection decisions, a correla-
reliability, was found to be 0.95, indicating a tion analysis was performed, regressing the
high degree of reliability. degree shared professional experience influ-

Table 2: Percentage breakdown of goal achievement.

To what degree did you achieve your coaching goals?


If your coach’s professional 1 – To no 2 – To a 3 – To some 4 – To a 5 – To a very Grand
experience was a factor in your degree little degree degree large degree large degree Total
decision to select your coach,
to what degree did that experience
influence your decision to work
with your coach?
1 – To no degree 0.0% 0.05% 3.9% 8.2% 7.2% 19.9%
2 – To a little degree 0.0% 0.0% 1.0% 2.4% 0.5% 3.9%
3 – To some degree 0.0% 0.0% 4.3% 11.1% 2.9% 18.4%
4 – To a large degree 0.0% 1.0% 8.2% 14.5% 5.3% 29.0%
5 – To a very large degree 0.0% 1.0% 3.4% 7.7% 7.7% 19.8%
(Blank) 0.5% 0.5% 3.4% 2.9% 1.9% 9.2%
Grand Total 0.5% 2.9% 24.2% 46.9% 25.6% 100%

156 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Walking a mile in an executive’s shoes

enced the client’s selection decision against the degree of client goal achievement; and
the degree of goal achievement. At a signifi- (2) the coach’s industry experience as a
cance level of 0.05, the Pearson correlation client selection factor and the degree of
was –0.0003 with p=.98. There was no statisti- client goal achievement. The fact that no
cally significant correlation between the correlations were found seemingly supports
degree to which the coach’s professional the non-subject-matter-expertise position
experience influenced the client’s decision that a coach does not need to share the
to work with the coach and client’s goal client’s professional or industry experience
achievement. Refer to Table 3. in order to facilitate client goal achievement.
In addition, a further stratification of the These findings challenge the subject-matter-
data for shared industry experience was expertise position that a coach does need to
performed. For respondents who answered share the client’s professional or industry
‘yes’ their coach’s industry experience was a experience in order to facilitate client goal
factor in their coach selection decision, a achievement. Consequently, advocates of the
correlation analysis was performed, regress- subject-matter-expertise position might
ing the degree shared industry experience needlessly invest resources in the client-
influenced the client’s selection decision coach matching process by trying to match
against the degree of goal achievement. At a their clients with coaches who share profes-
significance level of 0.05, the Pearson Corre- sional or industry experience. If companies
lation was 0.017 with p=.892. There was no exclude or include coaches based upon
statistically significant correlation between professional or industry experience, these
the degree to which the coach’s industry companies may make a matching error by
experience influenced the client’s decision not allowing clients to make an informed
to work with the coach and client’s goal choice. This process may prematurely elimi-
achievement. nate coaches who might have been an ideal
fit for the client. Perhaps the issue is not as
Results dichotomous as the correlation results would
A review of relevant research into coach- indicate; maybe it is not a question of either
client matching and selection factors identi- one or the other, but rather a question of
fied a gap. This quantitative research study both. One of the limitations with a simple
investigated the relationship between the regression analysis is the lack of visibility into
coach’s professional experience and the the frequency of occurrences for specific
coach’s industry experience, as client selec- combinations of responses.
tion factors, and the degree of client goal For industry experience versus goal
achievement. achievement, a similar pattern emerges.
The study’s findings present potentially Thirty-five per cent of the respondents
far reaching implications. The correlation answered that the coach’s industry experi-
analysis revealed that there was no correla- ence was not a factor in their coach selec-
tion between: (1) the coach’s professional tion; however, in terms of goal achievement,
experience as a client selection factor and the responses ranged from ‘to some degree’

Table: 3 Results of hypothesis tests.

Hypothesis Level of R-Squared p value


Significance
1 0.05 –0.038 0.603
2 0.05 –0.020 0.791

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 157


Alex T. Chinn, James P. Richmond & John L. Bennett

to ‘to a very large degree’. In contrast, 17 per coach’s professional experience influenced
cent of the respondents answered that the their decision to work with that coach. This
coach’s professional experience influenced result runs counter to the researchers’
their decision to work with that coach ‘to assumption that coaches-as-clients would
some degree’, and their goal achievement adhere more to the non-subject-matter-
ranged from ‘to some degree’ to ‘to a very expertise position and be less likely to be
large degree’. Further, a combined 26 per influenced by their coach’s professional
cent answered that the coach’s industry experience.
experience influenced their decision to work
with that coach either ‘to a large degree’ or Limitations
‘to a very large degree’, and their responses There were several limitations to this study.
to goal achievement ranged from ‘to some First, due to the brief, four-month time
degree’ to ‘to a very large degree’. Refer to constraint for the entire study, a deliberate
Table 4. The results in Table 4 suggest that trade-off decision was made to shorten the
regardless of the degree to which the coach’s survey length in the attempt to increase the
shared industry experience was a factor in participant response rate. Had the survey
the client’s coach selection decision, the been lengthier, perhaps more precise and
client goals were achieved. These results robust results could have been obtained.
would suggest that shared coach-client Second, this research survey did not inquire
professional or industry experience do not about the client’s coaching agenda. If the
positively or negatively predict goal achieve- client’s agenda was extraordinarily industry
ment. The results suggest there is no rela- specific, likely the respondent would have
tionship between shared coach-client sought out a coach with shared professional
professional or industry experience and goal or industry experience. Conversely, if the
achievement. client’s agenda was more generic, for exam-
There was a fairly even split of non- ple, developing executive presence, the
coaches (53 per cent) to coaches (47 per respondent would likely have been indiffer-
cent) responding to the survey. Interestingly, ent to selecting a coach with or without
74 per cent of the coaches indicated that the shared professional or industry experience.

Table 4: Industry experience versus goal achievement.

To what degree did you achieve your coaching goals?


If your coach’s industry 1 – To no 2 – To a 3 – To some 4 – To a 5 – To a very Grand
experience was a factor in your degree little degree degree large degree large degree Total
decision to select your coach,
to what degree did that experience
influence your decision to work
with your coach?
1 – To no degree 0.0% 1.0% 8.2% 14.5% 11.1% 34.8%
2 – To a little degree 0.0% 0.0% 1.0% 5.3% 1.4% 7.7%
3 – To some degree 0.0% 0.5% 3.9% 10.6% 2.4% 17.4%
4 – To a large degree 0.0% 0.0% 5.3% 7.2% 2.9% 15.5%
5 – To a very large degree 0.0% 0.5% 1.0% 3.9% 5.3% 10.6%
(Blank) 0.0% 1.0% 4.8% 5.3% 2.4% 14.0%
Grand Total 0.0% 2.9% 24.2% 46.9% 25.6% 100%

158 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Walking a mile in an executive’s shoes

This factor may have materially impacted the or the coach’s industry experience, as selec-
survey results. Third, due the deliberate tion factors, and the degree of client goal
quantitative design of the study, as opposed achievement.
to a mixed methods approach, no qualitative Second, by further stratifying the data by
follow-up was done that might have industry demographics, a few interesting
explained the reasons behind participants’ phenomena regarding the effect size analysis
responses. Thus, the study’s findings only results became clear. When comparing
reveal the lack of the relationship between industries against each other in terms of
shared coach-client industry or professional effect size, the results suggested certain
experience and goal achievement but not industries have higher goal achievement
the reasons as to why. than others. Third, the results suggest that
there is no relationship between shared
Future research coach-client professional or industry experi-
First, an additional study replicating the ence and goal achievement.
same findings would support the validity, The use of shared professional and indus-
reliability and repeatability of this try experience to match coaches and clients
research.Second, a mixed methods study, by coaches, clients, HR partners and third
comprising an initial quantitative compo- party coach-client matching services to
nent followed by a qualitative component, maximise goal achievement is not supported
would disclose why respondents answered by research. Continuing to use these criteria
the way they did. The purpose of this study without a direct connection to goal achieve-
would be to ascertain which coach selection ment seems an expensive and limiting
criteria lead them to select their coach; what endeavour, perhaps even to the detriment of
the client agenda was, and how the selection optimal outcomes. The continuing chal-
criteria lead to goal achievement. Addition- lenge appears to be identifying the appro-
ally, it would be interesting to understand priate selection criteria that will drive
why coaches-as-clients answered in a manner optimal goal achievement. The client’s
consistent with the subject-matter-expertise industry, agenda, and other unknown factors
position by responding that their coach’s may be influential variables. The gravitas of
professional or industry experience influ- the issue is clearly recognised by stakehold-
enced the coach selection. A third sugges- ers across the board. Future research will
tion for further research would be to illuminate the path and surely provide more
conduct a forced-pairing experiment to answers on this quest for the perfect coach-
compare the goal achievement scores of client fit.
clients matched with coaches who shared
professional or industry experience against a The Authors
group who did not share their coaches’ Alex T. Chinn, James P. Richmond &
professional or industry experience. John L. Bennett
McColl School of Business,
Conclusion Queens University of Charlotte,
There are three major implications stem- 1900 Selwyn Avenue,
ming from this study that impact executive Charlotte, NC 28274,
coaches, clients, HR partners and third party United States.
coach-client matching services. First, the
study produced statistically significant find- Correspondence
ings to suggest there is no correlation John L. Bennett
between the coach’s professional experience Email: bennettj@queens.edu

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 159


Alex T. Chinn, James P. Richmond & John L. Bennett

References
Bluckert, P. (2006). Psychological dimensions of executive International Coaching Federation (2012). ICF global
coaching. London: Open University Press. coaching study: Executive summary. Lexington, KY:
Baron, L. & Morin, L. (2009). The coach-coachee International Coaching Federation. Retrieved
relationship in executive coaching: A field study. from: http://icf.files.cmsplus.com/includes/
Human Resource Development Quarterly, 20(1), media/docs/2012ICFGlobalCoaching
85–106. doi:10.1002/hrdq.20009 Study-ExecutiveSummary.pdf
Bennett, J.L. & Bush, M.W. (2014). Coaching for Jarvis, J. (2004). Coaching and buying coaching services.
change. New York: Routledge. London: CIPD.
Blake-Beard, S., Bayne, M.L., Crosby, F.J. & Muller, Kauffman, C. & Coutu, D. (2009). The realities of
C.B. (2011). Matching by race and gender in executive coaching. Harvard Business Review: HBR
mentoring relationships: Keeping our eyes on Research Report, 1–25.
the prize. Journal of Social Issues, 67(3), 622–643. Kombarakaran, F.A., Yang, J.A., Baker, M.N. &
doi:10.1111/j.1540-4560.2011.01717.x Fernandes, P.B. (2008). Executive coaching:
Boyce, L.A., Jackson, R.J. & Neal, L.J. (2010). Build- It works! Consulting Psychology Journal: Practice and
ing successful leadership coaching relationships: Research, 60(1), 78–90.
Examining impact of matching criteria in a lead- doi:10.1037/1065-9293.60.1.78
ership coaching programme. Journal of Manage- Maxwell, J.A. (2005). Qualitative research design:
ment Development, 29, 914–931. An integrative approach (2nd ed., Vol. 41). Thou-
doi:10.1108/02621711011084231 sand Oaks, CA: Sage.
Creswell, J.W. (2013). Qualitative inquiry and research McLean, P. (2012). The completely revised handbook of
design: Choosing among five approaches (3rd ed.). coaching. A developmental approach. Santa Barbara,
Los Angeles: Sage. CA: Hudson Press.
de Haan, E., Duckworth, A., Birch, D. & Jones, C. McGovern, J., Lindemann, M., Vergara, M., Murphy,
(2013). Executive coaching outcome research: S., Barker, L. & Warrenfeltz, R. (2001). Maximis-
The contribution of common factors such as rela- ing the impact of executive coaching. Manchester
tionship, personality match, and self-efficacy. Review, 6(1), 2001. http://www.evolve-coach-
Consulting Psychology Journal: Practice and Research, ing.com/uploads/ManchesterReview_Maximis-
65, 40–57. doi:10.1037/a0031635 ing_Impactof_Exec_Coaching.pdf
Ellinger, A.D., Hamlin, R.G. & Beattie, R.S. (2008). Riddle, D., Zan, L. & Kuzmycz, D. (2009). Issues and
Coaching, HRD, and OD: Towards three ‘silo’ observations – five myths about executive coach-
fields of practice or a single ‘unified’ profession? ing. Leadership in Action, 29(5), 19–21.
Online Submission. ERIC, EBSCOhost (accessed Scoular, A. & Linley, P.A. (2006). Coaching, goal-
2 August 2014). setting and personality type: What matters?
Grant, A.M. (2005). What is evidence-based execu- The Coaching Psychologist, 2, 9–11.
tive, workplace and life coaching? In A.M. Grant, Stern, L. (2004). Executive coaching: A working defi-
M. Cavanagh & T. Kemp (Eds.), Evidence-based nition. Consulting Psychology Journal, 56, 154–162.
coaching (Vol. 1, pp.1–12). Bowen Hills, QLD: Stevens, J.H. (2005). Executive coaching from the
Australian Academic Press. executive’s perspective. Consulting Psychology
Grant, A.M. (2014). Autonomy support, relationship Journal: Practice and Research, 54, 274–285.
satisfaction and goal focus in the coach-coachee Stewart, L.J., Palmer, S., Wilkin, H. & Kerrin, M.
relationship: Which best predicts coaching (2008). The influence of character: Does person-
success? Coaching: An International Journal of ality impact coaching success? International
Theory, Research and Practice, 7(1), 18–38. Journal of Evidence Based Coaching & Mentoring,
doi:10.1080/17521882.2013.850106 6(1), 32–42.
Gray, D.E., Ekinci, Y. & Goregaokar, H. (2011a). Thompson, H.B., Bear, D.J., Dennis, D.J., Vickers, M.,
A five-dimensional model of attributes: Some London, J. & Morrison, C.L. (2008). Coaching:
precursors of executive coach selection. Interna- A global study of successful practices. Retrieved
tional Journal of Selection and Assessment, 19(4), 29 June 2008, from: American Management
415–428. Association website:
Gray, D.E., Ekinci, Y. & Goregaokar, H. (2011b). http://www.amanetorg/research/pdfs/
Coaching SME managers: Business development i4cp-coaching.pdf
or personal therapy? A mixed methods study. Underhill, B., McAnally, K., Bastian, C, Desrosiers, E.,
International Journal of Human Resource Manage- Golay, L. & Tuller, M. (2013). Executive coaching
ment, 22(4), 863–882. industry research. CoachSource. Retrieved from:
doi:10.1080/09585192.2011.555129 http://www.coachsource.com/research

160 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Using Clean Language to explore the
subjectivity of coachees’ experience
and outcomes
Susie Linder-Pelz & James Lawley

Objectives: This paper aims to contribute methodologically and substantively to understanding how coachees
experience and evaluate coaching. First, we explore the use of ‘Clean Language’ as a phenomenological
approach to coaching research, including the eliciting and analysing of data into findings and insights for
coaches and coach trainers (Tosey et al., 2014, p.630). Second, we explore the nature of events, effects,
evaluations and outcomes reported by coachees after a single coaching session.
Design: Three coaches accredited in the same coaching methodology each delivered a single session to two
randomly allocated coachees. The coachees were subsequently interviewed twice using Clean Language, in
person two days after the coaching and by telephone two weeks later.
Methodology: The transcribed follow-up interviews were analysed by an expert in Clean Language (the
second author), using a form of thematic analysis within a realist/essentialist paradigm (Braun & Clarke,
2006, p.85).
Findings: The interviews elicited detailed information on many aspects of coaching without the interviewer
introducing any topics. Coachees’ events, effects and evaluations happened during the coaching session,
between that session and the first interview, and during the two weeks between the first and second interviews.
Coachees emphasised coaches’ style of repeating back, pacing, setting goals and questioning, maintaining
the focus of the session, confronting and challenging, as well as their responsiveness (or lack of it). Increased
self-awareness was mentioned by all coachees. Outcomes occurring after the session were maintained two
weeks later, at which time new outcomes were also reported.
Conclusions: Clean Language Interviewing supplements and extends existing methods of phenomenological
interviewing and data coding. The study yielded nuanced findings on the coach behaviours that led coachees
to give favourable versus unfavourable evaluations, with implications for coaching psychologists with regard
in particular to coaches’ ability to calibrate and respond to coachees’ ongoing evaluation of the coaching, the
pace of the session and how the timing of coachees’ feedback affects the findings.
Keywords: Clean Language Interviewing; phenomenological research; coachees’ experience; coaching
outcomes; coach training; coaching evaluation.

T THE HEART OF INTERVIEWING perceived benefits of the programme and

A is an interest in understanding
peoples’ experience and the mean-
ing they make of it (Knox & Burkard, 2009,
‘this may have inadvertently precluded
participants from identifying unhelpful
aspects of the coaching programme.’ (Grant,
p.2) and the value of qualitative interviewing 2013, p.19).
in coaching psychology research is widely While O’Broin and Palmer (2010) used
recognised (de Haan & Nieß, 2012; Greif, semi-structured Repertory Grid interviews
2007). While researchers may believe that based on Personal Construct theory, their
their interviews are free of prejudice and wording is drawn from existing evidence-
presupposition, the wording of a question informed literature (p.125). Many of their
can inadvertently influence an interviewee’s probe questions contain strong researcher
recall and response (Loftus, 1975). For metaphors (e.g. ‘handle a rupture’) and
example, in a study of coaching outcomes presuppositions (e.g. ‘how important is the
two questions were asked about the coach-client relationship to outcome?’,

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 161


© The British Psychological Society – ISSN: 1750-2764
Susie Linder-Pelz & James Lawley

p.143). This last statement presupposes a nised difficulties in the process of exploring
causal link between the relationship and the and explicating a person’s self (Greif, 2007,
outcome; it also presupposes that the link is p.223). CLI is also grounded in NLP-based
important. The interviewee is, therefore, modelling (Tosey & Mathison, 2010) behind
more likely to answer within this specified which are constructivist and systemic
frame – whether or not they held this belief assumptions (Linder-Pelz, 2010, pp.81–82).
beforehand. The intent of Clean Language is akin to the
Passmore (2010) used a semi-structured practice of ‘bracketing’ in other phenome-
interview method centred around six prede- nological research; it is an attempt to
fined themes (p.51). Unfortunately he does suspend prior knowledge or belief about the
not give examples of the precise wording of phenomenon under study (Tosey et al.,
the additional prompts and questions asked 2014, p.633; Vansickel-Peterson, 2010, p.56).
to stimulate interviewees to respond, so we A comparison with the established
cannot know whether the interviewer intro- phenomenological method Interpretive
duced questions whose syntax inadvertently Phenomenological Analysis (IPA) is instruc-
led or constrained the interviewee’s answers. tive. Both CLI and IPA aim to explore and
This could cast doubt on the authenticity of understand meaning-making. With IPA the
the data. researcher is active in interpreting the partic-
‘The coaching psychologist … needs to ipant’s experiences; by contrast CLI aims to
be aware of the effects of different questions facilitate interviewees by restricting inter-
and the most appropriate timing for each’ viewer interpretation, impositions or effects
(Hieker & Huffington, 2006, p.48). ‘Even especially because ‘individuals may have
the subtlest instantiation of a metaphor (via difficulties reporting what they are thinking
a single word) can have a powerful influence or/and they may not want to self-disclose’
[and furthermore] the influence of the (Gyllensten & Palmer, 2007, p.170). While
metaphorical framing effect is covert: people CLI restricts interviewer influence it does
do not recognise metaphors as influential’ not eliminate it; the interviewer is still select-
(Thibodeau & Boroditsky, 2011, p.1). ing aspects of the interviewee’s description
‘People’ in this context includes both inter- to focus on, the Clean Language questions to
viewer and interviewee. ask and how to ask them.
Clean Language was developed from the Clean Language also offers an alternative
clinical work of David Grove (Grove & to the semi-structured interview method
Panzer, 1989) and extended into other areas which explicitly centres on themes (Braun &
such as management development, organisa- Clarke, 2006, p.94; Passmore 2010, p.51). By
tional change and education (Lawley & being more attuned to the individual inter-
Tompkins, 2000). By paying careful atten- viewee rather than following the same path
tion to their language, researchers can for all respondents, Clean Language can
minimise undesired influence and unin- enhance rapport and mitigate against the
tended bias during all stages of research – possibility that findings may misrepresent
design, data gathering, analysis and report- participants’ authentic responses (Tosey et
ing (Van Helsdingen & Lawley, 2012). In al., 2014, p.641). The adherence to a strict
particular, Clean Language can refine inter- protocol prevents the interviewer from intro-
viewing by minimising the introduction of ducing into the conversation content or
researchers’ metaphors and constructs leading questions such as, ‘Have you ever
(Tosey et al., 2014). experienced something that felt like a
The Clean Language interviewing (CLI) “critical moment” … an exciting, tense or
method fits within a phenomenological significant moment?’ (de Haan et al., 2010,
methodology (Owen, 1989; Tosey, 2011; p.8). This ensures that the descriptions
Worth, 2012) which addresses widely recog- obtained are sourced exclusively in the inter-

162 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Using Clean Language to explore the subjectivity of coachees’ experience and outcomes

viewee’s personal vocabulary and experi- The coaching method adopted was
ence. However, Clean Language is not Meta-Coaching, a goal-oriented coaching
appropriate where the interviewer is aiming methodology based explicitly on cognitive-
to co-create meaning (Tosey et al., 2014, behavioural psychology (Linder-Pelz & Hall,
p.641). 2008). We chose this method because Meta-
One application of Clean Language Coaches are trained and assessed in specific,
interviewing is to facilitate interviewees to benchmarked competencies as a require-
describe ‘what’ and ‘how’ they evaluate an ment for certification (Hall, 2011; Linder-
experience (Lawley & Tompkins, 2011). It Pelz, 2014). There is no unanimity as to
can address what Hall (2013) calls ‘evalua- whether coaching method plays a part in
tive vagueness’ where researchers often only effectiveness (Grant et al., 2010); neither is
get the ‘bottom line’ of a person’s evalua- there unanimity regarding what specific
tions and do not know the criteria by which behaviours constitute competency in coach-
the person made those judgments. Hence coachee relationship skills such as listening
CLI could be used by coaching psychologists (Passmore & Fillery-Travis, 2011). Hence it is
who want to better understand how coachees reasonable to expect that studying a single
evaluate coaching (de Haan et al., 2011). coaching method would reduce the variabil-
ity compared to using coaches with different
Research questions approaches and requiring different experts
The two research questions addressed in this to assess their competencies.
paper arise from the potential of CLI to Expecting within-coach variability as well
explore in detail how coachees evaluate. as between-coach variability – and given
1. Does Clean Language interviewing of resource constraints – we recruited three
coachees about their experience and coaches and six coachees in order to explore
evaluation of coaching yield insights for whether or not coaching skills related to the
coaches and trainers of coaching? coachees’ experiences and evaluations.
2. What events, effects and outcomes, We developed protocols for selecting and
during and after a single coaching briefing coaches and coachees as well as for
session, do coachees use to evaluate data collection and for the analysis of the
coaching? Clean Language interviews. These are
available at: www.cleanlanguage.co.uk/
Methodology articles/articles/350/.
This paper reports on part of a mixed
method study which triangulated the views The coaches
of coaches, coachees and a coach trainer/ The three coaches had demonstrated coach-
expert with regard to single coaching ‘break- ing competency, having been certified by the
through’ sessions (Lawley & Linder-Pelz, Meta-Coaching benchmarking system
2014). Six new/naive volunteer coachees (Linder-Pelz, 2014). The core Meta-Coach-
were randomly assigned to one of three prac- ing skills are listening, supporting, question-
tising coaches certified in the same coaching ing, meta-questioning, inducing states and
methodology. Convenience and purposive giving and receiving feedback (Hall, 2011).
sampling was used via a request from the All coaches were women aged in their 30s
lead researcher to colleagues and acquain- and 40s, running their own practices with
tances. Each coachee participated in a single paying clients and active in Meta-Coach
coaching session and two subsequent Clean training and mentoring programmes. Their
Language interviews, all of which were task was to conduct a single 90 minute Meta-
recorded. The participants were unknown to Coaching session with two randomly allo-
the coaches and the interviewer. cated coachees.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 163


Susie Linder-Pelz & James Lawley

Coachees descriptions obtained were sourced exclu-


Given that there would be variability in ages, sively in the interviewee’s personal vocabu-
genders and prior experience of change lary and experience.
work, we recruited six coachees. They
comprised a convenient and purposively- Analysing the interviews
selected group of volunteers who met our The method of analysis (see Appendix)
criteria of: (1) having no prior experience of followed the stages of thematic analysis:
Meta-Coaching; (2) having something mean- familiarisation with the data, generating
ingful they wanted to change in their life; (3) initial codes, searching for themes, then
not currently seeing a coach, psychologist or reviewing, defining and naming themes
psychotherapist; and (4) never having been (Braun & Clarke, 2006, p.87). However, a
diagnosed with a major psychological distur- new method was employed in Stage 2,
bance. All were aged from mid-30s to early ‘generating initial codes’, where the analyst
60s, five were women, three had had previ- distinguished between items that were
ous coaching or counselling and two had ‘events’, ‘effects’, ‘outcomes’ and ‘evalua-
some prior experience of NLP (Neuro- tions’ from each coachee’s perspective. An ‘event’
Linguistic Programming) on which Meta- is a description of what happens during the
Coaching is based. The topics they chose to coaching session, an ‘effect’ is the impact on
work with included health, building a the coachee during the session, an
business, confidence at work, self-worth, a ‘outcome’ is an effect that happens after the
relationship concern and managing money. session and an ‘evaluation’ involves the
All gave informed consent to the recording coachee making a favourable or
and use of their interviews on the condition unfavourable assessment of the experience.
of anonymity. Although small, the sample We prefer the terms ‘favourable’ (expressing
size was sufficient for the purpose of investi- approval) and ‘unfavourable’ to ‘positive’
gating the value of the CLI method and and ‘negative’ because the former retain the
exploring the resultant findings (Tosey et al., sense of being the interviewee’s preferences
2014, p.634). rather than an external observer’s assump-
tions. Our findings show that favourable
Procedures evaluations are not necessarily tied to benefi-
The coaching sessions all took place on the cial outcomes and unfavourable evaluations
same day in an office setting that was not any do not necessarily result in adverse
of the coaches’ work premises. The first outcomes.
interviews using Clean Language took place Examples from two coachees on the same
in person two days after the coaching session topic of ‘coach neutrality’ illustrate the data
and lasted, after preliminaries, for between coding:
37 and 51 minutes. The second interview, by I liked the way that she stayed very
telephone, was two weeks later and took neutral [favourable EVALUATION of
between 10 and 22 minutes. All interviews EVENT]. It was soothing, calming
were audio-recorded and transcribed. [favourable EVALUATION of EFFECT].
Coachees were informed that their coach If I did drop a bomb [or] say something
would not be privy to anything said in the that was quite personal [EVENT], I
interviews. couldn’t see it anywhere on her face or in
her speech. She wasn’t moved in any way
Clean Language Interviews [EVENT]. I appreciated that [and]
Using Clean Language as an interview didn’t feel judged [favourable EVALUA-
methodology meant that the interviewer TION & EFFECT].
aimed to not introduce any topic or content
into the conversation, ensuring that the

164 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Using Clean Language to explore the subjectivity of coachees’ experience and outcomes

I admire that … she could maintain that Beginnings of sessions


neutrality [favourable EVALUATION of Four of the six coachees referred in
EVENT] … But I will say on the other unfavourable terms to coach behaviour
hand … I did feel like there was a lack of occurring in the first 30 minutes of the
rapport in that sense [unfavourable coaching session. Words were repeated back
EVALUATION of EFFECT]. too often, the overall pace was too fast or too
The coachee’s evaluation – and whether it is slow and the manner of goal setting too
favourable or unfavourable – can be explicit direct. However, only one of these coachees
or implicit. In the first example above, said that the disliked behaviour affected the
‘I liked’ and ‘I appreciated’ clearly indicate final evaluation.
favourable evaluations, while ‘soothing and
calming’ and ‘didn’t feel judged’ imply a Repeating back words and managing the pace of
favourable evaluation because it is a our the session
assumption that the coachee considers these These four coachees found the manner and
qualities to be desirable. frequency with which their words were
The detailed analysis was undertaken by repeated back at the beginning of the
the second author and can be considered session ‘irritating’, ‘just constant’, ‘distract-
dependable (Mays & Pope, 1995, p.112) or ing’ or ‘a bit repetitive’. However, the
trustworthy (Sousa, 2014, p.213; Worth, coachees reported that after 20 to 30
2012, p.70) because of adherence to proto- minutes their coaches did more than simply
cols, adequacy of data, audit trail and the reflect what was said; the coaches were
repeated reflexive discussions between the ‘listening for what was going on underneath’
analyst and the first author. The Appendix and ‘had the thread of where I was going’,
shows the systematic steps taken by the which received favourable evaluations.
analyst, which could be replicated by some- Three of these four coachees also did not
one else trained in the method. appreciate the speed of the beginning of the
session. It either ‘went at a very rapid pace’
Findings or was ‘a little bit slow’. One coachee was
The identified events, effects, outcomes and thinking: ‘Come on, let’s move on and talk
evaluations of the coaching were separated about something’. Again, the opinion of
into five time frames, depending on when these coachees changed as the coaching
the interviewees reported they occurred: at session progressed.
the beginning of the session, throughout the
session, towards the end of the session, in the Goal setting
first two days after the session (i.e. before the Three coachees had difficulties with their
first interview) and in the two weeks between coach’s approach to goal setting. Being
the first and second interviews. asked, ‘What do you think we can achieve?’
The findings are presented in order of was for one coachee ‘very difficult because
time frame and are illustrated with quotes I don’t like to commit myself on a path.’
selected from all six coachees. These find- Similarly, another ‘didn’t want to pre-empt
ings need to be considered in the context of the endpoint; I wanted to go on the journey
the interviewees’ overall assessment of their and find out where the endpoint was.’ When
coaching; we show elsewhere that all a third coachee was asked, ‘If there was one
coachees evaluated their session highly and thing that could change your life, your
that their numerical ratings and verbal world, for the next year, what would that be?’
reports shed further light on how they evalu- the coachee thought, ‘Wow, that’s a big ques-
ated the effects (Lawley & Linder-Pelz, tion; it set some expectations that I felt like
2014). I wasn’t sure I lived up to.’ However, overall,
these three coachees all evaluated their

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 165


Susie Linder-Pelz & James Lawley

sessions highly, sometimes achieving more Neutral throughout the whole session;
than they had expected. Sympathetic, not judgemental.
The effects were:
Throughout the session You could be yourself;
There were six commonalities – occurring at A sense of being listened to for what was
varying times during the session – that going on underneath;
coachees indicated contributed to their eval- Not embarrassed;
uations: their increase in self-awareness, the Like talking to someone at a coffee shop;
coaches’ style, responsiveness, questioning, Not feeling judged;
maintenance of focus and confronting or Trust and could bare your soul.
challenging. Five coachees mentioned all Even though one coachee ‘…really
these factors while the sixth coachee genuinely liked that style of coaching; better
mentioned five of the factors. than the other stuff I got which was rubbish
crap coaching’, there was repeated concern
Self-awareness that ‘… because [the coach] was being so
Increased self-awareness was mentioned by neutral, I did feel like there was a lack of
all coachees and was described variously as rapport. Maybe I did hold myself back…
‘greater awareness’, ‘realisation’, ‘insight’, I don’t know whether that would have
‘aha moment’, ‘self-discovery’ and ‘looking changed the outcome.’
at myself in the mirror’. While the kind of
experience appears similar, what coachees Coach responsiveness
found revealing varied widely: ‘patterns’, the All coachees commented on how the coach
relevance of ‘events in my life’, ‘why I’ve responded to key things that did (or did not)
done things and why I haven’t’, ‘getting a happen; four remarked when it worked well
payoff from the problem behaviour’, ‘things and all six remarked when it didn’t. For
that are not working for me’ and ‘having the example:
experience of imagining myself without the It was really pertinent to me that the
hang-ups’. coach picked up that that was really
Some recognised these moments as turn- important to me and chose to go with
ing points; for others they contributed more that.
generally. One coachee used words associ- [The coach] highlighted certain words
ated with self-awareness 31 times in the first that I wasn’t paying that much attention
interview while another realised in the two to. She was paying a lot more attention to
weeks after the session that even increased the way that I framed things, which basi-
self-awareness ‘can have a downside too; cally just led me on that path to the end.
I was not aware of the limitations that those In addition, all coachees commented on
other people placed on my behaviour until their coach’s lack of responsiveness at one
I developed this heightened awareness’. time or another and found it unhelpful.
When I’m feeling vulnerable that I’m
Coach style putting myself out there … I need other
The interviewees recognised the relation- people to validate that that’s ok. [It]
ship-building qualities their coaches exhib- ended up feeling a bit condescending.
ited. There were numerous comments
highlighting coach qualities. One from each She was asking me questions that I would
interviewee is presented here: generally want to think about before I
Very engaging, natural, warm, sincere; gave an answer and I didn’t feel I had the
Saw me as a whole person; opportunity to give it as much thought.
Made me feel extremely at ease;
Comfortable with whatever was said;

166 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Using Clean Language to explore the subjectivity of coachees’ experience and outcomes

Sometimes I got stuck in ruts … I would reflection two weeks later, an interviewee
have liked [it] slightly more structured in said: ‘I realised perhaps the questions were
certain parts. framed deliberately to turn the whole
process back on myself, I guess akin to look-
Questioning ing at myself in the mirror and staring at it.’
All six coachees mentioned the style of ques- By contrast, one coachee would have
tioning. Most appreciated the quality of the liked more challenge. ‘I stayed in story for
questions and the skill in asking those ques- quite a long time. And the story was a bit
tions: safe.’ The coach needed ‘to butt in’ and ‘get
Her questions forced me to look at myself; me out of story’.

The simplicity [of] the wording, the ques- Ending of sessions


tions, everything was quite basic; the tone All six coachees had something to say about
was really soothing, calming, which made how their coach ended the session and, in
me respond the same way. particular, the setting of tasks or ‘home-
However, one coachee said that at times the work’. While one interviewee commented on
‘questioning was too open in style’ and what worked (‘I left the session having devel-
another found it ‘a bit repetitive’. oped a strategy to be able to deal with that
conflict, which was extremely beneficial’)
Maintaining focus most focussed on what didn’t work and what
Five coachees valued the coaches’ ability to they would have preferred instead. To give
maintain the purpose or focus of the session two examples:
and bring their attention back to what was [The coach] wanted to really nail me
important. ‘I had lost the link and [the down. But in my heart it was still like
coach] brought it back’. When another ‘I may or may not do that. I’ll promise
coachee had ‘run out of steam’, the coach you I’ll do it today but in my head I don’t
‘somehow managed to get it back on to know that I can’.
track’. Another talked of how in other coach- [The task] didn’t deal with the reality, the
ing, ‘they have flitted right across my life’, practicality [of life]. If we [had] talked a
while this coach ‘kept me really glued on the bit more about what obstacles might get
one path… I found that really awesome’. in my way for actually doing it, I would
have been more clear at the time about
Confronting and challenging what else I was going to do.
Coachees were clearly sensitive to the degree This matches previous findings that
and style of challenging since it was directly coachees had mixed responses to takeaway
addressed by five of them, sometimes in tasks. Passmore (2010, p.55) suggests that
strong terms. The very first words of two where the task was reflective, coachees
coachees in their interviews were, ‘It was expressed value in the task; more action-
quite confronting’ and ‘Very confronting; orientation tasks were less valued. While
she challenged me on just about everything Passmore links the variability to manage-
I said.’ They all, however, appreciated the ment seniority, our findings suggest there
value of the challenge. Sometimes this may be other, more general, factors involved.
happened at the moment of challenge: ‘[It]
actually stopped me there in my tracks and Outcomes after the coaching
I had to rethink whether my behaviour actu- An outcome in coaching is an effect that
ally was giving me a payoff and that’s the happens after the session. Every coaching
point in the session where there was a session in this study had beneficial outcomes
change’. Sometimes appreciation of the and, at minimum, these were maintained for
challenge happened after the session. On the next two weeks. By that time, five of the

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 167


Susie Linder-Pelz & James Lawley

Table 1: Some beneficial and adverse outcomes reported by interviewees as having


happened after the coaching session.
Beneficial outcome Illustrative quote
In sleep and dreams The first night [after the session] I slept like a log … which is something
I don’t do. …I remembered the dream vividly. [It] was about a catharsis,
a cleansing, an emptying – that to me was something significant.
Reduced ‘negative’ [The problem] doesn’t send shivers through my body any more.
feelings
Increased ‘positive’ Something has shifted that has allowed me to be more confident.
feelings and thoughts
Taken action Now that I’ve actually done some action, that helps. I’m happy.
Increased motivation Before it was a chore, and now it was like ‘Ok, I’ll wake up early and
I’ll do this’.
Developing new I am trying to develop strategies to deal with those changes, and that’s
strategy an ongoing process.
Change in attitude I was just much more open-minded towards what the options were.
New desired outcome Because I have that clarity from that coaching session, other things have
come up and now I want more clarity.
New behaviour I am treating [my husband] differently.
Increased awareness I use that awareness [from the coaching session] to help me to act
rather than react.
Adverse outcome Illustrative quote
Concern change By the time I walked out of [the coaching session] I had no doubt in my
would not last mind that that’s locked in, [but] it’s floating at the moment.
Increase in ‘negative’ The downside is that I have become far more aware of a lot of other
feelings things which are causing frustration.

six coachees could also report new beneficial At the second follow-up interview two
outcomes. Of the 38 outcomes described as weeks later, three interviewees reported expe-
occurring after the coaching session, 36 were riencing further beneficial outcomes and two
reported as beneficial and two adverse. others said that the beneficial outcomes
A selection is given in Table 1. reported two weeks earlier were maintained
(although one of these had also experienced
Changes in outcomes a new adverse outcome). The sixth intervie-
At the first interview, two days after the wee said that there had been no change since
coaching, four coachees reported experienc- the first interview. Table 2 summarises for
ing beneficial outcomes, one reported both each interviewee the changes in outcomes
a beneficial and an adverse outcome, and experienced after the coaching session.
one reported that the beneficial effect of the Table 2 shows five different profiles of
session had been maintained with no further outcome changes among the six coachees.
outcomes noticed. This diversity highlights the individuality of
the responses coachees can experience in
the two weeks following a coaching session.

168 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Using Clean Language to explore the subjectivity of coachees’ experience and outcomes

Table 2: Summary of changes in outcomes reported by each interviewee


after the coaching.
Coachee Two days after coaching Two weeks after coaching
1 Beneficial effect of session maintained Beneficial effect of session maintained
with no further outcomes with no further outcomes
2 Beneficial outcome + Adverse outcome More beneficial outcomes
3 Beneficial outcomes Beneficial outcomes maintained
+ Adverse outcome
4 Beneficial outcomes Beneficial outcome maintained
5 Beneficial outcomes More beneficial outcomes
6 Beneficial outcomes More beneficial outcomes

Discussion
Interviewer as researcher ‘clean-ness rating’ (classically clean, contex-
This study included processes that might tually clean, mildly leading or strongly lead-
have affected the outcomes (de Haan & ing). The tabulated results were used to
Duckworth, 2013, p.12). Given the second arrive at an overall assessment for each inter-
author was both interviewer and analyst, he view. The reviewers found that, on average,
minimised ‘over involvement’ due to his the interviewer contributed 50 questions or
dual roles (Allmark et al., 2009, p.7) and the statements in each interview, 40 of which
possible influence on coachees’ responses of were classically or contextually clean, eight
being interviewed (Brannick & Coghlan, mildly leading and two strongly leading.
2007; Shamai, 2003) by explaining to inter- While this was not quite as ‘clean’ as other
viewees the purpose of the interviews and Clean Language-based research (Tosey et.
sticking closely to the Clean Language inter- al., 2014), the reviewers concluded that the
viewing protocol. At the end of the second interviews substantially adhered to the CLI
interview, the interviewer asked each protocol and were, therefore, fit for the
coachee to comment on the interviews them- purpose of this research.
selves. Three mentioned the extra value they The research approach and analysis were
received over and above the coaching: ‘It congruent with the research questions
gave different insight into what was going (Passmore & Fillery-Travis, 2011, p.80).
on’, ‘It added another layer of reinforce- While the aim of the study was to investigate
ment about what had happened in the CLI as a means to explore coachees’ experi-
coaching session’ and ‘That is probably ences of coaching rather than to draw gener-
where I really did crystallise that idea’. alisable conclusions, our findings may have
Clearly we could not avoid some ‘interview some validity or transferability for contexts
effect’, namely, that the interview inevitably of ‘proximal similarity’ (Polit & Beck, 2010,
prompted some new sense-making. p.1453), such as other goal-oriented coach-
ing practices to which coachees bring health,
Issues of rigour career, business and relationship concerns.
To check the ‘cleanness’ of the interviews, As a study that analyses the data according to
we invited nine experienced Clean conceptual themes, it provides some
Language practitioners and researchers, ‘evidence-for-practice’ despite being limited
working in teams, to give each of the inter- by a lack of diversity in the sample (Daly et
viewer’s questions and statements a al., 2007, p.43).

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 169


Susie Linder-Pelz & James Lawley

As explained earlier, the analysis and 2010, p.137). The reports by coachees in this
interpretation of the interviews can be study confirm the importance of such rela-
considered trustworthy because of the tionship factors. Coachees said they were
design, protocols, adequacy of data, audit unfavourably affected by their coaches’
trail and repeated reflexive review of the behaviour when:
analysis. That said, trustworthiness will be Repeating coachee words back was over-
enhanced (or not) when similar studies are done;
undertaken by other Clean Language inter- The pace of the coachee was misjudged;
viewers and analysts. While longitudinal Goal setting was too direct;
studies of three months or more may in prin- Responsiveness to changes in the
ciple be preferable, it is worth considering coachee’s internal state was lacking; and
that the extra lapsed time may make it diffi- Tasking was inappropriate.
cult for coachees to separate the effects of a In addition, our findings indicate that
single session from other things that coachees’ evaluation of the coaching was
happened in the meantime. favourably influenced when coaches were
able to:
Addressing the research questions Display relationship qualities;
Question 1. The first research question Facilitate coachee’s self-awareness and
asked whether Clean Language interviewing insights;
of coachees about their experience and eval- Ask high-quality questions;
uation of coaching yields insights for Maintain the focus of the session;
coaches and trainers of coaching. Respond to what was, and was not,
This paper reports many insights and happening; and
demonstrates CLI is useful for understand- Challenge and confront appropriately.
ing coaching through the subjective lens of These findings confirm previous research
the coachee (de Haan et al., 2011, p.25). relating to the value of increased self-aware-
This suggests that existing evaluation ness (Froese et al., 2011; Greif, 2007;
methods can be supplemented and Shamai, 2003), being challenged and the
extended through the use of CLI and the provision of reflective space (Seamons,
coding of first-person accounts into events, 2006). It also supports the evidence that
effects, outcomes and evaluations. both challenge and support are needed for
effective coaching (Passmore & Fillery-
Question 2. The second research question Travis, 2011, p.81).
asked what events, effects and outcomes – However, we did not find a single aspect
during and after a single coaching session – of the coaching which every interviewee eval-
coachees used to evaluate coaching, uated the same way. There were always excep-
tions – too much or too little self-awareness, too
We found that coachees evaluated coaching much or too little challenge, too much or too little
in terms of relational events and effects. Many goal setting. This suggests that while these
other researchers have shown that the coach- aspects are important, so is how they applied
ing relationship is a key factor in determin- at the time to the individual coachee.
ing how coachees perceive the outcome of Coaches need to balance being engaging and
coaching (de Haan & Duckworth, 2013). being neutral, putting the coachee at ease
Relationship factors include trust, bond, and challenging them, not judging and
engagement, collaboration and working confronting, having a chat at a coffee shop
alliance (O’Broin & Palmer, 2010, p. 139); and focusing on outcomes, and so on.
the present study supports and fleshes out In all cases, the benefits accrued during
the association between working alliance the coaching sessions were maintained or
and coachees’ outcomes (O’Broin & Palmer, added to in the following two weeks.

170 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Using Clean Language to explore the subjectivity of coachees’ experience and outcomes

However, the pattern of these post-session The present study suggests that they need to
outcomes showed no consistency (Table 2). learn how coachees evaluate coaching and to
It seems each coachee follows their own path calibrate coachees’ in-the-moment responses
and it would be difficult to predict, on the so that their interventions are more
basis of what happened during the session, informed by what their coachees regard as
what additional changes will occur after important. Coaches need to be aware that
coaching. they can be considerably out of step with
their coachees in terms of the pace at the
Implications for coach practice and training beginning of the session, their degree of
The importance of recognising phenomena confrontation and their suggestions for take-
related to the beginning, middle and end away tasks.
stages of a coaching journey (de Haan & What happens after a session is a vital
Nieß, 2012, p.12) also seems to apply to a aspect of the value of the coaching. Given
single coaching conversation. Coach train- that most of the coachees in this study said
ings may need to address coaches’ ability to they benefitted from the review of their eval-
calibrate and respond to coachees’ ongoing uations during the follow-up interviews,
evaluation of the coaching, the pace of the coach training could support coaches to
session and how the timing of coachees’ learn how to seek this kind of information
feedback affects the findings. more directly; this can be done during the
Much of the coachees’ feedback seemed first coaching session when coach and
to be about calibration and responsiveness. coachee do not know each other well, and in
O’Broin and Palmer (2009) have docu- subsequent sessions.
mented the theoretical basis for bond, task
and collaboration in the coaching alliance Further research
and the cognitive-behavioural dynamics Clean Language interviewing techniques
thereof. Using skills of calibration (Linder- could provide researchers with more
Pelz, 2010, p.22; Tompkins & Lawley, 2011) detailed accounts of coachees’ experiences
coaches can, for example, get clues that the of difficult-to-define aspects of coaching
coachee wants less repeating back, wants the such as ‘balancing challenge and support’,
pace to change or has had an insight. ‘stimulating problem-solving’, ‘effective
Responsiveness is the ability to then act effec- communication’, ‘staying focused’ (Pass-
tively. Together, calibration and responsive- more, 2010) and the association between
ness form a complex competency that ‘working alliance’ and coachee outcomes
involves noticing shifts in coachee behaviour (O’Broin & Palmer, 2010, p.137).
and language, gauging his or her internal A research methodology similar to the
state and evaluations, creating questions one described in this paper could be
related to those calibrations and tracking the employed to establish coachee evaluations of
direction of the session – all without allowing second and subsequent coaching sessions. It
one’s own internal commentary, interpreta- could also be used in a longitudinal study to
tion or mind-reading to override the look at how coachees perceive the outcomes
coachee’s experience. of coaching after a series of coaching
More time and attention could be allo- sessions has ended.
cated in coach trainings to the ending stage In addition, the use of video coupled with
of coaching sessions, in particular to how to coachee accounts of a session could shed
formulate takeaway tasks appreciated by the light on the clues that a session is or is not
coachee. Time needs to be given to collabo- working well for the coachee. In a similar
ratively designing these tasks. way, coaches’ experience of the coaching
Passmore (2010, p.49) asks what coaching process could be investigated.
psychologists need to learn to be effective.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 171


Susie Linder-Pelz & James Lawley

While further study is needed, the poten- The Authors


tial of CLI as a method for evaluating Dr Susie Linder-Pelz
coachees’ experience has been demon- Independent researcher and director of
strated. Ongoing qualitative studies like this Good Decisions, Sydney.
will enable the coaching profession to learn Email: susie@gooddecisions.com.au
from exceptions to the coaching experience
as well as from averages and generalisation. James Lawley
Independent researcher and partner in
The Developing Company, London
Email: james@cleanglanguage.co.uk
www.cleanlanguage.co.uk

References
Allmark, P., Boote, J., Chambers, E., Clarke, A., Greif, S. (2007). Advances in research on coaching
McDonnell, A., Thompson, A. & Tod, A.M. outcomes. International Coaching Psychology
(2009). Ethical issues in the use of in-depth inter- Review, 2(3), 222–249.
views: Literature review and discussion. Research Grove, D.J. & Panzer, B.I. (1989). Resolving traumatic
Ethics Review, 5, 48–54. memories: Metaphors and symbols in psychotherapy.
Brannick, T. & Coghlan, D. (2007). In defense of New York: Irvington Publishers Inc.
being ‘native’: The case for insider academic Gyllensten, K. & Palmer, S. (2007). The coaching
research. Organisational Research Methods, 10(1), relationship: An interpretive phenomenological
59–74. analysis. International Coaching Psychology Review,
Braun, V. & Clarke, V. (2006). Using thematic analy- 2(2), 168–177.
sis in psychology. Qualitative Research in Psychology, Hall, L.M. (2011). Coaching mastery: Meta-Coaching
3(2), 77–101. module III, 2011 edition, certification training for
Daly, J., Willis, K., Small, R., Green, J., Welch, N., ACMC credentials. Grand Junction, CO: Neuro-
Kealy, M. & Hughes, E. (2007). A hierarchy of Semantic Publications.
evidence for assessing qualitative health Hall, L.M. (2013). Evaluative vagueness in the coaching
research. Journal of Clinical Epidemiology, 60(1), context. Message posted to E-Group for Certified
43–49. Meta-Coaches, 9 January.
de Haan, E., Bertie, C., Day, A. & Sills, C. (2010). Hieker, C. & Huffington, C. (2006). Reflexive ques-
Critical moments of clients of coaching: Towards tions in a coaching psychology context. Interna-
a ‘client model’ of executive coaching. Academy of tional Coaching Psychology Review, 1(2), 46–55.
Management Learning & Education, 9.4, 1–31. Knox, S. & Burkard, A.W. (2009). Qualitative
de Haan, E., Culpin, V. & Curd, J. (2011). Executive research interviews. Psychotherapy Research,
coaching in practice: What determines helpful- 19(4–5), 566–575.
ness for clients of coaching? Personnel Review, Lawley, J. & Linder-Pelz, S. (2014). ‘Evidence-based’ on
40(1), 24–44. what? Exploring coach, coachee and expert evaluations
de Haan, E. & Duckworth, A. (2013). Signalling a of coaching. Manuscript submitted for publica-
new trend in executive coaching outcome tion.
research. International Coaching Psychology Review, Lawley, J. & Tompkins, P. (2000). Metaphors in mind:
8(1), 6–19. Transformation through Symbolic Modelling.
de Haan, E. & Nieß, C. (2012). Critical moments in a London: The Developing Company Press.
coaching case study: Illustration of a process Lawley, J. & Tompkins, P. (2011). Clean Evaluative
research model. Consulting Psychology Journal: Interviewing. Retrieved 16 November 2014, from:
Practice and Research, 64(3), 198–224. www.cleanlanguage.co.uk/articles/articles/317/
Froese, T., Gould, C. & Barrett, A. (2011). Reviewing Linder-Pelz, S. (2010). NLP coaching: An evidence-based
from within: A commentary on first- and second- approach for coaches, leaders and individuals.
person methods in the science of consciousness. London: Kogan Page Limited.
Constructivist Foundations, 6(2), 254–269. Linder-Pelz, S. (2014). Steps towards the benchmark-
Grant, A.M. (2013). The efficacy of executive coach- ing of coaches’ skills. International Journal of
ing in times of organisational change. Journal of Evidence Based Coaching and Mentoring, 12(1),
Change Management (ahead-of-print), 1–23. 47–62.

172 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Using Clean Language to explore the subjectivity of coachees’ experience and outcomes

Linder-Pelz, S. & Hall, L.M. (2008). Meta-Coaching: Thibodeau, P.H. & Boroditsky, L. (2011). Metaphors
A methodology grounded in psychological we think with: The role of metaphor in reason-
theory. International Journal of Evidence Based ing. PLoS ONE, 6(2), 16782.
Coaching and Mentoring, 6(1), 43–56. doi: 10.1371/Journal.
Loftus, E.F. (1975). Leading questions and the Tompkins, P. & Lawley, J. (2011). Calibrating whether
eyewitness report. Cognitive Psychology, 7, what you are doing is working – or not. Retrieved
560–572. 16 November 2014, from:
Mays, N. & Pope, C. (1995). Rigour and qualitative www.cleanlanguage.co.uk/articles/
research. British Medical Journal, 311, 109–112. articles/308/
O’Broin, A. & Palmer, S. (2009). Co-creating an opti- Tosey, P. (2011). ‘Symbolic Modelling’ as an innovative
mal coaching alliance: A cognitive behavioural phenomenological method in HRD research: The work-
coaching perspective. International Coaching life balance project. Paper presented at the 12th
Psychology Review, 4(2), 184–194. International Conference on HRD Practice and
O’Broin, A. & Palmer, S. (2010). Exploring key Research across Europe, University of Glouster-
aspects in the formation of coaching relation- shire, 25–27 May.
ships: Initial indicators from the perspective of Tosey, P. Lawley, J. & Meese, R. (2014). Eliciting
the coachee and the coach. Coaching: An Interna- metaphor through Clean Language: An innova-
tional Journal of Theory, Research and Practice, 3(2), tion in qualitative research. British Journal of
124–143. Management, 25(3), 629–646.
Owen, I.R. (1989). Beyond Carl Rogers: The work of Tosey, P. & Mathison, J. (2010). Exploring inner land-
David Grove. Journal of Interprofessional Care, 4, scapes through psychophenomenology: The
186–196. contribution of neuro-linguistic programming to
Passmore, J. (2010). A grounded theory study of the innovations in researching first-person experi-
coachee experience: The implications for train- ence. Qualitative Research in Organisations and
ing and practice in coaching psychology. Interna- Management, 5(1), 63–82.
tional Coaching Psychology Review, 5(1), 48–62. van Helsdingen, A. & Lawley, J. (2012). Modelling
Passmore, J. & Fillery-Travis, A. (2011). A critical Shared Reality: Avoiding unintended influence
review of executive coaching research: A decade in qualitative research. Kwalon: Journal of the
of progress and what’s to come. Coaching: An Netherlands Association for Qualitative Research,
International Journal of Theory, Research and 1(3). Retrieved 16 November 2014, from:
Practice, 4(2), 70–88. www.cleanlanguage.co.uk/articles/
Polit, D.F. & Beck, C.T. (2010). Generalisation in articles/328/
quantitative and qualitative research: Myths and Vansickel-Peterson, D.L. (2010). Coaching efficacy with
strategies. International Journal of Nursing Studies, academic leaders: A phenomenological investigation.
47, 1451–1458. Open Access Theses and Dissertations from the
Seamons, B.L. (2006). The most effective factors in exec- College of Education and Human Sciences.
utive coaching engagements according to the coach, the Paper 87. University of Nebraska, Lincoln.
client, and the client’s boss. (PhD), Saybrook Grad- Retrieved 16 November 2014, from:
uate School and Research Center, California. http://digitalcommons.unl.edu/cehsdiss/87
(UMI Dissertations Publishing 3206219). Worth, S-A. (2012). An exploration of coaching women
Shamai, M. (2003). Therapeutic effects of qualitative towards authenticity in the workplace: A heuristic study
research: Reconstructing the experience of treat- with women in academia. (DCM), Oxford Brookes
ment as a by-product of qualitative evaluation. University. Retrieved from:
The Social Service Review, 77(3), 455–467. www.brookes.ac.uk/go/radar.
Sousa, D. (2014). Validation in qualitative research: Available from Oxford Brookes University
General aspects and specificities of the descrip- Research Archive and Digital Asset Repository
tive phenomenological method. Qualitative database.
Research in Psychology, 11, 211–227.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 173


Susie Linder-Pelz & James Lawley

Appendix
Methodology of present study compared with Braun and Clarke’s phases of Thematic Analysis (2006).

Braun & Clarke’s Analysis of Clean Language Interviews


Thematic Analysis 2006, p.87
1. Familiarise yourself with data. For each interview:
Read and re-read to get general sense of each interviewee’s
perspective. Noted how individuals expressed themselves and
organised their experience, especially through metaphor.
2. Generate initial codes. For each interview:
Coding interesting features in a Modelled the sentences of each interviewee separately,
systematic fashion across the highlighting events, effects, outcomes and ‘favourable’
entire data set, collating data or ‘unfavourable’ evaluation statements
relevant to each code. (Tompkins and Lawley 2010, Lawley & Tompkins, 2011).
3. Search for themes. For each interview:
Collating codes into potential a. Co-located ‘data extracts’ into clusters
(‘candidate’) themes, gathering for each interviewee by:
all data relevant to each potential – repetition (same words)
theme. – restatement (same idea said in a different way)
– inherent logic (e.g. cause-effect)
– sequence (when what happened).
b. Added remainder of examples to ‘unallocated cluster’.
c. Allocated ‘candidate theme’ names for clusters.
4a. Review Themes – Level 1 Across all data extracts:
Checking if the themes work in a. Co-located examples of similar themes
relation to the coded extracts (retain source of each quote).
b. Reviewed examples in ‘unallocated clusters’ for
new clusters or allocated to an existing cluster.
c. Retained remainder of examples in global ‘unallocated
cluster’.
4b. Review Themes – Level 2 Across themes:
a. Reviewed themes for ‘internal homogeneity’ –
removed examples that no longer ‘fit’ and reallocated.
b. Reviewed themes for ‘external heterogeneity’ – combined
or split clusters that covered the same or different themes.
c. Reviewed interviews to check original context and look for
missed or misallocated data items.
5. Define and name themes: Across themes:
Ongoing analysis to refine the a. Organised implicit structure inherent
specifics of each theme, and the (e.g. the five time-frames of coachee evaluations)
overall story the analysis tells, b. Defined ‘prevalence’ criteria for an ‘acceptable theme’
generating clear definitions and (e.g. example from at least three of the six interviewees).
names for each theme. c. Settled on names for selected themes.
6. Produce Report Wrote up results with reference to research questions.

174 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring
programme: Challenges and solutions
Tatiana Bachkirova, Linet Arthur & Emma Reading

Objectives: This paper describes an independently conducted research study to develop appropriate measures
and evaluate the coaching/mentoring programme that the London Deanery had been running for over five
years. It also aims to explore specific challenges in the evaluation of a large-scale coaching programme and
to suggest new solutions.
Design: The challenges to evaluation included the need to use established but also context-relevant measures
and the need for a rigorous but also pragmatic design that took into account a number of practical
constraints. Overall it was a mixed method research design consisting of a within-subject quantitative study
with support of a qualitative grounded theory methodology conducted in parallel.
Method: The selected measures for the quantitative part of the study included employee engagement, self-
efficacy and self-compassion. An additional questionnaire SWRQ (Specific Work-Related Questionnaire)
was developed as the result of a qualitative investigation with stakeholder representatives. It included a self-
estimation by the coached clients of the extent to which they could attribute each change to the coaching
received rather than any other factor. The qualitative part of the study included interviews with stakeholders
and the analysis of responses to an open question in the SWRQ.
Results: 120 (78 per cent) of matched responses pre- and post-coaching were analysed and seven stakeholders
interviewed. The results of the quantitative and qualitative analysis show improvement in all chosen scales.
The analysis also shows that coaching was a major contributor to these changes.
Conclusions: The paper argues for the development of additional methods in outcome research on coaching
programmes that are aligned with the main principles and philosophy of coaching as a practice.
Keywords: Coaching; evaluation of coaching; outcome research.

F
OR THE LAST TWO DECADES we vidual feedback from the service users.
have been witnessing unprecedented However, it was viewed that although this
growth of the coaching industry. Many provided some data on how the service was
organisations invest in coaching pro- performing, it was not sufficient to identify
grammes. It seems, however, that the pace of any performance changes in the recipients.
growing evidence of the added value of The service was publicly funded thus it was
coaching that should come from research, important that it should be properly evalu-
does not yet match the speed of the imple- ated to ensure value for money. Preliminary
mentation of coaching programmes. Conse- work looking at the literature evaluating the
quently many organisations aim to gather benefits of coaching and mentoring did not
their own evidence about the effectiveness of reveal an established methodology for
these programmes to justify the return on conducting such a review. The Oxford
investment. The London Deanery is one Brookes team of researchers won a bidding
such organisation. process for the research based on their
The London Deanery established a proposals for developing novel methodolo-
Coaching and Mentoring service for doctors gies for the evaluation of the service. The
and dentists in London in 2008. The coaches aim of the study was to establish whether the
were trained by an established leadership measures selected could identify changes in
coaching provider and their performance the performance and attitudes of doctors
was assessed at the end of the training. The undergoing the coaching intervention, since
outcome of the service was measured by indi- ultimately the purpose of the programme is

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 175


© The British Psychological Society – ISSN: 1750-2764
Tatiana Bachkirova, Linet Arthur & Emma Reading

to improve the effectiveness of doctors and costs involved in undertaking a full-scale


dentists for the benefit of the patient. research study on assessing the effectiveness
It appears that the London Deanery task of a coaching programme, the London
is not dissimilar to questions asked by many Deanery chose this option. However, such
HRD practitioners. However, as Lawrence evaluations face similar issues and obstacles
and Whyte (2014) recently argued, these as large-scale outcome research projects on
practitioners ‘have not yet collectively identi- organisational interventions (De Meuse et
fied a satisfactory approach to evaluating the al., 2009; Passmore & Fillery-Travis, 2011;
efficacy of coaching’ (2014, p.6). This is not Theeboom et al., 2013), particularly the use
surprising because the problem of measur- of established paradigms. If traditional posi-
ing the impact of organisational intervention tivist methodologies are considered as the
is not new: it has been actively discussed gold standard of evaluation, there is a
since Kirkpatrick’s (1977) methodology for danger that the complexity of coaching
evaluating training programmes (e.g. Ely et interventions may be overlooked (de Haan
al., 2010) but it is still debated, particularly & Duckworth, 2012; Ely et al., 2010). This
in relation to the evaluation of training paper explores how some specific challenges
(Passmore & Joao Velez, 2014). Kirkpatrick of the evaluation of a large-scale coaching
admitted that it is extremely difficult, if not programme were addressed and will suggest
impossible, to evaluate certain programmes a methodology that is more in line with the
in terms of the results (1977) because of the philosophy of coaching. This will be
numerous factors influencing the outcomes. discussed together with the results of the
Other authors continue to echo this conclu- actual evaluation.
sion (de Haan & Duckworth, 2012; Ely et al.,
2010). A financial addition to Kirpartick’s Literature review
methodology – ROI (Return on Investment) While recognising that there are wider
has been particularly critiqued in relation to debates on the evaluation of organisational
coaching with recent conclusions that are interventions (for example, Passmore & Joao
not dissimilar to Kirpatrick’s premise (de Velez, 2014), this literature review is only
Haan & Duckworth, 2012; De Meuse, 2009; focused on the evaluation of effectiveness of
Grant, 2012, 2013; Passmore & Fillery-Travis, coaching programmes. Typically this litera-
2011; Theeboom et al., 2013). ture addresses three main themes: (a) issues
The evaluation of coaching programmes of evaluation in principle depending on the
is considered to be even more difficult than main stakeholders; (b) most acceptable
the evaluation of training programmes (de methodologies of evaluation; and (c)
Haan & Duckworth, 2012; Ely et al., 2010; specific measures of evaluation.
Grant, 2012). The problems are exacerbated In relation to the general issues of evalua-
by a number of factors, such as the diversity tion Grant (2013) suggests that we need to
of outcomes of coaching compared to the start with a question: ‘who is interested in
relatively fixed expectations of training; the evaluation – and why’ (2013, p.15). The first
highly individual approach of the coach, group concerned with this question is the
which prevents more explicit knowledge of coaches. On the one hand they wish coach-
the process; the confidentiality that ing to be seen as effective for marketing
surrounds specific details of the goals and purposes; on the other hand, they are inter-
consequent outcomes. ested in improving their practice. Purchasers
On the other hand, as coaching of coaching ask the question of whether
programmes tend to be expensive there coaching works because they want to know if
appears to be a stronger need to justify such coaching is cost-effective. Both coaches and
expenditure, particularly in the public purchasers seem to have vested interests in
sector. Therefore, in spite of the additional the results of evaluation. In comparison,

176 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring programme: Challenges and solutions

researchers and academics are well placed to l Within-subject outcome research which
explore the effectiveness of coaching using allows comparison of the impact of
rigorous research methods and are inter- coaching on a group of individuals. The
ested in developing evidence-based practice group is assessed before and after the
for coaching (Briner, 2012; Fillery-Travis & coaching interventions. This is the most
Lane, 2006; Passmore & Fillery-Travis, 2011). commonly used study design in the liter-
However, they are probably more than ature and can provide valuable quantita-
others aware of many difficulties in applying tive data of change, but causation cannot
scientifically respected methods to research- be attributed only to coaching.
ing coaching practice (Drake, 2009; Ellam- l Between-subject and Randomised
Dyson, 2012; Ely et al., 2010; Grant, 2012). Controlled Studies, which are considered
One of the main problems is that many by some to be the ‘gold standard’ partic-
of these research methods require signifi- ularly in medical research. Although they
cant oversimplification of the nature of can measure change and relate it to the
practice. Coaching is a complex intervention intervention, the utility of these designs
influenced by the interplay of different for studying coaching is contested (de
factors such as the client’s attitude, coach’s Haan & Duckworth, 2012; Greif, 2009;
skill, coach/client relationship, all of which Passmore & Fillery-Travis, 2011) due to
are subject to complex dynamics affected by problems with delineating a control
contextual issues (de Haan & Duckworth, group, maintaining the ‘blind’ condition
2012; Ely et al., 2010). In addition if coach- and constructing ‘placebo’ interventions.
ing is sponsored by an organisation it is diffi- Uses of self-coaching, peer-coaching or
cult to establish who the main provider of ‘waiting list’ are considered practical
information about the effectiveness of issues in terms of implementation in rela-
coaching should be: the client, the coach, tion to coaching studies (Franklin &
the purchaser of the service or those on the Doran, 2009; Greif, 2009; Hicks, 1998;
receiving end of the changes that are made Williams, 2010).
by the client. In terms of more specific issues The traditional research literature on evalu-
various authors also question a typical ations typically associated with a positivist
assumption that coaches from different paradigm, focuses on searching for general
backgrounds, training and styles deliver the relationships between a small number of
same type of coaching and whether it is discrete variables across wide varieties of
possible to treat coaching as a homogeneous context. However, these contexts, from a
intervention, allowing general conclusions constructionist’s point of view, have a large
to be drawn about its effectiveness (Thee- impact upon these relationships (Fishman,
boom, 2013). 1999: 235). Without consideration of
In terms of acceptable methodologies of eval- context the findings of such studies may lead
uation the literature confirms again multiple to conclusions that are so generic that their
issues with different methodologies. It is practical value becomes questionable (de
accepted that there are certain advantages Haan & Duckworth, 2012; Grief, 2007; Orlin-
and disadvantages in each methodology. sky et al., 1994).
Grant (2013) differentiates as rigorous three It is not surprising that some research
types of outcome studies with an indication communities resist the idea that only one
of potential issues associated with them: notion of research is recognised as science:
l Case studies that can provide valuable the one identified with modernistic posi-
descriptive data but do not allow gener- tivism. It has been argued that there are
alised evaluations or the comparison of other meanings of science, for example, as
results between different coaching inter- disciplined, critical, reflective thought that
ventions. compares and contrasts evidence, arguing

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 177


Tatiana Bachkirova, Linet Arthur & Emma Reading

for alternative interpretations or explana- measured, rather than because they are
tions of a particular phenomenon (Cronin & appropriate for individual clients or reflect
Klimoski, 2011; Fishman, 1999). In coaching the nature of coaching (Easton & Van Laar,
research Grant (2013) argues, ‘an evidence 2013).
base per se does not purport to prove that any Often practitioners create a battery of
specific intervention is guaranteed to be measures, which might reflect the context of
effective, nor does it require that a double- the study, their priorities and those of their
blind, randomised, controlled trial is held as client or organisation commissioning the
being inevitably and objectively better than a evaluation. A combination of measures or
qualitative case study approach’ (2013, p.3). indicators can sometimes help to avoid over-
This means that the evaluations of coaching simplification with an intention to work
could be approached from different towards meeting a particular target that is
research paradigms (pragmatism, contextu- measured (Easton & Van Laar, 2013). Greif
alism, interpretivism) and may benefit from (2007), for example, proposes general
mixed designs. For example, it can include measures (degree of goal attainment and
retrospective questionnaires validated by client satisfaction with coaching) and
traditional positivist procedures (Passmore, specific measures such as particular social
2008), but also include new instruments that competences; performance improvement
were developed with considerations of and self-regulation. The choice of these
factors such as the type of coaching, the measures has to be justified by the theories
organisational level of the coachee, the tested in the independent research or by the
specific objectives and context of each practical needs of the organisation commis-
coaching engagement (De Meuse et al., sioning the evaluation.
2009; Ely et al., 2010). Overall, there is recognition in the litera-
The theme of specific measures that could ture that outcome research and evaluation
be used for evaluation of coaching is not an of effectiveness of coaching face significant
easy one either. According to Fillery-Travis challenges. Therefore, there is a need for
and Lane (2006) before we can ask whether pragmatic and creative approaches to this
coaching works we must ask why it is being task, which could assure rigour as the result
used. A fundamental difficulty of coaching of competent inquiry.
outcome research is the extreme hetero-
geneity of issues, problems and goals, which Methodology of the project
can be picked out as themes in different This project was designed as a pragmatic
coaching interventions. This could be inquiry requiring mixed methods
compared with therapy where it is possible to (Tashakkori & Teddli, 2010) with a large
offer general indicators of the quality of proportion of the data, as requested by the
service such as subjective well-being, symp- client, of a quantitative nature using qualita-
tom reduction and life functioning (e.g. tive data to construct a questionnaire and
Mental Health Index, Howard et al., 1996). further inform the results.
In coaching, however, it is difficult to identify The quantitative element of the study
the outcome measures applicable to the aimed to establish whether the coaching and
whole range of coaching interventions mentoring provided by London Deanery
(Greif, 2007, p.224). Grant (2013) providing practitioners had an impact on clients by
many examples from the vast range of issues comparing their scores from Time 1 (pre-
addressed in coaching, concludes that there coaching) and Time 2 (post-coaching)
is an almost endless list of applications. The online measures. In this project the London
majority of these outcomes are difficult to Deanery was interested in two variables,
quantify. This is why sometimes the target which are theoretically related to the indi-
outcomes are selected because they can be vidual change process and were considered

178 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring programme: Challenges and solutions

by them as relevant for the situation: a month or less, 3=sometimes, a few times a
employee engagement and self-esteem. To month, 4=often, once a week, 5=very often, a
give a fair representation of the aspect of few times a week, to 6=always, every day. The
self-esteem the researchers suggested two mean scale score of the three subscales is
measures: self-efficacy and self-compassion. computed by adding the scores on the
particular scale and dividing the sum by the
Selected measures number of items of the subscales involved.
Schaufeli and Bakker (2003) describe A similar procedure is followed for the total
Employee Engagement as a positive, fulfilling, score.
work-related state of mind that is charac- Perceived Self-Efficacy refers to beliefs
terised by vigour, dedication and absorption. about one’s competence to deal with chal-
Research over the past ten years has shown lenging encounters and the ‘belief in one’s
the importance of this concept in relation to capabilities to organise and execute the
understanding key organisational outcomes, courses of action required to produce given
such as low turnover (Schaufeli & Bakker attainments’ (Bandura, 1997, p.3). It is clear
2004), high organisational commitment why this concept is related to beneficial
(Demerouti et al., 2001), and customer-rated coaching and mentoring outcomes. There is
employee performance (Salanova, Agut & now a large body of research that supports a
Peiro, 2005). This has a potential to provide relationship between measures of perceived
an indirect relationship between the effect self-efficacy and performance (Stajkovic &
of coaching and ‘customer-rated’ employee Luthans, 1998).
performance as well as reduced turnover Self-Efficacy was measured using the
and increased organisational commitment. Generalised Self-Efficacy Scale, GSE
Employee engagement is also negatively (Schwarzer & Jerusalem, 1995). Cross-
related to burnout, which was particularly cultural research has been carried out which
important to the London Deanery confirms the validity of this scale, showing
The Oxford Brookes University team consistent evidence of associations between
used a typical instrument for measuring perceived self-efficacy and other psychologi-
employee engagement, the Utrecht Work cal constructs (e.g. health behaviours, well-
Engagement Scale (Schaufeli & Bakker, being, social cognitive variables and coping
2003). This scale consists of 17 items, six of strategies (Luszczynska, Scolz & Schwarzer,
which measure Vigour, six measure Absorp- 2005).
tion and five measure Dedication. Vigour is The 10 items are scored using a four-
characterised by high levels of energy and point scale: 1=not at all true, 2=hardly true,
mental resilience while working, the willing- 3=moderately true and 4=exactly true.
ness to invest efforts in one’s work and Schwarzer and Jerusalem (1995) found that
persistence even in the face of difficulties. the internal consistency varied across
Dedication refers to being strongly involved cultures but ranged from .78 to .91 and
in one’s work and experiencing a sense of concluded that it was very satisfactory,
significance, enthusiasm, inspiration, pride considering that the scale only has 10 items.
and challenge. Absorption is characterised Scherbaum et al. (2006) used Item Response
by being fully concentrated and happily Theory to test the GSE Scale and found that
engrossed in one’s work, whereby time it works best for individuals with average or
passes quickly and one has difficulties with below average levels of GSE. The GSE Scale
detaching oneself from work (Schaufeli & is less precise at above average levels of GSE.
Bakker, 2003). As low self-esteem has been frequently
The scale consists of seven points from associated with negative social comparisons
0=Never had this feeling, 1=almost never, and internalised self-judgments, Self-Compas-
a few times a year or less, 2=rarely, once sion (Neff, 2009) was introduced as an

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 179


Tatiana Bachkirova, Linet Arthur & Emma Reading

individual measure that is also a predictor of between the coaching service provided to
the ability to cope effectively with adversity London Deanery clients and noticeable
and good mental health. Self-compassion behavioural and attitudinal changes that
comprises being kind and understanding might be linked to their work performance
towards oneself when experiencing pain or and, consequently, patient care. The second
failure as opposed to being harsh and self- was recognising the importance of being
critical. Research studies have consistently creative when facing various issues associated
linked self-compassion to reduced fear of with measurement. In this case our intention
failure, enhanced perceived competence was to capture not just the static estimation
and emotionally-focused coping strategies, of particular aspects of the clients’ working
suggesting that this indicator is a promising lives but directly addressing the degree of
one for coaching (Neff, 2009; Neff & Lamb, changes that happened in relation to these
2009; Neff & Vonk, 2009). aspects by the end of the coaching process.
Self-compassion has three basic compo- To create this measure we interviewed
nents: (1) extending kindness and under- appropriate stakeholders: three users of
standing to oneself; (2) seeing one’s service (two consultants and one GP), two
experiences as part of the larger human coach/mentors and two matchers, those
experience rather than as separating and referring clients to this service and identify-
isolating; and (3) holding one’s painful ing a suitable coach. A Grounded Theory
thoughts and feelings in balanced awareness approach (Strauss & Corbin, 1990) was used
and not over-identifying with them. (Baume- as the main methodology for analysis. The
sieter, Bushman & Campbell, 2000, as following themes that emerged as the result
reported by Neff, 2003). of the qualitative analysis were particularly
Self-compassion is measured with the useful in the development of the bespoke
Self-compassion Scale (SCS, Neff, 2003). questionnaire:
The 12-item scale was used with items 2 and 1. Impact on patients
6 for self-kindness, items 11 and 12 for self- l Improved interactions with patients.
judgement, items 5 and 10 for common l Improved feedback from patients.
humanity, items 4 and 8 for isolation, items 3 l Use of coaching/mentoring tech-
and 7 for mindfulness and items 1 and 9 for niques with patients.
over-identification. Subscale scores are l Changes in patients’ behaviour, such
computed by calculating the mean of as reduced dependency, better use of
subscale item responses. To compute a total doctors’ time.
self-compassion score, reverse score the 2. Impact on colleagues
negative subscale items – self-judgement, l Improved interactions and communi-
isolation and over-identification (i.e. 1=5, cation with colleagues.
2=4, 3=4, 4=2, 5=1) – then compute a total l Use of coaching/mentoring tech-
mean. Neff (2003) found that internal niques with colleagues.
consistency was above the acceptable: .75 3. Impact on self
level for overall and subscales. Test/re-test l Improved confidence.
reliability of overall scale plus subscales was l Better time management at work,
also found to be acceptable (.93 overall). leading to an improved work-life
balance.
A bespoke questionnaire l Improved capacity to solve problems
We made the decision to develop another and make decisions, including career
instrument for this evaluation for two main decisions.
reasons. The first was responding to the l Better relationships with family
need of the client-organisation to address members.
the more specific contextual relationship

180 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring programme: Challenges and solutions

l Made them decide to stay within the degree to which the client attributed each
profession after seriously considering change to coaching. All the questionnaires
leaving the NHS. asked for the unique registration number
These questions allowed generation of allocated on application in order to pair the
contextually meaningful data for this evalua- Time 1 and Time 2 responses for each indi-
tion. Although this added an important vidual, whilst maintaining anonymity.
element for measuring the potential impact
of coaching we had to acknowledge that in Research process
this type of study, without a control group, it Once the potential participants of the evalu-
was impossible to claim that changes ation research applied for the coaching
happening to coached clients were the programme online they were informed
results of coaching rather than any other about the evaluation study and were given an
influences or combination of influences. In option to opt out if they did not wish to take
order to minimise this limitation we added part. Once accepted, clients were sent their
another question to our bespoke question- registration number (CLT number) and
naire in which clients themselves could indi- then an online link to the Time 1 Survey on
cate to what degree coaching contributed to Surveymonkey. The next stage was the
each identified change. Although this indi- normal process of the coaching programme
cation is a self-estimation we believe that the as provided by the London Deanery. The
well-educated and self-aware clients in this participants were rung by one of a small
study were conscious agents of their life situ- team of matchers, all trained Deanery
ation and therefore had sufficient insight Coaches. A structured conversation was held
into the relationship between various influ- with the client checking their reasons for
ences in their lives. We believed in their seeking coaching, their understanding of
unique position to isolate the role of the the process and practical requirements such
service they received from the complex array as venue and time. The participant was then
of other factors in their life and to be sent an email with the description of three
completely open about this under the condi- coaches attached for them to identify their
tions of this particular study when there was preferred coach. Clients were offered
no reason for them to misrepresent their coaches outside their specialty and outside
responses. their place of work to ensure externality to
This questionnaire was piloted internally the coaching process. The coaching inter-
to check the questions and appropriate vention consisted of four sessions of 60 to 90
adjustments were made following feedback. minutes taken over a period of six months.
The final questionnaire SWRQ (Specific When the coaching was completed partici-
Work-Related Questionnaire) became part pants were sent a link with an invitation to
of the Time 2 questionnaires. complete the Time 2 questionnaires. The
To summarise, the Time 1 questionnaire research was conducted with consideration
consisted of demographic questions and of good practice and strict ethical guidelines.
three scales measuring Employee Engage-
ment, Self-Efficacy and Self-Compassion. Results
The demographic questions were developed Overall there were 189 Time 1 responses and
to capture the respondents’ age group, sex, 137 Time 2 responses. After matching
ethnic origin, whether trained inside or responses and taking out responses where
outside the UK and career level. The Time 2 the clients had not completed the minimum
questionnaire included the above three number of sessions, there was a total of 120
scales of the Time 1 questionnaire and the matched Time 1 and Time 2 responses.
SWRQ scale that aimed to identify changes Therefore, the final response rate was 78
in aspects of working life of the client and per cent.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 181


Tatiana Bachkirova, Linet Arthur & Emma Reading

The demographic data show that 48.3 Standard deviation, which measures disper-
per cent of respondents were aged between sion around the average value.
30 to 39, 20.8 per cent were aged between 20 Although Self-Efficacy scores had the
to 29, 23.3 per cent were aged between 40 to largest effect size (Table 3) the ranges of
49 and 7.5 per cent were aged between 50 to scores and standard deviation stayed nearly
59. There were no respondents aged over 60 the same. Like Employee Engagement,
years old. The majority of respondents were scores for Self-Compassion showed decreases
female (66.7 per cent). Nearly all respon- in range of scores.
dents were trained within the UK (92 per The results of the paired sample t-tests in
cent). The majority of respondents (46.7 per Table 3 show a positive impact on mean
cent) were less than two years’ post-qualifica- scores of Employee Engagement, Self-Effi-
tion with a further 25.8 per cent more than cacy and Self-Compassion (at the .01 level)
two years’ post-qualification and 18.3 per with a highly significant effect for mean
cent Foundation Trainees. The majority of scores on all three scales. Effect sizes were
respondents were White British followed by calculated based on Cohen’s calculations for
18.3 per cent who were Asian or Asian paired sample t-tests. Effect size for
British: Indian. Employee Engagement is .32, effect size for
The results of the three selected estab- Self-Efficacy is 0.45 and effect size for Self-
lished measures (Tables 1 and 2) indicate Compassion is .38. This shows that the effect
that clients benefited from the programme sizes vary from between small and medium
in relation to each of them. (Employee Engagement and Self-Compas-
Table 1 shows the descriptive data for sion and medium (Self-Efficacy). It is also
both Time 1 and Time 2 for Employee important to highlight that there is evidence
Engagement, Self-Efficacy and Self-Compas- that the UWES is better at measuring lower
sion. The first line of data looks at the means compared to high levels of employee
and it is clear that all Time 2 means (aver- engagement. Therefore, it is possible that
age) are higher than the Time 1 means the coaching had more of an impact on
(average). coaches than these effect sizes suggest. The
However, before exploring whether these General Self-Efficacy scale is also better at
differences are statistically significant, it is measuring lower scores than higher ones.
important to consider levels of Employee This means that all three measures
Engagement, Self-Efficacy and Self-Compas- selected for their capacity to illustrate mean-
sion before the coaching began. Table 2 ingful changes in the clients as the result of
describes the differences in results of the their coaching, confirm that these changes
sample of doctors that was used in the UWES were significant. The clients reported higher
Manual. These results suggest that the levels of employee engagement, self-efficacy
clients in this study had higher levels of and self-compassion after being coached in
employee engagement before they started comparison to the levels of these aspects in
the coaching than the sample from the their lives before they engaged with the
UWES manual. What is also important to coaching programme. The results were not
point out is the minimum and maximum driven by any particular subgroup and bene-
scores and the resulting range of scores. fit was seen across subgroups in race, gender,
Whilst the average employee engagement stage of career and age.
levels are reasonably high there is a wide Another type of analysis was made avail-
range of scores, with the lowest being 1.60 able by using the SWRQ (specific work-
(which equates to ‘ at least once a year’) and related questionnaire developed for this
the highest being 5.80 (which equates to ‘a study). This questionnaire was designed to
couple of times a week or daily’). At Time 2 explore the changes that are perceived by
the range of scores is reduced, as is the the clients in relation to their work.

182 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring programme: Challenges and solutions

Table 1: Descriptive data from Time 1 and Time 2 questionnaires.

Employee Employee Self- Self- Self- Self-


Engagement Engagement Efficacy Efficacy Compassion Compassion
Time 1 Time 2 Time 1 Time 2 Time 1 Time 2
Mean/Standard
4.13 (0.78) 4.37 (0.71) 2.99 (0.39) 3.17 (0.39) 2.98 (0.61) 3.22 (0.63)
Deviation
Median/Range
4.2 (4.20) 4.4 (3.94) 3 (1.9) 3.1 (1.9) 2.92 (3.17) 3.25 (2.84)
of scores
Minimum score 1.60 1.93 2 2.1 1.25 1.58
Maximum score 5.80 5.87 3.9 4 4.42 4.42

Table 2: Comparing UWES sample and London Deanery sample.

UWES Manual Sample London Deanery Sample


Number 655 120
Mean 3.10 4.13
Coding ‘At least a couple of times a month’ ‘At least once a week’
Nationality Dutch and Finnish English
Background Completed career counselling Applied to coaching programme
questionnaire

Table 3: Paired sample t-tests to measure whether Time 2 means are higher than
Time 1 scores.
Scale Standard t Df Sig. (2-tailed)
Deviation
Employee Engagement 0.66 3.968 119 0.000
Self-Efficacy 0.36 5.423 119 0.000
Self-Compassion 0.47 5.586 119 0.000

The results of this analysis are shown in the the category ‘worsened significantly’ is not
Figures 1 and 2 and in Table 4. present in the figure. The result suggests
Figure 1 represents the results of the that the majority of these aspects improved
analysis of the participants’ responses to or improved significantly. Only a very small
Question 5: ‘How the following aspects of number of responses (21) indicated that
your work have changed since starting some particular aspects of their working life
coaching’. This figure illustrates how, ‘worsened somewhat’. It is interesting to
according to clients themselves, certain notice that ten of these responses are related
aspects of their working life were changing to the ‘Intention to stay in the current posi-
or remained the same after the period when tion’, which could be interpreted as a posi-
they undertook coaching. Different shades tive outcome in some situations when a
of grey represent the degree to which the radical action is beneficial for both the
clients perceived the changes. It is clear that employee and the employer.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 183


Tatiana Bachkirova, Linet Arthur & Emma Reading

Figure 1: Changes perceived in working life as the result of coaching.

Particularly positive perceptions of could indicate if the change could be attrib-


changes were demonstrated in relation to uted to coaching and the degree they
Perception of values of the client contribu- believed the coaching influenced this change.
tion to their current role, Confidence to The results of analysis of responses to this
make changes in the workplace and Ability question are demonstrated in Figure 2.
to make career decisions. In comparison to The black bar in Figure 2 highlights the
other factors it appears that the coaching number of respondents who felt that there
programme was particularly successful in had been some improvement (either some-
empowering the clients and improving their what or significant) in the areas highlighted
perception of themselves at work. This indi- in the SWRQ. The dark grey bar highlights
cation of changes corresponds with the data the numbers of respondents who felt that
of self-efficacy and self-compassion in the the coaching had influenced the positive
Time 1 and Time 2 questionnaires. change that is highlighted by the black bar.
Although the results of changes demon- The light grey bar sitting in front of two
strated in Table 2 and Figure 3 show signifi- other bars highlights what percentage of
cant changes in clients who undertook the positive improvement was attributed to the
coaching programme it could be argued that coaching. For example, as was already shown
these changes might indicate the influence of in Figure 1 the three areas of work where
a combination of factors other than coaching. respondents felt there had been the most
Because we had no control group we do not improvement were ‘Perception of value of
know to what degree the changes that we have your contribution’, ‘Confidence to make
seen are due to the coaching that they changes at work’ and ‘Ability to make career
received. In order to compensate for this issue decisions’. In these areas of work where
we included question 6 in our SWRQ, which there had been improvements, respondents
asked this question directly: ‘Please indicate felt that a large percentage of the improve-
the extent to which coaching/mentoring ment was due to the coaching that they had
contributed to this change’. In relation to received – on average 98 per ent for these
each change from Question 5 the clients three most changed areas of life.

184 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring programme: Challenges and solutions

Figure 2: Perception of participants on how changes occurred are attributable


to coaching.

The lowest change is indicated in the On the whole the qualitative analysis
area of work with patients, which may indi- suggests an overwhelmingly positive impact
cate that although Time 2 responses reflect of coaching on clients and a wide variety of
increased confidence and the way partici- the benefits associated with participation in
pants felt about themselves, it may take time this programme. The overarching patterns
to recognise such changes in action particu- of the benefits are:
larly with their work with patients. It is also l Confidence improvement and increased
possible that the junior doctors may be fairly self-awareness.
remote from patient satisfaction question- l Specific areas of working life where there
naires (this tends to happen at a departmen- was a significant difference as the result
tal level) and, therefore, find it difficult to of coaching such as career development
notice the effect of their internal changes on and work-life balance.
patients. l Acquiring a range of skills that could
make participants more capable of
Findings from the open question in SWRQ addressing potential issues, such as the
Question 9 in the SWRQ asked participants skills of problem-solving, reflection and
in a word or phrase to describe what differ- seeing things in perspective.
ence the coaching and mentoring pro- It would be unusual if the effect of coaching
gramme had made to them. All participants were universally positive. A small percentage
responded to this question. Three of general negative comments (4.96 per
researchers, first independently and then cent) illustrate that there are circumstances
together, analysed these responses and iden- in which this particular type of intervention
tified the following themes (see Table 4). is not the best solution. There could be, of
These themes are described in the order of course, other explanations (e.g. not the best
the number of comments considered as match between coach and client); however
representing each theme (from highest to without further investigation these are only
lowest). speculations.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 185


Tatiana Bachkirova, Linet Arthur & Emma Reading

Table 4: Summary of qualitative analysis.

Theme (No of comments) Example of the comments


Confidence (32) ‘Substantially increased my confidence in the workplace in the
context of being a new consultant joining a well-established
senior team’.
Change/problem solving (22) ‘I can now confidently formulate strategies to help me achieve
my goals’.
Self-awareness (17) ‘…gave me insight into the tools I possess myself to change
my work and personal life’.
Reflection (16) ‘…taught me how to analyse my experiences objectively –
reflecting, thinking about things a lot deeper than
I usually would.’
Work-life balance (12) ‘It has improved my perspective on what I am able to achieve at
work and so improved my work-life balance significantly.
I feel better able to cope as a result.’
Seeing things in perspective (8) ‘…helped me to see my position, behaviour and current options
in better perspective’
Career development (7) ‘…focused my ideas of where I want to be in the future and how
to influence and use the resources open to me now to reach
these roles’.
Being listened to/sharing (6) ‘I was able to safely discuss a very difficult situation at work’.
General positive (14) ‘An immense difference – turned my life around.’
General negative (7) ‘…not all problems have a solution’.

Discussion and conclusions SWRQ, was developed with a focus on evalu-


The evaluation described in the report with ating changes in the context specific to
the support of both quantitative and qualita- London Deanery coaching clients. The ques-
tive methods indicate that the London Dean- tionnaire allowed unique information to be
ery coaching programme provides an elicited about the nature of changes that
effective service for their clients. Well-vali- clients identified as the result of the
dated measures that were selected for this programme related to their place of work
evaluation project conclusively show that and consequently showed improvements
employee engagement, self-efficacy and self- particularly to the aspect of self (confidence
compassion of the participants significantly in their ability). We believe that this ques-
improved. It could be argued that the tionnaire would be useful for future evalua-
measures selected for this project have been tions and the data collected in this project
sufficient for the purposes of the evaluation. can be used for developing the scale for
They appropriately reflect the nature of this further investigations.
programme, which is by definition individu- In terms of the design of the evaluation
ally focused. However, as the programme is needless to say that projects with features of
delivered and paid for by public funding the the randomised control study would be
benefits for the individuals have to be mean- easier to defend in the traditional scientific
ingful in the context of the added value to community. However, there are many
the ultimate users: in this context, patients. reasons to expand this position and we
Therefore, an additional questionnaire, the propose to consider at least three of them.

186 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring programme: Challenges and solutions

The first is simply pragmatic. Considering these methods can include, for example,
many issues that constrain the use of RCTs in vignettes constructed around actual experi-
coaching research (Cavanagh & Grant, 2006; ences, by using situations provided by partic-
Greif, 2009; Passmore & Fillery-Travis, 2011), ipants before and after coaching. These rich
not the least the cost-effectiveness of the descriptions of actual experiences can be
evaluation itself, we need to develop seen as snapshots of the complexity reflected
research designs that are possible to execute. in one particular case without losing the link
A more positively formulated reason for with its context. We can use the SWRQ for
creating new measures for evaluating coach- evaluation of coaching programmes as an
ing programmes relates to giving more status addition to other methods and an alternative
to the participants according to the nature of solution when RCT is not possible/appropri-
coaching itself. Coaching is about valuing ate as it includes a self-estimation by the
the voice of the individual, empowering the respondents about the extent to which they
person and trusting in his/her ability to can attribute each change to the received
make a judgment about the issues that coaching also without losing the view of the
reflect his/her life. Research that actively systemic nature of their situations.
includes the voice of participants in judging We also wish to advocate further building
the changes they have experienced is better of the theoretical base of coaching by
aligned with coaching than research that extending evaluation research from the
treats participants as only capable of answer- question of effectiveness of coaching to
ing very simple questions leaving the analysis exploring further questions such as the
to an ‘objective’ researcher. following:
A third and probably the most important l What elements of coaching in this
reason for being more daring and creative in programme have particularly contri-
searching for new approaches to evaluation buted to positive outcomes?
is based on the acknowledgement that the l Are the changes identified by the clients
outcomes we aim to assess result from the sustained over a longer period?
complex interaction of multiple elements in l To what type of clients is this programme
systems with emerging properties. Jones and most suited?
Corner (2012) recently argued that mentor- l What difference does the matching
ing should be seen as a case of complex process make?
adaptive system (CAS) and their arguments l In what way can the changes identified by
are more than relevant also for coaching. the client actually affect their work with
Seeing coaching engagement through this patients?
lens brings to the fore many issues that were Research into the effect of the coaching
very difficult to account for in this research. programme on a large scale was on the agenda
For example, the changes that occurred for the London Deanery at the start of this
within the clients are directly and complexly project. Although this could be an important
related to their context and it is impossible and ambitious undertaking we believe that
to isolate all the influences without losing this current project has provided a positive
the essence of the process and the layers of answer to the question about the effectiveness
meaning for each individual involved. This of the coaching programme on a reasonable
means that we need to look at research scale. In light of these findings we would argue
methods that include new ideas different that the questions that aim at improvement of
from traditional science because it implies a the service which are of a more precise nature,
different view of the world. similar to the questions listed above, would be
In particular we suggest wider use of no less important and probably more perti-
qualitative methods that can enrich under- nent for the ultimate stakeholders of the
standing of the effect of coaching. Some of London Deanery’s coaching programme.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 187


Author name
Tatiana Bachkirova, Linet Arthur & Emma Reading

Acknowledgements The Authors


We are deeply grateful to all participants in Dr Tatiana Bachkirova
this study and our advisors from the London Faculty of Business,
Deanery Dr Rebecca Viney and Dr Sue Oxford Brookes University,
Morgan for constructive feedback at all Wheatley Campus,
stages of the project. Oxford, OX33 1HX.
Email: tbachkirova@brookes.ac.uk

Dr Linet Arthur
School of Education,
Oxford Brookes University,
Harcourt Hill,
Oxford, OX2 9AT.
Email: larthur@brookes.ac.uk

Mrs Emma Reading


EROP, 22 Chapel Street,
Wellesbourne,
Warwickshire, CV35 9QU.
Email: emma@erop.co.uk

References
Bandura, A. (1997). Self-efficacy: The exercise of control. Ellam-Dyson, V. (2012). Coaching psychology
New York: Freeman. research: Building the evidence, developing
Baumeister, R.F. (Ed.) (1999). The self in social psychol- awareness. OP Matters, 16, 13–16.
ogy. Philadelphia, PA: Psychology Press. Ely, K., Boyce, L., Nelson, J., Zaccaro, S., Hernez-
Briner, R. (2012) Does coaching work and does Broome, G. & Whyman, W. (2010). Evaluating
anyone really care? OP Matters, 16, 4–12. leadership coaching: A review and integrated
Cronin, M. & Klimoski, R. (2011). Broadening the framework. The Leadership Quarterly, 21, 585–599.
view of what constitutes evidence. Industrial and Fillery-Travis, A. & Lane, D. (2006). Does coaching
Organisational Psychology, 4(1), 57–61. work or are we asking the wrong question? Inter-
de Haan, E. & Duckworth, A. (2012). Signalling a national Coaching Psychology Review, 1(1), 23–36.
new trend in executing coaching outcome Franklin, J. & Doran, J. (2009). Does all coaching
research. International Coaching Psychology Review, enhance objective performance independently
8(1), 6–19. evaluated by blind assessors? The importance of
Demerouti, E., Bakker, A.B., Janssen, P.P.M. & the coaching model and content. International
Schaufeli, W.B. (2001). Burnout and engage- Coaching Psychology Review, 4, 128–144.
ment at work as a function of demands and Grant, A. (2013). The efficacy of coaching. In J. Pass-
control. Scandinavian Journal of Work, Environment more, D. Peterson & T. Freire (Eds.), The Wiley-
& Health, 27, 279–286. Blackwell handbook of the psychology of coaching and
De Meuse, K, Dai, G. & Lee, R. (2009). Evaluating the mentoring. Chichester: John Wiley & Sons.
effectiveness of executive coaching: beyond ROI? Grant, A. (2012). ROI is a poor measure of coaching
Coaching: An International Journal of Theory, success: towards a more holistic approach using a
Research and Practice, 2(2), 117–134. well-being and engagement framework. Coaching:
Drake, D. (2009). Evidence is a verb: A relational view An International Journal of Theory, Research and
of knowledge and mastery in coaching. Interna- Practice, 5(2), 74–85.
tional Journal of Evidence Based Coaching and Grief, S. (2007). Advances in research on coaching
Mentoring, 7(1), 1–2. outcomes. International Coaching Psychology
Easton, S. & Van Laar, D. (2013). Evaluation of Review. 2(3), 222–245.
outcomes and Quality of Working Life in the Hicks, C. (1998). The randomised controlled trial:
coaching setting. The Coaching Psychologist, 9(2), A critique. Nurse Researcher, 6(1), 19–32.
71–77.

188 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Evaluating a coaching and mentoring programme: Challenges and solutions

Howard, K. et al. (1996). Evaluation of psycho- Passmore, J. & Joao Velez, M. (2014). Training evalu-
therapy: Efficacy, effectiveness, and patient ation. In K. Kraiger, J. Passmore, A. Dos Santos &
progress. American Psychologist, 51, 1059–1064. S. Malvezzi (Eds.), The Wiley and Blackwell hand-
Kirkpatrick, D. (1977). Evaluating training programs: book of the psychology of training, development and
Evidence vs. proof. Training and Development Jour- performance improvement (pp.136–153). Chich-
nal, 31(11), 9–12. ester: Wiley & Blackwell.
Kühnel, J., Sonnentag, S. & Westman, M. (2009). Salanova, M., Agut, S. & Peiró, J.M. (2005). Linking
Does work engagement increase after a short organisational resources and work engagement
respite? The role of job involvement as a double- to employee performance and customer loyalty:
edged sword. Journal of Occupational and Organi- The mediation of service climate. Journal of
sational Psychology, 82, 575–594. Applied Psychology, 90, 1217–1227.
Lane, D.A. & Corrie, S. (2006). The modern scientist- Schaufeli, W.B. & Bakker, A.B. (2004). Job demands,
practitioner: A guide to practice in psychology. job resources and their relationship with
London: Routledge. burnout and engagement: A multi-sample study.
Lawrence, P. & Whyte, A. (2014). Return on invest- Journal of Organisational Behavior, 25, 293–315.
ment in executive coaching: A practical model Schaufeli, W.B., Salanova, M., Gonzalez-Romá. V. &
for measuring ROI in organisations. Coaching: Bakker, A.B. (2002). The measurement of
An International Journal of Theory, Research and engagement and burnout: A two-sample confir-
Practice, 7(1), 4–17. matory factor analytic approach. Journal of Happi-
Luszczynska, A., Scolz, U. & Schwarzer, R. (2005). ness Studies, 3, 71–92.
The General Self-Efficacy Scale: Multicultural Scherbaum, C., Cohen-Charash & Kern, M. (2006).
validation studies. The Journal of Psychology: Measuring general self-efficacy: A comparison of
Interdisciplinary and Applied, 139(5), 439–457. three measures using item response theory.
Neff, K.D. (2003). Development and validation of a Educational and Psychological Measurement, 66(6),
scale to measure self-compassion. Self and Identity, 1047–1061.
2, 223–250. Schwarzer, R. & Jerusalem, M. (1995). Generalised
Neff, K.D. (2009). The role of self-compassion in Self–Efficacy scale. In J. Weinman, S. Wright, &
development: A healthier way to relate to M. Johnston (Eds.), Measures in health psychology:
oneself. Human Development, 52, 211–214. A users portfolio. Causal and control beliefs. Windsor,
Neff, K.D. & Lamb, L.M. (2009). Self-compassion. In UK: NFER–NELSON.
S. Lopez (Ed.), The encyclopedia of positive psychol- Stajkovic, A. & Luthans. F. (1998). Self-efficacy and
ogy. Oxford: Blackwell Publishing. work-related performance: A meta-analysis.
Neff, K.D. & Vonk, R. (2009). Self-compassion versus Psychological Bulletin, 124(2), 240–261.
global self-esteem: Two different ways of relating Strauss, A. & Corbin, J. (1990). Basics of qualitative
to oneself. Journal of Personality, 77, 23–50. research: Grounded theory procedures and techniques.
Orlinsky, D., Grawe, K. & Parks, B. (1994). Process London: Sage.
and outcome in psychotherapy. In A. Bergin & Tashakkori, A. & Teddli, C. (Eds.) (2010). Sage hand-
S. Garfield (Eds.), Handbook of psychotherapy and book of mixed methods in social and behavioural
behavior change (4th ed.). New York: John Wiley. research. London: Sage.
Passmore, J. & Fillery-Travis, A. (2011). A critical Theeboom, T., Beersma, B. & van Vianen, A. (2013).
review of executive coaching research: a decade Does coaching work? A meta-analysis on the
of progress and whats to come. Coaching: An Inter- effects of coaching on individual level outcomes
national Journal of Theory, Research and Practice, in an organisational context. The Journal of
4(2), 70–88. Positive Psychology, 9(1), 1–18.
Passmore, J. (Ed.) (2008). Psychometrics in coaching. Williams, B.A. (2010). Perils of evidence-based medi-
London: Kegan Page. cine. Perspectives on Biology and Medicine, 53(1),
106–120.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 189


Teachers’ experiences of an introductory
coaching training workshop in Scotland:
An interpretative phenomenological
analysis
Margaret Barr & Christian van Nieuwerburgh

Objectives: This study sought to explore teachers’ experiences of a coaching psychology intervention –
an introductory coaching training workshop that included a positive psychology intervention and episodes
of narrative-collaborative group coaching.
Design: A qualitative design was applied to explore the participants’ experiences. Interpretative
phenomenological analysis (IPA) was used to analyse the data.
Method: The study took place in Scotland, where new professional update procedures require school leaders
to use coaching skills. The participants were five teachers who had attended the workshop. Data collection
was through semi-structured interviews.
Results: Two main themes emerged from the analysis. The first theme, ‘Learning with others – the value of
collaboration’, had two sub-themes: ‘Working with a partner made it real’ and ‘Feeling part of the group’.
The second theme, ‘Reflection – the value of time to think’ had three sub-themes: ‘Myself as coach and coachee’,
‘Coaching and other people’, and ‘Making plans to start coaching and sharing’.
Conclusions: The participants reported that collaborating with others and having time for reflection enhanced
their learning. The limitations of the study are discussed and areas for future research are proposed.
Keywords: coaching in education; coaching psychology; coaching training; GROW; interpretative
phenomenological analysis, narrative-collaborative group coaching; positive psychology, Scotland, teacher.

Coaching psychologists would do well to strive to combine the needs for both high
impact relevance and academic rigour in their work, thus meeting the call for more
pragmatic science that genuinely serves the needs of researchers and practitioners while
also adding to our knowledge corpus. (Linley & Harrington, 2008, p.52)

T
HIS STUDY strives to follow Linley and about teachers’ experiences of learning how
Harrington’s advice by addressing the to coach. This study explores five teachers’
gap in our knowledge about teachers’ experiences of an introductory coaching
experiences of taking part in coaching train- training workshop.
ing programmes. Such knowledge is espe- The topic of the study is coaching, at the
cially relevant for practitioners in Scotland, non-directive end of the directive–non-direc-
where the study took place. From August tive continuum (Pask & Joy, 2007 p.246), and
2014, the General Teaching Council for not mentoring which is more directive (Ives,
Scotland’s (GTCS) revised system of profes- 2008, p.100).
sional update for teachers (2013) has This paper reviews the literature on
required all school leaders to use coaching coaching in education and identifies the
and mentoring to support colleagues with need for the study. The method section
professional review and development (PRD). includes a description of the phenomenon,
Therefore it could serve the needs of details of the research design, and the
researchers and practitioners to know more rationale for selecting interpretative pheno-

190 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


© The British Psychological Society – ISSN: 1750-2764
Teachers’ experiences of coaching training

menological analysis (IPA) for data analysis. Peer-reviewed research on professional


The results are summarised and discussed, coaching for educators is somewhat limited
drawing on the literature review and intro- (Grant et al., 2010, p.153) and three exam-
ducing relevant new literature. Limitations ples are given next. First, evidence has shown
of the study are described. The paper that coaching has the capacity to improve
concludes by suggesting implications for learning and teaching, the core business of
practitioners, and proposing further schools, through peer coaching (Showers &
research. Joyce, 1996, p.15), and through ‘instruc-
tional coaching’ (Knight & van Nieuwer-
Literature review burgh, 2012). The second example relates to
The review of the literature considers a study of high school teachers who were
evidence about the benefits of coaching in coached using a cognitive behavioural, solu-
education. The context of coaching in tion focused framework (Grant, 2003), and
education in Scotland is then described. the coaching process GROW (Whitmore,
2009, pp.53–57). In this study, Grant et al.
Coaching in education (2010) have found that coaching can lead to
Coaching in education involves both educa- enhanced self-reported leadership and
tors and learners and has been defined by communication styles (p.162). Third, in a
van Nieuwerburgh (2012) as: review of research into coaching in educa-
a one-to-one conversation focused on the tion Cornett and Knight (2008) have found
enhancement of learning and develop- evidence that coaching after professional
ment through increasing self-awareness development leads to improvements in
and a sense of personal responsibility, implementation rates (p.209).
where the coach facilitates the self- Increasingly, coaching approaches based
directed learning of the coachee through on positive psychology (Seligman & Csik-
questioning, active listening, and appro- szentmihalyi, 2000) are used in education.
priate challenge in a supportive and Positive education (Green et al., 2012),
encouraging climate. (p.17) embracing positive psychology and coaching
This literature review looks at the coaching psychology, aims to use coaching approaches
of educators only, and not the coaching of and curricular programmes to enhance
learners. resilience, positivity, engagement and mean-
UK guidance on coaching has evolved ing. Seligman et al. (2009) have described
from definitions of coaching and mentoring evidence of its success. Fredrickson (2001)
(Centre for the Use of Research and has shown that positive emotions broaden
Evidence in Education, 2005; Department people’s thought–action repertoires (p.224),
for Education and Skills, 2003), to advice which could be of interest to coaching in
and resources for practitioners (Creasy & education.
Paterson, 2005; GTCS, 2014a, 2014b; Loft- In line with broader leadership literature
house et al., 2010; National College for about the power of conversations (Cavanagh,
Teaching and Leadership, 2014; Scottish 2013; Jackson & Waldman, 2011), Gross
College for Educational Leadership, 2014). Cheliotes and Flemming Reilly (2010)
For example, Creasy and Paterson (2005) observe that coaching conversations need
have advised school leaders ‘first develop not be formal. Referring to the solution-
yourself’ (p.23); and Suggett (2006) has focused nature of coaching, they have
commented on the importance of coaching pointed out that ‘coach-like’ conversations
being sponsored by senior leaders (p.13). have the power to transform school cultures
Lofthouse et al. (2010) have acknowledged (p.xiii).
that long-term resourcing is required (p.36).

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 191


Margaret Barr & Christian van Nieuwerburgh

Coaching in Scottish education plan learning for the next year, building on
This research study is set in Scotland, where the teacher’s self-evaluation and taking
the ‘distinctiveness’ of education has been account of their learning aspirations and the
noted (Arnott & Ozga, 2010; Bryce & priorities of the school improvement plan.
Humes, 2008; Ozga, 2005; Raffe, 2004). From August 2014, the system of Profes-
Experiential learning as a form of teacher sional Update (GTCS, 2013) requires the
learning in Scottish schools has increased in reviewer to use coaching and mentoring
prevalence for two reasons. First, HM Inspec- approaches in this meeting, consistent with
torate of Education (2009) have found a the revised Standards for Leadership and
reduction in the number of externally- Management (GTCS, 2012, pp.12–20). In
offered professional development courses addition, teachers are required to confirm
being offered, caused by budget cuts, requir- every five years that they regularly self-evalu-
ing schools to find innovative approaches to ate their practice against the professional
teacher learning (p.18). Second, there is standards, and engage in ongoing profes-
now an understanding that historic informal sional learning.
teacher learning activities such as collabora-
tion and the ‘listening ear’ are powerful Conclusion
approaches to teacher development (Forde, In conclusion, this review of the literature
2011, p.18). Therefore, experiential has found an upward trend in the use of
methodologies such as coaching, mentoring, coaching in education, and evidence of its
peer-supported learning and professional benefits. In Scotland, a coaching approach
learning communities have become more to leadership and management has been
widespread. One example is the Flexible embedded in professional standards and
Route to Headship (Education Scotland, professional update, which is likely to lead to
2014), a leadership development pro- an increase in teacher demand for coaching
gramme for aspirant head teachers which training. However, this review has not found
includes support from a coach who is also any literature about the individual experi-
head teacher of another school. Exploring ences of teachers who are learning how to
the role and experiences of these coaches, coach.
Forde et al. (2013) have described their
‘multi-faceted role’ of coach, mentor, tutor Method
and assessor (p.106). The study is a phenomenological inquiry
In his major review of teacher educa- into five teachers’ personal experiences of
tion – Teaching Scotland’s Future – Donaldson an introductory coaching training workshop.
(2010) has recognised the value of flexible This section describes the workshop and the
approaches to professional learning (p.96). sample. The rationale for using IPA for the
Among its recommendations, the review has study is explained. The process for collecting
established the necessity of a refreshed and analysing data is given, and reflexivity is
system of professional review and develop- explored.
ment (PRD) based on self-evaluation against
standards, where it is a professional require- The phenomenon
ment and an entitlement to engage in The phenomenon was a two-hour introduc-
career-long learning. The Scottish model of tory coaching training workshop for teach-
PRD is not a performance review, and is not ers, covering basic coaching skills and the
related to competence and discipline GROW model (Whitmore, 2009, pp.53–57).
matters. The reviewer (school leader) and In September 2013 the workshop took place
the reviewee (teacher) meet to discuss the seven times to accommodate teachers (both
impact of the teacher’s professional learning school leaders and unpromoted teachers in
experiences during the previous year, then mixed groups) taking part in the area’s pilot

192 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Teachers’ experiences of coaching training

programme for revised PRD procedures, as l how coaching can be used in PRD meet-
described in the literature review. Group size ings;
ranged from five to 26 people. The work- l a short unrehearsed demonstration,
shop facilitator was the researcher. where the facilitator used GROW to
Stelter et al. (2011) have suggested that coach a volunteer from the group on a
narrative-collaborative group coaching real issue;
could be used by teachers to reflect on l practising coaching with a partner;
professional challenges. The group coaching l planning next steps; and
design of the workshop aimed to encourage l invitation to participate in the research
collaborative meaning-making about coach- project related to this study.
ing, recognising that the presenter did not
have a monopoly on knowledge (Stelter, The participants
2013). Written by the researcher and peer- Eight workshop participants expressed an
reviewed by an experienced former interest in taking part in the research and
colleague, the content included: were given a letter of invitation and consent
l icebreaker to generate positive emotions form, and the opportunity to ask questions.
(Fredrickson, 2001); Of those eight, three chose not to proceed,
l coaching definitions and evidence of and five were recruited as participants for
impact; the study. Table 1 gives a profile of each
participant.

Table 1: The participants in the study.

Participant Post Teaching Promoted Ethnicity Gender Coaching


Experience Post Experience
Experience
P1 Primary teacher 2 years – White Female None
Scottish
P2 Primary teacher 6 years – White Female None
Scottish
P3 Secondary teacher 6 years – White Female None
Scottish
P4 Primary head teacher 19 years 14 years White Female Had been
Scottish coached
P5 Primary head teacher 29 years 18 years White Female Had used
Scottish solution–
focused
approaches
in previous
school

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 193


Margaret Barr & Christian van Nieuwerburgh

The choice of IPA for data analysis represented in the transcript (Jarman et al.,
IPA aims to explore and understand the 1997).
meaning of an experience from the partici-
pant’s point of view (Smith & Osborn, 2004). Data collection
This matches the intention of the study – to Semi-structured interviews were used to
gain a rich idiographic account of the partic- collect the data. The researcher met each
ipants’ individual experiences. Although participant individually, with interview
social constructionism is relevant – partici- length ranging from 59 minutes to one hour
pants were influenced by interactions with 44 minutes.
others, as they engaged with the group In order to give participants the opportu-
coaching approach – the overriding episte- nity to tell their own story in their own words
mological position for the research is (Brocki & Weardon, 2006, pp.90–91),
phenomenological, acknowledging that retrieval cues were selected to help them
each participant had a unique and valid access their episodic memory of their expe-
perception of the workshop. riences (Tulving & Pearlstone, 1966). They
First, a qualitative approach was chosen were invited to look at the presentation
over quantitative. Qualitative research aims slides again individually. For each slide they
to access the participants’ world and mean- were asked the main question in the inter-
ings, while quantitative research takes a real- view schedule: What were you thinking and feel-
ist epistemological position (Coyle, 2007, ing at that time?, then given time to think
p.12). (Kline, 1999) and to reply. There was a
Second, IPA was chosen over other quali- potential risk that this set of cues would not
tative approaches. Braun and Clarke (2006) help participants’ recall, especially if they
note similarities between thematic analysis had encoded the information in a different
and IPA (p.83). However, while thematic way (Watkins & Tulving, 1975), for example,
analysis is descriptive, IPA is highly interpre- through the sights, sounds and smells of the
tative. Therefore IPA is more suitable for workshop venue. However, since it was not
gaining deep insights into participants’ possible to return to the venue, the presen-
experiences, for example in the studies by tation slides were offered, and participants
Bramley and Eatough (2005); Gyllensten were given a choice about using them.
and Palmer (2006); Gyllensten et al. (2010); After each interview, notes were taken in
Timotijevic and Breakwell (2000); and van a journal, reflecting on initial impressions of
Nieuwerburgh and Tong (2013). In addi- interaction with the participant (Smith et al.,
tion, the study did not intend to direct the 2009, p.73).
analysis towards theory development, as The researcher transcribed each inter-
required in grounded theory (Holloway & view, adding non-verbal data about pauses
Todres, 2003). and laughter. The transcript included start
IPA recognises hermeneutics (Smith et and stop times for each interviewee
al., 2009, pp.21–29), the skill of interpreting comment, line numbers and page numbers,
the participant’s words and behaviour and wide margins for exploratory comments
during the interview. There is a double and thoughts about emergent themes.
hermeneutic because, while the participant
is interpreting their own experience and Analysis
putting it into words, the researcher is Analysis – reflective journal. Throughout
making their own meaning of the partici- the analysis, reflective notes were made in a
pant’s words while attempting to resist influ- journal. The notes evolved throughout the
ence from their own experiences. To address process, covering the researcher’s reaction
the risk of bias, emerging themes were to thoughts about themes which might be
repeatedly checked to ensure they were emerging.

194 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Teachers’ experiences of coaching training

Analysis – exploratory comments. While Reflexivity


being read and re-read, each transcript was Creswell (2003) stated, ‘One cannot escape
analysed individually (Smith et al., 2009, the personal interpretations brought to qual-
p.82). Exploratory comments were added on itative analysis’ (p.182). The researcher had
three levels – descriptive comments, linguis- previously been a school leader, had written
tic comments, and conceptual coding which and facilitated the workshop, and would also
was often interrogative (Smith et al., 2009, conduct the interviews. Therefore it was
p.84, p.88). essential to take actions to minimise the
effect of bias, congruent with Corrie’s (2013)
Analysis – emergent themes. The explora- observation that evidence-based practice is
tory comments for the first transcript were most helpful when understood as ‘a context
reviewed and patterns were explored to for learning and discovery, rather than justi-
compile a list of emergent themes, which fication’.
were noted on post-it notes on a board to be According to the ‘simultaneity principle’
clustered into provisional superordinate of appreciative coaching, the act of asking a
themes and sub-themes. These emergent question effects a change (Clancy & Binkert,
themes and related quotations were also 2010, p.15). Therefore, interview questions
collated in a spreadsheet, with further reflec- were neutral. Throughout the study, reflec-
tions. As recommended by Bainger (2011) tion on conscious and unconscious construc-
the script was re-read to ensure that the tion of the data was supported through the
themes were represented in the transcript, use of a reflexive journal, and regular discus-
and not a result of the researcher’s bias sions with the researcher’s supervisor, check-
(p.37). Relevant missed quotations or themes ing that analysis was well-founded on the
were added. Braun and Clarke (2006) advise transcripts. After completion of the study,
that themes should ‘capture something individual meetings with participants
important in relation to the overall research confirmed that the findings reflected their
question’ (p.82), so themes were not neces- experiences. Acknowledging the difficulty of
sarily dependent on prevalence. A concept total bracketing of bias, the reflexive journal
map of the participant’s provisional superor- was maintained until the report was
dinate themes and sub-themes was compiled. complete.
The above process was repeated for each of
the transcripts individually. Cross-references Results
and clusters of themes were sought by exam- The results are presented through the
ining the five concept maps, the display themes shown in Table 2.
board and the spreadsheets of quotations,
until two superordinate themes and their 1. Learning with others – the value of
sub-themes were identified. collaboration
All participants commented on the signifi-
The results. Quotations were selected to cance of collaborating with other people to
illustrate the results. The analysis continued make meaning, for example sharing narra-
during the writing phase (Smith, 1995, tives, practising with a partner and learning
p.24). as a group.

Ethical principles Learning: Working with a partner made it real.


Throughout the study, the British Psycholog- All participants reported that working with a
ical Society’s Code of Ethics and Conduct partner helped their understanding and
(2009) was followed. Ethical approval was consolidated their learning.
granted by the Research Ethics Committee I remember feeling, kind of accom-
at the University of East London. plished after it. …I think until you do

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 195


Margaret Barr & Christian van Nieuwerburgh

something, you don’t really understand Two participants observed that being in a
how it’s gonna [sic] work. (P3: coaching conversation had given them confi-
1403–1465) dence that equality would be respected in
Seeing it, you learn about it. But actually PRD conversations with their reviewer.
doing it yourself, it kind of cements that Although previously being doubtful, they
for you. (P2: 1504–1505) found the practice coaching conversation
When practising, participants realised that convincing.
listening and non-directive questioning give [before practice session] I remember being
responsibility to the coachee. They saw the quite doubtful….. Sometimes you feel if
coachee accept responsibility and feel confi- it is your boss, they are…more expert
dent about the outcome. than you. (P3: 922–924)
Actually I didn’t do anything. I just asked [after practice session] Both people in the
the questions that were there and she did conversation being equal – I believed
it all. It was quite good to help her to that… by then. I didn’t really believe it
help herself. …She seemed really confi- before. Having done it, and experienced
dent about it after[wards]. (P1: 961–964) the conversation.’ (P3: 1587–1598)
Four of the participants reported noticing
difficulty with listening attentively to their Learning: Feeling part of the group. Four of the
partner. participants reported enjoying learning as
It was really hard being quiet… it was a part of a group sharing a goal.
bit of an eye opener. (P2: 410–412) Because we were… there for the same
One participant experienced a ‘critical goal… it was quite nice. (P3: 364–365)
moment’ (de Haan, 2008, p.92) while work- One participant was explicit about the value
ing with a partner who displayed good listen- of collaborating with people from other
ing skills. schools.
I thought, ‘You are not listening!’ …So The opportunity to engage with
yeah, that made me think. (P5: colleagues. And I did like the fact that I
1044–1056) didn’t know these people. (P4:
When we changed places… she was very 1524–1525)
good at listening… didn’t interrupt… When being interviewed, participants
sort of encouraged me with her body used language illustrating that they had felt
language, but didn’t intervene. And I part of the group. For example, one partici-
thought, ‘…I’m learning from you’. pant spoke about the group sharing an
(P5: 1064–1071) insight while they all watched the demon-
stration.

Table 2: The themes in the coaches’ experiences.

Superordinate Theme Sub-theme


1. Learning with others – the value of Learning: Working with a partner made it real
collaboration Learning: Feeling part of the group
2. Reflection – the value of having time Reflection: Myself as a coach, and myself
to think as a coachee
Reflection: Coaching and other people
Reflection: Making plans to start coaching
and sharing

196 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Teachers’ experiences of coaching training

Everybody was like ‘Ah!’… Once we saw One participant noticed the ‘fit’ between
it, we were all… ‘I get it now’. (P1: coaching and her own values. Comparing
885–890) the practice coaching conversation with her
experience of previous non-coaching PRD
2. Reflection – the value of having time to meetings, she experienced an insight about
think both people in a coaching conversation
Throughout the workshop, participants being equal.
thought about what it would be like in future This fits better with the way I kind of see
to be a coach, and to be coached. They also the world…. We should treat other
began to plan next steps. people the way we would want to be
treated. (P2: 533–535).
Reflection: Myself as coach and coachee. While This idea that what I brought to the
reflecting during the workshop, participants conversation was just as important, was
compared their own behaviour with the really enlightening to me. (P2:
coaching skills and processes being 1104–1113)
discussed. Reflecting on their role as coach,
they became aware of their desire to listen Reflection: Coaching and other people. During
more, and to be less directive when working the workshop, participants reflected on links
with colleagues and learners. between coaching and other people in
What I got out of that night was I actually school. They related the workshop content
don’t listen. I look as if I’m listening. (P5: to real situations with colleagues and
1063–1064). children.
It also made me a bit more aware of I couldn’t help but relate what you were
maybe times where I have been more saying to the situations that I was dealing
directive in the school, and I maybe with in school. (P5: 676–677).
shouldn’t have been. (P2: 792–795) I’ve been so busy leading, directing and
Reflecting on their role as coachee, they fixing in this school that I haven’t used
recognised that they too would benefit from the coaching model at all. (P5: 966–967)
the thinking time they afforded to learners. They began to think that goal-setting and
We give the kids thinking time, but we non-directive questioning could benefit
don’t give ourselves it. So I think it makes teachers and learners alike.
you question it yourself. (P3: 976–978) Being allowed to set our own goals… we
When thinking about non-directive ques- do that with the children… If you dictate
tioning using the GROW model, one partici- to the children… they are not going to be
pant noticed that being given responsibility as motivated. (P4: 864–868)
for the outcome could challenge the It started to get me thinking about how
coachee. this wasn’t just for staff…. It’s for staff to
When I look at these questions there’s no pupil, or pupil to pupil. (P1: 507–512)
hiding really. It puts a lot of responsibility In particular, they identified with the
on you. (P1: 727–729) concept that people could use coaching
However, participants were enthusiastic skills and GROW to help one another,
about having responsibility, and felt encour- reporting that coaching was more supportive
aged by the non-judgemental approach to and nurturing than the previous model of
concepts of right or wrong. PRD.
But it seemed as if there was no right or Coaching’s a bit more nurturing. (P2:
wrong answer. It was just what you 217–218).
thought. (P2: 290–291) It was more of a supportive environment
than… the previous model. (P3:
1243–1244)

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 197


Margaret Barr & Christian van Nieuwerburgh

The discussion about using coaching as a I remember thinking: this actually would
support led to participants reflecting more be a good approach to share with the
widely about helping others. One participant whole staff. So that even if they were
had mixed feelings, speaking initially about working with parents, or a student,
the benefits of collegiality, then later about [teacher], or having to have possibly an
the difficulty of obtaining support from uncomfortable or difficult conversation
others. with someone, …not the least bit
Reminded me that we can have a colle- confrontational, …win-win situation. (P5:
giate approach to things. (P3: 441). 608–610)
Sometimes I thought, actually, it’s more Although overall the participants felt opti-
quick [sic] if you’re on your own. (P3: mistic about their next steps, one participant
532) reported feelings of anxiety about how she
The concern about accessing support was would do this.
echoed by another participant who was By the end of the session I was really posi-
worried about relying on her line manager’s tive, really motivated about going back to
coaching skills. school… A bit anxious in some respects,
Just the worry that, em, the success of this if I’m honest…. At the end of it
might land on the ability of the other I thought, ‘…I know it’s a learning curve
person… (P2: 690–691) for everybody.’ (P4: 1475–1492)
One participant reported that she had
Reflection: Making plans to start coaching and started implementing her plans the day after
sharing. Participants thought about how they the workshop. She recalled that using
could use coaching skills beyond PRD GROW with a colleague had resolved a long-
conversations, for example when target- standing problem.
setting with learners. Came in the very next day. Put it in place.
Made me think about the target-setting I Used the GROW model, and it
do every month with the kids. …the happened. And I’d been struggling with
wording that I could use, to make it… that for months… Because you had
more encouraging for them to speak. demonstrated the GROW model. And I
(P3: 791–796) thought, ‘Right, I’m doing that tomor-
They also reflected on how they could intro- row!’ [laughing]. (P5: 291–306)
duce coaching when working with current
and future colleagues. Discussion
I do have a student [student teacher] The study set out to enable teachers to
coming… so I’ve been thinking about explain from their own perspective, their
it… in terms of how I can help her. (P1: experience of an introductory coaching
1082–1084) training workshop, where they learned basic
One participant reported feeling an urgency coaching skills and GROW, and explored
to resume using coaching. their role as a coach and as a coachee. This
It’s quite a strong tool… one you’d have discussion compares the findings with the
to practise. That’s what I was thinking. ‘I literature review, and introduces further
need to get back into this, I need to use relevant literature. The limitations of the
this.’ (P5: 721–723) research are identified, and proposals for
Participants with line management responsi- future research are made.
bilities considered how they could engage Because the literature review on coach-
with teachers in school, and how coaching ing in education did not find any literature
skills and GROW could be used with about teachers’ experiences of undertaking
colleagues, parents, and children. a coaching training programme, the results
of this study are explored with reference to

198 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Teachers’ experiences of coaching training

the research into coaching in education in It was clear that the participants who were
general. head teachers would be advocates for coach-
ing, in line with Suggett’s (2006) recommen-
Definition of coaching. Participants’ experi- dation that coaching is ‘sponsored’ by senior
ences concur with van Nieuwerburgh’s leaders.
(2012) definition of coaching (p.17). They
reported enhanced learning and self-aware- Implementation of coaching. In the work-
ness as a result of the one-to-one conversa- shop section What action should I take now?
tion when practising coaching (P2: ‘…more participants were encouraged to coach one
aware of… times where I have been…direc- another after the workshop (‘co-coaching’)
tive in the school, and I maybe shouldn’t to work on their plans for coaching, and to
have been’). They felt supported and chal- increase the chance of implementation
lenged by the open questioning and active (Cornett & Knight, 2008, p.209). The work-
listening (P3: ‘It was more of a supportive shop did not devote time to the arrange-
environment than… the previous model’; ments. When being interviewed up to four
P5: ‘She was very good at listening’; P1: weeks later, none of the participants
‘When I look at these questions there’s no reported that they had set up a formal
hiding really’). arrangement. This raises a question about
whether participants would have set up the
GROW for leadership development. Other co-coaching arrangement if this section of
findings in the study are consistent with the the workshop, instead of simple encourage-
literature described. For example, one ment had used a coaching model that
participant reported success when using included a maintenance stage, for example
GROW for a colleague’s leadership develop- GROWTH (Growth Coaching International,
ment the day after the workshop (Grant et n.d.), or Skiffington and Zeus’ (2003) four-
al., 2010, p.162). stage model. Cornett and Knight (2008)
state that ‘one-shot professional develop-
First develop yourself. Creasy and Paterson’s ment without coaching follow-up does not
(2005) advice to school leaders ‘first develop lead to wide implementation’ (p.209). The
yourself’ (p.23) was not followed. Instead, participants did say that they planned to
the actions of all participants, whether teach- continue practising coaching, and they did
ers or school leaders, were congruent with not express concern about taking small
the principles of coaching; they showed steps. This concurs with Amabile and
interest in pulling not pushing coaching Kramer’s (2011) research into workplace
through the school (Whybrow & O’Riordan, motivation, in which they highlight the
2012, p.216). They were keen to move importance of small movements towards a
quickly so that the whole school community goal. Arnold (2014) reports that these
could learn together (P5: ‘a good approach ‘microresolutions’ build confidence because
to share with the whole staff’), and could they are more doable, so more likely to be
begin embedding ‘coach-like’ conversations implemented.
in school (Gross Cheliotes & Flemming
Reilly, 2010). The participants who were Positive psychology, critical moments and
unpromoted teachers displayed enthusiasm insights. The workshop began with a listen-
for putting their new knowledge and skills ing exercise intended to illustrate Fredrick-
into practice with colleagues and children son’s broaden-and-build theory of positive
(P1: ‘I do have a student [student teacher] emotions (2001, p.219). The findings do not
coming… so I’ve been thinking about… how include an explicit link to positive psychol-
I can help her’), and did not plan to wait ogy (Seligman & Csikszentmihalyi, 2000),
until their line managers became skilled. but we could speculate a link between the

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 199


Margaret Barr & Christian van Nieuwerburgh

positive emotions exercise and participants’ use’). Participants did not report thoughts
later experience of the workshop. During about using coaching to work with
coaching practice, participants experienced colleagues directly for improving teaching
‘critical moments’ (P5: ‘I thought, ‘You are and learning, for example instructional
not listening!’’), defined by de Haan (2008, coaching (Knight & van Nieuwerburgh,
p.92), as an ‘exciting, tense or significant 2012), which had not been covered in the
moment’ in a coaching conversation. While workshop.
reflecting outwith the practice coaching
session, they also experienced insights (P2: Fixer or Multiplier. Throughout the work-
‘This idea… was really enlightening to me’). shop, participants experienced both ‘reflec-
Colloquially called ‘Aha! moments’, insights tion-in-action’ (while they completed an
are sudden comprehensions that can result action) and ‘reflection-on-action’ (evaluat-
in a new interpretation of a situation and can ing past action) (Schön, 1987). When
point to the solution to a problem (Kounios reflecting-on-action, thinking about her
& Beeman, 2009, p.210; Sternberg & David- behaviour with others in school, one partici-
son, 1995; van Nieuwerburgh, 2014, p.160). pant became aware of a feature of her
In a study measuring brain activity, Subrama- behaviour with colleagues; she had chosen
niam et al. (2009) found that participants to keep ‘fixing’ and had no time to coach
were more likely to solve problems with (P5: ‘I’ve been so busy leading, directing and
insight if they were in a positive mood, than fixing in this school’). Like Reeves’ (2010)
if they were in a neutral or negative mood. Fixer, she had stopped giving people the
opportunity to struggle with challenging
A coaching approach to professional review problems (p.52). The workshop led her to
and development (PRD). The participants believe that a non-directive coaching
responded positively (both as coach and as approach to leadership and management
coachee) to the requirement that school gives responsibility to colleagues who then
leaders use coaching skills to support profes- develop their own problem-solving and
sional review and development (GTCS, analytical skills. To use Reeves’ (2010) term,
2013). They looked forward to the coaching she wanted to revert to being a Multiplier.
conversation giving them more responsibil-
ity for their own learning (P2: ‘I loved this Limitations of this study
idea of equality’). However, they recognised The study has several limitations and they
the responsibility (P1: ‘When I look at these should be taken into account when inter-
questions, there’s no hiding really’), and preting the findings. The researcher
they also reported disquiet that their experi- designed and facilitated the workshop,
ence of PRD relied on the coaching skills of designed the interview schedule, invited
the reviewer (P2: ‘Just the worry that, em, participation in the study, interviewed the
the success of this might land on the ability participants, and conducted the analysis.
of the other person’). This concurs with The researcher is also a former head teacher
Donaldson’s (2010) vision of teachers having and committed to coaching. First, it is possi-
a professional requirement to engage in ble that the participants may have
career-long learning, as well as an entitle- consciously or unconsciously emphasised
ment. positive experiences over negative because
of the positive relationship built up during
Wider uses for coaching. The participants the workshop. Second, the participants were
also reflected on wider uses for coaching all volunteers interested in talking about
with colleagues or learners (P3: ‘Made me their experience of the workshop, so they
think about the target-setting I do every may have been unconsciously biased. It is
month with the kids… the wording I could possible that non-volunteers interviewed by a

200 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Teachers’ experiences of coaching training

third party would have given different to increase access to coaching training for
answers. Third, there is a risk that bias teachers who find attendance at face-to-face
affected the collection and analysis of the workshops difficult because of scarcity of
data, despite attempts to conduct the study finance or supply teachers. If the workshop
scrupulously, including supervisor discus- were delivered through an alternative
sions and reflective journaling. Fourth, the model, for example online video conferenc-
study could not be replicated in exactly the ing and interactive forums, which helped
same context. The workshops took place in participants feel they were interacting with
September 2013 as part of a pilot other people (Okita et al., 2007), the educa-
programme, when teachers were preparing tors may be interested to know if partici-
for the introduction of new procedures in pants’ experiences followed the same
August 2014. If the workshop were repeated themes as those in this study. A mixed
in Scotland, the new procedures would method or qualitative study would also reveal
already be in place. any additional experiences that were not
A further consideration relates to the use manifested in the face-to-face workshop. The
of IPA. It was appropriate for interpreting fourth suggestion relates to the matter of
the idiographic accounts of the participants’ line manager coaching in the PRD process,
experiences, which are of interest in them- which is outwith the scope of this study.
selves, and it does not permit generalisation. Teachers’ experiences of coaching training
Hefferon and Gil-Rodriguez, (2011, p.758) could be explored with specific reference to
advise that, rather than generalising IPA their context – either as a reviewee who will
findings, we consider possible transferability be coached by their line manager, or as the
of findings from group to group. However line manager coach who will conduct the
further research is needed. review.

Implications for practice and for future Conclusion


research I remember feeling, kind of accom-
The findings of the study act as a foundation plished after it. …I think until you do
for further research on teachers’ experi- something, you don’t really understand
ences of coaching training. The study could how it’s gonna [sic] work. (P3:
also help construct one or more hypotheses 1403–1465)
for quantitative testing. The study aspired to respond to Linley and
Four suggestions are now made which Harrington’s (2008, p.52) call for more prag-
could extend our knowledge. First, a hypoth- matic science that genuinely serves the
esis could be tested quantitatively – it is needs of researchers and practitioners. It has
hypothesised that participants will experi- presented five individuals’ experiences of an
ence more insights if the workshop begins introductory coaching training workshop.
with an activity to generate positive Participants noticed that collaborating with
emotions. Second, a longitudinal study others through practice and shared mean-
could look at the extent of implementation ing-making enhanced their learning, which
following introductory training workshops. was further enriched by time for reflection.
The study could compare settings with and They experienced coaching from both sides
without formally-arranged follow-up co- of the conversation, and as an observer.
coaching, relating closely to Cornett and Reflecting on their own skills and
Knight’s (2008) findings that coaching after behaviours, they began to plan their next
professional development led to improved steps. Further research is needed to build on
implementation rates. The third suggestion the findings of this study.
might be of interest to educators attempting

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 201


Margaret Barr & Christian van Nieuwerburgh

The Authors Correspondence


Margaret Barr Margaret Barr
MSc Coaching Psychology student Email:
at the University of East London. margaretbarr2014@btopenworld.com

Dr Christian van Nieuwerburgh


Senior Lecturer in School of Psychology
at the University of East London.

References
Amabile, T. & Kramer, S. (2011). The progress principle: Cornett, J. & Knight, J. (2008). Research on coach-
Using small wins to ignite joy, engagement, and ing. In J. Knight (Ed.), Coaching: Approaches and
creativity at work. Boston, MA: Harvard Business perspectives (pp.192–216). Thousand Oaks, CA:
School. Corwin.
Arnold, C.L. (2014). Small move, big change: Using Corrie, S. (2013). Developing coaching psychology as an
micro-resolutions to transform your life permanently. evidence-based discipline: Challenges, opportunities
New York: Penguin. and seeking new horizons. Presentation at 4th Euro-
Arnott, M.A. & Ozga, J. (2010). Education and pean Coaching Psychology Conference in Edin-
nationalism: The discourse of education policy in burgh, December. London: Special Group in
Scotland. Discourse: Studies in the Cultural Politics of Coaching Psychology.
Education, 31(3), 335–350. Coyle, A. (2007). Introduction to qualitative psycho-
Bainger, L. (2011). Giving teachers a voice: Using logical research. In E. Lyons & A. Coyle (Eds.),
interpretative phenomenological analysis in Analysing qualitative data in psychology (pp.98–115).
music education research. Music Education London: Sage.
Research and Innovation, 14(1), 32–38. Creasy, J. & Paterson, F. (2005). Leading coaching in
Bramley, N. & Eatough, V. (2005). The experience of schools. Nottingham: National College for School
living with Parkinson’s disease: An interpretative Leadership.
phenomenological analysis case study. Psychology Creswell, J. (2003). Research design: Qualitative quanti-
and Health, 20(2), 223–235. tative and mixed methods approaches. London: Sage.
Braun, V. & Clarke, V. (2006). Using thematic analy- de Haan, E. (2008). I doubt therefore I coach:
sis in psychology. Qualitative Research in Psychology, Critical moments in coaching practice. Consulting
3(2), 77–101. Psychology Journal: Practice and Research, 60(1),
British Psychological Society (BPS) (2009). Code of 91–105.
ethics and conduct: Guidance published by the Department for Education and Skills (DfES) (2003).
Ethics Committee of the British Psychological Society. Sustaining improvement: A suite of modules on coach-
Leicester: BPS. ing, running networks and building capacity.
Brocki, J.J.M. & Wearden, A.J. (2006). A critical eval- Nottingham: DfES.
uation of the use of interpretative phenomeno- Donaldson, G. (2010). Teaching Scotland’s future:
logical analysis (IPA) in health psychology. Report of a review of teacher education in Scotland.
Psychology and Health, 21(1), 87–108. Edinburgh: The Scottish Government.
Bryce, T. & Humes, W. (Eds.) (2008). Scottish educa- Education Scotland (2014). Flexible route to Headship
tion beyond devolution. (3rd ed.). Edinburgh: Programme. Retrieved 10 July 2014, from:
Edinburgh University Press. www.educationscotland.gov.uk/Images/
Cavanagh, M. (2013). The coaching engagement in FRH8_Leaflet_Final_tcm4-826313.pdf
the 21st century: New paradigms for complex Forde, C. (2011). Approaches to professional learn-
times. In S. David, D. Clutterbuck & D. Meggin- ing: Coaching, mentoring and building collabo-
son (Eds.), Beyond goals: Effective strategies for coach- ration. In C. Forde & J. O’Brian (Eds.), Coaching
ing and mentoring (pp.151–184). London: Gower and mentoring: Developing teachers and leaders. Edin-
Publishing. burgh: Dunedin Academic Press
Centre for the Use of Research and Evidence in Forde, C., McMahon, M., Gronn, P. & Martin, M.
Education (CUREE) (2005). National framework (2013). Being a leadership development coach:
for coaching. London: CUREE. A multi-faceted role. Educational Management
Clancy, A.L. & Binkert, J. (2010). Appreciative coach- Administration & Leadership, 41, 105.
ing: Pathway to flourishing. In J. Passmore (Ed.),
Excellence in coaching: The industry guide (2nd ed.,
pp.147–156). London: Kogan Page.

202 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Teachers’ experiences of coaching training

Fredrickson, B.L. (2001). The role of positive HM Inspectorate of Education (HMIE) (2009).
emotions in positive psychology: The broaden- Learning together: Improving teaching, improving
and-build theory of positive emotions. American learning. The roles of continuing professional develop-
Psychologist, 56, 218–226. ment, collegiality and chartered teachers in implement-
General Teaching Council for Scotland (GTC Scot- ing curriculum for excellence. Livingston, UK:
land) (2012). Revised professional standards. HMIE.
Edinburgh: GTC Scotland. Retrieved 15 July Holloway, I. & Todres, L. (2003). The status of
2014, from: www.gtcs.org.uk/standards/stan- method: Flexibility, consistency and coherence.
dards.aspx Qualitative Research, 3, 345–357.
General Teaching Council for Scotland (GTC Scot- Ives, Y. (2008). What is ‘coaching’? An exploration of
land) (2013). Professional update. Edinburgh: conflicting paradigms. International Journal of
GTC Scotland. Retrieved 15 July 2014, from: Evidence Based Coaching and Mentoring, 6(2),
www.gtcs.org.uk/professional-development/ 100–113.
professional-update.aspx Jackson, P. & Waldman, J. (2011). Positively speaking:
General Teaching Council for Scotland (GTC Scot- The art of constructive conversation with a solutions
land) (2014a). Coaching and mentoring. focus. St Albans: The Solutions Focus.
Edinburgh: GTC Scotland. Retrieved 14 August Jarman, M., Smith, J.A. & Walsh, S. (1997). The
2014, from: psychological battle for control: A qualitative
www.gtcs.org.uk/professional-update/ study of health care professionals’ understand-
coaching-and-mentoring.aspx ings of the treatment of anorexia nervosa. Journal
General Teaching Council for Scotland (GTC Scot- of Community and Applied Social Psychology, 7,
land) (2014b). Sharing practice in professional 137–152
update for employers. Edinburgh: GTC Scotland. Kline, N. (1999). Time to think: listening to ignite the
Retrieved 6 August 2014, from: human mind. London: Cassell.
www.gtcs.org.uk/professional-update/ Knight, J. & van Nieuwerburgh, C.J. (2012). Instruc-
sharing-practice-in-professional-update.aspx tional coaching: A focus on practice. Coaching:
Grant, A.M., Green, L.S. & Rynsaardt, J. (2010). An International Journal of Theory, Research and
Developmental coaching for high school teach- Practice, 5(2), 1–13.
ers: Executive coaching goes to school. Consulting Kounios, J. & Beeman, M. (2009). The aha! moment:
Psychology Journal, Practice and Research, 62(3), The cognitive neuroscience of insight. Current
151–168. Directions in Psychological Science, 18(4), 210–216.
Green, L.S., Oades, L.G. & Robinson, P. (2012). Linley, P.A. & Harrington, S. (2008). Integrating posi-
Positive psychology and coaching psychology. In tive psychology and coaching psychology: Shared
C.J. van Nieuwerburgh (Ed.), Coaching in educa- assumptions and aspirations? In S. Palmer &
tion: Getting better results for students, educators and A. Whybrow (Eds.), Handbook of coaching psychol-
parents (pp.115–132). London: Karnac. ogy: A guide for practitioners. Hove: Routledge.
Gross Cheliotes, L. & Flemming Reilly, M. (2010). Lofthouse, R., Leat, D. & Towler, C. (2010). Coaching
Coaching conversations: Transforming your school one for teaching and learning: A practical guide for
conversation at a time. Thousand Oaks, CA: Sage. schools. Nottingham: CfBT Education Trust.
Growth Coaching International (n.d.) The GROWTH National College for Teaching & Leadership
Approach. Retrieved 18 August 2014, from: (NCT&L) (2014). Coaching. Nottingham:
www.growthcoaching.com.au/Default.aspx? NCT&L. Retrieved 14 August 2014, from:
PageID=3385088&A=SearchResult&Search www.nationalcollege.org.uk/index/resources/
ID=6376417&ObjectID=3385088&ObjectType=1. leadingschools/developing-leadership-in-your-
Gyllensten, K. & Palmer, S. (2006). Experiences of school/coaching
coaching and stress in the workplace: An inter- Okita, S.Y., Bailenson, J. & Schwartz, D.L. (2007).
pretative phenomenological analysis. Interna- The mere belief of social interaction improves
tional Coaching Psychology Review, 1(1), 86–98. learning. In D.S. McNamara & J.G. Trafton
Gyllensten, K., Palmer, S., Nilsson, El, Regner, A. M. (Eds.), The proceedings of the 29th meeting of the
& Frodi, A. (2010). Experiences of cognitive Cognitive Science Society (pp.1355–1360).
coaching: A qualitative study. International Coach- Nashville, Tennessee.
ing Psychology Review, 5(2), 98–108. Ozga, J. (2005). Modernising the education work-
Hefferon, K. & Gil-Rodriguez, E. (2011). Interpreta- force: A perspective from Scotland. Educational
tive phenomenological analysis. The Psychologist, Review, 57(2), 207–219.
24(10), 754–759. Pask, R. & Joy, B. (2007). Mentoring-coaching: A hand-
book for education professionals. Maidenhead: Open
University Press/McGraw Hill Education.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 203


Margaret Barr & Christian van Nieuwerburgh

Raffe, D. (2004). How distinctive is Scottish educa- Stelter, R., Nielsen, G. & Wikman, J. (2011). Narra-
tion? Five perspectives on distinctiveness. Scottish tive-collaborative group coaching develops social
Affairs, 49, 50–72. capital – a randomised control trial and further
Reeves, D.B. (2010). Fixer or Multiplier? American implications of the social impact of the interven-
School Board Journal, September 2010, 52–53. tion. Coaching: An International Journal of theory,
Alexandria, VA: National School Boards Associa- Research and Practice, 4(2), 123–137.
tion. Sternberg, R.J. & Davidson, J.E. (Eds.) (1995).
Schön, D.A. (1987). Teaching artistry through reflec- The nature of insight. Cambridge, MA: MIT Press.
tion-in-action. In Educating the reflective practi- Subramaniam, K., Kounios, J., Parrish, T.B. & Jung-
tioner: Toward a new design for teaching and learning Beeman, M. (2009). A brain mechanism for facil-
in the professions (pp.22–40). San Francisco: itation of insight by positive affect. Journal of
Jossey-Bass. Cognitive Neuroscience, 21, 415–432.
Scottish College for Educational Leadership (SCEL) Suggett, N. (2006). Time for coaching. Nottingham:
(2014). Resources. Glasgow: SCEL. Retrieved National College for School Leadership.
17 August 2014, from: Timotijevic, L. & Breakwell, G.M. (2000). Migration
www.scelscotland.org.uk/professionallearning/ and threat to identity. Journal of Community &
resources.asp Applied Social Psychology, 10, 355–372.
Seligman, M.E.P. & Csikszentmihalyi, M. (2000). Tulving, E. & Pearlstone, Z. (1966). Availability versus
Positive psychology: An introduction. American accessibility of information in memory for words.
Psychologist, 55(1), 5-14. Journal of Verbal Learning and Verbal Behavior, 5,
Seligman, M.E.P., Ernst, R.M., Gillham, J., Reivich, K. 381 391.
& Linkins, M. (2009). Positive education: Positive van Nieuwerburgh, C.J. (Ed.) (2012). Coaching in
psychology and classroom interventions. Oxford education: Getting better results for students, educators,
Review of Education, 35(3), 293–311. and parents. London: Karnac.
Showers, B. & Joyce, B. (1996). The evolution of peer van Nieuwerburgh, C.J. (2014). An introduction to
coaching. Educational Leadership, 53(6), 12–16. coaching skills: A practical guide. London: Sage.
Skiffington, S. & Zeus, P. (2003). Behavioural coaching: van Nieuwerburgh, C.J. & Tong, C. (2013). Exploring
How to build sustainable personal and organisational the benefits of being a student coach in educa-
strength. North Ryde, NSW: McGraw-Hill. tional settings: A mixed-method study. Coaching:
Smith, J.A. (1995). Semi-structured interviewing and An International Journal of Theory, Practice and
qualitative analysis. In J.A. Smith, R. Harre & Research, 6(1), 5–24.
L. Van Langenhove (Eds.), Rethinking methods in Watkins, M.J. & Tulving, E. (1975). Episodic memory:
psychology (pp.9–26). London: Sage. When recognition fails. Journal of Experimental
Smith, J.A., Flowers, P. & Larkin, M. (2009). Interpre- Psychology: General, 104, 5–29.
tative phenomenological analysis: Theory, method and Whitmore, J. (2009). Coaching for performance: GROW-
research. London: Sage. ing human potential and purpose: The principles and
Smith, J.A. & Osborn, M. (2004). Interpretative practice of coaching and leadership (4th ed.).
phenomenological analysis. In G.M. Breakwell London: Nicholas Brealey.
(Ed.), Doing social psychology research Whybrow, A. & O’Riordan, S. (2012). Developing a
(pp.229–254). Oxford: BPS Blackwell. coaching culture at work. In M. Neenan & S.
Stelter, R. (2013). Third generation coaching. Presenta- Palmer (Eds.), Cognitive behavioural coaching in
tion at 4th European Coaching Psychology practice: An evidence-based approach (pp.203–236).
Conference in Edinburgh, December. London: London: Routledge.
Special Group in Coaching Psychology. Willig, C. (2008). Introducing qualitative research in
psychology: Adventures in theory and method
(2nd ed.). Maidenhead: Open University Press.

204 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Report
Special Group in Coaching Psychology News
Dasha Grajfoner

S WE ARE ENTERING the second

A half of the year, we have been busy


with a variety of activities. Two
surveys – one at the last conference in 2014
and one sent out recently – have clearly indi-
cated what you, our members, are expecting
from your Special Group. Your views in
combination with the British Psychological
Society’s Strategic Plan have shaped both the
strategic plan of the SGCP and our current
projects, which include CPD events, develop-
ing our Coaching Psychology Research
Network, exploring Training and Accredita-
tion routes for Coaching Psychologists and
of course organising the 5th European
Coaching Psychology Conference.
To begin with I must mention our lineup tion’. This will be delivered by Chartered
of CPD events. At the time of publishing this Psychologists Hannah Azizollah and Kajal
issue of ICPR, our 2015 CPD programme is Ruparell on 8 September.
well underway with three workshops having Our final CPD event this year will be the
already been delivered in London. The SGCP professional practice workshop on the
‘Positive psychology and authentic well- 26 October, entitled ‘Psychological Interven-
being’ workshop was presented by Dr Sue tions for a Variety of Contexts: Issues of
Roffey on 30 March, and was a joint offering Design and Implementation’ presented by
from the SGCP, the Division of Health Dr Aneta Tunariu and Professor Rachel
Psychology, the Community Psychology Tribe.
Section, and the Social Psychology Section. These events are open to non-SGCP
The ‘Essential neuro-linguistic skills for members and the general public.
coaching psychologists’ workshop was an An exclusive additional CPD event – a
SGCP offering delivered by Dr Rene Bosman full-day Masterclass – will be run by Dr Suzy
on the 27 May. Green on positive psychology coaching. The
The ‘Self Composing: A new approach in event will take place in December just before
Leadership coaching’, was presented by the European Conference (for more details
Dr Ton Voogt on 26 June. Our events team, and registration please check the sgcp.eu
led by Andy Colville, reports that all work- website).
shops up to date were fully attended and Submissions for our 2016 CPD
were a great success. programme have been received, and our
The next CPD event coming up is an events team are working with the Society’s
SGCP and Division of Occupational Psychol- Professional Development Centre to select
ogy shared workshop called ‘Overcoming the workshops representing topics requested
resistance to change using process consulta- by you, our members.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 205


© The British Psychological Society – ISSN: 1750-2764
Dasha Grajfoner

The second activity I would like to high- that support our conference theme, ‘Break-
light is the development of The Coaching ing New Ground’. In addition, we can
Psychology Research Network, which was announce that the streams running across
inaugurated at the 4th International the two days of the conference will be: ‘Lead-
Congress of Coaching Psychology in Decem- ership, Executive and Business Coaching’,
ber last year. The development of the ‘Positive Psychology Coaching (including
Research Network is important on a number Resilience)’, Tools and Techniques in Coach-
of levels and is consistent with the strategic ing Psychology (including CPD and Peer
objectives of the SGCP and the Society more Practice)’ and ‘Coaching Psychology
broadly. Research Network (including international
The aims of the Research Network are to collaborations and developments, collabora-
enable excellence in coaching psychology tions between practice and research, and new
research through facilitating dialogue and emerging research and evidence-based
debate; promoting and enhancing awareness practice)’. Conference Co-Chairs David Tee
of coaching psychology research and practice and Michael Webster have managed to
through the dissemination of results and organise an exciting line-up of keynote speak-
establishing a community of coaching psychol- ers. The information is available on our
ogy researchers and practitioners that will conference website, so please do visit us,
stimulate new research interests and ventures. submit your abstract or register for attending
The Research Network also aims to connect the event.
people across specialisms and areas of interest, Last but not least, I would like to say
both nationally and internationally, for the thank you to Professor Stephen Palmer, who
purposes of research collaboration. will be stepping down following 10 volumes
We are actively recruiting members who as the UK Co-ordinating Editor of ICPR after
have an interest in research matters and this September 2015 issue.
strengthening the evidence-base of coaching Stephen has done a stellar job as the
psychology, so if you would like to be Founder and Editor of the ICPR. The publi-
involved in research collaborations please cation has become highly influential in the
contact our Research Officer, Professor field of coaching psychology under his lead-
Sarah Corrie, at sarah.corrie@pdf.net. ership.
Following the success of our 10th anniver- The SGCP Committee and I look forward
sary conference last year, plans are well afoot very much to meeting you at our CPD events
for this year’s event, entitled 5th European or in December for what is always a popular,
Coaching Psychology Conference: ‘Breaking friendly and informative occasion and one of
New Ground’. The event will be held over the highlights of the Coaching Psychology
10–11 December 2015 at the Holiday Inn, calendar.
Bloomsbury, in London, as the venue proved
such a success with our delegates previously. Dr Dasha Grajfoner
We are inviting submissions of abstracts via Chair of the Special Group in
our conference website: http://www.sgcp.eu Coaching Psychology
and are particularly interested in submissions Email: sgcpchair@bps.org.uk

206 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Report
Interest Group in Coaching Psychology News
Nic Eddy

I
N PREVIOUS REPORTS, I have discussed
the Coaching Psychology Interest Group’s
evolving strategic marketing efforts –
moving away from an earlier emphasis on
the merits of coaching psychologists and
coaching psychology to one of exploring the
contribution of psychology to best practice
coaching. This inclusive emphasis has
allowed us to address more readily the
professional development needs of those
coaches – psychologists or not – who aspire
to best practice coaching, as well as to the
needs of those HR practitioners and
purchasers of coaching who seek to improve
the utility of their coaching programs both
in initial coach engagement as well as post- the experience and satisfaction of Congress
assignment evaluation. participants as well as presenters.
Our most significant activity over the last l By comparison with the relatively focused
year has been the International Congress on emphasis on coaching at the 4th ICCP,
Coaching Psychology (4th ICCP) held in the IOP Conference was attempting to do
Melbourne in November 2014. I have previ- justice to a plethora of topics that fall
ously discussed (see ICPR Vol. 10 No. 1 under the umbrella of organisational
March 2015 pp.111–112) some of our early psychology.
evaluation of both qualitative feedback and l All presenters at the 4th ICCP were
quantitative data collected from the Novem- invited and then briefed/coached on
ber Congress in exploring whether we had presenting effectively to an audience of
been successful in meeting our more strate- experienced practitioners. With the IOP
gic aspirations. Whilst considering how we Conference, with the exception of
might improve a next Congress, we also took keynote presenters, the more common
a moment to pause and notice the profes- psychology conference approach was
sional satisfaction that arises when core adopted with the IOP Conference Scien-
processes and factors align: tific Committee seeking submissions
determining participant needs, design, from presenters for inclusion in the
implementation and evaluation. Conference programme.
The recent APS Industrial and Organisa- l Appealing to a relatively narrow band of
tional Psychology (IOP) Conference held in coaches who aspire to best practice
July 2015, Melbourne offered an unexpected implies training, maturity and experi-
opportunity to reflect on how factors such as ence. Not surprisingly, it appeared to me
the Congress underlying purpose, partici- that the majority of 4th ICCP participants
pant needs, program design, and presenter reflected this experience and were on
selection and presentation coaching affect average, notably older than the far more

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 207


© The British Psychological Society – ISSN: 1750-2764
Nic Eddy

diverse IOP participant age range and A different approach for 2016
hence a far greater diversity of individual The Coaching Psychology Interest Group
professional development needs. has conducted a Symposium, or in later
Two conferences with differing underlying years, a Congress every two years since 2004.
factors that require very different approaches However, we will be adopting a different
to conference design. approach for 2016. In September next year,
Can we say which conference design is the APS will be hosting its 50th Annual
more effective? As the previous points I think Conference and in honour of its half-
make clear, this is a misleading question century, has requested Colleges and Interest
without a clear understanding of the partic- Groups not run separate conferences during
ular conference purpose and participant the year but rather contribute to a mega-
needs. conference celebrating psychology in all its
Considering the challenges facing the forms and applications.
IOP Conference Organising Committee The Coaching Psychology Interest Group
provided an excellent lens to reflect that the National Committee is exploring how we can
success of the 4th ICCP was determined make a substantial contribution at the APS
easily as much by its particular and necessary Annual Conference, and will be adding to
organising design as by the subsequent this with a series of national ‘road shows’ in
performance of presenters on the day. In the first seven months of the year. These
appealing to those coaches, those practition- road shows will add to the ongoing profes-
ers, seeking to explore the contribution of sional development events organised by
psychology to best practice coaching then respective State Committees.
the Congress organisers’ approach of Which leaves me with an excellent oppor-
inviting all presenters – not just keynote tunity to thank the continuing efforts of my
presenters – and briefing them effectively on colleagues in Perth, Adelaide, Canberra,
the specific needs of an audience of experi- Melbourne, Sydney, and Brisbane as well as
enced practitioners resulted in an excellent my colleagues on the National Committee.
platform to deliver the outcome we sought.
Cheers.

Nic Eddy
National Convener
Interest Group on Coaching Psychology
Australian Psychological Society
Email: niced@bigpond.net.au

208 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


The Docklands Waterfront, Melbourne.

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 209


International Coaching Psychology Review
– Volume index 2015
Volume 10, No. 1, March 2015

4 Editorial: Celebrating our 10th volume of the


International Coaching Psychology Review
Stephen Palmer & Sandy Gordon
Papers
6 How coaching helps leadership resilience: The leadership perspective
Carmelina Lawton Smith
20 There is no leadership if no-one follows: Why leadership is necessarily a group process
Michael J. Platow, S. Alexander Haslam, Stephen D. Reicher & Niklas K. Steffens
38 Differences between critical moments for clients, coaches, and sponsors of coaching
Erik de Haan & Christiane Nieß
62 Helping people to ‘make things happen’: A framework for proactivity at work
Sharon K. Parker & Ying Wang
76 The experience of cognitive behavioural group coaching with college students:
An IPA study exploring its effectiveness
Pepita Torbrand & Vicky Ellam-Dyson
94 Clients’ experiences of Intentional Personality Change Coaching
Lesley S. Martin, Lindsay G. Oades & Peter Caputi
Reports
109 Special Group in Coaching Psychology News
Dasha Grajfoner
111 Interest Group in Coaching Psychology News
Nic Eddy

210 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


Volume 10, No. 2, September 2015

116 Editorial: 10 years, 10 volumes of the International Coaching Psychology Review


Stephen Palmer & Sandy Gordon
Papers
118 Who sees change after leadership coaching? An analysis of impact by rater level
and self-other alignment on multi-source feedback.
Doug MacKie
131 Authentic Leaders are… conscious, competent, confident, and congruent:
A Grounded Theory of Group Coaching and Authentic Leadership Development
Tony Fusco, Siobhain O’Riordan & Stephen Palmer
149 Walking a mile in an executive’s shoes: The influence of shared client-coach
experience on goal achievement
Alex T. Chinn, James P. Richmond & John L. Bennett
161 Using Clean Language to explore the subjectivity of coachees’ experience
and outcomes
Susie Linder-Pelz & James Lawley
175 Evaluating a coaching and mentoring programme: Challenges and solutions
Tatiana Bachkirova, Linet Arthur & Emma Reading
190 Teachers’ experiences of an introductory coaching training workshop in Scotland:
An interpretative phenomenological analysis
Margaret Barr & Christian van Nieuwerburgh
Reports
205 Special Group in Coaching Psychology News
Dasha Grajfoner
207 Interest Group in Coaching Psychology News
Nic Eddy

210 International Coaching Psychology Review – Volume index 2015

International Coaching Psychology Review l Vol. 10 No. 2 September 2015 211


Notes

212 International Coaching Psychology Review l Vol. 10 No. 2 September 2015


4. Online submission process
(1) All manuscripts must be submitted to a Co-ordinating Editor by email to:
Stephen Palmer (UK): s.palmer-1@city.ac.uk
Sandy Gordon (Australia): sandy.gordon@uwa.edu.au
(2) The submission must include the following as separate files:
l Title page consisting of manuscript title, authors’ full names and affiliations, name and address for corresponding author.
l Abstract.
l Full manuscript omitting authors’ names and affiliations. Figures and tables can be attached separately if necessary.
5. Manuscript requirements
l Contributions must be typed in double spacing with wide margins. All sheets must be numbered.
l Tables should be typed in double spacing, each on a separate page with a self-explanatory title. Tables should be comprehensible
without reference to the text. They should be placed at the end of the manuscript with their approximate locations indicated in
the text.
l Figures can be included at the end of the document or attached as separate files, carefully labelled in initial capital/lower case
lettering with symbols in a form consistent with text use. Unnecessary background patterns, lines and shading should be avoided.
Captions should be listed on a separate page. The resolution of digital images must be at least 300 dpi.
l For articles containing original scientific research, a structured abstract of up to 250 words should be included with the
headings: Objectives, Design, Methods, Results, Conclusions. Review articles should use these headings: Purpose, Methods, Results,
Conclusions.
l Overall, the presentation of papers should conform to the British Psychological Society’s Style Guide (available at www.bps.org.uk/
publications/publications_home.cfm in PDF format). Non-discriminatory language should be used throughout. Spelling should be
Anglicised when appropriate. Text should be concise and written for an international readership of applied psychologists.
Sensationalist and unsubstantiated views are discouraged. Abbreviations, acronyms and unfamiliar specialist terms should be
explained in the text on first use.
l Particular care should be taken to ensure that references are accurate and complete. Give all journal titles in full. Referencing
should follow BPS formats. For example:
Billington, T. (2000). Separating, losing and excluding children: Narratives of difference. London: Routledge/Falmer.
Elliott, J.G. (2000). Dynamic assessment in educational contexts: Purpose and promise. In C. Lidz & J.G. Elliott (Eds.),
Dynamic assessment: Prevailing models and applications (pp.713–740). New York: J.A.I. Press.
Palmer, S. & Whybrow, A. (2006). The coaching psychology movement and its development within the British Psychological
Society. International Coaching Psychology Review 1(1), 5–11.
l SI units must be used for all measurements, rounded off to practical values if appropriate, with the Imperial equivalent in
parentheses.
l In normal circumstances, effect size should be incorporated.
l Authors are requested to avoid the use of sexist language.
l Authors are responsible for acquiring written permission to publish lengthy quotations, illustrations, etc. for which they do not
own copyright.
6. Brief reports
These should be limited to 1000 words and may include research studies and theoretical, critical or review comments whose essential
contribution can be made briefly. A summary of not more than 50 words should be provided.
7. Publication ethics
BPS Code of Conduct – Code of Conduct, Ethical Principles and Guidelines.
Principles of Publishing – Principle of Publishing.
8. Supplementary data
Supplementary data too extensive for publication may be deposited with the British Library Document Supply Centre. Such material
includes numerical data, computer programs, fuller details of case studies and experimental techniques. The material should be
submitted to the Editor together with the article, for simultaneous refereeing.
9. Post acceptance
PDF page proofs are sent to authors via email for correction of typesetting but not for rewriting or the introduction of new material.
Corrections at this stage in production due to errors made by an author may incur a fee payable by the author or their institution.
10. Copyright
To protect authors and publications against unauthorised reproduction of articles, The British Psychological Society requires copyright
to be assigned to itself as publisher, on the express condition that authors may use their own material at any time without
permission. On acceptance of a paper, authors will be requested to sign an appropriate assignment of copyright form.
11. Checklist of requirements
l Abstract (100–200 words).
l Title page (include title, authors’ names, affiliations, full contact details).
l Full article text (double-spaced with numbered pages and anonymised).
l References (see above). Authors are responsible for bibliographic accuracy and must check every reference in the manuscript and
proofread again in the page proofs.
l Tables, figures, captions placed at the end of the article or attached as separate files.
Contents
116 Editorial: 10 years, 10 volumes of the International Coaching Psychology Review
Stephen Palmer & Sandy Gordon
Papers
118 Who sees change after leadership coaching? An analysis of impact by rater level
and self-other alignment on multi-source feedback.
Doug MacKie
131 Authentic Leaders are… conscious, competent, confident, and congruent:
A Grounded Theory of Group Coaching and Authentic Leadership Development
Tony Fusco, Siobhain O’Riordan & Stephen Palmer
149 Walking a mile in an executive’s shoes: The influence of shared client-coach
experience on goal achievement
Alex T. Chinn, James P. Richmond & John L. Bennett
161 Using Clean Language to explore the subjectivity of coachees’ experience
and outcomes
Susie Linder-Pelz & James Lawley
175 Evaluating a coaching and mentoring programme: Challenges and solutions
Tatiana Bachkirova, Linet Arthur & Emma Reading
190 Teachers’ experiences of an introductory coaching training workshop in Scotland:
An interpretative phenomenological analysis
Margaret Barr & Christian van Nieuwerburgh
Reports
205 Special Group in Coaching Psychology News
Dasha Grajfoner
207 Interest Group in Coaching Psychology News
Nic Eddy

210 International Coaching Psychology Review – Volume index 2015

St Andrews House, 48 Princess Road East, Leicester LE1 7DR, UK


Tel 0116 254 9568 Fax 0116 227 1314 E-mail mail@bps.org.uk www.bps.org.uk
© The British Psychological Society 2015
Incorporated by Royal Charter Registered Charity No 229642

You might also like