Professional Documents
Culture Documents
Difficult Incidents and Tutor Interventions in Problem-Based Learning Tutorials
Difficult Incidents and Tutor Interventions in Problem-Based Learning Tutorials
CONTEXT Tutors report difficult incidents student’ or ‘group dynamics’. Tutors described
and distressing conflicts that adversely affect 142 interventions in response to these difficult
learning in their problem-based learning (PBL) incidents, categorised as: (i) tutor intervenes
groups. Faculty development (training) and during tutorial; (ii) tutor gives feedback outside
peer support should help them to manage this. tutorial, or (iii) student or group intervenes.
Yet our understanding of these problems and Incidents in the ‘individual student’ category
how to deal with them often seems inadequate were addressed relatively unsuccessfully (effec-
to help tutors. tive < 50% of the time) by response (i), but with
moderate success by response (ii) and success-
OBJECTIVES The aim of this study was to cat- fully (> 75% of the time) by response (iii).
egorise difficult incidents and the interventions None of the interventions worked well when
that skilled tutors used in response, and to used in response to problems related to ‘group
determine the effectiveness of those responses. dynamics’. Overall, 59% of the difficult
incidents were dealt with successfully.
METHODS Thirty experienced and highly rated
tutors in our Year 1 and 2 medical curriculum CONCLUSIONS Dysfunctional PBL groups
took part in semi-structured interviews to: iden- can be highly challenging, even for experi-
tify and describe difficult incidents; describe how enced and skilled tutors. Within-tutorial
they responded, and assess the success of each feedback, the treatment that tutors are most
response. Recorded and transcribed data were frequently advised to apply, was often not
analysed thematically to develop typologies of effective. Our study suggests that the collective
difficult incidents and interventions and responsibility of the group, rather than of the
compare reported success or failure. tutor, to deal with these difficulties should be
emphasised.
RESULTS The 94 reported difficult incidents
belonged to the broad categories ‘individual
1 5
Department of Cellular and Physiological Sciences, Faculty of Department of Pathology and Laboratory Medicine, Faculty of
Medicine, University of British Columbia, Vancouver, British Medicine, University of British Columbia, Vancouver, British
Columbia, Canada Columbia, Canada
2
MD Undergraduate Program, Faculty of Medicine, University of
Correspondence: Pawel Kindler, Room 1545, Life Sciences Centre,
British Columbia, Vancouver, British Columbia, Canada
3 2350 Health Sciences Mall, Vancouver, British Columbia V6T 1Z3,
MD Class of 2008, Faculty of Medicine, University of British
Canada. Tel: 00 1 604 827 5959; Fax: 00 1 604 822 8720;
Columbia, Vancouver, British Columbia, Canada
4 E-mail: pkindler@interchange.ubc.ca
School of Population and Public Health, Faculty of Medicine,
University of British Columbia, Vancouver, British Columbia, Canada
866 ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873
Difficult incidents in problem-based learning
ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873 867
P Kindler et al
868 ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873
Difficult incidents in problem-based learning
7 Challenged by tutorial process. A single incident of students hated each other, didn’t get along’;
this type involved a student who ‘was completely ‘group consisted of hesitant, timid, trying-to-
overworked by the attempts to thoroughly maintain-low-profile students’, and ‘one really
address all learning issues’. bad group; one student required to be at the
centre of attention, two of his friends always
backed him up, [the] remaining five students
Group dynamics category were extremely quiet’.
5 Difficulties with the tutorial process. Group dynamics
A little more than half of the difficult incidents were sometimes adversely affected by challenges
belonged to this category. They involved either one inherent in the PBL tutorial process. Comments
or more individuals or the entire tutorial group and, included: ‘[the] student insisted on endless
on several occasions, the tutor. discussions, often about matters beyond the
scope of the tutorial, as a result of presupposi-
1 Tensions between a student or group and tutor. tions regarding a proper tutorial format’; ‘stu-
Incidents in this type were described as being very dents in [an] otherwise brilliant group went up to
challenging to the tutor. For example, a student or the board to draw diagrams straight from the
group demanded that a tutor be a passive observer lectures in order to please the tutor’, and ‘group
or that a tutor change his or her style of facilitation presented confounding information’.
or ‘way of doing things’. Several incidents involved
groups’ insistence on starting tutorials up to The overall success rate of all responses was 59%
30 minutes late, reducing the length and number (55 ⁄ 94). Among unsuccessful responses, 33% com-
of tutorials or refusing to provide meaningful prised a single unsuccessful intervention and 67%
group feedback. The remaining incidents involved consisted of multiple unsuccessful interventions. The
individual students making remarks to the tutor success rate of responses to each type of difficult
that were strong and inappropriate, harshly criti- incident varied from 23% to 100% (Table 1). Overall,
cal, or included accusations of inappropriate
behaviour or attempts to pressure the tutor to
boost end-of-block grades.
Table 1 Types of difficult incidents and success of tutor
2 Student’s inappropriate behaviour or comments. Such responses
incidents involved behaviours or remarks made
by a single group member, where, for example,
‘[an] angry and disruptive student [was] deter- Level of success Type of difficult incident*
mined to communicate his or her dissatisfaction
with [the] medical curriculum’, ‘[a] student’s Successful (‡ 75%) Underachiever
Palm Pilot addiction interfered with [the] Lacking focus on basic science
group’s ability to effectively develop learning Challenged by tutorial process
issues’, ‘rude comments and demeaning behav- Performance affected by
iour intimidated and negatively impacted the personal matters
level of participation of some group members’, Difficulties with tutorial process
and ‘[the] content expert was clearly disinter-
ested in active participation and very impatient’. Moderately successful Student’s inappropriate
3 Dominant student. One or more dominant students (50–74%) behaviour or comments
in a group impaired the tutor’s ability to effectively Relying on anecdotal or
facilitate the learning process. Most interviewees questionable information
attributed the behaviour to students’ internal Dominant student
motives or traits, describing such students as ‘[a] Quiet student
real know-it-all’, ‘overwhelming, could explain
everything’, ‘really straightforward’, ‘needed to Unsuccessful (< 50%) Tensions within the group
lecture to prove that they had done their PBL Tardy or absent
research’, ‘keen to present irrelevant information Tensions between student or
to disguise insecurity’, and ‘very authoritarian, group and tutor
often provided questionable information’.
4 Tensions within the group. Incidents in this type * Types of difficult incidents from the ‘group dynamics’
involved two or more students or the entire category are denoted in italics
group. Comments included: ‘two very vocal
ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873 869
P Kindler et al
870 ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873
Difficult incidents in problem-based learning
Table 4 Success rates of different categories of interventions when used to solve different categories of difficult incidents
‘chronically tardy or absent’ students, which is con- be willing to address conflicts without prior prompting
sistent with high occurrences of both these student from the tutor.15,16 As some authors have questioned
types in previous reports.6–9 the notion that effective PBL groups are those in which
conflict is minimised or prevented,17,18 it appears
In the ‘group dynamics’ category, we found detri- important to provide tutors and students with the skills
mental factors similar to those reported previously,14 required to learn from conflict, rather than to avoid it.
including ‘tutor-associated problems’, such as ‘tuto- Instead of advocating for strategies to prevent conflict,
rial domination’ or ‘lack of proper knowledge curriculum planners and PBL tutor trainers might
regarding PBL approach’, and ‘student-associated emphasise a ‘student-centred solution to group prob-
problems’, such as ‘negative attitude towards each lems’11,17,19 and the responsibility of all members of
other’ and ‘unresolved personal conflict’. the group in dealing with difficult incidents. Tutors
should focus less on intervening to solve problems and
However, among ‘tutor-associated problems’, none more on creating environments in which students feel
involved students remarking about the content invited to intervene effectively, and less on eliminating
expertise of the tutors. This is by contrast with reports conflict and more on helping students develop skills to
in which students referred exclusively to their ‘frus- learn from conflict and maintain group cohesion
tration with tutors who are not content experts’.9 The through it.
participants in this study were successful in respond-
ing to incidents involving difficulties with tutorial Equipping students with the skills they need to learn
processes, which is again consistent with the findings from conflict is no simple matter. Problem-based
of prior work.7 Our results also indicate that tutors learning tutorial groups in the medical school at
were moderately successful in dealing with dominant UBC, and elsewhere,4 develop ‘ground rules’ in the
students, contrasting with findings in an earlier early going. Ground rules typically cover issues such
report that both tutors and students dealt with as mutual respect, equitable participation, punctual-
dominant students ineffectively.7 ity and attendance. These are important, but they do
not address the skills students need to learn from
By contrast with often unsuccessful tutor-initiated conflict. The present research and earlier work4,17
interventions, most of those implemented by the suggest that more could be gained by asking newly
group or individual students were successful or established PBL groups to address questions such as:
moderately successful, but their frequencies were low. What can you do to ensure that you learn from
These results may indicate a lack of awareness by both conflicts and disagreements? How can you help
tutors and students of the importance of their everyone feel that it is okay to disagree? Can you
collaboration in dealing with difficult incidents. establish any rules that help people disagree in ways
According to Barrows:12 that are constructive for your learning? How will your
ground rules help you to intervene effectively when
‘If there are difficulties that develop in the function difficult situations arise?
of the group – personality clashes, an unproductive
session, poor morale, whatever – the students have A successful tutor intervention is likely to include
the responsibility to identify such states of affairs.’ effective feedback, suggested as a ‘necessity for
learning’20 and as ‘central to medical education’.21
It has also been suggested that students should develop However, medical students appear to be dissatisfied
a sense of ownership of the conduct of the tutorial and with feedback22 and tutors and students often
ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873 871
P Kindler et al
disagree not only about the definition and meaning provided some important insights, namely: that
of effective feedback, but about whether or not any even our highly experienced and highly rated
feedback was provided in a particular learning tutors have plenty of failures in dealing with prob-
setting.23 Interactions involving feedback often evoke lems; that commonly prescribed interventions have
strong emotions and the delivery of negative high failure rates, and that ‘hold on to the philoso-
feedback, highlighting deficiencies in student phy’19 (i.e. the group should solve its own problem)
performance, induces feelings of anxiety and is a promising strategy that could be facilitated and
depression.19,24 By contrast with moderately effective tested. A similar investigation of students’ percep-
interventions outside the tutorial, the public nature tions of the nature and effectiveness of student- and
of tutor feedback to individual students is likely to group-initiated interventions versus those initiated
heighten such emotional responses and may help to by tutors may provide insights that help both parties
explain why in-tutorial interventions fail to address resolve these distressing incidents.
most of such incidents. Similar interventions in
response to incidents involving group dynamics were
somewhat more successful. Perhaps the group can Contributors: PK, WG and GP designed the study. PK, CG
share ‘blame’ for such incidents, although, paradox- and SK conducted interviews and contributed to the data
ically, this same tendency to diffuse responsibility entry and analysis. PK and WG co-wrote the first draft of the
has been shown to reduce the overall effectiveness of paper. All authors contributed to subsequent drafts and
the intervention as students may think that it is approved the final manuscript.
someone else’s responsibility to deal with a prob- Acknowledgements: the authors wish to thank all the
problem-based learning tutors who participated in this
lem.25 Our results suggest that the most effective
study, and Professor L C Chan, of the University of Hong
interventions in incidents involving individual Kong, for providing valuable comments on an earlier
students may be those initiated by the group. This version of the manuscript.
underscores the importance of creating tutorial Funding: this study was supported by the Summer Student
environments in which students take responsibility Internship Program, MD Undergraduate Education,
for addressing problems. The low frequency of group- Faculty of Medicine, University of British Columbia,
initiated interventions suggests that tutors could do Vancouver.
more to create such environments. Conflicts of interest: none.
Ethical approval: the study protocol was reviewed and
The present research identifies where and when approved by the Behavioural Research Ethics Board,
specific tutor interventions are advised, depending University of British Columbia.
upon the type of incident being addressed. We do
not, however, know what is to be said during the
intervention. Characteristics of prescribed effective REFERENCES
feedback include starting with positive comments,
focusing on specific behaviours, suggesting ideas 1 Hmelo-Silver CE. Problem-based learning: what and
how do students learn? Educ Psychol Rev 2004;16
for improvement and delivering feedback in a
(3):235–66.
concise and specific manner.20–22 Faculty are
2 Schmidt HG, Vermeulen L, van der Molen HT. Long-
encouraged to participate in workshops designed to term effects of problem-based learning: a comparison
introduce such feedback techniques,20,26 but their of competencies acquired by graduates of a problem-
impact on the success of tutor interventions is based and a conventional medical school. Med Educ
unknown. 2006;40 (6):562–7.
3 De Grave WS, Dolmans DHJM, van der Vleuten CPM.
This study is limited by the fact that it is based on self- Profiles of effective tutors in problem-based learning:
reported data and, therefore, is prone to recall and scaffolding student learning. Med Educ 1999;33
attribution errors. Furthermore, interventions were (12):901–6.
deemed successful or not solely according to the 4 Maudsley G. Roles and responsibilities of the problem-
based learning tutor in the undergraduate medical
opinion of the tutors. The quantitative data should
curriculum. BMJ 1999;318 (7184):657–61.
not be extrapolated to the majority of tutors or
5 De Grave WS, Dolmans DHJM, van der Vleuten CPM.
tutorial groups. Such precision and representative- Student perceptions about the occurrence of critical
ness would require a much more inclusive incidents in tutorial groups. Med Teach 2001;23 (1):49–
sampling and survey method, perhaps based on 54.
the typology presented here. Moreover, the tutor 6 De Grave WS, Dolmans DHJM, van der Vleuten CPM.
population was highly selected. We believe, however, Student perspectives on critical incidents in the tutorial
that counting the incidents and interventions has group. Adv Health Sci Educ 2002;7 (3):201–9.
872 ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873
Difficult incidents in problem-based learning
7 Hendry GD, Ryan G, Harris J. Group problems in 18 Tennant M. Psychology and Adult Learning. New York,
problem-based learning. Med Teach 2003;25 (6):609–16. NY: Routledge 2006;107–19.
8 Hitchcock MA, Anderson AS. Dealing with dysfunc- 19 Dolmans DHJM, Wolfhagen IHAP, van der Vleuten
tional tutorial groups. Teach Learn Med 1997;9 (1):19– CPM, Wijnen WHFW. Solving problems with group
24. work in problem-based learning: hold on to the phi-
9 Houlden RL, Collier CP, Frid PJ, John SL, Pross H. losophy. Med Educ 2001;35 (9):884–9.
Problems identified by tutors in a hybrid problem- 20 Värlander S. The role of students’ emotions in formal
based learning curriculum. Acad Med 2001;76 (1):81. feedback situations. Teach Higher Educ 2008;13 (2):145–
10 Peterson M. Skills to enhance problem-based learning. 56.
Med Educ Online 1997;2:3. http://www.med-ed-online. 21 Hewson MG, Little ML. Giving feedback in medical
org/volume2.htm. [Accessed 16 July 2009.] education. Verification of recommended techniques.
11 Azer SA. Challenges facing PBL tutors: 12 tips for suc- J Gen Intern Med 1998;13 (2):111–6.
cessful group facilitation. Med Teach 2005;27 (8):676– 22 Ende J. Feedback in clinical education. JAMA 1983;250
81. (6):777–81.
12 Barrows HS. The Tutorial Process. Springfield, IL: 23 van de Ridder JMM, Stokking KM, McGaghie WC, ten
Southern Illinois University 1988. Cate OTJ. What is feedback in clinical education? Med
13 Braun V, Clarke V. Using thematic analysis in psychol- Educ 2008;42 (2):189–97.
ogy. Qual Res Psychol 2006;3 (2):77–101. 24 Jacobs A. The use of feedback in groups. In: Jacobs A,
14 Azer SA. Problem-based learning. A critical review of its Spradlin WW, eds. The Group as Agent of Change. New
educational objectives and the rationale for its use. York, NY: Behavioral Publications 1974;408–48.
Saudi Med J 2001;22 (4):299–305. 25 Guerin B. Language use as social strategy: a review and
15 Johnson DW, Johnson RT. Learning Together and Alone: an analytic framework for the social sciences. Rev Gen
Cooperative, Competitive and Individualistic Learning. Bos- Psychol 2003;7 (3):251–98.
ton, MA: Allyn & Bacon 1999;179–80. 26 Brukner H, Altkorn DL, Cook S, Quinn MT, McNabb
16 Johnson SM, Finucane PM. The emergence of prob- WL. Giving effective feedback to medical students: a
lem-based learning in medical education. J Eval Clin workshop for faculty and house staff. Med Teach 1999;21
Pract 2000;6 (3):281–91. (2):161–5.
17 Miflin B. Small groups and problem-based learning: are
Received 1 December 2008; editorial comments to authors
we singing from the same hymn sheet? Med Teach 16 January 2009; accepted for publication 18 May 2009
2004;26 (5):444–50.
ª Blackwell Publishing Ltd 2009. MEDICAL EDUCATION 2009; 43: 866–873 873