Download as pdf or txt
Download as pdf or txt
You are on page 1of 21

c11.

qxd 1/9/09 10:44 Page 143

Chapter 11 Specific examples of


exam technique

OVERVIEW

This chapter describes the various types of assessments used in medical education
before applying the general rules discussed in Chapter 10 to specific examples. It
should be noted that, while there are some excellent general books on exam technique
in higher education (see References and further reading), it is difficult to find any that
provide useful advice on the variety of assessments used specifically in medical
courses. Each medical school appears to add its own flavor to its assessments, so
supplement these rather generic pages with discussions with other students in your
year, those in years above, any past papers in the library, and any friendly faculty
members you meet.

Introduction
It would be tedious to end each paragraph with a disclaimer, so here's one:
good exam technique allows you to effectively demonstrate what you
know/can do. It does not, in any way, take the place of having first learned
the material! You should also remember from the first section of Chapter 10
that you should make every effort to learn the exact format of your school's
exams. As you will see further down, everyone has their own unique
variations based on common themes.
c11.qxd 1/9/09 10:44 Page 144

Types of exams
Multiple choice exams (MCQ)
We mean any assessment in which you are asked to choose between
different options in order to demonstrate that you know something. These
are popular exams, not least because they are simple to mark using
automatic systems such as optical readers of mark sheets (you mark in
pencil, and a computer scanner reads your answers and calculates your
marks, as well as a slew of exam statistics in seconds) and even direct-entry
exams where you interact with a computer (removing the need for
someone to stand over a computer scanner cursing every time it gets
jammed). Examples of various multiple choice formats are provided.

Items with true/false answers


Each item is marked as true or false on its own.
These are generally less popular in medical education because they tend
to test regurgitation of simple facts rather than comprehension, and they
fail to recognize that there is rarely a single correct answer. Some schools
still make extensive use of them.

True-false multiple choice question example

Q7 In terms of diabetes

A Insulin resistance is more common in type 2 (late-onset) diabetes than type 1 diabetes (T)
B A fasting blood glucose level of more than 5.0 is diagnostic (F)
C Women who develop diabetes during pregnancy have a higher risk of developing diabetes
later in life (T)

Best of five
In these questions, you must choose from a list of five items the one that is
most true or relevant to the question's lead in (or'stem'). This allows for
some uncertainty and judgment. Q8 demonstrates how to convert some
simple true-false questions to a best-of-five format (here best of three).
Both items B and C in Q9 may be true, but B is less clear and more debatable
than C, so C is the correct answer.
c11.qxd 1/9/09 10:44 Page 145

As an example, consider the 'best of five' format

Q8 Which of the following statements about diabetes is TRUE?

A Insulin resistance is more common in type 1 diabetes than type 2 diabetes


B A fasting blood glucose level of more than 5.0 is diagnostic
C Women who develop diabetes during pregnancy have a higher risk of developing
diabetes later in life (CORRECT)
Q9: Which of the following statements about study skills is most accurate?

A You can only make a MindMap if you have A3 paper


B The Cornell method works best in lectures
C It takes about three months to effectively learn a new study skill (CORRECT)
D Study skills have little effect on performance.
E Copying text from a textbook is an active learning technique

Extended matching questions (EMQs)


This type of question is becoming increasingly common in medical
education. Each question (stem) begins with a general topic and is followed
by a set of possible answers. The student is then given a list of question
items (often in the form of a scenario), and they must choose one (or
sometimes more than one) answer for each item on the list.

Exemplification of extended matching questions

A Multiple choice true/false G Structured clinical examination that is objective


B Best out of five H Examination by viva voce
C Questions about extended matching I Portfolio-based evaluation
D Questions with short answers J Assessment by computer
E Examined essay questions K The blood test
F Essay questions that aren't timed

Each of the descriptions below corresponds to a different type of evaluation; select the
single most appropriate answer from the list above

Q10 This knowledge-based exam was given to a 1980s graduate who had to choose
whether or not each of 600 basic and clinical sciences items were true or false

Q11 A medical school decides to replace traditional assessments in the final year with this
method, which requires students to gather evidence from a variety of sources to
demonstrate that they possess the necessary characteristics to graduate.
c11.qxd 1/9/09 10:44 Page 146

This format enables examiners to ask fairly probing questions in order to


assess understanding rather than just knowledge, as well as some
problem-solving skills.

Exams in writing
Essays
All students will be familiar with essays. You will be required to write essays
in medical school, most likely as assignments within coursework and, in
some schools, as part of formal exams. Essays are time-consuming to grade
and can be difficult to grade fairly. As a result, they appear to appear less
frequently in medical school assessments, and when they do, students may
feel underprepared. We did not include an essay section in this chapter, but
we did include some information about essays and academic writing in
Chapter 6.

Questions with short answers


Students are asked to write in free text what they know about a subject in
response to these questions. Questions are typically structured and very
focused, and answers are typically provided in the form of a note, as shown
in the example in Chapter 10. Some institutions ask single questions (for
example, Q12), while others divide a question into sub-parts to help
structure the answer (see Q13). The marking scheme is usually obvious, and
candidates write their answers directly on the question sheet, including any
rough work.
Q12 Describe the early clinical manifestations of a myocardial infarction (heart attack)
(10 points)

Q13 Describe the classic acute symptoms of a heart attack (4 marks) Describe the key
findings that are likely to be discovered during an examination of a patient suffering
from a myocardial infarction (3 marks)

List the primary preliminary investigations needed to confirm a myocardial infarction


(3 marks)

Clinical examinations
It is obvious that if you are to graduate as a doctor, you must be able to
demonstrate that you can apply your knowledge and skills directly with
patients. This was traditionally tested through long and short cases: long
cases in which you saw one or two patients, took their history, examined
them, and tried to figure out what was wrong before presenting your
findings to the examiners and answering questions, and short cases in
which the examiners took you to see 'bits' of patients to see if you could
spot what was wrong.
c11.qxd 1/9/09 10:44 Page 147

In one session, you could see three different types of hand arthritis, listen to
a couple of different heart murmurs, and feel a lump in someone's
abdomen, all while barely having time to introduce yourself to the patients
associated with these various clinical signs.
These exams had their advantages, but two students could have very
different experiences, with one having 'easier' patients than the other.
Long and short cases have been mostly (but not entirely) replaced by
Objective Structured Clinical Examinations (OSCEs). Consider a large hall
with 24 booths on each side of the walls. Each booth puts a different skill to
the test. In booth or'station' 1, a student may be expected to draw blood
from a rubber arm; in station 2, a student may be expected to ask a patient
about their chest pain in order to make a diagnosis; and in station 3,
students may be expected to examine a patient's arthritic hands, among
other things. Imagine a big hall, with 24 booths around the walls – six on
each side. Each booth tests a different skill. In booth or ‘station’ 1, a student
might be expected to take blood from a rubber arm, in station 2 a student
might be expected to ask a patient about their chest pain in order to come to
a diagnosis, in station 3 per-haps students examine a patient’s arthritic
hands and so forth.
Add some variations in timing (perhaps some stations last 10 minutes
and others last 5 minutes), design (perhaps it is made up of two 12-station
exams held at different times, with some'rest' stations where students can
sit and worry), and location (perhaps it is not in one large hall, but instead
students move in and out of pokey offices and tutorial rooms desperately
looking for the next station), and you have an OSCE. Fair because every
student has the same experience, safe because a wide range of skills are
tested, so unsafe students aren't able to slip through unnoticed, incredibly
boring for the examiners, and either quite fun or absolute torture for the
students depending on their perspective. Whether you like them or despise
them, OSCEs are still the gold standard for assessing clinical competence and
will be for some time.
Clearly, OSCEs are not very realistic, and various work-based
assessments have been proposed in response to calls for assessments that
truly assess what people can and do do in the real-life care of patients. The
Mini Clinical Evaluation Exercise is the most commonly used in the United
Kingdom (Mini CEX, pronounced mini C-E-X). This theme has many
variations, but in general, the candidate performs some kind of task,
usually with a patient, and is observed and graded by a senior using a semi-
structured pro forma. Many different people observe them over the
months and years as they perform many different clinical tasks with many
different patients, and an overall picture or judgement about the learner's
ability can be made.
c11.qxd 1/9/09 10:44 Page 148

The Mini CEX has the advantage of being used in a real-life setting, and the
assessor can provide rapid feedback to the learner to help them develop. As
you may recall from Chapter 3, this does not happen very often in the clinical
setting, so it must be a good thing. On the negative side, the original Mini
CEX form is probably a little too generic for detailed, focused feedback in
junior learners, and there have been some issues getting people to fill them
out.

Oral examinations
Oral exams are part of the history and tradition of medical education, and
you may find yourself taking a viva voce exam in front of two or three
examiners. Institutions now reserve these assessments for students on the
borderline or who may be eligible for a prize, though many have abandoned
them entirely. Even if you take an inter-calated BSc, you will almost certainly
have a thesis viva.
Historically, candidates have reacted with fear to this type of exam. The
format is rather elegant: the examiners ask the student questions about a
topic, each one more difficult than the last, until they determine the
candidate's upper limit of knowledge on that topic, at which point they
move on to another topic and work their way up the ladder again. They can
build a picture of the candidate's depth of knowledge from a variety of core
areas in a relatively short period of time. Unfortunately, whether they were
good or bad, the frustrated candidate leaves the exam remembering only
that they got the last question of every topic wrong, and thus feels terrible.

Thematic variations
So far, we have attempted to provide an overview of the major assessment
methods in this chapter. Of course, there are many variations, and your
institution's exams may differ. The OSCE, for example, appears differently
depending on where you see it, and sometimes people will take the OSCE
concept and apply it to something else, such as an anatomy spotter exam,
in which students rotate around anatomy specimens answering questions,
or data interpretation exams, in which students rotate around
radiographs, urine results, blood test results, and so on. In general, people
rename these exams anything that sounds like OSCE: OSPE, OSLER, OSTE—if
you're bored, try making up your own OSCE-like acronyms and entering
them into PubMed. You're likely to discover that someone else has already
coined your acronym! Mini-CEX, SAQs, and good old MCQs have all given
birth to a plethora of variations. Our call from Chapter 10 remains: make
sure you understand your institution's assessment program, what it entails,
what format it takes, and what purpose it serves.
c11.qxd 1/9/09 10:44 Page 149

Making the most of multiple-choice exams


MCQ exams, regardless of format, tend to instill fear in students. However,
there are a few simple rules to follow that will make life much easier.
Use 'TimePosts' to effectively manage your time. Begin the exam by going
over the question paper to see how many questions there are and how
much time you have. Calculate how much time you have to spend on each
question (including any time you want to leave at the end for checking) and
write the time next to each tenth question. If you completed the majority of
the calculations prior to the exam, this should take less than a minute. If you
are running late, these TimePosts will notify you immediately.
If you're using an automated marking grid, use these TimePosts to
double-check that you're still marking the question you think you're
marking. It is very easy to skip a question, and then all of your answers will
refer to the question that came before or after the one you thought you
were answering. From personal experience, it is far better to discover that
you have made a mistake early on than at the end of the exam!
There are no traps - if you're unsure whether a question means what it
says or if it has a hidden second meaning, just go with what it says and
move on. However, be wary of the double-negative question: these are
dubious-value questions that serve as both a test of knowledge and a test of
supreme logic. Because double-negative answers are difficult to answer in
Q14, the statement in A is false, and the question asks "which answer is
false," we highlight option A. Most schools will now avoid double-negative
questions for obvious reasons, but one or two will occasionally slip through
the net. Simply go back to basics - look at the question, put a box around all
the relevant words ('do not' and 'fall' in B) equates to'stays the same or
increases', so we don't select it).

Q14 One of the statements below is incorrect

A Double negative questions are simple to answer


B Most liver enzymes do not fall in hepatitis patients

There will occasionally be poorly written items that will provide you
with some hints. Look for items that are significantly longer or shorter
than their neighbors (in Q15, D is correct), and remember that 'never' is
always wrong and 'always' is never right.', only a guideline (very little in
medicine is
c11.qxd 1/9/09 10:44 Page 150

in Q16, you don't need to know much about items A, B, C, and E to guess
that they're false, leaving only item D as the correct answer.

Q15 Which of the following statements is true?

The cystic fibrosis gene is usually found

A Gene on chromosome 1
B On chromosome x
C On chromosome 5
D On chromosome 7 and is in charge of coding for a protein that regulates ion
and fluid flux across cell membranes
E On chromosome 8
Q16 Concerning chest pain

A Cardiac pain is never felt in the right arm


B Crushing is the most common way to describe cardiac pain
C In nature, esophageal pain is always burning
D Indigestion can sometimes be mistaken for cardiac pain
E Costochondritis does not cause pleuritic chest pain

Similarly, when answering EMQs, there aren't always 11 or so good


options, so examiners may need to insert some clearly bogus ones. Item K
'blood test' in Q10 and Q11 above is clearly meaningless, and some of the
items clearly relate to very different types of questions. Questions about
written exams, for example, cannot possibly relate to a viva voce, which
narrows your options.
There is a procedure to follow when answering EMQ questions (Fig-
ure 11.1). Read the stem first - what is the question about? (You now
know that questions 10 and 11 are about assessment forms.) Next, read
the question and see if an answer comes to mind. You probably knew
the answer to question 10 was a true-false MCQ. Now go through the
options and, if it exists, write it down (option A). You probably didn't
know the answer to question 11 at first, so you go through the options and
see if the correct answer is obvious. If you're still stuck, go through the
process of mentally or physically crossing off the answers that are clearly
incorrect and seeing what you have left (keep in mind that you'll need to
look at them again, so don't deface the question paper too badly).
The most common mistake that students make when taking any type
of multiple choice exam is in their exam preparation. A plethora of
multiple-choice questions can be found in library books, some of which
have been badly photocopied, illegible lists of questions that someone
you know has an answer to
c11.qxd 1/9/09 10:44 Page 151

Is it
Begin with: Do I Yes included on Yes Make a note of it
know the answer? the list?

No

No
s
Ye
Is there
anything
obviously incorrect
on the list?

No
Sort the items on the
list into impossible, Make an
improbable, educated
possible, and likely guess
Figure 11.1 Answering extended matching questions is a process.

friend who got them from someone who swore they were real exam
questions from a long time ago People make the mistake of attempting to
memorize every question they encounter. Your memory will not be able to
hold all of these questions, and if you get a rush of adrenaline during the
exam, you may recall seeing the question before, or at least a question
similar to it, but the answer, hmm, that's another question. This will result
in consternation and frustration. Even if you do have everything memorised,
the chances are that the questions will not be identical to the ones you learned
(examiners do not use books of exam questions to set the exams and they
tend to rewrite, write new and edit existing questions in the bank of questions
that your insti-tution uses).
Past papers and external questions can be extremely beneficial if used
correctly, specifically for two purposes. To begin, use them for timed mock
exams to familiarize yourself with the format and timing of the exam.
Second, they can be used as a diagnostic tool. Examine your answers, and if
you get a question wrong, jot down the area to which it relates. If you get a
couple of questions on similar topics wrong, it means you need to go back
over your notes and go over those topics again. Remember, instead of
memorizing answers to questions, try to understand the topic.

Making the most of short answer questions


Most of the key points about answering SAQs are highlighted in Chapter
10's discussion of Q3 and Q6 - read the questions carefully, box or highlight
the key points, and answer with as much structure as possible to highlight
the key points in your answer. You could try 'counting out the answers': it
c11.qxd 1/9/09 10:44 Page 152

is likely that if there are three marks for 'Describing the key findings likely on
examination of a patient suffering from a myocardial infarction' (Q13
above), it is likely that the examiner is looking for three main points; unless
the mark scheme gives half a mark for each main point, implying that the
examiner is expecting six main points. Regardless of the difficulty, looking at
the marks should help you structure your response. If there is only one mark
for a definition, you may write slightly less than if there are five marks.
We've already talked about how important timing is and how you should
answer every question. We also discussed planning. It is worthwhile to
spend a minute or two planning your answer: most schools will encourage
you to include your rough plan in your answer, with a single line through it
to indicate that it is rough. If you run out of time, you may still receive one or
two points.
If you carefully read Chapter 2 (note taking), you will have a good idea of
how to prepare for this type of exam. You can incorporate your own
questions into your daily note taking and practice answering them as a way
to review your studies. Of course, you'll want to have full-length practice
exams, but you should also be well prepared. Perhaps you will use a
combination of your own and external questions. Maybe you could share
your concerns with other students and form a study group.
SAQ papers make it simple to assess factual recall and even
comprehension. Writing a SAQ that tests the more advanced skills discussed
in Chapter 2, such as application, analysis, and synthesis, is much more
difficult. Very skilled question writers may attempt to test these higher
skills, but these are more often than not reserved for other formats such as
debates, vivas, and, of course, the essay.

Making the Most of the OSCE


Whatever your background, you will have had some experience with a
variety of tests, but the OSCE is likely to be a new and intimidating format.
As a result, we've included a rather large section on OSCE performance.
The OSCE's goal is straightforward. Consider a geologist drilling into the
ground to collect multiple core samples of the underlying soil and rock. At
some point, he or she will be able to say that enough samples have been
collected to form a reasonable picture of what lies beneath. If most or all of
the samples show clay, the underlying soil is most likely clay. The idea
behind the OSCE is that an individual will demonstrate competence across
the breadth of necessary skills through multiple samples, so that the exam
can infer that they are probably competent across all skills. The exam's goal
is to assess clinical competence - whether you'll be any good at your job.
c11.qxd 1/9/09 10:44 Page 153

Students who work hard to become good doctors, to learn the knowledge
and skills needed for the job, and to become good at patient care, should
easily pass the OSCE (with one or two caveats discussed below).
Unfortunately, some students see the OSCE as a higher education hurdle
unrelated to patients or being a doctor, and they focus their learning on
passing the exam rather than becoming a good doctor. They devise
elaborate plans to 'perform well,' but they frequently fail.

Q17 You are an A&E senior medical student. The registrar has requested that you
collect a venous blood sample to test for anaemia. Please demonstrate how you
would take blood as if this rubber arm were your patient.

Good students will have sought out The exam-centered Students will have
numerous opportunities on the wards to mostly practiced in the skills lab, knowing
take blood (with appropriate consent, of that the rubber arms used in the exam are
course, see Chapter 3), occasionally not the same as real arms. They will have
asking doctors, nurses, or peers to memorized a list of steps, possibly from an
observe them and ensure that they are OSCE book, and will have practiced
doing it correctly. They will have become reciting the steps with robotic accuracy.
acquainted with the various pieces of Because their training and practice will be
equipment available, including which solely focused on the exam, they will be
bottles are used for which tests, they will unlikely to perform well in real life.
have developed rapport with patients
when taking their blood, and it is likely
that they once forgot to write the
patient's details on the sample and had to
redo them with many apologies to the
poor patient, and they will never, ever do
this again.

These students will perform this skill These students' performance in the
fluently and professionally in the exam, exam will be wooden, and they may
even on a rubber arm. It will be obvious miss steps that would be critical in real
that they have done it numerous times life but are less obvious in simulation
before. (for example, forgetting to write the
patient's details on the bottle, or not
knowing which bottle is used for which
test).

This student passes the exam, but This student will most likely fail the skill
more importantly, you would consent or barely pass it, but you would never let
to them drawing blood from your them near your favorite aunt with a
favorite aunt. needle.
c11.qxd 1/9/09 10:44 Page 154

Looking at the two examples in Q17, it should be clear that those who aim
solely to pass the exam, to be OSCE competents, tend to perform worse on
the exam than those who aim to become clinically (with patients)
competent and pass the exam as a'side-effect.'
This is a critical point that cannot be overstated. Ninety-five percent of
your clinical and communication skills training should be devoted to
becoming a great doctor, with the remaining 5% devoted to exam
technique. With a few exam technique tips and some practice, you'll be able
to breeze through the exam.

The OSCE technique


Having said that, there are times when students who perform well on the
wards perform poorly in the OSCEs, and this section aims to highlight
common pitfalls and provide advice on how to avoid them.

Suspended disbelief
You've probably seen a movie that engrossed you so much that you forgot
you were watching a movie and instead felt like you were a part of it. Other
times, you've watched a movie and all you could see were mediocre actors
on a screen. You might have been critiquing the script, the direction, or the
soundtrack in your head. It was far from 'authentic.'
You've probably tried to move from one extreme to the other - you
noticed that you were unengaged in the film and took steps to be drawn into
it, or the film was so disturbing (perhaps a horror film that was too scary, or
an erotic moment in a film you watched with your parents) that you
distanced yourself from what you were watching. Spend a minute making a
list of things you've done to draw yourself into the film and things you've
done to distance yourself from it (two columns). Go ahead, do it now; you're
probably tired of reading anyway.
The OSCE is comparable. Students who perceive it as an exam, something
synthetic, or even a game may struggle to engage with it. Students who can
imagine that each scenario is real, or who can'suspend their disbelief' and
approach each station as if the actor in front of them is a real patient,
perform significantly better.
c11.qxd 1/9/09 10:44 Page 155

Q18 You are a general practice medical student. The doctor has asked you to take a
history from the next patient, Mr Leo Hill, who has recently complained of chest pain.
Please take a detailed history before making a diagnosis. You only have 5 minutes.

Student A enters the station, shows the examiner her name badge, and sits down,
making sure the examiner is out of her line of sight. She introduces herself to the
patient and assumes he is a general practice patient. She inquires about his pain
and, as he speaks, wonders what is causing it. She naturally asks open ('could you
tell me a little more about the pain?') and closed ('does the pain ever move down
your arm?') questions, summarizing as she goes to ensure she understands. She is
interested in his thoughts on the cause, and she discovers that he is terrified that it is
coming from his heart. She understands how upsetting that must be, especially since
his brother died recently of a heart attack.
Overall, she obtains a detailed history from the patient in front of her. She gets a good
sense of how his symptoms are affecting him and believes she has ruled out a cardiac
cause, suspecting that his symptoms are caused by acid reflux into the esophagus or a
stomach ulcer.
When the bell rings, the student becomes disoriented for a brief moment. She had
forgotten she was taking a test. She gathers her thoughts, thanks the patient, and
moves on.
Student B enters the station and shows the examiner his name badge. He notices the
examiner holding the mark scheme and wonders what it says. He anticipates that the
first mark will be for introducing himself, so he turns to the actor and introduces
himself as he has practiced for the OSCE. From the corner of his eye, he watches the
examiner to see if he ticks anything off on the mark scheme, and sure enough, it
looks like he got a mark for the introduction - things are going well. He's learned a lot
about previous exam questions, and he's wondering if this is the station from 2007
about carpal tunnel syndrome or one from 2006 about acid reflux.
He asks, 'Can you tell me about the pain?' knowing that the mark scheme will almost
certainly reward using some open questions, and notices the examiner moving his
pencil on the mark sheet - another point. 'Yes, it is quite frightening,' says the actor. It
usually hurts just here,' he says, pointing up and down the middle of his chest with the
flat of his hand. The student understands that an actor would have been trained to use
a fist if the pain was angina or a heart attack, and he feels pretty good about himself for
identifying that this is the acid reflux station from 2006, so he smiles at the actor and
says 'good'.
c11.qxd 1/9/09 10:44 Page 156

He overhears one of his colleagues say loudly, 'I'd just like to examine your abdomen,'
and makes a mental note that there will be an abdominal examination station later in
the circuit. His smile transforms into a grin. He is aware that he has prepared for an
abdominal examination.
He asks the actor some additional questions to demonstrate to the examiner that he
understands the diagnosis: 'Is it worse when you lie flat?' 'Do you take milk, antacids,
and cimetidine to help it?' The actor appears distressed but nods, and the student
smiles, seeing an opportunity to gain a mark for empathy, and says, 'Yes, I know exactly
how distressing this must feel for you.'
The student finishes early and sits back to hear what the next station is about. He
smiles when he hears the word warfarin.
The examiner was paying close attention to the two performances. Her grade scheme
rewarded students for taking a patient-centered history, investigating symptoms,
investigating all possible causes of chest pain, and being empathic and appropriately
reassuring the patient. The first student did an excellent job, and while she appeared
to be less certain of a final diagnosis, she had thoroughly investigated all possible
causes of chest pain. She appeared to be genuinely concerned about how the patient
felt. She received high marks for being fluent and professional, as well as having a
patient-centered approach. The second student did not perform well; in fact, his
behavior was unusual. He didn't ask the standard questions to rule out potential
cardiac causes and seemed to jump right to one diagnosis, without asking nearly
enough questions to confirm it safely. He smiled in the most unexpected places. He
received no credit for investigating the nature of the pain or investigating other
possible causes. The examiner was convinced that this candidate should fail.
Each candidate was asked to rate the actor's empathy. Although candidate A did not
make any 'empathic statements,' it was clear to him that she could truly understand
the patient's point of view, and he gave her a high rating. Candidate B struck him as
odd: he smiled at odd times, and while he made an empathic statement, it was clear
that there was no empathy behind it at all. He gave him a zero.

This example (Q18) may appear unrealistic to you. Unfortunately, you


would be incorrect; OSCEs are overrun with candidates 'playing the OSCE
game' and losing out as a result. Examine your list from the previous
exercise. You've probably identified some factors related to focus and
attention: you probably look away from the screen and focus on
something realistic in order to escape the scenario, you may purposefully
over-rationalise what you see
c11.qxd 1/9/09 10:44 Page 157

('how ridiculous, that's not something you'd hear in real life') You may also
consider other things outside of the film to bring you back to reality (what
could you have for dinner?). To draw yourself in, you could try to forget
where you are by ignoring distractions and positioning yourself to minimize
distractions in your line of sight; you could also try to form an emotional
connection with what you are watching - put yourself in the shoes of the
lead actor and see how things affect him or her. In the OSCE, you can use the
same skills - ignore distractions, focus on the patient, and try to ignore the
examiner. If you can get them out of your line of sight, that's even better.
You should practice gaining this focus. Perhaps you and your friends could
act out some stations. When you've mastered throwing yourself into the
role at hand, you might want to try it in a less distracting environment, such
as the hospital canteen or public transportation. If you miss your train or bus
stop because you are preoccupied with determining what is wrong with your
'patient,' you will know you are doing well. Consider what might cause you
to lose focus, such as the examiner interrupting with a question, and
practice how you can learn to manage these distractions and quickly return
to your role.

Examine the question


This should go without saying by now, but read the question. If you are
instructed to take a history, do not begin examining the patient, and vice
versa. If you are asked to explain the mechanism of action, potential
benefits, and potential side effects of three drugs, you can see that this is
nine distinct tasks - don't leave any out. Most OSCEs allow you to read the
task for each station before entering it, and there is usually a copy of the
task inside the station in case you forget. Examiners are not trained to
prompt you, but most will stop you if you start examining a patient's thyroid
when you are only supposed to talk to the patient, and will usually ask you to
read the question again.

Time management
Some students excel in clinical practice but struggle during the OSCE
because they are constantly running out of time. They may never have taken
a 5-minute focused history or examined the nervous system of the legs in 5
minutes in real life, so they become stuck.

'My name is Peter Muthos, and I am a third-year medical student.' I'm just getting
ready for an exam and was wondering if you wouldn't mind me practicing by
c11.qxd 1/9/09 10:44 Page 158

testing the nerves of your face. This would entail me simply looking at your face,
testing how strong the muscles around your head and neck are, and seeing how
sensitive your skin is to touch. I'd like to do this with a friend who will be timing me
for the exam. This is only for my education, so no worries if you say no.'
Although 95% of your practice time should be spent on becoming clinically
competent, you should also practice timed scenarios. You can still do this
with patients, and having a peer time you and provide feedback will help
you learn a lot. You will feel rushed at first, but if you become fluent in
taking a rapid, effective, focused, patient-centered history and conducting
appropriate focused, diagnostic examinations, you will quickly become a
popular junior doctor, particularly in outpatient clinics, A&E, and general
practice.

Recognizing distraction triggers


We worked with a student who had been bullied by a secondary school
teacher. The gymnastics teacher was a middle-aged woman with a
disapproving expression. She gave such harsh, destructive feedback that
our student, who was desperate to succeed in gymnastics, was frequently
moved to tears and eventually gave up. Years later, in her first OSCE, she
would freeze, her heart pounding, if she saw a station with a middle-aged
woman examining. She failed all stations where she appeared to be judged
by middle-aged women. She sought professional help and resolved to face
her fears. On the wards, she would tell female consultants that examiners
who looked disapproving threw her off in the exam, and she would ask if they
could observe her examining a patient under exam conditions (she didn't
mention the middle-aged bit to keep the consultants on her side). She
became desensitised (despite the fact that the first couple of times she
practiced were difficult) and went on to perform admirably in subsequent
exams.
This example may appear extreme, but we all have triggers that can
cause us to fail exams. Perhaps it is being interrupted in the middle of a
thought, or the examiner asking you to skip your usual starting steps of an
examination and proceed directly to the later steps, or the examiner
yawning or looking uninterested. Whatever it is that works for you, identify
it (see Chapter 7 on reflection) and actively engage in strategies to reduce
its impact when you practice (remember to include patients in the deal if
you are practicing with them) - if your friend interrupts you in the middle of
your thought with an unrelated question, you should inform the patient
that you are practicing how to manage distractions; otherwise, they will
suspect something strange is going on).
c11.qxd 1/9/09 10:44 Page 159

Managing 'brain freeze'


Every student's greatest fear during an OSCE is that they will completely dry
up: after years of preparation, after seeing hundreds or even thousands of
patients, they walk into a station, or get halfway through a station, and their
brain turns to mush, barely able to keep them breathing, let alone hold
anything resembling a thought. Mouth open, heart pounding, panic wells up
in the guts, but no thoughts come to mind.
As previously stated, this is simply stage fright; it is common and, in fact,
normal. You will be fine if you recognize what it is, accept it as normal, and
learn to actively manage it. If you pretend it will never happen to you, you
will be in big trouble when it does.
Ask other people who have taken OSCEs in medical school for advice on
how to deal with brain-freeze. You could even compile your findings and
make them available to others. There are some common strategies that we
describe here, but we are confident that there are many more.
● Summarise: it will demonstrate that you understand what is going on,
and usually the next step is obvious; for example, 'If I could just
summarize, you had this chest pain last night, it came on after exercise
and went down your left arm, and it was crushing in nature, is that
correct?' Can I continue by asking if anything helped?'
● Ask questions: this will buy you some time, get you saying something
sensible rather than just 'ummmmm' and drooling, and may open up
some more avenues; for example, 'I realize I've been asking you a lot of
questions; do you have any questions or concerns for me?'
● Ask open-ended questions: for example, suppose a simulated patient
(actor) has just told you that they have a certain disease and you can't
quite place it right now - your mind has gone blank. Hopefully, their
response will prompt you to remember. 'Wow, that's interesting; how
does myasthenia gravis affect you?'
● Get to'safer' ground: You may feel uncomfortable or lost at times while
reading a section of history, such as the history of the main problem
('history of presenting problem'). You may decide to move on to a more
comfortable area in order to gain confidence before returning. 'Could I
just ask you a question about your family history?' 'How are your
parents?' This method may result in a disjointed consultation, but it is
preferable to staring at the patient in silence, waiting for the right piece
of information to pop into your head.
You will need to practice these strategies with real patients as well as
with friends in simulation so that if you get brain freeze during an
exam, you can quickly grab a semi-automatic rescue strategy without
having to think too hard.
c11.qxd 1/9/09 10:44 Page 160

Leaving each station in its wake


On some of your OSCE stations, you will perform poorly. This is a simple fact,
and because the final OSCE marks are usually averaged across all stations,
you can afford to perform poorly in a few. Some students perform poorly in
one station and then can't think of anything else but that station; they keep
replaying other things they could have said or done, and as a result, they
underperform on the next station and then the next station.
The truth is that students rarely know how they performed on a station.
Examining a patient's respiratory system, for example, usually has a high
pass mark. Students leave these stations believing they did well (they got
most of it right), but they did not perform as well as expected (they were
expected to do all of it right). In contrast, students frequently leave really
difficult stations thinking they did poorly, but they were not expected to do
well, so the pass mark for that station may be very low. You may fail stations
in which you believe you performed well and pass stations in which you
believe you performed poorly.
Some students find it difficult to transition from thinking about one skill to
thinking about another with so little time in between. Practise a few 5-
minute skills in a row, and get used to switching from one skill to another - it
can be disorienting the first few times.
Begin a ritual that will allow you to leave each station behind you and
focus on the next task at hand. Make it a personal ritual for yourself.
Perhaps you smile and shake hands with the examiner or patient at each
new station, and you see the ritual of introducing yourself as purifying you
from the previous station. Physical stress relief techniques such as
clenching your fist tightly, feeling all the tension go into that fist, feeling it
getting tighter and tighter, and then shaking it loose may be beneficial,
feeling the tension dissipate (with practice, you'll be able to do this subtly
and between stations, as it's probably best not to shake your fist at the
examiner or the next patient!). Breathing exercises, brief visualisations, the
possibilities are endless: find something that works for you and practice it
until you can do it automatically when stressed.

Saying ‘I don’t know’


Every day, senior clinicians tell patients, "I don't know." They differ from
junior medical students in that they say something like, 'I don't know, but let
me get some more information from you and then this is my plan for finding
out and getting back to you.' What doctors do not do (or should not do) is lie
to patients or make up answers to their questions. Consider the OSCE
station listed below:
c11.qxd 1/9/09 10:44 Page 161

Q19 You're a senior medical student on a surgical rotation. The next patient will be
referred for an upper gastrointestinal endoscopy by your team. Please inform the
patient of the procedure.

Student 1: 'Good day, my name is... I understand you've been referred for an
endoscopy, and I've been asked to come and explain the procedure to you. I must
admit that I am not an expert on the subject, but I thought that if I could find out what
you already understand and what your main questions are, I could explain as best I
could, and if there are any outstanding questions, I will either find out and get back to
you, or I will ask one of my seniors to come and talk to you. 'Would that be okay?'
Student 2: (invents incorrect facts): 'Ah well, yes, hmm, an endoscopy - well, we will
pass a big telescope down your throat, erhm, but don't worry, you will be put to sleep
first, hmmm, and we will keep you in overnight to make sure you are ok afterward
[pause] ah yes, risk, hmm, well, no risk at all, very safe, unless...

For some reason, some (sometimes many) students believe that lying in
an OSCE is acceptable. True, saying 'I don't know' and sitting silent for the
next 4 minutes and 50 seconds won't help, but admitting uncertainty,
learning about the patient's perspective and prior knowledge, and
proposing a plan for getting the information you don't know back to the
patient will.

Putting it all together


The final section on OSCEs was lengthy, but it only had two messages. The
first step is to immerse yourself in the role as if each station were a real-life
scenario - read the station's student brief and imagine it to be true. Try to
resist the urge to second-guess the examiner. The second step is to consider
potential exam challenges (running out of time, freezing, etc.) and ensure
that, in addition to practicing to be a competent doctor, you also spend
some time practicing OSCE technique with your peers.

The examination
As previously stated, vivas are becoming less common. Knowing the
structure and format helps (the fact that they will always ask up to your level
of 'not knowing,' as mentioned above, means that you can remain confident
even if you make mistakes).
c11.qxd 1/9/09 10:44 Page 162

The ability to structure your answer well is probably the most important
skill in answering a viva.

Q20 Tell me about an ectopic pregnancy that has ruptured.

Student 3: 'Hmm, well, erhm, it's where a pregnancy develops in the fallopian tube,
usually around 6 weeks of pregnancy, erhm, it can be quite dangerous...'
Student 4: 'Ruptured ectopic pregnancy is a gynaecological emergency that is treated
by making a rapid diagnosis through history, examination, and special investigations
while simultaneously resuscitating the patient, followed by emergency surgical
treatment.' The historical features that would identify this diagnosis are...'

In this example (Q20), student P actually provided more hard facts than
student Q, but student Q began with confidence (without saying much), set
the scene (making it clear that this is an emergency), and laid out a strategy
for continuing to answer the question (he will talk about history,
examination, special investigations, resuscitation and surgical treat-ment).
He will persuade the examiner that he is a clear thinker who understands
the information by providing this answer and signposting each time he
moves on to a separate part of the answer. Some examiners may even move
him on to another topic after that introduction, believing that he has already
demonstrated that he knows more than enough about this topic.
If vivas are likely in your curriculum, get plenty of practice by recording
yourself to practice fluency and structuring your answers, using your peers
to practice answering unexpected questions, and using any faculty who have
experience with 'vivaring' to practice how you would handle it in real life.
Practicing these skills will come in handy later in life for job interviews, etc.

Summary
Chapters 10 and 11 attempted to highlight some of the common pitfalls
encountered in medical school assessment and how to avoid them. Good
exam technique does not replace appropriate learning; rather, it
complements it. The tone of this book in general, and the section on OSCEs
in particular, should have made it clear that the goal of medical school is to
prepare you to become an excellent doctor. Exams are a part of that
journey, but they should not be viewed as the end goal.
c11.qxd 1/9/09 10:44 Page 163

Further reading and references


Your library will have books on exam technique, especially essay writing, and some
great resources on referencing and plagiarism. We have found the following books
useful. Cottrell, S. (2006). The Exam Skills Handbook: achieving peak performance.
Basing-stoke, Palgrave Macmillan.
Evans, M. (2004). How to Pass Exams Every Time. Oxford, How To Books.
Lewis, R.S. (1993). How to Write Essays, London, National Extension College.
Answers to questions
Q: No matter how hard I try, I can't seem to do well on multiple-choice questions.
When I read through my answers again, I frequently change them. Is that the correct
course of action?

A: MCQ papers can be difficult. Some students have a tendency to answer more
questions correctly the first time, then become indecisive and 'correct' them,
resulting in incorrect answers when they look back at the end. Checking helps other
students improve their grades. Perform some practice questions and keep track of
which answers you change. Add up your score before and after making changes to
see how much of a difference it makes for you. If you do this for a few mock exams,
you should notice a pattern emerge.

Q: I understand that I shouldn't copy someone else's text from their work without
attribution, but isn't it acceptable to paraphrase?

A: If you use someone else's ideas, you must credit them. 'I think, therefore I am,' said
Descartes. Even if you change it to 'I think, therefore I exist,' it is still his idea, not
yours. Plagiarism is more difficult to detect than 'cut and pasted' plagiarism, but it is
no less wrong.

Q: In a multiple choice question paper, should I leave the questions I'm unsure about
blank and come back to them later, or should I guess?

A: This is determined by the type of exam, the amount of time available, and your
personal preferences. In general, it is preferable to answer everything as you go,
leaving no questions unanswered. This makes it easier to time accurately and reduces
the possibility of you becoming out of sync with the question sheet and the mark
sheet. If you are permitted to rub out answers, mark the question sheet to highlight
the ones you have guessed so that you can go back and correct them.

You might also like