Revisiting Assessment of Clinical Competence Using An OSCE
Revisiting Assessment of Clinical Competence Using An OSCE
Revisiting Assessment of Clinical Competence Using An OSCE
Editor’s note: As part of our 50th volume celebrations, Medical Education is looking back at its most impactful articles, as
defined by citation count. The most cited articles from each 5-year interval were identified and the original authors of one of
them (or other knowledgeable scholars if the original authors could not be found) were asked to comment on the state of the
field at the time of publication, the impact of the article, and what we have learned since then. The article illustrated in
Figure 1 was one of the most cited articles in our journal in the 1977–1981 period. To see the other top-cited articles from
Volumes 1–50, please view the interactive PDF by visiting www.mededuc.com.
The Association for the Study of Medical Education cow of British medicine’ and as a ‘half-hour disas-
(ASME) publication ‘Assessment of clinical compe- ter session’.3 Thirdly, it seemed to me that it
tence using an objective structured clinical examina- should be possible to construct an examination
tion (OSCE)’1 provided the first complete that reliably assessed the range of competencies
description of the use of the OSCE to assess a stu- expected of the student, in which what was to be
dent’s clinical competence (Fig. 1). This current assessed at each station would be defined clearly in
paper describes the background to the introduction advance and reflected in a checklist and rating
of the OSCE and how it became the reference stan- scale to be completed by the examiner. I was aware
dard for performance assessment. of the work of Barrows and Abrahamson4 and
others on the use of simulated patients and felt
In the late 1960s and early 1970s, as a senior lec- that in some areas, such as the assessment of com-
turer in medicine in Glasgow and later in Dundee, munication skills, a simulated patient could replace
I was responsible for student assessment. Three a real patient in the examination. In other situa-
things struck me. The first was that the assessment tions, such as those concerning a patient with a
of a student’s clinical skills was regarded as impor- hernia or goitre, the student should be assessed
tant and a student could not graduate without pass- with a real patient.
ing the clinical examination. Secondly, there were
major deficiencies in the clinical examination rep-
resented by the impact of the luck of the draw on In the traditional clinical examination, marks awarded
both the type of patient seen by the student in the by one examiner often varied considerably from those
long case and the two examiners assigned to assess awarded by another observing the same performance
the student’s competence. In the traditional clinical
examination, the marks awarded by one examiner
often varied considerably from those awarded by In Dundee I found a culture that encouraged
another examiner observing the same perfor- innovation in medical education. I recall a conver-
mance.2 John Stokes, an experienced examiner, sation in the hospital car park with Alfred
described the clinical examination as the ‘sacred Cuschieri, who had been appointed professor of
376 ª 2016 John Wiley & Sons Ltd. MEDICAL EDUCATION 2016; 50: 376–379
Celebrating 50 volumes
Figure 1 Title page from ‘Assessment of clinical competence using an objective structured clinical examination (OSCE)’1
ª 2016 John Wiley & Sons Ltd. MEDICAL EDUCATION 2016; 50: 376–379 377
Celebrating 50 volumes
surgery. He made clear his determination to Why has the OSCE been widely adopted as the
change the format of the final examination in recommended approach for the assessment of
surgery. Working with his two senior lecturers, Paul clinical competence and become the reference
Priece and Robert Wood, and with Fergus Gleeson, standard for performance assessment?11 Schnei-
who had come across from Ireland to work with der12 identified four characteristics that lead to
me in the field of medical education, we planned the adoption of an innovation. The first character-
to introduce the OSCE as the final examination in istic is perceived significance. Ideas that are
surgery at Dundee. The faculty board agreed that adopted, Schneider argues,12 stand out not neces-
we could run a pilot final surgery OSCE alongside sarily because they are but, rather, because they
the traditional final surgical clinical examination. seem to be significant. The OSCE was perceived by
The result was a success and the following year the teachers as addressing an important problem: the
board agreed to replace the traditional surgery assessment of a learner’s clinical competence. The
final clinical examination with an OSCE.5 This was second characteristic is philosophical compatibility:
possible because, in the UK, final examinations are teachers must view the innovation as appropriate
the responsibility not of a national body, but of for use. Clinical teachers and examiners easily
each school independently. identified the OSCE with their own thinking.
Schneider’s12 third characteristic refers to occupa-
tional realism: ideas must be practical and easy to
It should be possible to construct an examination put into immediate use. This is certainly true of
that reliably assessed the range of competencies the OSCE. The fourth characteristic is transporta-
expected of the student bility: the approach must be easily explainable to
a busy colleague and adaptable for use in differ-
ent situations. The OSCE has proved to be user-
This early development of the OSCE has been friendly and can be adapted for use in different
described in more detail.6–9 A preliminary report contexts.8 Its characteristics of perceived
that described the OSCE concept was published in significance, philosophical compatibility, occupa-
the British Medical Journal10 and a more complete tional realism and transportability have facilitated
description was published in Medical Education as an the wide adoption of the OSCE as a tool to assess
ASME medical education booklet.1 clinical competence.
378 ª 2016 John Wiley & Sons Ltd. MEDICAL EDUCATION 2016; 50: 376–379
Celebrating 50 volumes
Fourthly, flexibility and the ability to adapt a ing schemes using, for example, iPads. Further,
method to local contexts are key to the success of more serious attention is now paid to standard set-
an innovation. ting and to the assessment of competencies, such as
teamwork skills and error management, and to
Fifthly, scarce resources and the presence of large patient safety, none of which featured much on the
numbers of students need not stand in the way of agenda in 1979.
innovation. I have yet to see an example of a situa-
tion in which the cost or the number of students to
be assessed prevents the adoption of the approach.
The only limitation is the imagination of the REFERENCES
developer.
1 Harden RM, Gleeson FA. Assessment of clinical
My sixth lesson refers to the discovery that here competence using an objective structured clinical
are ‘good’ OSCEs and ‘not so good’ OSCEs. examination (OSCE). Med Educ 1979;13(1):39–54.
Reliability and validity are related to how the 2 Wilson GM, Lever R, Harden RM, Robertson JIS,
OSCE is implemented. The OSCE is really a MacRitchie J. Examination of clinical examiners.
Lancet 1969;293:37–40.
POSCE (potentially objective structured clinical
3 Stokes J. The Clinical Examination – Assessment of
examination). Clinical Skills. Medical Education Booklet 2. Dundee:
Association for the Study of Medical Education 1974.
4 Barrows HS, Abrahamson S. The programmed
There are ‘good’ OSCEs and ‘not so good’ OSCEs. patient: a technique for appraising student
Reliability and validity are related to how the OSCE performance in clinical neurology. J Med Educ
is implemented. 1964;39:802–5.
5 Cuschieri A, Gleeson FA, Harden RM, Wood RA. A
new approach to a final examination in surgery. Ann
My seventh lesson reflects the knowledge that the R Coll Surg Engl 1979;61:400–5.
clinical teacher is in a good position to advance 6 Hodges B. OSCE! Variations on a theme by Harden.
medical education. I was a senior lecturer in Med Educ 2003;37(12):1134–40.
7 Hodges B. The Objective Structured Clinical Examination:
medicine when I started the work on the OSCE.
A Socio-History. Berlin: Lambert Academic Publishing
Although there is a place in medical education for 2009.
large-scale research projects, more attention needs 8 Harden RM, Lilley P, Patricio M. The Definitive Guide
to be paid to the teacher as an action researcher. to the OSCE: The Objective Structured Clinical Examination
as a Performance Assessment. Edinburgh: Elsevier 2015.
9 Centre for Medical Education Dundee. Interview with
Although there is a place in medical education for Professor Ronald Harden about the OSCE. https://
large-scale research projects, more attention needs to be vimeo.com/67224904. [Accessed 30 December 2015.]
paid to the teacher as an action researcher. 10 Harden RM, Stevenson M, Downie WW, Wilson GM.
Assessment of clinical competence using an objective
structured clinical examination. Br Med J 1975;1:447–51.
Finally, an approach to education will continue to 11 Humphrey-Murto S, Touchie C, Smee S. Objective
structured clinical examinations. In: Walsh K, ed.
evolve with time. Although the basic principles of
Oxford Textbook of Medical Education. Oxford: Oxford
the OSCE are as true today as when they were first University Press 2013;524–536.
described in the paper published in Medical 12 Schneider J. Closing the gap. . . between university
Education in 1979,1 we can see developments in the and schoolhouse. Phi Delta Kappan 2014;96:30–5.
use of technology to support the OSCE, such as in
the use of simulators and in new automated mark-
ª 2016 John Wiley & Sons Ltd. MEDICAL EDUCATION 2016; 50: 376–379 379
Copyright of Medical Education is the property of Wiley-Blackwell and its content may not
be copied or emailed to multiple sites or posted to a listserv without the copyright holder's
express written permission. However, users may print, download, or email articles for
individual use.