Course Convenor: Dr Katharine Boursicot, Reader in Medical Education,
Head of Assessment, Centre for Medical and Healthcare Education, PHSE,
SGUL
22nd & 23rd November 2011
St George's, University of London, Cranmer Terrace, London, SW17 0RE
This course is for people involved in assessment, at both undergraduate and postgraduate medical education levels, who wish to broaden their perspective and deepen their understanding of specific areas of assessment.
The workshops will provide hands-on experience of psychometrics and methodologies relating to some of the newer and more challenging assessment and standard setting areas.
This course will provide advanced coverage of assessment principles and methodologies in medical education.
Participants will have the opportunity to:
- Gain deeper understanding of the principles of assessment and learn to evaluate evidence from the literature
- Acquire knowledge of classical test theory, generalisability theory and item response theory
- Gain hands-on experience of standard setting methods
- Review the use of a range of assessment tools (Workplace-Based Assessment, assessment of professionalism, Multi-Source Feedback)
- Identify issues in the assessment of challenging areas in medical education
Methods
The course will include interactive lectures and workshops. Participants will have the opportunity to attend 4 workshops, during which they will be able to address in depth areas of their particular interest. Reading lists and further references will be provided.
PROGRAMME | |
| Day 1: 22nd November | |
0900 – 0930 | Registration and Coffee |
0930 – 1010 | Welcome and introduction Dr Katharine Boursicot |
1010 – 1200 | Assessment: the evidence from the literature Professor Cees van der Vleuten, Director of the School of Health Professions Education, University of Maastricht, Netherlands |
1200 – 1245 | Lunch |
1245 – 1515 | Workshop Session 1 |
1515 – 1545 | Tea |
1545 – 1815 | Workshop Session 2 |
Day 2: 23rd November | |
0815 – 0830 | Coffee |
0830 – 1100 | Workshop Session 3 |
1100 – 1130 | Coffee |
1130 – 1215 | Online Testing – state of the art Dr David Swanson, Vice President, Assessment Programmes, National Board of Medical Examiners, Philadelphia, USA |
1215 – 1300 | Lunch |
1300 – 1530 | Workshop Session 4 |
1530 – 1600 | Tea |
1600 – 1645 | Validity: Establishing meaning for assessment data through scientific evidence Prof Steven Downing, Associate Professor of Medical Education, University of Illinois College of Medicine at Chicago, USA |
1645 – 1715 | Plenary |
1715 | Close |
WORKSHOPS: Participants may attend 4 workshops of their choice
Psychometrics
1. Psychometrics in Assessment
Professor Cees van der Vleuten,
Director of the School of Health Profession Education,
University of Maastricht, Netherlands
2. Use of Generalizability Theory for Design and Analysis of the OSCEs
and Other Performance-based Testing Methods
Dr. David Swanson, Vice President, Assessment Programmes,
National Board of Medical Examiners, Philadelphia, USA
3. Item Response Theory
Professor Steven Downing, PhD, Associate Professor Emeritus,
University of Illinois at Chicago, Department of Medical Education,
Chicago, IL USA
Standard Setting
4. Performance-Based Methods
Dr John Patterson, Emeritus Senior Lecturer and formerly
Head of Assessment at Barts and the London,
University of London
5. Angoff and Ebel Methods
Professor Peter McCrorie, Head of the Centre of Medical and
Healthcare Education, St. George's, University of London
Assessment Tools
6. Workplace-Based Assessment
Dr Julian Archer, NIHR Clinical Lecturer in Medical Education,
Peninsular College of Medicine and Dentistry, University of Plymouth
7.OSCE Examiner Training
Angela Hall, Emeritus Reader in Clinical Communication,
St. George's, University of London
8. Creating OSCE Cases: More than a Checklist
Dr Sydney Smee, Manager in Assessment,
Medical Council of Canada
Professional Development
9. Assessment of Professionalism
Professor Trudie Roberts, Director of Leeds Institute of
Medical Institute of Medical Education (LIME) &
Dr Kathy Boursicot, Head of Assessment, St. George's, University of London
10. Using Multi-Source Feedback Effectively
Professor Karen Mann, Director of Medical Education,
Dalhousie University Faculty of Medicine, Canada


Last year's comments...
"Excellent overview and opening session."
"A good introduction to a challenging topic."
"Quite a lot of mental “hard labour” but very valuable overall."
"A difficult topic, but it needed to be! Very good handouts and clearly delivered. Good to be personally stretched like this."
"The presence of knowledgeable people in the group really added to this session for me as I am new to this topic and wasn’t up to much discussion. Lots of interesting contributions from the group."
"Very useful session – will encourage me to try to make changes at home at my department level and at faculty level."
"A key topic presented at a high level of depth and meaning. Lots of food for thought and facilitation was very knowledgeable."
"Excellent workshop. Just what I came for and expected."
"Excellent! Very informative, interactive and helpful."