Using Objective Structured Clinical Exams OSCEs to Evaluate

Using Objective Structured Clinical Exams (OSCEs) to Evaluate an Interdisciplinary Clinical Skills Teaching Curriculum Karen Maughan, MD, Eugene C Corbett Jr , MD Veronica Michaelsen, MD, Nancy Payne, MD Elizabeth Bradley, Ph. D

AAMC Clinical Skills Education Objectives 1. *Practice of professionalism 7. 2. Application of science to solve clinical problems *Selection and performance of basic clinical procedures 8. Management of clinical information 9. Generation of prioritized differential diagnosis 10. Practice of intervention, cure, and prevention 3. *Development of patient engagement and relationship skills 4. *Elution of clinical history 5. *Performance of physical examination 11. Development of prognosis based on health risk and diagnosis 6. Selection and interpretation of clinical tests 12. *Knowledge of individual patient context in which medicine is practiced * Skills more appropriately assessed by OSCE than traditional knowledge-based tests www. aamc. org/meded/clinicalskills/

Clinical Skills Education in a Medical School Curriculum n 1 st year u Physical exam skills t t t t u Ear, nose, throat Lung Heart Upper/Lower extremity Vital Signs/Chest Exam Abdomen Neurological Eye Interviewing skills t t Basic interviewing skills Sexual History

Clinical Skills Education in a Medical School Curriculum n 1 st year u Physical exam skills t t t t u t 2 nd year u Ear, nose, throat Lung Heart Upper/Lower extremity Vital Signs/Chest Exam Abdomen Neurological Eye Interviewing skills t n Basic interviewing skills Sexual History Physical exam skills t t t t u Gynecologic Male GU Pulmonary Cardiac Neurological Ophthalmologic Rheumatologic Interviewing skills t Breaking bad news

Clinical Skills Education in a Medical School Curriculum n Basic Patient Care course u Transition to clerkship t t t t IV placement Lumbar puncture Foley placement CXR interpretation EKG performance Central line placement Sterile field Arterial blood gas procurement

Clinical Skills Education in a Medical School Curriculum n Family Medicine clerkship u u u u knee exam back exam ankle exam asthma, peak flow office derm procedures office gynecology u u u geriatric falls assessment ear, nose, throat information mastery medicine at the point of care challenging patient encounter motivational interviewing

Clinical Skills Education in a Medical School Curriculum n Ambulatory Internal Medicine clerkship u u u ophthalmoscopic exam breast exam shoulder exam infectious disease, dx and rx EKG interpretation u u u geriatric polypharmacy nephrology imaging and lab interpretation health economics rheumatology – hand wrist evaluation CXR and PFTs

Clinical Skills Education in a Medical School Curriculum n Pediatrics clerkship u u u screening for abuse and neglect in children phone triage ear exam adolescent interview developmental delays and school failure

Observed Clinical Experiences in the Medical School Curriculum n 1 st year u u 7 Physical Exam OSCEs History Taking

Observed Clinical Experiences in the Medical School Curriculum n 1 st year u u n 7 Physical Exam OSCEs History Taking 2 nd year u Complete history and physical

Observed Clinical Experiences in the Medical School Curriculum n 1 st year u u n 2 nd year u n 7 Physical Exam OSCEs History Taking Complete history and physical 3 rd year u u u Clinical skills passports for each clerkship CPX at end of clerkship year Clerkship Clinical Skills Education Project (OSCEs)

Despite a demonstrated interest in teaching clinical skills in different places in the curriculum ……

Despite a demonstrated interest in teaching clinical skills in different places in the curriculum …… there remains a need for a more coordinated teaching and assessment process

Teaching Clinical Skills n Important

Teaching Clinical Skills n Focused

Teaching Clinical Skills n Feels good

Teaching Clinical Skills n Rewarding

Barriers to Teaching Clinical Skills Time n Money n Evaluation bias n Physician specialization n Training in tertiary care environments n Regulatory and payor influences n

Development of an Interdisciplinary Clinical Skills Teaching Curriculum Clinical Skills Workshops Formative Assessment

Development of OSCEs for a Clinical Skills Assessment n Identify clinical skills to be assessed u u u n Communication skills Physical exam skills Procedural skills Include skills from all clerkship areas

OSCE Development Communication OSCEs working with an interpreter t motivational interviewing t breaking bad news t explaining a medical error t assessing decisional capacity t managing phone triage t teaching a patient about dx of osteoporosis t presenting a case after chart review t screening for anxiety disorder t

OSCE Development Physical exam OSCEs cardiac dysrrhythmia t cardiac gallop t geriatric gait assessment t blood pressure measurement t pediatric ear exam t knee exam t eye exam t mental status exam t pediatric hip exam t shoulder exam t

OSCE Development Procedural OSCEs airway management t cervical sampling t performance of EKG t peak flow measurement t information mastery t aseptic technique t IV insertion t

Development of OSCEs for a Clinical Skills Assessment n Recruit authors u u Identify and approach individuals with an interest in clinical teaching and expertise in the skills to be assessed Solicit commitment from department chairs to support project

Development of OSCEs for a Clinical Skills Assessment n Recruit authors u u n Identify and approach individuals with an interest in clinical teaching and expertise in the skills to be assessed Solicit commitment from department chairs to support project Guide authors u u Work with author to choose appropriate case Provide materials for case development

Development of OSCEs for a Clinical Skills Assessment n Recruit authors u u n Guide authors u u n Identify and approach individuals with an interest in clinical teaching and expertise in the skills to be assessed Solicit commitment from department chairs to support project Work with author to choose appropriate case Provide materials for case development Lead editorial process u Review case during development and provide feedback

Requirements for Conducting Clinical Skills Assessment n Authors for OSCE cases n Students (i. e. support of the school of medicine) n Clinical Standardized Observers (SO) n Standardized Patients (SP) and/or clinical models n Faculty trainers for SOs and SPs n Space to conduct assessment n Technical support n Someone who knows what to do with the data

Quantitative Results -

Clerkship Clinical Skills Education Project Comparison of average scores on OSCEs: students who have had workshops vs those who have not Inf o ee Kn ma st ery ge Ph on Ey e et ria r lde ou Sh tric dia Pe workshops ea r % of total possible points

Clerkship Clinical Skills Education Project How often is there opportunity for skill practice in the clerkship? (student opinion asked at the time of the assessment)

Qualitative Results n Extensive faculty participation n Opportunities for teaching clinical skills at faculty, fellow, resident, student level n Many faculty, fellows, residents, 4 th year students have participated in multiple sessions n Increased awareness of the importance of teaching clinical skills

Lessons Learned n We like teaching clinical skills n Need support of school of medicine for success n Developing OSCEs is a consensus-driven, faculty-intense iterative process n Students are appreciative of being taught clinical skills n Many benefits to interdisciplinary involvement such as developing consistency and standardization in teaching n Increased awareness of importance of clinical skills teaching at many levels n Makes more explicit student clinical performance development in the curriculum n Can link OSCEs to an interdisciplinary skills curriculum

Discussion