Evaluating Interns in a New Residency Program Using

Evaluating Interns in a New Residency Program – Using a July OSCE Paul Gordon, MD, MPH Tejal Parikh, MD Vic Weaver, MD Julia Hardeman, MD

Background Information n n What’s an OSCE? What’s an intern OSCE? Has it been done before? Why design and put on an intern OSCE?

Steps to Design Intern OSCE n n n Meet with PD Meet with Residency Faculty Propose a list of cases covering variety of problems Residency Faculty & PD rank order the list OSCE Director designs cases

Our Cases n n n n Delivering Bad News Abdominal Pain Acute Back Injury – drug seeking Depression Shortness of Breath Well woman exam Febrile infant telephone call from mom Multiple Complaints

Our Intern OSCE n n n n 8 cases 8 faculty observers (logistics challenging) Each faculty members observes all 8 interns on same case 15 minutes with SP 15 minutes with faculty observer All cases were videotaped Cost ~$6000

Faculty Expectations of OSCE n n n Provide formative feedback Identify sub-par interns Prevent patient harm Prevent intern attrition Get to know interns

Delivering Bad News You are working on the inpatient team. You just transported Christopher to the ICU after he became unresponsive during a CT scan. He had been referred for work-up of persistent lymphadenopathy with concerns for lymphoma. He was undergoing a chest CT scan when he coded, potentially due to an allergic reaction. He was resuscitated and currently is intubated on the respirator and sedated. Likelihood of complete recovery is unknown. The resident has asked you to speak with the patient’s mother, Carolyn Pierce who is in the ICU waiting room, to explain what happened. There is no physical exam to perform.

Acute Back Injury – Drug Seeking You are working in the Family Practice Office. The patient is complaining of unbearable back pain. Vital Signs: Temperature: Pulse: Respirations: Blood Pressure: 37 C 76/minute 138/84 mm Hg Perform a focused history and physical exam. Explain your initial thoughts regarding assessment and plans to the patient.

OSCE Review at 9 Months n n Paired 1: 1 with faculty advisor Questions for interns: – How have you changed because of OSCE? – What patients are scary or tough to handle? – What problems have or haven’t you overcome?

Cases residents felt most helpful n n n #1 Well woman exam #2 Delivering bad news #3 Multiple complaints #4 Depression #5 Acute Back Injury – drug seeking

Examples of resident feedback n n n Getting shadowed in clinic is preferable Separate session for well-woman exam Helpful to see strengths/weaknesses of interview style Helpful to see need to focus encounter Saw need to let patient talk more Avoiding doubling up questions

Other ideas from the literature n n n n Foreign language or culturally different patient Standardized nurse call Write orders, request labs Encounter evolves to ACLS activity Add EKG’s, CXR’s, lab results Skills demonstration Grade by ACGME competencies EBM/information mastery station

Faculty Expectations of OSCE: Were they met? n n n Provide formative feedback Identify sub-par interns Prevent patient harm Prevent intern attrition Get to know interns