How to make the most of wpba workshop

How to make the most of wpba. (workshop) Andrew Whitehouse Jan 25 2011

This workshop n Aim; to revisit workplace assessment of doctors to clarify purpose, to help us improve it. n Objectives; q q q Agree definitions Decide on what counts as wpba, now, and potentially. Identify best practice in formative assessment. Identify best practice in summative assessment. Find ways to maximise performance assessment.

Introductions n Who are you? n Why did you come? n What do you know about assessment? n What do you want to get from this?

The key terms needed for this workshop n Summative assessment n Formative assessment n Competence assessment n Performance assessment

Some principles to consider…. n Assessment has 2 main functions q Summative q Formative n Society needs to be assured that doctors are safe, and care about patients. Summative assessment is its check on this. n Summative assessment also drives learning. n The best teaching is “needs based”. Formative assessment, well done, uses this.

ASSESSMENTS PERFORMANCE “in vivo” eg MSF ( professional), supervision of work by multiple observers (clinical) Clinical audit/complaints etc DOES BEHAVIOUR SHOWS HOW COMPETENCE “in vitro” eg OSCE, simulation, mini. CEX, DOPS KNOWS HOW CLINICAL TEST exam, grey cases COGNITIVE KNOWS FACTUAL TEST MCQ

Principles for assessment (high stakes, summative) Validity. n q q Content Face Concurrent Predictive etc n Reliability n Fairness n Practicality

What counts as wpba in new curricula? (eg Foundation 2005/2010, CMT 2009) n n n mini. CEX DOPS Cb. D ACAT MSF Patient survey

What workplace assessments does GMC list? (2010) (a) systematic observation of clinical practice (b) direct observational procedure (wpbas) (c) Video (d) judgements of multiple assessors (e) consulting with simulated patients (f) case record review, including OPD letters (g) case-based discussions (wpba) (h) oral presentations (i) 360º peer assessment (wpba) (j) patient feedback surveys (k) audit projects (l) critical incident review.

Tasks; n Re GMC list of workplace assessments q q q Decide which are formative, which summative Decide which assess competence, which assess performance For the performance group, propose ways to measure, link to curriculum outcomes, record, embed into NHS assessment practice, generally improve their use…………(consider validity, reliability, fairness, practicality!)

What workplace assessments does GMC list? (2010) P=performance C=competence (a) systematic observation of clinical practice (b) direct observational procedure (wpbas) (c) Video (d) judgements of multiple assessors (e) consulting with simulated patients (f) case record review, including OPD letters (g) case-based discussions (wpba) (h) oral presentations (i) 360º peer assessment (wpba) (j) patient feedback surveys (k) audit projects (l) critical incident review. P C C P P/C P