Workplace Based Assessment Dr Jane Mamelok RCGP WPBA

Workplace Based Assessment Dr Jane Mamelok RCGP WPBA Lead Associate Director GP Education Promoting Excellence in Family Medicine

Workplace Based Assessment “The evaluation of a doctor’s progress over time, in their performance in those areas of professional practice best tested in the workplace”

The new MRCGP Tripos Workplace based assessment (WPBA) Machine marked test of applied knowledge (AKT) Clinical Skills Assessment (CSA)

n. MRCGP Integrated assessment package AKT – knowledge – >3 /12 ST 3 CSA - CLINICAL skills > 6/12 ST 3 The WPBA – tests those competencies not addressed in other components – 3 years. WPBA – attitudes, team work, assessment of performance and competence in practice, needs to include audit, consultation skills, management, peer review and appraisal.

Miller’s Pyramid WPBA Does CSA Action Performance Shows How CSA Knows How AKT Competence Knowledge Knows

Where do the competencies come from? Domains of GP Curriculum EURACT (European Academy of Teachers in General Practice) GMC – Good Medical Practice

12 competency areas 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Communication and consultation skills Practising holistically Data gathering and interpretation Making a diagnosis / making decisions Clinical management Managing complexity and promoting health Primary care administration and IMT Working with colleagues and in teams Community orientation Maintaining performance, learning and teaching Maintaining an ethical approach to practice Fitness to practise

RELATIONSHIP DIAGNOSTICS Data Gathering & Interpretation Communication & Consulting Skills Making a Diagnosis / Making decisions Practising Holistically Clinical Management Working with Colleagues & in Teams Professionalism Maintaining an Ethical Approach to Practice Fitness to Practise Community Orientation Primary Care Administration & IMT Maintaining Performance, Learning & Teaching MANAGEMENT Managing Medical Complexity

Some myths about WPBA is a continuous process, assessing the development of competencies in the workplace over the 3 year training envelope. All assessments must be timely i. e. within that 3 year envelope, FY 2 competencies cannot be carried forward for WPBA (although they can link with the e-portfolio for NHS appraisal)

Some myths about WPBA By the end of training the trainee must demonstrate competence in the 12 required areas. Naturally occurring evidence (professional conversations, learning logs, audit etc. ) Evidence taken from WPBA assessment tools informs the deanery review process.

Some myths about WPBA and e-portfolio are NOT synonymous WPBA is longitudinal assessment of performance in the workplace. E- portfolio is the personal learning portfolio and this houses all the required assessments including WPBA for the n. MRCGP and the certification and licensing process.

There is a risk of teaching to the assessment hurdles WPBA is not just 12 COTs & 12 CBDs MSF & PSQ give valuable information about “attitudes” The Naturally occurring evidence is the “Jewel in the crown” of WPBA. Informal feedback Professional conversations that validate competency Audits, critical events.

ARCP – Panel reviews The GPR gathers evidence – e-portfolio Prior to panel, the Educational Supervisor (ES) reviews evidence with GPR and eportfolio generates ES Report (ESR) Panel review ESR, collates results AKT/CSA checks successful completion WPBA. Based on all the evidence, panel make recommendation for CCT.

The Blueprint Dilemma Passed MRCGP video but tape would have failed summative assessment. Is it possible ? and what do we do if it happens? Could someone pass CSA but fail in those same competency area in WPBA?

Calm, considered reflection

The solution Each component of the tripos is mapped to the competency framework, GP Curriculum & GMP. Each cover different aspects e. g. AKT clinical, CSA communication. WPBA covers them all. Congruent assessment practices across the components Nationally agreed guidance and concordance for assessment judgements made locally. Calibration We all agree on the benchmark and do the same thing

Finally… The process is learner led. It is the learners responsibility to gather the evidence. Empowers the learner. Planning and personal organisation is key.