Evaluation of Improving Surgical Training Introduction to SQW

Evaluation of Improving Surgical Training Introduction to SQW and overview of our planned approach Friday 5 th April 2019 Lauren Roberts, SQW Director

1 Introduction to SQW Independent research and consultancy organisation Operating for over 35 years Approximately 40 staff, across 3 offices (London, Edinburgh, Manchester) Expertise in personalisation and integration, innovation and spatial development Economic, formative and summative assessment expertise Stakeholder engagement expertise Strong credibility and reputation for robust evaluation.

2 Some examples of our evaluation experience Macmillan’s Integrated Cancer Care programme Workforce transformation, recruitment and training programmes BHF’s Cardiac Physiology Trainers SIHED Evaluation ETF – SEND workforce development HEE’s Non-Medical Endoscopist Accelerated Training Programme GEO’s AHP / HSC Returners Evaluation Clinical and healthcare workforce training Early Adopter maternity transformation Secondary care pilots & system transformation UEC Vanguards x 3

3 Evaluation focus Cross-cohort and cross-specialty comparison Explore the counterfactual Explore impacts at trainee, trainer, service and programme levels Trainee satisfaction; wider perception of IST Identify any intended / negative consequences IST Trainee progression • Interim and final reports • Engagement with IST Scotland evaluators • Formative findings Supervisory encounter Impact of the EST and the Modern Firm Compare with BAU

Proposed approach Methodology, deliverables and underpinning principles • • Inception meeting Document and data review Stakeholder map Scoping interviews Logic modelling Tool design & PID Validation workshop • Monthly highlight reports and calls • 6 mth interim report • June 20 interim report • Dec 21 final report • Validation • Summaries • Data annex • Presentation • Peer reviewed journal publication Collaboration and flexibility Scoping & design Data collection • • Analysis and reporting • Interviews (2 waves per cohort): trainees, trainers & leads 7 case studies Web-based engagement Observations – boot-camp and selection days Analysis of metrics Actionable recommendations Strategic alignment ‘No surprises’ Minimal burden Sensitivity & real-world practicalities

5 Contact details Lauren Roberts Dr. Jo Hutchinson Director Associate Director SQW t. 07747 273 926 t. 07436 108 312 e. lroberts@sqw. co. uk e. jhutchinson@sqw. co. uk w. www. sqw. co. uk