REF Impact Case Studies For researchers and research

REF Impact Case Studies For researchers and research leaders Dr Tracey Wond

TODAY PART 1 - Understand REF impact requirements DR TRACEY WOND t. wond@derby. ac. uk Joint Uo. A lead 17 REF 2021 Uo. A lead 19 REF 2014 PART 2 - Exploring impact PART 3 - Consider how we might evaluate and evidence REF Impact - Learn from prior case studies (REF 2014)

Introducing REF

Introducing REF Impact

Defining REF Impact In REF 2014, Impact was defined as: “an effect on, change or benefit to the economy, society, culture, public policy or services, health, the environment or quality of life, beyond academia” Panel criteria further articulate.

‘Underpinning Research’

Nature of Impact Outputs usually come after activities. Here it appears they are trying to demonstrate outputs as actual research outputs – i. e. underpinning research. • Witnessed Uo. As getting this wrong in REF 2014 • Note doing things (activities) is not the same as impact. • REF panel chairs want to see distinction shown between activities and impact.

Logic Modelling • Plots how your activity is meant to work If your case study only covers up to here it may be worth reviewing

Attribution – Making the Link • Make the link between the underpinning research, the impact, and the impact evidence • Clarity about how the impact occurred. • Specific evidence – clearly support the impact and narrative.

CMO – A Realist Evaluation Approach CONTEXT MECHANISM What is the context in which the How was the change effected? Using impact occurs and what considerations what mechanisms? does this give rise to? This might be planned or unplanned. If Consideration for setting (e. g. planned then it may be worth entrepreneurs, SMEs, regional revisiting the ‘theory of change’. business support provision, policy etc. ) Mechanisms might include outputs Consideration for other features of the such as: context of the impact – reach, novelty, Satisfaction with new approach type of organisation, location. No. attending session No. of retweets a post gained. Consideration for intention for change/impact which will influence the evaluative research questions, e. g. : To what extent did team y’s work on entrepreneurial learning influence the way in which business support was delivered (in the regions targeted, and beyond)? Context Mechanism OUTCOMES What impact was created and how can this be evidenced? REF usually provide guidance on what impact may look like. Evidence that the research led to the change. Where possible with consideration for causality – linking the research intervention with the impact. Outcomes

Impact Evidence- Types See handout – ‘Guidance on the types of evidence that could be collected’ Source: Vertigo Ventures and Digital Science (2016)

Impact Evidence – REF 2014 analysis Analysis by Vertigo Ventures and Digital Science (2016)

Tips for Impact See handout – ‘Research Impact Process’

Further Resources • University of East Anglia: Impact Case Study Packs available at: https: //portal. uea. ac. uk/documents/6207125/#gsc. tab=0&gsc. q=impact%20 case%20 s tudy%20 pack&gsc. sort= • University of Bath: Impact toolkit: http: //www. bath. ac. uk/ris/impact/toolkit/