Preparing for your College Review Hannah Clarke David

Preparing for your College Review Hannah Clarke David Scott Simon Varwell Simon Jones @sparqs_Scotland #sparqs. Col. Review

Learning Objectives By the end of today you will: • Have developed a deeper understanding of the college review process • Have gained an understanding of the role of the Learner Engagement Questionnaire • Have developed skills to enable effective engagement with your students • Be able to plan for involvement in a college review @sparqs_scotland #sparqs. Col. Review

Agenda 14: 10 - 14: 30 How does the college review work? 14: 30 - 15: 15 The Learner Engagement Questionnaire 15: 15 - 16: 00 - 16: 45 - 17: 00 Gathering student responses Planning for your review Conclusions and close @sparqs_scotland #sparqs. Col. Review

2015 -16 Review sparqs contact Newbattle College w/b 9 -Nov-15 Simon Jones Perth College w/b 23 -Nov-15 Simon Varwell City of Glasgow w/b 11 -Jan 16 David Scott West Lothian w/b 25 -Jan-16 Simon Jones Dumfries & Galloway w/b 8 -Feb-16 Simon Jones North Highland w/b 22 -Feb-16 Simon Varwell Inverness w/b 7 -Mar-16 Simon Varwell Forth Valley w/b 14 -Mar-16 Simon Jones @sparqs_scotland #sparqs. Col. Review

Document title Transforming lives through learning

Preparing for your college review HMI Margaret Rose Livingstone Student Team Member – Julia Fitzgerald Document title Transforming lives through learning

Themes • Who we are and what we do • Pre-review • Review week • Post review Preparing for your college review Transforming lives through learning

Education Scotland - who we are and what we do … Part of the directorate that deals with Lifelong learning and post 16 provision. We review or inspect - • Colleges • Private colleges and English language schools • Prison education • Community learning and development • Career information, advice and guidance services • Modern apprenticeship providers Preparing for your college review Transforming lives through learning

The context • HM Inspectors undertake reviews of standards and quality in Scotland’s colleges on behalf of SFC Preparing for your college review Transforming lives through learning

What is the main purpose of the review? • to support and promote quality enhancement in colleges to provide the best possible experience for the learner; • to provide information to Scottish Ministers and the public on the quality of colleges and the education and training they provide; • to complement college-led internal review and selfevaluation; and • to identify excellent practice. Preparing for your college review Transforming lives through learning

Working with colleges: three key principles: • High quality learning: • Learner engagement • Quality culture Preparing for your college review Transforming lives through learning

Evaluative activities Annual engagement Subject based or thematic aspect reports Preparing for your college review External reviews of colleges Transforming lives through learning

High quality learning • How effective are the college’s learning and teaching processes? • How well are learners progressing and achieving relevant, high quality outcomes? Preparing for your college review Transforming lives through learning

Learner engagement • How well are learners engaged in enhancing their own learning and the work and life of the college? Preparing for your college review Transforming lives through learning

Quality culture • How well is the college led and how well is it enhancing the quality of its services for learners and other stakeholders? Preparing for your college review Transforming lives through learning

Pre-review phase Managing inspector: • meets Principal and Chair of the Board/Regional Lead, staff and learners; • agrees essential documentation from college or access to college intranet; • arranges for the return of the Learner Engagement Questionnaire; • liaises over arrangements with College Nominee. Preparing for your college review Transforming lives through learning

Review week (varies depending on size and nature of college) 3 x full days in college: • Monday all day • Tuesday all day • Wednesday all day • Evening classes as appropriate • Outreach classes as appropriate • Team meeting at the end of each day – in college (attended by college nominee) Preparing for your college review Transforming lives through learning

Arriving at evaluations • discussions with learners and other stakeholders • discussions with staff and managers • observations of learning and teaching • review essential documentation such as learning and teaching packs, internal review or self-evaluation reports, achievement information, including PI data Preparing for your college review Transforming lives through learning

Discussion of findings Friday – MI, one colleague and STM: • discussion of findings with Principal, SMT and student president. Preparing for your college review Transforming lives through learning

From draft to final report • summary evaluations two weeks after external review • draft report sent, accuracy check meeting, Principal and Chair/Regional Lead • publication of report on the Education Scotland website • development of a learners’ version of the report Preparing for your college review Transforming lives through learning

What will the report say? • Overarching statement of effectiveness; Effective Limited effectiveness Not effective • Plus supporting statements to provide detail Preparing for your college review Transforming lives through learning

After the external review • College prepares action plan • SFC determines whether follow-up required • College HMI visits college and monitors progress on Main Points for Action and areas for development • Within a year – college Bo. M publishes response • Annual engagement process by Education Scotland Preparing for your college review Transforming lives through learning

What will the report say? • Overarching statement of effectiveness; Effective Limited effectiveness Not effective • Plus supporting statements to provide detail Preparing for your college review Transforming lives through learning

the principle of student engagement implies … that colleges … support the development of students as co-creators of their learning who take responsibility for their own learning … and … are involved in decision-making about their curricula, teaching and learning, and all aspects of the student experience. - ‘Final report of the Scottish Funding Council’s Joint Quality Review Group’, 2008 Preparing for your college review Transforming lives through learning

Quality improvement and enhancement beyond the review … Learners Co-evaluators of the learner experience Reviewers (HMIs, AAs and STMs) Preparing for your college review Co-creators of learning Staff Co-evaluators of the learner experience Transforming lives through learning

Annual engagement visits Preparing for your college review Transforming lives through learning

Any questions? Margaret. Rose. Livingstone@educationscotland. gsi. gov. uk Preparing for your college review Transforming lives through learning

Education Scotland Denholm House Almondvale Business Park Almondvale Way Livingston EH 54 6 GA T +44 (0)141 282 5000 E enquiries@educationscotland. gov. uk www. educationscotland. gov. uk Preparing for your college review Transforming lives through learning

The Learner Engagement Questionnaire @sparqs_Scotland #sparqs. Col. Review

Learner Engagement Questionnaire • Aim: To become familiar with the Learner Engagement Questionnaire. • By the end of this session you will; – Understand the purpose of the Learner Engagement Questionnaire – Be familiar with the content of the Learner Engagement Questionnaire – Have begun to develop questions that will help you answer the Learner Engagement Questionnaire. @sparqs_scotland #sparqs. Col. Review

Important things to remember • Need to say how you’ve consulted and how many with. • Need to ensure that you engage with a range of the student body. • Need to generalise feedback. • Learner voice needs to be central throughout. • Use the prompts that are outlined in the Learner Engagement Questionnaire. @sparqs_scotland #sparqs. Col. Review

Activity: Learner Engagement Questionnaire In small groups: • Look at the example response and think about its strengths and weaknesses? • What would you change or do differently? @sparqs_scotland #sparqs. Col. Review

Remember! “The Questionnaire aims to capture and reflect the collective views of the whole student body across the college” – so the feedback gathered by your students’ association should be representative and balanced Feedback that is perceived as being representative and balanced is more likely to lead to change and enhancement, which is the reason we have the review! @sparqs_scotland #sparqs. Col. Review

Gathering Student Responses In this session we will discuss the most effective ways to gather student feedback for the Learner Engagement Questionnaire. @sparqs_scotland #sparqs. Col. Review

Consultation tools In small groups: • Select 2 -3 examples of consultation and list the pros and cons of each. • Consider how different students can be engaged via different methods. • What would work best at your college? @sparqs_scotland #sparqs. Col. Review

Surveys Pros: Cons: • Easy to collate or transcribe data • Data will not be ‘rich’ • Can reach lots of students at once • Depersonalised • We already get so many surveys • Can be a lot of work to administer @sparqs_scotland #sparqs. Col. Review

Focus Groups Pros: Cons: • Interviewer can interact and ask followup questions • Small groups make it hard to be representative • Data is very rich and contextualised • They can definitely go off topic • Quicker than interviewing people separately • Slower than a big survey! @sparqs_scotland #sparqs. Col. Review

Student Interviews Pros: Cons: • Extremely rich, detailed feedback • Not representative • Can ask questions that might get a different response in group settings • Harder to get balanced feedback • Easier to explain the purpose and context of the engagement • Time consuming @sparqs_scotland #sparqs. Col. Review

Asking questions In small groups: • Go through the sample LEQ and come up with questions that are specific to your college and can be used for your response. (use the worksheet on pages 6 & 7) • Think about what methods would you would use. – Would you utilise other sources? @sparqs_scotland #sparqs. Col. Review

Using existing data • Internal college survey data (Learner satisfaction surveys/pre-exist survey) • Course rep feedback • Staff/student liaison committee reports/minutes • Outcomes of students’ association campaigns • Annual Engagement Reports • Previous Education Scotland review reports @sparqs_scotland #sparqs. Col. Review

Hints and tips • Use methods that you feel comfortable with. • Ensure you triangulate the data. • Use methods which are suitable for your student body. • Use at least two different methods. • Make sure you have enough time to carry out consultation. • Don’t do it on your own – utilise students and staff to help gather opinion. @sparqs_scotland #sparqs. Col. Review

Remember… • It is important to consult across the college. • To leave adequate time for each stage of the research. • There is no right or wrong way to collate responses. • To keep feedback accurate, balanced, constructive and depersonalised. • To get help from the student body or support staff. • The Student Team Member is available for guidance. @sparqs_scotland #sparqs. Col. Review

Planning for your review This final session will help you plan how best to get the most out of the review and the additional resources you should draw on to do this. @sparqs_scotland #sparqs. Col. Review

Consultation Toolkit • Aim: what do you want to find out and why? • Target population: who do you want to consult with and why? • Methods & approaches: what tools are you going to use and how? • Partners: who would you involve? • Timescales: what do you need to do and by when? @sparqs_scotland #sparqs. Col. Review

Activity: timescales On your own: • Make notes within the consultation toolkit to assist you in planning for your review. – – What methods will you use? What information can you already utilise? Who will you inform? How long will you need for each aspect? @sparqs_scotland #sparqs. Col. Review

Planning for your review Find out when the review is taking place. Meet with others involved in the review. Find out who the Student Team Member is. Consider the challenges at the start. Familiarise yourself with the LEQ. Ensure methods are relevant to the student body. • Utilise other students and staff members. • Utilise methods already being used. • LET STUDENTS KNOW IT’S HAPPENING! • • • @sparqs_scotland #sparqs. Col. Review

Utilising the outcomes • What do you want to get out of the review? • What will be the most important outcomes for learners? • How will you use the results to make positive change within the college? • Who will you share the outcomes of the review with? @sparqs_scotland #sparqs. Col. Review

Thank you! • • Hannah. Clarke@sparqs. ac. uk David. scott@sparqs. ac. uk Simon. Varwell@sparqs. ac. uk Simon. jones@sparqs. ac. uk @sparqs_scotland #sparqs. Col. Review

2015 -16 Review sparqs contact Newbattle College w/b 9 -Nov-15 Simon Jones Perth College w/b 23 -Nov-15 Simon Varwell City of Glasgow w/b 11 -Jan 16 David Scott West Lothian w/b 25 -Jan-16 Simon Jones Dumfries & Galloway w/b 8 -Feb-16 Simon Jones North Highland w/b 22 -Feb-16 Simon Varwell Inverness w/b 7 -Mar-16 Simon Varwell Forth Valley w/b 14 -Mar-16 Simon Jones @sparqs_scotland #sparqs. Col. Review