Using the Qualification Verification Summary Report to Improve

Using the Qualification Verification Summary Report to Improve Quality Iain Walker Qualifications Implementation Manager Professional Development Conference 2019

This presentation includes exercises to be used in the delivery of this presentation. Please download the Word file Using QVSRs to Improve Quality Exercises to access them. The presentation will indicate when to hand out the exercises. This presentation uses Business Management QVSR 2018 as an example. However, the advice on how to use QVSRs to improve quality applies to all subjects.

QVSR and Quality QVSR Structure 1. Location of Qualification Verification Summary Reports 2. Units Covered 3. Where does the QVSR fit in with quality 4. Resources 2. 4, 5. Candidate Support 3. 2, 3. 3 6. Internal Assessment and Verification 4. 2, 4. 3, 4. 4, 4. 6, 4. 7, 4. 9 7. Areas of good practice reported by qualification verifiers 8. Specific areas for Development 9. Using the Qualification Verification Summary Report To Improve Quality

QVSR and Quality 1. Location of Qualification Verification Summary Reports http: //cn. sqa. org. uk Tutor Resources Qualification Verification Summary Reports

QVSR and Quality 1. Location of Qualification Verification Summary Reports

QVSR and Quality 2. Units Covered (example only - QVSRs for other subjects will use different units). Business Management (Verification Group 254) w w w F 84 T 34 Managing People and Organisations F 7 J 7 35 Business Culture and Strategy H 2 XK 35 Global Business Organisations H 3 MF 34 International Business Environment: Geographical Influences H 0 J 1 34 Business with Accounting: Graded Unit 1 H 0 HY 34 Business: Graded Unit 1 H 0 J 7 34 Business with Human Resources: Graded Unit 1 H 0 J 8 35 Business with Human Resource Management: Graded Unit 2 H 0 J 2 35 Business with Accounting: Graded Unit 2 H 3 P 5 35 Global Trade and Business: Graded Unit 2 H 0 J 0 35 Business: Graded Unit 2 H 0 J 6 35 Business with Information Technology: Graded Unit 2

QVSR and Quality 3. Where does the QVSR fit in with quality w Created from all EV reports from China by verification group w Can be used to help spread good practice w Can be used to improve areas that require improvement w Can help identify what to submit as evidence Ø Hand out the exercises Using QVSRs to Improve Quality Exercises

QVSR and Quality What is ‘Good Practice’? Exercise 1 At your table work together to define what is meant by the term good practice. Write down an agreed collective response and prepare to feedback your definition.

QVSR and Quality What is ‘Good Practice’? Exercise 1 – exemplar response “A good practice is not only a practice that is good, but a practice that has been proven to work well and produce good results, and is therefore recommended as a model. It is a successful experience, which has been tested and validated, in the broad sense, which has been repeated and deserves to be shared so that a greater number of people can adopt it. ” http: //www. fao. org/capacity-development/en/

QVSR and Quality What is ‘Good Practice’? Exercise 2 Working with the others at your table use the list of verification criteria and complete the exercise. 1. Against each criterion, list three pieces of evidence you could provide for external verification 2. Identify one (or more) examples of good practice against each criterion 3. At the end, explain how your centre could integrate QVS Reports into internal verification?

QVSR and Quality 4. Resources Criterion 2. 1: Assessors and internal verifiers must be competent to assess and internally verify, in line with the requirements of the qualification w w w Qualification certificates Industrial/commercial experience Postgraduate qualifications GP - The extent and SQA sponsored events relevance of training Internal CPD events Cascading training

QVSR and Quality 4. Resources Criterion 2. 4: There must be evidence of initial and ongoing reviews of assessment environments; equipment; and reference, learning and assessment materials w w w Operational planning cycles and checklists GP - Quality VLE and electronic materials and Student Learning Guides availability SQA ASP’s being altered for Tax etc. of resources, Prior verification electronic New buildings and equipment resources, etc.

QVSR and Quality 5. Candidate Support Criterion 3. 2: Candidates’ development needs and prior achievements (where appropriate) must be matched against the requirements of the award w w w GP - The level of Selection process support and its Induction availability English language training Pastoral care Student Advisors Individual tutorial time

QVSR and Quality 5. Candidate Support Criterion 3. 3: Candidates must have scheduled contact with their assessor to review their progress and to revise their assessment plans accordingly GP - Extent of available w Timetables support, drop in w Outside class sessions, specialist help, w Email quality of w We. Chat support w Verbal and written feedback w Tutorial records w Individual Learning Plans

QVSR and Quality 6. Internal Assessment and Verification Criterion 4. 2: Internal assessment and verification procedures must be implemented to ensure standardisation of assessment w w w IV policy document Completed IV records – narrative and actions Use of IV as developmental tool GP - Quality Team meetings Standardisation meetings and activities of reflection & usefulness

QVSR and Quality 6. Internal Assessment and Verification Criterion 4. 3: Assessment instruments and methods and their selection and use must be valid, reliable, practicable, equitable and fair w SQA CASP’s and Up-to-date Unit Specifications w Prior verified assessments GP - Quality of reviews and w IV records alternative assessments Criterion 4. 4: Assessment evidence must be the candidate’s own work, generated under SQA’s required conditions GP - Use of w Authenticity declaration checkers, w Formal referencing and electronic checkers referencing training w Manual checks and policy documents

QVSR and Quality 6. Internal Assessment and Verification Criterion 4. 6: Evidence of candidates’ work must be accurately and consistently judged by assessors against SQA’s requirements w w w IV/standardisation meetings Double marking of Graded Units Checklists Professional judgement Grades too high in projects GP - Detail in marking, use of the IV process, assessor feedback reports

QVSR and Quality 6. Internal Assessment and Verification Criterion 4. 7: Candidate evidence must be retained in line with SQA requirements. w Retention policy w Security w Photographs Criterion 4. 9: Feedback from qualification verifiers must be disseminated to staff and used to inform assessment practice. w Central files and IV records GP - How well feedback is embedded within IV w Minutes of meetings and acted upon

QVSR and Quality 7. Areas of good practice reported by qualification verifiers w Preparation for visiting and remote verification w Cascading information from CPD events w Better use of IV and standardisation w Quality and detail of feedback w Refining solutions w Tutor sessions accessed online w Better identification of additional marks in projects w Providing visiting verifiers with electronic files

QVSR and Quality 8. Specific areas for Development q General and vague project titles q Lack of primary research in projects q General and vague project objectives q Excessively long student work q Rigid project content eg SWOT q Candidate logs lack reflection q Formal referencing

QVSR and Quality 9. Using the Qualification Verification Summary Report To Improve Quality. Integrate the messages from the QVSR into the IV process and adopt change on a systematic basis. Set a target of adopting a number of items of good practice each year. q Add it to your Course Report q Add it to the agenda for course team meetings q Add it to standardisation meetings q Add it to internal verification meetings

cn. sqa. org. uk