Improving assessment and feedback processes with OCR technology
Improving assessment and feedback processes with OCR technology QAA Scotland 18 March 2015
HP Tele. Form • Tele. Form is a form processing software solution which captures images and data from forms and other documents. • Tele. Form uses text recognition software to identify the document type and extract the information using industryleading OCR (Optical Character Recognition), ICR (Intelligent Character Recognition) and OMR (Optical Mark Recognition) software, ready for export to a database.
Tele. Form Answer Sheet
Data capture Data verification Student views grade and answer sheets on Moodle Administrators record grades into course spreadsheet and My. Campus student record system Data export
Benefits Students • Ease and speed of getting grades and feedback online. • Transparency in grades/marks awarded. • 92. 5% agreed/strongly agreed that the opportunity to review exam answers with the exam paper and generic feedback will help prepare for future assessments. Markers • 78% agreed/strongly agreed the answer sheets are easy to use for marking. • No need to add up marks and convert marks into a grade. • Permit remote marking of assessments. Administrators • No sorting of attendance sheets and script books into student number order. • No manual entry of grades. • Reduced transcription error.
Challenges § Resources • Tele. Form expertise, hardware and software (11 K for 1 PC, scanner, Tele. Form Desktop Licence and support) § Students • New answer sheet and instructions § Administrators • Steep learning curve (new set of processes) § Inconsistencies • Marking in grades and/or marks • Multiple conversion tables for Multiple Choice Questions and written exams • Exam weightings - question/exam level totalling to 100%
Lessons learned • • Don’t implement while you are developing Communication – face to face, drop-ins, training, emails Academic leadership Management support and investment User guides and process documentation Standard conversion tables Standard exam paper rubrics and question weighting Tools to give administrators control over all aspects of managing grades • Improve quality of hand-written fields
Tele. Form website bit. ly/1 Bpf. QDi Hooi Ling Eng (Project Manager) Hooi. Ling. Eng@glasgow. ac. uk Malcolm Goldie (Analyst) Malcolm. Goldie@glasgow. ac. uk
Discussion question: Systems development uncovers existing working practices. How would you anticipate these issues and how would you resolve them?
- Slides: 10