edgehill ac ukls Electronic Assessment Management Using the

  • Slides: 29
Download presentation
edgehill. ac. uk/ls

edgehill. ac. uk/ls

Electronic Assessment Management - Using the right tools Adrian Cain, Mark Wilcock & David

Electronic Assessment Management - Using the right tools Adrian Cain, Mark Wilcock & David Callaghan edgehill. ac. uk/ls

Programme of Session Introduction • • Why use it? Opportunities for online submission Our

Programme of Session Introduction • • Why use it? Opportunities for online submission Our Experience • • Process considerations EHU Experiences of use Options • • Turnitin Blackboard Assignment Tool Data Management – In progress course considerations Data Curation – Post course considerations edgehill. ac. uk/ls

Definition Electronic Assessment Management: The use of information and communication technology to facilitate the

Definition Electronic Assessment Management: The use of information and communication technology to facilitate the creation, submission, marking, moderation and/or feedback of student work for assessment – usually summative, sometimes formative. edgehill. ac. uk/ls

Description • • • Creation Administration, tutors, proforma/template Submission Online (various electronic formats) and

Description • • • Creation Administration, tutors, proforma/template Submission Online (various electronic formats) and offline submission Marking On or off-line – even off screen, but eventually added online Moderation Online, email (zip), offline Feedback Online – Text and/or audio Release Online edgehill. ac. uk/ls

2011 -12 Annual Edge Hill University Student e. Learning Survey Insight into our students’

2011 -12 Annual Edge Hill University Student e. Learning Survey Insight into our students’ experience and expectations of TEL 84% it is important to submit/collect assignments online. 42. 7% that Online self-tests & quizzes are important “I find having access to lecture notes/slides enables me to reinforce any learning I have partaken in, and the quizzes/mocks are a useful way of checking learning is up to date. ” The 5 Most Important Things My Lecturer Does Colin Gibson, SU President, Edge Hill University Students Union (2012) Blackboard ‘…. . how important the basic things are to students…. ’ • Submit online “… a little thing we changed which made a big difference to our student’s lives. ” • • LE ‘…really, really powerful use it! LE ‘…for all info, not just Power. Points! edgehill. ac. uk/ls

Increase use of EAMs. . . results in the increased use of the grade

Increase use of EAMs. . . results in the increased use of the grade centre Positives • Less travel • More parking spaces! • Less paper • Anytime and anywhere Negatives • System/s down – Plan B • Internet access and device • More time on computer • More difficult to spread mark/review Student demands • NSS and local demand + edgehill. ac. uk/ls

Opportunities for online submission Blackboard • • Assignments Tests Surveys Discussions Journals Blogs Wikis

Opportunities for online submission Blackboard • • Assignments Tests Surveys Discussions Journals Blogs Wikis Learning Edge • • • Turnitin Campus Pack (Wikis, Blogs, Journals etc. ) Pebble Pad Offline • • • Performance Viva Artwork …and go to? • • Grade Centre (Staff) My Grades (Students) edgehill. ac. uk/ls

Our Experience of Typical Process (if there is such a thing!) edgehill. ac. uk/ls

Our Experience of Typical Process (if there is such a thing!) edgehill. ac. uk/ls

Start to finish considerations Set-up (start) Consistency - Follow Faculty/Department/Programme processes/guides (if nothing exists,

Start to finish considerations Set-up (start) Consistency - Follow Faculty/Department/Programme processes/guides (if nothing exists, start it) Testing - Add your ‘Test Student’ account to check operation Instructional text – Make sure there adequate student instructions (one file, cover sheet, lates, Plan B etc) Student Experience Competent – Become familiar with your submission process to support your students Differences – There is no EHU/HE fixed submission process and all tools offer different functionality Formative/Survey – Some tools can offer students formative or survey processes Submission (due date) Attempts – Single or Multiple attempts Timing – Open for exam period or module duration Marking Auto/manual – Instance tests with predefined answers or delayed manual marking Online/Offline – Some tools offer either or both, central co-ordination advised Multiple markers – Central co-ordination is advised when you divide your marking Wait and hide - Don’t start marking until due date has passed and hide relevant columns Moderation What to send out – File/paper, including plagiarism detection etc Feedback and returns (post date) Data Management and Data Curation edgehill. ac. uk/ls

User Experiences Fo. HSC • Turnitin – Faculty wide adoption – – • Assignment

User Experiences Fo. HSC • Turnitin – Faculty wide adoption – – • Assignment Handler – Portfoilio/Level wide adoption – – • Training and process consultancy Consistency Support Evolution of central control and management Training and process consultancy Mixed portfolio confusion (CPD and Pre-Reg) Student/staff confusion (Which system and process) CPD – Moved to Turnitin Exams (A and P, Mat Pack, Manual Handling) – – Set-up – Changing course teams Data curation Fo. E • Pebble Pad, • Campus Pack edgehill. ac. uk/ls

Preview your course with ‘Add Test Student’ Go to the course: • Control Panel

Preview your course with ‘Add Test Student’ Go to the course: • Control Panel • Course Tools • Add Test Student • The panel opposite appears: Your student account name is: • Your. Login. Name_S (i. e. caina_s) You can add this student to any course you are an instructor on. Learning Edge: Add Test Student http: //www. eshare. edgehill. ac. uk/1050/ edgehill. ac. uk/ls

Options edgehill. ac. uk/ls

Options edgehill. ac. uk/ls

Blackboard Assignment Features • Submitting work electronically (e. Submission) increased flexibility • Marking offline

Blackboard Assignment Features • Submitting work electronically (e. Submission) increased flexibility • Marking offline Download in batch • Marking work online (e. Marking) – Issues with Crocodocs reduced marking time • Comments and Feedback(e. Marking) improved feedback consistency • Student Expectations meeting student expectations of online assignment submission edgehill. ac. uk/ls

Blackboard Assignment Interface edgehill. ac. uk/ls

Blackboard Assignment Interface edgehill. ac. uk/ls

Blackboard Assignment Advice • Plan B (have one, but don’t advertise it) e. Mail?

Blackboard Assignment Advice • Plan B (have one, but don’t advertise it) e. Mail? • Test student Use a different browser • Submit as a single file Use a template – Cover sheet, Los, Feedback etc (one doc) • Single / multiple attempts If single you may have to reset • Dates Hand in on Thu, at 12 pm? • Hide columns during marking period … because if you don’t students see their draft results!? edgehill. ac. uk/ls

Turnitin Features • Submitting work electronically (e. Submission) increased flexibility • Detecting plagiarism (Similarity

Turnitin Features • Submitting work electronically (e. Submission) increased flexibility • Detecting plagiarism (Similarity indexing) academic integrity • Teaching referencing skills formative and summative learning tool • Marking work online (e. Marking) reduced marking time • Comments and Feedback(e. Marking) improved feedback consistency • Student Expectations meeting student expectations of online assignment submission edgehill. ac. uk/ls

Turnitin Interface Originality/Grade. Mark/Peer. Mark edgehill. ac. uk/ls

Turnitin Interface Originality/Grade. Mark/Peer. Mark edgehill. ac. uk/ls

Turnitin Advice • Files <20 MB, <400 pages Word better than Power. Point, PDFs

Turnitin Advice • Files <20 MB, <400 pages Word better than Power. Point, PDFs (5 -20% fail), any file type • Consistency – Programme, Portfolio, Faculty same settings between modules • Students responsible for own work don’t change policy - 6 weeks storage with paper copies • Not as flexible as a box ……. but more available a second late is a second late! • Understand the students' perspective role play a student with ‘add student • Know your process ……. if not ask! lates, re-sits, EMCs, new drop-boxes, new areas …… …. and always, always back -up edgehill. ac. uk/ls

Data Management edgehill. ac. uk/ls

Data Management edgehill. ac. uk/ls

Data Management – Tutor practice Short Term – For the length of the module/Academic

Data Management – Tutor practice Short Term – For the length of the module/Academic year Why • • Short-term data storage (for all the same reasons you may have kept an individuals assignment) Second and external marking/moderation Privacy – Other students’ marks may be seen every time you have to view someone's work, particularly important in student tutorial/class events. Need to present/look at some assignments/work, where there is no access to the internet. How • • • Check data curation procedures (admin) Analysis future needs, by what you have done in the past Export data and store it with in departments/faculties edgehill. ac. uk/ls

Data Curation edgehill. ac. uk/ls

Data Curation edgehill. ac. uk/ls

Data Curation – Admin practice Long Term Archiving Why • • • Blackboard upgrades

Data Curation – Admin practice Long Term Archiving Why • • • Blackboard upgrades (changes to existing VLE (5 yr Licence)) Data storage/archive - how long courses will remain available for Details transferred to SID ASAP (BB is not an alternative to SID) How • • Don’t change policy (or get lazy) just because its online (but digital stuff lasts forever … doesn’t it? ) Analysis future needs, by what you have done in the past Export data and archive it with in departments/faculties Create reports at Grade Centre level and download/copy individuals work at tool level (i. e. Turnitin) edgehill. ac. uk/ls

Trouble Shooting and Support edgehill. ac. uk/ls

Trouble Shooting and Support edgehill. ac. uk/ls

Trouble Shooting and Support • • Learning Services Helpdesk ltdsupport email LTD Operations Co-ordinator

Trouble Shooting and Support • • Learning Services Helpdesk ltdsupport email LTD Operations Co-ordinator LTDOs Faculty Senior Solstice Fellows Faculty Administrators DDE Blackboard area – Enrol Level’s of support 1 – Help desks 2 – LTDOs 3 – Escalated to providers Exemptions include; Content and tool development/management/set-up, bespoke process issues, enrolment issues, etc. We will help consult on all aspects of TEL including those identified exemptions edgehill. ac. uk/ls

Bespoke needs We offer bespoke training, awareness and implementation of technologies and processes. •

Bespoke needs We offer bespoke training, awareness and implementation of technologies and processes. • Team approach/members • Needs assessments – Present process – Proposed process – Critical processes • Block out time for group session edgehill. ac. uk/ls

Questions and Links edgehill. ac. uk/ls

Questions and Links edgehill. ac. uk/ls

Specific Links Please note: These guides may be/become slightly out of date as many

Specific Links Please note: These guides may be/become slightly out of date as many of our systems have regular routine upgrades, plus they may also have been developed for a particular audience which doesn’t match your requirements. Therefore, when you use these guides please have this in mind. Contact your faculty Learning Technologists if you need any further assistance 01695 650757 (x 7754) Turnitin • Turnitin - Setting up a Paper Assignment (PB - Mar 13) http: //www. eshare. edgehill. ac. uk/3087/ • Getting Started with the Turnitin for i. Pad App (MJ - Aug 13) http: //www. eshare. edgehill. ac. uk/3727/ • Turnitin formative assessment (DC - Oct 13) http: //www. eshare. edgehill. ac. uk/4060/ (presentation with set-up) • Turnitin – Submitting Work (CC – Mar 13) http: //www. eshare. edgehill. ac. uk/3224/ • Students FAQ (KR – Sep 11) http: //www. eshare. edgehill. ac. uk/883/ (Slightly out of date, but a good reference point) Blackboard Assignment • Blackboard Assignment - Creating a Blackboard Assignment Drop-box http: //www. eshare. edgehill. ac. uk/2528/ • LTD 7013: Blackboard Assignment Resetting the Assignment Dropbox http: //www. eshare. edgehill. ac. uk/3070/ edgehill. ac. uk/ls

Associated Links Please note: These guides may be/become slightly out of date as many

Associated Links Please note: These guides may be/become slightly out of date as many of our systems have regular routine upgrades, plus they may also have been developed for a particular audience which doesn’t match your requirements. Therefore, when you use these guides please have this in mind. Contact your faculty Learning Technologists if you need any further assistance 01695 650757 (x 7754) Grade Centre • LTD 7014: Create additional columns (in Grade Centre) (for ‘offline’ submission) http: //www. eshare. edgehill. ac. uk/3069/ • LTD 3036 Hiding a Column from Student View http: //www. eshare. edgehill. ac. uk/3068/ • LTD 3033. pdf Creating a 'My Grades' menu button http: //www. eshare. edgehill. ac. uk/2678/ Mobile • Blackboard Mobile Learn: Best Practices for Making Online Courses Mobile-Friendly http: //www. eshare. edgehill. ac. uk/1372/ edgehill. ac. uk/ls