FIFTY SHADES OF TRAINING PROCTORS AND INVIGILATORS FOR

FIFTY SHADES OF TRAINING PROCTORS AND INVIGILATORS FOR STANDARDIZED TEST ADMINISTRATION Granit ZELA Albanian Test Team Head STANAG 6001 Testing Workshop Skopje 5 -7 Sept 2017 1

Agenda 1. Standardized test administration validity 2. Invigilator training goals, role, aids/activities 3. Invigilator responsibilities: prior, during, at end of the test 4. Test cheating: test theft, test cheating methods STANAG 6001 Testing Workshop Skopje 57 Sept 2017 2

Standardized Test Administration Validity Test Administration in the Garden of Eden The cheating “Crib Garment” STANAG 6001 Testing Workshop Skopje 5 STANAG Testing Workshop 7 Sept 2017 Skopje 5 -7 Sept 3

Standardized Test Administration Validity • Test administration according to standardized procedures: uniform testing conditions - uniform test administration 1. The invigilator at one test centre who shows students to their seats is rude and aggressive. 2. Five venues are selected for a speaking test during the summer. One of these is next to a major road where extensive road works have just begun. STANAG 6001 Testing Workshop Skopje 57 Sept 2017 4

Training goals • • Fully comprehend what is expected of them for the test administration Be confident in roles and responsibilities as invigilators Understand regulations for running tests Be able to act appropriately in any given circumstances STANAG 6001 Testing Workshop Skopje 57 Sept 2017 5

Invigilator Training q Invigilation training must be mandatory • Tools, knowledge and experience to successfully invigilate • Introduces invigilation practices to perform to the highest level • Addresses trainees concerns • Provides tips and insights STANAG 6001 Testing Workshop Skopje 5 -7 Sept 2017 6 6

Invigilator Training aids Power point slides/DVD Links to resources Discussion activities Training notes Information sheets Quizzes Videos Test fraud scenarios Invigilator Handbook STANAG 6001 Testing Workshop Skopje 57 Sept 2017 7

Prior to testing Appropriate signage Acoustic conditions, heating, lighting, ventilation A quiet testing environment Clock placed in prominent position Candidate warning posters A room seating plan A Test Checklist of testees Stationery equipment distributed Right question papers and candidate materials Know to operate the equipment A tested method of calling for assistance STANAG 6001 Testing Workshop Skopje 57 Sept 2017 8

Prior to testing • • • Test is in progress as soon as candidates enter the room. Check the identification of each candidate. Ensure all mobile phones and electronic devices are handed in Remove any unauthorised materials from candidates and place Make sure candidates are seated according to your seating plan. Check that they have the items they need for the exam. Distribute test materials Give clear instructions about the test completion, time limits State clearly the policy on cheating and theft. Know procedure for late arrivals STANAG 6001 Testing Workshop Skopje 57 Sept 2017 9

During the testing ü ü ü Observe candidates all the time Move around the room Respond when a candidate asks for help No advice about the content of the test paper Look out for any malpractice or candidates looking unwell ü Be vigilant for use of hidden electronic communication ü If a candidate is disruptive remove them from the room while you resolve the issue. ü Maintain the required number of invigilators. . STANAG 6001 Testing Workshop Skopje 57 Sept 2017 10

Ending the exam ü ü ü Inform candidates of the remaining time Tell candidates to stop writing. Collection of all materials Complete relevant documentation Be committed to test material security Do not read or allow anyone else to read any of the scripts ü Collect any unused stationery or equipment. ü Hand the scripts and attendance register Emergency situations üLeave the scripts and question papers in the exam room üEvacuate the room STANAG 6001 Testing Workshop Skopje 57 Sept 2017 11

Traditional malpractice examples Notes hidden q q q calculator back the pencil case inside Juice box under the patch under the sleeves at a headscarf q q q q in the back of the tie in the back of the shoe water bottle label cover in a tampon in fingernails inside the breast on the thighs o Sneaking into hall before exam and attaching notes below desk o Developing “Mors code”, coughing, tapping desk etc. STANAG 6001 Testing Workshop Skopje 57 Sept 2017 12

High tech examples of malpractice q q q q Concealed ear-phones Glasses (Small cameras installed) Smart watches that look like digital watches Using ultra violet pens and invisible ink pens Hollowing out pens to write secret notes Mobile phones Calculators with memory functions used to hide answers STANAG 6001 Testing Workshop Skopje 5 -7 Sept 2017 13

Cheating Test Ads and sites in Internet STANAG 6001 Testing Workshop Skopje 5 STANAG Testing Workshop 7 Sept 2017 Skopje 5 -7 Sept 14

Train invigilators or… STANAG 6001 Testing Workshop Skopje 57 Sept 2017 15

Good invigilators are the solution ü ü Dress smartly, wear the invigilator badge Be aware of emerging situations Remain calm, vigilant, professional Keep a written record of any relevant circumstances – who/what/when ü An air of authority, yet relate with test-takers and staff ü Maintain confidentiality ü Provide a supportive atmosphere Prepare! - Test Invigilators never make assumptions STANAG 6001 Testing Workshop Skopje 57 Sept 2017 16

Conclusion 1. Tests administration is of much more important than it is afforded in language testing literature 2. Practical matters of test administration are critical to test validity - raise validity questions pertaining to fairness, ethics, law and how different cultures view testing and test takers 3. Training Proctors and Invigilators is indispensable in order to ensure a standardized test administration STANAG 6001 Testing Workshop Skopje 57 Sept 2017 17

STANAG 6001 Testing Workshop Skopje 57 Sept 2017 18