WV General Summative Assessment 2015 Test Administrator Examiner

  • Slides: 53
Download presentation
WV General Summative Assessment 2015 Test Administrator (Examiner) Training West Virginia Department of Education

WV General Summative Assessment 2015 Test Administrator (Examiner) Training West Virginia Department of Education Office of Assessment and Research 304 -558 -2546

WV General Summative Assessment training is required annually for all personnel with access to

WV General Summative Assessment training is required annually for all personnel with access to secure materials

Examiners TITLE 126 LEGISLATIVE RULE BOARD OF EDUCATION SERIES 14 WEST VIRGINIA MEASURES OF

Examiners TITLE 126 LEGISLATIVE RULE BOARD OF EDUCATION SERIES 14 WEST VIRGINIA MEASURES OF ACADEMIC PROGRESS (2340) § 126 -14 -1. General. 1. 1. Scope. -- This policy establishes rules governing the administration and operation of the West Virginia Measures of Academic Progress. 18 -2 E-8(c)(1), 18 A-3 -6, and Public Law 107 -110, Elementary and Secondary Education Act (ESEA). 1. 3. Filing Date. -- November 13, 2014. 1. 4. Effective Date. -- December 15, 2014. 3. 20. Examiner. The person who administers the test. 3. 20. a. must be a currently employed educator and/or an approved employee of the state, district or RESA, or a currently employed educator of a nonpublic school; 3. 20. a. 1 All nonpublic school educators must be approved by the WVDE. 3. 20. b. must hold a valid West Virginia teaching license or certification granted by the Office of Professional Preparation; 3. 20. c. must have been trained and must have on file a signed Examiner’s/Scribe’s Secure Materials and Test Procedures Agreement for the purpose of administering or assisting with the administration of an assessment included in the WV-MAP and pilot tests and field tests sanctioned by WVDE; 3. 20. d. may be a substitute teacher or an aide serving as an examiner for special needs students when instructionally assigned; 3. 20. d. 1. All aides must be providing services to the student during instruction and must be approved by the WVDE.

► 3. 20. a. must be a currently employed educator and/or an approved employee

► 3. 20. a. must be a currently employed educator and/or an approved employee of the state, district or RESA, or a currently employed educator of a nonpublic school; ♦ 3. 20. a. 1 All nonpublic school educators must be approved by the WVDE.

► 3. 20. b. must hold a valid West Virginia teaching license or certification

► 3. 20. b. must hold a valid West Virginia teaching license or certification granted by the Office of Professional Preparation;

► 3. 20. c. must have been trained and must have on file a

► 3. 20. c. must have been trained and must have on file a signed Examiner’s/Scribe’s Secure Materials and Test Procedures Agreement for the purpose of administering or assisting with the administration of an assessment included in the WV-MAP and pilot tests and field tests sanctioned by WVDE;

► 3. 20. d. may be a substitute teacher or an aide serving as

► 3. 20. d. may be a substitute teacher or an aide serving as an examiner for special needs students when instructionally assigned; ♦ 3. 20. d. 1. All aides must be providing services to the student during instruction and must be approved by the WVDE.

► 3. 20. e. may not be a student teacher; unless he or she

► 3. 20. e. may not be a student teacher; unless he or she is a teacher in residence. ♦ 3. 20. e. 1 Teacher in Residence. An intensively supervised and mentored residency program for prospective teachers during their senior year that refines professional practice skills and helps them gain the teaching experience needed to demonstrate competence as a prerequisite to certification to teach in West Virginia public schools. (W. Va. Code § 18 A-3 -1. )

► 3. 20. f. may not administer WV-MAP assessments to family members. ♦ 3.

► 3. 20. f. may not administer WV-MAP assessments to family members. ♦ 3. 20. f. 1 Decisions regarding other potential conflicts of interests involving test administration will be the responsibility of the district coordinators.

Before Test Administration Training 126 CSR 14 Appendix A Examiners must be trained on

Before Test Administration Training 126 CSR 14 Appendix A Examiners must be trained on the Testing Code of Ethics and Ethical Testing Practices. The WVBE Testing Code of Ethics addresses special concerns regarding appropriate professional practices within the West Virginia Measures of Academic Progress (WV-MAP), as well as appropriate professional conduct. The WVBE Testing Code of Ethics supplements the practices and procedures set forth by W. Va. 126 CSR 14, WVBE Policy 2340. ETHICAL TESTING PRACTICES Test Security 1. District school personnel shall establish and implement procedures to ensure maximum test security and limit access of secure materials to applicable district/school personnel. 2. Apart from the scheduled test administration to students, secure test materials shall be stored in a locked and secured location by the district test coordinator in accordance with the test administration guidelines of each assessment. 3. The district test coordinator shall be responsible for the test booklets/answer sheets received by the district and shall maintain a record of the booklets sent to each school in accordance to the test administration guidelines of each assessment.

Before Test Administration Training Policy 2340 – pg. 32 1. I will not keep,

Before Test Administration Training Policy 2340 – pg. 32 1. I will not keep, copy, reproduce, paraphrase, distribute, or review/discuss secure test materials and/or test items. 2. I will not use test items, test booklets/answer sheets, or any of the information contained in an assessment to review/prepare students for a test. 3. I will not allow access to the test materials or answer keys to any student or any other person not so authorized by the principal. 4. I will not alter students’ responses in any manner (indicate answers, point out rationale, prompt, etc. ). 5. I will not disclose individual student test scores or test performance data to unauthorized persons as set forth in FERPA, the Student Data Accessibility, Transparency, and Accountability Act, found in W. Va. Code § 18 -2 -5 h, Policy 4350, the WVDE Data Access and Management Guidance, and Policy 2340.

Before Test Administration Training 6. If serving as an examiner for APTA, I will

Before Test Administration Training 6. If serving as an examiner for APTA, I will adhere to the prompting hierarchies and document all applicable assistive technology to ensure the accuracy of student responses. 7. If serving as an examiner for students with IEPs, SAT Plans, Section 504 Plans, or ELL Assessment Participation Forms, I will adhere to the accommodations listed therein and monitor using the appropriate process (WV 326). 8. If serving as an examiner for an online assessment, I will not offer technical (accessing dictionary, grammar checks, formatting functions, etc. ) assistance that might alter the accuracy of student responses in the webbased assessment before, during, or after the administration of the test. 9. I have read Policy 2340. 10. I understand that if a breach of test security or copyright infringement occurs as a direct result of my actions, my license/certification may be suspended or revoked, or I may be suspended, terminated, or have other action taken.

Before Test Administration Training After they receive training, Examiners must sign the Verification of

Before Test Administration Training After they receive training, Examiners must sign the Verification of Training, Appendix I. This form and a copy are kept on file by the BLC and CTC.

Before Test Administration Training n o i t a m y d u St

Before Test Administration Training n o i t a m y d u St T e h t e d A t s tr s i in M l a u an

Before Test Administration Also — Review the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines.

Before Test Administration Also — Review the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines. Additionally, TAs should complete the Test Administrator certification course. All of these resources are available on the West Virginia Assessments portal at http: //wv. portal. airast. org.

Before Test Administration Test Administrators are responsible for: Study the Manual For a check

Before Test Administration Test Administrators are responsible for: Study the Manual For a check o list f activi ►completing WV Summative Assessments administration t ies for T training (see section 1. 4 Training) and reviewing all Smarter As to Balanced and state policy and administration documents prior complete , see A to administering any WV Summative assessments; ppend ix L ►viewing student information prior to testing to ensure that the correct student receives the proper test with the appropriate supports. TAs should report any potential data errors to SCs and DCs as appropriate; ►administering the WV Summative Assessments; and ►reporting all potential test security incidents to their SC and DC in a manner consistent with Smarter Balanced, state, and district policies.

Before Test Administration Preparing Students The best preparation for students are the practice and

Before Test Administration Preparing Students The best preparation for students are the practice and training tests.

Before Test Administration Preparing Students The Training Tests are specifically designed to help students

Before Test Administration Preparing Students The Training Tests are specifically designed to help students and teachers become familiar with the software interface and the basic format of the Smarter Balanced assessment. These tests will allow students to become comfortable with the various tools and supports available for the field test. Since the goal of the Training Tests is for students to be at ease with the program, the tests themselves are short and are not grade specific. Students will benefit from taking the Training Tests before attempting the practice tests and the summative assessment.

Before Test Administration Preparing Students The Practice Tests These tests, which are accessible to

Before Test Administration Preparing Students The Practice Tests These tests, which are accessible to students, parents, teachers and the public, focus on the items and evidence they are trying to elicit. The Practice Tests are grade specific and include performance tasks. These tests allow students to preview the complete test experience, from navigation, to item types, to content.

Before Test Administration Preparing Students v. Remind parents that students need proper sleep the

Before Test Administration Preparing Students v. Remind parents that students need proper sleep the night before testing. v Be sure students have a meal or snack before testing. v Do not test students immediately after strenuous exercise.

Before Test Administration Preparing Materials For 2015 v Math and science reference sheets will

Before Test Administration Preparing Materials For 2015 v Math and science reference sheets will be provided online. v Scratch paper may be distributed to students once they are in the testing room, but it MUST be destroyed as soon as testing is completed EXCEPT After ELA-PT part 1, scratch paper may be kept SECURELY by TA, and re-distributed to students at the beginning of Part 2 of the PT to use on the Long Write. v Headphones should be provided for all students.

Before Test Administration Preparing Materials For 2015 v Items that require/allow calculator use have

Before Test Administration Preparing Materials For 2015 v Items that require/allow calculator use have calculators embedded in the item. At grades 3 -5 there are no items that require/allow calculator use. (See WV Portal on calculator use for rationale. ) v. ONLY students with visual impairments may use special handheld (non- embedded) calculators, such braille or talking calculators. The requirement for the special handheld calculator must be documented on their IEPs. The special calculator may on be used only on the calculator allowed portion of the assessment for the item types described above. v. Please note there is NO CALCULATOR USAGE in elementary school – regardless of IEP. Appropriate calculators for middle and high school students will be provided online for student use during the calculator portion of the mathematics test.

Before Test Administration Preparing the testing room Be sure to cover any materials that

Before Test Administration Preparing the testing room Be sure to cover any materials that may provide clues to answers. Reflective surfaces, such as mirrors, that might reflect students’ screens should also be covered.

Before Test Administration Preparing the testing room ►Arrange seats to minimize student interaction. ►Assure

Before Test Administration Preparing the testing room ►Arrange seats to minimize student interaction. ►Assure that desks are clear of all books, papers and other materials. ►Provide proper lighting and ventilation.

Before Test Administration Preparing the testing room Options to Standardized Setting ►Individual, small group,

Before Test Administration Preparing the testing room Options to Standardized Setting ►Individual, small group, or different class testing may be provided. ►Adaptive furniture may be provided. ►Special lighting/acoustics (e. g. microphone/speakers) may be provided.

Before Test Administration Preparing the testing room Provide an environment free of distractions such

Before Test Administration Preparing the testing room Provide an environment free of distractions such as intercoms, cell/smart phones, pagers, gaming devices and watches with alarms.

Before Test Administration Preparing the testing room To ensure students have a quiet testing

Before Test Administration Preparing the testing room To ensure students have a quiet testing environment, free from distraction, place a “Do Not Enter – Testing in Progress” sign on your door.

Before Test Administration Preparing students Remind students to bring a quiet activity to do

Before Test Administration Preparing students Remind students to bring a quiet activity to do should they complete their test before others. Have activities ready in case a student forgets to provide his/her own.

Before Test Administration Providing Accommodations Your principal/building level coordinator will provide you a list

Before Test Administration Providing Accommodations Your principal/building level coordinator will provide you a list of students needing accommodations along with what those accommodations are. Refer to West Virginia Guidelines for Participation in State Assessments — 2014 -2015 http: //wvde. state. wv. us/oaa/pdf/Participation. Guidelines. pdf

Before Test Administration Understand Procedures If you are not sure of proper procedures, ask

Before Test Administration Understand Procedures If you are not sure of proper procedures, ask your principal/building level coordinator! All questions regarding test administration should be answered before testing begins.

Sequencing/Timing You must follow the testing schedule determined by your county and school. See

Sequencing/Timing You must follow the testing schedule determined by your county and school. See the TAM for suggestions on test order and the approximate amount of time needed for each portion of the assessments.

The WV General Summative Assessment is not timed, but the majority of students are

The WV General Summative Assessment is not timed, but the majority of students are able to finish within a class period. Any students who need more than the class period to finish must be given extra time. Students who need significantly more time than others should be grouped together to avoid disruptions. Monitor students to ensure additional time does not give them the chance to study information on a test already started. Timing

General Instructions Follow instructions in the Test Administration Manual. Follow the script. Follow instructions

General Instructions Follow instructions in the Test Administration Manual. Follow the script. Follow instructions for text-tospeech and calculators. See WV Portal for detailed documents.

General Instructions Assistance to students must be limited to… ► clarifying scripted answers ►

General Instructions Assistance to students must be limited to… ► clarifying scripted answers ► showing the correct way to select or input their answers ► showing the correct way to use the tools Read the scripts verbatim.

Special Options ►Text-to-speech ♦ Please refer to the following documents on the WV Portal

Special Options ►Text-to-speech ♦ Please refer to the following documents on the WV Portal > Text-to-speech Use ►Read Aloud ►Calculators ♦ Please refer to the following documents on the WV Portal > Assessment Targets and Calculator Use > Calculator and Multiplication Table Information ►Scribes may be used for short-term medical conditions.

Accommodations Embedded Breaks, Calculator, Digital Notepad, English Dictionary, English Glossary, Expandable Passages, Global Notes,

Accommodations Embedded Breaks, Calculator, Digital Notepad, English Dictionary, English Glossary, Expandable Passages, Global Notes, Highlighter, Keyboard Navigation, Mark for Review, Math Tools, Spell Check, Strikethrough, Writing Tools, Non-Embedded Zoom Breaks, English Dictionary, Scratch Paper, Thesaurus Universal Tools Embedded Color Contrast, Masking, Text-tospeech, Translated Test Directions, Translations (Glossary), Translations Stacked), Turn off Any Universal Tools Non-Embedded Bilingual Dictionary, Color Contrast, Color Overlay, Magnification, Read Aloud, Scribe, Separate Setting, Translation (Glossary) Designated Supports Accommodations Embedded American Sign Language, Braille, Closed Captioning, Text-tospeech Non. Embedded Abacus, Alternate Response Options Calculator, Multiplication Table, Print on Demand, Read Aloud, Scribe, Speech-to-text For de ta Accom ils on m ions, p odat le see th ase e WV Partici p Guide ation lines on the W V Portal

Test Security SECURITY OF THE TEST ENVIRONMENT ► Table 5 of the Test Administration

Test Security SECURITY OF THE TEST ENVIRONMENT ► Table 5 of the Test Administration Manual (TAM) describes security requirements for the test environment during various stages of testing, including what a student can see, hear, or access (including access via technology).

Test Security If a test security incident occurs that could affect the integrity of

Test Security If a test security incident occurs that could affect the integrity of the assessments or the data, the Test Administrator/School Coordinator should follow the steps outlined in the Test Administration Manual — Section 4. 0 Responding to Testing Improprieties, Irregularities, and Breaches AND Section 5. 0 Appeals (as necessary) Also, review the TIDE User Guide located at http: //wv. portal. airast. org.

Improprieties, Irregularities, and Breaches Table 6: Definitions for Test Security Incidents Type Impropriety Irregularity

Improprieties, Irregularities, and Breaches Table 6: Definitions for Test Security Incidents Type Impropriety Irregularity Breach Definition An unusual circumstance that has a low impact on the individual or group of students who are testing and has a low risk of potentially affecting student performance on the test, test security, or test validity. These circumstances can be corrected and contained at the local level. An impropriety must be reported to the School Coordinator who should report it to the District Coordinator who will enter it into the appeals module of TIDE if required. An unusual circumstance that impacts an individual or group of students who are testing and may potentially affect student performance on the test, test security, or test validity. These circumstances can be corrected and contained at the local level and submitted in the online appeals system for resolution. An irregularity must be reported to the School Coordinator who should report it to the District Coordinator who will enter it into the appeals module of TIDE if required. An event that poses a threat to the validity of the test. Examples may include such situations as a release of secure materials or a security/system risk. These circumstances have external implications for the Consortium and may result in a Consortium decision to remove the test item(s) from the available secure bank. A breach incident must be immediately reported to the School Coordinator who will report it to the District Coordinator who will enter it into the appeals module of TIDE if required.

Improprieties, Irregularities, and Breaches Test Administrators (TAs) must ensure that the physical conditions in

Improprieties, Irregularities, and Breaches Test Administrators (TAs) must ensure that the physical conditions in the testing room meet the criteria for a secure test environment. See Section 3. 1 Security of the Test Environment of the TAM for more details. 4. 2 Reporting Timelines and Activities Improprieties are escalated in accordance with state policies and procedures, protocols, and/or guidelines within 24 hours of the incident by individual districts via the Test Security Log and the appeals module of TIDE (if appropriate). The only security incidents that are reported in the appeals module of TIDE are those that involve a student and test, and that require an action for the test such as to reset, reopen, invalidate, or restore a test that a student was taking at the time of the incident. TIDE does not serve as a log for all incidents.

Breaks R E B M urity E M RE n test secing i dur

Breaks R E B M urity E M RE n test secing i dur nta s e Mai sur a e ks m brea There are recommendations for breaks in the TAM. ► Table 9: Assessment Sequence—ELA ► Table 10: Assessment Sequence— Mathematics

Pauses / Time Outs Pause rules/restrictions are for CAT portion ONLY ► After a

Pauses / Time Outs Pause rules/restrictions are for CAT portion ONLY ► After a twenty minute pause student is locked out Test Time ou (inac tivity t ♦ Will be returned to last page with unanswered questions OR ► ) after 30 m to a new page if all items on previous page were answered inute ► Fo s r det a i ♦ MAY NOT review/change any previously answered items, l s TAM see ♦ Must log back in even if they are marked for review ♦ Highlighted text and notes on the digital notepad will not be saved when a test is paused ♦ In the event of a technical issue (e. g. , power outage or network failure), students will need to log in again upon resuming the test. For details See TAM Appendix E: CAT Pause Rules Scenarios

Finishing Early Students who finish early should work on a quiet activity. Quiet activities

Finishing Early Students who finish early should work on a quiet activity. Quiet activities cannot be related to the content of the test you are giving.

After Testing Take up all calculators and reset to factory defaults. Co Sh llec

After Testing Take up all calculators and reset to factory defaults. Co Sh llec re t fo dd ing r Collect scratch paper for shredding. Shred the scratch paper immediately, EXCEPT for scratch paper from the ELA-PT Part 1. This may be saved, SECURELY, for students’ use in ELA-PT Part 2. or f g ct ll e din Co red Sh Instruct students not to discuss test items

Questions? Please Ask Your Principal/School Coordinator.

Questions? Please Ask Your Principal/School Coordinator.

Module 4: After Administration

Module 4: After Administration

►Be sure all students have logged out of test ►Destroy test materials securely ►Printed

►Be sure all students have logged out of test ►Destroy test materials securely ►Printed test items/passages, including embossed braille printouts, and scratch paper must be collected and inventoried at the end of each test session and then immediately shredded. ♦ See TAM, section 3. 2, Secure Handling of Printed Materials, for details.

Documenting Testing Irregularities ►Document Testing Irregularities ♦ Document Testing Irregularities per TAM, section 4.

Documenting Testing Irregularities ►Document Testing Irregularities ♦ Document Testing Irregularities per TAM, section 4. 2 Reporting Timelines and Activities ♦ For definitions and details of irregularities please refer to TAM, Section 4, re: Responding to Testing Improprieties, Irregularities, and Breaches

Questions? Ask Your Principal/Building Level Coordinator

Questions? Ask Your Principal/Building Level Coordinator