Test Security 2019 2020 Manuals STAAR TAM Grades

  • Slides: 34
Download presentation
Test Security 2019 -2020

Test Security 2019 -2020

Manuals STAAR • TAM Grades 3 -5 • TAM Grades 6 -8 • TAM

Manuals STAAR • TAM Grades 3 -5 • TAM Grades 6 -8 • TAM EOC (Hard copies provided, but also available electronically) TELPAS & TELPAS Alt • • Rater Manual (available electronically only) TAM for online assessments (hard copies provided, but also available electronically STAAR Alternate 2 Manual is divided into two parts: • Non-Secure Front Matter (hard copies provided, but also available electronically) • Secure TAM (hard copies will be received with secure test material.

DCCR • Available online only • You can download it, but TEA will continue

DCCR • Available online only • You can download it, but TEA will continue to update in the fall and spring

 • • This training doesn’t replace you reading your manuals and other resources!

• • This training doesn’t replace you reading your manuals and other resources! Signature on your oath indicates you have received all manuals, directions and procedures governing the test administration and that you will read your manuals prior to administering any state assessment.

What is Test Security? • • • Preserve the integrity of all test content

What is Test Security? • • • Preserve the integrity of all test content to ensure that results are meaningful and valid Strict adherence to instructions and procedures contained in the test administration manuals and resources Ensures fair and equal testing opportunities for all students Involves accounting for all secure materials before, during and after each test administration. This includes: • Identifying who can handle secure materials (trained & sign oath) • Properly storing secure material (consider location & limited access) • Tracking the chain of custody through each stage of the administration by using material control forms and other transfer forms • Maintaining the integrity of tracking documentation (store securely, audit periodically) Ensuring that all individuals involved in administering the assessment receive training and sign a test security oath.

Test Security – All Test Documents. Online Test Tickets (STAAR and TELPAS) STAAR Alternate

Test Security – All Test Documents. Online Test Tickets (STAAR and TELPAS) STAAR Alternate 2 image cards, secure TAM and secure test booklets Test books and completed answer documents TELPAS Calibration Activities and components for holistically rating student performance Involves protecting contents of all secure material!

Test Security Compliance with confidentiality requirements starts with: Y O U Be trained on

Test Security Compliance with confidentiality requirements starts with: Y O U Be trained on obligations concerning confidentiality and test security, read all manuals, and sign your oath Actively monitor administrations to ensure all tests are administered in strict accordance with test procedures Investigate and report any alleged or confirmed incidents

Testing Irregularities Incidents resulting in a deviation from documented tested procedures are defined as

Testing Irregularities Incidents resulting in a deviation from documented tested procedures are defined as testing irregularities. Test irregularities fall into one of two categories – serious or procedural. Serious: • • Constitute severe violations of test security or confidentiality Must be immediately investigated by the district testing coordinator Must be reported to TEA as soon as the district testing coordinator is made aware of a possible or confirmed violation Can result in the individual(s) responsible being referred to the TEA Educator Certification and Standards Division for consideration of disciplinary action

Serious Irregularities May include, but not limited to: • • • Directly or indirectly

Serious Irregularities May include, but not limited to: • • • Directly or indirectly assisting students with responses to test questions Tampering with student responses Falsifying holistic ratings or student responses Viewing secure content before, during or after an administration unless specifically authorized by TEA or by the procedures outlined in the test administrator manuals Discussing or disclosing secure test content or student responses Scoring student tests, either formally or informally Duplicating, recording or electronically capturing confidential test content unless specifically authorized by TEA or by the procedures outlined in the test administration manuals. Responding to secure test questions Fraudulently exempting or preventing a student from participating in the administration of a required state assessment Receiving or providing unallowable assistance during calibration activities (e. g. , taking notes, providing answer sheets, or sharing answers) Encouraging or assisting an individual to engage in the conduct described in the items listed above or in any other serious violation of security and confidentiality Failing to report to an appropriate authority that an individual has engaged or is suspected of engaging in conduct described in the items listed above or in any other serious violation of security and confidentiality

Testing Irregularities Incidents resulting in a deviation from documented tested procedures are defined as

Testing Irregularities Incidents resulting in a deviation from documented tested procedures are defined as testing irregularities. Test irregularities fall into one of two categories – serious or procedural. Procedural: • Reflect minor errors or deviations in testing procedures • Do not represent severe breaches in security or confidentiality • Does not require a call to TEA unless guidance is needed by the district • Must be reported to TEA within 10 days Monitoring Errors Accommodation Errors Eligibility Errors Improper accounting for secure materials

Examples of Procedural • • All or part of blank answer document accepted by

Examples of Procedural • • All or part of blank answer document accepted by the test administrator A designated support is not provided Improper active monitoring Test administrator failed to read the script verbatim from the manual Students were improperly monitored during a break A student was permitted to test beyond the allowed time limit, or was not provided the full allotment of time to complete an assessment A student was issued test materials or a test ticket belonging to another student Student was allowed to use a pen instead of a #2 pencil on an answer document Irregularities

 • Penalties for Violations of Test The Texas Administrative Code (TAC), § 101.

• Penalties for Violations of Test The Texas Administrative Code (TAC), § 101. 3031(a)(5) states that any violation of test security or confidential integrity may result in the TEA: • invalidating student test results; • referring certified educators to the State Board for Educator Certification (SBEC) for sanctions in accordance with TAC, Chapter 247 (relating to Educators’ Code of Ethics) and TAC, Chapter 249 (relating to Disciplinary Proceedings, Sanctions, and Contested Cases); and • lowering the school district’s or charter school’s accreditation status or a school district’s , charter school’s, or campus’s accountability rating in accordance with Texas Education Code (TEC), § 39. 057(d), or appointment of a monitor, conservator, or management team to the school district or charter school in accordance with TEC, Chapter 39 A. As indicated in TAC, § 249. 15, any person who violates, assists in the violation of, or solicits another to violate or assist in the violation of test security or confidentiality, as well as any person who fails to report such a violation or fails to cooperate with a TEA investigation, is subject to the following penalties: • placement of restrictions on the issuance, renewal, or holding of a certificate, either indefinitely or for a set term; • issuance of an inscribed or non-inscribed reprimand; • suspension of a certificate for a set term or issuance of a probated suspension for a set term; • revocation or cancellation, which includes accepting the surrender of, a certificate without opportunity for reapplication for a set term or permanently; or • imposition of any additional conditions or restrictions upon a certificate that the SBEC deems necessary to facilitate the rehabilitation and professional development of the educator or to protect students, parents of students, school personnel, or school officials; As stated in the TEC, § 39. 0303, Secure Assessment Instruments, Criminal Penalty, • A person commits an offense if: • the person intentionally discloses the contents of any portion of a secure assessment instrument developed or administered under this subchapter, including the answer to any item in the assessment instrument; and • the disclosure affects or is likely to affect the individual performance of one or more students on the assessment instrument. • An offense under this section is a Class C misdemeanor. Security • •

HCISD Testing Incidents 2018 -19 27 total incidents for the 2018 -19 testing year

HCISD Testing Incidents 2018 -19 27 total incidents for the 2018 -19 testing year Administration Month Assessment Type 0 Grades 3 -5 2 Grades 6 -8 4 6 EOC 8 TELPAS 10 0 December 2 4 April 6 May 8 June 10 12

Reporting Irregularities Clearly explained what happened, how it occurred and how it was discovered

Reporting Irregularities Clearly explained what happened, how it occurred and how it was discovered 01 Clearly outline the sequence of events… list date, room, test administrator(s), timeline of events 02 Include information about how the problem was resolved or remedied 03 Include a plan of action to prevent the incident from reoccurring 04 All persons with knowledge of a suspected testing irregularity are required to report it to the CTC or building principal.

Technology Use During Assessments When using allowable or approved technology-based accommodations, the following guidelines

Technology Use During Assessments When using allowable or approved technology-based accommodations, the following guidelines must be followed: Device or software must be set in a mode that locks the user into a specific software program Block user from the ability to send secure test content (messages, captured images, videos) Block user from sending or receiving any person to person communication Block user from saving secure test content

Electronic Device As per the Texas Education Agency, the use of cell Statement phones

Electronic Device As per the Texas Education Agency, the use of cell Statement phones and other personal electronic devices including smartwatches, laptops, tablet computers, portable listening or recording devices, cameras or other photographic equipment, devices that can access the internet and any other electronic device that allows for communication during testing not permitted. Electronic devices must be powered off and turned in to the Test Administrator to hold until ALL students have completed the test. Being in possession of any electronic device may result in NOT SCORING the test and disciplinary action will be taken by the campus administration.

Students: Capturing or Transmitting secure test content TEA considers it a serious violation if

Students: Capturing or Transmitting secure test content TEA considers it a serious violation if a student photographs or duplicates secure test content or disseminates this information using an electronic device. Contact the DTC immediately.

Student Cheating After investigating the incident, if the campus determines that a student has

Student Cheating After investigating the incident, if the campus determines that a student has been involved in cheating on a student assessment: • Invalidate the test by marking the score code “O” on the student’s answer document or in the online form • Complete the LDAA form • Submit an incident report form if a testing irregularity contributed to the student cheating (i. e. inadequate monitoring) • Contact the parent

Test Security – Oral/Signed Test Administrators who have Administration permission to view secure materials

Test Security – Oral/Signed Test Administrators who have Administration permission to view secure materials must be trained and reminded they are viewing secure test content • • Test administrators may not: Respond to test questions, make notes about test questions, discuss content or student responses Write notes or calculations Rephrase, clarify or interpret any test content Provide verbal and/or non-verbal assistance All security measures outlined in the STAAR TA Manuals and Oral/Signed Administration Guidelines MUST be followed.

Retention of Documentation Training material and security oaths for all personnel involved in testing

Retention of Documentation Training material and security oaths for all personnel involved in testing Campus inventory, material control forms and shipping records Seating charts for each test session must include: • Location of test session including district and campus name and room number or name • Specific test being administered including the month, year, program and grade and subject or course • First and last name of the test administrators and monitors involved in the test session • First and last name of each student participating in the assessment and where the student was seated Retain for 5 years following a test

Tips to Preventing Irregularities • Ensure that test administrators have accurate rosters that include

Tips to Preventing Irregularities • Ensure that test administrators have accurate rosters that include information about accommodations, and that they know how to provide an accommodation • Create accurate seating charts • Announce the time left to test in one-hour intervals • Provide required test material (i. e. calculators or dictionaries if applicable) • Verify that each student has recorded responses on his/her answer document before taking it from them • Ensure that principals, campus coordinators, and other staff are available to support test administrators and to monitor testing • Account for all test material immediately upon materials check-in • Verify each student ID prior to handing them an answer document or online test ticket • DO NOT ACCEPT BLANK ANSWER DOCUMENTS

Test Administratio n 2019 -2020

Test Administratio n 2019 -2020

Testing Stopped Instruction It is not necessary to conceal or remove instructional or reference

Testing Stopped Instruction It is not necessary to conceal or remove instructional or reference material unless they could provide assistance or are a direct source of answers for the subject-area being administered. Examples of content specific material: • Math tables for addition, subtraction, multiplication and division facts during mathematics assessments • Graphics containing testing information such as moon phases, the water cycle or human body systems during grade level science assessments • Historical timelines or lists of historical figures and their accomplishments during social studies assessments • Graphic organizers for written assessments, figurative language defined or modeled, or writing conventions rules from the writing assessments

Maintaining Testing • No element of the room should Environment hinder any student’s performance

Maintaining Testing • No element of the room should Environment hinder any student’s performance • A “Testing – Do Not Disturb” sign should be posted outside the testing room • All desks or computer workstations must be cleared of books and other materials not required for the test.

Maintaining Testing Procedures • • • Follow through with collecting electronics to prevent the

Maintaining Testing Procedures • • • Follow through with collecting electronics to prevent the use of cell phones and personal electronic devices A trained test administrator must be present in each testing room at all times with no more than 30 students Test administrators must complete seating charts Actively monitor students Prior to handing test material to students, please confirm the student matches the information on the testing ticket or answer document

Start and Stop Times Distribution of materials and the reading of the boldface, scripted

Start and Stop Times Distribution of materials and the reading of the boldface, scripted test administrator “Say” directions are not included in the time limit. The time period will start after the test administrator has read directions and tells students to begin working on their tests. • Start time must be recorded on the seating chart • Students must record all responses before the end of the time period. They will not be given additional time • Once the time period has ended, test administrators will instruct any students till testing to put their pencils down, or to stop typing for online test. • Stop time for the test session must be recorded on the seating chart.

Test Administrations – Announcement of Time left to Test Communicate the amount of time

Test Administrations – Announcement of Time left to Test Communicate the amount of time left to test in one-hour intervals and, in shorter intervals during the last hour. Students who do not complete their tests within the time limit should submit what they have completed.

Test Administrations – Late Arriving Students arriving late to school on a testing day

Test Administrations – Late Arriving Students arriving late to school on a testing day could still test during the day if time permits. • Each student must be allowed four hours (five for English I & II) in which to take the test. • Late arriving students must be kept aware of the time they have left to test.

Calculator Policy Calculators are required for grade 8 math, grade 8 science, Algebra I

Calculator Policy Calculators are required for grade 8 math, grade 8 science, Algebra I and Biology • Grade 8 Mathematics & Algebra I: Each student must be given a graphing calculator to use throughout the entire test. No other type of calculator is permitted. • 8 th grade Science and Biology: Access to a calculator with a four-function, scientific or graphing capability. There must be at least one calculator for every five students. If calculators are shared, the memory must be cleared after each use. • Students taking an online test will have a calculator available in the online testing platform. You are not required to provide a hand-held calculator.

Dictionary Policy Dictionaries must be available to all students taking STAAR Reading, STAAR Writing,

Dictionary Policy Dictionaries must be available to all students taking STAAR Reading, STAAR Writing, English I and English II • The following types are allowable: monolingual dictionary; dictionary/thesaurus combination; bilingual dictionary (word to word translations; no definitions or examples; ESL dictionary (definition of an English word using simplified English); sign language dictionary, picture dictionary • Minimum ratio is 1: 5 students • Dictionary apps are allowed, but must meet specific technology requirements

Monitor Testing • • • Test administrators must actively monitor the testing room while

Monitor Testing • • • Test administrators must actively monitor the testing room while students are working. Test administrators should confirm that students are only working on the subject area being administered that day and that they do not have access to nonallowable materials It is permissible to encourage students to stay on task. A clock or stopwatch must be made available for the test administrator to monitor the period. If a school emergency arises that represents an actual or potential danger (such as a fire alarm), students should go quietly outside following campus procedures for exiting the building. TAs must regularly remind students participating in a paper administration to record their responses on paper answer documents.

Collect & Return Testing Materials • Once a student has completed and returned in

Collect & Return Testing Materials • Once a student has completed and returned in or submitted the test, allow the student to leave the room or provide the student with an instructional activity such as reading or other quiet activity while the other students continue testing. • Before a student is released from testing, the test administrator must scan the completed answer document to be sure the student has recorded answers as instructed. If the student has not done so and time remains in the time period, the test administrator must say, “You have not recorded your responses on the answer document. Please go back and mark your answers on it now. ” Students will not be allowed to record answers after the time period ends. • TAs may not look at or comment on answers to individual test questions or point out individually skipped test questions. • Report any blank answer documents to your campus coordinator. • Please follow directions from your campus testing coordinator to return all materials.

Monitor Testing Q A What should you do during testing if a student says

Monitor Testing Q A What should you do during testing if a student says to the test administrator, “I normally have XXXX when I take a test (e. g. somebody reads my test to me, colored overlay etc)? The test administrator should tell the student to stop testing (and stop the clock). The test administrator should check the accommodations roster. If nothing is indicated, immediately contact the CTC for further guidance.