Administration Code Training 703 KAR 5 080 Office

Administration Code Training 703 KAR 5: 080 Office of Assessment and Accountability Kentucky Department of Education 2018

Related Documents KDE: OAA: DAS: jl: 1/23/2018 2

Rationale p. 3 Professional Ethics • Ethical standards of the education profession apply to anyone administering a state assessment. (16 KAR 1: 020) • Test Preparation Practice shall not violate those ethical standards. (16 KAR 1: 020) • It is a violation of the regulation to alter student information in order to give students access or help them avoid testing. Educational Defensibility • All test preparation practices shall be designed and used for the purpose of increasing student learning, not for the sole purpose of artificially increasing test scores. Student Ownership • All assessment work shall be done entirely by the student. KDE: OAA: DAS: jl: 1/23/2018 3

Appropriate Assessment Practices Ø Required Training Ø Nondisclosure KDE: OAA: DAS: jl: 1/23/2018 4

Appropriate Assessment Practices: Required Training Plan annual dedicated time for test administrator training in Admin Code and Inclusion regulations. p. 4 KDE: OAA: DAS: jl: 1/23/2018 Interactive training must occur BEFORE test -related processes. p. 4 Distribute Test Administration Manuals in advance of testing. Signature Page must be signed. p. 4 p. 6 5

Training Signature KDE: OAA: DAS: jl: 1/23/2018 6

Appropriate Assessment Practices: Nondisclosure In addition to the required training, all persons helping with testing (i. e. , packing materials, providing accommodations, escorting students to test sites) must annually sign a form committing to nondisclosure of information and to follow appropriate practices as outlined in the regulation. p. 5 Nondisclosure Form KDE: OAA: DAS: jl: 1/23/2018 7

Test Security Ø Confidential Test Content Ø Secure Test Materials Ø Review of Secure Test Components KDE: OAA: DAS: jl: 1/23/2018 Ø Monitoring Test Security Ø Data forensics Ø KDE Site visits 8

Test Security: Confidential Test Content Acceptable Not Acceptable Knowing and teaching concepts p. 5 Taking notes or discussing test content p. 5 Visually scanning student response books p. 6 Scoring or deliberately reading test items p. 5, p. 6 Making a copy of alert papers p. 6 Reproducing secure test materials in whole or in part or paraphrasing in any way p. 7 Collect and destroy (i. e. shred) any notes, rough drafts, or scratch paper produced by students p. 6 Showing items in test booklets to anyone not administering the test p. 6 Revealing content of any secure test item p. 5 Using knowledge of any test items to prepare students for the assessment p. 5 KDE: OAA: DAS: jl: 1/23/2018 9

Test Security: Secure Test Materials Acceptable Not Acceptable Anyone having test booklets without authorization from the DAC or BAC p. 6 Distributing Test Administration Manuals administrators prior to the testing window p. 6 Making test booklets available to test administrators before the first scheduled day of testing or not keeping them secure between test sessions p. 6 Storing test booklets in classrooms unless double locked p. 6 Leaving test booklets outside of locked storage unattended p. 6 KDE: OAA: DAS: jl: 1/23/2018 10

Test Security: Secure Test Materials Acceptable Not Acceptable Trained staff taking test materials from school to administer to homebound/hospitalized students or for KDE-approved offsite group testing p. 5 Taking materials outside district or school buildings for purposes such as bubbling demographics or modifying Alternate Assessment materials. p. 5 Students using technology to respond to test items and saving responses to CDs or portable drives p. 5 Maintaining electronic or other versions of the secure assessment materials or student responses in the district p. 5 Allowing a student to take a test booklet or answer booklet out of the testing area without proper supervision p. 12 KDE: OAA: DAS: jl: 1/23/2018 11

Review of Secure Assessment Components p. 20 Persons outside of local district employment can request to review test materials (restricted access under supervision). KDE: OAA: DAS: jl: 1/23/2018 Local districts are not required to allow reviews of secure materials. KDE will permit a review of materials at KDE offices in Frankfort based on availability of appropriate staff to supervise the review. Individuals reviewing materials will be monitored at all times and are required to sign a legally-binding nondisclosure form. 12

Monitoring Test Security: Data Forensics Erasure analysis and score analysis can lead to the discovery of inappropriate practices such as: Cheat sheets KDE: OAA: DAS: jl: 1/23/2018 Test administrators leading students Adults changing to answers student answers through gestures or verbal clues Students receiving help from test administrators 13

Monitoring Test Security: KDE Site Visits are conducted during spring testing windows. Sites are chosen by both purposeful and random selection. KDE Site Visits DACs are notified shortly before arrival. DACs may notify schools and attend. KDE: OAA: DAS: jl: 1/23/2018 KDE Staff will request to see testing and storage areas and will collect specific documents (e. g. , seating charts, test schedules, test materials log sheet). 14

Test Security Check for Understanding Is it acceptable to take photos of test items for use next year so that you know you are teaching the correct content? Is it acceptable for teachers to receive Test Administration Manuals prior to the first day of testing? Is it acceptable to read only the bold type instruction script in the TAMs and skip the test administrator directions if you have been a test administrator in previous years? KDE: OAA: DAS: jl: 1/23/2018 15

Administration Practices Ø DAC and BAC Responsibilities Ø Active Monitoring Ø Appropriate Monitoring Ø Monitoring Breaks Ø Student Behavior Ø Testing Time KDE: OAA: DAS: jl: 1/23/2018 Ø Testing Order Ø Test Materials Ø Reporting Concerns Regarding Test Materials Ø Accommodations 16

Administration Practices: DAC and BAC Responsibilities p. 10 Schedule test administration Arrange for adequate staff to administer assessment Prepare accurate student testing rosters and seating charts Ensure all test materials are kept secure before, during and after testing KDE: OAA: DAS: jl: 1/23/2018 17

Administration Practices: Active Monitoring Acceptable Not Acceptable Test administrators circulating throughout the testing site during testing sessions. Principals and district administrators shall ensure that proper monitoring occurs p. 10 Space that limits the test administrator’s ability to circulate and monitor students during testing p. 10 Scheduling test sessions to prevent overcrowding in the testing location p. 10 Exceeding reasonable seating capacity in testing locations and rooms p. 10 KDE: OAA: DAS: jl: 1/23/2018 18

Administration Practices: Appropriate Monitoring Acceptable Not Acceptable Offering words of encouragement and general instructions that direct students to apply themselves to the task at hand, but do not imply evaluation of student work or allow an advantage are permissible (Examples include, “Do your best, ” “Get started, ” and “Stay on task. ”) p. 10 Engaging in any behavior that would assist the students in understanding or responding to any item on the test p. 10 Encouraging students to edit their responses by providing evaluation of student work p. 10 Coaching, editing, pointing out errors or missing answers p. 10 Making evaluative statements to students regarding their responses p. 13 District/school staff altering student answers at any time. p. 10 KDE: OAA: DAS: jl: 1/23/2018 19

Test Administration: Monitoring Breaks Acceptable Allowing students a restroom break during a testing session if monitored at all times p. 10 Not Acceptable Leaving students alone with test materials at any time p. 11 Conducting interval or restroom breakswithout affecting the integrity of the testing p. 11 Scheduling tests to avoid conflicts with lunch p. 11 KDE: OAA: DAS: jl: 1/23/2018 20

Test Administration: Student Behavior Acceptable Testing students who exhibit disruptive behavior prior to or during testing in a different location from their peers (A plan to avoid a disruptive situation can be in place prior to testing. ) p. 12 KDE: OAA: DAS: jl: 1/23/2018 Not Acceptable Allowing students to move about the room during a testing session p. 10 21

Administration Practices: Testing Time Acceptable Test administrators observing any time limits and following the specific directions in the provided manuals. p. 11 Not Acceptable Students taking more than a single school day to complete a testing session, except where there is a scheduled makeup session Students who are absent or missed test sections for any reason completing these during makeup sessions (The order of the test may be changed for makeup test sessions. ) p. 12 KDE: OAA: DAS: jl: 1/23/2018 22

Administration Practices: Testing Time for Accommodations Acceptable Begin additional time to complete a test session immediately following initial administration for students who receive extended time as part of their Individualized Education Plan (IEP), 504 Plan or Program Services Plan (PSP). (If students must move to another test location, they shall be escorted by a school staff member. ) p. 11 Not Acceptable For more information, see Inclusion of Special Populations in the State-required Assessment and Accountability Programs 703 KAR 5: 070. Changing the testing schedule only if a shortage of personnel exists for providing accommodations to students (If the schedule is changed, all students in the same grade must complete the same testing section by the end of the school day. ) p. 12 KDE: OAA: DAS: jl: 1/23/2018 23

Administration Practices: Testing Order Acceptable Administering test sections in the order in which they appear in the test booklets, with students of the same grade being simultaneously tested in the same content area and test session in a given school p. 11 Not Acceptable Altering the order of testing to facilitate the need for calculators or to provide accommodations p. 11 Allowing students to work ahead to future test session parts or to return to past test session parts p. 12 KDE: OAA: DAS: jl: 1/23/2018 24

Administration Practices: Test Materials Acceptable Distributing tests in the order in which they are packaged p. 6 Not Acceptable Altering testing materials prior to test administration (i. e. , trimming rulers, adding or removing information on reference sheets) p. 12 Keeping rulers and reference sheets after the completion of testing to use for instruction if so stated in specific test administration manuals p. 12 Modifying Alternate Assessment testing materials to the extent described in the administration manuals p. 12 KDE: OAA: DAS: jl: 1/23/2018 25

Reporting Concerns Regarding Test Materials Do NOT Reproduce Test Items in whole, in part, or by paraphrasing Identify Error by test, grade level, test form/ID number, subject and item number Example: K-PREP, Grade 7, form 3, mathematics, #26 KDE: OAA: DAS: jl: 1/23/2018 Summarize Error Notify DAC in a general manner that does not jeopardize test security who will then notify KDE Example: No correct answer choice is provided. 26

Administration Practices: Accommodations Acceptable Not Acceptable Providing accommodations that are consistent with the student’s evaluation data, IEP, 504 Plan, PSP, and the routine delivery of instructional services p. 11 Providing accommodations for the assessment that inappropriately interfere with or influence the administration of the assessment to other students p. 11 Giving a student more time on a specific test part than specified in the administration manual, unless the student has extended time as an accommodation on an IEP, 504 Plan or PSP p. 12 KDE: OAA: DAS: jl: 1/23/2018 27

Administration Practices Check for Understanding Is it acceptable to indicate to a student the appropriate work area in a test booklet or student response booklet after a testing session has begun? Is it acceptable to point out to a student that he/she probably hasn’t written enough for a constructed response? Is it acceptable to allow a student a few more minutes beyond stop time to finish an exam if he/she has been working diligently? KDE: OAA: DAS: jl: 1/23/2018 28

Classroom Materials Ø Ø Resources Calculators Electronic Devices Walls and Bulletin Boards KDE: OAA: DAS: jl: 1/23/2018 29

Classroom Materials: Resources Acceptable At the student’s request, providing resources in the testing environment that are specified in a student’s IEP, 504 Plan or PSP that are consistent with instructional strategies p. 8 Not Acceptable Providing any resources not listed in the administration manuals during testing p. 8 Making available blank writing or graph paper, blank (clear or colored) overlay sheets and bookmarks free of content at student workstations p. 9 KDE: OAA: DAS: jl: 1/23/2018 30

Classroom Materials: Resources Acceptable Not Acceptable Using dictionaries and thesauri, including non-programmable, electronic dictionaries and thesauri only for on-demand writing p. 8 Using dictionaries and thesauri on the reading, mathematics, science, or social studies content area tests p. 8 Allowing a student to have non-contentrelated materials such as books, puzzles, etc. , at the workstation after the test administrator has collected an individual student’s test materials p. 9 During testing, distributing, making available, or attaching to students’ workstations any information or materials that are not sent as part of the assessment materials or specified in the test administration manuals. p. 8 KDE: OAA: DAS: jl: 1/23/2018 31

Classroom Materials: Calculators Acceptable Not Acceptable Providing students access to the types of calculators as designated in the test administration manuals accompanying each state-required assessment p. 8 Allowing students to leave the testing area to gain access to any calculators, dictionaries or thesauri, blank writing or graph paper, or any resources used for accommodations as specified in 703 KAR 5: 070 p. 8 Schools providing calculators to students (Permitted electronic devices such as calculators will be listed in test administration manuals. ) p. 9 Students sharing calculators within the testing session. p. 9 KDE: OAA: DAS: jl: 1/23/2018 32

Classroom Materials: Electronic Devices Acceptable Not Acceptable Students using personal electronic devices for test administration as long as the device meets the acceptable use criteria for a particular assessment (Communication and Internet features must be disabled. ) p. 9 Using electronic devices in any way to gain a testing advantage p. 7 Test administrators using electronic devices to contact school administrators regarding test sessions p. 9 Students or test administrators using electronic devices except in the case of an emergency p. 9 If directed by KDE or test vendors for the purpose of test administration, accessing the Internet or imaging capabilities during test sessions p. 6 Accessing the Internet, wireless communication functions or imaging capabilities on electronic devices during testing sessions for purposes other than test administration p. 7 KDE: OAA: DAS: jl: 1/23/2018 33

Classroom Materials: Walls and Bulletin Boards Acceptable Placing materials on classroom walls and bulletin boards for instructional purposes anytime during the year p. 8 Not Acceptable Displaying or leaving any materials containing content information or strategies for solving problems uncovered p. 8 Leaving periodic tables or materials without content or strategies for solving problems uncovered p. 8 KDE: OAA: DAS: jl: 1/23/2018 34

Classroom Materials: Walls and Bulletin Boards p. 8 Basic periodic tables and motivational materials may remain posted. ACCEPTABLE KDE: OAA: DAS: jl: 1/23/2018 35

Classroom Materials: Walls and Bulletin Boards p. 8 Materials used during direct instruction, containing content, or strategies/processes should not be displayed on classroom surfaces including walls, workstations or clothing. Classroom materials shall not provide a testing advantage to any student. NOT ACCEPTABLE KDE: OAA: DAS: jl: 1/23/2018 36

Classroom Materials Check for Understanding Is it acceptable for a teacher to use his/her personal cellphone to communicate with another teacher about a testing situation in the classroom? Is it acceptable to allow students to use their own approved calculators instead of one provided by the school? Is it acceptable to allow students to read library or personal books as each student finishes and test materials are collected? KDE: OAA: DAS: jl: 1/23/2018 37

Test Preparation Ø Instruction Ø Test Simulation KDE: OAA: DAS: jl: 1/23/2018 38

Test Preparation: Instruction Acceptable Continuing normal instruction during the testing window p. 13 Regular Review of content as part of the ongoing year-long instructional practice p. 13 Instructional activities that positively contribute to students’ overall learning experience p. 15 Not Acceptable Cessation of all normal instruction during the testing window, except during test sessions Altering the order of instruction to match the order of content area tests p. 13 Developing or modifying a culminating review of content based on information gained from secure test booklets p. 13 Teachers and other staff shall not be required to conduct test preparation activities instead of regular classroom instruction and shall not be required to conduct test prep activities outside the normal work day. p. 13 KDE: OAA: DAS: jl: 1/23/2018 39

Test Preparation: Test Simulation Acceptable Embedding test taking strategies in regular content instruction p. 13 Not Acceptable Test prep activities that simulate test administration without providing feedback to students to enhance learning and to teachers to improve instruction p. 13 Scrimmages, content review, benchmark testing, etc. , types of activities, if results are used to guide further instruction and to identify and improve areas of student weakness p. 14 Test prep courses and strategies that implement content instruction and Kentucky’s content standards p. 13 KDE: OAA: DAS: jl: 1/23/2018 40

Student Motivation and Rewards Ø Good Faith Effort Checklist Ø Student Discipline Ø Funding KDE: OAA: DAS: jl: 1/23/2018 41

Student Motivation/Rewards: Good Faith Effort Checklist Acceptable Not Acceptable Visually scanning student responses during or after the testing session to determine good faith efforts based on a checklist created and communicated to students and parents prior to testing p. 14 Reading student responses in their entirety as part of visually scanning for good faith effort criteria p. 6 Including a pre-writing requirement (determined by the student) on a good faith effort checklist p. 14 Specifying a particular organizer, pre-write method or first draft for the good faith effort checklist p. 14 Making individual results from checklists or any other evaluative statements available to students before the entire assessment has been administered and submitted to the BAC or DAC p. 13 Making results or rewards based on individual checklists available to students before all testing is complete p. 14 KDE: OAA: DAS: jl: 1/23/2018 42

Student Motivation/Rewards: Funding Acceptable Using donations from individuals, businesses, parents, or school staff for student incentives p. 14 Not Acceptable Using local school board funds or cash awards from school activity funds generated by students for student incentives or rewards p. 14 Using Extended School Services (ESS) funds for test preparation p. 14 KDE: OAA: DAS: jl: 1/23/2018 43

Student Motivation/Rewards: Student Discipline Acceptable Visually scanning student responses during or after the testing session to determine disciplinary problems p. 14 Not Acceptable Allowing students to modify their initial response to test items if disciplinary problems are determined to exist p. 14 Instructing a student to answer the questions again on separate sheets of paper for disciplinary purposes when his/her responses to test items are reviewed and are found to contain inappropriate language or drawings (e. g. , obscenities) p. 14 KDE: OAA: DAS: jl: 1/23/2018 44

Test Preparation/ Student Motivation and Rewards Check for Understanding Is it acceptable to announce on the intercom each day the results of the Good Faith Effort Checklist? Is it acceptable to let students know that they are doing a good job on test responses? Is it acceptable on a Good Faith Effort Checklist to require students to use a strategy they learned in class when answering test questions? KDE: OAA: DAS: jl: 1/23/2018 45

Administration Code Violations Ø Allegations Categories Ø Allegations Process KDE: OAA: DAS: jl: 1/23/2018 46

Monitoring Test Security: Allegations Categories Allegation Category Examples Inappropriate Assistance/Intervention by Staff Leading students to answers, making corrections to student work Test Security (Staff) Discussing item specifics, leaving materials unattended Test Security (Student) Removing a test booklet from a testing location Out of Order (Staff) Not following test schedule Out of Order (Student) Working ahead or in prior sections Special Education Giving inappropriate accommodations or not providing accommodations Student Action Using cell phones or prohibited materials Missing Test Booklets Misplacing or failing to collect books by test administrator Other Giving feedback, allowing students to change answers after testing KDE: OAA: DAS: jl: 1/23/2018 47

Monitoring Test Security: Allegations Process pp. 18 -19 Allegation is referred to the KDE Allegations Coordinator KDE: OAA: DAS: jl: 1/23/2018 Allegations Coordinator investigates Allegations Coordinator reports findings to Board of Review reviews and makes recommendation to Commissioner makes final determination District receives a letter from KDE stating the actions to be taken 48

Inclusion of Special Populations p. 16 } Training required } Proper administration of accommodations } Any violation of Inclusion of Special Populations regulation also considered a violation of the Administration Code KDE: OAA: DAS: jl: 1/23/2018 49

Alternate Assessment Acceptable Not Acceptable Required training for administration of the Alternate Assessment components p. 16 Altering results of Alternate Assessment components p. 16 Students having primary ownership of their assessment pieces (Any intervention from teachers, peers or others should enhance rather than remove or diminish that ownership. ) p. 16 Using any accommodation or assistive device that is not a regular part of instruction p. 16 Keeping Alternate Assessment components (considered secure) in locked storage until administration p. 16 Adding or subtracting, revising or working on Alternate Assessment materials after the completion of the deadline p. 16 KDE: OAA: DAS: jl: 1/23/2018 50

Proper Reporting of Student Data and Nonacademic Indicators p. 20 Local districts are responsible for submitting and/or correcting student data and nonacademic indicators as accurately as possible for use in public reporting. KDE: OAA: DAS: jl: 1/23/2018 Submitting incorrect data for the purpose of inaccurately affecting public reports is considered a violation. Schools and districts shall follow KDE guidance on the release of data during the data review periods and adhere to embargoed dates. 51

Division of Assessment Support } Jennifer Stafford, Director } Michael Hackworth, Branch Manager } Joy Barr, Program Consultant } Jenni Larkins, Program Consultant } Kevin O’Hair, Program Consultant } Pam Powers, Systems Consultant IT } Cindy Warren, Program Consultant } Chris Williams, Program Consultant } Teresa King, Support Staff KDE: OAA: DAS: jl: 1/23/2018 (502) 564 -4394 dacinfo@education. ky. gov 52