Administration Code Training Office of Assessment and Accountability
Administration Code Training Office of Assessment and Accountability Kentucky Department of Education August 2009 1
Allegations for 2009 4, 6, 18, 24, 27, 36, 39, 47 Allegation Inappropriate Assistance/Intervention by Staff # of Incidents Test Security (Staff) Test Security (Student) Out of Order (Staff) Out of Order (Student) Special Education Student Action Missing Test Booklets Other Unavailable August 2009 2
Allegations for 2009 Allegation # of Incidents Inappropriate Assistance/Intervention by Staff 18 Test Security (Student) 27 Out of Order (Staff) 24 Test Security (Staff) Out of Order (Student) Special Education Student Action Missing Test Booklets Other 39 6 36 4 Unavailable 47 August 2009 3
Purpose of This Training To review the appropriate practices for the state assessment system as defined in the Administration Code for Kentucky’s Educational Assessment Program (703 KAR 5: 080) Revised May 2009 To review the Inclusion of Special Populations in the State-Required Assessment and Accountability Programs (703 KAR 5: 070) Revised October 2008 August 2009 4
703 KAR 5: 080 Table of Contents I. III. IV. V. VI. Rationale Appropriate Assessment Practices Violations of the 703 KAR 5: 080 Administration Code Review of Secure Assessment Components Proper Reporting of Nonacademic Indicators Signature Page August 2009 5
Key to Administration Regulation and Training Power. Point ACCEPTABLE NOT ACCEPTABLE From the Regulation Positive Statement Aligns Topic Change appears below line in regulation New or Clarified information in Bold Blue Negative Statement Aligns Topic Change appears below line in regulation New or Clarified information in Bold Blue From the Power. Point August 2009 6
I. Rationale Multiple state-required assessments 1. 2. 3. Professional Ethics 704 KAR 20: 680 Educational Defensibility Teach the content Student Ownership All work done entirely by the student August 2009 7
NRT KCCT ACT PLAN EXPLORE Alternate Assessment Access KY Non. Academic Data August 2009 8
II. APPROPRIATE ASSESSMENT PRACTICES Test Security, Procedures for Reporting Errors, Classroom Materials, Administration Practices, Test Preparation, Inclusion of Special Populations, & Alternate Assessment August 2009 9
Appropriate Assessment Practices Requires annual training for all individuals involved in any component of the state assessment Annually read and comply with documents and manuals specific to the state-wide assessment Training includes “documents and administration manuals specific to staterequired assessment components” August 2009 10
Appropriate Assessment Practices Training must be completed prior to any state required assessment administration 703 KAR 5: 080 & 703 KAR 5: 070 shall be reviewed prior to spring test administration by all involved in assessment August 2009 11
Test Security “DACs, administrators, and teachers shall ensure the security of the assessment materials before, during, and after test administration. ” “When not being used for a scheduled testing session, all assessment materials shall be stored in a secure location with access granted to authorized personnel only. ” August 2009 12
Test Security ACCEPTABLE Using Kentucky’s Core Content for Assessment Using released items Signing of nondisclosure forms by noncertified personnel assisting with testing NOT ACCEPTABLE Revealing any secure test item Using secure test items to prepare students for assessment Taking notes about or discussing the content, concepts or structure of any secure test item August 2009 13
Test Security ACCEPTABLE Using technology to save responses to CDs or portable drives (i. e. , flash drives, floppy discs, etc. ) Copying of Alert Papers by DAC, BAC or school administrator NOT ACCEPTABLE Saving student responses electronically to local drives or network drive Reproducing secure test materials in any way Access to electronic devices with wireless communication or imaging capabilities August 2009 14
Test Security ACCEPTABLE Destroying student notes, rough drafts or scratch paper after testing Visually scanning student response booklets for stray marks and “good faith effort” NOT ACCEPTABLE Scoring of test items or rough drafts is not permitted Reading student responses in entirety for “good faith effort” is not permitted August 2009 15
Test Security ACCEPTABLE Distributing Test Administration Manuals (TAMs) to administrators or proctors prior to the testing window Distributing tests in the order of the shrink -wrapped packages Ensuring that reusable test materials are free of any marks made by past students NOT ACCEPTABLE Making test booklets available to administrators or proctors prior to the testing window Showing test items to anyone not administering the test Leaving test booklets unattended outside of locked storage Storing test booklets in a classroom without doublelocked storage August 2009 16
Reporting Errors Example – For DAC Sent to KDE from DAC Grade Level Grade 4 Content Area & Part Reading – Part B Form 3 A Page Number Page 30 Identify item as multiple Multiple Choice Item # 2 choice or open response or on-demand writing prompt Do not reproduce test item! Error or Problem No correct answer choice provided August 2009 17
Classroom Materials & Surfaces Content information or strategies/processes cannot be displayed on any classroom surface, including clothing. Materials containing content information or strategies/processes added to classroom surfaces during instruction must be removed or covered during the assessment. Periodic tables and motivational-type posters may remain. August 2009 18
My Classroom Coverings ACTIVITY What are acceptable materials on the walls, ceilings, floors, blinds, windows and clothing during testing? ACTIVITY August 2009 19
Acceptable Materials Dictionaries & Thesauri for on-demand writing Calculators as designated in the administration manual for that assessment Required for KCCT Mathematics Optional for KCCT, other content areas Refer to EXPLORE, PLAN & ACT manuals for acceptable calculators Blank writing or graph paper, blank overlay sheets, and bookmarks which are free of content August 2009 20
Not Acceptable Practices � Sharing calculators during testing session � Leaving the testing area for calculators, dictionaries, thesauri, blank writing or graph paper, etc. � Having materials or information at the student workstation that was not sent as a part of the assessment August 2009 21
Administration Practices General Instructions “Do your best” “Stay on task” Assistance or Evaluative Comments “You can do better. ” “You can write more. ” August 2009 22
Students with Accommodations for assessment shall be consistent with a student’s current IEP, 504 or PSP. Accommodations for one student shall not interfere or influence the assessment of another student. Students who exhibit disruptive behavior prior to or during testing may be tested in a different location from their peers. August 2009 23
Breaks During Testing Restroom breaks are allowed, if the student is monitored at all times. Lunch Break Tests should be scheduled to avoid lunch. If lunch is unavoidable, it should be brought to the students in the testing area. If there are too many students to bring lunch to the testing area, then students may be escorted to the lunchroom and monitored to prevent discussion. August 2009 24
Do either of these classrooms display suitable arrangements for testing? Why or Why Not? August 2009 25
Testing Schedules All students in the same grade level in the same school must be simultaneously assessed in the same content area. • Students that are absent should resume testing with their class in the section that the class is testing. • Example: A student that was absent for Part A and returns to school when Part B is being administered will take Part B with the class. Then he will take Part A in a makeup session later. August 2009 26
Testing Schedules � � Time Limits and extended time for each assessment must be followed per the administration manual. Students with extended time as an accommodation on an IEP, 504 Plan or PSP may have additional time during that school day. August 2009 27
Student Illness – vs. – Appointment If a student is ill and cannot finish the test section, the student may complete that section later. The student may not return to previously answered parts of the section. If a student leaves during the test session for a reason other than sudden illness, the student cannot complete the test section at a later time. August 2009 28
Test Preparation ACCEPTABLE – Instructional Practice • Continuing normal instruction during testing window • Ongoing regular review of year long content • Embedded test taking strategies in regular content instruction • Test item retaken for disciplinary purposes NOT ACCEPTABLE – Instructional Practice • Cessation of normal instruction during testing window • Review of content based upon information from secure test materials • Test prep courses with no link to Program of Studies August 2009 29
Test Preparation • • Test preparation or practice activities are not to be conducted instead of regular classroom instruction. Teachers and other staff shall not be required to conduct test preparation or practice activities outside the normal work day. August 2009 30
Good Faith Effort � Can include pre-writing requirement (type to be determined by the student) � Cannot require complete first drafts Cannot include evaluative statements or grade assignments of test answers Cannot give feedback until after test booklets are returned to the BAC or DAC August 2009 31
Rewards or Motivational Strategies Shall be consistent with those applied within the regular curriculum or with the larger school program in general and attainable year round for student achievement. August 2009 32
Funding of “rewards” Follow School Food Services Guidelines and local and state boards finance policies. Local school board funds or cash awards from school activity funds generated by students shall not be used for student incentives. ESS funds shall not be used for test preparation. Donations from individuals, businesses, parents or school staff can be used for student incentives. August 2009 33
Inclusion of Special populations � Those providing accommodations must be trained in Administration Code and how the student uses accommodations. � Accommodations during an assessment shall be consistent with 703 KAR 5: 070, Procedures for the Inclusion of Special Populations August 2009 34
Alternate Assessment Students in program have primary ownership of assessment pieces Yearly training for administration is required Alternate Assessment components are secure materials Altering results of Alternate Assessment components is prohibited August 2009 35
III. Violations of the Administration Code for Kentucky’s Educational Assessment Program August 2009 36
Reporting Allegations All allegations, or perceived inappropriate testing procedure or behavior, should be reported to the Building Assessment Coordinator (BAC) and then to the District Assessment Coordinator (DAC). If the DAC is the one not following proper procedure and does not correct or report the situation, a call or e-mail can be placed to the Allegations Coordinator in the Office of Legal Services by any concerned person. August 2009 37
Alleged Testing Violation Process Step 1 Allegation referred to KDE Allegation Coordinator Step 2 KDE manages investigation process Step 3 Findings reported to Board of Review Step 4 Board of Review makes recommendations to Commissioner of Education Step 5 Commissioner of Education makes final determination Step 6 District receives letter from KDE with action to be taken
IV. Review of Secure Assessment Components by Parents and Persons not in the Employment of a Kentucky Public School District August 2009 39
Review of Secure Materials �Parents and Others not employed by a Kentucky Public School District may: review secure materials at the KDE office in Frankfort and not at the local district. �A nondisclosure statement must be signed before reviewing secure assessment components. August 2009 40
V. Proper Reporting of Nonacademic Indicators (Attendance, Retention, Dropout Rate, Graduation Rate and Transition to Adult Life) August 2009 41
Nonacademic Data � Local districts shall: ◦ report data to KDE. ◦ inform KDE of any errors in reporting. � Data that is reported is lagged by one year. ◦ Example: Information reported in fall will be information regarding students in the prior school year. August 2009 42
VI. Signature Page August 2009 43
Signature Page – 1 page/person August 2009 44
Questions? Division of Assessment Support Rhonda Sims, Director Phyllis Shuttleworth, Branch Manager Joy Barr, Program Consultant Cindy Greer, Program Consultant Kathy Moore, Program Consultant Kevin O’Hair, Program Consultant Pam Powers, Systems Consultant IT Chris Williams, Program Consultant August 2009 45
- Slides: 45