Assessment Options for Students with Disabilities 2019 2020

Assessment Options for Students with Disabilities 2019 -2020 Department of Student Assessment, Accountability & ESEA Programs 1

Discussion Topics • State Assessment Options for Students with Disabilities • Assessment Updates for Students with Disabilities • Testing Accommodations • Virginia Alternate Assessment Program (VAAP) Department of Student Assessment, Accountability & ESEA Programs 2

Students with Disabilities in VA § The majority of students with disabilities will be instructed in the general curriculum and will participate in the Standards of Learning assessments. § An additional small number of students with significant cognitive disabilities will be instructed on an adapted curriculum and will participate in the state alternate assessment based on alternate achievement standards. Department of Student Assessment, Accountability & ESEA Programs 3

2019 -2020 State Assessment Options for Students with Disabilities (SOL) Standards of Learning (SOL) Tests with or without accommodations • Students are instructed in grade level content. Disability does not prevent the demonstration of knowledge through multiple-choice and technology enhanced formats with or without accommodations. Department of Student Assessment, Accountability & ESEA Programs 4

2019 -2020 State Assessment Options for Students with Disabilities (VAAP) Virginia Alternate Assessment Program (VAAP) • Students are not instructed in grade level content. Disability requires content that is reduced in depth and complexity. In Virginia, these are the Aligned Standards of Learning (ASOL). • The VMAST EOC Reading assessment is no longer available beginning in Fall 2019. Department of Student Assessment, Accountability & ESEA Programs 5

Determination of How Students with Disabilities Participate in Virginia’s Assessment System – Role of IEP Team/504 Committee For all students with disabilities identified under IDEA, the IEP Team determines how the student will participate in the assessment system. For students identified under Section 504, the 504 Committee determines how the student will participate. 6 Department of Student Assessment, Accountability & ESEA Programs 6

Determination of How Students with Disabilities Participate in Virginia’s Assessment System – IEP or 504 Plan A student’s IEP or 504 Plan must specify the student’s participation in the state assessment system as follows: – participation in the SOL test with or without accommodations or – participation in VAAP. 7 Department of Student Assessment, Accountability & ESEA Programs 7

Determination of How Students with Disabilities Participate in Virginia’s Assessment System VAAP Participation (1 of 2) If the IEP Team determines that the student must participate in VAAP instead of the SOL program, a statement that addresses each of the following must be included in the IEP: – Why the student cannot participate in the regular SOL assessment; – Why participation in VAAP is appropriate for the student, including how the student meets the criteria for the alternate assessment; and 8 Department of Student Assessment, Accountability & ESEA Programs 8

Determination of How Students with Disabilities Participate in Virginia’s Assessment System VAAP Participation (2 of 2) – How the student’s participation in VAAP will contribute to the student’s promotion and/or graduation or other matters. Additional guidance is available in the documents, VAAP Participation Criteria and the Determination of Significant Cognitive Disabilities. 9 Department of Student Assessment, Accountability & ESEA Programs 9

Non-Participation of Students with Disabilities in the Virginia Assessment Program Neither the IEP Team nor the 504 Committee can make the decision that a student will not participate in state assessments. If a parent requests that a student not participate in one or more state assessments, then the IEP Team or 504 Committee must be convened to explain the consequences associated with non-participation. Department of Student Assessment, Accountability & ESEA Programs 10

Documentation of Non-Participation for Students with Disabilities in the Virginia Assessment Program Documentation indicating that the consequences of the decision have been fully explained to and understood by the parent, guardian, surrogate or student must be attached to or become part of the student’s IEP or 504 Plan. Department of Student Assessment, Accountability & ESEA Programs 11

ASSESSMENT UPDATES Department of Student Assessment, Accountability & ESEA Programs 12

Reading (2017 SOL) Tests (1 of 2) The reading assessments measuring the 2017 English Standards of Learning will be administered for the first time in the spring 2020 test administration in grades 3 through 8 and end-of-course (EOC). See Superintendent’s Memo #260 -18 Department of Student Assessment, Accountability & ESEA Programs 13

Reading (2017 SOL) Tests (2 of 2) • To support preparation for implementation of the 2017 English Standards of Learning, the new reading test blueprints are available online along with the revised Standards of Learning and the Curriculum Framework. Department of Student Assessment, Accountability & ESEA Programs 14

History (2015 SOL) Tests (1 of 2) The history assessments measuring the 2015 History and Social Science Standards of Learning will be administered for the first time in the spring 2020 test administration in the following areas: • Virginia Studies • Civics and Economics • EOC Virginia and United States History See Superintendent’s Memo #092 -19 Department of Student Assessment, Accountability & ESEA Programs 15 15

History (2015 SOL) Tests (2 of 2) The other EOC History and Social Science Standards of Learning tests, which include: • World History to 1500, • World History from 1500 to the Present, and • World Geography tests, will continue to be based on the 2008 History and Social Science Standards of Learning. Department of Student Assessment, Accountability & ESEA Programs 16

Audio Accommodation for Online Reading (2017 SOL) and History (2015 SOL) Tests (1 of 2) Beginning in spring 2020, the audio accommodation for the online Reading (2017 SOL) and Virginia Studies, Civics and Economics, and Virginia and U. S. History (2015 SOL) tests will be delivered through the text-to-speech feature in Test. Nav. Practice items will available in fall 2019 for teachers and students to experience the text-to-speech audio and controls in Test. Nav for these content areas. Department of Student Assessment, Accountability & ESEA Programs 17

Audio Accommodation for Online Reading (2017 SOL) and History (2015 SOL) Tests (2 of 2) A testing memo will be sent to announce when the practice items for the Reading (2017 SOL) and Virginia Studies, Civics and Economics, and Virginia and U. S. History (2015 SOL) tests are updated with the text-to-speech feature. Department of Student Assessment, Accountability & ESEA Programs 18

Paper, Large Print, and Braille Reading (2017 SOL) Tests The paper, large print, and braille Grades 3 -8 and EOC Reading (2017 SOL) tests will not have an audio CD available. If a student taking a paper, large print, or braille test requires an audio test accommodation, then a read-aloud accommodation (i. e. , the examiner reads the test to the student) must be provided. Department of Student Assessment, Accountability & ESEA Programs 19

Paper, Large Print, and Braille History (2015 SOL) Tests – No Audio CD The paper, large print, and braille format of the following History (2015 SOL) tests will not have an audio CD available when introduced in spring 2020: • Virginia Studies • Civics and Economics • EOC Virginia and U. S. History Department of Student Assessment, Accountability & ESEA Programs 20

Paper, Large Print, and Braille History (2015 SOL) Tests – Provide Read-Aloud If a student taking a paper, large print, or braille test requires an audio test accommodation, then a read-aloud accommodation (i. e. , the examiner reads the test to the student) must be provided. Refer to Appendix B for guidance on Read-Aloud test administrations. Department of Student Assessment, Accountability & ESEA Programs 21

Unified English Braille (UEB) (1 of 2) • Beginning in spring 2020, grades 3 -8 and EOC Reading (2017 SOL) tests and Virginia Studies, Civics and Economics, and EOC Virginia and U. S. History (2015 SOL) tests will be transcribed in Unified English Braille (UEB). Department of Student Assessment, Accountability & ESEA Programs 22

Unified English Braille (UEB) (2 of 2) • Statewide assessments will be transcribed in UEB for literary and technical content areas (e. g. , Reading, Mathematics, and Science) as new assessments are implemented to align with revised SOL. • See Superintendent’s Memo #198 -16 Department of Student Assessment, Accountability & ESEA Programs 23

TESTING ACCOMMODATIONS Department of Student Assessment, Accountability & ESEA Programs 24

Test Accommodations (1 of 2) § are approved changes in the administration of an assessment resulting in an adjustment to how the test is presented or how the student responds to test items. § must be based upon individual student need, and not upon the category of disability, level of instruction, or program setting. § must be justified and documented in the student’s IEP or 504 Plan. Department of Student Assessment, Accountability & ESEA Programs 25

Test Accommodations (2 of 2) • should be aligned with and part of daily instruction. • should not be introduced for the first time during the administration of a state assessment. Department of Student Assessment, Accountability & ESEA Programs 26

Selecting Testing Accommodations for State Assessments (1 of 2) § Each test accommodation should be considered and discussed separately for each content area assessment. § Only test accommodations needed by the student to access the assessment should be selected. Department of Student Assessment, Accountability & ESEA Programs 27

Selecting Testing Accommodations for State Assessments (2 of 2) § Use Students with Disabilities: Guidelines for Special Test Accommodations to determine which accommodations are permitted for specific writing and non-writing tests. § Use the Test Implementation Manual to verify the conditions under which the accommodation must be administered in a testing session. Department of Student Assessment, Accountability & ESEA Programs 28

Test Implementation Manual- Appendix B • Appendix B located in the Test Implementation Manuals lists and explains the allowable testing accommodations available to eligible students with disabilities. • The accommodations in Appendix B are placed in four categories with guidance on how accommodations should be administered to eligible students with disabilities during a testing session. Department of Student Assessment, Accountability & ESEA Programs 29

Test Accommodations – Important Note § Any test accommodations which may enhance student performance beyond providing equal access are considered inappropriate and, therefore, are not permitted. § Some accommodations that are appropriate for instructional use are inappropriate for state assessments, and their use is not permitted. Department of Student Assessment, Accountability & ESEA Programs 30

Appendix B § An accommodation not listed in Appendix B of the Test Implementation Manual may only be used with prior approval from VDOE through the Special Assessment Accommodation Request process. § The use of an accommodation which is not approved is considered a test irregularity which may result in invalidation of the student’s score and may require retesting. Department of Student Assessment, Accountability & ESEA Programs 31

Testing Accommodations The following clarifications have been provided to existing testing accommodations documented in Appendix B of the Test Implementation Manual: Graphic Organizers: The structure of the graphic organizer may not clue or guide the student in any manner. The graphic organizer may not be visible to other students. Department of Student Assessment, Accountability & ESEA Programs 32

Plain English Mathematics (1 of 2) • The Plain English Algebra I (2009 SOL) test is only available to students with disabilities who – previously passed an Algebra I class prior to Spring 2019 and – need to retake the Plain English Algebra I (2009 SOL) test for verified credit to meet graduation requirements. Department of Student Assessment, Accountability & ESEA Programs 33

Plain English Mathematics (2 of 2) • The Plain English Grade 8 Mathematics (2009 SOL) test is only available to students with disabilities who are pursuing a Modified Standard Diploma. Students must still meet the qualifying criteria. Department of Student Assessment, Accountability & ESEA Programs 34

CALCULATOR ACCOMMODATIONS Department of Student Assessment, Accountability & ESEA Programs 35

Calculator Accommodation- Student’s Disability The IEP Team or 504 Committee must consider the unique aspects of the student’s disability which have an impact on the student’s ability: • to access the mathematics curriculum, and/or • to demonstrate his or her understanding of the mathematical concepts assessed on the SOL test. Department of Student Assessment, Accountability & ESEA Programs 36

Calculator Accommodation-Identify Need (1 of 2) In light of the characteristics of the student’s disability, the IEP Team or 504 Committee must: • consider the types of instructional methods and accommodations used in the classroom and types of assessment accommodations, other than a calculator, which will be provided for the student, and Department of Student Assessment, Accountability & ESEA Programs 37

Calculator Accommodation-Identify Need (2 of 2) • identify the specific calculator accessibility features and/or additional mathematical capabilities which correlate to the aspect(s) of the student’s disability and are required by the student to access the SOL assessment. Department of Student Assessment, Accountability & ESEA Programs 38

Complete Calculator Accommodation Criteria Form The IEP Team or 504 Committee must complete the Calculator Accommodation Criteria Form to document the student’s need to use: • a calculator with accessibility features, and/or • a calculator with additional mathematical capabilities, and/or • a calculator and/or arithmetic tools on the non-calculator portion of a SOL Mathematics assessment. Department of Student Assessment, Accountability & ESEA Programs 39

Calculator Accommodation Criteria Form – (1 of 2) Department of Student Assessment, Accountability & ESEA Programs 40

Calculator Accommodation Criteria Form – (2 of 2) Department of Student Assessment, Accountability & ESEA Programs 41

Calculator Accommodation. Justification Statement (1 of 2) The IEP Team or 504 Committee must complete each pertinent Justification Statement including: • a description of the impact of the student’s disabilities as related to mathematics, • a complete list of the calculator’s accessibility features and/or additional mathematical capabilities based on the completed Checklist of Mathematical Capabilities for Approved Calculators, and Department of Student Assessment, Accountability & ESEA Programs 42

Calculator Accommodation. Justification Statement (2 of 2) • an explanation of how the specific characteristics of the student’s disabilities are addressed by the features and/or capabilities of the selected calculator. Department of Student Assessment, Accountability & ESEA Programs 43

Calculator Accommodation-Use Checklist The IEP Team or 504 Committee must: • complete the Checklist of Mathematical Capabilities for Approved Calculators provided with the Calculator Accommodation Criteria Form for each calculator considered, and • select the calculator best suited to provide the features or capabilities required by the student. Department of Student Assessment, Accountability & ESEA Programs 44

Calculator Accommodation Criteria Form – Checklist Department of Student Assessment, Accountability & ESEA Programs 45

Calculator Accommodation Criteria Form – Appendix Department of Student Assessment, Accountability & ESEA Programs 46

Calculator Accommodation - Submission to VDOE The DDOT must submit a Special Assessment Accommodation Request with the Calculator Accommodation Criteria Form to VDOE, • if the IEP Team or 504 Committee determines that the student with disabilities requires a specific calculator with accessibility features and/or additional mathematical capabilities and • the calculator has one or more additional mathematical capabilities that the student is not eligible to use. Department of Student Assessment, Accountability & ESEA Programs 47

Calculator Accommodation - VDOE Approval The Special Assessment Accommodation Request must explain how student access to the specific additional mathematical capabilities the student is not eligible to use will be prevented during testing. Please note: • Some additional mathematical capabilities are integrated into the calculator (e. g. , Algebraic or Equation Operating Systems, multi-line display) so that they may not be restricted. • Any student using such a calculator will inherently use those capabilities and, thus, must be eligible to do so. Department of Student Assessment, Accountability & ESEA Programs 48

DESMOS and/or Hand-Held Calculators For online Grades 4– 8 and EOC Mathematics (2016 SOL) tests, the Desmos Virginia calculator is provided within Test. Nav for the sections of the mathematics assessments in which a calculator is permitted. School divisions are permitted to continue to provide one of the hand-held calculators from the list of Approved Calculators for the Virginia Standards of Learning Assessments, in addition to the Desmos calculator provided within Test. Nav. Department of Student Assessment, Accountability & ESEA Programs 49

DESMOS and Paper/Pencil Tests For paper Grades 4– 8 and EOC Mathematics (2016 SOL) tests administered to students with a documented need for a paper test, school divisions may provide a hand-held calculator from the list of Approved Calculators for the Virginia Standards of Learning Assessments and/or provide access to the Desmos Virginia calculator for the sections of the Mathematics assessments in which a calculator is permitted under the following specific conditions: Department of Student Assessment, Accountability & ESEA Programs 50

DESMOS and Paper/Pencil Test Conditions (1 of 2) • Access to the Desmos Virginia calculator must only be provided using the appropriate Desmos Virginia Calculator Training Center Test to ensure the student has access to the approved calculator and does not have access to other applications or the Internet while using the calculator. Department of Student Assessment, Accountability & ESEA Programs 51

DESMOS and Paper/Pencil Test Conditions (2 of 2) • A proctor must observe the test session to verify the student has not exited or closed the Training Center test to access other applications or the Internet rather than using the Desmos Virginia calculator. • Upon completion of the test, the proctor must sign a written statement indicating that the test was administered under the above conditions. Department of Student Assessment, Accountability & ESEA Programs 52

DESMOS and Non-Calculator Section of the SOL Mathematics Test • For students with disabilities eligible to use State approved calculators on the non-calculator section of the online or paper 3– 7 Mathematics SOL tests, the IEP/504 Plan must specify whether to provide: – a hand-held calculator (State Approved) for the mathematics tests, and/or – access to the Desmos Virginia calculator during their mathematics test following the specific conditions provided in the previous slides. Department of Student Assessment, Accountability & ESEA Programs 53

VIRGINIA ALTERNATE ASSESSMENT PROGRAM (VAAP) Department of Student Assessment, Accountability & ESEA Programs 54

VAAP 2019 -2020 § An evidence-based alternate assessment for students with significant cognitive disabilities in grades 3 -8 and high school. § Students participating in the VAAP assessment are instructed on academic content in Reading, Writing, Mathematics, Science and History/Social Science reduced in depth and complexity known as the Aligned Standards of Learning (ASOL). Department of Student Assessment, Accountability & ESEA Programs 55

VAAP Participation Criteria and Guidance Document • The VAAP Participation Criteria have been revised by the Department of Special Education and Student Services. • The revised participation criteria will be implemented during annual IEP meetings occurring during the 2019 -2020 school year. • Note: IEP’s developed during the 2018 -2019 school year do not need to be amended. Department of Student Assessment, Accountability & ESEA Programs 56

VAAP Eligibility § Participation is determined by the IEP Team based on the VAAP participation criteria. § For additional guidance refer to the documents: § Students with Disabilities: Guidelines for Assessment Participation § VAAP Participation Criteria and the Determination of Significant Cognitive Disabilities Department of Student Assessment, Accountability & ESEA Programs 57

Various Types of VAAP Evidence • • • Work Samples Audio/ Video Captioned Photographs Anecdotal Records Data Charts/Graphs Interviews Department of Student Assessment, Accountability & ESEA Programs 58

High School VAAP Participation § High school students participating in VAAP must submit Collections of Evidence (COE) that include Reading, Writing, Mathematics, Science and History/Social Science by the end of their 11 th grade school year or according to a schedule determined by the local school division. § Divisions have the option either to continue the submission of required VAAP content areas in grade 11 only or to develop a schedule in which one or more content areas are submitted in grades 9, 10, or 11. Department of Student Assessment, Accountability & ESEA Programs 59

High School VAAP Submission Schedule § For example, the division may determine that VAAP Science will be collected in grade 9, History/Social Science in grade 10, and Reading, Writing, and Mathematics in grade 11. § The division must provide this information to the Virginia Department of Education via the Education Registry Application (ERA) available in SSWS. § Contact resultshelp@doe. virginia. gov. Department of Student Assessment, Accountability & ESEA Programs 60

VAAP in 2019 -2020 • During the 2019– 2020 school year, students participating in VAAP Reading and Writing will continue to complete evidence based on the 2010 Aligned Standards of Learning (ASOL). • The 2010 Reading and Writing ASOL will continue to be assessed in VAAP through the 2020 -2021 school year. • The Aligned Standards of Learning (ASOL) have been removed from the VAAP Implementation Manual and are available on the Virginia Department of Education website. Department of Student Assessment, Accountability & ESEA Programs 61

VAAP 2019 -2020 • During the 2019– 2020 school year, students participating in VAAP Mathematics will continue to complete evidence based on the 2009 Aligned Standards of Learning (ASOL). • The 2009 Mathematics ASOL will continue to be assessed in VAAP through the 2020 -2021 school year. Department of Student Assessment, Accountability & ESEA Programs 62

VAAP Audit Concerns 2018 -2019 (1 of 3) Concerns with VAAP Collections of Evidence (COE) selected for audit were: – – – Affidavits: Missing or incorrect information SEI Tags: Missing or incorrect information Cover Sheet and SEI Tag discrepancies Levels of Performance Scoring Rule Violations Department of Student Assessment, Accountability & ESEA Programs 63

VAAP Audit Concerns 2018 -2019 (2 of 3) 47 School Divisions had issues with affidavits: – Missing or outdated affidavits – No signature, incorrect STI, DOB or name – Affidavit did not match student evidence 56 School Divisions had issues with SEI tags: – Missing reporting category, ASOL number or bullet – Additional bullets – Correct on SEI tag but incorrect in PAN Department of Student Assessment, Accountability & ESEA Programs 64

VAAP Audit Concerns 2018 -2019 (3 of 3) 45 School Divisions received condition codes: – Condition Code Q on 42 pieces of evidence – Condition Code U on 3 pieces of evidence Department of Student Assessment, Accountability & ESEA Programs 65

VAAP Audit Concern: Condition Code Q: No evidence of student-generated work. This includes copying, full physical assistance, group work without description of individual contribution, homework, hints, clueing or prompts that would provide answers. 42 pieces of evidence included at least one of the following issues: – Too much teacher help – Answers provided – Hand-Over-Hand – Prompting Department of Student Assessment, Accountability & ESEA Programs 66

VAAP Audit Concern: Condition Code U: The ASOL does not align with the registered grade. If none of the evidence addresses the ASOL from the registered grade level, the evidence cannot be scored. • Condition Code U was applied to 3 pieces of evidence. – The ASOL demonstrated does not match the student’s grade of enrollment. • Example: Student is enrolled in grade 5 and evidence is demonstrated with ASOLs from grade 3 Department of Student Assessment, Accountability & ESEA Programs 67

Affidavit • Missing or incorrect student information (i. e. , date of birth or STI) • Incorrect affidavit for student COE Department of Student Assessment, Accountability & ESEA Programs 68

Student Evidence Identification Tag Department of Student Assessment, Accountability & ESEA Programs 69

Missing ASOL Number from SEI Tag Department of Student Assessment, Accountability & ESEA Programs 70

Missing Bullet from SEI Tag Department of Student Assessment, Accountability & ESEA Programs 71

Important Dates - VAAP 2019 -2020 (1 of 2) January 6 - May 13, 2020: Register VAAP submissions March 23 - May 15, 2020: VAAP Score Entry May 29, 2020: Shipping materials for audit COE arrive June 5, 2020: Deadline to ship audit COE to Pearson June 26, 2020: All score corrections/test statuses due Department of Student Assessment, Accountability & ESEA Programs 72

Important Dates - VAAP 2019 -2020 (2 of 2) July 6, 2020: All score reports available in PANext July 17, 2020: VAAP Authorization to Report due date July 24, 2020: Audited COE returned to divisions Department of Student Assessment, Accountability & ESEA Programs 73

Special Assessment Accommodation Request Submission Deadlines To ensure adequate review time, requests must be submitted for each administration by the due dates listed below. Submission prior to the deadline is strongly encouraged. Test Administration Request Form Deadline Fall 2019 Writing Fall 2019 Non-Writing Spring 2020 Non-Writing Summer 2020 Writing & Non-Writing September 30, 2019 October 14, 2019 February 3, 2020 February 24, 2020 April 20, 2020 Department of Student Assessment, Accountability & ESEA Programs 74

Important Reminders • Ensure that only the 2019– 2020 VAAP Implementation Manual, affidavits, forms, and checklists are used in conjunction with 2019– 2020 submissions. Please destroy all “old” VAAP manuals, affidavits, forms, and checklists. • Evidence for VAAP collections must be completed under the supervision of the content area teacher or other school personnel and under testing conditions in which the student does not have access to the subject content or curriculum, hints, clueing, prompts, or test taking strategies that would provide an unfair advantage. Department of Student Assessment, Accountability & ESEA Programs 75

Affidavit for the Alternate Assessment • An Affidavit of Student Performance must be completed by all staff and personnel involved with the development of the COE to ensure that the student independently completed all evidence under the supervision of the content area teacher or other school personnel and under testing conditions. • The Affidavit of Student Performance must be completed and signed prior to submission for scoring. Department of Student Assessment, Accountability & ESEA Programs 76

School Division Personnel Test Security Agreement • All individuals involved in the administration of the Virginia Alternate Assessment Program (VAAP), including collection development, monitoring, and pre-scoring, MUST read, understand, and agree to adhere to the School Division Personnel Test Security Agreement for the Virginia Alternate Assessment Program prior to collecting, submitting, and prescoring student evidence. • The test security agreement must be kept on file in the office of the Division Director of Testing (DDOT). Department of Student Assessment, Accountability & ESEA Programs 77

Questions? To contact student assessment staff for assistance: Student_assessment@doe. virginia. gov or (804) 225 -2102 Department of Student Assessment, Accountability & ESEA Programs 78