Accessibility and Accommodations Challenges in TechnologyBased State Assessments

Accessibility and Accommodations Challenges in Technology-Based State Assessments Martha Thurlow, Sheryl Lazarus, Laurene Christensen, and Vitaliy Shyyan National Center on Educational Outcomes www. CTDInstitute. org

Topics • • Technology Challenges and Solutions Terminology Challenges and Solutions Accessibility Challenges and Solutions Opportunities www. CTDInstitute. org

Technology Challenges • Digital divide still exists Ø Frequent complaints that schools did not have enough computers Ø Frequent complaints that bandwidth not sufficient for assessment needs • Testing interruptions – occur even when the best technology is available www. CTDInstitute. org

Testing Interruptions CCSSO (2015) produced a report on testing interruptions: Recommendations for Addressing the Impact of Test Administration Interruptions and Irregularities www. CTDInstitute. org

Accessibility Issues* • Resources not available or not working properly Ø Example: Highlighter tool is not available for all or a portion of the administration time • Accessibility features not working properly Ø Example: Read-aloud feature is not functioning for a portion of the administration time *Identified by CCSSO www. CTDInstitute. org

Importance for Students with Disabilities • May affect students with disabilities differently from other students* Ø Example: Student with a disability might be frustrated and not continue to try when other students are not as frustrated and do continue to try *Effect may be direct or indirect www. CTDInstitute. org

Framework for Analyzing Effects of Test Interruptions See: http: //www. ccsso. org/Documents/Co mputer%20 Based %20 Interruptions. pdf www. CTDInstitute. org

Terminology Challenges • Many different terms now being used to mean the same thing • Same terms also are used to mean different things Next slide shows terminology used in six assessment consortia www. CTDInstitute. org

Accessibility Frameworks Type of Assessment For All Participating Students For Some Students with Educator Input For Few Students with Documented Needs General Assessment PARCC Features for All Students Accessibility Features Identified in Advance Accommodations Smarter Balanced Universal Tools Designated Supports Accommodations ELP Assessment ELPA 21 Universal Features Designated Features Accommodations WIDA ASSETS Accessibility Tools Alternate Assessment DLM Supports Provided within DLM via PNP Supports Requiring Additional Tools/Materials NCSC Optimal Testing Conditions Accessibility Features Accommodations

National Education Technology Plan (2016) • “Future of Assessment” compares traditional and next generation assessments, with the goal of “more flexibility, responsiveness, and contextualization” – accessibility that is universally designed in one of the features of next generation assessments: When both assistive technologies and assessments effectively interoperate, students are better able to demonstrate what they know and how to apply this knowledge. (NETP, 2016, p. 57) www. CTDInstitute. org

Accessibility Challenges • Inconsistent testing platforms for different assessments Ø May have been more of a challenge for adults than for students, but still a challenge! www. CTDInstitute. org

Accessibility Challenges • Scrolling issues Ø An issue for all students mentioned by all consortia Ø May have a greater impact on students with disabilities and English learners than other students www. CTDInstitute. org

Accessibility Challenges • Accessibility features and accommodations did not work as intended Ø Not able to turn off universal features (an important designated feature) Ø Limitation on number of re-reads did not activate www. CTDInstitute. org

Accessibility Challenges • Guidance on how to configure computers and other devices to handle videos not available • Tutorials for students needed to be more “kid friendly” www. CTDInstitute. org

Accessibility Challenges • Use of accessibility features and accommodations was not tracked Ø Ability to track the USE of accommodations (and other accessibility features) was a huge promise of technology-based assessments Ø No consortium assessment was able to do this –only could track the accessibility features and accommodations that were SELECTED for a given student www. CTDInstitute. org

Accessibility Challenges • Many concerns related to the use of assistive technology (AT) Ø Lack of security with “ 3 rd party” AT Ø Incompatibility with “ 3 rd party” AT Result is often that students are not allowed to use AT they regularly use during instruction www. CTDInstitute. org

Some Solutions • Develop test security policies and procedures to address AT issues (e. g. , erase assessment content; turn off features not allowed on assessment) • Allow the student to use AT that is regularly used during instruction (unless it would compromise test validity. www. CTDInstitute. org

Successfully Using AT • Students need to be familiar with AT they will use on the assessment. • Ensure that students using AT have access to a practice test session that enables them (and their teachers) to see that the AT works as intended in the test environment. • AT compatibility issues should be checked before test day. • Tools and procedures should be developed to make it easy for LEAs to report any compatibility issues. Procedures also are needed that address how reported issues will be addressed. www. CTDInstitute. org

More Solutions • Require vendors to demonstrate their capabilities before signing a contract! • Ensure that practice tests have the same embedded (and non-embedded) accessibility features and accommodations as the actual assessment. • Check out the technology, not just the assessment items. • Involve students in cognitive labs and usability studies. • Include students with disabilities in infrastructure trials prior to testing. www. CTDInstitute. org

Opportunities • Race-to-the-Top Assessment Consortia were a first step (and the source of issues already highlighted) • Innovative Assessment Program is a next opportunity for large-scale assessments – NOW IN COMMENT PERIOD, until May 18, 2016. See: https: //www. gpo. gov/fdsys/pkg/FR-2016 -0418/pdf/2016 -08726. pdf www. CTDInstitute. org

Innovative Assessment Program Priority 1: Developing Innovative Assessment Item Types and Design Approaches (a) develop, evaluate, and implement new, innovative item types for use in summative assessments in reading/language arts, mathematics, or science; (b) develop new approaches to transform traditional, end-ofyear summative assessment forms with many items into a series of modular assessment forms, each with fewer items (c) for either a or b, provide a dissemination plan such that models and resources can be shared with states across www. CTDInstitute. org nation

Innovative Assessment Program Priority 2: Improving Assessment Scoring and Score Reporting (a) develop innovative tools that leverage technology to score assessments; (b) propose projects, in consultation with …to address needs related to score reporting and improve the utility of information about student performance… (c) for either a or b, provide a dissemination plan such that models and resources can be shared with states across nation www. CTDInstitute. org

We want to hear from you! Please click on the link in the chatbox and complete the short webinar survey. www. CTDInstitute. org

“Assistive and Instructional Technology Supporting Learners with Disabilities” The Center on Technology and Disability is funded by the U. S. Department of Education, Office of Special Education Programs (OSEP) under award #H 327 F 130003 – 13 A. www. CTDInstitute. org