Idahos Online Testing Boots on the Ground Report

Idaho’s Online Testing: Boots on the Ground Report CCSSO June 21, 2010

Overview A. Review of ISAT Matrix and Tested Population B. A [very] Brief History of Online Testing in the Gem State C. Paper vs. Online: schedule comparison D. Pressure Points: capacity, connecting students to their work, test reactivation, in-district tech. capacity E. Final thoughts: provide ample practice opportunity; build in robust, ongoing training and help line support; worst of both worlds-running dual system for extended period

Idaho Standards Achievement Tests (ISAT)

ISAT Testing Matrix § ISAT is Federally Mandated Under the No Child Left Behind Legislation § Grades 3 -10 are tested in Reading, Math, and Language Usage [grade 9 not part of AYP] ü These content areas form the basis of the Annual Yearly Progress [AYP] Proficiency and Participation Requirements § Grades 5, 7 and 10 are tested in Science, but Science is not part of AYP Calculations

ISAT 2010 Facts § NCLB core test [Session 1]-42 to 50 MC ; Adaptive overlay [Session 2] 10 -15 MC—provides strand level reporting tailored to individual student; untimed § 650 schools, 135 districts, many remote § @ 21, 000 Students per grade § 570, 000 Tests Delivered in 4 weeks § @ 400 Tests delivered via P/P- LP, Braille Ø 99% online since 2003 q Data Recognition Corporation [DRC] with Computerized Assessments and Learning [CAL] create and deliver ISAT

Idaho Commitment to Technology § Late 90’s Idaho legislature begins providing technology grants to districts § Federal funds for enhancing education through technology § Albertsons Foundation trained ‘technology integration’ personnel Ø Ø Investment made in ‘strong’ economic times Idaho has 3 to 1 computer/student ratio Rollout of online testing was gradual Early on issues with computer speed, bandwidth

Generic PAPER BASED Schedule § December 10 - Initial Pre-Id data due § January 18 - Final Pre-ID file Cut § Doc. creation, Print, Pack, Ship, Overage § March 1 - Ship 4 separate 2 week test windows § Processing, scanning, then reporting summer or fall Ø Cons: Tracking millions of pieces of paper and barcodes; lead time required; you are LL Bean

ISAT Online Schedule § @ April 1 Student Enrollment File Upload § April 12 -May 14 Test Window [last week make-ups only] § Immediate Preliminary Reports § June 4 - Final reports- 3 weeks from close of window ü Pros: no shipping; proximity of data upload to testing; no paper chase; security-few hard copies; later testing/earlier reporting

Testing Capacity Ø So online testing is all good news? § Behold the power of paper and pencil: all students in all grades in a school can test simultaneously! § Online testing depends on Computer capacity: ü Traditional model- a 35 computer lab can test a single class every 1. 5 hours ü “Hub Approach”-dramatically increases capacity; Students are funneled into testing as others finishno computer sits empty- Meridian District used this model to test 800+ students in a school in 4 content areas in 12 days; limits impact on instruction

Connecting Students to Tests Pre-Id process is handled at District Level SEF. “Session ticket” = Pre-Id

Session Tickets § Requires the right student get right ticket, hard copies § Onus on Local district personnel to manage the functionality of online testing and management-requires increased level of technology skill down to the school and proctor level

District Facility with Technology Critical Full online management of Testing Process: § Data uploads § Editing exiting data § Add/Delete Students § Print tickets § Monitor/manage testing § Reactivations, invalidations § Managing Permissions and Passwords § Manage reporting § Connectivity issues q See ISAT TAM for details: http: //www. sde. idaho. gov/site/assessment/ISAT/test Coordinators. htm

Supporting Districts § Ongoing, real time support/problem solving prior to and through testing cycle § In–Depth Support for new District Test Coordinators § Capacity is built over time and must be renewed

Reactivation: Potential Logjam v. All multiple day test sessions require State Department approval • Prior approval- IEP, ELP, 540 plan logged on Reactivation Form • Time sensitive Emergency approvals: connectivity problems, sudden illness, audio accommodation, login error

Reactivation Process üSDE fields emails, consults w/DRC on test details; SDE reply to districts on status üReset one or more parts or restart entire test, or not at all üRelentless Emails-we stayed above water, just, with nearly all same day or next AM reactivation. Consider effect of larger population of this constraint.

ISAT Final Thoughts o Must allow for ample opportunity for students to ‘practice’ with testing platform, especially audio. Technology should not affect measurement. o Building capacity in technological expertise, ongoing and vital. Be sure training and ‘helpline’ is part of strategic planning, RFP. Districts must be supported in transition and beyond. o Running a dual system, half paper/half online, blunts the benefits of both systems. Try not to be caught mid -court. o Silver lining in starting now: faster connections/computers

ISAT Idaho Standards Achievement Tests Contact: Scott Cook ISAT Coordinator 208 -332 -6976 scook@SDE. idaho. gov

Questions?