Assessment Update SY 15 16 UPDATE 10 JUNE

Assessment Update SY 15 -16 UPDATE #10 JUNE 14, 2016 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 1

Fun Flag Fact Nepal is the only country with a non-rectangular national flag. Image licensed under CC-BY-SA, from the Wikipedia article Flag of Nepal (contributors). OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 3/3/2021 2

Today’s Topics WELPA/ELPA 21 ORS Scores and Reporting Rates Data Technology WA-AIM Contacts OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 3

WELPA/ELPA 21 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 4

WELPA: Placement Test Materials Shipment 2016 -17 School Year v. For the 2016 -17 School Year districts will continue to use the WELPA Placement Test to determine initial student eligibility for English language development (ELD) services. The Placement Test is given to all students whose families answer “a language other than English” to question #2 or to question #3 on the Home Language Survey. v. WELPA Placement Test materials will be sent to districts in August based on District Test Coordinator selection of one of two delivery dates in WAMS. There is no need to order materials. Test materials for each district are generated using historical data to account for growth. If a selection is not made, the system will default to the August 25, 2016 delivery date. v. Schools not accounted for in the previous year’s data or districts who have new students not accounted for in the initial delivery may contact Assessment Operations to place initial orders. OSPI will require student information to accompany these orders. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 5

ELPA 21 Screener Pilot v. During recent development activities it was determined by the ELPA 21 consortium that the original selected vendor will not fulfill all the design requirements and still be able to conduct the planned spring 2016 pilot testing as specified. Thus, the consortium is obliged to delay the operational launch of the screener to allow sufficient time to secure the services to fulfill the intended design specifications. v. The ELPA 21 Screener pilot will be conducted in October 2016. OSPI and the consortium will be reaching out to districts to solicit participation in the screener pilot. Participation in the screener pilot will offer districts the opportunity to familiarize themselves with the new screener and share valuable feedback before the screener is launched. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 6

ELPA 21 Scores - Update OSPI previously announced that student scores would not be available any earlier than late summer due to consortium activities • OSPI would provide electronic score file for district/school use in student placement decisions and resource allocation • Student reports to follow after the start of school. Vendor communicated required efforts to achieve early electronic score file might fall short of aim: • OSPI and vendor continue problem-solving to support original score file delivery timeline OSPI requests that districts and schools allow the agency time to work through possible contingencies • Original process had results in late August, so districts could not make decisions any earlier • OSPI will communicate at earliest opportunity additional guidance should score file availability be delayed from original plan. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 7

Online Reporting System (ORS): as of June 10, 2016 From Spring 2016: Number of completed summative Smarter Balanced tests that were reported in ORS within 10 days, 2 weeks (16 days), 3 weeks (21 days), or more than 3 weeks of the completion date of both components of the test. % n-count Fewer than 10 days 56. 0% Fewer than 16 days 91. 3% 1, 006, 215 Fewer than 21 days 99. 9% 1, 100, 670 More than 21 days 0. 2% 617, 240 1609 Testing ends today (6/10), so more scoring is underway. These numbers will continue to grow for three weeks. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 8

Scores Reported in ORS The scoring process begins shortly after the testing window opens in March. Within a few weeks of testing, or by mid-April, the scores available in ORS are 99. 9% accurate and reliable. OSPI considers scores ‘preliminary’ until all scores for the state are processed and reported statewide to districts in July, but schools should feel comfortable sharing scores with parents and institutions of higher ed as needed for placement decisions prior to that time. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 9

Alphabet Soup Assessment and Registration Tool (ART) ◦ Digital Library (DL) Test Information Distribution Engine (TIDE) ◦ ◦ Managing and editing users/students Registering students for tests Selecting supports and accommodations Processing and viewing test invalidations Test Delivery System (TDS) ◦ ◦ Test Administrator Interface Student Interface OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 10

Alphabet Soup • Teacher Hand Scoring System (THSS) • Online Reporting System (ORS) • AIR 360 formerly Item Response Viewer (IRV) • Assessment Viewing Application (AVA) • Washington Assessment Management System (WAMS) • Education Data System (EDS) OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 11

Data OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 12

Last Notes on Spring Data Cleanup Coding reason not tested L 2 -Basic for EOC tests: ◦ Must select “Spring 2016” rather than “Spring EOC 2016” ◦ …in other words, the same place you’d record it for all other tests ◦ ONLY necessary not-tested coding is grade 10 biology, only NNEP and Alternate Assessment ◦ Grade 10 Biology is the ONLY EOC assessment that factors into accountability in any way ◦ Coding grade 10 bio “Alternate Assessment” indicates that the student will take grade 11 WA-AIM Science next year. ◦ L 2 Basic: use ‘Math’ or ‘Science’ for EOC subjects WAMS CEDARS Data Review now available: ◦ “CEDARS Data Review” replaced “Record Reconciliation” tab w/ cleanup instructions ◦ Revisit last webinar or most recent WAW ◦ If there is an error in how we’ve processed the data (e. g. , NNEP flag calculating incorrectly) report to OSPI Data Team assessmentanalysts@k 12. wa. us 360 -725 -6109 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 13

AIR Platform Rollover TIDE Go Live (SY 2016 -2017) – - July 1 - TIDE becomes Read-Only to All Users - July 21 - 3: 00 pm TIDE downtime begins - July 25 – TIDE Downtime ends - July 26 – ‘Old’ TIDE goes live for 2016 -17 (No actual 2016 -17 data until August… next slide…) - August 11 – 5: 00 pm TIDE downtime begins - August 14 – TIDE downtime ends - August 15 – ‘New’ TIDE goes live (Initial user guide for “New TIDE” available around this time) NOTE: any data loaded to “Old” TIDE from 2016 -17 CEDARS will roll over when “New” TIDE goes live. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 14

AIR Platform Rollover ALL DATES BELOW ARE BEST GUESS AS OF NOW IF ALL GOES ACCORDING TO PLAN. UPDATES WILL BE PROVIDED IN TIME FOR 8/5 ASSESSMENT COORDINATORS NETWORK MEETING August 1 OSPI repopulates TIDE with Districts and Schools (including ESDs as Districts). ◦ Prerequisite: directory information provided to and finalized by OSPI staff August 2 OSPI repopulates TIDE with District Assessment Coordinators (creates statewide DC roles) ◦ Prerequisite: DAC contact information populated in WAMS August 10 CEDARS accepts submissions for 2016 -17 August 15 OSPI sends first nightly TIDE student file ◦ Prerequisite: CEDARS 2016 -17 Go-Live runs smoothly ◦ No, we’re not expecting a ton of data in CEDARS on that date August 15 OSPI turns on “ 5 minute files” from issuance ◦ NOTE: SSID issuance will be adjusted during 2016 -17 to send records to WAMS for DACs to choose which records will be used for OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 15

AIR Platform Rollover Student Records in AIR Platforms: All accommodations and supports reset ◦ Good News! “New TIDE” has a plain-language upload template ◦ Better News! “New TIDE” has a “show me all kids with X accommodations” filters ◦ Even Better News! “New TIDE” allows for ticket/label printing by roster – you can create special rosters for students needing specific accommodations. Student records (2016 -17) won’t show up in TIDE until CEDARS submissions start Records are preserved in ORS AIR 360 will start fresh (no previous years’ IRV-type data) OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 16

AIR Platform Rollover TDS, Secure Browser, and AVA ◦ ◦ ◦ Secure Browser available – July 15, 2016 TDS AVA availability for professional development – August 4, 2016 TDS Interims Go Live – August 16, 2016 THSS Go Live – August 16, 2016 TDS Smarter Practice and Training Tests Go Live - ~September 1, 2016 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 17

AIR Platform Rollover Online Reporting System (ORS), Scoring, Reporting, and Analysis July 18 -July 19 – Downtime: Off Grade Science/MSP deployment of scores July 20 – ORS Go Live: Off Grade Science and MSP Spring 2016 July 25 – ORS rollover to SY 2016 -2017 August 17 - ORS Live w/ 2016 -17 Interims August 17 - AIR 360 (formerly known as IRV) Go Live OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 18

Wa. KIDS: Nightly File Process This is what CEDARS admins heard in their webinar last week: When pre-enrolling kindergarteners, please include the school and grade level of students who will be enrolling as kindergarteners in Fall 2016; OSPI is working with Teaching Strategies to implement an automated nightly file transfer to populate TS GOLD™ with data directly from CEDARS. In our initial file loads to TS GOLD™ , it may be necessary to identify kindergarteners who were issued SSIDs in Spring of 2016, in which case it is necessary to know that they will be in kindergarten. If you have already requested SSIDs for next year’s kindergarteners, it is not necessary to redo that work at this time, but be prepared to do so at some point should your district need to populate TS GOLD™ with student records prior to your first routine CEDARS submission of the 2016 -17 school year. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 19

Wa. KIDS: Nightly File Process Initial file handoff date: Early-mid August TBD Who we’re loading in the initial Wa. KIDS load as “ 2016 -17 Kindergarteners”: 1) All kindergarten students enrolled in 2017 CEDARS. Though not so much enrolled as the record is active. I wasn’t going to look at the district/school enrolled dates. 2) All kindergarten students created in issuance since 9/1/15 but only if they aren’t in CEDARS or were pre-kindergarten for the 15 -16 school year. ◦ If a record does occur in both issuance for kindergarten and full 2017 CEDARS then we will use the record that was created most recently. 3) All pre-kindergarten students enrolled in 15 -16 CEDARS. 4) All pre-kindergarten issuance records created since 9/1/15 but only if they aren’t in CEDARS or were pre-kindergarten for the 15 -16 school year OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 20

Wa. KIDS: Nightly File Process District Responsibilities and Notes 1) Assign Students to Class ◦ Students are put in a Holding Class by default during the initial load any time a student moves between schools ◦ Local staff must move records to actual Teachers 2) Archiving Students ◦ Students are not automatically archived after a move ◦ Students will be moved to a new school when that school reports to CEDARS whether active or archived OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 21

Nightly Files: one last note SSID Issuance for assessment purposes is getting an enhancement: 1) “…include school and grade when requesting an SSID…” will be replaced with “indicate that this records needs to be sent for assessment purposes” ◦ Untangle the “student needs to be assessed in our district” from “student needs an SSID” ◦ Reduce accidental “stealing” of student records when requesting SSIDs 2) Exact mechanism and timing TBD ◦ Probably a report in WAMS or elsewhere in EDS ◦ Responsibility for indicating a record is for assessment shifts to DAC after CEDARS admin issues SSID rather than 100% on CEDARS admin to record correctly ◦ Until we advise otherwise, continue with status quo OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 22

Digital Library: User Role Cleanup Digital Library accounts creation did not go well 2 years ago. ART works better than ever. Here’s what you need to know and do to start fresh: 1) Extract all Digital Library Users from ART 2) Figure out which users need action taken (see next slides) 3) Take action via upload or UI OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 23

1. Retrieve All DL_End. User from ART Steps: 1) Go to art. smarterbalanced. org and log in (you’ll be directed through sso. smarterbalanced. org) ◦ District Assessment Coordinators without login credentials can email assessmentanalysts@k 12. wa. us to 2) Click the “Create/Modify User” icon: 3) Under “Role” select “DL_End. User”, then click the “search” button OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 24

2. Use DL_End. User sheet to track ‘action’ for each record Five Main Scenarios for DL Users An account was created for a Digital Library user and the user…: 1) Logged in just fine, created security questions and a password, and has done work in the digital library. ACTION: No Action Needed. 2) Never received their welcome email (from technical issues early in the launch of the ART/DL systems) ACTION: Delete existing account and create a new account 3) Received and ignored their welcome email, allowing it to expire ACTION: Delete existing account and create a new account OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 25

2. Use DL_End. User sheet to track ‘action’ for each record Five Main Scenarios for DL Users (continued) 4) logged in during the preliminary launch without setting security questions and therefore can’t use the ‘forgot password’ link (delete and re-add will only work to the degree that they have no work saved in the DL that they can’t afford to lose) ACTIONS: Verify with user that they don’t have saved work and delete account OR confirm they have work they do not want to lose and contact AIR helpdesk for assistance 5) moved schools or changed email addresses (need to preserve entire account while changing the email address). ACTIONS: Smarter Balanced is adding some functionality to self-administer accounts. Preserve DL_End. User accounts for teachers that have moved until that is available (they can change their own email address). OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 26

3. Modify Accounts Two options: 1) Through the ART site, administer accounts user-by-user 2) Administer the accounts via template upload ◦ Instructions (ART User Guide) and templates accessed through the “Resources” link in the top right corner of ART ◦ Need to delete unused accounts prior to recreating user accounts ADVICE: ART and Digital Library are undergoing usability and content improvements this summer. Use late Spring through start of school year to prepare any modifications to DL_End. User accounts in preparation for an August/September training and update schedule. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 27

Who gets to do all this? LOCAL CHOICE: Whoever determines district-level user role District Assessment Coordinators have district level admin access – can retrieve and assign users throughout the district -OR- District Assessment Coordinators can create School Coordinators who can retrieve and assign users throughout the scshool OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 28

Technology Update OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 29

Technology Update § Updated Secure Browser (version 9. 0 for Windows/Mac/Linux) for 2016 - 2017 school year will be available starting July 15 § Windows, Mac OSX, and Linux will have an Auto-Update option, so the updated browser does not have to be manually installed (and the old version uninstalled), which will also be available starting in mid-July • Windows will have a pop-up prompt with choice to install immediately or later § All versions of the Secure Browser will include a new splash screen that informs the user of the current SB version and prevents user from landing at a blank white page until an Internet connection is detected OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 30

WA-AIM OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 31

WA-AIM HS Fall Retake Administration Window: September 12 -November 18, 2016 Who: 12 th graders eligible for alternate assessments What: Off Grade level administration for students needing to fulfill CIA Content Available Grades Required Achievement Level ELA/Mathematics 3 or 6 L 3 Science 5 or 8 L 3 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 3/3/2021 32

WA-AIM CIA Graduation Cut Scores Students who met the following scores on the 2015 -2016 Grade 11 WA-AIM have fulfilled the CIA requirement for that content area. WA-AIM High School Graduation Cut Scores ELA Mathematics Science 104 103 104 Students who participated in the Grade 11 WA-AIM via the Engagement Rubric have had the CIA requirement waived- the Engagement Rubric replaces the prior Awareness Waiver. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 3/3/2021 33

WCAP USER SUPPORT Questions regarding information in the Test Administration Manuals • TAs and School Test Coordinators, contact your District Test Coordinator. • District Test Coordinators contact the OSPI Assessment Operations Team at: Assessment@k 12. wa. us. Policy or Test Administration Questions • TAs and School Test Coordinators, refer to the Test Administration Manual. If additional support is needed, contact your District Test Coordinator. • District Test Coordinators contact the OSPI Assessment Operations Team at: Assessment@k 12. wa. us. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 34

WCAP Contacts AIR Help Desk for Technical, Network, and password issues • AIR Help Desk: wahelpdesk@air. org 1 -844 -560 -7366 OSPI Assessment Analysts for student data issues • OSPI Assessment Analysts: assessmentanalysts@k 12. wa. us 360 -725 -6109 OSPI Assessment Operations for assessment policy and test materials • Assessment Operations Assessment@k 12. wa. us (360) 725 -6348 or (800) 725 -4311, press option 3 The Smarter Balanced Assessment Consortium has updated it website. Check out the revamped and more user friendly site launched this week at http: //www. smarterbalanced. org/. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 35

WCAP Contacts for Technology, System, or Program Issues • TAs, School Test Coordinators, and District Test Coordinators contact the WCAP Help Desk (TAs and School Test Coordinators must also alert the District Test and Technology Coordinators of issues). • The WCAP Help Desk is open Monday–Friday from 6: 00 a. m. to 6: 00 p. m. PT (except holidays or as otherwise indicated on the Washington Comprehensive Assessment Program Portal). • Washington Comprehensive Assessment Program Help Desk Toll-Free Phone Support: 1 -844 -560 -7366 Email Support: wahelpdesk@air. org OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 36

Have a wonderful summer! OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 37