Summative Assessment Test Administration Workshop February 2020 Welcome

Summative Assessment Test Administration Workshop February 2020

Welcome • Jeremy Heneger, Director of Assessment, NDE • Trudy Clark, Assist. Director of Assessment, NDE • Rhonda True, Enhanced Assessment Grant Coordinator, NDE • Maggie Sis, Assessment Program Coordinator, NDE • Melinda Orta, Sr. Program Manager, NWEA • Katrina Fitzpatrick, Sr. Program Manager, NWEA • Jenna Gifford, Executive Account Manager, NWEA • Aly Martinez Wilkinson – NWEA Professional Learning Lead, NWEA • Alex Luisi, Technical Consultant, NWEA

Agenda • NSCAS General Summative Assessment Overview • Technology Readiness • Summative Assessment Management • Student Experience • Resources • Communication & Help Desk • Questions & Answers

State Components of NSCAS • • • Test. Wiz and Navigate • MAP® Growth™ (3 -8) • NSCAS Summative Item Bank • Reading • NSCAS Alternate Open. Ed, ACT Online • Language • ACT Prep, Practice Tests • Science Local • Mathematics • Open. Ed, ACT Online Prep, Practice Tests • Local

NSCAS Summative Assessment Overview Subjects and Grades • English Language Arts and Mathematics (College and Career Ready Standards)- Grades 3 – 8 • Science (College and Career Ready Standards) - Grades 5 and 8 **Field Test Window • March 16 – April 24 • Make Up Window April 27 – May 1 Modes of Delivery: Online and Paper/Pencil (ELA and Math only) Resource: NSCAS Summative Paper/ Pencil Tips and Task Sheet Location: https: //cdn. nwea. org/docs/NE/Paper+Pencil+Tips+Sheet_Spring+2020. pdf

NSCAS Summative Science Overview Science (College and Career Ready Standards) Grades 5 and 8: Field Test for Spring 2020 • Online test only, no paper/pencil testing (including those students that need Large print, Braille accommodations) • English only • No score results for spring 2020 Students who typically need access to translated materials or paper/pencil materials are exempt from the NSCAS General Science Field Test. Districts will report Person IDs and Reason for Exemption to Maggie Sis at NDE

Testing Time and Scheduling Recommendations § Grade Level Content Area Approximate number of test questions Estimated test taking time 3 -8 Mathematics 48 -53 90 minutes 3 -8 English Language Arts 48 -53 90 minutes 5 and 8 Science 36 90 minutes Districts/Schools have flexibility in scheduling test sessions § Testing times are M-F, 6: 00 am to 7: 00 pm CT § § Recommendation: two to three sittings for ELA and Math over a five day period. The Science field test does not need to be completed in one sitting. § ✚ Recommendation – end testing at 5: 00 pm CT on Fridays For example, given the 90 -minute estimated test taking time in math, Districts/Schools can schedule two 45 -minute sittings –OR– three 30 -minute sittings Resource: ⎼ ⎼ Scheduling Guidance for the Spring 2020 General Summative Assessment Scheduling Guidance Supporting Data from Spring 2018 Scheduling Guidance Webinar Scheduling Guidance Power. Point

Testing Time and Scheduling Recommendations and Considerations • Estimated test taking time does not include: o Test ticket distribution o Starting the test session o Launching the secure browser o Student log in • Students’ tests can only be paused by Proctor • Student will be automatically logged out of the test after 15 min of inactivity • Note: Proctor action required for the student to resume testing

Technology Readiness

Technology Readiness • System Requirements – Secure Testing Browser or App is REQUIRED for all devices Browser/ App Current Version Minimum Version Release Date Mac Secure Testing Browser 5. 0 4. 0. 0. 3 February 7, 2020 Windows Secure Testing Browser 5. 4. 148 5. 4. 117. 0 June 14, 2019 Chromebook App 3. 1. 0 3. 0. 2 June 14, 2019 i. Pad App 3. 2 February 15, 2019 Resource: System and Technology – Summative Guide Location: https: //teach. mapnwea. org/impl/cap/System. Technology. Summative. pdf

How to Confirm Secure Browser Version Number • PC: Launch Secure Browser. Version number listed on lower right corner. If not listed, you might be using an older version. Press CTRL-ALT-V to check. • MAC: Launch Secure Browser. Version number listed on lower right corner. • i. Pad: Launch Secure Browser. Version number listed on lower right corner. • Chromebook: Kiosk App. Version number listed on lower right corner

Supported Devices Proctor Station Student Devices • • Windows 7, 8. 1, or 10 – Chrome 71 or higher • Mac OS X v 10. 12 to 10. 15 – Firefox 64 or higher • i. OS 12 to 13 • Chromebook OS 71 or higher Windows 7, 8. 1, or 10 – Microsoft Edge 16 • Mac OS X v 10. 12 to 10. 15 – Chrome 71 or higher – Firefox 64 or higher – Safari 11 to 13 • i. Pad and Chromebook – Chrome 71 or higher – Firefox 64 or higher Notes: Minimum Screen Resolution (Student Devices): 1024 x 768

Technology Readiness • System and Technology – Summative Guide – Add to your White lists – Exclude from caching – Prioritize the traffic • Diagnostic Tool – check. nwea. org Resource: System and Technology – Summative Guide Location: https: //teach. mapnwea. org/impl/cap/System. Technology. Summative. pdf

System Maintenance Comprehensive Assessment Platform (CAP) for the NSCAS General Summative will be unavailable: • Friday, March 13 at 7: 00 PM CT through Saturday, March 14 at 12: 00 PM CT • Friday, April 17 at 7: 00 PM CT through Saturday, April 18 at 12: 00 PM CT • Every Friday morning during the summative window from 8: 00 AM CT – 12: 00 PM CT districts should refrain from rostering but testing activities can continue

Summative Assessment Management

Summative Assessment Management • MAP Growth users will be familiar with the platform • MAP Growth users will use the same username and password credentials • District Assessment Contact will receive admin rights to roster all users. • After logging into the platform, users will see the Summative Testing module

Summative – Assessment Management

Summative Tasks Comprehensive Assessment Platform • Manage User Accounts • Update/add additional Student Roster information • Create Test Sessions • Update Accessibility information • Print Test Tickets • Manage Online Test Sessions • Monitor Student Progress • Data Clean Up Resource: Assessment Coordination Guide – Summative and supplement Location: https: //teach. mapnwea. org/impl/cap/Assessment. Coord. Guide. Sum. pdf https: //cdn. nwea. org/docs/NE/NSCAS+Assess+Coor+Supplement. pdf

Summative Testing - Roles Manage Users District Assessment Coordinator x Data Administrator x District Proctor School Assessment Coordinator School Proctor Roster Students x Manage Sessions/ Accommodations / NTCs Access to Student Testing Progress x x x Proctor Sessions x x Resource: Student/Staff Management Guide-Summative Location: https: //teach. mapnwea. org/impl/cap/Students. Staff. Management. Guide. Sum. pdf

Summative – Rostering • Initial State Student Roster file uploaded in mid-January from ADVISER. Another roster file will be uploaded on February 19. This process will occur weekly starting the week of March 16 through the end of the summative test window. Districts update roster data by Thursday at noon NDE will pull the data Thursday night NWEA will process the roster data Friday morning Updated Student information will display in CAP by noon on Saturday • Students that arrive in the district after the NDE pull on Thursday should wait until the following Monday to test

Summative – Rostering • District responsibility to be sure student data is up to date in their SIS (including demographic information, 504 status, IEP status, and EL status) • Districts roster all Students using Nebraska State – Roster File Template to the Spring term beginning in February • Link: Nebraska State - Roster File Template o Required use of school code and student State Unique ID o Roster information will also support MAP Growth for the Spring term

Summative – Rostering The following are required fields in the Nebraska State – Roster File Template for the Spring 2019 -2020 term: • First Name • Last Name • Date of Birth • State Student ID (aka Person ID) • Gender • Grade • Ethnic Group Name • School State Code • Teacher Information (not required but recommended) Note: If a student is rostered to multiple schools for the Spring Term, the school indicated as the “School of Record” is the school that the student is eligible for summative testing. Note: Roster file imports require overnight processing

Roles for Testing Students District Assessment Coordinator School Assessment Coordinator Create and Edit Test Sessions X X Assign Accommodations X X Assign Not-Tested Codes X X Add or Remove Students from Test Sessions X X View Student Testing Progress Dashboard X X Print Test Tickets X X View and Proctor Assigned Test Sessions District Proctor School Proctor X X

Test Session Management How-to-Videos from Nebraska Assessment Portal • • • Creating Test Sessions (1: 47) Editing and Modifying Test Sessions (2: 04) Assigning Accommodation Codes (1: 08) Assigning Non-Tested Codes (1: 55) Printing Test Tickets (0: 58) Starting a Test Session (1: 27) Ending a Test Session(0: 57) Moving a student to a new test session (1: 24) Moving a student to an existing test session (1: 27) Copying a test session (2: 50)

Accommodations Students with disabilities may be included in state assessment and accountability in the following ways: • Students may be tested on the NSCAS General Summative assessments without accommodations. • Students may be tested on the NSCAS General Summative assessments with approved accommodations specified in the student’s IEP. Accommodations provided to students must be specified in the student’s IEP and used during instruction throughout the year. Accommodations may require paper/pencil testing. Resource: NSCAS Summative & Alternate Accessibility Manual Location: https: //www. education. ne. gov/assessment

Accessibility Universal Tools • Scratch paper (lined or blank scratch paper or blank graph paper) • Grades 4 – 8 Math Reference Sheets: This will be available in the toolbar. May be printed from the Assessment Portal prior to students testing online. • Embedded resources § Highlighter § Eraser § Line Guide § Answer Eliminator § Notepad § Zoom § Math reference sheets

Accessibility • Linguistic Supports – Text to Speech (available for all of Math and Science; ELA – not passages) – Online Spanish Test in ELA and Math – Paper Pencil in Spanish in ELA and Math – Additional non-embedded supports • Accommodations Some items on the ELA assessment assess writing skills. The prompts for these items will be read aloud. – Text to Speech (available for all of Math and Science; ELA – not passages) – Additional non-embedded supports

Text to Speech (TTS) • Must meet criteria: TTS will only be available to students designated as English Learners, a Monitoring English Learner, IEPs or 504 plans in CAP for the Spring 2019 -2020 term for ELA and Math – NSCAS Science is currently being field-tested. Please see additional guidance to determine which students may have access to TTS on NSCAS Science. • If a student meets the criteria, the option will be available as an accommodation for summative tests that support TTS. When enabled by selecting the TTS option, Text to Speech will display in the toolbar • Students must click on an icon for each item • All text will be read aloud in Math and Science. On ELA, passages will not be read Resource: Text to Speech instructions included in the Assessment Coordinator Guide Supplement for NSCAS Location: https: //cdn. nwea. org/docs/NE/NSCAS+Assess+Coor+Supplement. pdf

Accessibility in CAP Non-embedded Universal Tools q Setting Embedded Linguistic Support/ Accommodation q Text to Speech Non-embedded Linguistic Supports q Bilingual dictionary q Native language translation Non-embedded Accommodations q Mathematical supports q Assistive Technology q Specialized presentation of test q Scribe

Non-Tested Codes Code Description ALT Alternate Assessment EMW Emergency Medical Waiver Student was not tested because of an approved Emergency Medical Waiver. NLE No Longer Enrolled Student was not tested because of relocation from district/school after data submission but prior to testing. PAR Parental Refusal Student was not tested because of a written request from parent or guardian. PPE Paper-Pencil Expected SAE Student Absent for the Entire Testing Window STR Student Refusal Resource: TXPLocation: Tested at External Program UTT District Unable to Test Student Explanation of Use Student participated in the alternate assessment. Student is expected to take a paper-pencil test. Student was not tested because student was absent from school from the beginning of testing till the end of testing. Student was not tested due to student refusal to participate. Student is attending an external program and test scores will be transferred to the district/school of accountability. District was unable to test the student during the testing window and none of the other not-tested codes is applicable.

Print Student Test Tickets • Two ways: – From Test Sessions § Multiple sessions at once, if required § Prints tickets for all students in selected sessions – From Proctor Console § Print for one or multiple Students at once, if required • Default: test tickets print 4 to a page – Test tickets can also be exported Resource: Proctor Guide Location: https: //teach. mapnwea. org/impl/cap/Proctor. Guide. Sum. pdf

Student Test Tickets NSCAS Summative 2020

Testing Progress Note: Use the export functionality to get a detailed list of student/session information! Resource: Assessment Coordination - Summative Location: https: //teach. mapnwea. org/impl/cap/Assessment. Coord. Guide. Sum. pdf

Student Mobility Within District Transfers 1. District removes student from summative test sessions in sending school that are NOT complete. 2. District assigns student to the receiving school's sessions for all remaining content areas. Note: For any test that the student started but did not complete in the sending school, they will continue from where they left off in the receiving school. Note B: The School Assessment Coordinator at the sending school will NOT be able to remove the student. The student who has moved will be hidden from their view. A District Assessment Coordinator will need to edit the session to remove the student who is no longer enrolled in the school. Note C: Districts may have students being serviced at other programs inside or outside the district. In these cases, districts should apply the TXP—Tested at External Program not-tested code in the Test Session in the Comprehensive Assessment Platform to indicate that the student tested at another location but the district is still accountable for that student.

Student Mobility • Between District Transfers – Original school needs to apply Non-Tested Code of NLE for any tests the student did not complete – New district/school needs to roster student to their new district/school using standard rostering process. – New district/school needs to add student to sessions for all content areas – New district/school needs to apply Non-Tested Code of NLE for any tests the student completed in their original district.

Walkthrough: Creating Test Sessions

Summative – Assessment Management

Create Test Session

Step 1: Find and Add Students

Step 2: Assign Test and Accommodations

Step 2: Assign Test and Accommodations Note: In this example, The Text to Speech (TTS) option is not available for selection. This student does not meet the criteria for the TTS accommodation.

Step 2: TTS Eligibility Check in CAP Note: Check student’s profile for the Spring term. If the student meets the criteria (504, IEP or EL) then the TTS option will be available as an accommodation for summative tests that support TTS.

Step 3: Name Session & Assign Proctor

Copy Session

Copy Session Note: Accommodations and NTCs are not retained when a session is copied

Move Students

Move Students Note: Accommodations and NTCs are retained when a student is moved into a different session Common use case for moving students: Make-up testing

Filters

Session Status

Proctor/Student Experience

Proctor / Student Experience - Login Step 1: Student launches secure browser Step 2: Student enters session name and session password Step 3: Student enters student ID and student code from test ticket Step 4: Start Test

Proctor Experience – Generate a Session Password

Proctor Experience

Student Experience: Session Name & Password

Student Experience: State Student ID & Student Code

Student Experience: Confirmation Page

Proctor Experience – Confirm Students

Student Experience: Ready to Test

Proctor Experience Testing Progress

Student Experience - Pause

Student Experience: Inactivity Timeout Note: Inactivity timeout is 15 minutes

Proctor Experience • Logout button for disconnected students to help them login again – sets them back to Awaiting Student status • Ability to refresh table to see latest student progress apart from auto-refresh every 60 s

Student Experience – End of Test

Proctor Experience – Exit Session

Proctor Experience - Reopen a Session

New Student Experience • Linking Study for Through-Year in the Spring 2020 General Summative – For ELA and Math, there will be MAP Growth items added to the end of the test – Differences in the way the items are formatted, particularly reading passages – Some Math items may use a different calculator – Students may have seen items from previous MAP Growth tests – The results of these items will not be included in the student's score

New Student Experience • Science Field Test – Survey questions at the end of each test – Reminder: There are no scores resulting from the field test

Summative – Student Tutorials • Available for students to learn how to use the online test platform. – How to use the online tools – How to navigate through the test – How to respond to different item types – Test-Taking Tips Resource: Student Tutorial Location: https: //teach. mapnwea. org/impl/captraining/Student. Tutorial. NE/index. html

Item Type Samplers – Purpose: Provide students with an opportunity to practice each item type and gain familiarity with the platform/interface – Includes all item types and item aides for each grade level § The Science Item Type Samplers will also have open-ended item types, though these will not be seen on the Spring 2020 field test. – Accessed on the Assessment Portal Username: ne Password: sampler – Paper item type samplers are also provided as PDFs for Districts to download and print (including answer documents) – Large Print and Braille item type samplers will be shipped based on District orders – Reminder: There will be no paper Item Type Sampler for Science

Summative – Item Type Samplers Username: ne Password: sampler

Preliminary Score Files • On the Reports Landing Page, there will be data files containing preliminary overall scores of completed tests. – Tests with NTCs or incomplete tests will not be on the file. – Will not contain Reporting Category Data – Paper/Pencil tests will not be present • Supporting documents will be made available soon. IMPORTANT: The preliminary score data provided to you is preliminary and is not an indication of the official score results. NWEA maintains stringent verification procedures for each assessment taken and scores provided on reports. While preliminary score data are typically an indication of student performance, they are not official or final.

Preliminary Score File: Data Clean Up Activities Recommended fields to look at during the test window: – Confirm all non-embedded accessibility features – Confirm all students have a test record or an assigned Not Tested Code – Students missing info – Duplicate tests for the same content area – Incorrect language tests – Testing outside of grade level Any changes that need to be made should be coordinated with NDE.

NSCAS Reports Page Update • Update to the look of the NSCAS Reports Page • Functionality remains the same • No longer lists reports that are not yet available • Reminder – 2018 -19 NSCAS reports removed as of March 13 th

Preparing for Summative Assessment • Review technical requirements for Summative Testing • Download Latest Secure Browsers – confirm version numbers • Run NWEA Diagnostic Tool on devices used for testing • Review NDE guidelines for accessibility and identify individual students in need of specific accommodations • Consider structure for Test Sessions and review scheduling guidance from NDE • Review NDE Test Security Manual

Suggestions for a Smooth Testing Experience • Enable audio on devices used for TTS • Create sessions in advance • Ensure all students are included in test sessions and accessibility feature enabled, as need • Validate school proctors rights have been assigned • Proctor station will refresh every 60 seconds. Communicate this functionality with proctors • Use the student testing progress dashboard to monitor testing progress throughout the test window

Summative Assessment – Important Dates • January 27: Districts can begin to roster all students • February 24: Districts can begin Test Session Management Activities • By March 6: Paper/pencil test materials delivered to districts from orders • March 9 – April 27: Districts place additional orders for paper/pencil materials • March 16 – April 24: Test administration window • April 27 – May 1: Make up window • May 5: Last Day for Districts to Enter non-embedded Accommodation Codes, Non-tested Codes • May 5: Last Day for UPS to Pick Up/Drop-off of Paper/Pencil Materials • August: Review and final data files available • September: Score Reports Available • October: Matrix available • Maintenance dates: Friday mornings during the window

Summative Assessment – Resources • Summative Help Center https: //teach. mapnwea. org/impl/caphelp/Content/Summative. Help. Center. htm § Assessment Coordination Guide: electronic only § Proctor Guide: electronic only § System and Technology Guide : electronic only § Students/Staff Management: electronic only • Assessment Portal https: //community. nwea. org/community/nebraska § Item Type Manual (English and Spanish): electronic only § Test Administration Manual for Online Test (English and Spanish): electronic only § Test Administration Manual for Paper/Pencil Test (English and Spanish): electronic and printed § Online Student Tutorial § How to Order Paper/Pencil Test Materials tutorial and support document § Recorded trainings for test session management activities

Communication & Help Desk

Communication Overview • NDE-District-NWEA Partnership Update • Assessment Portal – https: //community. nwea. org/community/nebraska • Incident Reports/Communication – Incident notification message directing you the status page – http: //status. nwea. org/

Help Desk • Policy questions: Contact NDE – Phone: 402 -471 -2495 – Email: nde. stateassessment@nebraska. gov • Summative or MAP Growth inquires or support: Contact NWEA – Phone: (855) 225 -9926 – Email: NWEANebraska@nwea. org – 7: 00 a. m. – 5: 00 p. m. Central Time (CT), Monday – Friday

Questions & Answers