Summative Assessment Test Administration Workshop February 2019 Welcome

Summative Assessment Test Administration Workshop February 2019

Welcome • Jeremy Heneger, Director of Assessment, NDE • Rhonda True, Enhanced Assessment Grant Coordinator, NDE • Maggie Sis, Assessment Program Coordinator • Terri Ough, NAEP Coordinator • Tyrina Webster, Administrative Assistant • Stacey Weber, Administrative Assistant • Dacia Hopfensperger, Sr. Program Manager, NWEA • Melinda Orta, Sr. Program Manager, NWEA • Rock Sharma, Sr. Technical Consultant, NWEA • Jenna Gifford, Executive Account Manager

Agenda • NSCAS General Summative Assessment Overview • Technology Readiness • Summative Assessment Management • Student Experience • Resources • Communication & Help Desk • Questions & Answers

State Components of NSCAS • • • Test. Wiz and Navigate • MAP® Growth™ (3 -8) • NSCAS Summative Item Bank • Reading • NSCAS Alternate Open. Ed, ACT Online • Language • ACT Prep, Practice Tests • Science (11) • Mathematics Local • Open. Ed, ACT Online Prep, Practice Tests (11) • Local

NSCAS Summative Assessment Overview Subjects and Grades • English Language Arts and Mathematics (College and Career Ready Standards)- Grades 3 – 8 • Science (Legacy Standards) - Grades 5 and 8 Test Window March 18 – April 26 • Make Up Window April 29 – May 3 Modes of Delivery: Online and Paper/Pencil Resource: NSCAS Summative Paper/ Pencil Tips and Task Sheet Location: https: //cdn. nwea. org/docs/NE/Paper+Pencil+Tips+Sheet_2019. pdf

Testing Time and Scheduling Recommendations § Grade Level Content Area Approximate number of test questions Estimated test taking time 3 -8 Mathematics 48 90 minutes 3 -8 English Language Arts 48 120 minutes 5 and 8 Science 50 – 60 45 minutes Districts/Schools have flexibility in scheduling test sessions § Testing times are M-F, 6: 00 am to 7: 00 pm CT § § Recommendation: two to three sittings for ELA and Math over a five day period. One sitting for Science. § ✚ Recommendation – end testing at 5: 00 pm CT on Fridays For example, given the 90 -minute estimated test taking time in math, Districts/Schools can schedule two 45 -minute sittings –OR– three 30 -minute sittings Resource: ⎼ Scheduling Guidance for the Spring 2019 Summative Assessment ⎼ Scheduling Guidance Supporting Data ⎼ Scheduling Guidance Webinar

Testing Time and Scheduling Recommendations and Considerations • Estimated test taking time does not include: o Test ticket distribution o Starting the test session o Launching the secure browser o Student log in • Students’ tests can only be paused by Proctor • Student will be automatically logged out of the test after 15 min of inactivity • Note: Proctor action required for the Student to resume testing

Technology Readiness

Technology Readiness • System Requirements – Secure browser or app is REQUIRED for all devices Browser/ App Current Version Release Date Mac Lock Down Browser 4. 0. 0. 3 December 21, 2018 Windows Lock Down Browser 5. 4. 117. 0 June 8, 2018 Chromebook App 3. 0. 2 February 20, 2018 i. Pad App 3. 2 February 15, 2019 Resource: System and Technology – Summative Guide Location: https: //teach. mapnwea. org/impl/cap/System. Technology. Summative. pdf

How to Confirm Secure Browser Version Number • PC: Launch Secure Browser. Version number listed on lower right corner. If not listed, you might be using an older version. Press CTRL-ALT-V to check. • MAC: Launch Secure Browser. Version number listed on lower right corner. • i. Pad: Launch Secure Browser. Version number listed on lower right corner. • Chromebook: Kiosk App. Version number listed on lower right corner

Supported Devices Proctor Station Student Devices • • Windows 7, 8. 1, or 10 – Chrome 65 or higher • Mac OS X v 10. 11 to 10. 14 – Firefox 56 or higher • i. OS 10 to 12 – Microsoft Edge or IE 11 or higher • Chromebook OS 65 or higher • Windows 7, 8. 1, or 10 Mac OS X v 10. 11 to 10. 14 – Safari 9 to 12 • Mac and Chromebook – Chrome 65 or higher – Firefox 56 or higher (not supported on Chromebook) Notes: July 2018 – support ended for Windows 8. 0, Mac OS X v 10. 9 and Safari 7 (Proctor and Student) Minimum Screen Resolution (Student Devices): 1024 x 768

Technology Readiness • System and Technology – Summative Guide – Add to your White lists – Exclude from caching – Prioritize the traffic • Diagnostic Tool – check. nwea. org Resource: System and Technology – Summative Guide Location: https: //teach. mapnwea. org/impl/cap/System. Technology. Summative. pdf

System Maintenance Comprehensive Assessment Platform (CAP) for the NSCAS General Summative will be unavailable: • Friday, March 15 at 5: 00 PM CT through Saturday, March 16 at 12: 00 PM CT • Every Thursday evening during the summative window from 6: 00 PM CT – 8: 00 PM CT • Every Friday evening during the summative window from 5: 00 PM CT – 12: 00 PM CT Saturday for roster upload

Communication Overview • NDE-District-NWEA Partnership Update • Assessment Portal – https: //community. nwea. org/community/nebraska • Incident Reports/Communication – Incident notification message directing you the status page – http: //status. nwea. org/

Help Desk • Policy questions: Contact NDE – Phone: 402 -471 -2495 – Email: nde. stateassessment@nebraska. gov • Summative or MAP Growth inquires or support: Contact NWEA – Phone: (855) 225 -9926 – Email: NWEANebraska@nwea. org – 7: 00 a. m. – 5: 00 p. m. Central Time (CT), Monday – Friday

Summative Assessment Management

Summative Assessment Management • MAP Growth users will be familiar with the platform • MAP Growth users will use the same username and password credentials • District Assessment Contact will receive admin rights to roster all users. • After logging into the platform, users will see the Summative Testing module

Summative – Assessment Management

Summative Tasks Comprehensive Assessment Platform • Manage User Accounts • Update/add additional Student Roster information • Create Test Sessions • Update Accessibility information • Print Test Tickets • Manage Online Test Sessions • Monitor Student Progress • Data Clean Up Resource: Assessment Coordination Guide – Summative and supplement Location: https: //teach. mapnwea. org/impl/cap/Assessment. Coord. Guide. Sum. pdf https: //cdn. nwea. org/docs/AC_NSCAS_Supplement. pdf

Summative Testing - Roles Manage Users District Assessment Coordinator x Data Administrator x District Proctor School Assessment Coordinator School Proctor Roster Students x Manage Sessions/ Accommodations / NTCs Access to Student Testing Progress x x x Proctor Sessions x x Resource: Student/Staff Management Guide-Summative Location: https: //teach. mapnwea. org/impl/cap/Students. Staff. Management. Guide. Sum. pdf

Summative – Rostering • Initial State Student Roster file uploaded in mid-January from ADVISER. Another roster file will be uploaded on February 23 and this process will continue weekly throughout the test window. Districts update roster data by Thursday at noon NDE will pull the data Thursday night NWEA will process the roster data Friday night Updated Student information will display in CAP by noon on Saturday • Students that arrive in the district after the NDE pull on Thursday should wait until the following Monday to test • Districts will not have access to test session management activities Friday night during the test window

Summative – Rostering • District responsibility to be sure student data is up to date in their SIS (including demographic information, 504 status, IEP status, and EL status) • Districts roster all Students using Nebraska State – Roster File Template to the Spring term beginning in February • Link: Nebraska State - Roster File Template o Required use of school code and student State Unique ID o Roster information will also support MAP Growth for the Spring term

Summative – Rostering The following are required fields in the Nebraska State – Roster File Template for the Spring 2018 – 2019 term: • First Name • Last Name • Date of Birth • Student ID • State Student ID • Gender • Grade • Ethnic Group Name • School State Code • Teacher Information Note: If a student is rostered to multiple schools for the Spring Term, the school indicated as the “School of Record” is the school that the student is eligible for summative testing. Note: Roster file imports require overnight processing

Roles for Testing Students District Assessment Coordinator School Assessment Coordinator Create and Edit Test Sessions X X Assign Accommodations X X Assign Not-Tested Codes X X Add or Remove Students from Test Sessions X X View Student Testing Progress Dashboard X X Print Test Tickets X X View and Proctor Assigned Test Sessions District Proctor School Proctor X X

Test Session Management How-to-Videos from Nebraska Assessment Portal • Creating Test Sessions (1: 47) • Editing and Modifying Test Sessions (2: 04) • Assigning Accommodation Codes (1: 08) • Assigning Non-Tested Codes (1: 55) • Printing Test Tickets (0: 58) • Starting a Test Session (1: 27) • Ending a Test Session

Test Session Management Enhancements • Workflow improvements for creating sessions and moving students between sessions. – Copy a session – Move students between sessions

Accommodations Students with disabilities may be included in state assessment and accountability in the following ways: • Students may be tested on the NSCAS General Summative assessments without accommodations. • Students may be tested on the NSCAS General Summative assessments with approved accommodations specified in the student’s IEP. Accommodations provided to students must be specified in the student’s IEP and used during instruction throughout the year. Accommodations may require paper/pencil testing. Resource: NSCAS Summative & Alternate Accessibility Manual Location: https: //www. education. ne. gov/assessment

Accessibility Universal Tools • Scratch paper (lined or blank scratch paper or blank graph paper) • Grades 4 – 8 Math Reference Sheets: This will be available in the toolbar. May be printed, from the Assessment Portal, prior to students testing online. • Embedded resources § Highlighter § Eraser § Line Guide § Answer Eliminator § Notepad § Zoom § Math reference sheets

Accessibility • Linguistic Supports – Text to Speech (available for all of Math and Science; ELA – not passages) Some items on the – Online Spanish Test – Paper Pencil in Spanish – Additional non-embedded supports ELA assessment assess writing skills. The prompts for these items will be read aloud. • Accommodations – Text to Speech (available for all of Math and Science; ELA – not passages) – Additional non-embedded supports

Text to Speech (TTS) • Must meet criteria: TTS will only be available to students designated as English Learners (EL), IEPs or 504 plans in CAP for the Spring 2018 -2019 term • If a student meets the criteria, the option will be available as an accommodation for summative tests that support TTS. When enabled by selecting the TTS option, Text to Speech will display in the toolbar • Students must click on an icon for each item • All text will be read aloud in Math and Science. On ELA, passages will not be read Resource: Text to Speech instructions included in the Assessment Coordinator Guide Supplement for NSCAS Location: https: //cdn. nwea. org/docs/AC_NSCAS_Supplement. pdf

Accessibility in CAP Non-embedded Universal Tools q Setting Embedded Linguistic Support/ Accommodation q Text to Speech Non-embedded Linguistic Supports q Bilingual dictionary q Native language translation Non-embedded Accommodations q Mathematical supports q Assistive Technology q Specialized presentation of test q Scribe

Non-Tested Codes Code Description ALT Alternate Assessment EMW Emergency Medical Waiver Student was not tested because of an approved Emergency Medical Waiver. NLE No Longer Enrolled Student was not tested because of relocation from district/school after data submission but prior to testing. PAR Parental Refusal Student was not tested because of a written request from parent or guardian. PPE Paper-Pencil Expected SAE Student Absent for the Entire Testing Window UTT Resource: District Unable to Test Location: Student Explanation of Use Student participated in the alternate assessment. Student is expected to take a paper-pencil test. Student was not tested because student was absent from school from the beginning of testing till the end of testing. District was unable to test the student during the testing window and none of the other not-tested codes is applicable.

Print Student Test Tickets • Two ways: – From Test Sessions § Multiple sessions at once, if required § Prints tickets for all students in selected sessions – From Proctor Console § Print for one or multiple Students at once, if required • Default: test tickets print 4 to a page – Test tickets can also be exported Resource: Proctor Guide Location: https: //teach. mapnwea. org/impl/cap/Proctor. Guide. Sum. pdf

Student Test Tickets NSCAS Summative 2019

Testing Progress Note: Use the export functionality to get a detailed list of student/session information! Resource: Assessment Coordination - Summative Location: https: //teach. mapnwea. org/impl/cap/Assessment. Coord. Guide. Sum. pdf

Student Mobility Within District Transfers 1. District removes student from summative test sessions in sending school that are NOT complete. 2. District assigns student to the receiving school's sessions for all remaining content areas. Note: For any test that the student started but did not complete in the sending school, they will continue from where they left off in the receiving school. Note B: The School Assessment Coordinator at the sending school will NOT be able to remove the student. The student who has moved will be hidden from their view. A District Assessment Coordinator will need to edit the session to remove the student who is no longer enrolled in the school.

Student Mobility • Between District Transfers – Original school needs to apply Non-Tested Code of NLE for any tests the student did not complete – New district/school needs to roster student to their new district/school using standard rostering process. – New district/school needs to add student to sessions for all content areas – New district/school needs to apply Non-Tested Code of NLE for any tests the student completed in their original district.

Test Session Management Enhancements • Students can only be assigned one test English or Spanish for each subject • Text to Speech assignments are dependent upon student's IEP, 504, or EL status in the student’s Spring profile • Accommodations will remain assigned to students when moving students between sessions • New students added through Manage Students UI will be available for same-day testing.

Walkthrough: Creating Test Sessions

Summative – Assessment Management

Create Test Session

Step 1: Find and Add Students

Step 2: Assign Test and Accommodations

Step 2: Assign Test and Accommodations Note: In this example, The Text to Speech (TTS) option is not available for selection. This student does not meet the criteria for the TTS accommodation.

Step 2: TTS Eligibility Check in CAP Note: Check student’s profile for the Spring term. If the student meets the criteria (504, IEP or EL) then the TTS option will be available as an accommodation for summative tests that support TTS.

Step 3: Name Session & Assign Proctor

Copy Session

Copy Session Note: Accommodations and NTCs are not retained when a session is copied

Move Students

Move Students Note: Accommodations and NTCs are retained when a student is moved into a different session Common use case for moving students: Make-up testing

Filters

Session Status

Proctor/Student Experience

Proctor / Student Experience - Login Step 1: Student launches secure browser Step 2: Student enters session name and session password Step 3: Student enters student ID and student code from test ticket Step 4: Start Test

Proctor Experience – Generate a Session Password

Proctor Experience

Student Experience: Session Name & Password

Student Experience: State Student ID & Student Code

Student Experience: Confirmation Page

Proctor Experience – Confirm Students

Student Experience: Ready to Test

Proctor Experience Testing Progress

Student Experience - Pause

Student Experience: Inactivity Timeout Note: Inactivity timeout is now 15 minutes

Student Experience – End of Test

Proctor Experience – Exit Session

Proctor Experience

Proctor Experience Enhancements • UI improvements and better usability • Logout button for disconnected students to help them login again – sets them back to Awaiting Student status • Ability to refresh table to see latest student progress apart from auto-refresh every 60 s

Student Experience Enhancements Improvements to Hot Text Items • Spring 2019 hot text items – Prior to Spring 2018 testing, hot text items in the item type sampler will be updated to reflect the new functionality

Student Experience Enhancements • When multiple questions are presented for the same reading passage – Notes captured on the Notepad will remain – Highlighting on the passage will remain • Access to online calculator to use in daily instruction – Scientific (grade 7 and 8) – www. desmos. com/scientific – Four Function (grade 6) – www. desmos. com/fourfunction • Students now have access to the same tools on NSCAS and MAP Growth • Math reference sheets are embedded in the toolbar

Summative – Student Tutorials • Available for students to learn how to use the online test platform. – How to use the online tools – How to navigate through the test – How to respond to different item types – Test-Taking Tips Resource: Student Tutorial Location: https: //teach. mapnwea. org/impl/captraining/Student. Tutorial. NE/index. html

Item Type Samplers – Purpose: Provide students with an opportunity to practice each item type and gain familiarity with the platform/interface – New version includes all item types for each grade level including revised hot text functionality and reference sheets – Accessed on the Assessment Portal Username: ne Password: sampler – Paper item type samplers are also provided as PDFs for Districts to download and print (including answer documents) – Large Print and Braille item type samplers will be shipped based on District orders

Summative – Item Type Samplers Username: ne Password: sampler

Data Clean Up Activities • Data clean up throughout the test window – Confirm all non-embedded accessibility features – Confirm all students have a test record or an assigned Not Tested Code • Exception Report – Provided weekly via CAP – Report is designed to highlight test records or student records that may need data clean up § Examples: students missing race/ethnicity information; students without a test record or NTC (near the end of the test window) § Additional guidance and information will be coming soon

Preparing for Summative Assessment • Review technical requirements for Summative Testing • Download Latest Secure Browsers – confirm version numbers • Run NWEA Diagnostic Tool on devices used for testing • Review NDE guidelines for accessibility and identify individual students in need of specific accommodations • Consider structure for Test Sessions and review scheduling guidance from NDE • Review NDE Test Security Manual

How to Confirm Secure Browser Version Number • PC: Launch Secure Browser. Version number listed on lower right corner. If not listed, you might be using an older version. Press CTRL-ALT-V to check. • MAC: Launch Secure Browser. Version number listed on lower right corner. • i. Pad: Launch Secure Browser. Version number listed on lower right corner. • Chromebook: Kiosk App. Version number listed on lower right corner

Suggestions for a Smooth Testing Experience • Enable audio on devices used for TTS • Create sessions in advance • Ensure all students are included in test sessions and accessibility feature enabled, as need • Validate school proctors rights have been assigned • Proctor station will refresh every 60 seconds. Communicate this functionality with proctors • Use the student testing progress dashboard to monitor testing progress throughout the test window

Summative Assessment – Important Dates • February 1: Districts can begin to roster all students • February 25: Districts can begin Test Session Management Activities • By March 8: Paper/pencil test materials delivered to districts from orders • March 11 – April 26: Districts place additional orders for paper/pencil materials • March 18 – April 26: Test administration window • April 29 – May 3: Make up window • May 7: Last Day for Districts to Enter non-embedded Accommodation Codes, Non-tested Codes • May 7: Last Day for UPS to Pick Up/Drop-off of Paper/Pencil Materials • August/September: Preliminary and final data files available • October: Score Reports Available • Maintenance dates: Thursday and Friday nights

Summative Assessment – Resources • Summative Help Center https: //teach. mapnwea. org/impl/caphelp/Content/Summative. Help. Center. htm § Assessment Coordination Guide: electronic only § Proctor Guide: electronic only § System and Technology Guide : electronic only § Students/Staff Management: electronic only • Assessment Portal https: //community. nwea. org/community/nebraska § Item Type Manual (English and Spanish): electronic only § Test Administration Manual for Online Test (English and Spanish): electronic only § Test Administration Manual for Paper/Pencil Test (English and Spanish): electronic and printed § Online Student Tutorial § How to Order Paper/Pencil Test Materials tutorial and support document § Recorded trainings for test session management activities

User Feedback • Interviews – Google doc will be sent via NDE-District-NWEA Communication to recruit interested proctor, district and school assessment coordinators – 60 minute 1: 1 virtual interviews • Focus Groups – Held at numerous meetings over the summer (i. e. content workshops, ALD workshops, Administrator Days)

Communication & Help Desk

Communication Overview • NDE-District-NWEA Partnership Update • Assessment Portal – https: //community. nwea. org/community/nebraska • Incident Reports/Communication – Incident notification message directing you the status page – http: //status. nwea. org/

Help Desk • Policy questions: Contact NDE – Phone: 402 -471 -2495 – Email: nde. stateassessment@nebraska. gov • Summative or MAP Growth inquires or support: Contact NWEA – Phone: (855) 225 -9926 – Email: NWEANebraska@nwea. org – 7: 00 a. m. – 5: 00 p. m. Central Time (CT), Monday – Friday

Science Pilot • March 4 through March 15 • Optional for all Nebraska districts in Science grades 5 and 8. • Training for districts on February 25 at 10: 00 am CT

Questions & Answers