Test Coordinator Training RI Next Generation Science Assessment

Test Coordinator Training RI Next Generation Science Assessment | February 2019 1

Agenda Layout 1. RI NGSA Overview 2. AIR Systems a. TIDE b. TA Certification Course c. Training Tests d. TDS e. DEI 3. Accommodations and Accessibility Tools 4. Test Administration Reminders AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 2

Presenters • RIDE – Phyllis Lynch – Director, State Assessments – Pamela Denton – Coordinator, State Assessments – Heather Heineke – Assessment Specialist • AIR – Liz Mortimer – Program Manager – Alicja Kania – Project Coordinator AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 3

Contact Information Purpose • Test Administration Procedures Questions • Technology Questions • State Policy Test Administration Questions • Reporting of Testing Irregularities • Designated Supports and Accommodations Questions Who Phone E-mail RI NGSA Help Desk 866. 757. 9437 rihelpdesk@air. org RIDE 401. 222. 8494 assessment@ride. ri. gov Heather 401. 222. 8493 Heineke at RIDE AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG heather. heineke@ride. ri. gov 4

RI NGSA Overview 5

Administration Test Window April 22 to May 31, 2019 Students Required to Test All students in Grades 5, 8 and 11 Test Duration Minimum: 2 -60 minute sessions (plus 10 minutes for directions) Maximum: Students may have as much time as needed. Standards for four achievement levels will be set over Test Achievement the summer by a committee of Rhode Island Levels Vermont educators. Test Results will be available for students, schools, and districts in Fall 2019. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 6

Test Configuration • New test configuration for spring 2019 administration. • 4 segments will create 2 distinct sessions of equal length: » Life Science » Physical Science » Earth/Space Science » Field Test • Segments, and the items within each segment, are assigned randomly. • Variety of item types including simulations and animations. • On average, students will receive 8 standalones and 4 clusters per session. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 7

Test Sessions • The two sessions will appear as separate tests in the TA Interface • Sessions can be administered in any order • Students must respond to at least one question in BOTH sessions to receive a score AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 8

Testing Irregularities • If a test irregularity occurs: » Correct and contain the incident at the district/school level » Enter into the Appeals module of TIDE (if appropriate) » District Test Coordinator must notify RIDE • Examples of test irregularities: » Allowing students access to digital, electronic, or manual devices (except approved accommodations) » Testing staff failing to ensure administration and supervision of the assessments by qualified, trained personnel » Testing staff giving incorrect instructions that are not corrected prior to testing AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 9

Testing Irregularities: Appeals • A TA may want to appeal a test because of: – A hardware malfunction – Incorrect accommodation – Missing accommodation – A test was submitted incorrectly • The TA needs to work with their school coordinator to file an appeal AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 10

Testing Irregularities: Appeals Reset a Test • Removes the test and scores from the system • Enables student to start a new test Re-open a Test • Allows for a test that has already been submitted in error or has expired to be re-opened Grace Period Extension • Granted if a test session is unexpectedly interrupted • Allows access to all previous responses Restore a Test That Has Been Reset • Returns a test from the Reset status to its prior status • Only allowed on tests that have been reset • A test can be restored if it was reset in error Invalidate a Test • Rarely Used • Eliminates the test • Student does not receive a score AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 11

AIR Systems 12

Overview • Portal • Secure Browser • Test Information Distribution Engine (TIDE) • Test Administrator (TA) Certification Course • Test Delivery System (TDS) • Data Entry Interface (DEI) AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 13

Portal 14

Rhode Island Next Generation Science Assessment Portal AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 15

Secure Browser 16

Secure Browser Information • Designed to ensure test security by prohibiting students from accessing any other programs or websites during testing • Download the latest secure browser from the portal • The secure browser from 2017 -2018 will no longer work • Before taking the test, all applications must be closed AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 17

Secure Browser Download AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 18

Chrome Update • AIR currently supports Chrome versions of 67 to 72 • AIR provides presumptive support for new versions of Chrome as they are released which means students are not prevented from taking tests on the newest versions. However, although AIR and Google work collaboratively on new versions, with each new stable release, AIR does not need to perform internal testing to make sure there are no issues. If issues are discovered at this stage, AIR and Google will resolve them as quickly as possible. It is our recommendation that all devices are locked down before the test administration window begins. This will reduce the risk of any issues occurring during testing should a new version be released with problems that were not anticipated. • AIR can no longer support a device once Google stops supporting it. Please continue to monitor Google’s end-of-life policy (https: //support. google. com/chrome/a/answer/6220366? hl=en) AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 19

Mac OS Support • AIR released a new secure on November 30 th in order to support 10. 14 and address new security issues with the other Mac OC versions • All mac OS devices (10. 9 to 10. 14) are required to have the new secure browser installed in order to take the RI NGSA AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 20

TIDE 21

Accessing AIR Systems • All user accounts were rolled over and passwords reset on February 5 th, 2019. – If you did not receive a password reset email, check your spam folder or use the “Request a new one for this school year” link on the TIDE log in page. • Starting this year, setting up a security question is no longer required. • If you log in on a new device or browser (or clear the cache on a previously-used browser) you must enter an emailed code after passing the initial login screen. This step does not occur when you activate your account. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 22

TIDE: User Roles Task Viewing and Editing Student Settings Managing Rosters Adding User Accounts at the same level Creating Appeals Running Participation Reports Printing Test Tickets AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG DA SC TE 23

TIDE: Student Information Syncing • Student demographic information is updated in TIDE via a nightly upload by the state. • Changes made in the state e. RIDE registration system will be reflected in TIDE the following day. • Public schools must ensure that students in outplacement schools are included in their e. RIDE enrollment registration in order for them to be tested. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 24

TIDE: Manage Users AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 25

TIDE: Add Users AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 26

TIDE: Student Information AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 27

TIDE: Retrieve Students AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 28

TIDE: View Retrieved Students AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 29

TIDE: Student Settings AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 30

TIDE: Upload Student Settings AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 31

TIDE: Student Settings and Tools AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 32

TIDE: Accommodation Eligibility • In order to be eligible for any embedded or nonembedded accommodation, the IDEA Indicator or 504 Plan field must be set to Yes. • This information is transferred to TIDE in the nightly upload. Make sure e. RIDE is up to date. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 33

TIDE: Appeals AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 34

TIDE: Types of Appeals Appeal Type Reset a Test Description • • • Removes the test, and scores associated with the test, from the system Enables student to start a new test Requested due to accommodations not being set properly Reopen a Test • Allows for a test that has already been submitted or has expired to be re-opened Grace Period Extension • • Extends the grace period if a test session is unexpectedly interrupted for longer than 20 minutes Gives access to all previous answers Restore a Test That Has Been Reset • • • Return a test from the Reset status to its prior status Only allowed on tests that have been reset A test can be restored if it was reset in error Invalidate a Test • • • Eliminates the test Student loses that test and does not receive a score Requested due to test security incidences AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 35

TIDE: Rosters AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 36

TIDE: Rosters Overview • Rosters are composed of groups of students associated with a teacher in a school. • You can only create rosters from students associated with your school or district. • You can only view students’ demographic information and test settings within their rosters. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 37

TIDE: Rosters • Rosters must to be created so users with the Teacher (TE) role can view student scores and data when scores are available in Fall 2019. • Rosters typically represent entire classrooms in lower grades or individual classroom periods in upper grades. • A clear and consistent naming convention that indicates grade, class name, teacher, or period is recommended. For example, 1819 -G 3 -Jones. • Students do NOT need to be in a roster for testing. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 38

TIDE: Rosters • Rosters must to be created so users with the Teacher (TE) role can view student scores and data when scores are available in Fall 2019. • Rosters typically represent entire classrooms in lower grades or individual classroom periods in upper grades. • A clear and consistent naming convention that indicates grade, class name, teacher, or period is recommended. For example, 1819 -G 3 -Jones. • Students do NOT need to be in a roster for testing. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 39

TIDE: Ordering Paper Materials • Braille, Large Print, and Standard paper tests available • Confirm that the student has the non-embedded accommodation set properly in TIDE. • Districts can start to order paper materials starting February 27, 2019. • If contact information is not uploaded for your school or district, you will not be able to proceed with an order. • Districts can track shipments in TIDE. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 40

TIDE: Ordering Paper Materials 1. Step 1: From the Orders task menu on the TIDE dashboard, select Paper Orders. 2. Step 2: Search for orders by District or School. 3. Step 3: Enter the quantity needed for each of the materials needed. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 41

TIDE: Viewing Order History • The Order Details form includes: – Material Description – Expected Shipment Quantity – Approved Quantity – Awaiting Approval Quantity – Approval Status » This information is also available on the Order Quantity Reports. • Tracking reports are available by selecting the truck icon ( ). • Packing lists, manifests, and security checklists are available by selecting the report icon ( ). AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 42

TIDE: District Shipping Contact Information • DAs can check shipping information for their district, and schools within their district. • If necessary, DAs can edit shipping information AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 43

TIDE: Participation Reports • Plan and Manage Testing • Test Status Code Report • Test Completion Rates AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 44

TIDE: Participation Reports (Plan and Manage Testing) AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 45

TIDE: Participation Reports (Plan and Manage Testing) Select multiple schools from a drop down AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 46

TIDE: Participation Reports (Plan and Manage Testing) Select multiple grades from a drop down AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 47

TIDE: Participation Reports (Plan and Manage Testing) Test Duration will be included in Plan and Manage Testing results. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG Show and hide result columns. Only columns visible in the TIDE user interface will be exported. 48

TIDE: Participation Reports (Test Status Code Report) • Specific report used to view each student’s test status and all special codes to explain a student’s non-participation in a test • Displays all test statuses for each test for which each student in a district/school is eligible • May be generated at the district level or at the school level, depending on your user role • Report should be generated for each test to obtain an accurate picture reflecting the testing status of all students for all tests in the school or district • Updated nightly at 5: 00 am AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 49

TIDE: Participation Reports (Test Status Code Report) AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 50

TIDE: Participation Reports (Test Status Code Report) AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 51

TIDE: Participation Reports (Test Completion Rates) • High-level reports used to summarize the number and percentage of students who have started or completed a test • May be generated at the district or school level, depending on your user role • All students in the specified school or district will be included in this report • Report should be generated for each test to obtain an accurate picture that reflects the testing status of all students for all tests in the school or district • Updated nightly at 5: 00 am AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 52

TIDE: Participation Reports (Test Completion Rates) AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 53

TIDE: Participation Reports (Test Completion Rates) AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 54

TIDE: Participation Reports (Student Level) Student Participation data tied to student profile. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 55

TA Certification Course 56

What is the TA Certification Course? • An online course that walks users through: – Navigating the TA Interface – Approving students to test – Pausing and stopping a test session – Logging into the test as a student • The TA Certification Course is one part of TA training. It supplements other training resources (user guides, the Test Administrator Manual (TAM)) and necessary training on test administration, test security, and accommodations. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 57

TA Certification Components • This online course includes the following: – Contains step-by-step instructions for Test Administrators – Contains interactive portion – Contains quiz questions – Multiple viewing opportunities – Certificate of completion AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 58

TA Certification Course Intended Audience • All Test Administrators (TAs) must complete the course before proctoring a test. • The course takes about 30 minutes to complete. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 59

Training Tests 60

Accessing Training Tests AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 61

What are Training Tests? • Allows administrators, students, and guest users to become familiar with the online testing environment. • Provides a preview of question types that may appear on the operational assessment. • Refreshed this year to include a Spanish Toggle and Standalone Items • Provides students with the opportunity to test accessibility tools and assistive technology devices with the Test Delivery System (TDS). • Note: Training Tests can be accessed using a Guest User and/or a Guest Session. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 62

Test Delivery System (TDS) 63

TDS Overview • Two interfaces: – Student – Test Administrator • Two sites: – Operational – Training Test AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 64

Test Administration (TA) Interface 65

Accessing the TA Interface AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 66

TA Interface Overview AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 67

Test Tree AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 68

Approving Students AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 69

Approvals and Student Test Settings AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 70

Monitoring a Test Session AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 71

Student Interface 72

Please Sign-In Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 73

Is This You? Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 74

Your Tests Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 75

Waiting for Approval Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 76

Audio/Video Checks Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 77

Instructions and Help Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 78

Review Test Settings Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 79

Spanish Toggle New Feature for 2018 -19 Administration AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 80

Review Your Answers Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 81

Your Results Page AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 82

Data Entry Interface (DEI) 83

What is the DEI? • For students completing paper assessments, the teacher must enter the student responses into the DEI. • 3 forms of Paper tests will be available: • UEB Braille • Large Print • Standard Print • Paper tests will be ordered directly through AIR. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 84

Ordering Paper Tests 85

Paper Material Shipments When will paper test materials be shipped? • Paper tests should be shipped to participating districts by April 15 th. • District or school test coordinators are responsible for distributing them to the appropriate school. When do paper test materials need to be returned? • Paper tests should be returned to Measurement Incorporated (MI) no later than June 6, 2019 (three business days after testing is complete). • The Test Coordinator is responsible for arranging the test materials pickup with Fed. Ex and should keep the receipt tabs for reference. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 86

Accommodations and Accessibility Tools 87

Accommodations and Accessibility Tool Categories • Embedded and Non-Embedded Accessibility Features are supports and tools that are made available to all students. • Embedded and Non-Embedded Accommodations are supports and tools that are made available to students with disabilities and English learners. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 88

Accessibility Features 89

Embedded Accessibility Features • Answer Masking • Color Contrast • Magnification • Mouse Pointer • Streamline Mode • Text-to-Speech (available in English and Spanish) Note: During the 2017 -2018 test administration Answer Masking was referred to as Masking and Magnification was referred to as Zoom/Print Size. AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 90

Non-Embedded Accessibility Features • Amplification • Color Overlay • Magnification AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 91

Accommodations 92

Embedded Accommodations • Braille Edition • Print-on-Demand • Spanish Edition • Permissive Mode AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 93

Non-Embedded Accommodations • AT/AAC Devices • Read Aloud in Spanish • Bilingual Word-to-Word Dictionary or Glossary • Scribe • Braille Edition - Contracted • Braille Edition - Uncontracted • Large Print Edition • Sign Language Interpreter • Simplified Test Directions • Speech-to-Text • Word Prediction • Paper Edition • Read Aloud in English AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 94

RISAP Accommodations and Accessibility Features Manual and Excel Sheet • Two new documents have been developed this year to assist LEAs and schools in selecting accommodations – RISAP Accommodations and Accessibility Features Manual – RISAP Accommodations and Accessibility Features Excel sheet – www. ride. ri. gov/ngsa AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 95

Test Administration Reminders 96

Recommended Resources • Test Administrator (TA) User Guide – Intended for Test Administrators – helps users navigate the Test Delivery System (TDS) including the Student Interface and the Test Administration (TA) Interface • Test Administrator Manual (TAM) – Intended for Test Administrators – outlines rules and policies that should be followed prior to, during and after test administration • Test Coordinator Manual (TCM) – intended for District Administrators and School Test Coordinator – provides procedural and policy guidance to administer the RI NGSA AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 97

Recommended Resources: TCM • Includes information about • Scheduling testing • Test administration roles and responsibilities • Test administrator and proctor qualifications • Test security • Tasks that take place before, during, and after testing • RI NGSA item types AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 98

Recommended Resources: TAM • Includes • Directions for test administration • script used during test administration • step-by-step instructions, with screenshots, for administrating RI NGSA • A translated Spanish test administration script AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 99

Reminders • Review all policy and test administration documents. • Complete the Test Administrator Certification Course (required). • Verify student settings for accommodations and accessibility tools in TIDE. • Note: Student accommodations for online testing should be set in TIDE a minimum of three days prior to testing through the nightly file process. • 2 sixty minute sessions is the minimum testing time. Students can have more time to complete their test if they need it. • Run participation reports to ensure all students complete testing! AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 100

Wrap Up 101

Contact Us RI Next Generation Science Assessment Program Portal https: //ri. portal. airast. org/ RI Next Generation Science Assessment Help Desk 1. 866. 757. 9437 rihelpdesk@air. org AMERICAN INSTITUTES FOR RESEARCH | AIR. ORG 102