Spring 2018 IDOE Pretest Workshop for Examiners ISTEP

Spring 2018 IDOE Pretest Workshop (for Examiners) ISTEP+ 3 -8 & 10, IREAD-3, and ISTEP+ End-of-Course Assessments (ECAs)

Introductions • Tarrell Berry (ISTEP+ Grade 10; ECAs) o Assessment Program Specialist o tberry 2@doe. in. gov • Kelly Connelly (ISTEP+ Grades 3 -8; IREAD-3) o Assessment Program Specialist o kconnelly@doe. in. gov

Agenda • ISTEP+ Grades 3 -8, 10 o (Slides 4 -38) • IREAD-3 o (Slides 4 -38) • End-of-Course Assessments o (Slides 39 -53) • ILEARN Updates o (Slides 54 -61)

ISTEP+ (Grades 3 -8 & 10) IREAD-3

ISTEP+ & IREAD-3: Shared Updates • • • Student Transfer Process Test Overview Practice Test Updates Test Administration Guidance Accommodations Avoiding Undetermined Results

ISTEP+ & IREAD-3: Test Overview • IREAD-3 • ISTEP+ o Grades 3 -8 & 10 § § includes Gr. 10 retesters Math & ELA (3 -8 & 10) Science (4, 6, & 10) Social Studies (5 & 7) o Part 1 § OL/PP: 2/26/18 – 3/9/18 § Applied skills items o Part 2 § OL: 4/16/18 – 5/4/18 § PP: 4/16/18 – 5/2/18 Ø shortened to accommodate reporting timeline § Multiple-choice/technology-enhanced items o Grade 3 (4 and 5, as needed) o Assesses foundational reading standards through Grade 3 o OL/PP: 3/12/18 – 3/16/18 o 3 test sections o Multiple-choice items only

ISTEP+ & IREAD-3: Practice Tests • Practice tests are required. o Students must participate at least once before completing the operational test o Same mode as operational test • Allow students access to item types, online functionalities • Practice tests are untimed. • Administration directions are contained in respective manuals (e. g. , ISTEP+ EMs, IREAD-3 TAM) • Practice Test Windows o ISTEP+ Part 1: 1/22/18 – 3/9/18 (OL & PP) o ISTEP+ Part 2: 3/5/18 – 5/4/18 (OL); 3/5/18 – 5/2/18 (PP) o IREAD-3: 2/12/18 – 3/16/18 (OL & PP)

ISTEP+ & IREAD-3: Practice Tests • Pearson generated online practice test sessions for sample students based on schools’ DOE-TL submissions. • Number of sample students approximates number of students submitted in DOE-TL upload • Generic Test Tickets o Include student’s first name and a generic last name o Reflect TTS and CALC form designation, as reported in DOE-TL o Not reusable § STCs/CTCs may generate additional sample students and practice test sessions, as needed, for new students and/or repeated practice test administrations

ISTEP+ & IREAD-3: Administering Operational Tests • Pearson set up online test sessions for students reported through the DOE-TL (December 4 -22) • Use Accessibility Features and Accommodations for Student Tests report in PAN to confirm accommodations before testing begins o Inappropriate use of accommodations leads to undetermined results each year

ISTEP+ & IREAD-3: Administering Operational Tests • Testing schedules are defined by test coordinators • ISTEP+ o Part 1 § Order of test sessions Ø First: Math or ELA Ø Second: Other content area (Math or ELA) Ø Third: Science or Social Studies Ø All sections within each content area must be administered in order (e. g. , Section 1, 2, 3…) o Part 2 § See Part 1 guidance, above • IREAD-3 o Administer all 3 sections in order (e. g. , Section 1, 2, 3…)

ISTEP+ & IREAD-3: Common Causes of Test Invalidations Please plan ahead to avoid instances in which test invalidation may result. Here are some common irregularities that result in test invalidations and undetermined results (not an exhaustive list): • • Incorrect STN is assigned for a student Students use incorrect test tickets/test books Students working in the wrong part of test Students without an IEP, ILP, or Section 504 Plan receive accommodation(s) in error • School personnel coach or encourage students to revisit certain responses • School personnel review test items and/or student responses • Invalidation bubbles are accidentally filled in on front cover of test books/answer documents

Lessons Learned from Winter Retest • Most invalidations of student test sessions resulted from one of the following errors, leading to undetermined results and missed opportunities to pass the required graduation assessment: o Test Tickets Swaps o Use of calculator on non-calculator section o Wrong amount of testing time provided to students • Adding specific examiner training to minimize these issues

ISTEP+ & IREAD-3: Accommodations • Appendix E in the 2017 -18 Indiana Assessment Program Manual o https: //www. doe. in. gov/sites/default/files/assessment/accessibility-andaccommodations-guidance. pdf o Outlines standard accommodations for students with an IEP, Section 504 Plan, ILP or Nonpublic School Service Plan o STCs/CTCs must manually assign any accommodations in Pearson. Accessnext that were not reported in the DOE-TL upload (12/4/17 – 12/22/17) • Assign correct accommodations before preparing test sessions o Students with IEP, ILP, or Section 504 Plan only o Resolve any issues/confirm accommodations before testing begins § Crosscheck with report in PAN: Accessibility Features and Accommodations for Student Tests § Check in with your STC/CTC, as needed

ISTEP+ & IREAD-3: Accommodations • Students with an IEP, ILP, or Section 504 Plan only o Online § Calculator* § Text-to-Speech (TTS) o Paper/Pencil § Large Print, Braille § Scribe* § Computer-Generated Response* (ISTEP+ Part 2) § Online administration should be used in lieu of CGRs, if possible. § Read-Aloud Scripts o TTS and read aloud accommodations very limited on IREAD-3 *ISTEP+ only

ISTEP+ & IREAD-3: Reminders Before testing (Examiners): • Provide each student correct test ticket or test book • Review spring testing manuals with examiners o Examiners must review prior to the testing window § ISTEP+ Examiner’s Manual (Examiners/Proctors) • Electronic files – Ask your STC/CTC to download Ø Test Coordinator’s Corner in Learning Connection (STC/CTC access only) Ø Indiana Resource Center in Pearson. Accessnext (STC/CTC access only) • Paper copies shipped to schools Ø ISTEP+ Part 1: 2/12/18 Ø ISTEP+ Part 2: 4/2/18

ISTEP+ & IREAD-3: Reminders Before testing (Examiners): • IREAD-3 Test Administration Manual o Single manual for use with Spring and Summer 2018 administrations o Contains secure content § STCs/CTCs must distribute and collect TAMs during examiner training, and immediately before and after testing each day § Examiners may NOT have access to IREAD-3 TAMs except in these circumstances § STCs/CTCs must keep TAMs in locked storage when not in use o Paper copies shipped to schools: 2/23/18

ISTEP+ & IREAD-3: Reminders During testing: • Students must be working in the correct part of the test • Students with an IEP, ILP, or Section 504 Plan must have access to the correct accommodation(s), as appropriate • Students without a formal plan must not receive accommodations in error • Students must not coached or instructed to revisit certain responses After testing: • School personnel must not review test items and/or student responses • Examiners and STCs/CTCs should check front covers of test books to ensure that the invalidation bubbles were not accidentally filled by adults or students. Avoid test invalidations and undetermined results!!

ISTEP+ Updates • • • Testing Times Federal Flexibility – Update Grade 10 Retest Calculator & Text-To-Speech Accommodations Available Resources for Educators

ISTEP+: Federal Flexibility • ESSA changes take effect with the 2018 -19 school year… o “Recently arrived” English learner for 2017 -18 school year is one who: § Initially enrolled in US schools after March 1, 2017 or has been enrolled in US schools for less than 12 cumulative months; and § Demonstrated limited English proficiency (LEP) based on WIDA screener (< 5. 0) WIDA ACCESS 2. 0 assessment (< 5. 0) o Recently arrived* English learners must participate in ALL parts of statewide assessment (e. g. , ISTEP+) § Report on the LEP-ISTEP collection o Detailed memo sent to Corporation Test Coordinators on December 1.

ISTEP+: Grade 10 Retest Opportunity • ISTEP+ Grade 10 (Math and ELA) is graduation assessment for students in class of 2019 o Current juniors who… § Did not pass in Spring 2017 ISTEP+ Grade 10 as sophomores § Did not participate in Spring 2017 ISTEP+ Grade 10 as sophomores § Enrolled in your school this year from an out-of-state or home school • May participate in spring with sophomores testing for first time • Should only participate in Math and/or ELA, as needed (no science requirement) • May also participate in summer retest, if needed

ISTEP+: Calculator & Text-To-Speech • Pearson will assign calculator and Text-To-Speech (TTS) accommodations for students based on schools’ DOE-TL submissions. o Accommodation(s) will be noted in each student’s PNP (Personal Needs Profile) o No separate form group types for spring! • Immediately report to STCs/CTCs any students whose calculator or TTS accommodations are not rendering upon login

ISTEP+: Calculator Guidance • Online Testing o Students testing online must use the online calculator is to ensure a valid test attempt. o Exception: Students with an IEP, ILP, or Section 504 Plan that require the use of a handheld calculator when testing online. • Paper/Pencil Testing o Students may be provided a handheld calculator for test sessions that allow this tool. o The handheld calculator must be equal to or of less functionality than the online calculator tool. o Students may not have a handheld calculator available during non-calculator sessions (with the exception of students who have Calculator as a formal accommodation). • Inappropriate use of calculators will lead to test invalidations, so please proceed with caution!

ISTEP+: Educator Resources • ISTEP+ Blueprints o Align test expectations with mastery of standards o Grades 3 -8 & 10 on IDOE website • ISTEP+ Item Specifications o Offers details on how standards may be assessed o Grade 10 Math & ELA now posted o Item specs for Grades 3 -8 coming soon with transition to ILEARN • ISTEP+ Tutorial • ISTEP+ Part 1 • Online Blank Practice Forms • Online Videos • Scoring Resources • ISTEP+ Experience Online https: //www. doe. in. gov/assessment/istep-grades-3 -8 -10

ISTEP+: Grade 10 Item Specifications Reporting Category Evidence Statement(s) Depth of Knowledge Sample Item Stem(s) Standard Content Limit(s)/Constraint(s) Item Types(s) https: //www. doe. in. gov/asse ssment/istep-grades-3 -8 -10

ISTEP+: Tutorial Form http: //download. pearsonaccessnext. com/in/in-practicetest. html? links=1

ISTEP+: New Instructional Videos • Math Part 1 • “Understanding Online Responses to ISTEP+ Math Part 1” • ELA Part 1 • “ 2018 ISTEP+ Part 1: Online Writing Prompt” • Each video is narrated by an IDOE assessment content specialist and accompanied by a Power. Point that can be used by educators. • Please contact our office with any questions.

ISTEP+: Part 1 Blank Practice Forms (Writing Prompt) http: //download. pearsonaccessnext. co m/in/in-practicetest. html? links=1

ISTEP+: Part 1 Blank Practice Forms (Equation Editor) http: //download. pearsonaccessnext. com/in/in-practicetest. html? links=1

IREAD-3 Updates • • Participation Requirements Good Cause Exemptions Updated Retention Guidance Spring/Summer TAM Accommodations Availability & Use of Results Educator Resources

IREAD-3: Participation & Good Cause Exemption Eligibility Participate in IREAD-3? Eligibility for Good Cause Exemption Student with a Section 504 Plan Yes No Student with an IEP (SWDs) Yes Determined by Case Conference Committee Student with an ILP (ELs) Yes Determined by ILP Committee Student has been retained twice Yes Student who is eligible for ISTAR No N/A Student

IREAD-3: Participation – Additional Information • Students should participate in IREAD-3 if they are… o Enrolled in Grade 3, or o Enrolled in Grade 4 or Grade 5 and did not take or did not pass IREAD-3 while in Grade 3 or Grade 4 at your school or at an accredited Indiana school. NOTE: Students from a home school or out-of-state school who enroll in your accredited school in Grade 4 or Grade 5 will not participate in IREAD-3.

IREAD-3: Good Cause Exemptions • Good Cause Exemptions allow for flexibility when determining access to Grade 4 reading and literacy instruction. 1. Students who have been previously retained two times prior to 4 th grade. 2. Students with disabilities whose Case Conference Committees have determined that promotion is appropriate. 3. English learners whose Individual Learning Plan (ILP) Committees have determined that promotion is appropriate. • A school or committee may only grant a Good Cause Exemption only after reviewing the student’s IREAD-3 results. • A Good Cause Exemption would exempt a student from the effects of retention, not the initial requirement to test.

IREAD-3: Students Who Do Not Pass IREAD-3 • Students who do not pass (or do not participate in) IREAD-3 in the spring may retest in the summer. • Students who do not pass IREAD-3 in the spring or summer will: o Continue to receive Grade 3 reading instruction, and o Participate in the IREAD-3 assessment the following spring • As of April 2017, schools have flexibility to determine appropriate official grade-level reporting status to IDOE (see next slide) o Schools should consider the instructional needs of each student and include the parents when making this decision.

IREAD-3: Updated Retention Guidance • The Indiana State Board of Education approved updated guidance in April 2017: o Provides schools the flexibility to officially report students’ official grade level reporting status regardless of IREAD-3 performance, o Continues to require schools to provide grade 3 reading/literacy instruction and administer the IREAD-3 assessment to students who do not pass IREAD-3 in spring or summer in each subsequent year up to and including grade 5, and o Allows schools to grant Good Cause Exemptions to students who receive two additional years of grade 3 reading/literacy instruction (e. g. , through the end of grade 5).

IREAD-3: Test Administration Manual • IREAD-3 2018 Spring/Summer Test Administration Manual • Use during Spring and Summer test windows • Includes information for practice and operational tests: • • Testing times Accommodations Detailed examiner’s scripts – Follow specific instructions!! Online and Paper/Pencil directions Read aloud scripts Processing, packaging and shipping paper tests Frequently Asked Questions • Contains secure test content (see slide #18) • STCs/CTCs must keep in locked storage for use this summer • STCs/CTCs may access non-secure version in Test Coordinator Corner later this spring

IREAD-3: Accommodations • Students whose hearing impairments prevent them from receiving phonics instruction will not be asked to respond to questions measuring beginning, middle, and ending sounds. o Specific instructions in Section 1 of the IREAD-3 Test Administration Manual o Based on CTC survey responses to IDOE (December 22), Pearson set up special online test sessions for students. § CTCs must update the student’s Personal Needs Profile (PNP) in Pearson. Accessnext if they did not submit student names to IDOE (December 11 -22).

IREAD-3: Accommodations • Students with a read aloud accommodation… o Given that IREAD-3 tests reading students’ reading skills, text read aloud to students is limited to section directions o Based on DOE-TL submissions: § Pearson set up online sessions with the Text-To-Speech accommodation § Schools will receive read aloud scripts for students testing paper/pencil o CTCs must update the student’s Personal Needs Profile (PNP) in Pearson. Accessnext if they did not submit this data to IDOE by December 22.

IREAD-3: Educator Resources • Test Blueprint o Align test expectations with mastery of standards o More detailed version posted on IDOE website • Item Specifications o Offers details on how standards may be assessed o Released for first time! • Both resources posted under “Blueprint and Specifications” dropdown: https: //www. doe. in. gov/assessment/iread-3

End of Course Assessments (ECAs)

Important Dates • Test Administration Window April 23 -May 25, 2018 o Schools must Test within this window • 8 days per subject area Online Testing • 4 days per subject area for Paper/Pencil

Important Dates Before Testing • Additional Materials Order (AMO) Window: April 9 – April 20 2018 o Additional Standard Paper Test Books, Large Print Test Books, Braille Test Books, and Read-Aloud Scripts • Previously ordered Accommodated Materials will arrive on April 9 2018. • Electronic Reports o Online Testing Results o If testing is completed by May 4 th Electronic Reports are available by May 11 th o If testing is completed after May 4 th scoring will be completed within 1 business day following indication of “Testing Complete” by STCs. Reports will be released the next business day, for a total of two business days.

Important Reminder • Graduation Requirements: o Obtaining a passing score on the Algebra I and English 10 ECAs are a graduation requirement for students in the Class of 2018 cohort (All Seniors) o Any student who did not pass the ECA(s), but did pass the ISTEP+ Grade 10 assessment(s), can use ISTEP+ in lieu of the ECA for graduation purposes. o Remember for the cohort of 2018 (regardless of graduation year), their test is the ECA Algebra 1 and English 10.

Screen Reader Option

Enabling the Screen Reader

Online Administration • Server Connection icon in student client • Do Not Score/Invalidate checkbox in Questar admin site • Exponent button for Algebra I • Rich text tools such as bold, underline, and italicize not applicable • Online training modules available under the Help tab in Questar admin site

Online Administration • ECA Practice Test o Required for all students testing and must be completed prior to beginning the operational assessment § Students with accommodations must participate in the Practice Test at least one week prior to taking the operational assessment. § General education students must participate in the Practice Test at least one day prior to taking the operational assessment. o Teacher-directed (script in Online Examiner’s Manual) o Use the Student Web Client to access Practice Test o Practice Test is no longer available under the student’s unique login § Generic login(s) must be used

Online Administration Practice Test Login Credentials

Paper/Pencil Administration • Barcode Labels o Only use labels for Spring 2018 test administration o Students must write their own names on the test book o Review Barcode Label “rules” in the Test Coordinator’s Manual § Not all data is included on label, see roster for details § If correct retest information is not on the roster, bubble the correct information on the Student Data Grid o Bubble for all “new” students without labels o Securely destroy all unused labels

Student Results • Rescore Requests • § https: //in-servicepoint. questarai. com/Login. aspx Rescore Request Dates for Spring 2018 o Parent and school staff may collaborate o Rescores are initiated through online website Service Point o Rescore window: July 16– July 27, 2018 o Rescore Report Release Electronically: August 10, 2018 o Rescore Paper Reports arrive in Corps: August 23, 2018 (score change only)

EAS Student Web Client Features • Online Testing Tools for ALL Students o Highlighter - When this tool is selected, the pointer changes to a highlighter pen, permitting the student to highlight specific text. o Option Eliminator - This tool permits the student to cross out an answer choice, marking it as incorrect. o Bookmark - A student can utilize this feature to mark any question for later review. o English 10 Progress Bar- The bar fills up as students type their response. • Read Aloud Accommodations o Screen Reader Player/Text-to-Speech (Online assessment) § Not available on i. Pads o Read-Aloud Scripts (Paper/Pencil assessment)

ILEARN Update

ILEARN: Understanding the New Assessment Computer Adaptive • Math and ELA • Unique student experience that always meets the blueprint • Adapts on difficulty, not across grade levels unless content aligns at multiple grade levels Assesses Grades 3 -8 • Math (Grades 3 -8) • English/Language Arts (Grades 3 -8) • Science (Grades 4 and 6) • Social Studies (Grade 5) • Custom-built for IN standards • Includes open-ended items for all content areas Additional Student Supports and Accommodations • Translations • Glossaries • Embedded Dictionary/Thesaurus • Spell Check • Rich Text Tools • Desmos Calculator • Intuitive Graphing Interfaces • American Sign Language Improved Testing Times • Single testing window at the end of the year • Decreased test length (average 2 hours shorter total at each grade level) • Untimed sessions *These times will begin in 2020 due to setting cut scores in Summer 2019. Final reporting will be available Aug 15 for 2019. Improved Reporting Structures • Individual student results in 12 days* • Final results by July 1* • More detailed student reports for computer adaptive tests • Revised cut scores and proficiency levels (by educator committee)

ILEARN: The Test Delivery System & Item Samples AIR provides a mature and reliable Test Delivery System that has successfully delivered summative tests for several years.

ILEARN: The Test Delivery System & Item Samples AIR provides a mature and reliable Test Delivery System that has successfully delivered summative tests for several years.

ILEARN: Educator Involvement & Next Steps We are building ILEARN from the ground up, and educators are involved in every step! Standard Setting Scoring Determine cut scores for each proficiency category. Score open-ended items for field test (calibrate the scoring through range finding) and operational data. Data Review statistical data from field test items to determine if the items can be used operationally. Item Development Develop new items to ensure the assessment of the breadth and depth of Indiana standards. Item Audit Specifications Blueprints IN Academic Standards Review items from licensed banks to determine alignment with Indiana Standards. Determine how each standard should be measured (e. g. , evidence statements, item types, cognitive complexity, etc. ) Create test parameters that define essential content from the standards and appropriate proportions of the standards. Define the knowledge and skills students should achieve at each grade level for each content area.

Questions During the Test Window Please use this directory to obtain the quickest response to questions or concerns during a test window: Call Vendor Call Office of Student Assessment Call STN Application Center Usernames & passwords Policy issues Barcode data file questions or concerns Student login information Test irregularities Questions about STNs Online testing issues Test security concerns Paper/pencil test materials Assessment program information Pearson: 866 -683 -6668 Questar: 877 -424 -0322 317 -232 -9050 INassessments@doe. in. gov 800 -527 -4931

More Contact Information • Office of Student Assessment o INassessments@doe. in. gov o 317 -232 -9050 o Web: http: //www. doe. in. gov/assessment o Learning Connection: https: //learningconnection. doe. in. gov • • STN Application Center: 800 -527 -4931 Office of School Accountability: schoolaccountability@doe. in. gov Pearson (ISTEP+ & IREAD-3): 866 -683 -6668 Questar: 877 -424 -0322 ecasupport@questarai. com

This concludes today’s presentation. Thanks for joining us!