Administering Smarter Balanced Interim Assessments and Accessing Results
Administering Smarter Balanced Interim Assessments and Accessing Results Dianne Morada, Test Development Specialist Kelsie Pualoa, Test Development Specialist Paul Dumas, Test Development Specialist
Purpose 1. An Overview of Interim Assessments 2. Types of Interim Assessments 3. Using Assessment Systems for the Interim Assessments a. Viewing Assessments and Scoring Guides b. Administering a Test c. Retrieving Students’ Results 4. Next Steps: Accessing the Smarter Balanced Digital Library
1. Overview
Interim Assessments: An Overview Three Types of Interim Assessments: ★ Interim Comprehensive Assessments (ICAs) ★ Interim Assessment Blocks (IABs) ★ Focused Interim Assessment Blocks (FIABs) Interim Assessment Basics: ● Developed using the same process/criteria as items on the summative ● Can be administered through the TA Live Site (like the summative) ● 5 opportunities (fixed-form tests) ● Scores appear in AIRWays Reporting ○ Short answer/essay items can be scored/rescored in AIRWays Reporting ● Can be viewed in the Assessment Viewing Application (AVA)
Non-Secure but Non-Public The interim assessments are considered non-secure and non-public. ● Because the interims are non-secure, they are not intended to be used for accountability purposes. ● Non-secure means teachers and students can have access to the items, answers, and student responses. ● Non-public means they are not to be posted publicly (such as on a school website). Schools and departments should be “on the same page” regarding Interim Assessments. School leaders may want to establish a timeframe and policies related to the use of the Interim Assessments. 5
SY 2019 -2020: Interim Assessment Updates ● ICAs are available for ELA/Math in Grades 9 and 10 (may be released after the Interim Assessments launch date, September 24). ● New Focused IABs will be launched for ELA/Math this year. ● Interim Assessment Reporting will ONLY appear in AIRWays Reporting. ○ Past years’ interim assessment reports will still be retained in the Online Reporting System (ORS). However, no new interim assessment reports will appear in ORS as of this year. ● As a reminder, most interim assessment items will be machine scored, including short answer and essay items. However, some may require hand scoring (notably, the Math PT IAB) or require you to review the machine score. You can do this in AIRWays Reporting. ● There may be short answer items on the ELA PT ICA for all grades. However, this will not be the case for the summative assessments.
2. Types of Interim Assessments
Select the Appropriate Assessment for your Purposes Interim Comprehensive Assessments (ICAs) measure the same content as the summative assessment. ● They can be used to determine the knowledge and skills of students who are new to Smarter Balanced tests. ● They can provide interim information after a significant period of instruction. Interim Assessment Blocks (IABs and Focused IABs) can be used throughout the school year to concentrate on more focused sets of related concepts in math and ELA. ● more granular than the ICA ● can be administered in a manner more consistent with the sequence of their curricula 8
Types of Interim Assessments at a Glance
Interim Comprehensive Assessments (ICAs) ● The ELA/L ICA consists of two parts, the Computer Adaptive Test (CAT) and the Performance Task (PT). ● The Math ICA consists of the CAT. There is no PT. ● ICA Scores will be reported “almost immediately” in AIRWays Reporting. ● For the ELA/L ICA, the “full write” will receive a machine score that can be accepted or rescored in AIRWays Reporting. 10
Planning for Administering the ICAs Content Area English Language Arts/Literacy Mathematics Grades Computer Adaptive Test (CAT) Performance Task (PT) Total 3– 5 1: 30 1: 45 3: 15 6– 8 1: 25 1: 20 2: 45 HS 1: 15 0: 55 2: 10 3– 5 1: 35 N/A 1: 35 6– 8 1: 35 N/A 1: 35 HS 1: 05 N/A 1: 05 Note: The ICAs take approximately the same length of time for students to complete as the summative assessments. 11
Interim Assessment Blocks: IABs (old) + FIABs (new) ● The IABs are administered through the TA Live site but, because they are shorter, there is not a need for extensive planning and often teachers, grade levels, and/or secondary school departments develop their own plans for the use of these assessments. ● Performance Tasks IABs are available for math. ● IAB scores - except the Math PT IAB - will be reported “almost immediately” in AIRWays Reporting. 12
IABs (old) and FIABs (new): Grade 3 Sample
IABs (old) blueprint: Grade 3 Sample
FIABs (new) blueprint: Grade 3 Sample
Available Interim Assessment Blocks: ELA Grades 3 - 7 Grade 8 High School Read Literary Texts Read Informational Texts Brief Writes Research Performance Task Revision Edit/Revise Revision 16
Available Focused Interim Assessment Blocks: ELA Grades 3 - 7 Grade 8 High School Research: Interpret and Integrate Information Listen/Interpret Research: Analyze Information Write and Revise Narratives 1 Language and Vocabulary Use (Writing) Editing 1 Includes at least one item that may be hand-scored
Available Interim Assessment Blocks: Math Grade 3 Grade 4 Grade 5 Operations and Algebraic Thinking Measurement and Data Performance Task Numbers and Operations - Fractions Number and Operations in Base Ten Grade 6 Grade 7 Grade 8 Expressions and Equations I Performance Task The Number System Geometry High School Algebra and Functions I - Linear Functions, Equations and Inequalities Algebra and Functions II - Quadratic Functions, Equations, and Inequalities Geometry Congruence Geometry Measurement and Modeling Performance Task 18
Available Focused Interim Assessment Blocks: Math Grade 3 Grade 4 Grade 5 Geometry Multiplication and Division: Interpret, Represent, and Solve Four Operations: Interpret, Represent and Solve Numerical Expressions Properties of Multiplication and Division Fraction Equivalence and Ordering Operations with Whole Numbers and Decimals Multiply and Divide within 100 Fractions and Decimal Notation Add and Subtract with Equivalent Fractions Number and Operations in Base Ten Number and Operations - Fractions Grade 6 Grade 7 Grade 8 Ratios and Proportional Relationships, Lines, and Linear Equations Statistics and Probability Functions Divide Fractions by Fractions The Number System One-Variable Expressions and Equations Equivalent Expressions & Equations II Dependent and Independent Variables Algebraic Expressions and Equations Analyze and Solve Linear Equations Geometry Geometric Figures Congruence and Similarity High School Number and Quantity Equations and Reasoning Interpreting Functions Statistics and Probability Seeing Structure in Expressions/Polynomial Expressions Solve Equations and Inequalities: Linear and Exponential Solve Equations and Inequalities: Quadratic Geometry and Right Triangle Trigonometry
Interim Assessment Blocks ICAs IAB (original) FIAB (new) What they measure Similar claims, targets, standards as summative 3 - 8 targets 1 -3 targets Test format fixed-form Kinds of Test items Same item types as summative Overall scale scores Claim Level results are reported as ○ Below Standard ○ At/Near Standard ○ Above Standard No Target reports Reported as ● Below Standard ● At/Near Standard ● Above Standard Search Digital Library for relevant resources by filtering for grade level, subject, and claim Associated with a Digital Library Connections Playlist Reporting Results ● ● ● Resources for Next Steps
3. Using Assessment Systems for the Interim Assessments
Interim Assessments - Systems to Use 1. 2. 3. Alohahsap. org Through AIRWays a. Select either ‘Performance by Roster’ or ‘Performance by Student’ b. Click on hyperlink and match student’s performance with the DL resources 1. 2. 3. 4. 5. Identify Focus Areas from Summative Results of Current Students (ORS) 6. 7. Use the Digital Library Connections Playlists as supplements in your instruction. (AIRWays or ‘Digital Library’ Icon) 1. 2. 3. Alohahsap. org Select the Interim Assessment Click either ‘Performance by Roster’ or ‘Performance by Student’ Analyze Results from the Interim Assessments (AIRWays Reporting) Alohahsap. org Click on ‘Online Reporting System’ Select Location (based on your role) Click Score Report Select ‘Smarter Summative’, Select Administration ‘ 2017 -2018’, Click on ‘Scores for my current students’, Click on Desired Grade Level (if you teach more than one grade level) Click on the magnifying glass of the class for which you’d like to see the results. Select ‘Targets’ in the popup screen Decide which Interim Assessment Blocks to Use (AVA) 1. 2. 3. 4. 5. Administer the Interim Assessments (TA Live Site) 1. 2. 3. Alohahsap. org Click on ‘AVA System’ Select ‘Grade’ Select IAB or ICA Review Blueprints on Alohahsap. org Click on ‘TA Live Site’ a. Pass TA Certification b. Secure Browser Click on either IAB or ICA
alohahsap. org: Your Assessment One-stop Shop! 23
Activity: Temperature Check Q: What is the purpose of each of these?
Activity: Temperature Check 1. 2. 3. 4. 5. 6. 7. 8. Training Sites a. TA Certification Course b. Training and Practice Tests c. TA Training Site (Practice administering a test) TA Live Site a. Test Administration TIDE a. Assessment systems’ user database b. Status of student testing c. Reasons for non-participation d. Answer keys Resources a. User guides, training manuals, supporting documentation (e. g. , assessment blueprints, crosswalks, etc. ) b. Materials for students, families, and educators Online Reporting System a. Summative results (e. g. , claim and target reports) Assessment Viewing Application (AVA) a. View Interim Assessment items AIRWays Reporting a. Interim Assessment results b. Access to Connections Playlist Digital Library a. Instructional Resources (Connections Playlist)
A Brief Note on Standardized vs. Non-Standardized Administration ● Interim Assessments can be administered in a standardized (like the summative) or non-standardized (collaborative) way.
Standardized vs. Non-Standardized Interim Assessment Administration Standardized Administration ● ● ● Individual and independent testing Single administration allows for a reliable “point-in-time” spot check of student knowledge Following summative policies and procedures, such as a secure test environment (e. g. , no cell phones, guiding resources, etc. ) Non-Standardized Administration ● ● ● Non-secure, Non-public Working on assessment items collaboratively ○ Students working with other students to answer items ○ Teacher guides students through items Students use resources to help them answer questions
The Assessment Viewing Application (AVA) Key Feature: Allows teachers to view all items on all Smarter Balanced Interim Assessments. ● ● Educators log into AVA with their TIDE username and password, select a grade, select a test, and take that test “as if they were a student”. If a school so decides, because AVA does not use the secure browser, interim items could be projected. AVA can help educators make informed decisions regarding how/when to use the Interim Assessments. The answer keys for the Interim Assessments can be found in TIDE within Download Forms under General Resources on the Navigation Bar. 28
Standardized Administration: TA Certification Course, TA Live Site, TIDE, Secure Browser Key Feature: Allows teachers to check student knowledge in a secure environment with valid results. In order to do this, you need to get. . . ● Certified (TA Certification Course) ● Student Supports (TIDE) ● Secure (Secure Browser) ● Testing (TA Live Site) ● Results (AIRWays Reporting) 29
Standardized Administration: Best Practices 1. Plan ahead with your Test Coordinator. 2. Confirm that you have a TA role in TIDE and complete the Test Administration Certification Course. 3. Ensure that all accessibility supports your students will need on the Summative Assessments are verified by the appropriate teams and updated in TIDE before administering the Interim Assessments (if possible). 4. Ensure that the updated Secure Browsers are downloaded to all students’ testing devices. 5. Administer a Training Test to familiarize your students with the test environment.
AIRWays Reporting Key Feature: Allows teachers to review student performance reports, score/rescore items, and plan ahead. ● Reporting ● ● ● Most interim assessment items will be machine scored, including short answer and essay items. However, some may require hand scoring (notably, the Math PT IAB) or require that you review the machine score. You can do this in AIRWays Reporting. Scoring Next Steps The Dashboard provides a summary of all the Interim Assessments associated with a particular TIDE user or institution (school, complex, etc. ) The information users will see varies by role group. Principals and Test Coordinators can see all school data. Classroom teachers can see data for their students. Others can see data determined by user defined rosters. ● Interim Assessment Blocks are connected to the Smarter Balanced Digital Library Connections Playlist. 31
Types of AIRWays Reports ● District Assessment Report provides information about how a complex performed on the assessment, by school. ● School Assessment Report provides information about how a school performed on the assessment, by roster and by student. This can be by roster or by student. ● Teacher Assessment Report provides information about how a teacher’s associated students performed on the assessment. This can be by roster or by student. ● Student Assessment Report provides information about how an individual student performed on the assessment. ● Longitudinal Reports that compares the student's performance information for related interim assessments. ● Student Portfolio Report includes a row of data for each assessment that an individual student completed. 32
AIRWays Reporting: Walkthrough 33
When you open an assessment, you will see the results by class/roster or by student. 34
Each of the bars on the right can be expanded to get further information. 35
By clicking on an item in a student’s row, his/her response and the scoring rubric can be viewed. 36
Student Assessment Report: Searching by SSID will yield all of the Interim Assessments taken by a student. All reports in AIRWays can be printed or saved in a number of formats. Individual items with student responses can only be printed by cutting/pasting into Word or similar tool, taking a screenshot, etc. 37
Longitudinal Report: This report shows how students performed on related assessments over time. This report is only available when the students in an Assessment Report have completed at least one other related assessment. 38
AIRWays Reporting and Scoring ● As a reminder, some items may require scoring in AIRWays Reporting in order for the student to receive a score (the system will alert you). ● Teachers also have the opportunity to rescore a student’s response. 39
The Tests to Score button will appear when the machine scores an item with low confidence OR if there is a Math PT item that needs to be hand-scored. If you click on the Tests to Score button, it sends you to a page where there is a list of items that need to be handscored.
Teachers will need to score some items in order for the student to receive a score for the assessment. Otherwise, teachers have the option to modify machine scores, if interested. ELA Scoring Example Alert: Each machine-suggested essay score has an associated confidence level. When the confidence level for a machine-suggested score is low, a warning icon displays in the cell for that score. A user review is highly recommended for item scores with low confidence. 41
Math Scoring Example 42
Connections Playlists: Linking IABs to Digital Library Resources 43
Connections Playlists: How to Access Instructional Resources
Activity: Turn & Talk 1. Does anyone at your table use AIRWays Reporting? 1. What is most useful about AIRWays Reporting? 1. What is most challenging about AIRWays Reporting? 1. What other questions do you have about AIRWays Reporting?
4. Next Steps: Accessing the Smarter Balanced Digital Library
Accessing the Digital Library - OR https: //www. sbdigitallibrary. org/
1. Register ● HIDOE Public Schools: E-mail address should be your Google account (employee. ID#@k 12. hi. us) and your password should be the same as your TIDE account. ● Charter Schools: Continue to use their charter school email address. THIS HAS BEEN UPDATED FROM WHAT IS IN THE PRINT OUTS!! ● Contact the HSAP Help Desk if you have problems. 48
2. Set Up Your Expertise ● The Account page allows you to adjust your profile to access the resources you need. Use the Personal Information tab to update your name and title, include a short biography, or add a photo. 49
2. Set Up Your Expertise ● Use the Expertise tab to indicate the subjects, grades, and student populations that are related to your educational role. ● Setting up the Expertise tab helps to prioritize resources when you do searches. 50
2. Set Up Your Expertise From the top of the page, select your name, then [Account]. Next, select [Expertise]. When prompted, identify your subject area and grade(s). 51
2. Set Up Your Expertise After login, click [Account]. In the Account page, scroll down and click on [Expertise]. Click the [x] to remove subjects, grades, and student populations. To add onto your expertise, click in the box and select. 52
3. Search: Across the Site Use the Search bar on the home page to search across the site for resources. 53
3. Search: Filtered Here you will see the subject and grade level you selected in your profile. It is auto-populated to target your search. 54
3. Search: Filtered Click the plus sign to expand each field. Deselect/Select the checkbox next to any fields that you do not wish to/wish to see resources for. There is NO ‘Select All’ option once you deselect the checkbox next to each subject. So deselect fields at the more granular level (practice or content) 55
3. Search: Within Results Search resources within filtered results Sort filtered search results 56
Any Questions?
Mahalo nui! Contact us if you have any questions or concerns For technical issues with Interim Assessment systems: For all other assessment questions: HSAP Help Desk Phone: 1 -866 -648 -3712 Email: hsaphelpdesk@air. org Assessment Section Phone: 808 -307 -3636 Email: hsa@notes. k 12. hi. us
- Slides: 58