Smarter Balanced Interim Assessments California Assessment of Student
Smarter Balanced Interim Assessments California Assessment of Student Performance and Progress Program Principal’s Training Version: 090915
Interim Assessment Principal’s Training Agenda 1) 2) 3) 4) 5) Interim Assessment Principal’s Training Objectives LAUSD Comprehensive Assessment Program Help Desk Reference Guide Interim Assessment LAUSD Policy (REF-6507. 1) Interim Assessment Purpose Interim Assessment Types a) Smarter Balanced Interim Comprehensive Assessments (ICA) b) Smarter Balanced Interim Assessment Blocks (IAB) 6) TOMS and Digital Library Accounts 7) Interim Assessment Viewing System “Teacher View” LD 8) Interim Assessment Administration – with Live Demonstrations (LD) a) Designated Supports and Accommodations (REF-6420) LD b) Student Log in Information LD c) Test Administrator Interface LD 9) Interim Assessment Hand Scoring System LD a) Interim Assessments Estimated Hand Scoring Times b) Hand Scoring System Overview 10) Interim Assessment Reporting System a) Requirements for viewing Interim Assessment Scores (Digital Library account) b) ICA Score Reports c) IAB Score Reports 11) Interim Assessment General Information a) LAUSD – Division of Instruction Smarter Balanced Assessment Scoring Training Plan b) Technology Updates c) TOMS System Downtime d) Earbuds e) For More Information – Contact Information 2
Interim Assessment Principal’s Training Objectives • To provide school site Principals with an overview of the Smarter Balanced Interim Assessments and its components. • To provide school site Principals with an overview of the comprehensive training that the school site Testing Coordinators will receive that will enable them to guide their schools in the administration of the Interim Assessments. 3
LAUSD Comprehensive Assessment Program Help Desk Reference Guide 4
LAUSD Interim Assessment Policy PURPOSE: The purpose of this Reference Guide is to provide information about the Comprehensive Assessment Program for 2015 -2016. The Comprehensive Assessment Program is designed to be formative and to provide multiple measures to drive decisions about instruction and intervention. This document details program policies and also provides the 2015 -2016 assessment schedules in calendar form. MAJOR CHANGES: For 2015 -2016, the District will adopt the Smarter Balanced Assessment Consortium’s Interim Assessment Blocks* (IAB) in Mathematics and English/Language Arts for Grades 3 rd -11 th (9 th and 10 th grade students can only take the 11 th grade IABs). Science and History/Social Science assessments will continue to be the District’s California State Standards-based assessments. For ELA and Mathematics, grades 3 rd -12 th, schools will have the option to: (1) give the SBAC IABs, or (2) give the District’s CA State Standards-based interim assessments in ELA and Math, or (3) give CCSS-based interim assessments determined by the school and with approval of the Local District Superintendent (see Attachment J). The District’s Interim ELA and Math assessments for grades TK-2 nd will continue to be the California State Standards-based interim assessments. Kindergarten Literacy interim assessments will not be optional, as they were in 2014 -2015. Additionally, Grade 3 will have an end-of-year Integrated Unit, joining the Integrated Units for Grade 4 and 5. *NOTE: The Interim Comprehensive Assessment (ICA) is another version of the SBAC Summative and requires as much time as the Summative for administration. Use of the ICA is ultimately a school decision and may replace or supplement one of the options above. 5
Smarter Balanced Interim Assessments Standards set expectations on path to college and career readiness Summative assessments benchmarked to college and career readiness (Grades 3 -8 and 11) Digital Library: Formative assessment tools and practices for teachers to improve instruction Teachers and schools have information and tools to improve teaching and learning All students graduate college and career ready Interim assessments Flexible, open, used for actionable feedback 6
Interim Assessment Purpose • The Interim Assessments are one component of the Smarter Balanced assessment system and are designed to support teaching and student learning throughout the year. The items are developed under the same conditions, protocols, and review procedures as those used in the summative assessments. ‒ ‒ Not secure, but not public Limited access to only those individuals within the District who have a professional interest in the use of the assessments 7
Interim Assessment Purpose cont. • The interim assessments are optional, but are recommended. They enable teachers to check student progress throughout the year, providing actionable information to inform instruction and help students meet the challenge of college-and career-ready standards. 8
Interim Assessment Purpose cont. • The content of the tests have been aligned to the Common Core State Standards in grades 3– 8 and high school. The grade level to assess should be based on the purpose of the testing event. • Each test can be administered to students in any grade (e. g. , a grade 7 interim test is not limited to grade 7 students, but can be administered to students in grades 6 or 8). 9
Interim Assessment Types • Two types of interim assessments: 1. Interim Comprehensive Assessments (ICAs) – English language arts/literacy (ELA) test and performance task – Mathematics test and performance task 2. Interim Assessment Blocks (IABs) – There are between 5 and 17 IABs per grade and content area 10
Smarter Balanced Interim Comprehensive Assessments (ICA) • Fixed form • Use the same blueprints and assess the same standards as the summative assessments • Include the same item types and formats, including performance tasks, as the summative assessments • Yield overall scale scores, overall achievement level designations, and claim score information – Report against the same scale as the summative test 11
Smarter Balanced Interim Comprehensive Assessments (ICA) • Examples of the use of ICAs include: − − A new student from another state is given the previous year’s ICA. Mid-year a teacher gives an ICA to gauge how students might perform on the summative assessment. 12
Smarter Balanced Interim Comprehensive Assessments (ICA) • This document is intended to assist LEA CAASPP coordinators, site coordinators, and test administrators in planning for the administration and local hand scoring of the interim comprehensive assessments (ICA). The following table provides key information, including the total number of items appearing on each ICA. This total includes items that are both machine scored and hand scored. Also included on this table are the number of items that require local hand scoring on the non. Performance Task (PT) constructed response, the PT constructed response, and the PT essay. http: //www. cde. ca. gov/ta/tg/ca/icahandscoring. asp 13
Smarter Balanced Interim Assessment Blocks (IABs) • • Fixed form Focus on fewer sets of skills (e. g. , Geometry) Flexible; supports instruction and curriculum Include the same item types and formats, including classroom activities and performance tasks, as the summative assessments • Yield overall information for each block • Results are reported as Below Standard, At/Near Standard, and Above Standard 14
Smarter Balanced Interim Assessment Blocks (IABs) • Examples of the use of IABs include: − − A teacher uses the argument performance task to determine the degree of a student’s understanding before or after instruction. A team of teachers uses a block to become informed about how a group of students are performing in geometry. 15
Smarter Balanced Interim Assessment Blocks (IABs) The following tables are intended to assist LEAs in planning for the administration and local hand scoring of the Interim Assessment Blocks (IAB). Included in each table are the total number of items on each IAB. The total number of items shown includes both machine scored and hand scored items. Each table also provides the number of constructed response and essay items that require local hand scoring. The entire list of available IABs for grades 3 -8 and 11 can be found at the following web link http: //www. cde. ca. gov/ta/tg/ca/iabhandscoring. asp 16
TOMS and Digital Library ACCOUNTS • In order to administer, score and view reports of the Interim Assessments, staff will need to have an active TOMS and Digital Library account • All TOMS and Digital Library accounts from 2014 -2015 are still active and are to be used to administer, score and view reports of the Interim Assessments • Procedures to create new TOMS or Digital Library accounts, and/or to reset any TOMS or Digital Library account remain the same as last year and are the following: 17
TOMS ACCOUNT CREATING OR RESETTING TOMS Accounts All teachers need to verify that their existing TOMS accounts from last year are working by logging in to TOMS. If their accounts are not working: 1. They should try to reset their password themselves by clicking on the “Forgot my password” button 2. If any teacher cannot reset their TOMS account, they should contact their school Testing Coordinator and request that the Coordinator reset their TOMS account for them. If their Testing Coordinator isn't able to reset their TOMS account, the Testing Coordinator needs to send an email to Nancy Foote at nancy. foote@lausd. net and request that she reset their accounts 3. If any teacher does not have a TOMS account: a. They should contact their school Testing Coordinator and request that the Coordinator create a TOMS account for them. The Testing Coordinator will need to have the staff member sign and submit to them a Security Affidavit before they are granted a TOMS account. If their Testing Coordinator isn't able to create the NEW TOMS accounts, the Testing Coordinator needs to send an email to Nancy Foote at nancy. foote@lausd. net and request that she create a TOMS for them 18
DIGITAL LIBRARY ACCOUNT CREATING OR RESETTING DIGITAL LIBRARY Accounts All teachers need to verify that their existing Digital Library accounts from last year are working by logging in to the Digital Library. If their accounts are not working: 1. They should try to reset their password themselves by clicking on the “Forgot my Password” button 2. If any teacher cannot reset their Digital Library account, they should contact their school Testing Coordinator and request that the Coordinator reset their Digital Library account for them. If their Testing Coordinator isn't able to reset their Digital Library account, the Testing Coordinator needs to send an email to James Overturf at james. overturf@lausd. net and request guidance on the procedures to create a Digital Library account or refer to MEMO-6423 for detailed instructions 3. If any teacher does not have a Digital Library account: a. They should contact their school Testing Coordinator and request that the Coordinator create a Digital Library account for them. If their Testing Coordinator isn't able to create the NEW Digital Library accounts, the Testing Coordinator needs to send an email to James Overturf at james. overturf@lausd. net and request guidance on the procedures to create a Digital Library account or refer to MEMO-6423 for detailed instructions Note: Coordinators need to log in to the Log in to Digital Library for Coordinators link located at the Student Testing Branch website behind the “Digital Library” tab or (art. smarterbalanced. org) 19
Interim Assessment Viewing System 20
Interim Assessment Viewing System § Teacher View enhancement is available for TOMS account holders to use for planning and or training purposes § Is accessible through the caaspp. org website 21
Preview the Tests 22
Preview the Tests cont. . 23
Interim Assessment Administration 24
Interim Assessment Administration Designated Supports and Accommodations Designated Supports § Must be designated prior to the first day of testing window § Available to ELs for whom the need has been indicated § Decision made by educators familiar with the student’s characteristics and needs § Supports the student has been using during instruction/assessments § Non-embedded supports are to be provided by the school § ELs with an IEP or a 504 Plan have to have the designated supports and accommodations listed on the IEP or 504 Plan. 25
Interim Assessment Administration Student Log In 26
Interim Assessment Administration Considerations § The performance task is the same for both the ICA and IAB for the same grade and subject (i. e. , grade 3 ELA), . § Each performance task requires administration of a classroom activity 1 to 3 days before the performance task is administered. § Classroom activities and guidelines are available for download on the TA Resources for the Interim Assessments page at caaspp. org. 27
Interim Assessment Administration • Accessing and Administering Interim Assessments • Interim Assessments are administered in the same way as summative tests. The test administrator (TA) must use the TA Interface and the student must log onto the test through the secure browser. 1. Select the [Test Administrator Interface] button on the CAASPP portal at http: //caaspp. org. 2. Log onto the TA Interface using your sign in credentials. 28
Interim Assessment Administration 3. Select the test category or grade and content area. 29
Interim Assessment Hand Scoring 30
Interim Assessment Hand Scoring This table is a Smarter Balanced document that describes a range of estimated times required to complete the hand-scoring portion of the interim assessments. Non-PT Items Performance Tasks Grade ELA Reading Short-Text Items and Brief Writes Math Short-Text Items ELA Research Short -Text Items ELA Full Writes Math Short-Text Fill. In Table Items without dependencies Math Short-Text Fill. In Table Items with dependencies Grade 3 15 -40 sec. N/A 15 -44 sec. 28 -646 sec. 5 -30 sec. 11 -82 sec. Grade 4 10 -46 sec. 17 -24 sec. 15 -55 sec. 319 -1042 sec. Grade 5 18 -61 sec. 11 -25 sec. 18 -79 sec. 288 -1037 sec. Grade 6 103 -393 sec. 17 -18 sec. 14 -60 sec. 139 -146 sec. 55 -231 sec. 72 -432 sec. Grade 7 120 -345 sec. 13 -34 sec. 12 -75 sec. 134 -148 sec. 81 -150 sec. 49 -291 sec. Grade 8 106 -475 sec. 10 -29 sec. 12 -76 sec. 124 -151 sec. 87 -402 sec. 67 -394 sec. High School 21 -107 sec. 8 -37 sec. 10 -67 sec. 85 -177 sec. 4 -39 sec. 3 -141 sec. 31 -360 sec. 7 -51 sec. 13 -68 sec. 45 -301 sec. 31
Interim Assessment Hand Scoring § Most interim assessment items are scored by the Smarter Balanced test delivery engine. § Hand scoring of constructed-response items and performance tasks is a local responsibility. § Results for individual students are generated only after the constructed-response item scores and performance task scores are inputted into the Interim Assessment Hand Scoring System (IAHSS). (Processing time of up to 48 hours) § Scoring is supported by training guides, rubrics, exemplars (i. e. , anchor and practice papers). 32
Interim Assessment Scoring cont. IABs That Do Not Require Local Hand Scoring § ELA, all grades Edit/Revise Listen/Interpret Research § Mathematics, all grades All blocks, except Performance Task blocks 33
Training Guides and Exemplars • Training Guides and Exemplars for all constructed response items and performance tasks are accessible in TOMS. • LEAs can access these materials for professional development and training purposes. 34
Videos, Training Guides and Exemplars 35
Interim Assessment Scoring Logging In… The Interim Hand Scoring System is part of the connected suite of Single Sign-On systems (e. g. , TOMS, TA Interface, Completion Reports, etc. ) 36
Hand Scoring System Home Page 37
Scoring Responses 38
Training Guides and Exemplars In P C d n s a p Set e r st In ruc fo tio rm ns at a io nd n k c he 39
Interim Assessment Hand Scoring Guide The Interim Assessment Hand Scoring System User Guide can be found at the following web link http: //caaspp. org/ta-resources/interim. html 40
Interim Assessment Reporting System 41
Interim Assessment Reporting System cont. … Teachers will use their Digital Library logon credentials to access the Data Warehouse to view Interim Assessment student reports. Requires same logon credentials used for the Digital Library 42
Interim Assessment Reporting System Results § Reports for lists of students and individual student reports. No aggregate reports. § ICA: Overall scale score (i. e. , 2000 to 3000); Achievement Level (Level 1, 2, 3, or 4); and Claim level (Below, At/Near, or Above Standard). § IAB: Level of Below, At/Near, or Above Standard for each Block. § Exportable data file. 43
Interpreting Interim Assessment Results § The extent to which interim assessments were administered under standardized conditions will affect the interpretations. § Interim assessment results should only be used in combination with other evidence of student learning; they should not be the sole basis for making any high-stakes decisions. 44
IA Reporting System Home Page List of Districts 45
“List of Students” Display Presents the following information listed by individual student name: § Individual results for students within grade or subgroup. § Overall scores, achievement levels, and error bands for individual student performance (ICA only). § Overall individual student performance by claim (ICA) or block (IAB). 46
Interim Comprehensive Assessment List of Students 47
ICA Student Report § Student’s Mathematics and ELA/literacy overall score and achievement level (i. e. , Level 1, 2, 3, or 4) § Overall score is displayed (scale is 2000 to 3000) and surrounded by error bands marked with brackets § Claim level of Below Standard, At/Near Standard, or Above Standard § List of student accommodations 48
ICA Student Report 49
IAB Student Report § Block level of Below Standard At/Near Standard Above Standard § Multiple blocks on the same report § Current and previous results for each block on the same report § Overall scores, error bands, and achievement levels NOT reported for blocks 50
Interim Assessment Block List of Students 51
Interim Assessment Block Student Report 52
Interim Assessment General Information LAUSD –DIVISION OF INSTRUCTION Smarter Balanced Assessment Scoring Training Plan Working with the Los Angeles County Office of Education, the Division is arranging training in Building Educator Assessment Literacy (BEAL) for four 30 -person teams of trainers in each of four areas: Elementary Math, Secondary Math, Elementary Literacy and Secondary Literacy. Using secure SBAC items, performance tasks will be examined and implications for instruction will be discussed. The trainers will then be eligible to lead BEAL training of teachers in their local district. 53
Interim Assessment General Information cont. Technology Updates 1. i. OS Upgrade a) DO NOT update any pending i-Pad i. OS upgrade. 2. All testing device carts should be opened, devices accounted for (including keyboards) and charged 3. For technical assistance or issues with testing devices or infrastructure, email or contact: a) Testing Hotline - (323) 224 -2450 i. b) For immediate issues affecting test environment or technical assistance with testing devices ITD Hotline - (213) 241 -5200 i. c) For trouble calls Joe Oliver, Director Information Technology Division 213 -241 -3837 @ joe. oliver@lausd. net i. For assistance with Testing Device Carts or inventory of Testing Devices 54
Interim Assessment General Information cont. TOMS Updates Test Operations Management System (TOMS) Downtime Please note that TOMS will be offline October 1– 14 During the downtime, LEAs will not be able to download student data files or score report PDFs; access the Online Reporting System, interim assessments, or hand scoring for interim assessments; add/delete users; or view completion status for interim assessments. We anticipate the system to be back online Thursday, October 15, with new system enhancements that will make 2015– 16 version of TOMS easier to use. 55
Interim Assessment General Information cont. Earbuds Smarter Balanced Summative Assessments 2015 -2016 The Student Testing Branch will provide schools that are not participating in the i. Pad 1 -to-1 program with earphones for the Smarter Balanced Summative Assessment. Schools will receive earphones to accommodate their student enrollment in grades 3 -8 and 11 two to six weeks prior to the opening of their Smarter Balanced Summative Assessment testing window. 56
For More Information CDE Interim Assessments Web Page http: //www. cde. ca. gov/ta/tg/sa/sbacinterimassess. asp ETS CAASPP Web Site http: //www. caaspp. org California Technical Assistance Center (for LEA CAASPP Coordinators) 800 -955 -2954 caltac@ets. org LAUSD Student Testing Branch http: //achieve. lausd. net/testing 213 -241 -4104 Office of Curriculum, Instruction, and School Support http: //achieve. lausd. net/instruction#spn-content 213 -241 -5333 57
- Slides: 57