Smarter Balanced Interim Assessments California Assessment of Student

Smarter Balanced Interim Assessments California Assessment of Student Performance and Progress Program School Site Testing Coordinator Training Version 102715

Interim Assessment School Site Coordinator’s Training To download this power point: 1. Go to Student Testing Branch home page 2. Click on Interim Assessments 3. Click on Smarter Balanced Interim Assessments 4. Under “Training Materials” click on Principal Training Power. Point 2

Critical Links http: //achieve. lausd. net/testing http: //www. caaspp. org/ �Best Practice Bookmark these Webpages CAASPP 2015 3

Interim Assessment School Site Testing Coordinators Training Agenda 1) 2) 3) 4) 5) 6) Interim Assessment School Site Testing Coordinator Training Objectives Professional Development Topics Interim Assessment LAUSD Policy (REF-6507. 1) LAUSD Comprehensive Assessment Program Help Desk Reference Guide Interim Assessment Purpose Interim Assessment Types a) Smarter Balanced Interim Comprehensive Assessments (ICA) b) Smarter Balanced Interim Assessment Blocks (IAB) 7) TOMS and Digital Library Accounts (REF-6578) 8) Interim Assessment Viewing System “Teacher View” LD 9) Interim Assessment Administration a) Designated Supports and Accommodations (REF-6420) LD b) Student Log in Information LD c) Test Administrator Interface LD 10) Interim Assessment Hand Scoring System LD a) Interim Assessments Estimated Hand Scoring Times b) Hand Scoring System Overview 11) Interim Assessment Reporting System a) Requirements for viewing Interim Assessment Scores (Digital Library account) b) ICA Score Reports c) IAB Score Reports 12) Interim Assessment General Information a) LAUSD – Division of Instruction Smarter Balanced Assessment Scoring Training Plan b) Technology Updates c) Earbuds REF-6571 d) For More Information – Contact Information 4

Interim Assessment School Site Testing Coordinators Training Objectives To provide School Site Testing Coordinators with a comprehensive training that will enable them to guide their school in the administration of the Smarter Balanced Interim Assessments, including: 1. Administering the Interim Assessments 2. Scoring the Interim Assessments 3. Viewing Score Reports of the Interim Assessments 5

Interim Assessment School Site Testing Coordinators Training Professional Development Topics 1. Test Administrator Security Affidavit and Learning Zone Class and Assessment (30 min) 2. Interim Assessment overview and Interim Assessment Viewing System (35 -45 min) 3. Interim Assessment Hand Scoring A. Training Guides and Exemplars (2+ sessions) i. For instructional planning (35 -45 min) ii. For scoring student’s Interim Assessments (30 min) 4. Interim Assessment Reporting System (25 -30 min) 5. Interim Assessment Administration (2+ sessions) A. Test Security protocols (25 min) i. TOMS accounts ii. Student log in credentials B. Creating a test session in Test Administrator Interface (25 -30 min) C. Student log in procedures and test session management (25 -30 min) D. School specific testing logistics (25 -30 min) i. Device scheduling ii. Interim Assessments to be administered 6

LAUSD Interim Assessment Policy PURPOSE: The purpose of this Reference Guide is to provide information about the Comprehensive Assessment Program for 2015 -2016. The Comprehensive Assessment Program is designed to be formative and to provide multiple measures to drive decisions about instruction and intervention. This document details program policies and also provides the 2015 -2016 assessment schedules in calendar form. MAJOR CHANGES: For 2015 -2016, the District will adopt the Smarter Balanced Assessment Consortium’s Interim Assessment Blocks* (IAB) in Mathematics and English/Language Arts for Grades 3 rd -11 th (9 th and 10 th grade students can only take the 11 th grade IABs). Science and History/Social Science assessments will continue to be the District’s California State Standards-based assessments. For ELA and Mathematics, grades 3 rd -12 th, schools will have the option to: (1) give the SBAC IABs, or (2) give the District’s CA State Standards-based interim assessments in ELA and Math, or (3) give CCSS-based interim assessments determined by the school and with approval of the Local District Superintendent (see Attachment J). The District’s Interim ELA and Math assessments for grades TK-2 nd will continue to be the California State Standards-based interim assessments. Kindergarten Literacy interim assessments will not be optional, as they were in 2014 -2015. Additionally, Grade 3 will have an end-of-year Integrated Unit, joining the Integrated Units for Grade 4 and 5. *NOTE: The Interim Comprehensive Assessment (ICA) is another version of the SBAC Summative and requires as much time as the Summative for administration. Use of the ICA is ultimately a school decision and may replace or supplement one of the options above. 7

LAUSD Comprehensive Assessment Program Help Desk Reference Guide 8

Smarter Balanced Interim Assessments Standards set expectations on path to college and career readiness Summative assessments benchmarked to college and career readiness (Grades 3 -8 and 11) Digital Library: Formative assessment tools and practices for teachers to improve instruction Teachers and schools have information and tools to improve teaching and learning All students graduate college and career ready Interim assessments Flexible, open, used for actionable feedback 9

Interim Assessment Purpose • The Interim Assessments are one component of the Smarter Balanced assessment system and are designed to support teaching and student learning throughout the year. The items are developed under the same conditions, protocols, and review procedures as those used in the summative assessments. ‒ ‒ Not secure, but not public Limited access to only those individuals within the District who have a professional interest in the use of the assessments 10

Interim Assessment Purpose cont. • The interim assessments are optional, but are recommended. They enable teachers to check student progress throughout the year, providing actionable information to inform instruction and help students meet the challenge of college-and career-ready standards. 11

Interim Assessment Purpose cont. • The content of the tests have been aligned to the Common Core State Standards in grades 3– 8 and high school. The grade level to assess should be based on the purpose of the testing event. • Each test can be administered to students in any grade (e. g. , a grade 7 interim test is not limited to grade 7 students, but can be administered to students in grades 6 or 8). 12

Interim Assessment Types • Two types of interim assessments: 1. Interim Comprehensive Assessments (ICAs) – English language arts/literacy (ELA) test and performance task – Mathematics test and performance task 2. Interim Assessment Blocks (IABs) – There are between 5 and 17 IABs per grade and content area 13

Smarter Balanced Interim Comprehensive Assessments (ICA) • Fixed form • Use the same blueprints and assess the same standards as the summative assessments • Include the same item types and formats, including performance tasks, as the summative assessments • Yield overall scale scores, overall achievement level designations, and claim score information – Report against the same scale as the summative test 14

Smarter Balanced Interim Comprehensive Assessments (ICA) • Examples of the use of ICAs include: − − A new student from another state is given the previous year’s ICA. Mid-year a teacher gives an ICA to gauge how students might perform on the summative assessment. 15

Smarter Balanced Interim Comprehensive Assessments (ICA) • This document is intended to assist LEA CAASPP coordinators, site coordinators, and test administrators in planning for the administration and local hand scoring of the interim comprehensive assessments (ICA). The following table provides key information, including the total number of items appearing on each ICA. This total includes items that are both machine scored and hand scored. Also included on this table are the number of items that require local hand scoring on the non. Performance Task (PT) constructed response, the PT constructed response, and the PT essay. http: //www. cde. ca. gov/ta/tg/ca/icahandscoring. asp 16

Smarter Balanced Interim Assessment Blocks (IABs) • • Fixed form Focus on fewer sets of skills (e. g. , Geometry) Flexible; supports instruction and curriculum Include the same item types and formats, including classroom activities and performance tasks, as the summative assessments • Yield overall information for each block • Results are reported as Below Standard, At/Near Standard, and Above Standard 17

Smarter Balanced Interim Assessment Blocks (IABs) • Examples of the use of IABs include: − − A teacher uses the argument performance task to determine the degree of a student’s understanding before or after instruction. A team of teachers uses a block to become informed about how a group of students are performing in geometry. 18

Smarter Balanced Interim Assessment Blocks (IABs) The following tables are intended to assist LEAs in planning for the administration and local hand scoring of the Interim Assessment Blocks (IAB). Included in each table are the total number of items on each IAB. The total number of items shown includes both machine scored and hand scored items. Each table also provides the number of constructed response and essay items that require local hand scoring. The entire list of available IABs for grades 3 -8 and 11 can be found at the following web link http: //www. cde. ca. gov/ta/tg/ca/iabhandscoring. asp 19

TOMS and Digital Library ACCOUNTS REF-6578 Getting Ready for Your 15 -16 TOMS Accounts CAASPP Coordinators Principals 1. 2. 3. 1. Designate CAASPP Coordinator in the Principal’s Portal Security Agreement and Security Affidavit in the Principal’s Portal Sign a hard copy of the Security Agreement and the Security Affidavit 2. Sign a hard copy of the Security Agreement and the Security Affidavit Complete the training and assessment in the Learning Zone, “ 2015 -16 CAASPP Security Forms Coordinator Training” Teachers (Test Administrators) 1. 2. 3. Sign a hard copy of the Security Affidavit Complete the training and assessment in the Learning Zone, “ 2015 -16 CAASPP Security Forms Teacher Training” Submit a hard copy of the Security Affidavit and the Certificate for the Learning Zone class to the CAASPP Coordinator 20

TOMS ACCOUNT CREATING OR RESETTING TOMS Accounts • Procedures to create new TOMS accounts, and/or to reset any TOMS account remain the same as last year and are the following: 1. They should try to reset their password themselves by clicking on the “Forgot my password” button 2. If any teacher cannot reset their TOMS account, they should contact their school Testing Coordinator and request that the Coordinator reset their TOMS account for them. If their Testing Coordinator isn't able to reset their TOMS account, the Testing Coordinator needs to send an email to Nancy Foote at nancy. foote@lausd. net and request that she reset their accounts 3. If any teacher does not have a TOMS account: a. They should contact their school Testing Coordinator and request that the Coordinator create a TOMS account for them. Teachers needing a TOMS account will be required to complete the “ 2015 -16 CAASPP Security Forms Teacher Training” in the Learning Zone, print the certificate of completion for the class, and sign a hard copy of the 201516 CAASPP Security Affidavit form. No TOMS access should be given until a certificate of completion and a signed Affidavit is on file at the school. Retain these originals throughout the school year. CAASPP Coordinators will be required to submit copies of both documents to the school’s designated Testing Center at the end of testing in the spring. 21

Test Security and TOMS ACCOUNTS Staff that have been granted accounts to the Smarter Balanced Test Operations Management System (TOMS) are permitted to access secure and confidential information and resources. Therefore: • Memorize or store account log in information in a secure location • Do not share account credentials with any other employee or person • Do not request computer to store or remember password • Do not disclose or share any secure material in any format with anyone else • Report to STB (Nancy Foote) if account is compromised 22

DIGITAL LIBRARY ACCOUNT CREATING OR RESETTING DIGITAL LIBRARY Accounts • Procedures to create new Digital Library accounts, and/or to reset any Digital Library account remain the same as last year and are the following: 1. They should try to reset their password themselves by clicking on the “Forgot my Password” button 2. If any teacher cannot reset their Digital Library account, they should contact their school Testing Coordinator and request that the Coordinator reset their Digital Library account for them. If their Testing Coordinator isn't able to reset their Digital Library account, the Testing Coordinator needs to send an email to James Overturf at james. overturf@lausd. net and request guidance on the procedures to create a Digital Library account or refer to MEMO-6423 for detailed instructions 3. If any teacher does not have a Digital Library account: a. They should contact their school Testing Coordinator and request that the Coordinator create a Digital Library account for them. If their Testing Coordinator isn't able to create the NEW Digital Library accounts, the Testing Coordinator needs to send an email to James Overturf at james. overturf@lausd. net and request guidance on the procedures to create a Digital Library account or refer to MEMO-6423 for detailed instructions Note: Coordinators need to log in to the Log in to Digital Library for Coordinators link located at the Student Testing Branch website behind the “Digital Library” tab or (art. smarterbalanced. org) 23

Interim Assessment Viewing System 24

Interim Assessment Viewing System • Teacher View enhancement is available for TOMS account holders to use for planning and or training purposes • Is accessible through the caaspp. org website 25

Preview the Tests 26

Preview the Tests cont. . 27

Interim Assessment Administration 28

Interim Assessment Administration Designated Supports and Accommodations • • Designated Supports Must be designated prior to the first day of testing window Available to ELs for whom the need has been indicated Decision made by educators familiar with the student’s characteristics and needs Supports the student has been using during instruction/assessments Non-embedded supports are to be provided by the school ELs with an IEP or a 504 Plan have to have the designated supports and accommodations listed on the IEP or 504 Plan. 29

Interim Assessment Administration Student Log In Credentials 30

Test Security and Student Log In Credentials Student log in credentials (i. e. . SSID and Confirmation Code) are to be considered secure and confidential information that grant access to a student’s Personal Identifiable Information (Pii). Therefore: • Schools must establish procedures and guidelines to maintain all student log in credentials secure • Schools must train all staff that will be handling student log in credentials on the established procedures and guidelines for maintaining the security of student log in credentials • Schools are to report to the Student Testing Branch if student log in credentials are compromised, using the CAASPP System—Test Administration Testing Incident or Impropriety Report Form located at the Student Testing Branch web site (form is to be faxed to 213 -241 -8461) 31

Interim Assessment Administration Considerations • The performance task is the same for both the ICA and IAB for the same grade and subject (i. e. , grade 3 ELA), . • Each performance task requires administration of a classroom activity 1 to 3 days before the performance task is administered. • Classroom activities and guidelines are available for download on the TA Resources for the Interim Assessments page at caaspp. org. 32

Interim Assessment Administration • Accessing and Administering Interim Assessments • Interim Assessments are administered in the same way as summative tests. The test administrator (TA) must use the TA Interface and the student must log onto the test through the secure browser. 1. Select the [Test Administrator Interface] button on the CAASPP portal at http: //caaspp. org. 2. Log onto the TA Interface using your TOMS sign in credentials. 33

Interim Assessment Administration 3. Select the test to be administered: 34

Interim Assessment Administration 3. Start operational Test Session to obtain “Session ID”: 35

Interim Assessment Hand Scoring 36

Interim Assessment Hand Scoring • Most interim assessment items are scored by the Smarter Balanced test delivery engine. • Hand scoring of constructed-response items and performance tasks is a local responsibility. • Results for individual students are generated only after the constructed-response item scores and performance task scores are inputted into the Interim Assessment Hand Scoring System (IAHSS). (Processing time of up to 48 hours) • Scoring is supported by training guides, rubrics, exemplars (i. e. , anchor and practice papers). 37

Interim Assessment Scoring cont. IABs That Do Not Require Local Hand Scoring • ELA, all grades • Edit/Revise • Listen/Interpret • Research • Mathematics, all grades • All blocks, except Performance Task blocks 38

Training Guides and Exemplars • Training Guides and Exemplars for all constructed response items and performance tasks are accessible in TOMS. • LEAs can access these materials for professional development and training purposes. 39

Videos, Training Guides and Exemplars 40

Interim Assessment Scoring Logging In… The Interim Hand Scoring System is part of the connected suite of Single Sign-On systems (e. g. , TOMS, TA Interface, Completion Reports, etc. ) 41

Hand Scoring System Home Page 42

Scoring Responses 43

Scoring Responses cont. 44

Interim Assessment Hand Scoring Guide The Interim Assessment Hand Scoring System User Guide can be found at the following web link http: //caaspp. org/ta-resources/interim. html 45

Interim Assessment Reporting System 46

Interim Assessment Reporting System cont. … Teachers will use their Digital Library logon credentials to access the Data Warehouse to view Interim Assessment student reports. Requires same logon credentials used for the Digital Library 47

Interim Assessment Reporting System Results • Reports for lists of students and individual student reports. No aggregate reports. • ICA: Overall scale score (i. e. , 2000 to 3000); Achievement Level (Level 1, 2, 3, or 4); and Claim level (Below, At/Near, or Above Standard). • IAB: Level of Below, At/Near, or Above Standard for each Block. • Exportable data file. 48

Interpreting Interim Assessment Results • The extent to which interim assessments were administered under standardized conditions will affect the interpretations. • Interim assessment results should only be used in combination with other evidence of student learning; they should not be the sole basis for making any high-stakes decisions. 49

IA Reporting System Home Page List of Districts 50

“List of Students” Display • Presents the following information listed by individual student name: • Individual results for students within grade or subgroup. • Overall scores, achievement levels, and error bands for individual student performance (ICA only). • Overall individual student performance by claim (ICA) or block (IAB). 51

Interim Comprehensive Assessment List of Students 52

ICA Student Report • Student’s Mathematics and ELA/literacy overall score and achievement level (i. e. , Level 1, 2, 3, or 4) • Overall score is displayed (scale is 2000 to 3000) and surrounded by error bands marked with brackets • Claim level of Below Standard, At/Near Standard, or Above Standard • List of student accommodations 53

ICA Student Report 54

IAB Student Report • Block level of • • • Below Standard At/Near Standard Above Standard • Multiple blocks on the same report • Current and previous results for each block on the same report • Overall scores, error bands, and achievement levels NOT reported for blocks 55

Interim Assessment Block List of Students 56

Interim Assessment Block Student Report 57

Interim Assessment General Information LAUSD –DIVISION OF INSTRUCTION Smarter Balanced Assessment Scoring Training Plan Working with the Los Angeles County Office of Education, the Division is arranging training in Building Educator Assessment Literacy (BEAL) for four 30 -person teams of trainers in each of four areas: Elementary Math, Secondary Math, Elementary Literacy and Secondary Literacy. Using secure SBA items, performance tasks will be examined and implications for instruction will be discussed. The trainers will then be eligible to lead BEAL training of teachers in their local district. 58

Interim Assessment General Information cont. Technology Updates 1. i. OS Upgrade a) DO NOT update any pending i-Pad i. OS upgrade. 2. All testing device carts should be opened, devices accounted for (including keyboards) and charged 3. For technical assistance or issues with testing devices or infrastructure, email or contact: a) Testing Hotline - (323) 224 -2450 i. b) For immediate issues affecting test environment or technical assistance with testing devices ITD Hotline - (213) 241 -5200 i. c) For trouble calls Joe Oliver, Director Information Technology Division 213 -241 -3837 @ joe. oliver@lausd. net i. For assistance with Testing Device Carts or inventory of Testing Devices 59

Interim Assessment General Information cont. Earbuds Smarter Balanced Summative Assessments 2015 -2016 MEMO-6571 The Student Testing Branch will provide schools that are not participating in the i. Pad 1 -to-1 program with earphones for the Smarter Balanced Summative Assessment. Schools will receive earphones to accommodate their student enrollment in grades 3 -8 and 11 two to six weeks prior to the opening of their Smarter Balanced Summative Assessment testing window. 60

Interim Assessment General Information cont. Smarter Balanced Interim Assessments Interim Assessment Viewing System TOMS Test Administrator Interface Interim Assessment Hand Scoring System Interim Assessment Reporting System Primary Use Select to access interim assessments for professional development and/or training purposes. Select to access video demonstrations of interim assessment hand scoring. It includes Training Guides and Exemplars. Select to start a test session, add tests to the session, verify students’ test settings, approve students for testing, and monitor their progress. Select to access Interim Assessment Hand Scoring System to score Smarter Balanced Interim assessment responses that require human scoring. Select to view interim assessment results for tests that have been scored (all required computer-scored and human-scored items must be completed). Log-in Credentials Needed TOMS Credentials Digital Library Credentials Who creates new teacher accounts and reset teacher passwords? Manuals and User Guides CAASPP school coordinator in TOMS Instructions: TOMS: Adding and Managing Users n/a CAASPP school coordinator in TOMS Instructions: TOMS: Adding and Managing Users TOMS: Test Administration Setup Guide CAASPP school coordinator in TOMS Instructions: TOMS: Adding and Managing Users Administration of the Online Interim Tests Resource Guide Interim Assessment Hand Scoring System User Guide Other Resources CAASPP school coordinator in TOMS Instructions: TOMS: Adding and Managing Users ICA number of items and hand scoring requirements IAB number of items and hand scoring requirements CAASPP school coordinator in Digital Library Instructions: SBAC Administration and Registration Tools User Guide Interim Assessment Reporting System Quick Start Guide 61

For More Information CDE Interim Assessments Web Page http: //www. cde. ca. gov/ta/tg/sa/sbacinterimassess. asp ETS CAASPP Web Site http: //www. caaspp. org California Technical Assistance Center (for LEA CAASPP Coordinators) 800 -955 -2954 caltac@ets. org LAUSD Student Testing Branch http: //achieve. lausd. net/testing 213 -241 -4104 Division of Instruction http: //achieve. lausd. net/instruction#spn-content 213 -241 -5333 62