Training Tests Practice Tests and Interim Assessments What

Training Tests, Practice Tests, and Interim Assessments What? Who? Why? When? Where? and How?

The “Big” Picture Common Core aligned instructional programs Common Core State Standards specify K-12 English Language Arts and Mathematics expectations for college and career readiness Digital Library Tools and resources to support the formative assessment process Teachers and schools have the information and tools they need to align teaching and learning Interim Assessments Flexible and open assessments used for actionable feedback Training Tests Practice Tests All students leave high school college and career ready Summative Assessments: College and career readiness assessments for accountability

“Your Assessment One Stop Shop” http: //www. alohahsap. org 4

Accessing Resources and Tools www. alohahsap. org should be your go to site for information, tools, and resources for our Smarter Balance Assessments. › There are many valuable resources that can be found at www. smarterbalanced. org but keep in mind that the “Hawaii documents” may differ and supersede information on the

Purposes of This Session This session will include: – an overview of the Smarter Balanced Training Tests; – an overview of the Smarter Balance Practice Tests; and, – an in-depth look at the Smarter Balanced Interim Assessments, including: – the Interim Comprehensive Assessment – the Interim Assessments Blocks

Training and Practice Tests › What ? The Training Tests are designed to provide an opportunity for users to familiarize themselves with the software, navigational tools and the item types that make up the Smarter Balanced Assessments. These are organized by grade bands and contain 6 to 10 items. The Practice Tests include about 30 items similar to the Interim and Summative Assessments as well as performance tasks at each grade level. There also classroom activities to be completed before each of the performance tasks. › Who? The primary audience is students although it is also beneficial for teachers to be aware of the types of items students may encounter during Smarter Balanced Assessments. The training and practice tests can also be accessed by parents and community members. › Why? The Training Tests allow students to become familiar with the assessment software, tools, etc. , so that they can focus on the content and responding when participating in the Practice Test and Interim and Summative Assessments. The Practice Tests give students an opportunity to experience and become comfortable with a “full” Smarter Balanced Assessment, including the universal tools and, if administered using the secure browser, the designated supports and accommodations.

Training and Practice Tests › When? The Training Test should be completed by all students before taking the Practice Test or any other Smarter Balance Assessment. The Practice Test should be used after completing the Training Test and prior to the Interim or Summative Assessments. › Where and How? The Training Test and the Practice Test can be conducted in a testing session administered by a Test Administrator using the secure browser or in a “guest session” using any browser (see tech specs for further information) from any location. Keep in mind that the universal tools are always available but the designated supports and accommodations are only available in a proctored session using the secure browser. administered using the secure browser › Notes Regarding the Training Test: – There is no answer key or scoring for the training test. – There are no performance tasks included in the training tests. – All universal tools and some designated supports are available in guest sessions. Additional designated supports and accommodations are available in TA proctored sessions. › Notes Regarding the Practice Test: – Although not scored, classroom activities, scoring guides and rubrics for ELA performance task writing are available. The Practice Tests are not “secure tests” so, following completion of a practice test, teachers can engage their students in reflective discussions about the content and expectations they encountered. In a similar way, individual teachers or peer teams can use the Practice Test experience to deepen their understanding of the Common Core State Standards, the Smarter Balanced assessments, and aligned teaching and learning. – If administered as a proctored session using the secure browser, they provide an opportunity for Test Coordinators and Test Administrators gain valuable experience in a “low-stakes” situation.

Practice Test Resources › The Training and Practice Tests should be accessed through www. alohahsap. org › The Smarter Balanced Practice Test website (http: //sbac. portal. airast. org/practice-test/resources) contains the following resources: – Practice and Training Test Manual and Users Guide – Classroom Activity Administration Guidelines – Classroom Activities – Scoring Guides – Performance Task Writing Rubrics – Elementary Writing Fact Sheet

From the Student/Guest Perspective

From the TA Perspective in TA Training Site Session ID #s will be longer

Let’s “Take 5” for questions before we move on!

Interim Assessments Now Available !! January 26, 2014 13

Interim Assessments › What? The Interim Assessments are intended to support teaching and learning by gauging student progress towards attaining the knowledge and skills called for in the Common Core State Standards they will be measured by the Smarter Balanced Summative Assessment. – The Interim Comprehensive Assessment (ICA) is a complete assessment based on the Summative Assessment blueprint including: Computer Adaptive Test Classroom Activities Performance Tasks. (All Currently Available) – The Interim Assessment Blocks (IABs) are shorter, focused assessments that provide more detailed information for instructional purposes. (Available by January 30) (Only a limited number available this year) › Who? Grades 3 -8 and high school are supported. At the high school level, the assessments are consistent with the grade 11 summative design and may be administered in grades 9, 10, 11, and/or 12. › Why? The Interim Assessments (ICA and IABs) provide both students and teachers with an indication of progress towards meeting the Common Core State Standards. The results can be used to inform instruction and target areas in need of improvement prior to the Summative Assessment.

Interim Assessments…. What the Interim Assessments are NOT…. . The Interim Assessments are intended to support teaching and learning by gauging student progress. They are: › Not public and should not be shared or reproduced. › Not intended for use in instruction. Other Resources that can be shared, used in instruction, etc. : 1. Training and Practice Tests 2. Teaching strategies and formative assessments in the Digital Library 3. Sample Items and Tasks released by Smarter Balanced www. smarterbalanced. org >>> Smarter Balanced Assessments >>> Sample Items and Performance Tasks 4. Commissioned Performance Task Examples available from the SB CAST members. 5. SB Item Specifications – available by content area, claim, and grade level The item specifications explain the content for each target area, task models, example items and rubrics covering the entire “realm of possibility” for the assessment. (These were used by all of the item developers) www. smarterbalanced. org >>> Smarter Balanced Assessments >>> Item Writing and Review >> Click on

› When? The ICA can be administered at either the classroom or school level one or more times during the school year to determine students’ overall progress. › The IABs can be administered as pre- and/or post-assessments in the classroom in conjunction with the corresponding units of instruction. Where and How? Both the ICA and IABs can only be administered in a proctored test session set up by a certified Test Administrator using the HISecure Browser. TA Certification Course can be found on www. alohahsap. org under TA Training. ICAs and IABs are administered using the TA Live Site *Due to the timeframe and the fact that the Interim Assessments are fixed form this year, students will be limited to two opportunities for the ICA and for each available IAB

Interim Comprehensive Assessment › The ICA will mirror the content of the summative assessment in the spring. They will: › have the same range of standards as the summative assessment. › include the same item types and formats as the summative assessment such as selected response, technology-enhanced, and constructed response. › provide overall scale scores, performance level designations, and claim-level information similar to the summative assessment. › The ICA is a “complete assessment” that matches the blueprint of the summative assessment including ELA and Math: › Computer Adaptive Components › Pre-Performance Task In-Class Activities › Performance Tasks › Test questions are not secure but also not publically available. Teachers will have access to the items (Teacher access and/or creation of currently in take the a pdf available from a password protected location is development) and students may have 2 opportunities to assessments.

Administering the ICA › The ICA is administered in the same way as the summative assessment. The assessment session: › Is set up by the teacher as test administrator(TA) using TIDE. › Requires students log in using their SSID through the secure browser. › Has the TA verify/set-up appropriate accommodations and accept students into the session. › All universal tools, designated supports and accommodations will be available. › The anticipated time to complete the assessments is the same as the summative assessment. › TAs must complete the Certification Course before administering an Interim Assessment (www. alohahsap. org ) › The HISecure Browser 7. 2 must be used for the Interim Assessment (www. alohahsap. org) (Do not use the browser from www. smarterbalanced. org) PAGE 18

Information and Supports for ICAs The SB TAM applies to both the Summative and Interim Assessments

From the TA Perspective once again… • • Gr 3 Gr 4 Gr 5 Gr 6 Gr 7 Gr 8 Gr 11 High School • • Algebra II Biology ELA Math Science U. S. History • EOC Assessments • HAS Science • Smarter Interim Comprehensive CAT • Smarter Interim Comprehensive Performance • HSA-Alt will be added If you select ICA CAT…. ICA-G 11 E-11 ICA-G 11 M ICA-G 3 E-ELA-3 ICA-G 3 M ICA-G 4 E ICA-G 4 M ICA-G 5 E ICA-G 5 M ICA-G 6 E ICA-G 6 M ICA-G 7 E ICA-G 7 M ICA-G 8 E ICA-G 8 M If you select ICA Performance… ICA-G 11 E-Perf ICA-G 11 M-Perf ICA-G 3 E-Perf ICA-G 3 M-Perf ICA-G 4 E-Perf ICA-G 4 M-Perf ICA-G 5 E-Perf ICA-G 5 M-Perf ICA-G 6 E-Perf ICA-G 6 M-Perf ICA-G 7 E-Perf ICA-G 7 M-Perf ICA-G 8 E-Perf ICA-G 8 M-Perf Note: TAs and students must also be careful to select the correct assessment if multiple assessments are offered in the same testing session.

ICA Reporting › Students will receive scores if the entire assessment (the CAT and performance task) is completed. Note 1: The assessment provides information to inform instruction and should not be used for accountability purposes. Note: 2 Some items on the ICA require hand scoring. › The ICA will yield overall scale scores (on the same vertical scale as the Summative assessment), overall performance level designations, and claim-level information. › Claim-level information results will be reported as “Below Standard, ” “At/Near Standard, ” and “Above Standard”. › ICA results will be available through the Online Reporting System at www. alohahsap. org PAGE 21

ICA Scoring › All items on the assessment, including the performance task, must be completed by a student and scored before the student’s results are available. › Most items in the ICA will be scored via the computer. › Constructed response items within the CAT portion of the ICA and the ICA Performance Tasks require hand scoring at the school level. This scoring must be completed for students results to become available. › A variety of resources are available to support hand scoring. These include: – An ICA Constructed Response Scoring Manual. (http: //www. smarterbalanced. org/smarterbalanced-assessments/ Bottom of page) – A recorded Hand Scoring Training webinar. – Scoring rubrics accompanied by exemplars and anchor papers. – An on-line Interim Teacher Hand Scoring System.

Teacher Hand Scoring: How Much? › ICA: – ELA has about 50 items in total. › 3 short answers in CAT will require hand scoring. › 2 short answers and 1 essay in the Performance task will require hand scoring. – Mathematics has about 38 items in total. › Grades 3 to 8 have no items in CAT will require hand scoring. High school has 1. › 2 -4 short answers in the Performance task will require hand scoring

ICA Teacher Hand Scoring System › The Teacher Hand Scoring System (THSS) is secure. Scorers use their TIDE usernames and passwords. Student Completes ICA TA receives notification of items to score › Any educator who meets the qualifications to be a TA can serve as a scorer. Scoring › The system includes: Scoring rubrics Exemplar responses Training Guides The prompt and/or stimuli to which a student is responding. – The student’s response › The THSS process: – When a student submits an assessment, the student responses to constructed response items will be available in the THSS for scoring. – The TA enters the THSS and either scores the item or assigns it to another scorer (This is a school decision). – The scorer reviews the rubric, exemplars, and student work then assigns a tentative score. – Tentative scores are confirmed and submitted. – Once all of a student’s constructed response items are scored overall results will be available in the ORS. § A school or complex area may opt to have a “Score Manager (TC or Administrator) oversee/monitor the scoring through the THSS. Score Manager Oversight (optional) – – Assigned to Peer TA Scored Team Scoring Review of Scoring Rubrics Review of Exemplars Rating of Student Work Tentative Score Entered Scores Confirmed All Items Have Confirmed Scores Hand-Scored and Machine. Scored Merged, Processed Student Results available in ORS

Inside the THSS TA will see ICA Tests and Sessions they have administered Score Manager may score or reassign items from any ICA at the school TA may opt to score or reassign items to other teachers

1. Study Rubric and Description 2. Review Exemplars 4. Enter Student Score and push submit at the bottom of the page. 3. Rate Student Response

› At this point either the TA or Score Manager can “Mark Selected as Complete” and the scores are entered in “the system”. › Once all constructed response items are scored, the students’ results will appear in the ORS. Note: Multiple student responses may be assigned to scorers or “Marked as Complete” at the same time.

Interim Assessment Blocks (IAB) IABs focus on smaller sets of targets and provide more detailed information for instructional purposes. The IABs yield overall information for each block. They › Include the same item types and formats, including performance tasks, as the summative assessments. › Provide teachers with information about a student’s strengths or needs in a particular area. › Focus on content across grade levels and may, at the high school level be used in grades 9, 10, 11, and/or 12. › During 2015, the ICA and IABs will contain overlapping item banks. Therefore students who take the ICA and IABs more than once, or who take both the ICA and IABs in the same grade levels and content areas will see the same items more than once.

IAB Administration and Reporting › IABs are administered by a Test Administrator using the Secure Browser like the Summative and ICA assessments. › Some IAB’s, including the Performance Tasks, require hand scoring using the THSS. – ELA has about 15 items in total (Brief Writes have 6 and the Performance Tasks have the essay). › 1 to 2 short answers in CAT will require hand scoring. › 2 short answers and 1 essay in the Performance task will require hand scoring. – Mathematics has about 15 items in total. › No items in non-performance Task IABs will require hand scoring. › 2 -4 short answers in the Performance task will require hand scoring. › Student results on each IAB will be reported as “Below Standard, “At/Near Standard, ” and “Above Standard”.

ELA/Literacy IABs GR 4 & 5 GR 3 Not available in 2015

Mathematics IABs High School Not available in 2015

Questions ?

Assessment Section Contact Paul Dumas Paul_Dumas@notes. k 12. hi. us https: //intranet. hawaiipublicschools. org/offices/osip/aa/ http: //alohahsap. org