Science Assessment Development and Status Regional Assessment Network

Science Assessment Development and Status Regional Assessment Network Meeting January 18, 2017 Michelle Center, Director Assessment Development and Administration Division TOM TORLAKSON STATE SUPERINTENDENT OF PUBLIC INSTRUCTION

California Science Test (CAST) Overview of the CAST and the CAA for Science 2

California Science Test (CAST) Implementation Timeline Spring 2017 Pilot test (census) Overview of the CAST and the CAA for Science Spring 2018 Spring 2019 Field test (census) Operational administration 3

2017 CAST Full Census Pilot • Participation required for all students in grades five and eight • High school sampling: o All high schools o Each high school assigned a single grade State-level high school sample Grade 12 Grade 11 Grade 10 o All students enrolled in that grade are required to participate Overview of the CAST and the CAA for Science 4

2017 CAST Pilot Purpose • Collect participation status of students • Try out newly developed item types • Test system functionality Overview of the CAST and the CAA for Science 5

CAST Pilot Test Components • Each form will have 12– 15 discrete items, and one performance task. • Student survey: - One survey per student - Approximately three to five questions - No more than seven minutes to complete • Estimated testing time is one hour. Overview of the CAST and the CAA for Science 6

Test Administrator Survey • Collect feedback on the pilot test administration • One survey per Test Administrator • Approximately 10– 12 questions • No more than 15 minutes to complete Overview of the CAST and the CAA for Science 7

CAST Item Writing Challenges • Align to the CA NGSS Performance Expectations – Multidimensional and broad focus of Performance Expectations • Accessibility • Appropriate rigor – Content coverage – Depth of knowledge Overview of the CAST and the CAA for Science 8

CAST Training Test: The Next Step in Developing California’s New Science Test • Educator, students, parents, and stakeholders are encouraged to try out a small number of sample tasks and questions in preparation for the statewide pilot test in the spring. • Training test is tentatively scheduled to be available in early February. • Scoring rubric will be provided. http: //www. caaspp. org/practice-and-training/index. html Overview of the CAST and the CAA for Science 9

Sample Grade Five Performance Task: Segment B Passage Overview of the CAST and the CAA for Science Constructed Response Item 10

Sample Grade Five Performance Task: Drag and Drop—Multiple Section Overview of the CAST and the CAA for Science 11

Sample Grade Eight Discrete Item: Segment A Overview of the CAST and the CAA for Science 12

Sample Grade Eight Discrete Item Student selected “Increases” from drop-down menu for the perch population. The graphs autopopulate for the perch and sea otter populations Overview of the CAST and the CAA for Science Student selected “Decreases” from drop-down menu for the perch population. The graphs autopopulate for the perch and sea otter populations 13

Sample Grade Eight Discrete Item: Drag and Drop Multiple Select Overview of the CAST and the CAA for Science 14

Sample High School Performance Task: Segment B Constructed Response Question Overview of the CAST and the CAA for Science 15

Overview of Accessibility Features • Purpose: Evaluate functionality of some accessibility features • American Sign Language • Text-to-speech • Braille (refreshable and embosser) • Print on demand § Student eligibility will be determined by the accommodations identified as required in the student’s IEP and/or Section 504 plan. Overview of the CAST and the CAA for Science 16

Plan for 2017 CAST Accessibility • Pilot test and field test will include limited accessibility features • Operational test will include a full suite of accessibility features • Operational accessibility features will be determined by CAASPP regulations ₋ CDE will recommend changes to the permanent regulations for State Board of Education approval to begin the rulemaking process in March 2017. Overview of the CAST and the CAA for Science 17

California Alternate Assessment (CAA) for Science Overview of the CAST and the CAA for Science 18

CAA for Science Implementation Timeline Spring 2017 Pilot Test (census) Overview of the CAST and the CAA for Science Spring 2018 Pilot Test (census) Spring 2019 Spring 2020 Field Test (census) Operational Administrati on 19

Benefits of Collecting Embedded PTs • Shows student progress over time when collecting student work samples throughout the school year • Provides an opportunity for students to demonstrate performance “in real time” • Conforms to the principles of universal design • Offers the least restrictive environment for teacher/students to select/produce evidence • Supports the improvement of teaching and learning • Provides a minimally stressful and burdensome process for students • Promotes the delivery of challenging, yet developmentally appropriate, academic content to students Overview of the CAST and the CAA for Science 20

CAA Preliminary CA NGSS Content Core Connectors • Educational Testing Service, in collaboration with their subcontractor ed. Count (the developers of the National Center and State Collaborative Connectors for ELA and mathematics), developed the preliminary CA NGSS alternate summative assessment Content Core Connectors (Connectors) • Purpose of the connectors is to provide learning goals aligned appropriately with the needs of students with the most significant cognitive disabilities • Connectors are posted to the CDE CAASPP California Alternate Assessments Web page at http: //www. cde. ca. gov/ta/tg/ca/documents/ngssaltconnectors. pdf Overview of the CAST and the CAA for Science 21

CAA for Science Pilot Test Overview The CAA for science will be a new type of alternate assessment for science. • The embedded Performance Task will provide the construct being measured and allow flexibility where appropriate. • Tasks are designed to be adjustable according to how each student is taught science concepts. • The embedded Performance Task explains which parts can and cannot be changed by the test examiner. • Remember, this year is a pilot, and we want feedback on… – How it works for your students. – How it works for test examiners. Overview of the CAST and the CAA for Science 22

Grade 5 Example Connector Term Description Performance Expectation: 5 -PS 1– 3. Make observations and measurements to identify materials based on their properties. Connector Classify through observation materials (e. g. , shape, texture, buoyancy, color, magnetism, solubility) by physical properties. Focal Knowledge, Skill, and Abilities FKSA: 1: Ability to classify materials by physical properties. Essential Understanding Match materials with similar physical properties (e. g. , color, hardness, response to magnets). Overview of the CAST and the CAA for Science 23

Example of CAA for Science Overview of the CAST and the CAA for Science 24

Example of CAA for Science Overview of the CAST and the CAA for Science 25

Challenges of Collecting Embedded PTs • Some educators may see the use of the embedded PTs as distinct from the instructional process. • Scoring and professional development activities can be costly. • Extra vigilance is required to ensure technical integrity. Overview of the CAST and the CAA for Science 26

How to Get Involved in the Development of the CAST and the CAA for Science Opportunities for California educator involvement may include: • Item writing • • • Item review Form review Scoring Data review Rangefinding To get involved, complete the content reviewer application at http: //caaspp. org/reviewers. html. Overview of the CAST and the CAA for Science 27