New Standards New Assessments New School Grade Models

New Standards, New Assessments, New School Grade Models, Teacher Evaluations and Performance Pay Tied to New Assessments Kamela Patton, Ph. D. , Superintendent Collier County Public Schools Wednesday, May 7, 2014

Convergence of Five Significant Elements SY 15 CCPS Assessment Program NEW Standards NEW Assessments NEW School Grade Models Evaluations and Performance Pay Tied to New Assessments Collier County Public Schools | www. collierschools. com

Convergence of Five Significant Elements SY 15 CCPS Assessment Program NEW Standards NEW Assessments NEW School Grade Models Evaluations and Performance Pay Tied to New Assessments Collier County Public Schools | www. collierschools. com

SY 15 CCPS Assessment Program LOCAL Quarterly Benchmark Assessments • Statewide EOCs • FCAT 2. 0 Science • FCAT Retakes • FAA • FAIR (72% of pop. ) • CELLA (14% of pop. ) • CELLA F 3 (10% of pop. ) FLDOE • • • Baseline Assmt. DA Req. Benchmark Assmt. DA Req. SAT 10/AGS FLKRS PSAT • PERT • FCAT 2. 0 (R and M) • FCAT Writing INTL. (PISA) Collier County Public Schools | www. collierschools. com STUDENT SELECTED • • • LAFS AIR (3‐ 10) MAFS AIR (3‐ 8) Algebra II EOC Grade 11 ELA EOC Districtwide EOCs in areas not measured by Statewide Assessments NATL. (NAEP)

Statewide Standardized Assessment Program • F. S. 1008. 22 addresses the Statewide Assessment Program • Provision states that the “Participation in the assessment program is mandatory for all school districts and all students attending public schools…” • The mandate is repeated in FS 1008. 22(4): “each public school shall participate in the statewide standardized assessment program. . . ” • Given the statute’s mandatory participation requirement, opting out is not possible • The purpose behind the program includes the ability to provide data relative to whether a student is ready to be promoted to the next grade level or graduate from high school Collier County Public Schools | www. collierschools. com

Convergence of Five Significant Elements SY 15 CCPS Assessment Program NEW Standards NEW Assessments NEW School Grade Models Evaluations and Performance Pay Tied to New Assessments Collier County Public Schools | www. collierschools. com

Shifts in the Language Arts Florida Standards (LAFS) Three Key Shifts: 1. Building knowledge through content‐ rich informational text 2. Reading and writing grounded in evidence from text 3. Regular practice with complex text and its academic vocabulary Collier County Public Schools | www. collierschools. com

Shifts in the Mathematics Florida Standards (MAFS) Three Key Shifts: 1. Concepts are prioritized in the standards so that time and energy spent on content is focused on critical concepts in a given grade (Focus). 2. Think across grades and link to major topics (Coherence). 3. Require fluency, application, and deep understanding (Rigor). Collier County Public Schools | www. collierschools. com

Convergence of Five Significant Elements SY 15 CCPS Assessment Program NEW Standards NEW Assessments NEW School Grade Models Evaluations and Performance Pay Tied to New Assessments Collier County Public Schools | www. collierschools. com

Shifts in State‐wide Assessments • AIR will provide: – English Language Arts assessments in Grades 3‐ 11 with Writing embedded in grades 4‐ 11 – Mathematics assessments in Grades 3‐ 8 • Grade 11 English Language Arts assessment (details forthcoming) • Algebra 2 EOC assessment (details forthcoming) • FCAT 2. 0 science exam in grades 5 and 8 will continue in their current form and structure • State‐wide End‐of‐Course (EOC) assessments for Algebra 1, Geometry, U. S. Civics, and U. S. History will continue in their current form and structure Collier County Public Schools | www. collierschools. com

Shifts in the Construction of State‐wide Assessments Driven by the New Standards FCAT 2. 0 = 2013‐ 14 AIR ASSESSMENT ‐ SY 15 Item Type Minutes Allocated Point Value Selected Response 1‐ 3 Minutes 1 Gridded Response 1‐ 3 Minutes 1 Short Response 3 Minutes 1 Constructed Response 5 Minutes 2 Extended Response 10‐ 15 Minutes 4 Essay Response 20‐ 30 Minutes 6 Performance Task Varies Collier County Public Schools | www. collierschools. com 1‐ 10 (depending on complexity and content area)

Phasing of Statewide and Districtwide Assessment Programs 6. FALL 15 2. SPRING 14 4. SPRING 15 FCAT 2. 0 administered 1 st Field testing of AIR assessment in UTAH Baseline school grades released with New assessment administered Standards setting process in FLORIDA new assessment 2013‐ 2014 2015‐ 2016 2014‐ 2015 1. SUMMER 14* 3. COURSE SPECIFIC EOCs 5. SUMMER 15 School Grades released with current formula and accountability measures. Pursuant to F. S. 11008. 22 Districts begin required administration of assessments for each course offered in the district. District‐wide Assessments 7. SPRING 16 Standard setting begins (cut scores New assessment administered with set)—New baseline set _________________________ consequences Pursuant to F. S. to 1012. 34 and 1012. 3401 the student learning growth portion of teachers’ final evaluations will be based on EOCs directly aligned to courses taught. *Collier County Public Schools | www. collierschools. com Performance Salary Schedule shall be implemented July 1, 2014. Development and payment on this schedule subject to negotiation.

Initial AIR Assessment Timeline Title Description Delivery Date SY 15 Test Administration Schedule The test administration schedule will provide approximate testing windows for the assessments that districts will use to inform their selection of specific test administration dates. May 2014 Computer‐Based Test Transition Schedule This schedule will provides information about the grades and subjects that are scheduled to transition from paper‐based tests to computer‐based tests each school year until all ELA/L and mathematics tests are expected to be administered on computer. CBT Technical Specifications The technical specifications will describe the hardware, software, connectivity and bandwidth requirements for computer‐based testing. Collier County Public Schools | www. collierschools. com

Initial AIR Assessment Timeline Title Description Delivery Date Mathematics Policies and materials specific to the mathematics June 2014 and Materials assessments, such as calculators and formulas, will be provided to guide students and teachers in preparing for the tests. DRAFT Sample Test Sample test questions will be designed to help students Questions and teachers become familiar with assessment question formats and, for computer‐based assessments, to provide practice with the computer‐based testing platform. Test Design The test design summary and blueprints will provide Summary/Blueprints more detailed information about the assessments, including the percentage of items allocated to each content category, cognitive complexity and test duration. DRAFT Test Item Specifications Test item specifications will define the content and format of the assessment and test items. Collier County Public Schools | www. collierschools. com

Initial AIR Assessment Timeline Title Description Writing Rubrics The writing rubrics will the scoring guidelines or criteria July 2014 used to evaluate student responses to the ELA/L writing prompts. Content Focus Reports Content focus reports will define the specific content measured by each test item. These will be provided annually to coincide with the posting of results. Collier County Public Schools | www. collierschools. com Delivery Date May 2015

Convergence of Five Significant Elements SY 15 CCPS Assessment Program NEW Standards NEW Assessments NEW School Grade Models Evaluations and Performance Pay Tied to New Assessments Collier County Public Schools | www. collierschools. com

Current Elementary School Grade Model

Revised Elementary School Grade Model CONCERNS WITH NEW ELEMENTARY MODEL • • Loss of 100 points in model Loss of a single measure that ONLY assesses READING proficiency Writing is now embedded into the ELA assessment (eliminates single WRITING measure) New assessment evaluates student learning through 7 distinctly different items types (selected, gridded, short, constructed, extended, essay, and performance tasks)

Current Middle School Grade Model

Revised Middle School Grade Model CONCERNS WITH NEW MIDDLE SCHOOL MODEL • Loss of a single measure that ONLY assesses READING proficiency • Writing is now embedded into the ELA assessment (eliminates single WRITING measure) • New assessment evaluates student learning through 7 distinctly different items types (selected, gridded, short, constructed, extended, essay, and performance tasks) • U. S. Civics is a new area • Acceleration has vastly changed from providing points for both “PARTICIPATION and PERFORMANCE” to ONLY “ACCELERATION SUCCESS”

Current High School Grade Model 2 4 2 17 Accountability Cells and 9* Bonus Point Opportunities *8 Bonus Point Opportunities = 8 in Other Components and 1 in Retake Bonus

Revised High School Grade Model 11 Accountability Cells and No Bonus Points ‐ Loss of 6 Cells and 80 Bonus Points

Concerns with Revised High School Academic Accountability Components SY 14 School Grade Formula Assessment Components SY 15 School Grade Formula Assessment Components ELIMINATES SINGLE READING MEASURE Both Models Accountability Components are Comprised of 800 Points

Concerns with Revised High School Non‐Academic Accountability Components SY 14 School Grade Formula Other Components SY 15 School Grade Formula Other Components LOSS OF BONUS POINT INCENTIVES Standard Diploma Grads. Only POINT LOSSES • Loss of 600 points within model I. Loss of 80 possible (+5, +10, or ‐ 5) II. Loss of 10 Retake bonus points

Concerns with Revised High School Accountability Components • Loss of 600 points in the School Grade accountability model • Loss of a single measure that ONLY assesses READING proficiency • Writing is embedded into the ELA assessment (eliminates single WRITING proficiency) • New assessment evaluates student learning through 7 distinctly different items types (selected, gridded, short, constructed, extended, essay, and performance tasks)

Concerns with Revised High School Accountability Components • U. S. History shifted from Non-Academic to Academic Components • Major changes in the calculation of graduation rates— shift from four (4) graduation calculations to one (1) calculation (4 Year Rate) with no bonus points and duplication counts across graduation cells • Acceleration calculation vastly changed from providing points for both “PARTICIPATION and PERFORMANCE” to ONLY “ACCELERATION SUCCESS” • No bonus points will be awarded in any category (eliminates incentives)

Current vs. Revised School Grading Scales for SY 15 School Type Elementary Schools Middle Schools High Schools SY 14 800 900 1600 SY 15 700 1000 Difference ‐ 100 +100 ‐ 600 School Grades in SY 15 • A‐F grades based on a percentage of points earned (e. g. , 70%, 80%), rather than a point scale • There would be no new school turnaround options required for one year as a result of the SY 15 baseline School Grades Collier County Public Schools | www. collierschools. com 27

School Grade Models Closing Remarks • Due to more stringent standards, corresponding assessments, and school grade models schools may experience regression as measured by new school accountability formulae • A possible scenario is that student achievement may increase and performance may improve, but school grades may decrease • Today’s A schools may become tomorrow’s B or C graded schools • Could lead to loss of School Recognition Funds (A+ Funds) Collier County Public Schools | www. collierschools. com

Convergence of Five Significant Elements SY 15 CCPS Assessment Program NEW Standards NEW Assessments NEW School Grade Models Evaluations and Performance Pay Tied to New Assessments Collier County Public Schools | www. collierschools. com

Shifts in Assessments Related to Evaluations 1. S. 1008. 22(8), F. S. , requires that the district determine the assessments to use for students’ mastery of content for each course the district offers beginning in the SY 15 school year 2. Pursuant to F. S. to 1012. 34 and 1012. 3401 the student learning growth portion of teachers’ final evaluations will be based on EOCs directly aligned to taught course content (EOCs will either be State or District generated) – The district is charged by statute to choose the assessment or assessments that best fit/s based on the goals for students in the course Collier County Public Schools | www. collierschools. com

Shifts in District‐wide Assessments Driven by Statute • CCPS is must designate assessments for all courses (724 courses to date), to ensure that teachers are evaluated on their OWN students' work in all content areas • Such assessments may include: – statewide assessments – other standardized assessments, including nationally recognized standardized assessments – industry certification examinations – districtwide developed or district‐selected end‐of‐ course assessments Collier County Public Schools | www. collierschools. com

District‐wide Developed Assessments Build Test Maps Item Development • Training as necessary • Quality Checks • Pre, QBAs, Mid‐ Year, Post‐ Assessments • Training as necessary • Quality Checks • Item Writing Training • Item Writing Quality Checks • Final Item Reviews by Coordinators • Ongoing Item Reviews Secure Assessments Report Data in DW • Quality Checks Enter Scores for Open Response Items Create or Adjust Pacing Guides • Training as necessary • Quality Checks Collier County Public Schools | www. collierschools. com Create and Post Assessments • Pre, QBAs, Mid‐ Year, Post‐ Assessments • Training as Necessary • Quality Checks Administer Assessments • Pre, QBAs, Mid‐ Year, Post‐ Assessments • Quality Checks Schedule Assessments • Training as necessary • Quality Checks Staff Training on Administration and Security Procedures

Implications for CCPS • All 724 courses will need varying levels of curriculum development, alignment, materials construction, assessment protocols and procedures • 435 courses will need a Districtwide assessment that will need to be created • Changes to test administration schedules (Mitigate logistical concerns and possible loss of instructional time) Collier County Public Schools | www. collierschools. com SY 14 Course Study Findings

Implications for CCPS • Curricular re‐design and alignment • Changes in teaching and learning practices • Redesign Data Warehouse and all district reporting mechanisms—currently underway • Run and maintain two Data Warehouse sites • Training in assessment creation and administration practices • Infrastructure and device demands—device agnostic platform • Investment in additional staff allocations and hourly labor to support assessment creation requirements (estimated at $1. 5 M) Collier County Public Schools | www. collierschools. com

Implications for Students • Shift to new standards will increase: – expectations for learning – need for remediation – time spent on testing • Shift in promotion and graduation requirements: – Students entering 3 rd grade in SY 15, will be required to achieve a passing score on the 3 rd grade LAFS assessment – Students entering 10 th grade in SY 15 will be required to achieve a passing score on the LAFS and Algebra I assessments – Students in grade 10 who fail the Reading FCAT 2. 0 must retake the Reading FCAT 2. 0 assessment until it is passed Collier County Public Schools | www. collierschools. com 35

Districtwide Assessments Project • • • Began Assessment Project in Fall 2013 Project is comprised of developing: – Curriculum Pacing Guides – Assessment Blueprints – Assessment Item Creation – Data Warehouse Reconstruction – Creation of New Data Reports Significant training and staff development – Engaged FDOE for on‐site staff training and technical support – Over 200 staff members have been trained and will be contributing to this project Collier County Public Schools | www. collierschools. com

Districtwide Assessments Project – Working with consortia to limit unnecessary duplication of effort – Securing vendors for outsourced work (e. g, Photocopying of Assessments, Items for “Hard‐to‐ Measure” assessments, Data, Statistical, and Psychometric services) – Currently seeeking to hire a Psychometrician to assure that all assessments are valid Collier County Public Schools | www. collierschools. com

Closing Remarks • Implementation timeline is unrealistic, under resourced, and unfunded • Challenging assessment landscape • Lack of direction, support, and/or relief from FLDOE • Concerned of the negative effect assessments will have on instructional time, stakeholder morale, and student scheduling • Empathy and understanding of stakeholders’ concerns/ issues Collier County Public Schools | www. collierschools. com

New Standards, New Assessments, New School Grade Models, Teacher Evaluations and Performance Pay Tied to New Assessments Kamela Patton, Ph. D. , Superintendent Collier County Public Schools Wednesday, May 7, 2014