Using the Surveys of the Enacted Curriculum as

Using the Surveys of the Enacted Curriculum as Part of a Larger District and/or School Improvement Effort Lisa Palacios CCSSO, September 2008 Copyright © 2007 Learning Point Associates. All rights reserved.

District and School Improvement Ø As AYP levels increase as we approach 2014, individual schools as well as entire districts will quickly find themselves no longer in good standing. Ø These schools are turning to data to capture evidence of what isn’t working, what is working, and what changes data can drive at the programmatic and instructional levels. 2 www. learningpt. org

Learning Point Associates is a non-profit organization dedicated to helping educators and policymakers improve student learning by equipping them with knowledge and strategies that meet their needs and produce results. www. learningpt. org 3 www. learningpt. org

Background: Corrective Action Ø NCLB requires proficiency in reading & math for all students by 2013 -2014. Ø State Education Agencies (SEAs) define proficiency by establishing Adequate Yearly Progress (AYP) benchmarks. Ø Districts are identified for Corrective Action if they do not meet AYP for 2 consecutive years for one or more subgroups. 4 www. learningpt. org

Background: Corrective Action Ø NCLB calls for SEAs to impose sanctions on Districts in Corrective Action: • Defer programmatic funds or reduce administrative funds; • Institute and fully implement a new curriculum based on State and local content and academic achievement standards • Replace LEA personnel who are relevant to the inability of the LEA to make adequate progress; • Remove individual schools from the jurisdiction of the LEA and arrange for their public governance and supervision; • Appoint a receiver or trustee to administer the affairs of the LEA in place of the and school board; and/or • Abolish or restructure the LEA. 5 www. learningpt. org

NYSED Proposal Ø Under the curriculum option, the New York State Education Department (NYSED) proposed an audit focusing on the alignment of the written, taught, and tested curriculum 6 www. learningpt. org

Research has found that faculty in successful schools always question existing instructional practice and do not blame lack of student achievement on external causes. — Carl Glickman, 2002 www. learningpt. org

Audit Focus Ø Only the subject(s) in which the district has been identified for Corrective Action: • Round 3 = English/Language Arts ONLY Ø Must pay particular attention to specific grade levels and subpopulations not meeting AYP • Special Education • English Language Learners Ø Includes all grade levels K-12. 8 www. learningpt. org

Phase 1 - Planning: Contextualizing the Audit Process Ø Meet with key district personnel Ø Outline audit process Ø Determine district steering committee members Ø Customize timeline Ø Conduct district kickoff meeting Ø Establish site visit schedule 9 www. learningpt. org

Phase 2 - Data Collection: Creating a Picture of the District Ø Classroom Observations Ø Interviews (teachers, principals, district staff) Ø Curriculum Alignment (ELA) Ø Key Document Review Ø Other Data (demographic data, student achievement data, local reports) Ø Surveys of the Enacted Curriculum 10 www. learningpt. org

Surveys of the Enacted Curriculum Ø Online teacher survey Ø Provides visual comparison of classroom instruction to state standards and assessments Ø 30 -minute orientation provided by LPA Ø Survey takes 60 – 90 minutes to complete Ø Maximum teacher participation = valid and reliable data 11 www. learningpt. org

Surveys of the Enacted Curriculum as a New York Audit Data Source Ø Review the curriculum through several different lenses for district improvement: • Written curriculum documents • Teacher interviews • Classroom observations • Enacted curriculum (SEC) Ø Answer a variety of research questions to help identify issues and action plans. www. learningpt. org

How the SEC Data Is Collected and Used Ø Collects teachers’ reflections on classroom instruction. Ø Aggregates data from teachers for districtlevel displays. Ø In groups of three teachers or more, display comparisons with the following: • State standards and/or assessments • District-level groups • Grade-level groups within the district www. learningpt. org

Additional Uses of the SEC Ø Articulation of instruction across grades. Ø Instruction compared with achievement data and student performance. Ø Program evaluation. Ø Never for teacher evaluation. www. learningpt. org

SEC Research Areas for New York Ø Instruction compared to the written curriculum in classrooms. Ø Instruction compared to state standards. Ø Instruction compared to state assessments. Ø Instruction related to research-based practices. Ø Translation of professional development into effective classroom practice. www. learningpt. org

What is the Value of SEC Data? Ø Provide alignment with standards and assessments. Ø Provide application of research-based teaching strategies. Ø Inform professional development initiatives and learning communities. Ø Provide added value to instructional discussions in the context of school improvement. 16 www. learningpt. org

Guiding Questions Ø What areas of the curriculum are most aligned to state Ø Ø Ø standards as indicated by teacher data? Does student achievement data support this? What areas of the curriculum are least aligned to state standards as indicated by teacher data? Is this reflected in student achievement data? Is there sufficient instruction to develop depth of understanding indicated in teacher data? What triangulation can be done using student assessment data, released assessment items and teacher SEC data? Does instructional practice data support best practices? Does alignment suggest a professional development focus? www. learningpt. org

www. learningpt. org

Instructional Strategies Linked to Research Categories of Instructional Strategies that Affect Student Achievement: Ø Ø Ø Ø Ø Identifying similarities and differences Summarizing and note taking Reinforcing effort and providing recognition Home work and practice Nonlinguistic representations Cooperative learning Setting objectives and providing feedback Generating and testing hypothesis Questions cues, and advance organizers www. learningpt. org

22 www. learningpt. org

Phase 3 - Co-Interpretation: What does it all mean? Ø Review emergent themes from data collection (ongoing) Ø 2 -day co-interpretation event with district team and local stakeholders Ø Key findings used to prepare research-based recommendations 23 www. learningpt. org

Phase 4 - Action Planning: A Road Map for District Improvement Ø A co-facilitated process Ø Outcome = district plans that are: • Long-term (3+ years) • Actionable and doable • Compatible with local laws and collective bargaining agreements • Incorporated into District Improvement Plan 24 www. learningpt. org

Questions? 25 www. learningpt. org

Lisa Palacios, Team Lead, Data P: 630 -649 -6601 E-Mail: lisa. palacios@learningpt. org Cary Goodell, Project Lead, New York Audits P: 630 -649 -6692 E-Mail: cary. goodell@learningpt. org 1120 East Diehl Road, Suite 200 Naperville, IL 60563 -1486 General Information: 800 -252 -0283 26 www. learningpt. org