Unified Improvement Planning Basics II Action Planning October
Unified Improvement Planning Basics II: Action Planning October 2013
Introductions § Name § Role § School/District § What are you most excited to learn about today? 2
Today’s Session § Objectives: § Understand the fundamentals of the action planning steps of the Unified Improvement Planning process. § Understand the elements that support UIP. § Understand expectations and processes for target setting. § Understand expectations for major improvement strategies, including action steps, key logistics and implementation benchmarks. § Time to consider planning needs at the local level.
Topics § UIP Overview § Purpose § UIP Resources § UIP Process § Reviewing Previous Steps (Data Analysis) § Annual Performance Targets § Interim Measures § Major Improvement Strategies § Action Steps, including Timeline, Key Personnel, Resources § Implementation Benchmarks § Reflection and Local Planning 4
What is Unified Improvement Planning? Alignment A system to align improvement planning requirements for state and federal accountability into a “single” plan. A common format for schools and for districts to document improvement planning efforts. Schools/districts on accountability clock must Documentation demonstrate a coherent plan for dramatic change and adjustments over time. Reviews conducted by CDE and the State Review Panel. Transparency A process for including multiple voices, including staff, families and community representatives. Plans are also posted publicly. Best Practice A statewide strategy to promote improvement planning based on bestpractice, including use of state and local data and engagement in a continuous improvement cycle. Support A mechanism for triggering additional supports through CDE (especially for schools/districts on accountability clock).
Continuous Improvement
Unified Improvement Planning Processes Preparing to Plan Gather and Organize Data Section III: Data Narrative Review Performance Summary Section IV: Target Setting Describe Notable Trends Ongoing: Progress Monitoring Section IV: Action Planning Prioritize Performance Challenges Identify Root Causes Set Performance Targets Identify Major Improvement Strategies Identify Interim Measures Identify Implementation Benchmarks
Components that support UIP 8 Template Addenda Quality Criteria Handbook
UIP Template & Addenda § Layout designed to explicitly guide schools and districts through a focused planning process § Pre-populated report § Flexibility to “tell your local story” § Addenda created to support schools and districts in meeting specific program requirements § Unified ≠ Simplified
Section I State + Federal Performance Data Section II Grant Info Contact Improvement Plan Info Section III Data Narrative Data Used Notable Trends Priority Performance Challenges Root Causes Processes Used Section IV School Target Setting Form Priority Performance Challenges Targets Interim Measures Major Improvement Strategies Review Progress on Last Year’s Targets Action Planning Form Worksheet Major Improvement Strategies Data Worksheet Associated root causes Notable Trends Action Steps Priority Performance Timeline Challenges Key People Root Causes Resources Implementation Benchmarks Status of Action Steps
Quality Criteria § Identify elements in a quality plan - makes clear standard for proficiency § Developed in conjunction with district leaders § Identifies program requirements to be met in each section of the plan § Basis for review by CDE
UIP Handbook § Provides the guidance for the process § Includes as glossary to serve as a reference for the terminology used in the UIP process § Includes helpful hints for the process 12
UIP Big Idea: Timeframe § The UIP should be a two year plan that gets revised on at least an annual basis § Revision process should be updated with current information, then planning projected out § Modifications should be made based on determinations from data (interim measures/implementation benchmarks) Notable Trends, Priority Performance Challenges Root Cause Analysis What has been happening? 2010 2011 2012 ? Where do we need to go? 2013 Interim Measures, Implementation Benchmarks Target Setting, Action Planning 2014 2015
Topics § UIP Overview § Purpose § UIP Resources § UIP Process § Reviewing Previous Steps (Data Analysis) § Annual Performance Targets § Interim Measures § Major Improvement Strategies § Action Steps, including Timeline, Key Personnel, Resources § Implementation Benchmarks § Reflection and Local Planning 14
Previous Steps: UIP Basics Part I Preparing to Plan Gather and Organize Data Section III: Data Narrative Review Performance Summary Section IV: Target Setting Describe Notable Trends Ongoing: Progress Monitoring Section IV: Action Planning Prioritize Performance Challenges Identify Root Causes Set Performance Targets Identify Major Improvement Strategies Identify Interim Measures Identify Implementation Benchmarks
Continuous Improvement Decision Point Revise current Action Plan Develop New Action Plan • To what degree have your priority performance challenges changed or remained the same? • To what degree have your root causes changed or remained the same? • What degree of buy-in from the staff on the current plan? 16
Relationship of Accountability to Unified Improvement Planning Preparing to Plan Gather and Organize Data Section III: Data Narrative Review Performance Summary Section IV: Target Setting Describe Notable Trends Ongoing: Progress Monitoring Section IV: Action Planning Prioritize Performance Challenges Identify Root Causes Set Performance Targets Identify Major Improvement Strategies Identify Interim Measures Identify Implementation Benchmarks
Read: Target Setting (p 22) to Interim Measures Handbook Reading 18
Target Setting § In what performance indicators is the school/district not at least meeting state expectations (there should also be identified priority performance challenges for these performance indicators)? § What is the state measure/metric being used? § What comparison point is being considered (e. g. “meets” state expectations, district average, “exceeds” expectations, etc. )? § What other measures/metrics may be considered on an annual basis (k-2, non-tested subjects, etc. )? 19
How to Set Performance Targets Focus on a priority performance challenge Determine a comparison point (expectation against which current performance is compared) Determine a time frame to meet expectations Determine progress needed in the next two years Describe annual performance targets for two years
Consider Minimum State Expectations § Provided in the Performance Framework Reports § The value for which a rating of “meets” would be assigned for the state metric in each sub-indicator area. § Academic Achievement: the 50 th percentile of % proficient or advanced for Colorado schools. § Academic Growth and Growth Gaps: MGP of 55 if MGP is < AGP, and 45 otherwise. § Postsecondary and Workforce Readiness: Graduation rate at or above 80%, Drop-Out rate at or below the state average, and Colorado ACT Composite Score at or above the state average.
What is the target? 68 Things to consider about Targets: § What is being measured? § Is it specific enough to know if the target has been achieved? § Is it ambitious, yet attainable?
Relationship of Accountability to Unified Improvement Planning Preparing to Plan Gather and Organize Data Section III: Data Narrative Review Performance Summary Section IV: Target Setting Describe Notable Trends Ongoing: Progress Monitoring Section IV: Action Planning Prioritize Performance Challenges Identify Root Causes Set Performance Targets Identify Major Improvement Strategies Identify Interim Measures Identify Implementation Benchmarks
Interim Measures § Interim measures must be identified for each target. § Data from interim measures should be available more than once during the school year. § Across all interim measures, data should be available that would allow schools to monitor progress at least quarterly. § Examples: District Benchmark Assessment, NWEA MAPS, Galileo, Acuity, DIBELS, commonly administered end-of-unit assessments § Measures, metrics and availability should be specified in the School Goals Form.
How do Performance Targets Shape Interim Measures Interim measures should: § Provide data several times during the school year about the degree to which progress is being made towards each performance target. § Provide data about the same students as the performance target § Provide data about the same content focus.
Interim Measures: Is there enough detail to identify if progress is being made? Considerations: Frequency of administration? What changes would you expect to see to make your target? Does DRA 2 measure math performance? Will DIBELS tell you if you are addressing your Priority Performance Challenges for 4 -6 th grade students?
Alignment: Priority Performance Challenges and Targets 27
Target Setting Activity § What are some targets would you consider for this sample Priority Performance Challenge with this SPF: § 28 Math achievement and growth (and for all student groups) and for all has been low and flat for the last three years, not increasing above 60% proficient and advanced, with MGP not exceeding 51%.
N=107, MGP 44, MAGP 52 N=37, MGP 51, MAGP 86 29 What targets would you consider for this sample PPC: Math achievement and growth (and for all student groups) and for all has been low and flat for the last three years, not increasing above 60% proficient and advanced, with MGP not exceeding 51%.
Description: What is needed? Skills, Resources, Time Held Timeframe: What is the deadline/timeframe in which the actions need to happen? People Involved: Which stakeholders need to be involved or communicated with. Consider: • Teachers • Parents • Students • School Accountability Committees • Board Members (District or Charter) • Community 30 Reflection: Target Setting Next Steps: What actions need to happen?
Unified Improvement Planning Preparing to Plan Gather and Organize Data Section III: Data Narrative Review Performance Summary Section IV: Target Setting Describe Notable Trends Ongoing: Progress Monitoring Section IV: Action Planning Prioritize Performance Challenges Identify Root Causes Set Performance Targets Identify Major Improvement Strategies Identify Interim Measures Identify Implementation Benchmarks
Reviewing Prior Year Major Improvement Strategies With your team, discuss the following questions: § How successful have our major improvement strategies from last year been at improving our performance in prioritized areas? § To what degree have our prior year major improvement strategies been implemented? § To what degree are our existing major improvement strategies likely to eliminate the root causes of our updated priority performance challenges?
Reviewing Prior Year Major Improvement Strategies § Identify for each Major Improvement Strategy: § Continue, just update status of action steps. § Continue, with modification to action steps. § Do not continue.
Identifying New Major Improvement Strategies 1. Focus on a priority performance challenge and the root cause(s). 2. Consider research. 3. Identify a desired future (if action is taken to dissolve root cause(s), from the perspective of various local stakeholders). 4. Identify strategies to get to the desired future. 5. Articulate a Theory of Action (If, then, and). 6. Re-write as a major improvement strategy.
Additional Information to Consider § CDE provides a variety of resources and technical assistance related to areas where schools and districts may have performance gaps. English Language Learners Walk Through and Program Review Tool Positive Behavior Implementation Support Implementation Policies and Practices Related to Student Failure and Dropping Out: Tools and Resources Rt. I Implementation Rubrics Self-Assessment for Building a Healthy Human Capital System in Schools and Districts TELL Colorado § Are there resources available that should be considered?
Example: Data Source for Action Planning § How could this self-assessment be used to develop action steps? 36
Factors to consider in Action Plan § School Demographics: Are there specific needs for student groups (i. e. action steps to support needs of English Language Learners are identified) § Progress monitoring built into action steps § Stakeholder groups within action plan 37 § What steps will ensure MIS are effective for student populations? § How will both student performance data and implementation benchmarks be examined in an ongoing way? § Do different stakeholders take different actions (parents, teachers, BOCES staff? )
Action Steps § Cumulative effect of action steps will lead to implementation of Major Improvement Strategy § Each step associated with key personnel, timelines and resources § Possible to “check off”- yes, we did it! 38
Unified Improvement Planning Preparing to Plan Gather and Organize Data Section III: Data Narrative Review Performance Summary Section IV: Target Setting Describe Notable Trends Ongoing: Progress Monitoring Section IV: Action Planning Prioritize Performance Challenges Identify Root Causes Set Performance Targets Identify Major Improvement Strategies Identify Interim Measures Identify Implementation Benchmarks
Implementation Benchmarks § Measures implementation § How will we know we are implementing the action plan well? § Tend to fall into two categories: § Output- trainings held, walkthrough document developed, hiring criteria identified § Outcome- Teachers will score student writing samples with 95% consistency on writing rubric by December 2014, 90% of classroom walkthroughs will exhibit use of formative assessment practices by April 2014. 40
Action Plan Activity 41
Implementation Benchmarks: How do you know? Artifacts of implementation, but not the impact or effectiveness of their implementation. More specific implementation benchmarks allow school staff to determine whether identified action steps are making being implemented with fidelity so they can be associated with student learning. Consider: Classroom observations indicate 100% use of cooperative learning structures by May 2013. 42
Description: What is needed? Skills, Resources, Time Protected, etc. Timeframe: What is the deadline/timeframe in which the actions need to happen? People Involved: Which stakeholders need to be involved in development and/or communication. Consider: • Teachers • Parents • Students • School Accountability Committees • Board Members (District or Charter) • Community 43 Reflection: Major Improvement Strategies Next Steps: What actions need to happen?
Unified Improvement Planning Preparing to Plan Gather and Organize Data Section III: Data Narrative Review Performance Summary Section IV: Target Setting Describe Notable Trends Ongoing: Progress Monitoring Section IV: Action Planning Prioritize Performance Challenges Identify Root Causes Set Performance Targets Identify Major Improvement Strategies Identify Interim Measures Identify Implementation Benchmarks
Topics § UIP Overview § Purpose § UIP Resources § UIP Process § Reviewing Previous Steps (Data Analysis) § Annual Performance Targets § Interim Measures § Major Improvement Strategies § Action Steps, including Timeline, Key Personnel, Resources § Implementation Benchmarks § Reflection and Local Planning 45
Plan Development and Revision § Who will write the plan? § How can feedback on the plan be gathered and incorporated? § How will the plan contents be reviewed with key stakeholders? § How will plan results (implementation and outcomes) be monitored and communicated to key stakeholder groups: § Teachers § SAC/DAC/Board § Parents/Community 46
Wrap up & feedback § Please provide us with feedback using post-it notes at your table - Things that worked well for this session - Things that we should change - Questions you still have - A-ha’s from today’s session
- Slides: 47