Educator Performance Evaluation Office of Educator Effectiveness January

Educator Performance Evaluation Office of Educator Effectiveness January 31, 2013

Agenda for today Successes & challenges Resources Formative Assessments Problem Solving

Where we are today 5, 079 licensed educators 82% have goals & action steps approved 6, 103 observations logged in EDFS 21, 133 artifacts uploaded in EDFS 285 formative assessments have been started

Nice work! 90 - 100% of goals and action steps have been approved at: Bradley Elementary Hurley K-8 Mildred Avenue K-8 Mc. Kinley Middle Tech Boston Academy Tobin K-8 Condon Elementary Winship Elementary Winthrop Elementary Excel High School Charlestown High Beethoven Elementary Everett Elementary Grew Elementary Sumner Elementary Ohrenberger Elementary Philbrick Elementary Dever Elementary Murphy Elementary S Greenwood K-8 Mozart Elementary Holmes Elementary Otis Elementary Boston Evening Academy BCLA Kenny Elementary Burke High Henderson Elementary Rogers Middle The Harbor School Latin Academy Bates Elementary Lyndon K-8 Another Course To College Lee Academy Umana Middle Mendell Elementary Trotter Elementary Gardner Pilot Academy Blackstone Elementary Carter Center Haynes EEC Roosevelt K-8 Warren/Prescott K-8 Boston Latin Lee Elementary CASH

Way to go! Every educator has received feedback through EDFS at: Bradley Elementary Charlestown High Philbrick Elementary Mozart Elementary Roland Hayes Middle School Academy Sumner Elementary Tobin K-8 CASH Holmes Elementary Otis Elementary Beethoven Elementary Bates Elementary Everett Elementary Rogers Middle Murphy Elementary Gardner Pilot Academy Marshall Elementary Winship Elementary Fifield Mckay Elementary Condon Elementary Umana Middle West Zone ELC S Greenwood K-8 Conley Elementary Curley K-8 Latin Academy

To Do List: Approve goals & action plans ASAP Log observations & artifacts in EDFS Schedule & complete Formative Assessments

We Hear You We know the EDFS statistics do not reflect all of the work you are doing. We know the system needs to be improved. Developers are working hard on making EDFS more reliable.

Resources: Artifacts Breakdown of Artifacts by Standard (n=20, 877) 60% 53% 51% 50% 37% 40% 30% 27% 20% 10% 0% Standard III Standard IV

Resources: Artifacts

Resources: Artifacts Standard III Standard IV • Unit plans & assessments • Lesson plans • Data made public to students • Class activities/ assignments • Data analysis • Plans for re-teaching • Exemplars • Rubrics • Differentiated instructional plans & materials • Class routines, rules, norms • Student work samples • Letters & emails to families • Invitations to participate in class activities • Progress reports • Log of contact with families • Family surveys • Thoughtful selfassessment, goals, & action plans • Reflection on participation in PD • Reflection on leadership role • Records of participation in team meetings

Resources: Prescriptions Breakdown of Prescriptions by Standard (n=516) 35% 30% 25% 20% 15% 32% 10% 16% 19% 5% 0% I. Curriculum, Planning and Assessment II. Teaching All Students III. Family and Community Engagement IV. Professional Culture

Resources: Prescriptions Standard III Standard IV -Teacher X must post daily content and language objectives in student friendly language. -Teacher X needs to create a - Make at least three calls -Teacher X should be sure to classroom management plan that addresses and reduces the off-task behaviors that are occurring in the classroom. home per week to the families of students in your classes to update them on their progress. Be sure to note these calls in your Call Log submit work in a timely manner. She should contact her supervisor in advance of deadlines if she needs extra time or support with completing any work related tasks.

Resources: Claims Standard III Standard IV

Formative Assessments: The Basics Mid-cycle, no hard deadline Teachers should have advance notice Ratings on each goal and standard inform an overall rating Overall rating may lead to a change in plans

Formative Assessments: EDFS Can start & and save it before releasing Info from observations & artifacts will be at the bottom of the screen Ratings of “Needs Improvement” & “Unsatisfactory” require prescriptions Releasing will send an email to the educator; they have 5 days to comment

Formative Assessments: Guiding Principles Rationales for ratings should include: Claim about performance Connection to the rubric Evidence from observations & artifacts

Formative Assessments: Guiding Principles Evidence accumulates throughout the year If formative is thorough, summative may not be very different If formative is brief, summative should have more evidence

Formative Assessments: Examples Read through the ratings and rationales for Standard II in each examples. Identify the claims in each What similarities and differences do you notice?

Formative Assessments: Comparing the Examples Looking at each rationale for Standard II, Does it include…? o Claim about performance o Connection to the rubric o Evidence from observations and/or artifacts

Pop Quiz! Work with the people around you to check your understanding of some of the details of the evaluation process.

Pop Quiz! 1. True 2. I. Curriculum, Planning & Assessment II. Teaching All Students III. Family and Community Engagement IV. Professional Culture 3. False 4. Exemplary, Proficient, Needs Improvement, Unsatisfactory 5. False 6. Timing & implications 7. True 8. False 9. Progress toward… Proficiency in… Student Learning Goal Professional Practice Goal + I. Curriculum, Planning & Assessment II. Teaching All Students III. Family & Community Engagement IV. Professional Culture = Overall Rating

Problem Solving: Top 10 Questions #10: What should I do if the Formative Assessment is extremely late? Write and release the Formative Assessment anyway, and then complete the Summative by the plan’s end date. Accept the probability that it will be grieved by the teacher.

Problem Solving: Top 10 Questions #9: What happens I give someone on a Self-Directed plan an overall rating of “Needs Improvement” or “Unsatisfactory” at the Formative Assessment? The teacher can continue on the Self-Directed plan until the Summative Evaluation. OR You can end the current Self-Directed plan create a new plan. The teacher may be placed on a Directed Growth Plan or an Improvement Plan.

Problem Solving: Top 10 Questions #8: If I start someone on a new plan now, how long should it last? A new plan will require another self-assessment, new goals and a new action plan. The plan starts when the goals are approved by the evaluator. There are 140 calendar days between today (1/31/13) and the end of the school year (6/20/13). Allowing time for creating the plan, the maximum plan length is about 130 days.

Problem Solving: Top 10 Questions #7: What should I do if an educator has not uploaded any artifacts? If no artifacts are uploaded or submitted, the evaluator can note this as evidence in the rationales of the Formative Assessment. Your responsibility is to notify the educator of the date of the Formative Assessment. The contract says artifacts should be submitted at least 2 weeks in advance, but you may choose to accept artifacts up to the day of.

Problem Solving: Top 10 Questions #6: What should I do if an educator files a grievance after a Formative Assessment? Contact Labor Relations at 617– 635 – 1577. Do not change the Formative Assessment.

Problem Solving: Top 10 Questions #5: What can I do to streamline the writing of a Formative Assessment? 1. Review evidence: Read through the goals, action steps, observations, and artifacts. 2. Identify ratings: Use the teacher rubric to identify the educator’s performance level in priority elements in each standard. 3. Write the rationale: Use the language of the rubric to write claims, and support them by citing specific evidence.

#5 Streamlining the Formative continued… You don’t need to restate evidence and feedback from observations, just refer to them. If you don’t have multiple sources of evidence for each rationale, it’s ok – you can add more before the summative. While it is a best practice, it is not mandatory to write a rationale for proficient ratings. The same prescriptions may apply to multiple educators. Write “See rationale for Standard _” instead of restating information in the Statement/ Evidence of the Problem sections.

Problem Solving: Top 10 Questions #4: What can I do if I release a Formative Assessment but realize something is missing? Formative Assessments can be edited within 5 school days of being released. If the five days have passed, changes can still be made, but the issue may be grieved. Another option is to upload a statement about the mistake as an artifact.

Problem Solving: Top 10 Questions #3: What if an educator wants to add comments to a Formative Assessment after the five day window has closed? The teacher may type up his/her comments and send them to the principal. The principal can send them to OEE and we can upload the document as an artifact to the educator’s plan.

Problem Solving: Top 10 Questions #2: What happens if someone receives an overall rating of Unsatisfactory at the end of an Improvement Plan? Notify Labor Relations & request an “Intent to dismiss” letter Compile all written correspondences with the educator related to performance evaluation & submit them to OEE Meet with the educator to discuss the evaluation. Let him/her know that you are requesting the ‘Intent to dismiss’ letter.

Problem Solving: Top 10 Questions #1: Do I have to do this twice every year for every teacher? No. All of the information from the Formative will filter into the Summative. If you complete a thorough Formative Assessment, your Summative Evaluation may not need many changes or additions.

Support: Office of Educator Effectiveness Ross Wilson, Assistant Superintendent for Educator Effectiveness (rwilson@boston. k 12. ma. us) Jared Joiner, Implementation Specialist (jjoiner) Emily Kalejs Qazilbash, Implementation Specialist (eqazilbash) Angela Rubenstein, Implementation Specialist (arubenstein) Kris Taylor, Implementation Specialist (ktaylor 2) Jenna Costin, EDFS On-line System Coordinator (jcostin) Chason Ishino, Consultant (cishino)