RAPPS Rural Alaska Principal Preparation and Support Program

RAPPS – Rural Alaska Principal Preparation and Support Program Selecting and Training Evaluators May 28 – 30, 2014 Learning Groups 1, 2, and 3 Hilton Hotel - Anchorage, Alaska Session Leader: Al Bertani, RAPPS Senior Design Consultant

Session Objectives ➜ Establishing criteria for selecting who can evaluate ➜ Preparing evaluators for inter-rater reliability ➜ Addressing issue of quality EE-4

ESTABLISHING CRITERIA FOR SELECTING WHO CAN EVALUATE

Selecting And Training EE Evaluators ² Who will be eligible to conduct evaluations? - 10 ² Will there be examples and explicit guidance in determining levels of proficiency and approval? ² To what extent will training provide opportunities for guided practice paired with specific feedback to improve reliability? ² Will evaluators be monitored regularly for reliability checks? ² How will implementation fidelity be ensured? A Practical Guide to Designing Comprehensive Teacher Evaluation Systems; National Comprehensive Center for Teacher Quality; May 2012

PREPARING EVALUATORS FOR INTER-RATER RELIABILITY

Preparing Evaluators 1. Start with an overview of the process — give evaluators the big picture. 2. Familiarize evaluators with the performance dimensions and rating scales. 3. Help evaluators recognize their own biases (e. g. , for certain teaching styles). 4. Describe common judgment errors to be aware of and avoided. 5. Describe how to recognize and record evidence of performance. 6. Practice collecting evidence and observing. 7. Practice connecting evidence to performance dimensions. 8. Practice interpreting evidence relative to the rating scale. 9. Discuss rating conventions (e. g. , What do you do if you do not have any evidence for a performance dimension? How do you interpret words like “consistently” Observations of Teacher Classroom Performance – Guide to Implementation Resources or “frequently” for Applied Practice; Milanowski, Prince, Koppich; CECR; 2013

EE-5 and 6 Danielson At-A-Glance Washington State Teacher/Principal Evaluation Project; 2014 http: //tpep-wa. org/the-model/framework-and-rubrics/instructional-frameworks/danielson-framework/

EE-7, 8 and 9 Marzano At-A-Glance Washington State Teacher/Principal Evaluation Project; 2014 http: //tpep-wa. org/the-model/framework-and-rubrics/instructional-frameworks/marzano/

Video Simulation – BTSA California Available on You. Tube – BTSA Teacher Observation Videos Step 1 Declare which framework you want for the practice round (D or M) Step 2 Determine which grade and content example you want for practice. Step 3 Join one of the four learning groups for the video simulation. Step 4 Use the Danielson or Marzano rubric for practice Beginningpurposes. Teacher Support and Assessment; California Department of Education (CDE) and Commission on Teacher Credentialing (CTC); Web Address for Resources http: //www. btsa. ca. gov

Video Resources – BTSA California Available on You. Tube – BTSA Teacher Observation Videos 6 th Grade Math https: //www. youtube. com/watch? v=Qx. LFTvod. BBI K Language Arts https: //www. youtube. com/watch? v=fm. CA 5 rn 75 Nc 9 th Grade L. A. https: //www. youtube. com/watch? v=7 K 4 M 2 WJXNx. Q H. S. Dance Class https: //www. youtube. com/watch? v=k. Fs 1 Ll. TXm. Jo Beginning Teacher Support and Assessment; California Department of Education (CDE) and Commission on Teacher Credentialing (CTC); Web Address for Resources http: //www. btsa. ca. gov

Preparing Evaluators q Will the state or districts offer specialized training for evaluators? q Will the training provide opportunities for guided practice paired with specific feedback? q Will the state or districts provide examples and explicit guidance in determining levels of proficiency? q Will evaluators be monitored regularly by the A Practical Guide to Designing Comprehensive Teacher Evaluation Systems; state and/or National Comprehensive Center for Teacher Quality; May 2012

ADDRESSING ISSUES OF QUALITY

Video Resources – San Diego Available at http: //www. teachereffectivenessandevaluation. com Identify Apply Define ² Observations ² Evidence vs. Opinion Training ² Calibrated Walk-Through Conduct Calibrat e San Diego County Office of Education; Teacher Effectiveness and Evaluation; Web Address for Resources http: //www. teachereffectivenessandevaluation. com

Video Resources – San Diego Available at http: //www. teachereffectivenessandevaluation. com San Diego County Office of Education; Teacher Effectiveness and Evaluation; Web Address for Resources http: //www. teachereffectivenessandevaluation. com

Video Resources – San Diego Available at http: //www. teachereffectivenessandevaluation. com Demonstration San Diego Calibration Videos Grade 1 Grade 3 Grades 4/5 Grade 6 MS Science HS Algebra Directions for Calibration Videos San Diego County Office of Education; Teacher Effectiveness and Evaluation; Web Address for Resources http: //www. teachereffectivenessandevaluation. com

Video Resources – San Diego Available at http: //www. teachereffectivenessandevaluation. com Researching the Resources 1. Decide which example you’d like to explore. 2. Join that table for your chosen example. 3. View the video example. 4. Join your colleagues in discussing how the resource could be used. 5. Be prepared to discuss your suggestions for using the videos. San Diego County Office of Education; Teacher Effectiveness and Evaluation; Web Address for Resources http: //www. teachereffectivenessandevaluation. com