Writing Using Rubrics to Score with Reliability Charlottesville

Writing: Using Rubrics to Score with Reliability Charlottesville City Schools September 28

Learning Targets for Today: 1. Understanding of VDOE and CCS rubric scoring 2. Goals for Reading, Spelling, and Writing in Charlottesville 3. Interrater reliability when using rubric across grade levels and across schools 4. Time to grade!

Writing and the SOL: • Writing is “officially” tested in 8 th and End of Course (10 th grade here in Charlottesville) • Two components: 1. Multiple choice 2. Short paper

Writing and the SOL: Multiple choice: ~number of questions on 2 domains: 1. Research, plan, compose, and revise 2. Edit for language, capitalization, punctuation, and spelling * All skills have been introduced and spiraled since elementary grades

Writing and the SOL: ~Short paper scored on 2 domains: 1. Composing and Written Expression 2. Usage and Mechanics ~Each reader (2) give a score for each domain: 4= consistent control (“almost always”) 3= reasonable control (“mostly”) 2= inconsistent control (“some”) 1= little or no control

Writing and the SOL: Each paper is read by 2 readers and given a score for each of the domains. ~Composing and Written expression counts twice ~Usage and Mechanics counts once Therefore, a child could get a total # of points of 24 from both readers ~ Special cases of a score of 0

The Scoring is NOT: ~ based on the number of bullets a child has or does not have (graded holistically) ~ an average score of each of the domains ~ based on a child’s legibility of handwriting

Where we are currently. . . ~ Overall numbers: 8 th SP 65% EOC: 74% ~ Areas of strength on MC: transitional words, combining sentences, revising writing ~ Areas of needed improvement on MC: quotation marks, subject-verb agreement, commas, apostrophes, homophones

Where we want to be… ~In three years, our 8 th grade writing scores should be reflective of the VTSS model— 80% or above of our students reading, spelling, and WRITING on or above grade level expectations.

The CCS Writing Rubric: ~ Models the VDOE scoring conventions ~ Uses grade level SOL expectations based on the two short paper domains ~ Will help us to define those that are on/above or below grade level in writing at the end of the year ~A “ 3” or a “ 4” will be considered on or above grade level in each of the domains or a combined score of 9 -12

In Our Breakout Sessions Today… ~ Review new or existing rubrics for grade levels ~ Discuss scoring of writing prompts ~ Establish reliability of the scoring across grade levels and school ~ Have the opporunity to score our fall papers

Breakout Sessions Today : K: Jen Davis (B 229) 1: Stephanie Tatel (B 226) 2: Ashley Fitzgerald (B 222) 3: Lindsay Kamide (B 212) 4: Linda Humphries (B 201) 5 -6: Stacy Reedal, Jen Snyder, Jane Harrington (B 234) 7 -8: Trish Suchoski and Cheryl Miller (B 239)

Welcome to the Breakout Session! Please sit with your grade level group from your school. Each teacher should have a copy of the grade level rubric and samples. Learning target: Grade fall writing prompts with new rubrics and develop anchor papers.

Activity #1: 1. Review the rubric together and the items in the domains. Remember they build over time and these are end of year expectations! 2. Score the sample papers as a group.

Activity #2: 1. Individually, select two papers from your class of differing abilities. If you are a specialist, choose two of your students’ papers from their homeroom. 2. Grade both using the rubric. Write your name and the total score you gave (2 X’s C/WE, 1 X U/M) on the back.

Activity #2: 3. Select a partner at your table. 4. Switch papers and grade using rubric for both. Place this score on the top right corner of the page. 5. Compare your scores to your partner’s on back and discuss together any differences and how/why you came to that score.

Across Your Grade Level: 1. After working with the partner, open it up to your grade level. What did you find easy about this? What was difficult? Did you find consensus? 2. Compare your papers as a grade level. What did you feel was a 4, 3, 2, 1? You may not have examples of these…

Across Your School: 3. Using the chart paper, post your examples of anchors for your school/grade (for Walker). 4. Gallery walk to see what the other schools/grade level (for Walker) deemed as “ 4, 3, 2, 1”. Was there consistency?

Across School/ Grade Level Groups: 1. Number off and divide into grade level groups representing all schools/ levels within your grade level. 2. As a group, discuss the experience of grading with colleagues. Benefits? Issues? 3. Reflect on the gallery walk as a group. Be prepared to share out.

For the remainder of the time… 1. Complete the reflective feedback on today’s session. Place in center of table. 2. Use the remainder of the time to grade the fall prompts. 3. Have a great rest of your afternoon!