Holistic Scoring for Benchmark Assessment Created by Maxie

Holistic Scoring for Benchmark Assessment Created by Maxie Patel Sequoia - Edkey

Introduction Agenda • • • gain a better understanding of the Arizona Writing Standard Writing Assessment understand the use of the holistic rubric in scoring student writing develop consistency in scoring actual student work Specifically Øprovide an opportunity to study the rubric Øprovide an opportunity to study anchor papers that illustrate each score point of the rubric Øprovide an opportunity to practice scoring several sets of papers written by Arizona students Øverify your progress by evaluating the accuracy of the scores you assign to a final set of papers (qualification set)

Holistic Scoring Focus Holistic scoring is the evaluation of writing proficiency based on several specific elements of writing. The writer is scored by applying the scoring descriptors to each paper. What are these descriptors?

Holistic Scoring Descriptors 6 = The writer demonstrates sophisticated, though not necessarily perfect, control* of almost all of the bullets. This indicates exceptional writing skill. 5 = The writer demonstrates consistent, but not sophisticated, control* of most of the bullets, indicating some slight weakness but still very good skill in writing. 4 = The writer demonstrates consistent control* of writing based on the bullets to indicate an appropriate and acceptable writing skill. 3 = The writer demonstrates inadequate control* of several skills as indicated by the bullets in this score point. 2 = The writer demonstrates poor control of skills as indicated by the bullets in this score point. 1 = The writer demonstrates inferior skill as indicated by the bullets in this score point. *Control: The ability to use a given feature of written language effectively at appropriate grade level. A paper receives a higher score to the extent that it demonstrates control of the skills represented by the bullets.

How are rubrics used to Score papers? Ø Rubrics for writing assessments are fairly generic. Ø Anchor (exemplar) papers need to be used as the criteria for each score point to obtain close to precise scoring. ØIt is most important that in leaning to apply a rubric consistently, you let go of existing prejudices.

Holistic Scoring Rubric Application Look as much at what the writer does well first before looking at what he/she does poorly. Give consideration to all features. "Brite" is one misspelling no matter how often the word appears; a missing comma after an introductory word or phrase is one misuse no matter how often it is missing. Compare papers to the requirements of each score point, not to each other, or to student writing that you may have previously read, or to some general standard of desired literacy.

Holistic Scoring Rubric Application Score only what is on the paper. It is impossible to evaluate what the writer might have intended to say. Note that a word that seems to have been omitted due to haste in revising, editing or copying need not demonstrate a total lack of control over that feature. Do not score a paper on only length. Length, in and of itself, is not a feature of writing competency. Read the entire paper before assigning a score.

Differences Between Grading and Scoring Holistic scoring is not a substitute for classroom grading classroom teachers become holistic scorers, they need to shift gears in order to score fairly and consistently. In the holistic scoring situation expectations must be generated by the criteria in the rubric and not the daily classroom practices. Consensus should be formed by referring to the anchor papers and the holistic rubric.

Allowable Scoring Interpretations When scoring writing samples, decisions must be made regarding how papers with unexpected content, organization, or structure will be scored. While some guidelines are general, other decisions must be made because a significant number of writers have chosen to respond to a specific prompt in an appropriate but unanticipated way. Writing mode will also dictate the way in which the piece of writing is evaluated.

How does reader bias affect scoring? Appearance of Response Length of Response Repetition of Response Offensive or Disturbing Content Alert Papers Response to Prompt Reactions to Style Writer's Voice and Tone Reactions to Extended Writing Assessments

Nonscorable Papers All papers, no matter how brief, must be scored, unless they are off-topic, illegible, blank, or written in a language other than English. Only an administrator or designee is permitted to assign a nonscorable code. Nonscorable Codes ØBlank – A; ØIllegible – B; Ønon-English – C Øoff-topic – D.

Questions? ? ? Get in touch with us: lmiller@edkey. org kcrang@edkey. org kcotter@edkey. org