Rubrics If I hear I forget If I

Rubrics If I hear, I forget. If I see, I remember. If I do, I understand.

Rubric • A criteria-based scoring guideline that can be used to evaluate performance. • Rubrics indicate the qualities the judge/reviewer will look for in differentiating levels of performance and assessing achievement. 2

Scoring Rubrics • Holistic Rubric • Analytic Rubric – Checklist Rubric – Rating Scale Rubric Holistic vs. Analytic: one or several judgments? 3

Holistic • Rubric that requires a teacher to rate or score a student’s product or process as whole without first scoring parts or components separately. Analytic • A rule that you use to rate or score that separate parts or traits (dimensions) of a student’s product or process first then sum these part scores to obtain a total score. 4

Rubric Definition Holistic All criteria (dimensions, traits) are evaluated simultaneously Analytic Each criterion (dimension, trait) is evaluated separately Advantages Limitations • faster • No focus on • View the performance as a details whole (paper, product) • one overall • Resembles real life score Less assessment-use of precise than information analytical • Less time for inter-rater • not good for reliability formative • Good for summative (no • Doesn’t feedback) communicates how to improve • Identifies strengths and weaknesses of each participant for each dimension • Some key elements may be given higher weight in • Scoring is slower • Difficult to identify well defined elements • Longer time for 5 inter rater

Checklist Rubric Checklist for a web site �� The purpose of the site is obvious. �� The site’s structure is clear and intuitive. �� Titles are meaningful. �� Each page looks meaningful. �� The text is easy to read. �� Graphics and multimedia help convey the site’s main points. �� Spelling, punctuation and grammar are correct. �� Contact information for the author or webmaster is given. �� The date each page was last updated is given. Source: Suskie, L. (2004) Assessing Student Learning: A Common Sense Guide. Anker Publishing Company, Bolton, MA. 6

Rating scales A checklist with a rating scale added to show the degree to which these things were present in the assignment. • A rubric translates the standards and criteria that make up grading into some sort of a chart or a description. • Articulating in writing what precisely is an A on a particular assignment or task? How is different from a “B” or a “C” • To be Shared with students along with the assignment, the task, not in first day of class, not after you grade the task. 7

8

Example of assessing group work Instructions: Write the names of each member of the group, including yourself, in the boxes in the first column. Using the key that follows, circle the number that represents your opinion on your and the group member's performance on each item. Scale: 3=Outstanding 2=More than satisfactory 1=Satisfactory 0=Less than satisfactory Group Worked Attended and Members cooperatively to participated in (list by complete meetings name) assignments 0 1 2 3 0 1 2 3 Supported and Prepared Made substantial respected other adequately for contributions to members' efforts meetings group's and opinions understandings - shared ideas, resources, information 0 1 2 3 0 1 2 3 0 1 2 3 Additional Comments: 9

A Rubric for Rubrics • Clarity of criteria Each criteria is distinct, clearly delineated and fully appropriate for the assignment(s)/course • Distinction between Levels Each level is distinct and progresses in a clear and logical order • Reliability of Scoring Cross-scoring of assignments using rubric results in consistent agreement among scorers

• Clarity of Expectations/ Guidance to Learners Rubric serves as primary reference point for discussion and guidance for assignments as well as evaluation of assignment(s) • Support of Metacognition (Awareness of Learning) Rubric is regularly referenced and used to help learners identify the skills and knowledge they are developing throughout the course/ assignment(s) • Engagement of learners in Rubric Development/use Faculty and learners are jointly responsible for design of rubrics and learners use them in peer and/or selfevaluation

Advantages of a Rubric • For the Professor - Objective and consistent ; Clarify criteria in specific terms ; Feedback vehicle ; Benchmarks against which to measure and document progress ; Make scoring faster and easier; Help tie performance to outcomes. • For Students - Help define "quality“; Awareness of criteria; Understand expectations; Help judge and revise their own work ; Shows how their work will be evaluated and what is expected; How to improve performance. 12