Taking a VOCAL Approach to Assessment validating observation

Taking a "VOCAL" Approach to Assessment: validating observation and conversation when assessing learning 4 Th. Annual Canadian Assessment for Learning Conference Saskatoon, May 5, 2017 Damian Cooper Plan Teach Assess website: www. planteachassess. com cell: 905 -460 -7109 email: damiancooper 11@gmail. com Twitter: @cooperd 1954

Session Outcomes We shall: n Consider what balanced assessment looks like n Explore why balanced assessment is essential n Examine challenges and solutions to gathering evidence of balanced assessment

Fair Means Same?

Balanced Assessment?

Balanced Assessment Means Triangulation Do (performance tasks) observations Valid & Reliable Picture of Student Achievement Write (tests, essays, projects, etc. ) products Say (oral defense, conferencing, conversations, etc. )

Triangulation: the what and why Definition Triangulation involves using multiple data sources in an investigation to produce understanding. Reasons to triangulate n A single method can never adequately shed light on a phenomenon. Using 2. multiple methods can help facilitate deeper understanding. n (Citation: Cohen D, Crabtree B. "Qualitative Research Guidelines Project. " July 2006. http: //www. qualres. org/Home. Tria-3692. html ) 1. 3.

Why is it necessary to triangulate assessment evidence? 2 Main Reasons: Write n The curriculum demands it n Students need it Do Say

Validating observation and conversation when assessing learning

“Backward Design” Program Planning Stage 1: Identify essential learnings Stage 2: Determine critical evidence (summative) of those learnings Stage 3: Plan learning experiences and instruction that make such learnings possible Adapted from Wiggins and Mc. Tighe, Understanding by Design

We must begin with the question, “What constitutes essential learning for students in the st 21. century? ”

Jack’s Story

Stage 1: Identify targeted understandings

Fair Assessment? ? ?

Stage 2: Determine appropriate assessment of those understandings & skills

Planning Assessment with the End in Mind

3 Critical Questions to Ask Before Assessment Occurs What is the purpose of this assessment? – Diagnostic? – Formative? – Summative? 2. Who is the primary user of the data? – Teacher? – Student? – Parent? Next grade teacher? Employer? – University/College entrance board? 3. What kind of data does the user need? – Feedback? – Score? – Percentage grade? – Anecdotal evidence? – Portfolio? 1.

Effective Assessment Planning: Full Year/Course or Per Unit Design summative assessment tasks first. These must provide evidence or one or more of the essential learning targets n Review to determine whether this set of summative tasks includes an appropriate balance of write, do, and say n Design smaller formative tasks to build understanding and skills towards the summative tasks n Design initial/diagnostic assessment tasks to determine students’ levels of understanding and skill before you begin teaching n

Summative Assessment: Helen Hills Grade 9 English Seminar

Helen’s Backward Planning

Helen’s Backward Planning n Key to success: gradual release of responsibility from teacher-directed to student autonomy

Helen Hills Grade 9 English Seminar n https: //www. youtube. com/watch? v=NZc Kup. Nzg. W 0

Assessment for Learning: Diagnostic Mathematics Assessment n (add video of Jeff interviewing Blake)

Co-constructed Assessment Criteria for Infomercial

Teacher Records Formative Performance

Students Discuss Feedback from Peer Assessment of Formative Performance

Time to Talk About Assessment n Share with a colleague your initial reactions to these examples of assessment through observation & conversation.

Triangulation of Evidence by Assessment Mode Do (performance tasks) observations Valid & Reliable Picture of Student Achievement Write (tests, essays, projects, etc. ) products Say (oral defense, conferencing, conversations, etc. )

Chris’s Story

Teach for Understanding and Assess for Transfer n When students are able to demonstrate a skill on cue, in a controlled situation, they have knowledge… BUT n When students independently make appropriate decisions by drawing on their knowledge and skills in response to new situations, they understand

Authentic Performance Tasks

Authentic Performance Tasks n n n n Are designed to provide evidence of learning of 1 or more overall expectations Require transfer or application of knowledge & skills Are relevant, meaningful, and therefore engaging for students Are challenging Often involve simulation or role-play Are accompanied by clear assessment criteria: a rubric and/or checklist Include realistic constraints: time, resources, etc. May require collaboration, and therefore include individual accountability

Backward Planning from an Authentic Summative Performance: The G 7

Stage 1: Essential Learning Targets Grade 12 - Economics Enduring Understandings (content) Students will demonstrate an understanding of the following economic concepts: n n n n n International trade Economic interdependence and convergence Specialization Exchange rates and their impact on trade Risk assessment and foreign expansion Infrastructure Relationship between money supply and interest rates Inflation Taxes and spending and their impact on national and global economies Essential Skills (competencies) Students will demonstrate the following skills : n n n n Collaboration Negotiation Application of knowledge of course concepts Decision-making Responsibility Problem-solving Critical thinking Self-reflection , self-montoring, and selfadjustment

Time to Talk About Assessment n Discuss the essential skills that Jeff can assess through the G 7 task that could NOT be assessed through the written examination.

Jeff’s Assessment Plan for His Grade 12 Economics Course Diagnostic (Pre) Assessments to Identify Strengths & Needs in Each Essential Skill & Concept Mid-Unit Formative Tasks to Identify Learning & Learning Gaps End-of-Course Summative Assessment Tasks G 7 Simulation: -performance -written report End-of-Unit Summative Tasks Summative Interview With Teacher Written Examination

Reliability is a measure of confidence in the data we are gathering.

Validity Does this assessment task actually provide evidence of the learning I’m looking for?

Reliability and Validity Reliability Validity

Summative Assessment and Reliability When students work in groups, the reliability of individual student assessment data will naturally be compromised n To counter this, you must plan for individual accountability: n – Independent student report – Individual student conferencing - Recording the evidence

Professional Judgment Decisions educators make, in light of their professional experience, with reference to public standards and guidelines (Cooper, Redefining Fair)

Triangulation of Evidence by Assessment Mode Do (performance tasks) observations Valid & Reliable Picture of Student Achievement Write (tests, essays, projects, etc. ) products Say (oral defense, conferencing, conversations, etc. )

Conversation as Assessment

Alan’s Story

Listening to Conversation to Assess Mathematical Understanding

Assessment as Learning: Using Conversation to Improve Reading Skills

Conversation: Jackie’s Grade 3 Reading Program n n n n Data-gathering Student oral reading Student viewing video of her reading performance Student setting goals for improvement Conference with peer coach Conference with teacher Teacher communication with parents Student meeting with parent and teacher

Conversation: Jackie’s Grade 3 Reading Program n https: //www. youtube. com/watch? v=t. HE 6 e. Rk 54 CI n https: //www. youtube. com/watch? v=Kfo 6 n. Diq. Aew

Planning for Conversations

Assessing Collaboration in the Primary Classroom

Assessing Collaboration in the Primary Classroom

Gr. 11 English - Writing How shall I assess this learning?

Of course …. Macbeth: Essay Topics 1) The supernatural plays an important role in Macbeth. To what extent does it motivate Macbeth's actions? 2) Discuss King Duncan and examine what contribution he makes to the play. 3) In constructing Macbeth, Shakespeare dramatically altered historical characters to enhance certain themes. Examine Shakespeare's sources and discuss why he made these radical changes. 4) Is Lady Macbeth more responsible than Macbeth for the murder of King Duncan? Is Lady Macbeth a more evil character than her husband and, if so, why?

An Authentic Performance Task in English n Could a TED Talk possibly provide evidence of those curriculum standards?

Grading and Reporting in 2017 n As a parent, what do you want to learn about your son/daughter’s learning through the grading and reporting process?

A New Reporting Paradigm

A New Reporting Paradigm