Authentic Assessment Lynne E Houtz Ph D Associate

  • Slides: 24
Download presentation
Authentic Assessment Lynne E. Houtz, Ph. D. Associate Professor of Education Creighton University Lynne

Authentic Assessment Lynne E. Houtz, Ph. D. Associate Professor of Education Creighton University Lynne E. Houtz, Ph. D. 2006

Skill Goals As a result of participating in this workshop, participants will be able

Skill Goals As a result of participating in this workshop, participants will be able to: • Define “Assessment. ” • Use assessment to inform teaching and learning. • Identify appropriate strategies to evaluate student learning, including test development and alternative assessments. • Provide examples of a variety of assessment techniques and tools. • Provide examples of rubrics and resources for rubric development. Lynne E. Houtz, Ph. D. 2006 2

Assessment: “The systematic collection, review, and use of information about educational programs undertaken for

Assessment: “The systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development. ” - Scritchfield (2002) - Scritchfield, S. A. (2002). Assessment of student learning: What, how, why bother. Workshop sponsored by Office for Excellence in Teaching, Learning & Assessment. Lynne E. Houtz, Ph. D. 2006 3

Lynne E. Houtz, Ph. D. 2006 4

Lynne E. Houtz, Ph. D. 2006 4

Often the long-range goal is far downstream and difficult to measure because of the

Often the long-range goal is far downstream and difficult to measure because of the many intervening variables and time constraints within funding and reporting periods. Lynne E. Houtz, Ph. D. 2006 5

Fairness in classroom assessment refers to giving all students an equal chance to show

Fairness in classroom assessment refers to giving all students an equal chance to show what they know and can do!! NEA Professional Standards and Practice Lynne E. Houtz, Ph. D. 2006 6

Written Tests • • Paper & pencil or computer Essay or objective Standardized achievement

Written Tests • • Paper & pencil or computer Essay or objective Standardized achievement Criterion-referenced Lynne E. Houtz, Ph. D. 2006 7

Assessment Terms • “Alternative” - one of several possibilities; another option. Any type of

Assessment Terms • “Alternative” - one of several possibilities; another option. Any type of assessment in which students create a response to a question, rather than choosing a response from a given list. Lynne E. Houtz, Ph. D. 2006 8

“Authentic” • Tests should involve real-life tasks, performances, or challenges that replicate the problems

“Authentic” • Tests should involve real-life tasks, performances, or challenges that replicate the problems faced by an expert in a particular field. • Students should understand up-front the criteria on which their work will be judged and be able to apply the criteria to their work. • Students should be asked to demonstrate their control over the essential knowledge being taught by actually using the information in a way that reveals their level of understanding. Lynne E. Houtz, Ph. D. 2006 9

Lynne E. Houtz, Ph. D. 2006 10

Lynne E. Houtz, Ph. D. 2006 10

Assessment Methods • • • Observations Oral Questions Written Tasks Tests Class Presentations Extended

Assessment Methods • • • Observations Oral Questions Written Tasks Tests Class Presentations Extended Problem. Solving Projects • Take-Home Tests • Homework • • Journals Group Work Portfolios Standardized Achievement Tests Student Interviews Focus Groups Performance Tests Criterion-References Tests Lynne E. Houtz, Ph. D. 2006 11

Making Assessments based on Observations Lynne E. Houtz, Ph. D. 2006 12

Making Assessments based on Observations Lynne E. Houtz, Ph. D. 2006 12

The Primary Components of Performance Assessment • 1. Context: What performance will you evaluate?

The Primary Components of Performance Assessment • 1. Context: What performance will you evaluate? • 2. Criteria: By what standards will you judge proficiency? How will these standards be determined? • 3. Method: How will you elicit this performance so that you can observe it? How will you rate performance and create a record of your assessment? Who shall evaluate the Lynne E. Houtz, performance? Ph. D. 2006 13

Performance Based Curriculum Key Quality Points • Students are given quality models of performance

Performance Based Curriculum Key Quality Points • Students are given quality models of performance based upon real-world examples of excellence. • Students practice toward, and teachers teach toward those models. Criteria are clearly stated and set in advance. • High standards are set and maintained and additional instructional support provided, for all students to meet standards. • Students have the opportunity to reflect and practice self e�valuation. • The engagement and motivation factors that have traditionally involved students in sports and the arts Lynne E. Houtz, Ph. D. 2006 14 are applied to academic endeavors.

Criteria for Good Alternative Assessment National Research Centers (1993) A Tool Kit for Professional

Criteria for Good Alternative Assessment National Research Centers (1993) A Tool Kit for Professional Developers: Alternative Assessment. Laboratory Network Program. • Coverage • Fairness and Rater Bias • Performance Criteria • Consequences/ • Sampling/ Validity Representativeness/ Generalizability • Cost and Efficiency • Tasks. • Extraneous Interference Lynne E. Houtz, Ph. D. 2006 15

Performance Assessment • • Criteria for success: Content Details Quality, etc • Rubric http:

Performance Assessment • • Criteria for success: Content Details Quality, etc • Rubric http: //rubistar. 4 teach ers. org/index. php • Checklist • Reliability • Validity Lynne E. Houtz, Ph. D. 2006 16

Perceptual Data: views, judgments, or appraisals from an individual’s perspective (Bernhardt, 1998). • Focus

Perceptual Data: views, judgments, or appraisals from an individual’s perspective (Bernhardt, 1998). • Focus Groups • Interviews • Surveys Bernhardt, Victoria L. (1998). Data Analysis for Comprehensive Schoolwide Improvement. Larchmont, NY: Eye On Education, 292 pages. Lynne E. Houtz, Ph. D. 2006 17

I find the great thing in this world is not so much where we

I find the great thing in this world is not so much where we stand as in what direction we are moving!! Lynne E. Houtz, Ph. D. 2006 18

“Everything that can be counted does not necessarily count; everything that counts cannot necessarily

“Everything that can be counted does not necessarily count; everything that counts cannot necessarily be counted. ” - Albert Einstein Lynne E. Houtz, Ph. D. 2006

Analyzing Focus Group Information • Memory-Based Analysis • Note-Based Analysis • Tape-Based Analysis •

Analyzing Focus Group Information • Memory-Based Analysis • Note-Based Analysis • Tape-Based Analysis • Transcript-Based Analysis Lynne E. Houtz, Ph. D. 2006 20

FOCUS GROUP ANALYSIS Least timeintensive Mostrigorous Memorybased Note-based Tape-based Transcript Based Focus Groups, Second

FOCUS GROUP ANALYSIS Least timeintensive Mostrigorous Memorybased Note-based Tape-based Transcript Based Focus Groups, Second Edition: A Practical Guide for Applied Research. Krueger, R. 1994. Sage Publications. Thousand Oaks, CA Lynne E. Houtz, Ph. D. 2006 21

Portfolio Assessment • Students compose a portrait of themselves as able learners, selecting and

Portfolio Assessment • Students compose a portrait of themselves as able learners, selecting and presenting evidence that they have met the learning standards for individual classes and for the broader learning tasks. Lynne E. Houtz, Ph. D. 2006 22

Final Thoughts • Alternative assessment is not automatically better assessment. • Alternatives have advantages

Final Thoughts • Alternative assessment is not automatically better assessment. • Alternatives have advantages and disadvantages. • Take a balanced approach to assessment. • Design alternative assessments to be tools for learning and teaching. Lynne E. Houtz, Ph. D. 2006 23

It is good to have an end to journey “It is good to have

It is good to have an end to journey “It is good to have an end to toward; but it is the journey that journey toward; but it is the matters in the end. ” journey that matters in the end. ” Ursula K. Le Guin Lynne E. Houtz, Ph. D. 2006 24