MODULE 1 EFFECTIVE USE OF DATA THE DATA

  • Slides: 31
Download presentation
MODULE 1: EFFECTIVE USE OF DATA & THE DATA TEAMS MODEL 10. 9. 12

MODULE 1: EFFECTIVE USE OF DATA & THE DATA TEAMS MODEL 10. 9. 12

AGENDA Part 1: Formative Assessment Common Formative Assessment Design Part 2: Balanced Assessment Data

AGENDA Part 1: Formative Assessment Common Formative Assessment Design Part 2: Balanced Assessment Data Teams Defined Part 3: Data Teams Review Data Teams Simulation

DATA TEAMS Part 1 § Introduction § Formative Assessment § Common Formative Assessment Design

DATA TEAMS Part 1 § Introduction § Formative Assessment § Common Formative Assessment Design

DATA DRIVES INSTRUCTION “The monitoring of effective instruction is the heart of effective instruction.

DATA DRIVES INSTRUCTION “The monitoring of effective instruction is the heart of effective instruction. ” - D. C. Lortie “Data are to goals, what signposts are to travelers; data are not endpoints, but are essential to reaching them…” - M. Schmoker

DATA DRIVES INSTRUCTION Data determines where we enter in with instruction Data determines how

DATA DRIVES INSTRUCTION Data determines where we enter in with instruction Data determines how effective our instruction has been Data determines the path in which future instruction will take

Data collection can and should happen in a variety of ways…

Data collection can and should happen in a variety of ways…

DMPS BALANCED ASSESSMENT SYSTEM Classroom Formative Assessments To inform instruction within and between lessons

DMPS BALANCED ASSESSMENT SYSTEM Classroom Formative Assessments To inform instruction within and between lessons for both student and teacher Classroom Summative Assessment To give a grade Common Formative Assessments District Interim/Benchmark Assessments To determine if students have learned the materials and how to respond instructionally To support building and district teams in assessing curriculum, instructional strategies, and pacing. External Summative Assessments To serve as a predictor for success on External Summative Assessments Purpose To support building and district teams in determining whether curriculum, instructional strategies and pacing were appropriate Student response systems, whiteboards, Writing to Learn, student: teacher conferences Final Exams, final projects, performance based tasks Learner objectives assessed with rubrics, short quizzes, Writing to Learn, and Journeys assessment materials District Benchmark Assessments, Writing Assessments, Basic/Analytical Reading Inventory (BRI/ARI), Scholastic Reading/Math Inventory (SRI/SMI) Iowa Assessment, ACT, PLAN, AP Exams, PA Profile (Kindergarten), Technology Assessment (Grade 8) Formative or Summative Very formative More summative Summative Whose responsibility for creation Classroom teachers Collaborative teams at each school (Data Teams) District teams of representative teachers An external group of experts Reported to Student and parents Grade level teams (Data Teams) District and State Examples of Practice Each successive type of assessment (from left to right) requires a more significant investment in time, resources, and collaboration to prepare, administer, and garner useful data. Additionally, the direct impact on classroom instruction decreases as the type of assessments migrates away (left to right) from classroom formative assessments. Copy Provided

RICK WORMELI – VIDEO 1 http: //www. youtube. com/watch? v=r. Jx. FXjf. B_B 4

RICK WORMELI – VIDEO 1 http: //www. youtube. com/watch? v=r. Jx. FXjf. B_B 4 Quick Write: Compare/contrast formative and summative assessment.

UNIT ASSESSMENT MAP (5 -6 WEEK UNIT) Square = pre-assessment Triangle = CFA Star

UNIT ASSESSMENT MAP (5 -6 WEEK UNIT) Square = pre-assessment Triangle = CFA Star = summative assessment *** Daily classroom formative assessments ***

DEFINITION OF FORMATIVE ASSESSMENT

DEFINITION OF FORMATIVE ASSESSMENT

WHAT THE EXPERTS SAY Formative assessment, therefore, is essentially feedback both to the teachers

WHAT THE EXPERTS SAY Formative assessment, therefore, is essentially feedback both to the teachers and to the pupil about present understanding and skill development in order to determine the way forward. - Harlen & James, 1997 It is not the instrument that is formative; it is the use of the information gathered to adjust teaching and learning. - Black & Wiliam, 1998

WHAT THE EXPERTS SAY Formative assessment is defined as assessment carried out during the

WHAT THE EXPERTS SAY Formative assessment is defined as assessment carried out during the instructional process for the purpose of improving teaching or learning. What makes formative assessment is that it is immediately used to make adjustments so as to form new learning. - Shepard 2008

WHAT THE EXPERTS SAY Typical effect sizes [of formative assessment] were between 0. 4

WHAT THE EXPERTS SAY Typical effect sizes [of formative assessment] were between 0. 4 and 0. 7. The achievement gains realized by students whose teachers rely on formative assessment can range from 15 to 25 percentile points on commonly used standardized achievement test score scales. This kind of score gain, if applied to performance on recent international assessments, would move the United State’s rank from the middle of the pack of 42 nations tested to the top five. - Black & William 1998

WORKING DEFINITION Formative assessments provide accurate and relevant data that impacts instruction and allows

WORKING DEFINITION Formative assessments provide accurate and relevant data that impacts instruction and allows teachers to give effective and meaningful feedback to students.

THE BIG PICTURE 1. Clearly define what students need to KNOW and be able

THE BIG PICTURE 1. Clearly define what students need to KNOW and be able to DO 2. Create consensus on what is “good enough” 3. Keep score, make adjustments

STEP 1: PRIORITIZE AND ANALYZE LEARNER OBJECTIVES

STEP 1: PRIORITIZE AND ANALYZE LEARNER OBJECTIVES

CLUSTER LEARNER OBJECTIVES 7 th Grade Literacy Example Standard: RL 3 Analyze how particular

CLUSTER LEARNER OBJECTIVES 7 th Grade Literacy Example Standard: RL 3 Analyze how particular elements of a story interact. Learner Objectives: § Identify the setting of a story. § Identify the stages of plot within a story. § Identify characters within a story and their character traits. § Identify conflicts within a story. § Analyze how different stages of plot, conflict, setting, and characters work together in a story.

ANALYZE VERB Prioritized Learner Objectives What will students do? (verbs) Analyze What will students

ANALYZE VERB Prioritized Learner Objectives What will students do? (verbs) Analyze What will students know? how particular elements of a story interact. Bloom’s Level of Thinking Remembering Understanding Applying Analyzing Evaluating

EXAMPLE Analyze = make connections between parts, talk about how they “work” together for

EXAMPLE Analyze = make connections between parts, talk about how they “work” together for a purpose

STEP 2: DEFINING PROFICIENCY

STEP 2: DEFINING PROFICIENCY

RICK WORMELI http: //www. youtube. com/watch? v=n. PUq. Kpn_hs (up to 2: 45) Create

RICK WORMELI http: //www. youtube. com/watch? v=n. PUq. Kpn_hs (up to 2: 45) Create a summary statement for “defining proficiency”.

CONSIDERATIONS What is ‘good enough’? What does ‘Proficient’ look like? What will we look

CONSIDERATIONS What is ‘good enough’? What does ‘Proficient’ look like? What will we look for in student work?

EXAMPLE Analyze how particular elements of a story interact. 1 2 Shows some or

EXAMPLE Analyze how particular elements of a story interact. 1 2 Shows some or no knowledge of parts of a story; cannot show connection between parts Shows understanding of some or all parts of a story but cannot show connection 3 Shows understanding of all parts of a story; shows how some (1 -3) parts of story work together 4 Shows understanding of all parts of a story; shows how all (4) parts of story work together

STEP 3: DETERMINE ASSESSMENT TYPE

STEP 3: DETERMINE ASSESSMENT TYPE

CONSIDERATIONS Consider Bloom’s Levels in Step 1. Which assessment type will best measure student

CONSIDERATIONS Consider Bloom’s Levels in Step 1. Which assessment type will best measure student learning most efficiently? Will we need a variety? How many items will we need to ensure validity?

Assessment Type Format Advantages/Disadvantages Selected Response Multiple choice, matching, A: Quick scoring, several true/false

Assessment Type Format Advantages/Disadvantages Selected Response Multiple choice, matching, A: Quick scoring, several true/false questions for each objective D: Difficult to measure higher levels of thinking Constructed Response or Extended Written Response Short or long essay, graphic organizers, student work samples (if tied to standard and done individually), scored with a common rubric A: Can assess chunks of knowledge that interrelate, can assess student thinking, can measure higher levels of thinking D: More time to score, difficult to get consistent scoring, writing skill level can skew results Performance Assessment Oral reports, demonstrations, projects, scored with a common rubric A: Engaging for students, can assess multiple standards in an integrated way D: More time to administer and score

EXAMPLE Standard: Analyze how particular elements of a story interact. Assessment Type: constructed response

EXAMPLE Standard: Analyze how particular elements of a story interact. Assessment Type: constructed response or extended written response (writing prompt)

STEP 4: ASSESSMENT CREATION

STEP 4: ASSESSMENT CREATION

EXAMPLE Use text from Rikki Tavi (7 th grade materials) Standard: Analyze how particular

EXAMPLE Use text from Rikki Tavi (7 th grade materials) Standard: Analyze how particular elements of a story interact. Writing Prompt: We have been learning about how quality literature consists of many parts: plot, conflict, setting, and characters. Identify the parts from the story Rikki Tavi and tell how they work together (analyze). You must use the underlined words in your response.

EVALUATING THE QUALITY OF AN ASSESSMENT Is it valid? Is it reliable?

EVALUATING THE QUALITY OF AN ASSESSMENT Is it valid? Is it reliable?