Data Literacy Collaborative Inquiry Date June 13 2013

Data Literacy & Collaborative Inquiry Date: June 13, 2013 Presenter: Diana Nunnaley

Leaders need preparation to use data Most people who currently work in public schools weren’t hired to do this work, nor have they been adequately prepared to do it either by their professional education or by their prior experience in schools. —Elmore, 2002, p. 5 Using Data ©TERC 2013

Let’s Agree On What We Mean § Data Driven Culture? § What should the result be? § What is effective data use? § Turn to someone near you and discuss the above questions. Using Data ©TERC 2013

Key Characteristics – High Performing Schools § Thoughtful public discussion of important and central issues § Collaboration –co-constructing the new, not just cooperation § Shared norms and values § Focus on student learning Using Data ©TERC 2013 Karen Seashore Louis, 2008 http: //workingconditions. net/? ca t=8 NSDC St. Louis, 2009

Synthesis – Research on Data Use • Establish a clear vision for school wide data use. • Develop and maintain a district wide data system. • Make data part of an ongoing cycle of instructional improvement. • Provide supports that foster a data-driven culture within the school. • Teach students to examine their own data and set learning goals. Using Data ©TERC 2013

The Data Divide Data Results

Professional Development Needed Data Leadership & Capacity Structured Collaboration Frequent Data Use Results Instructional Improvement

Grade 4 Data Team Using Data ©TERC 2013

The Data Team Data teams are school- or district-based teams comprising administrators, teacher-leaders, and data and other specialists who engage in ongoing dialogue informed by data and use the process of collaborative inquiry to improve teaching and learning. Using Data ©TERC 2013

Data Coach Data coaches are school and/or district leaders or service providers who work directly with a Data Team to lead them through the process of data analysis using collaborative inquiry. Using Data ©TERC 2013

An Underlying Assumption Data have no meaning. Meaning is imposed through interpretation. Frames of reference, the way we see the world, influence the meaning we derive from data. Effective data users become aware of and critically examine their frames of reference and assumptions. Conversely, data can be a catalyst to rethinking our assumptions. Based on Bruce Wellman and Laura Lipton, Data-Driven Dialogue, 2004

Data-Driven Dialogue Phase 1 Phase 2 Phase 3 Phase 4 Predict Go Visual Observe Infer/Question Surfacing experiences, possibilities, expectations • • What are some predictions that we might make? • What assumptions might be underlying our predictions? • What are some questions we are asking that this data might help us answer? What might we be able to learn from this data? Communicating ideas about data using visual images and representations What data do we want to convey? • What visual would communicate this data most clearly, accurately and completely? • What information and labels will we need to provide to the visual to ensure that the data represented is clear? • Analyzing and making observations about data • What important points seem to “pop out”? • What are some patterns or trends that are emerging? • What seems to be surprising or unexpected? • What are some things we have not explored? Generating possible explanations for the observations of the data • What inferences and explanations can we draw? • What questions are we asking? • What additional data might we explore to verify our explanations? • What tentative conclusions might we draw Adapted from Wellman, B. , & Lipton, L. , 2004. Data-Driven Dialogue: A Facilitator’s Guide to Collaborative Inquiry. Sherman, CT: Mira. Via LLC. Used with permission. The Using Data Initiative, TERC© 2007. All rights reserved. DCK Chart & Handout

Multiple Measures Sharpen Our Using Data ©TERC 2013

Data Drill Down Triangulate Student Learning Data Task 5: Build Data Literacy S ourc e 3 3 : St ork uden t. W Source 2: Benchmark Assessments t men ess Ass ate : St 1 rce Sou Task 6: Aggregate Data Task 7: Disaggregated Data Task 8: Content Strand Task 9: Item Data Task 10: Student Work Task 11: Common Assessments & other Task 12: Develop a Student-Learning Problem and Goal Using Data ©TERC 2013

What’s My Line? - Do the Work! The line segment below has been divided into three equal parts and labeled with letters as shown. The value of point A is 0, point B is 3/4, and the value of point D is 2. 25 A B 0 3/4 C D 2. 25 1 a. What is the value of point C? 1 b. Plot the value of point C on the number line. Show all of your work. Explain how you found the point value of C. Source: STAR Program, Center for Educational Services, Auburn, Maine (permission pending) Using Data ©TERC 2013 18

Using Data ©TERC 2013 PM p. 121 PM, pp. 125 & 126 Student Work: Deconstruct Task 19

Task Deconstruction Example Using Data ©TERC 2013 20

Sample Student Learning Problem Statement Seventh-grade students at Lincoln School are below grade level in mathematics. Weak areas are number sense and algebraic reasoning as evidenced by these data: • 64% of students are below proficiency on the 2013 Nebraska State Assessment • 52% of students are below basic on the 2013 district benchmark assessment • 37% of students scored a 1 on the 2013 school common assessment These performance gaps were noted: • 49% of Special Needs students are below proficiency, while 33% of all other students are below proficiency as evidenced by the 2013 Nebraska State Assessment Using Data ©TERC 2013

“Too often in education, we start with answers before we have understood the problem we’re trying to solve. ” Tony Wagner, Co-Director of Change Leadership Group, Harvard University Graduate School. Education Week, August 15, 2007.

Fishbone Cause-and-Effect Analysis Also known as the Ishikawa Diagram

Fishbone w/Spend a Buck Equity All students not taught at grade level. Critical Supports School culture not collaborative Teachers have low expectations for some students 6 th-grade unit on motion not aligned with new standards. K-5 curriculum not developing motion concepts Curriculum Teacher Preparation Teachers not comfortable with physical science content Fragmented PD Inconsistent implementation of curriculum units Instruction Unit assessments not aligned with national assessments Assessment Problem 6 th-grade students are below proficiency in physical science; achievement gap between Special Education students and all other students

Verify Causes: Research Wall Priority Causes Questions Sources Findings Cause 1 Cause 2 Cause 3 Using Data ©TERC 2013 25

Logic Model Chain Student Learning Problem & Cause IF WE DO… Strategy A Student Learning Goal B Outcome THEN… Using Data ©TERC 2013 Outcome

Monitoring 1 To what degree are we implementing our strategy? 2 Is the strategy being implemented achieving the desired outcome? How will we know? What evidence will need to collect and summarize? What evidence will need to collect and analyze? Using Data ©TERC 2013

Classsroom Focused: Action Plan Using Data ©TERC 2013

Data Analysis Leads to School Improvement Plans • Grade and course teams report findings to whole faculty. • Faculty analyzes the results for trends and patterns. • Results of the faculty analysis inform the development of the School Improvement Plan. Using Data ©TERC 2013