Progress Monitoring Diagnostics Reporting December 8 2015 AGENDA
Progress Monitoring & Diagnostics Reporting December 8, 2015
AGENDA o Introduction and Purpose o Navigation Performance Matters Overview o High Impact Reports Performance Matters/ADMS o UNIFY Student Item Analysis (SIA) Navigation o Blender Discussion and Resources o FY 16 Winter Diagnostics Data Reporting Top-performing urban school district in Florida
Introduction
Levers to Improve Instruction CULTURE SYSTEMS INSTRUCTION LEADERSHI P Top-performing urban school district in Florida
Alignment of Standards Based Teaching and Learning Standards WRITTEN Curriculum TESTED Student Learning Assessment Instruction TAUGHT
Alignment of Standards Based Teaching and Learning Are we Learning collaborating Team around data, Meetings content, Administrators instruction, Teachers and student LTF mastery? Coaches What Standards should Scope and students Sequence know and Breakdown of be able to Standards do? Guiding Questions Aligned Are Assessments students FSQ learning NGSQ the standards? USA Diagnostics Aligned Resources What are the in Blender aligned Unit Plans instructional Lesson Plans resources? Resources
What evidence do we have that instruction is being delivered to the full intent and rigor of the standards? Session: Using Data to Inform Standards Based Teaching and Learning Top-performing urban school district in Florida
Top-performing urban school district in Florida Purpose To identify changes that must be implemented to positively impact student achievement
Top-performing urban school district in Florida Learning Goal: Participants will be able to identify key data points and progress monitor data trends through routine navigation of Performance Matters reports to effectively communicate and support standards based learning. • Level 4: Participants are able to identify key data points and progress monitor data trends through routine navigation of Performance Matters reports to effectively communicate, disseminate information, and troubleshoot issues that will in turn support standards based learning which would impact student performance. • Level 3: Participants are able to identify key data points and progress monitor data trends through routine navigation of Performance Matters reports to effectively communicate and support standards based learning. • Level 2: Participants are able to identify data points and some data trends through navigation of both EDW and Performance Matters reports to communicate and support standards based learning. • Level 1: Participants are able to identify limited data points, some data trends and can minimally navigate both EDW and Performance Matters reports and communicates when necessary.
CONFIDENTIALITY Florida Statutes, Chapter 1002. 22, and the Family Educational Rights and Privacy Act (FERPA) limits and makes confidential student related records and information. All applicable laws, rules, and regulations and codes of ethics govern the use of this data. ** In accordance with Board Policy 2. 142
Top-performing urban school district in Florida Performance Matters Navigation Preferred Browser: Google Chrome From the Portal: From Unify or BBCard:
Power of i. Filters The i. Filters are useful when drilling down to specific student demographics and other indicators. i. Filters can also be used for comparative analysis purposes. Early Warning Indicators help with an inquiry driven approach to view other factors impacting student achievement.
Progress Monitoring with Performance Matters Administrators – School View Users Top-performing urban school district in Florida
High Impact Reports In Performance Matters/ADMS Top-performing urban school district in Florida
t s ue Q g in R o c e g n i rd tr a M r o f ix id u G s n io
Top-performing urban school district in Florida Item Analysis How did the school perform on a specific assessment? What are the areas of weakness that need remediation? What are the strengths to capitalize on or celebrate?
Print options - PDF - CSV (Excel)
Shows the number of items on an assessment as well as how many student results you are viewing. This number will change as you add filters. Top-performing urban school district in Florida Scoring at or above the Mastery level will be colored green. Scoring below the Threshold Level will be colored red. Any other scoring will display as yellow.
The system will determine whether a question is easy, average, or challenging based on the percentage of students who got it correct. Easy More than 70% answered correctly Average Between 40 -69% answered correctly Top-performing urban school district in Florida Challenging Less than 40% answered correctly
Item Analysis - Standards Analyze the standard. Is it an exhibited weakness or critical weakness?
Click on blue hyperlink of the question number. Item Analysis
These bars indicate the percentage of students who chose each response (0. 000 incorrect response, 1. 000 – correct response). The black bar indicates the district average of students who chose the correct answer. These bars indicate the performance percentages of all question items related to the benchmark or standard chosen.
GUIDING QUESTIONS Activity One ITEM ANALYSIS REPORT Are there standards on which the entire grade level was less successful? What changes or modifications can be made to instruction for re-teaching those standards? How can student performance on those standards be monitored for mastery? Record findings Top-performing urban school district in Florida
Top-performing urban school district in Florida Executive Director’s Report How can mastery levels be monitored within my school (i. e. , teacher/course)? How can mastery levels be monitored by demographics? How did my teachers/school compare to the others (i. e. , standard, self, and others)?
Executive Director’s Report Assessment Type Assessment Category Sub-groups Suppress
Executive Director’s Report i. Filters applied to show only 504 students Top-performing urban school district in Florida
Executive Director’s Report Top-performing urban school district in Florida
GUIDING QUESTIONS Activity Two EXECUTIVE DIRECTOR’S REPORT Is there a particular demographic group represented that is struggling? Is that demographic group represented in a particular teacher’s class? What is needed to support instruction for all students to have successful outcomes? Record findings Top-performing urban school district in Florida
Top-performing urban school district in Florida Local Test Performance by Teacher How can an assessment administered by a teacher in a grade level be viewed? How can a summary of the students who have met or exceeded the mastery level for an assessment be viewed?
Local Test Performance by Teacher 1. 2. Select the School, Course Subject, Assessment Category, and Test. (Multiple Assessment by holding Shift key while selecting). Select Display Courses and Display Met and %Met. Click Process
Local Test Performance by Teacher The report will display by Teacher, School, Area, and District with columns for each test selected. Progressing can be viewed over time for performance on FSQ, USA, etc. Top-performing urban school district in Florida
GUIDING QUESTIONS Activity Three LOCAL TEST PERFORMANCE by TEACHER Which teacher(s) have not administered a particular assessment? Is the overall performance by teacher improving for classes in the percent (%) Met and Count for the assessments? Is there a particular teacher with class performance higher where best practices and LTM discussions can be shared to support other teacher(s)? Record findings Top-performing urban school district in Florida
Top-performing urban school district in Florida Class Scores by Benchmark How can a class level performance over time on a particular standard or in a reporting category be examined? How can a pattern throughout a class on a particular standard or reporting category be determined? How are skills which challenged students the most be identified?
Class Scores by Benchmark Select the School, Teacher, Class by Test or By Student. Select High Stakes, State Test Subject, and Test. Click Process.
Class Scores by Benchmark by Test Top-performing urban school district in Florida
Class Scores by Benchmark Graph Drill Through Top-performing urban school district in Florida
Class Scores by Benchmark by Student Name Top-performing urban school district in Florida
GUIDING QUESTIONS Activity Four CLASS SCORES BY BENCHMARK How are students progressing on standards from one assessment to the next? What reporting categories and/or standards have students mastered? How can groups be established based on this data? Record findings Top-performing urban school district in Florida
Top-performing urban school district in Florida Unify Student Item Analysis From the Portal: palmbeachschools. org From ADMS or BBCard:
Top-performing urban school district in Florida How can progression by standards on an assessment be identified? Where can performance by Depth of Knowledge (DOK) or Complexity on an assessment be monitored? How can comparison be made to standard, self, and others?
Unify Student Item Analysis Breeze
Top-performing urban school district in Florida Navigate to Unify SIA
Top-performing urban school district in Florida Select an Assessment
Top-performing urban school district in Florida Item Attributes Tab
Top-performing urban school district in Florida Depth of Knowledge
Top-performing urban school district in Florida Complexity
Top-performing urban school district in Florida Question Interactions
Top-performing urban school district in Florida Understanding Achievement Bands (Below Threshold Value, and Mastery Value)
Top-performing urban school district in Florida Viewing an Item Detail
Top-performing urban school district in Florida Viewing an Item
Top-performing urban school district in Florida Setting Filters – Selecting Teacher Click “All” to select Teacher; click OK Note: Selecting more than one teacher will combine results.
Top-performing urban school district in Florida Teacher Performance At a glance view of student count performing in the achievement band Teacher compared to Others Advance to view more standards analysis
Top-performing urban school district in Florida Share, Export, and Resources
GUIDING QUESTIONS Activity Five UNIFY Student Item Analysis (SIA) Did students correctly answer questions in one level of Depth of Knowledge (DOK) more frequently than another? What standards have students not mastered? What types of questions (i. e. , DOK level, Choice, Technology Enhanced Interactions -TEI) did the students struggle with? Which benchmarks/standards need reinforcement or remediation? Record findings Top-performing urban school district in Florida
Principal Collaboration Top-performing urban school district in Florida
Elementary Curriculum Support Top-performing urban school district in Florida
Science Support
Scope and Pacing Ensure instruction aligns with the district scope. Following this pacing guide permits enough time for instruction, remediation, and covers all tested benchmarks prior to the state assessment.
Resources for Science Standards Assessment • Florida Panthers Hockey modules • Review games and Power. Points • Mini-assessments, question stems, and review pieces from Cpalms • Fair game benchmark lessons • Vocabulary cards (interactive and static) in English & Spanish • Graphic organizers and writing prompts • Sample science-based informational texts
Using Data to Change Instruction These links, for teachers and administrators, connect directly to the specific assessment results in one click. Teachers can then use benchmark-specific resources for remediation.
Remediation Resources Ø Instructional Resource Chart Additional resources aligned to the benchmarks highlighting various instructional tools and introductory/review applications. Found on Blender’s Grade 5 Science Landing Page under the “Scope and Pacing” tab, (also under the “resources” tab). Ø Digital Lessons: Reteach Resources All digital lessons provided by the publisher within Think. Central offer reteach resources. Found in Think. Central Digital Lessons – Publisher Resource Ø Review Games by Reporting Categories Big Idea interactive games focus on Statewide Science Assessment (FCAT 2. 0) content. Found on Blender’s Grade 5 Science Landing Page under the “Resources” tab (FCAT 2. 0 Review Games). Ø Big Idea Posters Dual language visual guides representing abstract science concepts—Instructional tool for remediation/review Found on Blender’s Grade 5 Science Landing Page under the “Resources” tab (Big Idea Posters) Ø Edmodo Group: K-5 Science Teachers of Palm Beach County A plethora of additional benchmark focused hands-on activities, resources, and teacher collaboration Join Edmodo Group using code 2 dw 2 xb Science Coaches and Contacts Edmodo code is jvr 8 rk
Mathematics Support
Unit Resources on Blender • For each Unit of Instruction, teachers will have resources aligned to each standard/target for the Unit: • Targeted lesson plans with Power. Point presentations • Formative assessment tasks with rubrics • Resources for small-group instruction • Learning station/center activities • Cognitively complex tasks • Additional resources (i. e. , games, virtual manipulatives, problem solving tasks) aligned to the standard
Accessing Diagnostic Data
Accessing Diagnostic Data
Accessing Diagnostic Data
Other Good Data to Look At • PM > A+ > Local Test Scores > Comparative Results • Compares Classroom to School to District • Unify > Tests > Student Item Analysis > Interaction Scores
Supplemental lesson plans or activities Resources to Support FSA Tested Standards
Reading Support
Reading Intervention ~ iii Top-performing urban school district in Florida
Guide for Selecting K-5 Intervention Strategies, Systems & Programs • Immediate Intensive Intervention (iii) • Identifying Students’ Needs for Intervention • Determining Intervention and Progress Monitoring Tools for iii or Rt. I • Multi-Tiered System of Supports (MTSS) Top-performing urban school district in Florida
Standards Top-performing urban school district in Florida
Language Arts Florida Standards (LAFS) Tracking Sheet Top-performing urban school district in Florida
Units of Study Top-performing urban school district in Florida
Additional Resources
A Process for Teaching Language Standards
The Reading and Writing Connection
Re-teaching through Balanced Literacy Components After items have been analyzed, o If the majority of students are not meeting particular standards, consider whole group instruction using interactive read aloud, shared reading, or minilesson. o If there are six or less students not meeting standards, consider small group instruction, using strategy lessons, guided reading, shared reading, or individual conferring.
Principal Activity Six n o cti A r o f x i r t a d r co M g in Re Top-performing urban school district in Florida n a Pl
FY 16 Winter Diagnostics Data Reporting Top-performing urban school district in Florida
DIAGNOSTICS REPORTING EDUCATIONAL DATA WAREHOUSE (EDW) Interactive Roster Reports Interactive EOC Roster Reports (Civics only) FSA Diagnostics Reports FSA Profile Reports Diagnostic Diamond Report Diagnostic EOC Diamond Report (Civics only) PERFORMANCE MATTERS/ADMS & UNIFY Unify Student Item Analysis Class Scores by Benchmark Local Test Performance by Teacher Executive Director’s Report Comparative Report Baseball Card (Custom Report Creation)
DIAGNOSTICS REPORTING FAQs üWhen will Diagnostics data be available in Performance Matters? üDiagnostics data will be available in Performance Matters platform immediately in the Pending Item Analysis and Pending Student Item Analysis. üWhen will all reports in Performance Matters update to evaluate student performance? üAfter the overnight build, data will be located in Performance Matters/ADMS reports, Baseball Card, and Unify Student Item Analysis. üWhere can users locate student response and distractor analysis for interventions? ü Standards analysis utilizing the Unify Student Item Analysis and Item Analysis will be readily available for actionable plans and interventions. Top-performing urban school district in Florida
REFLECTION
Data Electronic Binder (e. Binder) Top-performing urban school district in Florida
Data Electronic Binder (e. Binder) Top-performing urban school district in Florida
Performance Matters Sharepoint To access Performance Matters resources, click the ADMS tile to get the Quick Doc guides. links Custom om fr created DW E specific Reports Top-performing urban school district in Florida
Today We Have Learned… Navigating High Impact Reports in Performance Matters Navigating Unify Student Item Analysis Performance Matters Share. Point Site
Contact Information Area EDW Specialist Office Phone Mobile Phone Area 1 Tracy Paletti 561 -434 -8351 561 -644 -2291 Area 2 Shannon Schwartz 561 -434 -8913 561 -644 -2456 Area 3 Taryn Butler 561 -434 -8742 561 -719 -2327 Area 4 Tiffany Latimore 561 -357 -5920 561 -644 -2505 Area 5 Kathleen Ali 561 -434 -8892 561 -644 -2724 Paula Joseph 561 -629 -8578 561 -876 -4609 Report Solutions Manager Top-performing urban school district in Florida
DIVISION OF Performance Accountability Mark Howard, Chief Performance Accountability Dr. Sandra Raymond-Roberts, Director Department of Research and Evaluation Paul Houchens, Director Department of Assessment
- Slides: 94