Building Stronger Professional Development Systems Using Data to
Building Stronger Professional Development Systems: Using Data to Improve Implementation Jennifer Coffey, Ph. D. OSEP Project Director and SPDG Program Lead Audrey Desjarlais Knowledge Mobilization Coordinator, Signetwork
Implementation: Research on Tools; Research as Tool Sonja K. Schoenwald Professor of Psychiatry & Behavioral Sciences Medical University of South Carolina August 20, 2013, Global Implementation Conference.
TODAY’S AGENDA
AGENDA – Day One Continued
Thank You! Planning Committee Members, Staff, and Facilitators SPDG Members • • Susan Bailey-Anderson, Montana Don Briere, Connecticut Kathy Cox, Illinois Alice Henley, Connecticut David Merves, Delaware & New Hampshire Brenda Oas, North Dakota Mary Steady, New Hampshire RRCP Implementation Core Team • • • Jeanna Mullins, Mid-South RRC Kim Hartsell, Southeast RRC Nancy O’Hara, Mid-South RRC OSEP • • • Jennifer Coffey Tina Diamond David Guardino Pat Gonzalez Shedeh Hajghassemali Terry Jackson Greg Knollman Ingrid Oxaal Corinne Weidenthal Susan Weigert Grace Zamora Duran Signetwork Staff • • Linda Lynch Melissa Moseley Leslie Stephenson Audrey Desjarlais
Invited Guests OSERS • Michael Yudin, Acting Assistant Secretary, US Department of Education OSEP • Melody Musgrove, Director, OSEP • Ruth Ryder, Deputy Director, OSEP • Larry Wexler, Director, Research to Practice Division Parent Centers/ Regional PTACs • Barbara Buswell, Region 5 • Debra Jennings, Region 1 • Connie Hawkins, Region 2 • Nora Thompson, Region 6
SPDG Participation • 43 States Represented • State teams range from • • • 1 rep (8 states) CA, CO, MA, MN, NE, PA, VA, WI 2 reps (4 states) AR, MT, RI, SC 3 reps (6 states) AL, ID, NC, OR, VT, WY 4 reps (9 states) AK, CT, IL, IN, KS, KY, MO, NM, TN 5 reps (8 states) DE, FL, GA, MD, MI, NH, OK, UT 6 reps (1 state) MS • Partners include representatives from: Parent Organizations, Institutes of Higher Education
Welcome!
Fiscal Year (FY) 2014 • FY 2015 • What you can do to prepare • GPRA/Program Measures • Partners • Current/past data – telling your story • Start sharing with others what a new SPDG could accomplish • IDEA Statute – SPDG • www. Signetwork. org
The Letter and Spirit of the Law • Partnerships • Serving children with disabilities • Fulfilling the purpose of your project
GPRA/Program Measures – Pilot Review • External Review Results for FY 2012 • Program Measure 1: 11 of 22 initiatives (50%) met the set targets • Program Measure 2: 4 of 22 (18%) initiatives met the targets they set • Program Measure 3: 7 out of 22 (32%) initiatives me the targets they set • Program Measure 4: 1 out of 1
Reliability for the pilot • For Program Measure 1 more variation in scores – from complete agreement to 44% difference. • For Program Measure 2 there were no disagreements for the first pair of reviewers and just 1 disagreement for the 2 nd pair. • For Program Measure 3, there was 1 disagreement for the first pair of reviewers and 4 disagreements for the 2 nd pair. • For Program Measure 4, there was 1 disagreement for the first pair and none for the second pair.
Current External Review • Westat – Data Quality Initiative • Will produce a 1 -page document that summarizes each project’s results • OSEP will provide another FAQ document to improve the data coming from projects
This Meeting • Why focus on implementation fidelity? • Implementation Science • We are the resource • Other resources – AI Hub
INTRODUCTIONS – ALLISON METZ
SMALL GROUP DISCUSSIONS
Discussion Process PURPOSE: • To learn from others about tools and approaches in using data to: • define your practice, • improve the fidelity of the practice • effectively engage the various drivers to support the use of data
Discussion Process 1. Pick a topic • ? s to define the what and how – of the ‘what’ • ? s to improve the fidelity of ‘what’ through the implementation drivers • ? s about coaching systems to improve the fidelity of ‘what’
Discussion Process 2. 3. 4. 5. 6. 7. 8. State Teams – Split up Groups – 8 -10 people Facilitator – OSEP & RRCP Listen & Engage Write your questions Take Notes Return to Academy Hall for Allison & Jennifer’s Q&A session – 11: 30 AM
LARGE GROUP Q & A
What’s Next 11: 45 -1: 00 pm - Lunch on your own, dining options in packet 1: 00 -1: 30 pm – State team time, Action Planning, Meet with your evaluators or Meet with Project Officers
AFTERNOON SESSIONS
DAY TWO – BEGINS @ 8: 00 am - Project Sharing - U. S. Dept of Ed Presentation
- Slides: 24