Using PostSchool Outcome Data for Program Planning Center

  • Slides: 60
Download presentation
Using Post-School Outcome Data for Program Planning Center for Change in Transition Services (CCTS)

Using Post-School Outcome Data for Program Planning Center for Change in Transition Services (CCTS) Improving post-school outcomes for students with disabilities in Washington state www. seattleu. edu/ccts 1 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Agenda • Overview of Post-School Survey • How to interpret post-school outcome (PSO) data

Agenda • Overview of Post-School Survey • How to interpret post-school outcome (PSO) data • Explore data − State data − District/ESD data • Using data for program planning 2 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Post-School Survey Overview 3 Center for Change in Transition Services | www. seattleu. edu/ccts

Post-School Survey Overview 3 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Federal Collection & Reporting • Requirement − States collect data and report to the

Federal Collection & Reporting • Requirement − States collect data and report to the Office of Special Education Programs (OSEP) on a series of performance indicators. • Purpose − Increased emphasis on accountability in education − Determine how well the state is meeting its responsibility under the Individuals with Disabilities Education Act (IDEA) − System improvement 4 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Critical Interrelationship of Indicators Four of the IDEA indicators relate to secondary transition. These

Critical Interrelationship of Indicators Four of the IDEA indicators relate to secondary transition. These indicators also correlate with one another. • Quality IEPs – Indicator 13 • Staying in school – Indicator 2 • Graduating – Indicator 1 • Positive post-school outcomes – Indicator 14 (Kohler, Gothberg, & Hill, "NSTTAC Evaluation Toolkit", 2009) 5 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Data Collection How are post-school outcome (PSO) data collected? What data are reported? 6

Data Collection How are post-school outcome (PSO) data collected? What data are reported? 6 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

What Data are Collected? • • Demographics (e. g. , gender, disability, race/ethnicity) Work

What Data are Collected? • • Demographics (e. g. , gender, disability, race/ethnicity) Work and school experiences Type of job or school Number of hours working or in school Contact with agencies Wages Optional open-ended questions 8 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Raw data: Open-ended follow-up questions • Are there additional reasons why: − You didn’t

Raw data: Open-ended follow-up questions • Are there additional reasons why: − You didn’t work more days (for those who didn’t work 90 days)? − You didn’t work more hours (for those working less than 20 hours)? − You didn’t complete a term (for those not enrolled at least one term)? • About how much was your average hourly wage? • I see you left high school before graduating. Are you willing to tell me why? 9 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

What additional information is in raw data? • Agency connections for each former student:

What additional information is in raw data? • Agency connections for each former student: − Whether they contacted a state agency − If so, which agency (e. g. , DVR, DDA, etc) • Responses to individual questions: − Whether former student made minimum wage − Number of hours worked − School attending − Program of study − Job title, company 10 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Limitations of survey data • Self-reported data • Not observational, verifiable • Responses depend

Limitations of survey data • Self-reported data • Not observational, verifiable • Responses depend upon question phrasing • Missing data − Refusal to participate − Questions left unanswered − Unable to reach leavers • Descriptive data 11 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Post-School Outcome Charts and Tables, 2016 -17 The following slides include a selection of

Post-School Outcome Charts and Tables, 2016 -17 The following slides include a selection of the state-level charts available in the TSF 2. 0 (www. ccts. TSF. com). Each set of charts is followed by a data table summary. 20 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – PSO Bar Chart Post-School Outcomes, Washington state, 2016 -17 Higher Education 21,

State – PSO Bar Chart Post-School Outcomes, Washington state, 2016 -17 Higher Education 21, 3% Competitive Employment Other Education/ Training Other Employment 34, 8% 3, 0% 13, 1% No Engagement 27, 8% (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) 21 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – PSO Summary Sample Size 6475 Higher Education 21. 3% Competitive Employment Other

State – PSO Summary Sample Size 6475 Higher Education 21. 3% Competitive Employment Other Education 34. 8% 3. 0% Other Employment 13. 1% No Engagement 27. 8% 22 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Breaking Down PSO Data by Engagement Post School Outcomes No Engagement Any Engagement Higher

Breaking Down PSO Data by Engagement Post School Outcomes No Engagement Any Engagement Higher Education Competitive Employment Other Education/ Training Other Employment 23 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Any Engagement vs. No Engagement, Five. Year Overview Line Graphs Any Engagement

State – Any Engagement vs. No Engagement, Five. Year Overview Line Graphs Any Engagement Five-Year Overview No Engagement Five-Year Overview Washington state 100% 90% 80% 60% 80% 40% 70% 20% 60% 0% 2012 -13 2013 -14 2014 -15 2015 -16 2016 -17 (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 24

State – Any Engagement vs. No Engagement, Five. Year Overview Summary Leaver Year Sample

State – Any Engagement vs. No Engagement, Five. Year Overview Summary Leaver Year Sample Size Any Engagement No Engagement 2016 -17 6475 72. 2% 27. 8% 2015 -16 6081 72. 2% 27. 8% 2014 -15 6153 70. 5% 29. 5% 2013 -14 5717 67. 4% 32. 6% 2012 -13 5348 65. 2% 34. 8% 25 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Engagement Outcomes, Five-Year Overview Line Graphs [1 of 2] Higher Education Five-Year

State – Engagement Outcomes, Five-Year Overview Line Graphs [1 of 2] Higher Education Five-Year Overview Competitive Employment Five-Year Overview Washington state 100% 80% 60% 40% 20% 0% 2012 -13 2013 -14 2014 -15 2015 -16 2016 -17 (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 26

State – Engagement Outcomes, Five-Year Overview Line Graphs [2 of 2] Other Education/Training Five-Year

State – Engagement Outcomes, Five-Year Overview Line Graphs [2 of 2] Other Education/Training Five-Year Overview Washington state 100% Other Employment Five-Year Overview Washington state 100% 80% 60% 40% 20% 0% 0% 2012 -13 2013 -14 2014 -15 2015 -16 2016 -17 (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 27

State – Engagement Outcomes, Five-Year Overview Summary [1 of 2] Leaver Year Sample Size

State – Engagement Outcomes, Five-Year Overview Summary [1 of 2] Leaver Year Sample Size Higher Education Competitive Employment 2016 -17 6475 21. 3% 34. 8% 2015 -16 6081 21. 8% 35. 3% 2014 -15 6153 22. 1% 33. 4% 2013 -14 5717 22. 3% 30. 9% 2012 -13 5348 23. 8% 28. 4% 28 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Engagement Outcomes, Five-Year Overview Summary [2 of 2] Leaver Year Sample Size

State – Engagement Outcomes, Five-Year Overview Summary [2 of 2] Leaver Year Sample Size Other Education/ Training Other Employment 2016 -17 6475 3. 0% 13. 1% 2015 -16 6081 2. 9% 12. 2% 2014 -15 6153 3. 3% 11. 6% 2013 -14 5717 3. 2% 11. 0% 2012 -13 5348 3. 3% 9. 8% 29 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Outcomes by demographic categories 30 Center for Change in Transition Services | www. seattleu.

Outcomes by demographic categories 30 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Any Engagement vs. No Engagement by Exit Categories Bar Charts Any Engagement

State – Any Engagement vs. No Engagement by Exit Categories Bar Charts Any Engagement by Exit Categories Washington state, 2016 -17 Graduated Dropped Out* 77, 2% No Engagement by Exit Categories Washington state, 2016 -17 Graduated 51, 1% Dropped Out* 22, 8% 48, 9% *Includes students who aged out or received an adult high school diploma or GED. (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 31

State – Any Engagement vs. No Engagement by Exit Categories Summary Exit Category Sample

State – Any Engagement vs. No Engagement by Exit Categories Summary Exit Category Sample Size Any Engagement No Engagement Graduated 5219 77. 2% 22. 8% Dropped Out* 1256 51. 1% 48. 9% *Includes students who aged out or received an adult high school diploma or GED. 32 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Engagement Outcomes by Exit Categories Bar Charts [1 of 2] Higher Education

State – Engagement Outcomes by Exit Categories Bar Charts [1 of 2] Higher Education by Exit Category Washington state, 2016 -17 Graduated Dropped Out* 25, 5% Competitive Employment by Exit Category Washington state, 2016 -17 Graduated 4, 1% Dropped Out* 36, 3% 28, 3% *Includes students who aged out or received an adult high school diploma or GED. (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 33

State – Engagement Outcomes by Exit Categories Bar Charts [2 of 2] Other Education/Training

State – Engagement Outcomes by Exit Categories Bar Charts [2 of 2] Other Education/Training by Exit Categories Washington state, 2016 -17 Graduated Dropped Out* Other Employment by Exit Categories Washington state, 2016 -17 2, 8% Graduated 12, 7% 3, 9% Dropped Out* 14, 7% *Includes students who aged out or received an adult high school diploma or GED. (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 34

State – Engagement Outcomes for Exit Categories Summary Sample Higher Competitive Other Exit Category

State – Engagement Outcomes for Exit Categories Summary Sample Higher Competitive Other Exit Category Size Education Employment Graduated 5219 25. 5% 36. 3% 2. 8% 12. 7% Dropped Out* 1256 4. 1% 28. 3% 3. 9% 14. 7% *Includes students who aged out or received an adult high school diploma or GED. 35 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Any Engagement vs. No Engagement by Gender Categories Bar Charts Any Engagement

State – Any Engagement vs. No Engagement by Gender Categories Bar Charts Any Engagement by Gender Categories Washington state, 2016 -17 No Engagement by Gender Categories Washington state, 2016 -17 F 71, 1% F 29, 0% M 72, 8% M 27, 2% (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 36

State – Any Engagement vs. No Engagement by Gender Categories Summary Gender Category Sample

State – Any Engagement vs. No Engagement by Gender Categories Summary Gender Category Sample Size Any Engagement No Engagement F 2349 71. 1% 29. 0% M 4126 72. 8% 27. 2% 37 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Engagement Outcomes by Gender Categories Bar Charts [1 of 2] Higher Education

State – Engagement Outcomes by Gender Categories Bar Charts [1 of 2] Higher Education by Gender Categories Washington state, 2016 -17 F M 25, 8% 18, 8% Competitive Employment by Gender Categories Washington state, 2016 -17 F M 29, 9% 37, 5% (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 38

State – Engagement Outcomes by Gender Categories Bar Charts [2 of 2] Other Education/Training

State – Engagement Outcomes by Gender Categories Bar Charts [2 of 2] Other Education/Training by Gender Categories Washington state, 2016 -17 Other Employment by Gender Categories Washington state, 2016 -17 F 3, 1% F 12, 2% M 3, 0% M 13, 5% (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 39

State – Engagement Outcomes for Gender Categories Summary Gender Sample Higher Category Size Education

State – Engagement Outcomes for Gender Categories Summary Gender Sample Higher Category Size Education Competitive Other Employment Education Other Employment F 2349 25. 8% 29. 9% 3. 1% 12. 2% M 4126 18. 8% 37. 5% 3. 0% 13. 5% 40 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Any Engagement vs. No Engagement by Race/Ethnicity Categories Bar Charts Any Engagement

State – Any Engagement vs. No Engagement by Race/Ethnicity Categories Bar Charts Any Engagement by Race/Ethnicity Categories Washington state, 2016 -17 American Indian/Native Alaskan No Engagement by Race/Ethnicity Categories Washington state, 2016 -17 58, 7% AIAN 41, 3% Asian 75, 0% Asian 25, 0% Black/African American 77, 1% Black 22, 9% Hispanic/Latino 74, 1% Hispanic 25, 9% Caucasian/White 71, 7% White 28, 3% Native Hawaiian/Pacific Islander 74, 1% NHPI 25, 9% Of more than one race/multiracial Not provided 69, 3% 77, 8% Two or more races Not provided (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 30, 7% 22, 2% 41

State – Any Engagement vs. No Engagement by Race/Ethnicity Categories Summary Race/Ethnicity Sample Any

State – Any Engagement vs. No Engagement by Race/Ethnicity Categories Summary Race/Ethnicity Sample Any No Category Size Engagement American Indian/Native Alaskan 184 58. 7% 41. 3% Asian 228 75. 0% 25. 0% Black/African American 406 77. 1% 22. 9% Hispanic/Latino 1436 74. 1% 25. 9% Caucasian/White 3728 71. 7% 28. 3% Native Hawaiian/Pacific Islander 54 74. 1% 25. 9% Of more than one race/multiracial 430 69. 3% 30. 7% Not provided < 10 77. 8% 22. 2% 42 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Engagement Outcomes by Race/Ethnicity Categories Bar Charts [1 of 2] Higher Education

State – Engagement Outcomes by Race/Ethnicity Categories Bar Charts [1 of 2] Higher Education by Race/Ethnicity Categories Washington state, 2016 -17 American Indian/Native Alaskan 14, 7% 36, 8% Asian Black/African American Competitive Employment by Race/Ethnicity Categories Washington state, 2016 -17 25, 1% 31, 5% AIAN Asian 22, 8% Black 30, 1% Hispanic/Latino 20, 7% Hispanic 37, 9% Caucasian/White 20, 7% White 35, 1% Native Hawaiian/Pacific Islander Of more than one race/multiracial Not provided 7, 4% 21, 4% 11, 1% NHPI Two or more races Not provided (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 50, 0% 31, 9% 44, 4% 43

State – Engagement Outcomes by Race/Ethnicity Categories Bar Charts [2 of 2] Other Education/Training

State – Engagement Outcomes by Race/Ethnicity Categories Bar Charts [2 of 2] Other Education/Training by Race/Ethnicity Categories Washington state, 2016 -17 Other Employment by Race/Ethnicity Categories Washington state, 2016 -17 American Indian/Native Alaskan 4, 4% AIAN Asian 2, 6% Asian Black/African American 3, 7% Black Hispanic/Latino 1, 7% Hispanic 13, 8% Caucasian/White 3, 5% White 12, 4% Native Hawaiian/Pacific Islander 0, 0% Of more than one race/multiracial Not provided 3, 0% 11, 1% NHPI 8, 2% 12, 7% 18, 2% 16, 7% Two or more races 13, 0% Not provided 11, 1% (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 44

State – Engagement Outcomes by Race/Ethnicity Categories Summary Race/Ethnicity Sample Higher Competitive Other Category

State – Engagement Outcomes by Race/Ethnicity Categories Summary Race/Ethnicity Sample Higher Competitive Other Category Size Education Employment AIAN 184 14. 7% 31. 5% 4. 4% 8. 2% Asian 228 36. 8% 22. 8% 2. 6% 12. 7% Black 406 25. 1% 30. 1% 3. 7% 18. 2% Hispanic 1436 20. 7% 37. 9% 1. 7% 13. 8% White 3728 20. 7% 35. 1% 3. 5% 12. 4% NHPI 54 7. 4% 50. 0% 16. 7% Two or more races 430 21. 4% 31. 9% 3. 0% 13. 0% Not provided < 10 11. 1% 44. 4% 11. 1% 45 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Any Engagement vs. No Engagement by Disability Categories Bar Charts No Engagement

State – Any Engagement vs. No Engagement by Disability Categories Bar Charts No Engagement by Disability Categories Washington state, 2016 -17 Any Engagement by Disability Categories Washington state, 2016 -17 Emotional/Behavioral Disability 60, 6% Other Health Impairment 72, 4% Specific Learning Disability Intellectual Disability Sensory Impairment Autism Other Disability 79, 5% 50, 5% 68, 5% 64, 3% 48, 1% EBD OHI SLD 39, 4% 27, 6% 20, 5% ID SI Autism 49, 5% 31, 5% 35, 7% Other (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 51, 9% 46

State – Any Engagement vs. No Engagement by Disability Categories Summary Disability Category Sample

State – Any Engagement vs. No Engagement by Disability Categories Summary Disability Category Sample Any No Size Engagement Emotional / Behavioral Disability 307 60. 6% 39. 4% Other Health Impairments 1682 72. 4% 27. 6% Specific Learning Disability 3172 79. 5% 20. 5% Intellectual Disability 392 50. 5% 49. 5% Sensory Impairments 89 68. 5% 31. 5% Autism 540 64. 3% 35. 7% Other Disability 293 48. 1% 51. 9% 47 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

State – Engagement Outcomes by Disability Categories Bar Charts [1 of 2] Higher Education

State – Engagement Outcomes by Disability Categories Bar Charts [1 of 2] Higher Education by Disability Categories Washington state, 2016 -17 Emotional/Behavioral Disability Competitive Employment by Disability Categories Washington state, 2016 -17 12, 7% EBD Other Health Impairment 22, 2% OHI Specific Learning Disability 23, 0% SLD Intellectual Disability ID 5, 9% 29, 3% 34, 5% 42, 4% 19, 9% Sensory Impairment 29, 2% SI Autism 27, 4% Autism 16, 7% Other 16, 4% Other Disability 14, 3% 22, 5% (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 48

State – Engagement Outcomes by Disability Categories Bar Charts [2 of 2] Other Education/Training

State – Engagement Outcomes by Disability Categories Bar Charts [2 of 2] Other Education/Training by Disability Categories Washington state, 2016 -17 Other Employment by Disability Categories Washington state, 2016 -17 Emotional/Behavioral Disability 4, 6% EBD 14, 0% Other Health Impairment 3, 5% OHI 12, 2% Specific Learning Disability 2, 0% SLD 12, 2% Intellectual Disability 3, 8% ID Sensory Impairment 7, 9% SI 20, 9% 9, 0% Autism 5, 2% Autism 15, 0% Other Disability 3, 8% Other 13, 7% (CCTS 2019, Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -17) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 49

State – Engagement Outcomes by Disability Categories Summary Disability Category EBD OHI SLD ID

State – Engagement Outcomes by Disability Categories Summary Disability Category EBD OHI SLD ID SI Autism Other Sample Higher Competitive Other Size Education Employment 307 12. 7% 29. 3% 4. 6% 14. 0% 1682 22. 2% 34. 5% 3. 5% 12. 2% 3172 23. 0% 42. 4% 2. 0% 12. 2% 392 5. 9% 19. 9% 3. 8% 20. 9% 89 29. 2% 22. 5% 7. 9% 9. 0% 540 27. 4% 16. 7% 5. 2% 15. 0% 293 14. 3% 16. 4% 3. 8% 13. 7% 50 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

What do your data tell you? 51 Center for Change in Transition Services |

What do your data tell you? 51 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Examining your data: Compare with state data • How do your outcomes compare with

Examining your data: Compare with state data • How do your outcomes compare with state outcomes? • What changes have occurred over the past 5 years? • Which subgroups are doing comparatively well/worse? 52 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Data Interpretation Worksheet (1) What do the data show? Hypotheses/ Questions Data needed/ sources

Data Interpretation Worksheet (1) What do the data show? Hypotheses/ Questions Data needed/ sources Program Improvement Leavers in my district are engaged at a lower rate than the state (65% vs. 72%). The main difference appears to be in competitive employment (19% vs. 35%) 53 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Hypotheses/Questions • What are your hypotheses about the data? • Why do your district’s

Hypotheses/Questions • What are your hypotheses about the data? • Why do your district’s results differ from the state? • Why do outcomes for some subgroups differ? 54 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Data Interpretation Worksheet (2) What do the Hypotheses/Questions data show? Leavers in my district

Data Interpretation Worksheet (2) What do the Hypotheses/Questions data show? Leavers in my district are engaged at a lower rate than the state (65% vs. 72%). The main difference appears to be in competitive employment (19% vs. 35%) • Are there large differences between subgroups? • What is our dropout rate? Is this impacting outcomes? • What areas of transition services are we lacking? • Are we providing enough community and work study experiences? • Are we connecting students with appropriate agencies? Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 Data needed/ sources Program Improvement 55

What additional data are needed? • What data do you need to examine your

What additional data are needed? • What data do you need to examine your hypotheses/questions? • Are these data readily available or do you need to collect data? • Can you use an evaluation tool? • Think about both system-level and student level data 56 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Data Interpretation Worksheet (3) What do the Hypotheses/ data show? Questions Leavers in my

Data Interpretation Worksheet (3) What do the Hypotheses/ data show? Questions Leavers in my district are engaged at a lower rate than the state (65% vs. 72%). The main difference appears to be in competitive employment (19% vs. 35%) • Are there large differences between subgroups? • What is our dropout rate? Is this impacting outcomes? • What areas of transition services are we lacking? • Are we providing enough community and work study experiences? • Are we connecting students with appropriate agencies? Data needed/sources Program Improvement • PSO data • District level data vs. state • Dropout vs. graduate engagement • Qu. IST • Discussion/survey/IEP review • PSO data 57 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Evaluation Tools • Indicator 13: Transition IEP Review Tool − Tool to evaluate whether

Evaluation Tools • Indicator 13: Transition IEP Review Tool − Tool to evaluate whether all quality components of the transition IEP are present • Qu. IST: Quality Indicators for Secondary Transition − The Qu. IST is a free program improvement tool that enables school districts to self-evaluate their transition services for students with disabilities. • NTACT Evaluation Toolkit − Toolkit with resources to assist transition educators and service providers to improve their programs and services by determining what is working, what is not working, and what needs to be changed or replicated. 58 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Program improvement • What programs could be improved or targeted based on this information?

Program improvement • What programs could be improved or targeted based on this information? • Keep in mind that data gathered may guide or change this • May be district-level, school-level, or student-level changes 59 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

What does the system need to support use of date for program improvements? •

What does the system need to support use of date for program improvements? • Administrative leader • Support for data collection • Teachers make the calls • Team review of data • Facilitator for review of data • Stories behind the data, “the heart part” 60 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

CCTS Transition Services Flow Chart (Johnson, 2012) Center for Change in Transition Services |

CCTS Transition Services Flow Chart (Johnson, 2012) Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 61

Data Interpretation Worksheet (4) What do the Hypotheses/ data show? Questions Leavers in my

Data Interpretation Worksheet (4) What do the Hypotheses/ data show? Questions Leavers in my district are engaged at a lower rate than the state (65% vs. 72%). The main difference appears to be in competitive employment (19% vs. 35%) • Are there large differences between subgroups? • What is our dropout rate? Is this impacting outcomes? • What areas of transition services are we lacking? • Are we providing enough community and work study experiences? • Are we connecting students with appropriate agencies? Data needed/ sources Program Improvement • PSO data • District level data vs. state • Dropout vs. graduate engagement • Qu. IST • Discussion/survey/I EP review • PSO data • ? • Strategies to target dropout rate • Qu. IST results will guide • New curriculum, community and workstudy sites • Interagency collaboration efforts Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0 62

Implementation Resources • NTACT Predictor Implementation School/District Self. Assessment: Checklist to determine degree to

Implementation Resources • NTACT Predictor Implementation School/District Self. Assessment: Checklist to determine degree to which school/district is implementing practices that promote positive post-school outcomes • NTACT Toolkits: Collections of resources on a variety of transition-related topics, including Resource mapping, School based enterprise, Transition Assessment, and Transition Fairs • T-Folio: Free transition portfolio tool to guide youth in exploring, identifying, and planning for their desired post-school goals 63 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Questions? Please complete a quick session feedback form. Thank you! 74 Center for Change

Questions? Please complete a quick session feedback form. Thank you! 74 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

CCTS Contact CCTS General Information ccts@seattleu. edu 206 -296 -6494 www. seattleu. edu/ccts @WACCTS

CCTS Contact CCTS General Information ccts@seattleu. edu 206 -296 -6494 www. seattleu. edu/ccts @WACCTS on Facebook, Twitter, and Pinterest 75 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Citations for PSO Charts and Data Center for Change in Transition Services, Seattle University

Citations for PSO Charts and Data Center for Change in Transition Services, Seattle University (January, 2019). Indicator 14 Post-School Outcome Mini-Report, Washington state, 2016 -2017. 76 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Additional Citations • Kohler, P. D. , Gothberg, J. , & Hill, J. (2009,

Additional Citations • Kohler, P. D. , Gothberg, J. , & Hill, J. (2009, November 12). NSTTAC Evaluation Toolkit [PDF]. Kalamazoo: Western Michigan University. http: //comm. eval. org/Higher. Logic/System/Download. Document. File. ashx? Document. File. Key= 8 d 43 c 53 a-e 804 -4647 -856 c-f 783 fceccff 2&force. Dialog=0 • Kohler, P. D. , Gothberg, J. E. , Fowler, C. , and Coyle, J. (2016). Taxonomy for transition programming 2. 0: A model for planning, organizing, and evaluating transition education, services, and programs. Western Michigan University. Available at www. transitionta. org. • National Technical Assistance Center on Transition. (2018, October). Post-School Outcomes: What’s New, How to Find, Improve, and Use Them [PDF]. Presented at DCDT, Cedar Rapids, Iowa. • Predictors of Post School Success [PDF]. (n. d. ) National Technical Center on Transition. http: //transitionta. org/system/files /resources/EPP_Matrix_Preds%20 revised. pdf 77 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

Creative Commons License • Except where otherwise noted, content in this presentation is licensed

Creative Commons License • Except where otherwise noted, content in this presentation is licensed under a Creative Commons Attribution 4. 0 International license. All logos and trademarks are property of their respective owners. • You may share and adapt this material, but you must give appropriate credit, provide a link to the license, and indicate if changes were made. 78 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0

OSPI Disclaimer This presentation is meant to supplement, not supplant reading bulletins and accompanying

OSPI Disclaimer This presentation is meant to supplement, not supplant reading bulletins and accompanying documents; guidance from the U. S. Department of Education; chapter 392 -172 A WAC; Part 300 of the federal regulations; and, the Individuals with Disabilities Act. This presentation and/or materials should be viewed and applied by users according to their specific needs. The presentation should be used as guidance and is not intended as legal advice. 79 Center for Change in Transition Services | www. seattleu. edu/ccts | CC BY 4. 0