Dashboard Report 2019 Dashboard Report 2019 Introduction Theory

  • Slides: 14
Download presentation
Dashboard Report 2019

Dashboard Report 2019

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Problem:

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Problem: • Children growing up in informal settlements have limited access to quality ECD services. • This creates a disadvantage at a critical stage in child development. • Perpetuates cycles of poverty and exclusion. Improving access to quality ECD programmes is a key factor in addressing inequality in SA.

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Adopt-a-Crèche

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Adopt-a-Crèche programme: • Aim: to support and promote quality ECD education for children growing up in informal settlements in the West Rand, Johannesburg and Ekhurleni • Mission: to provide training for teachers working in crèches in these informal settlements This report presents the results of the Monitoring & Evaluation data collected for the 2018 training cohort.

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Evaluation

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Evaluation Question: What is the impact of the Adopt-a-Crèche programme? Design Qualitative evaluation design Sample 186 training participants 2 training facilitators 300 children Instruments Document analysis (Registers, Training evaluation forms, Crèche visit checklists & testing scores) and Focus group discussions. Analysis Quantitative: Descriptive statistics Qualitative: Thematic content analysis

Dashboard Report 2019 Introduction Theory of Change A theory of change provides a visual

Dashboard Report 2019 Introduction Theory of Change A theory of change provides a visual and descriptive theory of how and what change an intervention causes. This theory of change is based on the evidence collected during the evaluation. It demonstrates the following: 1. Problem statement 2. Adopt-a-Crèche intervention 3. Masenze Training Outputs 4. Impact on Practitioner 5. Impact on Crèche 6. Impact on Children 7. Impact on Parents 8. Impact on Community Reach Outputs Impact Conclusion Recommend ations

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations

Dashboard Report 2019 Introduction Theory of Change Reach Estimated no. of unregistered crèche’s in

Dashboard Report 2019 Introduction Theory of Change Reach Estimated no. of unregistered crèche’s in informal settlements (West Rand, Johannesburg & Ekhurleni) *Sources: DSD Registry (2016), ETDPSETA (2017) Impact Conclusion Recommend ations 59 186 2891 8% 5% 8% Crèche’s No. of crèche’s identified and recruited to date Outputs Practitioners Children Estimated % of CRÈCHE’S reached Estimated % of PRACTITIONERS reached Estimated % of CHILDREN reached 782 3910 38318 Crèche’s Practitioners Children

Dashboard Report 2019 Reach Outputs Impact Demographic Reach Conclusion Recommend ations 70 50 te

Dashboard Report 2019 Reach Outputs Impact Demographic Reach Conclusion Recommend ations 70 50 te di an In ur ed Bl a 50 5 1 0 -1 yr Ethnicity 20 Age 70 55+ yrs 30 5 25 -35 yrs < 25 yrs ia n 1 In d Co l k 10 W hi 50 ac 50 te 36 -55 yrs Bl ECD Practitioners Gender 30 2 -4 yrs 10 W hi 50 ck Children 5+ yrs Co lo Theory of Change ou re d Introduction 80 100 20

Dashboard Report 2019 Introduction Theory of Change Reach 2018 Training Outputs 2 8 118

Dashboard Report 2019 Introduction Theory of Change Reach 2018 Training Outputs 2 8 118 Level 1 & 2 grps Outputs Impact 39 Level 1 & 2 ECD Course First Aid Level 1 Beneficiaries Fire Awareness Parenting 55 38 22 33 Child Protection 41 HIV & Aids Awareness 12 0 2018 2019 2020 Level 1 & 2 Graduates 59 Center’s of Excellence in 2018 Recommend ations Participants per training course - 2018 Short Courses 37 Conclusion 32 Leadership 26 Financial Management Toy Training 21

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Training Outputs to date 2

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Training Outputs to date 2 8 118 37 Level 1 & 2 grps Short Courses Beneficiaries Impact Conclusion Training & Short Course Participants 140 120 100 80 60 40 20 0 118 0 2017 37 2018 12 2019 2020 Centre’s of Excellence 0 2018 0 2019 2020 37 30 0 2018 0 Level 1 & 2 Training Participants 40 12 Recommend ations 2019 2020 Level 1 & 2 Graduates 20 12 10 0 0 2017 0 2018 2019 2020

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact on practitioners 100% Conclusion

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact on practitioners 100% Conclusion Recommend ations 100% Increased capacity Gain knowledge & skills 60% Feel better able to manage their crèche and improve internal structures Experience Personal development 73% Feel more equipped to work with children & have better interactions as a result 20% Report to have learned techniques for interviewing parents 1% Would like to share their knowledge & skills with others

Dashboard Report 2019 Theory of Change Introduction Reach Outputs Impact on crèche’s Impact on

Dashboard Report 2019 Theory of Change Introduction Reach Outputs Impact on crèche’s Impact on children Improvement (First vs. final visit) GR RR Improvement (Pre vs. post scores) 29% 24% 12% 58% 29% 12% Catch & Throw Hop on two legs 12% Themes – Practitioner feedback: • Rules are communicated • Host parent workshops 8% 6% Name 1 Shape Count 1 -5 Kick a ball ce ur 42% Promoted the growth in no. of children ”Our school is shining now” . . . en . . it. . rre Co ra te In e Cr os d. Un id lin M 0% ct w . . l al ab Dr es ck 3 e m Ki Sh a. . . l. . . Co 3 Na e Na m un o Co tw on t 1 -5 . . r. . Th p & Ho tc h Ca Themes – Practitioner feedback: • Financial Management improved • Policies provided structure • Increased organization • More professionalized 24% 8% 14% 5% 11% 9% ct p 27% s& so 50% Promoted improved interactions with parents ”We even did a workshop for parents, we all gained” s s Name 1 Colour GR R Improvement (Pre vs. post scores) Re ay ar ea ty Pl fe Sa ng Pl an ni in m Ad ep ke Re co r d Po lic i in g es 0% Recommend ations Impact on parents 58% 57% Conclusion Improvement in the pre and post assessment scores across all areas of development observed, except for interacting with others (Gr R group). Impact on community Themes – Practitioner feedback: • Sharing information • Recognition from DSD More quality cheche’s for children living in informal settlements

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Overall

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations Overall the evaluation resulted in: 1. The development of a theory of change, 2. The presentation of findings in the form of a logic model, 3. A descriptive account of the Adopt-a-crèche programme’s reach, outputs and impact, 4. A dashboard report that can be updated with the latest figures and 5. Recommendations for enhancing the programme’s M&E tools and processes. A positive impact was noted across four broad areas, namely: the crèche, children, parents and the surrounding community. The evidence, however, does need to be strengthened according to the recommendations that follow.

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations 1.

Dashboard Report 2019 Introduction Theory of Change Reach Outputs Impact Conclusion Recommend ations 1. Adapt current M&E tools to capture data points linked to the Theory of Change • First & final visit crèche checklist • Training evaluation form • Developmental observation 2. Design a new baseline and end line procedure for the developmental observations • Specific recommendations around sampling size and groups • Procedure for the base and end line assessment 3. Incorporate a follow-up focus group into M&E plan to assess long-term outcomes