PIIRS experiences and challenges CARE Ethiopia Programs PIIRS

PIIRS experiences and challenges CARE Ethiopia Programs PIIRS refresher/induction training Bishoftu, Ethiopia August 2017

Outline ØTOC & Programs ØCARE Ethiopia PIIRS reporting & contribution to CI ØExperiences ØFollow-up actions 1 May 19, 2021

CARE Ethiopia Theory of change Economic & social transformatio n of the most vulnerable women & girls 2 May 19, 2021 Institutions are responsive to women & girls priorities Women & girls have equal access to social services &economic opportunities Women and girls realize & exercise their full potential Women and girls have access to and control over household assets and resources Cultural & social norms & attitude support women right and aspiration

The CARE Ethiopia Programs CFIRW 3 May 19, 2021 PSAG RPUFY

Impact and knowledge system • Developed in 2011, following the ‘P’ shift • Subsystems such as monitoring, evaluation, lesson generating(MEL) and impact measurement • Intended to ensure that whether the project/program design, monitoring, evaluation, learning and impact measurement functions are in line with the program principles and program characteristics

Impact & Knowledge system • Set to coordinate and harmonize the projects/programs MEL and impact measurement works to enable CARE demonstrate program impacts at systemic and structural level • So far CARE Ethiopia has nearly 20(65% female MEL professionals) qualified M&E/LDM professional that are assigned at head office and field offices 5 May 19, 2021

Current forces CARE USA/ CI& Gov. Own experiences, & sectorial favouritism Gov. &Targe ts GAC CARE Ethiopia GATES Foundatio ns & other donors May 19, 2021 USAID EU

CARE MEL/LDM: Consultancy To establish MEL system that will lead to: May 19, 2021 a. Unify and organize CARE Ethiopia’s data(Project, program & PIIRS) and, b. Strengthen the study of program impact.

CARE Eth. PIIRS FY 16 report & contribution to CI 8 May 19, 2021

Reflection from PIIRS FY’ 16 What we did? What do we lack ? All projects completed project information for FY 16 on time(REACH 100 % but impact ? ) Heterogeneous information and difficulty in Consistency accumulate(HH Vs individual, # Vs % …) & direct indirect All projects have M&E framework & plans Project specific/ donor based and minimal flexibility to accommodate country office expectations More nearness while choosing information type and purpose during MEL implementation Almost all have conducts surveys(baseline, midterm and end line) Sampling, headcount, use of regional & national level values for projects baseline and incomplete survey(humanitarian) Clarity, consistency and acceptability at outside of CARE as well Commitment to demonstrate impact at country level Distinct approaches and different unit of measurement, different form of information. Difficult to accumulate projects contribution towards organizational TOC/ goals Uniformity starting from baseline through to end line and impact assessment All projects reported its 9 information Difficult to measure values obtained through different approaches. Clarity on how PIIRs accommodate information generated through different methodologies May 19, 2021 What could we do?

Follow-up action by CARE Ethiopia • Requested & received assistance from CARE HQ-MI • Two months in country support by MS -student intern from Emory university, USA • A day long training on PIIRS • Global indicator mapping Vs CARE Ethiopia projects • Mapping CARE Ethiopia implementation areas and identification of potential double countering • Field visit at NPO, EH & WH field offices • Findings shared to LDM/PMT 10 May 19, 2021

Generated evidences: Where is project data coming from? • Village Agents • Definition? • Government staff / volunteers / kebele leaders • Small component of their job • High turnover • Lack of training • Community Facilitators • GROW E Hararghe example • 1348 groups • 6 CFs • Monthly visits?

Double Counting • Geographic Overlap • Sectoral Overlap • Projects with multiple activities • Unclear definitions of direct / indirect participants • Lack of activity specific attendance lists • Inconsistent Master Beneficiary Lists (MBLs) • Untrained Village Agents • No M&E officer / not enough human power

Information Flow Chief of Party Program Coordinator Village Agent Sector Head Country Office LDM Manager POM? Field Office LDM Manager? PQL? Community Facilitator Data Clerk Project Team Leader Project Manager M&E Officer

Thank you 14 May 19, 2021