Using PIIRS data for planning learning improving programing

  • Slides: 49
Download presentation
Using PIIRS data for planning, learning, improving programing CI MEL Community of Practice Session

Using PIIRS data for planning, learning, improving programing CI MEL Community of Practice Session 2 March 20, 2018

Quick recap: Where to find PIIRS data Staff – Reach – Impact http: //careglobalmel.

Quick recap: Where to find PIIRS data Staff – Reach – Impact http: //careglobalmel. care 2 share. wikispaces. net/FY 17%20 data

Quick poll • Go to www. menti. com and use the code 46 27

Quick poll • Go to www. menti. com and use the code 46 27 20 • Have you used PIIRS data in your role? 2 February 26, 2021

Case Examples for Using PIIRS Data • Mali Modibo Bamadio – National Coordinator for

Case Examples for Using PIIRS Data • Mali Modibo Bamadio – National Coordinator for MEL • Bangladesh Sazidur Rahman - Program Monitoring, Evaluation and Evidence Coordinator • Southern Africa Gideon Cohen – Evidence and Knowledge Management Specialist • Latin America and the Caribbean Claudia Sanchez – Regional Coordinator Program Quality and Impact 3 February 26, 2021

Mali 4 February 26, 2021

Mali 4 February 26, 2021

Mali PIIRS data used Staff, Reach and Impact linked to CI 2020 program strategy

Mali PIIRS data used Staff, Reach and Impact linked to CI 2020 program strategy and TOC geographic coverage. The data is often translated into Infographics, developed by the MEAL coordinator Purposes: ü Reflection on the PIIRS cycle and how the yearly PIIRS data collection can help us measure progressively our impact, from the project start. ü Discussions on whether we are going to achieve impact in the long term. ü Dialogue on alignment with the Program Strategy. ü Dialogue on PQ 5 February 26, 2021

Mali ü MEL: Inclusion of CARE’s others projects/Programs Results Indicators, beyond the Impact/Outcomes indicators

Mali ü MEL: Inclusion of CARE’s others projects/Programs Results Indicators, beyond the Impact/Outcomes indicators or CARE’s global ones) ü Writing proposals (e. g. inclusion of CARE’s global outcomes indicators) ü Communicating our work to various actors Internally, for example, with implementing partners during Country Office Coordinating Meeting (CCM) session (a space at CO level for Management decision making) Externally, during CO annual reporting, etc. 6 February 26, 2021

CARE Mali 2025 Programmatic Strategy, TOC and MEL CARE Mali 2025 Theory of Change

CARE Mali 2025 Programmatic Strategy, TOC and MEL CARE Mali 2025 Theory of Change of Programmatic Strategy 1. If the financial situation of women and girls is improved through more diversified livelihoods and equal access and control of productive resources. • Fight against gender inequality and strengthen women's voices 7 2. And women and girls living in chronically vulnerable areas have the capacity (information, skills, knowledge and means) to adapt their livelihoods to climate change and manage the consequences of conflict. • Increase resilience, reduce risk and respond to the humanitarian crisis 3. And governance at all levels is more effective and transparent, ensuring that women have better civic participation and better access to basic social services. • Supporting inclusive and improved governance capacities By 2025, women and girls in the 15 -49 age group (and their children under 5) are empowered to adapt to recurrent crises and their voices are strengthened. February 26, 2021

Mali CO Programs participants by Sector/Theme February 26, 2021 8

Mali CO Programs participants by Sector/Theme February 26, 2021 8

Mali CO’s Programs participants Direct vs. Indirect in 2017 February 26, 2021 9

Mali CO’s Programs participants Direct vs. Indirect in 2017 February 26, 2021 9

Mali CO Programs participants by Sector/Theme February 26, 2021 10

Mali CO Programs participants by Sector/Theme February 26, 2021 10

Level of CO’s projects alignment/integration of CARE’s Approach in 2017 February 26, 2021 11

Level of CO’s projects alignment/integration of CARE’s Approach in 2017 February 26, 2021 11

Mali CO PIIRS 2017 Process Findings and Recommendations Findings Strength Proposed Solutions Weakness 1.

Mali CO PIIRS 2017 Process Findings and Recommendations Findings Strength Proposed Solutions Weakness 1. PIIRS submission on time 2. Dynamic process for tools, review and discussion on harmonized methodology at CO level 3. Institutionalize PIIRS Workshop Organization 4. Collective PIIRS tools filling out by Project team include Project manager, M&E staff and other Project staff 12 Lack of Annual evaluations to allow the PIIRS to have the second comparison point of indicators 1. Review Projects and initiatives and Programs M 7 E Plan to see how that will be possible before the 2018 PIIRS 2. Elaborate action Plan to collect, analyze PIIRS data for 2018 February 26, 2021

Bangladesh 13 February 26, 2021

Bangladesh 13 February 26, 2021

Bangladesh FY-17 182 Staff 4 Humanitarian 48 Projects 40 Long-Term 4 Both Monitoring and

Bangladesh FY-17 182 Staff 4 Humanitarian 48 Projects 40 Long-Term 4 Both Monitoring and Evaluation Team 31 14 February 26, 2021 340 Staff

Bangladesh PIIRS 2017 -Presentation team 15 February 26, 2021

Bangladesh PIIRS 2017 -Presentation team 15 February 26, 2021

Bangladesh PIIRS data used COUNTRY Information REACH and STRATEGY Information IMPACT OUTCOMES Information 16

Bangladesh PIIRS data used COUNTRY Information REACH and STRATEGY Information IMPACT OUTCOMES Information 16 February 26, 2021

Bangladesh Purposes Review progress against strategies Proposal development including cost proposal PIIRS information as

Bangladesh Purposes Review progress against strategies Proposal development including cost proposal PIIRS information as barometer for program progress Updating Knowledge Platform (Knowledge Hub) Communicating with external audience (Donors, Partners, INGOs, Government and SDG goals) 17 Facilitate dialogue with Technical team at country level (Governance Coordinator, Resilience Coordinator) for program improvement February 26, 2021

Bangladesh: formats in which FY 17 data was used 18 February 26, 2021

Bangladesh: formats in which FY 17 data was used 18 February 26, 2021

Bangladesh: formats in which FY 17 data was used 19 February 26, 2021

Bangladesh: formats in which FY 17 data was used 19 February 26, 2021

Bangladesh: formats in which FY 17 data was used Latest measurement 85% Baseline 66%

Bangladesh: formats in which FY 17 data was used Latest measurement 85% Baseline 66% 20 Indicator February 26, 2021 6: Demand satisfied for modern contraceptive among women aged 15 -49

Bangladesh: formats in which FY 16 data was used 21 February 26, 2021

Bangladesh: formats in which FY 16 data was used 21 February 26, 2021

Bangladesh: formats in which FY 15 data was used 22 February 26, 2021

Bangladesh: formats in which FY 15 data was used 22 February 26, 2021

Bangladesh: formats in which FY 10 -FY 15 data was used teen n a

Bangladesh: formats in which FY 10 -FY 15 data was used teen n a C h s e d a gl CARE Ban 23 February 26, 2021 e Gaz c i f f O d l e i F ipur

The limitations q Incorporating IMPACT indicators (approved LFAs) q Impact data project specific q

The limitations q Incorporating IMPACT indicators (approved LFAs) q Impact data project specific q Adjusting reporting timeline (PIIRS vs Donors) q Resilience Marker (Rural focused on food security and nutrition; mismatched in WE context – progress misrepresented) q Lengthy Timing limits usage (review and approval process) ____________________________ 24 q Sharing information with partners and communities (Internal struggle) February 26, 2021

How would you recommend others to use PIIRS data? Recommendations Using PIIRS findings in

How would you recommend others to use PIIRS data? Recommendations Using PIIRS findings in country level leadership platforms Comprehensible presentation of complex information in simpler formats (3 Cs: Clear, Concise, Compelling) Ensure accountability of program team in the PIIRS process Visible use of PIIRS information by Regional Management Units for KML, Resource mobilization and advocacy 25 February 26, 2021

Has using the PIIRS data led to any type of actions or commitments in

Has using the PIIRS data led to any type of actions or commitments in your CO/region? Result sharing with Programs Heads to improve program effectiveness around gender, resilience and governance marker 26 February 26, 2021 Result sharing with M&E working groups (capacity building, quality improvement and Application) Consistent use of CI 2020 indicators for impact assessment and evaluation (To. R and STC contracts) Sharing information consistently at country and regional level Consistent use of PIIRS information in resource mobilization process

Southern Africa 27 February 26, 2021

Southern Africa 27 February 26, 2021

Southern Africa • PIIRS data has been used to aggregate our collective results, under

Southern Africa • PIIRS data has been used to aggregate our collective results, under six broad outcome areas, for the Impact Growth Strategy HER HARVEST OUR FUTURE. These results have been used as the means of measuring progress towards the 10 million IGS impact target, and are featured in the annual Impact Report (used to leverage resources for Southern Africa). We have also summarized these in an infographic (bottom left) to quickly share overall results. • PIIRS comparative graphics (e. g. on advocacy & scale up – bottom right) are used during the annual MEAL training, and participants from COs engage with the forms in detail, and see how they can use the data for reflection, analysis and action planning. Participants’ call for summary visualizations of PIIRS data led to the development of the global PIIRS FY 17 summaries 28 February 26, 2021

CARE Malawi: Use of Project and Country Profiles • Summaries of CO PIIRS FY

CARE Malawi: Use of Project and Country Profiles • Summaries of CO PIIRS FY 17 results were produced and circulated to COs. CARE Malawi used this as an opportunity to include staff in a reflection exercise about the results that the CO is achieving. This exercise helped to develop a national level picture in comparison to peer COs in the region, and allowed staff to think about CO strengths and where some gaps remain. 29 February 26, 2021

Latin America and the Caribbean LAC is one of the more UNEQUAL region of

Latin America and the Caribbean LAC is one of the more UNEQUAL region of the world, where the richest concentrate almost 50% of the income of the region, when the poorest benefit only 5% of it. Inequalities of income between countries, measured by the Gini coefficient, where 0 corresponds to perfect equality, and 1 to total inequality. Countries in red are more unequal than countries in green. 30 February 26, 2021 Social Dynamics in LAC q. MICs q. Migration: Urban–rural dynamics q. Youth (urban and rural) q. Governance (national level) q. Climate change q. Insecurity and Corruption q. Private Sector Engagement

LAC Strategy - 2014 Multiplying impact § Gender Based § § Violence and Violence

LAC Strategy - 2014 Multiplying impact § Gender Based § § Violence and Violence against women Economic opportunities Food Nutrition and Security Resilence Climate Change and DRR Social inclusion: Rights, Leadership

A diverse region : LAC countries with presence of CARE (6) • Central America:

A diverse region : LAC countries with presence of CARE (6) • Central America: Honduras, Guatemala • Andes: Ecuador and Peru • Caribbean: Cuba and Haiti Other LAC countries where we work through partners (5): • • • Colombia Mexico Costa Rica Nicaragua Dominican Republic

For what purpose have you used the PIIRS data? Dialogue on alignment with the

For what purpose have you used the PIIRS data? Dialogue on alignment with the Program Strategy, dialogue on PQ or MEL at the regional level and CO level Does using the PIIRS data lead to any type of actions or commitments in your CO/region? Yes! Year 2016 • Workshop February - Create the CARE LAC program leadership team (PQ and ACD of 6 countries) We have a regional strategy…. now, we need to development a system to measure the implementation and impact of the strategy and our programs!! – we can use PIIRS for that , and add other components if is necessary. Compromise to work together, have a plan and also meetings for analysis and learning every 6 months. • March – june: • Revision of LAC Theories of Change (working women, indigenous peoples, women rural smallholders – & populations affected by disasters), and the alignment with the CI indicators…. • Aggregation & analysis of LAC region PIIRS FY 14 & FY 15 data, the base line of the strategy (where we are? ) • Workshop September: Analysis of the PIIRS FY 14 and FY 15 results with the team, analysis of CI indicators…. . first reflections • • Direct and indirect participants…. it is not clear, we need better definitions Advocacy, are we reporting all? Unpacking and understanding the CI indicators – is that clear? Develop a Pilot in Honduras for the alignment of CI indicators to the current programs, create a system for that and a visual

Data collection Project M&E systems – data collection tools Reports to donors Reports to

Data collection Project M&E systems – data collection tools Reports to donors Reports to Government & other stakeholders Transparent information for Impact Groups FNS sub-indicator format (CI) PIIRS formats (CI) Revision of Theories of Change in programs – and revision of application of CARE approach & roles Data storing, aggregation & analysis Use and dissemination of data PIIRS on line Revision of regional, thematic & global theories of change PIIRS data exported to Excel Aggregation and analysis of data – in Excel, SPSS, Access etc. Country level impact reports At country level Influencing for multiplying impact (country or regional) At regional level Regional impact reports Regional M&E tools (contribution analysis, outcome harvesting, most significant change, etc. ) At global level CI/Outcome Areas Thematic impact and reach reports Global impact and reach reports (CI)

CARE LAC program leadership team - Peru, Cuba, Guatemala, Haiti, Ecuador, Honduras (February 2016)

CARE LAC program leadership team - Peru, Cuba, Guatemala, Haiti, Ecuador, Honduras (February 2016)

External or Internal Evaluations - & control groups

External or Internal Evaluations - & control groups

Full/partial alignment with global & regional priorities

Full/partial alignment with global & regional priorities

5. Global indicators relevant for LAC To. Cs Highly relevant for 3 To. Cs:

5. Global indicators relevant for LAC To. Cs Highly relevant for 3 To. Cs: • 19. # and % of people of all genders who have meaningfully participated in formal (governmentled) and informal (civil society-led, private sector-led) decision-making spaces • 20. # of new or amended policies, legislation, public programs, and/or budgets responsive to the rights, needs and demands of people of all genders • SE 3. # of policies, norms and practices changes for more inclusive and sustainable economies (e. g. of private sector) Highly relevant for 2 To. Cs: • 17. % of women who (report they) are able to equally participate in household financial decisionmaking • 18. # and % of women with union, women’s group or cooperative membership through which they can voice their labor rights • SE 5. # of new employment created for impact population (women, youth) • LAC 1. % of time dedicated to unpaid domestic and care work, by sex, age and geographical area (SDG Indicator 5. 4. 1)

Process indicators - advocacy

Process indicators - advocacy

Does using the PIIRS data lead to any type of actions or commitments in

Does using the PIIRS data lead to any type of actions or commitments in your CO/region? Yes! Year 2017 • Workshop June: Analysis of the AF 16 PIIRS results… this results really represent our work in LAC? . . The PIIRS forms are completed correctly by project teams or is necessary to put more effort in training? . Commitment to improvement for next PIIRS AF 17! – 6 countries. • July – September: Every CO prepare a plan to have a good campaign of PIIRS. They place unrestricted resources, LAC Region coordinate Support of CI MEL and MI CARE USA. Training and monitoring in the quality of the data and the Support and evidence behind any results…. more in the calculate of indirect participants (for generate evidence in the multiplying impact strategy) • September – sent PIIRS formats to CI • Workshop November – seeing our first results of AF 17…. yeiiiii!!, now we can see the LAC multipliyng impact strategy in action! /direct vs indirect and identify our best initiatives for learning. . it is Working!

5 Direct / Indirect by Country / 89 Projects LAC Region 5, 217, 659.

5 Direct / Indirect by Country / 89 Projects LAC Region 5, 217, 659. 00 19 2, 237, 831. 00 142, 129. 00 Cuba 88, 400. 00 Ecuador 7 35 3, 456, 989. 00 3, 538, 560. 50 189, 791. 00 197, 930. 00 Honduras Peru 8 15 186, 835. 00 1, 426, 199. 00 1, 825, 727. 00 149, 493. 00 Guatemala Directos Haiti Indirectos

% de proyectos por Marcador de Genero 5% 20% 0% 7% 16% 13% 0%

% de proyectos por Marcador de Genero 5% 20% 0% 7% 16% 13% 0% 6% 3% 29% 40% 20% 40% 14% 47% 88% 40% 60% 57% 49% 0% Honduras 3% Peru 26% 0% Cuba 0. Harmful 5% Ecuador 1. Neutral 13% 0% Guatemala 2. Sensitive 0% Haiti 3. Responsive 4. Transformative

% de los proyecto por Marcador de Governanza 0% 5% 5% 13% 0% 29%

% de los proyecto por Marcador de Governanza 0% 5% 5% 13% 0% 29% 11% 3% 0% 47% 80% 100% 84% 71% 40% 20% 0% 5% 0% Cuba Ecuador 0. Unaware 1. Tokenistic 0% Guatemala 2. Accommodating 0% Haiti 0% Honduras 3. Responsive 6% 9% Peru 4. Transformational

% de proyectos por Marcador de Resiliencia 0% 5% 0% 20% 14% 27% 29%

% de proyectos por Marcador de Resiliencia 0% 5% 0% 20% 14% 27% 29% 0% 68% 27% 75% 29% 6% 37% 60% 14% 27% 34% 20% 0% Cuba 21% 5% Ecuador 0. Harmful 20% 25% 29% 0% Guatemala 0% Haiti 0% Honduras 1. Neutral 2. Sensitive 3. Responsive 4. Transformative 9% Peru

What has been the outcome of using the PIIRS data? - How is the

What has been the outcome of using the PIIRS data? - How is the PIIRS data useful/valuable for the purposes you have defined? • Allows to analyze areas of programmatic strength or weakness year by year, and work improvement plans (regional level, CO level) to overcome areas of weakness • Allows to measure the direct and indirect reach, which is a measure of Multiplying impact and a proxi is that so much advocacy can be done • It allows us to know the scope and application of our approaches • allows you to map which are the initiatives that work best with partners What are its limitations? • Cualitive data to understand the changes – link with other tools like most significant change to capture this changes • Advocacy results are not totally represented – need to use other tools for MEL in advocacy • More figures and graphics to combine data by countries (Power BI? ) • effectiveness/eficience of the iniciatives – cross PIIRS with new report of Pamotzi by program, in term of budget and impact or reach

Reflections on today’s session • Go to www. menti. com and use the code

Reflections on today’s session • Go to www. menti. com and use the code 46 27 20 • How do you plan on using PIIRS data with your team? • Q&A 47 February 26, 2021

Upcoming sessions • Contact us if you have something you would like to share:

Upcoming sessions • Contact us if you have something you would like to share: 48 February 26, 2021