WHAT is evaluation and WHY is it important

DESIRED RESULT (Better!) Impact Evaluation LATER E C Policy / Formative N G A

Evaluation is Doing the Right Answering Three Questions Doing it Right? Relevance Thing? Rational

“An evaluation is an assessment, as systematic and impartial as possible, of an activity,

Evaluation criteria Standard Evaluation Criteria • • • Relevance Effectiveness Efficiency Impact Sustainability Relevance:

Why evaluation? Accountability for results Capacity development Evidence-based decision making / advocacy KNOWLEDGE to

The complementarity between M & E Monitoring Evaluation a. Tracking of programme/project/ activity progress

Different options to collect data • • • Information from individuals Information from groups

For more information • A free and very informative online resource on evaluation: http:

Evaluation Types in the Implementation Process Initial Situation Design an Intervention Identify a need

The evaluation planning process 1. Evaluation Purposes Why now? For what? Who? 2. Evaluation

Only when these 4 elements are clear, start the process Engage Stakeholders 1 Analysis

M &E MONITORING EVALUATION • Situation /events monitoring • Performance Monitoring • Doing the

Slides: 17

Download presentation

WHAT is evaluation and WHY is it important? Clemens Gros Edited & Presented by Stephen Ntow, Ph. D June 2017

DESIRED RESULT (Better!) Impact Evaluation LATER E C Policy / Formative N G A Evaluation Programme N I M R R O TO F I R N PE O SITUATION Ex-ante M SITUAEvaluation TION NOW MONI TO RING (Challenges) Monitoring

Evaluation is Doing the Right Answering Three Questions Doing it Right? Relevance Thing? Rational / justification Beneficiary satisfacti Effectiveness / coherence Efficiency: optimizing resources Better Ways of Doing Alternatives it? Good practices Lessons learned

“An evaluation is an assessment, as systematic and impartial as possible, of an activity, project, programme, strategy, policy, topic, theme, sector, operational area, institutional performance, etc. It focuses on expected and achieved accomplishments examining the results chain, processes, contextual factors and causality, in order to understand achievements or the lack thereof. It aims at determining the relevance, impact, effectiveness, efficiency and sustainability of the interventions and contributions an institution or actor. An evaluation should provide evidence-based information that is

Evaluation criteria Standard Evaluation Criteria • • • Relevance Effectiveness Efficiency Impact Sustainability Relevance: The extent to which the intervention is suited to the needs of the primary target group / national priorities and policies. Effectiveness: Is the intervention achieving satisfactory results in relation to stated objectives? Efficiency: measures the outputs in relation to the inputs. Does the intervention use the least costly resources possible to achieve the desired results? Impact: The positive and negative changes produced by an intervention, directly or indirectly, intended or unintended. Sustainability: measures whether the benefits of an intervention are likely to continue after support / funding has been withdrawn.

Why evaluation? Accountability for results Capacity development Evidence-based decision making / advocacy KNOWLEDGE to change behaviour and to influence policy

The complementarity between M & E Monitoring Evaluation a. Tracking of programme/project/ activity progress a. Appraisal of merit, value or worth of programme/project/activity progress b. Systematic, ongoing b. Systematic, periodic or ongoing c. During programme implementation c. Before, During and after programme implementation) d. According to implementation plan d. Compared to criteria (relevance, effectiveness, impact, etc. ) e. For decision-making, especially short term corrective action e. For decision-making about future programming f. For accountability for implementation f. For accountability for results g. Contributes to evaluation g. For organizational learning

QUESTIONS ?

Different evaluation approaches

Different options to collect data • • • Information from individuals Information from groups Observation Physical measurements Reviewing existing records and data

For more information • A free and very informative online resource on evaluation: http: //betterevaluation. org

Evaluation Types in the Implementation Process Initial Situation Design an Intervention Identify a need Programme / Project Start-Up Desired Result OUTPUTS Ex-ante Baseline Evaluation Framework OUTCOMES Formative/ Process Evaluation On-going Monitoring Reconsider, Redesign, Expand, Reduce, or End IMPACT Summative/ Outcome/ Impact Evaluation

The evaluation planning process 1. Evaluation Purposes Why now? For what? Who? 2. Evaluation Objectives/Criteria Relevance, Efficiency, Effectiveness, Impact, Sustainability 3. Evaluation Questions Related to each criterion/issue 4. Evaluation Methodology answers questions Defines the evaluation approach

Only when these 4 elements are clear, start the process Engage Stakeholders 1 Analysis & recommendations Recruit evaluation team 2 Prepare TOR, based on evaluation approach, incl. utilisation & dissemination strategy! 3 4 Collect evidence 5 6 Share & use results

M &E MONITORING EVALUATION • Situation /events monitoring • Performance Monitoring • Doing the right thing? • Doing it right? • Better ways of doing it?

QUESTIONS ?