Sri Lanka Parliamentarians Forum for Evaluation EVALUATION AND

Sri Lanka Parliamentarians Forum for Evaluation EVALUATION AND SUSTAINABLE DEVELOPMENT GOALS Introduction to evaluation and importance of evaluation for development process in the district

Project Cycle -Traditional Initiating-concept building with objective Close up Monitoring Needs Assessments Scope Time Objective Budgeting Resources planning Planning Implementation Author Isha Miranda (M&E Consultant) ishamiranda@yahoo. ca Project Development Stage Project Assessment with monthly and final progress report.

What do you know about evaluation? courtesy by Dorothy Lucks and adapted for the workshop

Project Cycle -Traditional End Initiating-concept building with objective Evaluation Close up Mid Term Needs Assessments Scope Time Objectives Budgeting Resources planning Assumption Risk Evaluation Planning Implementation Author Isha Miranda (M&E Consultant) ishamiranda@yahoo. ca Project Development Stage Mid Term findings and filling the gap

Definition of Evaluation An evaluation is an assessment, conducted as systematically and impartially as possible, of an activity, project, programme, strategy, policy, topic, theme, sector, operational area or institutional performance. Author Soma De Silva

An evaluation analyses the level of achievement of both expected and unexpected results by examining the results chain, processes, contextual factors and causality using appropriate criteria such as relevance, effectiveness, efficiency, impact and sustainability. Author Soma De Silva

An evaluation should provide credible, useful evidence-based information that enables the timely incorporation of its findings, recommendations and lessons into the decision-making processes of organizations and stakeholders Author Soma De Silva

OECD/DAC Definition An assessment, as systematic as possible of the on-going or completed projects …. . It’s design, implementation and results. The aim is to determine the relevance and fulfillment of objectives, development efficiency, effectiveness, impact and sustainability. An Evaluation should provide information that is credible and useful enabling the incorporation of lessons learned into the decision – making process. Author V. Sivagnanasothy

Evaluation purpose Accountability Learning Author Dorothy Lucks

Evaluation can inform • planning Evaluation • programming • budgeting • implementation • and reporting Programming Evaluation Implementation Evaluation can contribute to evidencebased policymaking Author Soma De Silva

Why evaluation so important ? • Improves Accountability, Transparency, Results orientation and Good Governance • Feedback helps Lessons learning and access to best practices-Improves Project quality • Helps to avoid repetition of past mistakes • Mid- course corrections during implementation • Early warning signals – Alerts, feedback on Design, implementation and results • Establish performance Management Culture and Facilitates Public Sector Reforms • Improve the process of decision making • Empowerment of beneficiaries. Author V. Sivagnanasothy

Why Evaluate To see what had been achieved To help us see where we are going and if we need to change To help us to make better plans for the future direction To take corrective actions To identify the issues, problems and constraints (early warning alerts) To see where our strengths and weaknesses lie Author V. Sivagnanasothy To make our work more effective and Empower Stakeholders To collect more information Why Evaluate To compare the program with others like it To see if our work is costing too much and achieving too little To be able to share our experiences and learn lessons To improve accountability, transparency and good governance

Monitoring , Evaluations and Learning Cycle 4. Improve Use findings and understandings 3. Learn Data analysis reporting southern Hemisphere's 1. Define Program designing and Planning 2. Measures Data collection management

Evaluation 4. Improve Use findings and understandings 3. Learn Purpose: to assist decision makers to improve policies, programs and projects Data analysis reporting FINAL/POST EVALUATION Were targets met? What lessons were learned? What are the recommendations for the future? 1. Define Program designing and Planning INTERIM EVALUATION Checks progress Reviews test/pilot activities Helps adaptability Avoids wasted resources DESIGN EVALUABILITY Program Logic Monitoring design 2. Measures Data collection management Author Dorothy Lucks and adapted for the workshop

How do you think evaluation helps for programmes in your district? DCC identifies needs of the district DCC reviews progress DCC decides programmes DCC allocates financial resources DCC finds disparities in the district Would evaluation findings help for DCC for above?

What do you want to achieve in programmes? • Activities (Building a school, building a community hall) or • Results? Ø Impact (educated youth ready for the job market) Ø Outcome (higher enrollment at schools, low drop out rate) Ø Output (education facilities available) • Use of resources timely manner • Effective decision making

Evaluation criteria OECDDAC criteria courtesy by Natalia Kosheleva

Key steps in evaluation process Decide • Purpose • Scope • Criteria and Qs Plan Implement • Sources of information • Methods • Instruments • Workplan courtesy by Natalia Kosheleva • Data collection • Analysis • Presentation of findings

How to read evaluation report • Executive Summary • Background • Purpose (Evaluation Questions) • Methodology • Findings • Lessons learned • Conclusions • Recommendations courtesy by Natalia Kosheleva

Evaluation policies, norms and standards http: //www. unevaluation. org/document/detail/1914 courtesy by Natalia Kosheleva

courtesy by Natalia Kosheleva

courtesy by Natalia Kosheleva

courtesy by Natalia Kosheleva

courtesy by Natalia Kosheleva

Discussion about ethics courtesy by Natalia Kosheleva

Case 1 You’ve done the summative final evaluation of a project. Evaluation was commissioned by an organization that implemented the project. According to organization policy evaluation report has to be made public. Client thinks that some of the evaluation findings reflect badly on the organization. Client asks you to remove these findings from the report. What would you do? courtesy by Natalia Kosheleva

Case 2 You asked for individual interviews with members of a local women committee who participated in the project activities and you have a schedule for these interviews. You come for the first meeting and find out that all women are already there and would prefer to have a group conversation. What would you do? courtesy by Natalia Kosheleva

How evaluations can be used in our district? • Present 1 -2 one page evaluation reports in DCC meetings with clear recommendations for decision making. • Advocate decision makers to take decisions based on evidence. • When progress is reviewed at DCC, request evaluation findings to encourage use of evaluation. • Design projects based on needs so that deprived/ most disadvantaged people are served. • When approving new programmes/ interventions, check whether it defines clear results and includes M&E in the design. • When approving new programmes/ interventions, allocating financial resources, check whether they are priorities. • Try to identify disparities in the district through disaggregated data and evaluation findings.