Comisso Europeia Resultsoriented Monitoring Seminrio sobre Resultados da

Comissão Europeia Results-oriented Monitoring Seminário sobre Resultados da Ajuda Externa e Metodologias de Avaliação da CE, em Lisboa 9/3/2007 Alexandra Chambel Europe. Aid/ Unidade de Avaliação http: //ec. europa. eu/europeaid/evaluation/index. htm

How is it done? § § § Independent experts Ongoing projects Rapid assessment using a strictly structured consistent methodology against internationally agreed criteria: Ø Relevance Ø Efficiency Ø Effectiveness Ø (Potential) Impact Ø (Potential) Sustainability 21/10/2021 2

Outputs Ø A two page report is uploaded in a database allowing for aggregations, simple statistics and comparisons. It provides, short explanations and recommendations on quality improvement + important complementary information to internal monitoring Ø A response from the field on quality and usefulness of the report is also uploaded, projects synopsis , etc 21/10/2021 3

Aims The assessment gives a picture of the situation helping : üto improve the individual projects quality performance üto have an overview over the performance of the project portfolio; how is it progressing towards results 21/10/2021 4

Some Numbers In 2006 • 148 countries visited • 1402 projects monitored by ROM with a total value of approximately € 9. 9 billion were visited. Sinception, in 2000 • 6721 monitoring reports • 4247 projects in 172 Countries have been recorded. 21/10/2021 5

Grading The basis for the assessment is the programming document of the project => Is the project, with all due flexibility pursuing its planned course and will it attain its objectives? Is it on track? track 4 Grades: 4 points (A): Much better than planned , very good 3 points (B): slightly better than planned , good 2 points (C): slightly below plan, minor problems 1 point (D): serious problems Methodological note: The baseline parameter for the scoring scale, 2. 5 points, has been defined as “implementation according to plan”. Thus, a project with a score of 2. 5 is fully on track and expected to deliver the benefits and impact planned. 21/10/2021 6

Performance Timeline 2002 – 2006 21/10/2021 7

Improved Projects (all regions) * Average ratings for main criteria for the re-monitored projects in 2006, which had been monitored in 2004 and 2005 21/10/2021 8

Table: Results per Sector • • Social infrastructure and services (education, health, water, government and civil society etc. ) - performing well and in line with the global picture. Another important sector, economic infrastructure and services with transport, energy and banking, is performing even better with 2. 81. 21/10/2021 9

Scope: Ø The aim is to cover all projects above 1 million EC contribution and a 10% sample of smaller ones Ø For the time being only ongoing projects are monitored But • Ex-post monitoring is being tested to get information on impact and sustainability as realized • Sector Policy Support Programme methodology under preparation – Pool Finding + Sector Budget Support 21/10/2021 10

Project Evaluations q. Challenge: best possible access to credible and useful information q. Strategy: global Evaluations + Project performance information (ROM) + in depth project evaluations only where needed 21/10/2021 11

Making project evaluations more useful • Number of project evaluation limited to relevant ones (value - added to the EC) • Focus on quality for devolved environment (delegations) • Common methodology and harmonized terms of reference –> comparability • Compile reports and draw lessons across the board 21/10/2021 12