European Commission DG Budget Evaluation Unit European Commission
European Commission DG Budget – Evaluation Unit European Commission IDEAS - New Delhi 14 April 2005
European Commission DG Budget – Evaluation Unit Commission Communication on evaluation standards and good practise 4 Entry into force July 2003 Organisational context • Main evaluation responsability on individual Directorates General (evaluation functions) • Centralised support and coordination
European Commission DG Budget – Evaluation Unit Regulatory context • Previous good practise guidelines • Commission Communications: - on evaluation (2000) - on Activity Based Management (2001) • Financial regulation with rules on evaluation • Internal Control Standards (evaluation is one of 24)
European Commission DG Budget – Evaluation Unit Purpose and scope Purpose: • Assist services in organising and managing their evaluation activities • Ensure quality of evaluation • Achieve usefulness and use of evaluation • Recognition of the importance of evaluation across management levels and decision-making
European Commission DG Budget – Evaluation Unit Scope: • "Evaluation principles", resources, processes • Evaluation function in all Commission departments and the preparation, management and use of results of evaluation activities • Type of evaluation: - evaluations of policies, programmes, activities, . . . (except individual projects) - ex ante, interim and ex post - internal and external
European Commission DG Budget – Evaluation Unit Structure • 39 standards (binding) and 20 good practice (recommended). Main sections: • Evaluation function: profile, role, tasks, resources • Evaluation activities: planning, feedback, external communication • Evaluation process: evaluation project, steering groups, conduct of evaluations • Quality of evaluation reports
European Commission DG Budget – Evaluation Unit Contents (1) – The evaluation function • Profile, role, tasks and resources of the evaluation function - Evaluation function with clear role and visible in the DG structure - Support in the formulation of policies, programmes and management processes - Adequate human & financial resources
European Commission DG Budget – Evaluation Unit Contents (2) – Evaluation activities • Management of Evaluation Activities - Annual and multi-annual planning - Feedback to decision-making process - Action on conclusions and recommendations - Dissemination of evaluation results
European Commission DG Budget – Evaluation Unit Contents (3) – The evaluation process - Design of an evaluation project - terms of reference - Steering Group - Managing evaluations: responsibilities, independence
European Commission DG Budget – Evaluation Unit Contents (4) – Quality of Report • Quality of the reports. - Substance of the report - Conclusions and recommendations: non-interference and unbiased - Recommendations: clear, useful, applicable
European Commission DG Budget – Evaluation Unit Regulation vs. persuasion • Binding minimum standards & auditable • Combined with good practices • Guidance on how to apply the standards • Training & exchange of good practices
European Commission DG Budget – Evaluation Unit Acceptance and utilisation In the establishment phase • Drafted with the involvement of an interservice working group • Formal Interservice consultation (integration of comments)
European Commission DG Budget – Evaluation Unit Acceptance and utilisation In the application phase • Self assessment by services - Compliance with Internal Control Standards (89% claim compliance) - Annual reporting cycle • Questionnaire by DG Budget questions: - Useful? - Changes needed? -open-ended with 2 • European Court of Auditors: auditing questionnaire covering many standards
- Slides: 13