Tsunami Evaluation Coalition Progress to Date Background OCHA

Tsunami Evaluation Coalition: Progress to Date

Background OCHA, WHO, ALNAP Secretariat + DANIDA, USAID Level 1 Purpose: To promote a sector wide approach to evaluations of tsunami response in order to optimise sector wide learning Aims 1. 2. 3. 4. To enhance coordination through the establishment of an ‘evaluation coalition’ To increase comparability & reduce unnecessary duplication To strengthen policy level as well as operational evaluation and learning To increase and strengthen learning opportunities Level 2 Purpose: To develop and test procedures for future timely establishment of an evaluation coordination mechanism (coalition) that could facilitate such an approach

Concept Paper (Geneva Feb 2005) Developing a Sectorwide Approach for Evaluation Tsunami Assistance 1. Map (ALNAP Full & Observer Members = 500 +; handout) 2. Options for way forward (Lessons from previous joint evaluations)

OPTION 1: INFORMAL FRAMEWORK Key concept: Harmonisation & rationalisation Key features: Sharing To. R; avoiding duplication; sharing evaluative reports OPTION 3: FORMAL FRAMEWORK OPTION 2: ‘COMMON EVALUATION FRAMEWORK’ Key concepts: Comparability for increased lesson learning Improved quality Key features: CEF (common issues & questions) Active facilitation by OCHA & ALNAP Secretariat OPTION 4: SYSTEMWIDE EVALUATION Key concepts: Optimised coordination & sectorwide learning Comparability for increased lesson learning Greater robustness & rigour of final evaluations Key features (eg): SC & Project Mgmt Committee Key features: Core ‘Study Teams’ CEF One overall To. R for evaluation Core Management Group (CMG) Regional ‘Expert Panel’

INTEGRATED FRAMEWORK OPTION 1: Concepts & features OPTION 2: CEF OPTION 3: CMG OPTION 4: eg, thematic study teams; regional expert panel

Meeting Agreements 1. To constitute an ‘evaluation coalition’ 2. ALNAP Secretariat: coordinating mechanism 3. End of Year Synthesis Report 4. Longer term Study

1. To constitute an ‘evaluation coalition’ (Core Management Group & four Guiding Principles) Sharing Lesson learning Accountability Mutual support & transparency: such that potentially negative findings are seen to present opportunities for improved policy & practice 2. ALNAP Secretariat: coordinating mechanism • Evaluation map • Online Forum • End-of-Year Synthesis Report (RHA 2005)

3. End of Year Synthesis Report (emergency & initial recovery) 1. Findings & learning from individual evaluation reports (coalition) 2. Multi-agency, ‘thematic’ evaluations on crosscutting issues of priority interest • • • Coordination Needs assessment Local / regional capacities Funding / fundraising (incl role of media) Civil-military axis Others 4. Longer term Study

Evaluation Coalition: Current Structure & Activities Core Management Group ALNAP Secretariat / Coalition Coordinator E–V–A–L–U–A–T–I–O–N Online Forum Evaluation Map C–O–A–L–I–T–I–O–N Synthesis Report Longer term Study Common Framework/s Individual agency evaluations (own mgmt and/or sectoral) Multiagency thematic evaluations Individual agency evaluations (thematic)

How Jointly is ‘Joint’? DAC Evaluation Network Study: 11 typologies Decentralised multi-partner: Joint activities focus on establishing common frameworks. Implementation is decentralised – ie, devolved to different partners in the evaluations (IDP Synthesis Study) Stratified multi-partner: Partners enter on the understanding of some stratification of their respective roles (eg, lead agency + others in group)

Agencies Involved to Date Donor UN Agencies Intl NGOs DANIDA USAID SIDA CIDA MFA-Netherlands DC-Ireland FAO OCHA UNDP UNICEF (UNFPA) (DEC) (IWG)

Total Evaluation Activity to Date Concrete plans: Total activities: Evaluations: Reviews: Other: Joint: 35 44 26 (12 ‘traditional’; 7 ‘joint’; 6 real-time) 11 (5 ‘learning reviews’; 2 ‘after action’) 8 (various including surveys, research projects & monitoring visits) Thematic evaluations + IWG (World Vision Intl, Oxfam GB, Care) WHO, SEARO + HAC coordinated by OCHA Geographical emphasis: Indonesia, India, Thailand, Sri Lanka

Next Steps • • • CMG: 14 th April Writing of CFs & To. R: April – May ALNAP Biannual: June Evaluation research: July – early Oct Synthesis: Dec/Jan Publication: Jan/Feb (later for RHA)