Ex post evaluation 2007 2014 of ERDF and

Ex post evaluation 2007 -2014 of ERDF and CF: State of play DG Regional and Urban Policy Brussels, 15 January 2015 1 Regional Cohesion Policy

Overview of work packages No. Work package Responsible in REGIO evaluation unit 0 1 2 Daniele Vidoni Kai Stryczynski Marielle Riché 3 4 5 6 7 8 9 10 11 12 13 14 15 Data collection and quality assessment Synthesis Support to SMEs – Increasing Research and Innovation in SMEs and SME development Financial instruments for enterprise support Support to Large Enterprises Transport Environment Modelling the effects of transport projects Energy efficiency Culture and Tourism Urban development and Social Infrastructures European Territorial Cooperation Delivery system (covers also the ESF) Geography of expenditure Effect on GDP etc Modelling: QUEST, Rhomolo, Regional Discontinuity Design, Propensity Score Matching Communication Regional Policy Daniel Mouqué Jan-Marek Ziolkowski Anette Holtmann Postponed Patty Simou Samuele Dossi David Alba Ivanka Lakova Alida Staicu Daniel Mouqué Daniele Vidoni Kai Stryczynski 2015

WP 1: Synthesis • Two interim deliverables: • - Macroeconomic situation • - Regional developments • Ultimate use for synthesis report in 2016 3 Regional Policy

WP 2: Support to SME: research & Innovation and SME development • Started July 2014, inception report accepted by Steering group last September • Consultant: CSIL (IT), CSES (UK), ZEW (DE) • First intermediate report to be examined on 23 January: - Establish the main instruments funded in 50 programmes: context, funding, logic of intervention, beneficiary SMEs, effectiveness - Pilot case study: Puglia + proposal for 7 other case studies - Proposal for 7 policy instruments (in view of 3 theorie-based evaluations) - In parallel: literature review (rationale for public support, evidence) 4 Regional Policy

WP 2: Support to SME: research & Innovation and SME development Next steps: • April: seminar on case studies' findings (MA, SMEs & external experts) • May: 8 case studies • October: 3 theory-based impact evaluations on 3 policy instruments • January 2016: final report Contact: Marielle Riché 5 Regional Policy

WP 3: Financial instruments • Equity, loan and guarantee instruments – support to enterprise only • First draft stocktaking report being finalised. Covers 12 MSs which account for 92% of support (BE, CZ, DK, DE, ES, FR, HU, IT, LT, PL, PO, UK) • Will select 9 representative case study OPs to examine initial performance, using theory of change evaluation. • Seminar in July, final report in November. 6 Regional Policy

WP 4: Support to large enterprises • Large enterprises as defined in EU law • First draft stocktaking report being finalised. Covers 8 MSs which account for 75% of support (PO, DE, PT, ES, HU, IT, CZ, AT) • Will select 8 representative case study OPs to examine initial performance, using theory of change evaluation • Seminar in July, final report in November. 7 Regional Policy

WP 5: Transport Consultant – AECOM + KPMG Italy • Kick-off in December 2014 • 1 st Interim report – April 2015 (cohesion policy contribution + review of financial analysis) • 2 nd Interim report – August 2015 (10 major project case studies + 6 MS case studies + draft catalogue of challenges) • Seminar – October 2015 (to discuss and develop findings from the case studies) • Final report – December, 2015 (draft in November 2015) 8 Regional Policy

WP 6: Environment Analysis of Cohesion Policy contribution in 2007 -2013 for environmental infrastructure projects (drinking water, wastewater and waste). Consultant – COWI • Kick-off in December 2014 and list of 40 major projects provided by the Commission • Inception report: 28 January 2015 (detailed methodology, selection of 20 projects for task 2) • Interim report by mid-March (cohesion policy contribution, review of financial analysis for 20 major projects, verifying the correctness of assumptions for operational projects and proposal for 2 pilot case studies) • All ten case studies by mid-August and catalogue of challenges by mid. September • Seminar (to discuss and verify findings) in October 2015 • Final Report in December 2015 9 Regional Policy

WP 8: Energy Efficiency Consultant – Ramboll / Institute for European Environmental Policy • • • Kick-off : 13 November 2014 Inception report: 09. 01. 2015 (detailed methodology, proposal for case study pilot) Interim report (Literature review / Review of ERDF/CF measures, finalised pilot case study) by mid April 2015 Remaining case studies to be submitted as they are completed, the latest by mid June 2015 Seminar (to discuss and verify findings) in June 2015 Final Report by the end of August 2015 10 Regional Policy

WP 9: Culture and Tourism Consultant – IRS, CSIL BOP Consulting • • Kick-off : 21 August 2014 Inception report: December 2014 (detailed methodology, proposal for Survey to Managing Authorities) Interim report (Literature review / Data analysis and sampling / survey of selected programmes) by January 2015 Pilot Case study (Regional Strategy) and 2 min—case studies (project level) by February 2015 Six case studies and 12 mini-case studies, by May 2015 Seminar (to discuss and verify findings) in September 2015 Final Report by the end of October 2015 11 Regional Policy

WP 10: Urban Development and Social Infrastructures Consultant – METIS • • • Kick-off : November 2014 Inception report: December 2014 (detailed methodology, proposal for Survey to projects Implementation Bodies) Interim report (Distribution of Investments and reported outputs / Analysis of OPs and AIRs) by April 2015 Survey to project Implementation Bodies Final Report by the end of September 2015 12 Regional Policy

WP 11: ETC Consultant – ADE • • • Kick-off : 8 January 2014 Inception report: 12 February 2015 (detailed methodology, proposal for case study pilot) Interim report (Completion of Task 1 and case study selection) by mid May 2015 2 nd Interim report (Completion of Task 2 -4) by mid November 2015 Seminar (to discuss and verify findings) in mid December 2015 Final Report mid March 2016 • Contact: David Alba • 13 Regional Policy

WP 12: Delivery Systems (1/2) • Delivery System is defined as: programming, project selection, compliance with EU & national law, financial man't & control, monitoring, evaluation, reporting • Main focus : the OP level, how well (i) it translates strategic guidelines into results delivered by the policy and (ii) in terms of: accountability, regularity, results, timeliness, responsiveness, cost • TA's performance for reinforcing administrative capacity is assessed • Data and evidence collection through: structured interviews, websurvey, case studies. 14 Regional Policy

WP 12: Delivery Systems (2/2) Consultant – KPMG (DE) / Prognos • • A 16 -months contract Kick-off on 18 November 2014 Inception report submitted 18 December 2014 (in progress) 1 st Interim report 4 March 2015 2 nd Interim report by June 2015 3 rd and 4 th Interim reports by mid-September and mid-October 2015, respectively Draft final report by January 2016 Final Report by the end March 2016 • Contact: Ivanka Lakova 15 Regional Policy

WP 13: Geography of expenditure Consultant – The Vienna Institute for International Economic Studies & Ismeri Europa • • 8 months contract Kick-off on 21 January 2015 Inception report by the end of January 2015 (detailed methodology for each task) 1 st Interim report (Database & proposed methodology for estimates) by the end of April 2015 2 nd Interim report (Database & maps & user's manual) by the end of June 2015 Draft final report by the end of July 2015 (2 nd Interim Report + additional sections on tasks 5&6) Final Report by the end of August 2015 16 Regional Policy

WP 14 c / 14 d: Effect on GDP etc • Two low value contracts with econometric approaches signed • - regression discontinuity design (G Pellegrini) • - Propensity score matching (D Bondonio) • Questions: • - Effect of SF on GDP and other variables on a regional level • - Attempt to capture effect of different aid intensity on regions Regional Policy

Gentle reminder: Have you finished new evaluations? • - Finished in 2013 or 2014, • - Please send them to us: regio-eval@ec. europa. eu • - Title and weblink is enough! • Use: • - for ex post evaluation 2007 – 2013 • - library of evaluations on INFOREGIO 18 Regional Policy