ECCENTRIC Projectlevel Evaluation Helber Lpez PEM CIVITAS Forum

ECCENTRIC Project-level Evaluation Helber López – PEM CIVITAS Forum 2018 September 2018 - Umeå

ECCENTRIC Project-level Evaluation Motivation Why going the extra mile? 2 CIVITAS Forum • September 2018 • Umeå • Helber López

ECCENTRIC Project-level Evaluation framework 8. 1 Common Evaluation Framework 8. 2 Evaluation Plans System framework ECCENTRIC Key Performance Indicators (KPI) D 8. 1 Common Evaluation Framework for ECCENTRIC Impact, process, and project level D 8. 2 Evaluation Plans 8. 3 Process Evaluation During planning and implementation D 8. 3 Process Evaluation phases mainly Report 8. 5 Project Evaluation System analysis based Comparative and integrated eval. Upscaling D 8. 4 Impact Evaluation Report D 8. 5 Project Evaluation Report Baseline + Ba. U Two measurements during demonstration 8. 4 Impact Evaluation 3 CIVITAS Forum • September 2018 • Umeå • Helber López

ECCENTRIC Project-level Evaluation Project-level evaluation 4 CIVITAS Forum • September 2018 • Umeå • Helber López

ECCENTRIC Project-level Evaluation The system Analysis approach Example of a “simple” system To determine the outcome of such a system is a gigantic, and probably useless task. Which variables describe the system? Hint: there might be several ways to do it! How are these variables related. Is there a clear direct relationship? Has it been quantified? The system analysis doesn’t help to determine quantitatively the outcome of the system (who wins the game). Instead, it supports the development of actions and strategies that support the achievement of given objectives. 9 CIVITAS Forum • September 2018 • Umeå • Helber López

ECCENTRIC Project-level Evaluation ECCENTRIC system model Vester’s Sensitivity Model: Tool of choice for ECCENTRIC 2018 2017 2019 2020 PER 2 Interaction with WPL Local evaluation PER 3 Interaction with WPL M 18 M 12 MER 3 MUC Meeting M 30 M 42 MAD Meeting System analysis MUC Meeting M 35 Development of the system model (PEM+WPL) M 36 M 43 Cross-site evaluation Exploitation of the system model (PEM+WPL) M 45 M 48 WP support 12 CIVITAS Forum • September 2018 • Umeå • Helber López

ECCENTRIC Project-level Evaluation ECCENTRIC system model Main activities System analysis Development (PEM+WPL) Cross-site evaluation 1 Exploitation (PEM+WPL) 6 2 5 3 4 13 CIVITAS Forum • September 2018 • Umeå • Helber López

ECCENTRIC Project-level Evaluation ECCENTRIC system model Main activities 1 6 2 5 3 4 14 CIVITAS Forum • September 2018 • Umeå • Helber López

ECCENTRIC Project-level Evaluation System analysis progress Hands-on work… • Two interactions and 4 stages in progress: 1 October 2017 2 Until January 2018 4 January 2018 15 CIVITAS Forum • September 2018 • Umeå • Helber López

16 CIVITAS Forum • September 2018 • Umeå • Helber López

17 CIVITAS Forum • September 2018 • Umeå • Helber López

18 CIVITAS Forum • September 2018 • Umeå • Helber López

Thank you! Helber López Contact Details Technische Universität München Arcisstr. 21 80333 Munich helber. lopez@tum. de http: //www. civitas. eu