Cleantech Incubators Journey to Impact Monitoring and Evaluation

Cleantech Incubators’ Journey to Impact: Monitoring and Evaluation at CICs February 28, 2018

Monitoring Evaluation • • Track activities Ensure proper implementation of work plan Demonstrate accountability • • Why given outcome achieved (or not) How program can be more efficient Impact relative to other comparable programs Accountability, effectiveness, efficiency

6 Steps of the M&E Journey Problem Identification 1 Indicator Selection and Definition 2 Logic Model 3 Data Collection 4 Target Setting 5 6 Analysis, Evaluation, and Learning

Step 1 - Problem Identification 1 Indicator Selection and Definition 2 Logic Model 3 Data Collection 4 Target Setting 5 6 Analysis, Evaluation, and Learning

Food for Thought What is the main problem your enabler aims to address? • Has that problem been explicitly defined (either internally or externally)? How would you define success for your enabler?

Step 2 – Logic Model Problem Identification 1 Indicator Selection and Definition 2 Logic Model 3 Data Collection 4 Target Setting 5 6 Analysis, Evaluation, and Learning

Sample Logic Model Climate mitigation and adaptation Widespread use of clean technologies Clean tech companies grow Incubator provides high quality and appropriate services

Food for Thought Do you already have a logic model or theory of change? How do the activities at your enabler contribute to overcoming the identified problem? What assumptions are you making as you work to address that problem?

Questions?

Step 3 – Indicator Selection Problem Identification 1 Indicator Selection and Definition 2 Logic Model 3 Data Collection 4 Target Setting 5 6 Analysis, Evaluation, and Learning

Impacts • CO 2 emissions avoided Outcomes • Number of clean technologies supported Outputs • Number of businesses supported • Number of mentoring sessions Incubator provides high quality and appropriate services Intermediate Outcomes • Additional sales revenue • Number of businesses securing financing Clean tech companies grow Widespread use of clean technologies Climate mitigation and adaptation

Food for Thought If you were starting from scratch, which indicators would you want to track that aren’t currently in the results framework? Why?

Step 4 – Target Setting Problem Identification 1 Indicator Selection and Definition 2 Logic Model 3 Data Collection 4 Target Setting 5 6 Analysis, Evaluation, and Learning

Questions?

Step 5 – Data Collection Problem Identification 1 Indicator Selection and Definition 2 Logic Model 3 Data Collection 4 Target Setting 5 6 Analysis, Evaluation, and Learning

Food for Thought How do you think entrepreneurs can be incentivized to share information for M&E purposes? Have you tested any new ways to improve response rates?

Step 6 – Analysis and Evaluation Problem Identification 1 Indicator Selection and Definition 2 Logic Model 3 Data Collection 4 Target Setting 5 6 Analysis, Evaluation, and Learning

Step 6 – Analysis and Evaluation Showcasing the incubator Accountability Learning and improving Finding focus Fundraising Showcasing clients

Step 6 – Analysis and Evaluation • Reviewing data periodically – what is changing every quarter? Why? • Individual clients and aggregate portfolio • Use charts and graphs embedded in Survey Monkey • Validate hypotheses • Dashboard analytics

M&E Perspectives

The Role of M&E in Supporting Cleantech Incubator Objectives: The GCIC Model What? Output Internal review Setting expectations Data collection Data validation • Improved data • Customized data collection tools • Revised data collection methodology Reporting • Ad hoc information request • Quarterly results reporting • Annual report Decision making Programme improvement

Thank you! Yehia Eldozdar yeldozdar@ifc. org Sarah Craig scraig 1@worldbank. org