Welcome to Max Sumo training session Pernilla Hyllenius

Welcome to Max. Sumo training session Pernilla Hyllenius Mattisson, Trivector Traffic, SWEDEN EU project MAX (2006 -2009) Work Package B: Behaviour change model and Methods for Evaluation Partners: ILS (D), CNRS (F), NU Napier (UK), Univ. of AUTH (GR), Uni Griesen, Uni Magdeburg, Trivector (S), ESTC (USA) slide 1

Max. Sumo A tool that gives guidance on how to plan, monitor and evaluate an MMproject slide 2

Max. Sumo • Based on MOST-MET (MOST), CAF (Tapestry), SUMO • Further developed in the EU project MAX • Has great possibilities to become a common European standardised evaluation tool ensuring… … that evaluations are able to be done at all … that evaluations are done in a comparable way slide 3

Mobility Management Max. Sumo System impact slide 4

Assessment Levels Background Mobility Management services System impacts Overall effects System impacts Mobility option offered New mobility option Services provided Mobility Management Y External factors P Person-related factors A Project activities and output B Awareness of mobility services provided C Usage of mobility services provided D Satisfaction with mobility services provided E Acceptance of mobility option offered F Take up of mobility option offered G Satisfaction with the mobility option offered H Long-term attitudes and behaviour I System impacts slide 5

Example: Test Traveller / Job ticket project Background Before data: 5 % PT, 95 % car (in TT group) Mobility Services Activities: 10 posters, Intra net info, meetings, 100 E Awareness: 48 % (480 employees) Usage: 28 % (280 employees) particip. in info-meet. Mobility Option Offered Effects Satisfaction: 80 % satisfied with info and test concept Acceptance: 6 % (54 people) signed a contract Take up: : During: 85 % PT (in TT group) Satisfaction: 90 % of TT satisfied with commuting by PT Perm travel beh. After 12 months: 40 % PT (in TT group) Decrease/year: Car traffic: 110. 000 km, CO 2: 20 tonnes slide 6

How to use Max. Sumo? slide 7

Project Start Mission Statement Uppdragsbeskrivning & målsättningar and Objectives Target Groups Services & Option offered Targets and indicators on Assessment Levels Methods MEP: Monitoring and Evaluation Plan for the actual project Monitoring and Evaluation Monitoring Collect a basic data-set Evaluation of the data collected slide 8

Project Start Mission Statement Uppdragsbeskrivning & målsättningar and Objectives Target Groups Services & Option offered Targets and indicators on Assessment Levels Methods MEP: Monitoring and Evaluation Plan for the actual project Monitoring and Evaluation Monitoring Collect a basic data-set Evaluation of the data collected slide 9

Max. Sumo Monitoring and Evaluation Plan Template 1 Overall goals Target groups Mobility services provided Mobility option(s) offered slide 1010

Max. Sumo Monitoring and Evaluation Plan Template 2 Level Services provided Mobility option offered Overall effects A Project activities and outputs B Awareness of mobility services provided C Usage of mobility services provided D Satisfaction with mobility services provided E Acceptance of mobility options offered F Take up of mobility option offered G Satisfaction with the mobility option offered H Long-term attitudes and behaviour I System impacts Targets Indicators Methods When slide 11

Max. SUMO Max. Sumo Monitoring Evaluation and Plan. Evaluation Plan Template 2 2 Level Services provided Mobility option offered Overall effects Targets Indicators A Project activities and outputs XXX B Awareness of mobility services provided XXX C Usage of mobility services provided XXX D Satisfaction with mobility services provided XXX E Acceptance of mobility options offered XXX F Take up of mobility option offered XXX G Satisfaction with the mobility option offered XXX H Long-term attitudes and behaviour XXX I System impacts XXX Methods When slide 12

Max. SUMO Max. Sumo Monitoring Evaluation and Plan. Evaluation Plan Template 2 2 Level Services provided Mobility option offered Overall effects Targets Indicators A Project activities and outputs XXX B Awareness of mobility services provided XXX C Usage of mobility services provided XXX D Satisfaction with mobility services provided XXX E Acceptance of mobility options offered XXX F Take up of mobility option offered XXX G Satisfaction with the mobility option offered XXX H Long-term attitudes and behaviour XXX I System impacts XXX Methods When slide 13

Max. SUMO Max. Sumo Monitoring Evaluation and Plan. Evaluation Plan Template 2 2 Level Services provided Mobility option offered Overall effects A Project activities and outputs B Awareness of mobility services provided C Usage of mobility services provided D Satisfaction with mobility services provided E Acceptance of mobility options offered F Take up of mobility option offered G Satisfaction with the mobility option offered H Long-term attitudes and behaviour I System impacts Targets XXX Indicators Methods When XXX XXX XXX XXX XXX slide 14

OK, let´s practice! • Case 1: Personalised travel planning • Case 2: Walk and Bike to school slide 15

Max. Sumo Monitoring and Evaluation Plan Template 1 Overall goals Target groups Mobility services provided Mobility option(s) offered slide 1616

Max. Sumo Evaluation Plan Template 1 Overall goals To decrease the use of car and decrease the CO 2 emissions. Target groups Inhabitants living in Gros i San Sebastian. Services - Information letter to all households (timetables, bikemaps, etc) - An ”answering card” with possibility to: - ask for personalised advices - to order a free 1 -week PT ticket Mobility option offered To travel by public transport, bike or foot instead of using the car. slide 17

Max. Sumo Monitoring and Evaluation Plan Template 2 Level Services provided Mobility option offered Overall effects A Project activities and outputs B Awareness of mobility services provided C Usage of mobility services provided D Satisfaction with mobility services provided E Acceptance of mobility options offered F Take up of mobility option offered G Satisfaction with the mobility option offered H Long-term attitudes and behaviour I System impacts Targets Indicators Methods When slide 18

Max. Sumo gives you To be aware of… - Help to manage and pilot - Clear objective - Guidance on survey design: - - control group - comparison group - one group Clear conceptions of services and options offered - Best if used already in the planning stage - You don´t have to use all levels - Only provides a structure – still the same requirements on the competence of the evaluator - Seems to be easier than it is… - Practical help (examples of questions) - Help throughout the whole process: stop and go - Early results Comparable results slide 19

Max. Eva web-based tool • Interactive database with input and output modules • Based on Max. Sumo and Swedish SARA • Accumulates results from different projects evaluated using Max. Sumo • Gives guidance on how to evaluate • Makes it possilible to benchmark with others slide 20

Thank you! Pernilla Hyllenius Mattisson pernilla. hyllenius@trivector. se Max. Sumo and Max. Eva: www. epomm. eu / Max MM-tools slide 21