Diversity of Evaluation Procedures Irina Slosar Science evaluation

Diversity of Evaluation Procedures Irina Slosar Science evaluation as a prerequisite for promoting excellence in research 6 th November 2012, Chisinau

Parliament Committee for Research, Innovation & Technology Federal Government BMF BMWFJ BMVIT BMWF Austrian Science Fund Page 2 www. ffg. at

FFG – Austrian Research Promotion Agency Company profile • Major funding agency at federal level addressing the innovation base of the Austrian business sector • Comprehensive portfolio of funding instruments both for innovationnewcomers and innovation champions • • Partner of Austrian regions in design and implementation of RTD-initiatives Mobilisation and support of industry and science for participation in European programmes (European Research Framework Programme, EUREKA, CIP, etc. ) Facts and figures • Budget 2012: 525 million € / ca. 5, 5 million foreign partners • Staff: 225 full-time equivalents – expert organization – 141 Experts • Projects 2011: 3. 000 funded projects involving 5. 500 partners Page 3 www. ffg. at

FFG-Research Promotion Statistics II Allocation of total funding according to type of organisations in 2011 Source: FFG Promotion Statistics 2011 Seite 4 www. ffg. at

Organisational Structure Internal Audits Aeronautics and Space Agency (ALR) Internal Services General Programmes Structural Programmes Thematic Programmes (BP) (SP) (TP) Page 5 Strategy Management European and International Programmes (EIP) Project Controlling (PA)

General Programmes (GP) Objective • Strengthening the technological competitiveness of companies based in Austria • Broadening of the innovation base (attracting newcomers) Funding model is based on • In-house project assessment and selection • Open call • Bottom-up (no thematic focus) Page 6 www. ffg. at

General Programmes (bottom up) Programmes and Initiatives SMEs Large scale enterprise Innovation Voucher x BRIDGE (Programme) x x General application-oriented research funding x x (High. Tech) Start up Funding x Feasibility Studies x Headquarter Strategy x Young Experts (preperation for diplomas) x Collective Research x x Service Innovations x x Financing of international projects within the funding schemes EFRE, EUREKA, Eurostars, ERA NET and EU preparatory funding x (x) Page 7 x

Structural Programmes The Structural Programmes serve to optimise structures and infrastructures in research and innovation. This enables companies, research and transfer organisations to identify new methods of cooperation, to generate new knowledge and to establish new areas of strength. Competencies in science and business are improved and the Austrian innovation system is strengthened in the long term. Page 8 www. ffg. at

Competence Centres in Austria http: //www. ffg. at/sp Page 9

Thematic Programmes (GP) Objective • to define key research areas in order to ensure internationally recognised critical masses in strategic research fields of future importance • to encourage and promote research and development activities of Austrian companies in selected subject fields Funding model is based on • External Experts (international) • Call • Top down Page 10 www. ffg. at

Thematic Programmes (TP) (1) Energy and Environment e!Mission. at The House of the Future International Energy Agency (IEA) New Energies 2020 Smart Energy Demo - fit 4 set Technologische Leuchttürme der Elektromobilität Information Technologies AT: net– austrian electronic network Benefit – New technologies for elderly people AAL Ambient Assisted Living Joint Programme FIT-IT– Information technologies ARTEMIS – Advanced Research and Technology for Embedded Intelligence and Systems ENICAC – European Nanoelectronics Initiative Page 11 www. ffg. at

Thematic Programmes (TP) (2) Life Sciences GEN-AU – Austrian Genome Research Programme Materials and Production Intelligent Production- innovative technologies, processes und materials for competitive production NANO EHS – Environment, Health and Safety Austrian NANO Initiative Transportation IV 2 Splus– Intelligent Transport Systems and Services TAKE OFF – the Austrian aeronautics programme Security KIRAS Page 12 www. ffg. at

Aeronautics and Space Agency (ALR) Objectives • International positioning and networking of Austrian industry, economy, science • Securing Austria‘s competitiveness at the international level • Implementation of Austrian aeronautics and space policy Tasks • Central contact point for coordination of activities • Representing Austria in EU bodies, ESA, EUMETSAT • Management of participation in bilateral and international aerospace programmes, management of the Austrian space programme • Sustainable development and strengthening of the Austrian aeronautics and space cluster Page 13 www. ffg. at

European and International Programmes (EIP) Objectives • Strengthening the Austrian participation in European & international R&D Programmes & acording • Support of Austrian researchers in industry and science Tasks • National competence and service centre for European and international R&D programmes and initiatives • Professional information and counselling on all programmes by competent national contact points • Establishment of contacts with international R&D networks • Monitoring of Austrian participation in EU Framework Programme Page 14

European and International Programmes (EIP) Host • FP National Contact Points, EUREKA/EUROSTARS, EEN, CIP, ICT-PSP Activities • Awareness, Information, Training (FFG Academy), Consultation, Coaching, International Networking (Consortium Building) EIP with 3 rd Countries • providing expertise in how to develop FP cooperation Page 15

National Project Evaluation Procedures • • • Transparency Confidentality Quality Equality of treatment Efficiency… • Variety of procedures • Application in German Page 16

Evaluation in General Programmes Page 17

COMET Evaluation Process Ex-Ante Extern Evaluation FWF, CDG Stage 1 Intern Evaluation FFG Decision Panel 1 K 1/K 2: Invitation - Full Proposal Projects: 1 -Stage Evaluation Extern Evaluation FWF, CDG Stage 2 Intern Evaluation FFG Hearings Standing Committee & Review Team Funding Recommendation: Panel 2 K 2, K 1 Förderungsentscheidung durch den Bundesminister Funding Decision from the Minister Page 18

FFG in ERA. NETs Air. TN- Air Transport Net BIOENERGY- Pulling Bioenergy Research together COMPERA- National and Regional Programmes and Initiatives dedicated to the creation and support of Competence Research Centres CORNET II- to the Benefit of Large Communities of SMEs: Collective Research ERACOBUILD- Strategic cooperation between national programmes promoting sustainable construction and operation of buildings ERA-LEARN- Supporting the ERA-NET learning platform by creating a toolbox for the ERA-NET community ERA-NET ROAD- Coordination and implementation of Road Research in Europe ERA-PG Plant Genomics ERASME- Promote Innovation Networking and Cooperation between SMEs and Research Organisations ERA-STAR Regions- ERA - Space Technologies Applications & Research for the Regions and medium-sized Countries ERASys. Bio- Towards a European Research Area for Systems Biology EUROTRANSBIO- European network of transnational collaborative RTD for SME projects in the field of biotechnology MNT-ERA. NET- R&D projects in the area of micro and nanotechnologies M-ERA. NET - From micro- and nanoscale science to new technologies for Europe Patho. Geno. Mics - Trans-European Cooperation and Coordination of Genome Sequencing and Functional Genomics of Humanpathogenic Micro-organisms Piano Plus- Photonic-based Internet Access Networks of the Future PV ERA -NET- networking and integration of national and regional programmes in the field of photovoltaic (PV) solar energy research and technological development in the ERA a Page 19 www. ffg. at

ERA-LEARN • ERA-LEARN is a systematic investigation of experiences and acquired know-how with the perspective to identify good examples and to develop a set of recommended procedures • This includes the examination of complementarities and synergies of the ERA-NET instrument with the other existing schemes and programmes at all levels (regional, national, trans-national, international). • Based on a comprehensive analysis of existing and already validated procedures ERA-LEARN facilitates the identification of tools that are suitable for a broad use. Page 20 www. ffg. at

http: //netwatch. jrc. europa. eu/n w/index. cfm/static/learning. cfm Page 21

ERA. NET Evaluation Procedures Page 22

International Evaluation Page 23

Exploitation of Evaluation Experience FFG Servcies Proposers Meet the Evaluators Page 24 www. ffg. at

Your GPS through European R&D! 7) Project Management Trainings for effective R&D project management FFG/EIP Services 6) Proposal Check We increase your chances for successful evaluation 5) Legal Issues (IPR) Assistance in legal matters of your R&D projects 4) Partner Search We help in finding the right partners for your projects 3) Preparatory Co-funding for European R&D project development 2) Individual Coaching Should you invest time & money for getting involved in European R&D? 1) Email Services 8) Exploitation Tech transfer and exploitation assistance for your R&D projects Information on relevant R&D Programmes straight to your PC! Page 25 Project Development Phases Page 25

EIP – Success FP 7, data 2010: • 1. 558 successful Austrian teams working in • 1. 141 projects • 189 projects are coordinated by Austrian organizations • 490 Mio. EUR funding for Austrian partners • 126% ROI Page 26 www. ffg. at

Contact: Irina Slosar Unit International Cooperation and Mobility Division European and International Projects Email: irina. slosar@ffg. at Tel. : +43 (5)5775 - 4605 Austrian Research Promotion Agency www. ffg. at/eip www. ffg. at/rp 7 Page 27 www. ffg. at