ESS Vision 2020 Activities Update Involvement of the

ESS Vision 2020: Activities Update Involvement of the DIME-ITDG Plenary meeting Luxembourg, 14. 02. 2017

About: 1. Stock-taking exercise of the ESS Vision 2020 implementation 2. Enterprise Architecture – new developments 3. ESDEN 4. Validation

Stock-taking exercise "Check-up" of the Vision implementation: • What have been the focus areas so far? • What will be the focus areas in the future? • How can deployment be improved? Identify potential gaps in the implementation of the ESS Vision 2020 • Does the current portfolio adequately cover the Vision? • How do emerging technological trends impact the Vision and its implementation?

Stock-taking exercise Portfolio analysis: methodology Vision statements BCM Capability Project deliverables Ø Key Vision statements/phrases identified Ø Each statement linked to capability from ESS Business Capability Model and to relevant ESS Vision 2020 major project deliverables

Stock-taking exercise Portfolio evolution: main findings Number of major deliverables expected by year 30 25 20 15 10 5 0 2012 2014 2016 Year 2018 2020 Out of 99 major deliverables, 34 delivered so far 2017 is expected to be peak year for deliverables 2022 2024

Stock-taking exercise Portfolio evolution: main findings • IT developments (tied to Key Area 4) dominated ESS Vision 2020 output so far. • Growth of output in other areas is expected to rebalance portfolio in the coming years.

Stock-taking exercise Vision gaps: main findings

ENTERPRISE ARCHITECTURE ESS VIP supporting framework State of play and next steps

ENTERPRISE ARCHITECTURE Background: ESS EA • ESS EA RF adopted by DIME & ITDG on Feb 2016 • ESS EA Roadmap agreed with VIG in January 2017 • Governance • – Establishment of ESS EA Board • - Maintenance of the ESS EARF • - Communication - Awareness raising • ESS. VIP reviews 9

ENTERPRISE ARCHITECTURE Governance • ESS EA Board • Launched in May - 4 Meetings in 2016 • Project reviews • ESS EA RF reviews • Overall governance of ESS EA (priorities, challenges) • ESS EA RF maintenance • New version of ESS EA RF (SPRA) aligned with EIF in June 2017 • Template for Domain Interoperability Framework • Communication • Trainings : Q 2017 – Madrid; ESTP Course in Rome • ESS Workshop on EA : Focus on EA at work in the ESS

ENTERPRISE ARCHITECTURE Project reviews - key outcomes • ESBRs • Business architecture review and guidance • EBRS interoperability framework review and guidance • Validation architecture review and endorsement • SERV • Agree on principles and roadmap for the integration of SPRA and ESSnet deliverables 11

ENTERPRISE ARCHITECTURE Project reviews - key outcomes • DIGICOM • Guidance for the development of linked open data architecture for the ESS • ESDEN • Review and extension of business requirements for ESDEN (messaging in the ESS) for ESBRs and Validation ESSVIP portfolio management • Analysis of ESS. VIP portfolio (deliverables – gap analysis for VIG) preparing for VIG discussion on ESS beyond 2020 12

ENTERPRISE ARCHITECTURE Next steps (with ESS EAB) • Report to VIG (June 2017) • New release of ESS EA RF (June 2017) • BIG DATA industrialisation: initial reflection • Reflection on ESS Vision 2020 projects' shared developments, deployment issues and MS's architecture alignment • Reflection on an ESS Data architecture and platform project 13

UPDATE OF VIP PROJECT ESDEN DIME-ITDG

ESDEN Table of contents 1. Background of the project: objectives 2. Planning 3. Deliverables

ESDEN Objectives of ESDEN • Enable the usage of new data sources • Increasing security, sensitive data • Upgrade capacity, high volumes • Creation of efficient and robust statistical processes • Modernise interfaces, use standard transmission protocols • Foster automation 16

ESDEN Overall planning • Phase 1 (2015 -2016) • Secure infrastructure for the pilot on microdata exchange (SIMSTAT) • Phase 2 (2016 -2017) • Connect rest of ESS members to the secure network infrastructure • Modernisation of the data exchange infrastructure (EDAMIS) • Phase 3 (2018) • Integrate with new generations of secure networks 17

ESDEN Timeline 2013 Phases Project life span 2014 Init. Phase 1 ES SC Decision points 2015 ES SC 2016 2017 Phase 2 ES SC 2018 2019 2020 Phase 3 Closure ES SC Steering Group ESSNet Grants 2013 2014 2015 2016 2017 Today 2018 2019 2020

19 ESDEN Phase 2 – achievements • Software analysis phase completed • TESTA network validated • Corporate software building blocks validated • Successful tests carried out with the NSIs of Spain, Sweden and The Netherlands

20 ESDEN Phase 2 – ongoing actions • Connection to secure networks • Phase 1: 20 org. connected • Phase 2: 6 more connected • Modernisation of the data exchange infrastructure (EDAMIS) • New EDAMIS version coming up • Planning migration to new version

21 ESDEN The new EDAMIS 4 • Enhanced security • Enhanced interoperability • Enhanced performance • Adapted to new technological landscape • Based on corporate building blocks

22 ESDEN Approach to the migration • Objective: minimal impact for business • Gradual introduction of changes • Rollback procedures foreseen • Transition phase • Both versions running • Volunteering organisations involved earlier

DATA VALIDATIONDEPLOYMENT PROJECT STATE OF PLAY AND NEXT STEPS DIME-ITDG 2017

Validation deployment Background: ESS. VIP Data Validation • First ESS VIP project finalised (in Nov 2015) • Deliverables: • methodological handbook, • First version of validation language (VTL), • Proposal for architecture (3 scenarios in countries), • Two early prototypes for validation services 1) Structural validation 2) Validation rule manager 24

Validation deployment Cooperation with countries and domains • Pilot domains (Animal, Asylum, BOP-ITS, Energy, ESA, HBS, STS) • Task Force between June 2016 and Dec 2017 (DE, EE, IT, NL, PT, SI, UK) • ESSnet between Jan 2017 and March 2018 (DE, LT, NL, PT, SE) 25

Validation deployment Main actions planned for 2016 -2018 • Business and IT architecture for data validation • Agreement and documentation at Working Group level of validation rules and roles • Use of shareable and reusable validation services to validate data 26

Validation deployment Recent achievements (2016 – Jan 2017) • Business and IT architecture including validation principles approved by Task Force members • Validation rules expressed in VTL for 5 pilot domains • Proof of concept of a VTL interpreter and assessment of usability of VTL by statisticians • SDMX structural validation service started to be used in production process for 3 domains • First version of content validation service planned for first quarter 2017. 27

Validation deployment Next steps (2017) • Description of validation rules across further domains based on the harmonised approach and the results of the pilots • Identification of preferred scenario for the implementation of validation services on the basis of data providers' IT environment • Standardisation of ESS validation reports • ESSnet Workshop in Lisbon • Roll-out of SDMX structural and content validation services in further domains 28

ESS Vision 2020 Thank you for your attention ! Questions?