ESDEN modernisation of data exchange in the ESS

ESDEN - modernisation of data exchange in the ESS Alvaro Diez Soto, Eurostat (B 3) DIME/ITDG Steering committee 18 November 2015 – item 6 a 1 Eurostat

Introduction • • • Objectives of the project Status of the project data exchange in numbers Challenges on the data exchange Next steps 2 Eurostat

Objectives of the project q Cross cutting project of the ESS. VIP programme to: • Provide value added services for exchange of confidential and non-confidential statistical data among ESS partners • Define the communication backbone for the future ESS common infrastructure • Support business needs expressed in the ESS. VIP projects 3

Schedule of the project q Phase 1: q Development of SIMSTAT communication infrastructure q ESDEN feasibility study q Phase 2: q Evolution of the network architecture q Integration of SIMSTAT developments q Phase 3: q Migration to the new communication infrastructure SISAI-Metadata Working Group meeting 8 -9. 6. 2015 4

ESDEN – Benefits of the project • secure exchange of data and metadata with high agility, high security and high reliability • easier usage of new data sources in the production of statistics • high volume of data (big data or micro-data exchange) • creation of efficient and robust statistical processes 5 Eurostat

ESDEN – Costs / Deployment actions for MS • Provision of Hardware infrastructure to host the communication platform • Creation of communication link between NSIs and the National authorities • Deployment of communication component • Usage of standard protocols for Data Exchange • IT support for issues on the local infrastructure 6 Eurostat

Status of the project • SIMSTAT network infrastructure delivered on time for the pilot exchange • Ongoing support to the countries for the data exchange 7

SIMSTAT data exchange in numbers From 3, 500 to 14, 000 messages per NSI exchanged with ESTAT so far Total is over 200, 000! Variations among NSIs are due to local systems being off-line 8

Facts on data exchange – EDAMIS vs SIMSTAT 2015 (during SIMSTAT pilot exchange) 9

Challenges on the data exchange Interfaces Duplication of interfaces Phase-out of used technologies (java in browsers) Communication Usage of not recommended protocols (FTP, HTTP) Difficulty to maintain the communication programs Infrastructure Requirements for usage of secure networks Specific IT requirements for the Member States Eurostat 10

ESDEN Phase 2 - Modernisation of the data exchange Interfaces Rationalisation of user interfaces Pilot project of Web forms based on HTML 5 Communication Usage of secure communication protocols Replace the communication program by a Web Service based comm. infrastructure Infrastructure Flexible infrastructure for secure networks Platform independent interfaces provided to the MS for the data exchange Eurostat 11

ESDEN – next steps • Set up of the steering committee to guide the project (Member States involvement) • Note to the VIG on next steps of the project • Connection of additional countries to the CCN network • Approval of ESSC for phase 2 • Pilot project on Web forms and new protocols for the data exchange • ESSNet for the creation of future interfaces and modernisation of the data exchange 12 Eurostat

ESDEN – Steering Committee • Set up of the steering committee to guide the project (Member States involvement) • Letter sent to the Member States in October 2015 • First physical meeting foreseen this year • Additional teleconference meetings and a physical meeting to prepare the ESSC meeting in 2016 13 Eurostat

ESDEN – ESSNet Modernisation of the ESS Network Infrastructure • WP 1 ESS physical connection for the data exchange Recommendations, planning and implementation of secure networks • WP 2 Modernisation of the ESS data exchange platform Analysis of standard protocols, analysis of impact of proposed solutions for data exchange platform modernisation • WP 3 Pilot deployment and testing of the modernised ESS network Pilot implementation using new standard protocols and secure networks 14 Eurostat

Thank you for your attention! 15 Eurostat