From Data to Knowledge Big Data Workshop Ljubljana

From Data to Knowledge Big Data Workshop, Ljubljana, 13 -14 Oct 2016 Emanuele Baldacci, Eurostat Director, Directorate B Methodology, Corporate statistical and IT services

D A Shift in Paradigm a t Information Knowledge a

Data revolution: challenges for official statistics Data revolution New data sources Data collection: New & multi-mode access to multiple new sources Data Integration: Combining surveys & model based & algorithm based statistics I N N O V A T I V E S New statistical and analytical methods and tools Official Statistics Competition among data providers New users' needs Data Analytics: New inference methods & visualisation tools Dissemination: From data as a product to data as a service

Multi-Source SB- Data DG- • Survey-Data • a. Dministrative-Data • Geospatial-Data • Big Data

The "factory" of the future Process Analyse Access raw information Combining multiple sources Data analytics New services Survey, Administrative, big data sources New methods, new quality indicators New analytical tools, new indicators Unified data entry point New modes of data collection Data platform New analytical/theo retical frameworks Data analytics services Users' needs driven Data integration Complexity, uncertainty measurement Web services on the cloud Disseminate • Statistical domain 1 • Statistical domain 2 • …. • Statistical domain Standardised tools n • Statistical domain 1 • Statistical domain Data engineering Modernisation Collect • Statistical domain 1 • Statistical domain 2 • …. • Statistical domain n 2 • …. • Statistical domain n

The "shop" of the future Data analytics as a service offered to "Prosumers"

The human capital of the future q. Data engineering increasingly demanded in NSIs to complement domain statistical expertise. q. Needs to share and re-use knowledge towards cross-cutting activities q. Partnership based output with international organisations and academic world.

You'll never walk alone Statistical Community Partner. Communicators ships Data Custodians are crucial Users Academic

ESS* Vision 2020 portfolio *ESS: European statistical system

Conclusions • Use of all relevant sources to produce knowledge • Data Revolution brings opportunities and challenges • Vision 2020 as a first response • Big data as new data source • Smart systems: Prepare for the next wave • Cannot be done by statistical community alone Partnerships, strong political support and investment