Towards Implementation of SDMX 9 11 January 2007

  • Slides: 15
Download presentation
Towards Implementation of SDMX 9 -11 January 2007 SDMX Open Data Interchange (SODI) Eurostat

Towards Implementation of SDMX 9 -11 January 2007 SDMX Open Data Interchange (SODI) Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 1

Eurostat and the European Statistical System • Network of national institutions and agencies •

Eurostat and the European Statistical System • Network of national institutions and agencies • Co-ordinated by Eurostat – European Commission Directorate General – European Union Statistical Authority • Tasked with providing a high quality statistical information service • 1000 data providers to Eurostat • More than 100 committees, working groups and expert groups Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 2

Harmonisation & methodology coordination • EU Regulations and Agreements • Code lists, nomenclatures •

Harmonisation & methodology coordination • EU Regulations and Agreements • Code lists, nomenclatures • Reporting tools, services and standards – National raw data – Aggregated European data • Latest technologies – Internet, Web services, XML – SDMX Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 3

SODI objectives • Implement a data sharing approach for the Principal European Economic Indicators

SODI objectives • Implement a data sharing approach for the Principal European Economic Indicators (PEEI) – a set of 19 key short term indicators aimed at improving timeliness of European economics statistics SDMX is not only an informatics project. . . SODI is Eurostat’s vehicle for driving forward the whole range of technical, organisational, statistical, legal, and political developments involved in implementing SDMX in the European Union Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 4

Data sharing in SODI NSI Collection Production Dissemination shared data Collection Production Dissemination Eurostat

Data sharing in SODI NSI Collection Production Dissemination shared data Collection Production Dissemination Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 5

The SODI Workflow Internet Connection to NSIs RSSFeed Web service Eurostat "Pull" Requestor Received

The SODI Workflow Internet Connection to NSIs RSSFeed Web service Eurostat "Pull" Requestor Received data in SDMX-ML Extract (and merge) SDMX-ML Reference Data Base / Shared Data XSL for SDMX-ML Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Dissemination Slide 6

The SODI Workflow Internet Connection to NSIs RSSFeed http: //sodi. istat. it Web service

The SODI Workflow Internet Connection to NSIs RSSFeed http: //sodi. istat. it Web service Eurostat "Pull" Requestor Received data in SDMX-ML Extract (and merge) SDMX-ML Reference Data Base / Shared Data XSL for SDMX-ML Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Dissemination Slide 7

The SODI Workflow Internet Connection to NSIs RSSFeed Web service <item> Eurostat Received Extract

The SODI Workflow Internet Connection to NSIs RSSFeed Web service <item> Eurostat Received Extract <title>IND-PROD monthly 1</title> "Pull" data in (and merge) Reference <link>http: //sodi. istat. it/feeds/sodi_rss 2_feed 2. xml</link> Requestor SDMX-ML Data Base / Shared Data <guid>urn: uuid: 11</guid> <description>IND-PROD monthly 1</description> <pub. Date>Tue, 07 Sep 2006 12: 16: 00 GMT</pub. Date> XSL for SDMX-ML Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Dissemination Slide 8

The SODI Workflow Internet Connection to NSIs RSSFeed … Web service Eurostat "Pull" Requestor

The SODI Workflow Internet Connection to NSIs RSSFeed … Web service Eurostat "Pull" Requestor <Query> <query: Data. Where> <query: And> <query: Data. Provider>ISTAT</query: Data. Provider> <query: Dataflow>STSIND_ORD_M</query: Dataflow> Received Extract <query: Dimension data in (and merge) Reference SDMX-ML Data Base / name="FREQUENCY">M</query: Dimension> Shared Data … <query: Time> <query: Start. Time>1990 -01</query: Start. Time> <query: End. Time>2006 -01</query: End. Time> XSL for </query: Time> Dissemination SDMX-ML … Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 9

The SODI Workflow Internet Connection to NSIs RSSFeed Web service Eurostat "Pull" Requestor Received

The SODI Workflow Internet Connection to NSIs RSSFeed Web service Eurostat "Pull" Requestor Received data in SDMX-ML Extract (and merge) SDMX-ML Reference Data Base / Shared Data XSL for SDMX-ML Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Dissemination Slide 10

Reference Metadata for SODI • To enable end users and metadata producers to access,

Reference Metadata for SODI • To enable end users and metadata producers to access, analyse and reuse statistical metadata originated from multiple sources • Standardise the set of concepts for collecting, processing, and disseminating statistical metadata 1. SDMX protocols for ensuring the interoperability of messages, independently on the respective IT platforms. 2. Tasks: 1. 2. 3. 4. Architecture analysis; design, development and testing of a MSD (Metadata Structure Definitions) tool. Analysis of metadata transfer from national and international sources; toolkit for conversion and transfer of reference metadata. Loading metadata into Eurostat's database and formulating queries for extracting the information. Module for dispatching SDMX-compliant metadata to Eurostat’s website. Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 11

SODI Reference Metadata: System Architecture Eurostat Directorate B – Statistical methods and tools; dissemination

SODI Reference Metadata: System Architecture Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 12

SDMX implementation in the European Statistical System • Implementation strategy including short, medium and

SDMX implementation in the European Statistical System • Implementation strategy including short, medium and long term actions • Aimed at making SDMX a workable tool for statisticians • To be developed along the technical and content lines of work • Mostly financed by IDABC, the European Commission program on interoperability Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 13

Lines of work • Main tools – SDMX registry – SDMX converter • Content

Lines of work • Main tools – SDMX registry – SDMX converter • Content oriented work – DSD development: agriculture, demography, education, waste, … – transition from GESMES to SDMX-ML – SDMX reference metadata – harmonisation of code lists Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 14

Conclusions • Strong commitment of Eurostat to SDMX implementation • SODI as driving project

Conclusions • Strong commitment of Eurostat to SDMX implementation • SODI as driving project • Continuity with the past • Feedback to SDMX standard development Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 Slide 15