ESCWA SDMX Workshop Session Data Formats Metadata Technology

ESCWA SDMX Workshop Session: Data Formats © Metadata Technology

What is Data? • Results of Measurements Country: UK Unemployed: 13 million Year: 2010 Country: Australia Country: France State : Perth Unemployed: 5 million Coastline (Km): 12500 Year: 1982 © Metadata Technology

What is a Data. Set? • An organised collection of Data Set KEY Values Think of a Dataset as an organised container for exchanging Data © Metadata Technology

How is the Data organised? Use case: House Price Data © Metadata Technology

Average House Price • House Type – Terrace – Semi Detached – Detached • County (location) – Surrey – Hampshire • Number Bedrooms • Time • Average Price (measure) © Metadata Technology Code List Dimensions (Concepts)

Data House Type County Bedrooms Price Time Terrace Surrey 2 130, 000 2008 Terrace Surrey 2 150, 000 2009 Terrace Surrey 2 120, 000 2010 Terrace Hampshire 3 170, 000 2009 Terrace Hampshire 2 200, 000 2008 Detached Hampshire 3 250, 000 2008 Detached Hampshire 2 210, 000 2009 Detached Surrey 2 300, 000 2008 Semi-Det Surrey 3 250, 000 2008 Semi-Det Surrey 2 220, 000 2009 Semi-Det Hampshire 3 250, 000 2009 © Metadata Technology

Time Series View KEY House Type Semi-Det House Type Terrace County Surrey Bedrooms 2 2008 VALUES 2009 220, 000 210, 000 House Type Detached County Hampshire Bedrooms 3 Bedrooms 2 VALUES 2008 130, 000 2009 150, 000 2008 200, 000 © Metadata Technology 2010 220, 000 2009 210, 000

Pivot on County KEY House Type Terrace Bedrooms 2 Time 2008 VALUES Surrey 130, 000 © Metadata Technology Hampshire 200, 000

Pivot on House Type KEY County Surrey Bedrooms 2 Time 2008 VALUES Terrace 130, 000 © Metadata Technology Semi 220, 000 Detached 300, 000

Q: What is the Key? A: Anything except the Observation Value and a pivot dimension House Type County Bedrooms Time Price Terrace Surrey 2 2008 130, 000 Terrace Surrey 2 2009 150, 000 Terrace Surrey 2 2010 120, 000 Terrace Hampshire 2 2008 200, 000 Terrace Hampshire 3 2008 250, 000 Detached Hampshire 3 2009 170, 000 Detached Hampshire 2 2009 210, 000 Detached Surrey 2 2008 300, 000 Semi-Det Surrey 3 2008 250, 000 Semi-Det Surrey 2 2009 220, 000 Semi-Det Hampshire 3 2009 250, 000 © Metadata Technology

Pivot on House Type Key Values House Type County Bedrooms Time Price Terrace Surrey 2 2008 130, 000 Terrace Surrey 2 2009 150, 000 Terrace Surrey 2 2010 120, 000 Terrace Hampshire 2 2008 200, 000 Terrace Hampshire 3 2008 250, 000 Detached Hampshire 3 2009 170, 000 Detached Hampshire 2 2009 210, 000 Detached Surrey 2 2008 300, 000 Semi-Det Surrey 3 2008 250, 000 Semi-Det Surrey 2 2009 220, 000 Semi-Det Hampshire 3 2009 250, 000 © Metadata Technology

Pivot on Country Key Values House Type County Bedrooms Time Price Terrace Surrey 2 2008 130, 000 Terrace Surrey 2 2009 150, 000 Terrace Surrey 2 2010 120, 000 Terrace Hampshire 2 2008 200, 000 Terrace Hampshire 3 2008 250, 000 Detached Hampshire 3 2009 170, 000 Detached Hampshire 2 2009 210, 000 Detached Surrey 2 2008 300, 000 Semi-Det Surrey 3 2008 250, 000 Semi-Det Surrey 2 2009 220, 000 Semi-Det Hampshire 3 2009 250, 000 © Metadata Technology

Add new Dimension Key Values House Type County Bed Bath Time Price Terrace Surrey 2 2 2008 130, 000 Terrace Surrey 2 2 2009 150, 000 Terrace Surrey 2 2 2010 120, 000 Terrace Hampshire 2 2 2008 200, 000 Terrace Hampshire 3 3 2008 250, 000 Detached Hampshire 3 3 2009 170, 000 © Metadata Technology

Data. Set and SDMX Schema © Metadata Technology

SDMX Schema for Data • SDMX Has 2 Widely Used Formats Data 1. GENERIC The way the XML is structured 2. COMPACT <Person name=“Matt” age=“ 28” /> <Person> <Name>Matt</Name> <Age>28</Age> </Person> © Metadata Technology

Generic Data KEY VALUES © Metadata Technology

Compact Data KEY VALUES KEY VALUE DATASET © Metadata Technology

GENERIC DATA – ONE SERIES COMPACT DATA – ONE SERIES © Metadata Technology

SERIES ATTRIBUTES GENERIC DATA – 1 Series COMPACT DATA – 1 Series © Metadata Technology

OBSERVATION ATTRIBUTES GENERIC DATA – 1 Observation COMPACT DATA – 3 Observations © Metadata Technology

Exercise Generate Schema • Open Up the SDMX Tool Suite • Drag DSD File onto Tool Suite • Generate a Compact Schema © Metadata Technology

Web Services © Metadata Technology