SDMX Guidelines SDMX Global Conference 2017 Addis Ababa

SDMX Guidelines SDMX Global Conference 2017, Addis Ababa, Ethiopia Daniel Suranyi, Eurostat SDMX Guidelines page: https: //sdmx. org/? page_id=4345 1

Why guidelines? • Best practises – Checklists • Harmonised approach – Cross domain artefacts – General use cases • Better understanding – Glossary Not enforced, recommended 5 October 2017 • Governance & policy SDMX Global Conference 2017 Capacity Building 2

Guidelines - Overview Already presented in the Conference • • • Cross domain concepts Cross domain code lists Statistical subject-matter domains SDMX Glossary Checklist for SDMX design projects – incl. modelling a statistical domain using SDMX 5 October 2017 SDMX Global Conference 2017 Capacity Building 3

Guidelines - Overview Covered in this session 1. Governance of commonly used artefacts 2. Global registry content policy 3. Versioning of artefacts 4. Creation and management of code lists https: //sdmx. org/? page_id=4345 5. Non-calendar year reporting 6. Confidentiality and embargo 7. Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 4

1 – Governance of commonly used artefacts 1. 2. Governance Global registry content policy 3. 4. 5. 6. 7. Versioning of artefacts Code lists Non-calendar year reporting Confidentiality and embargo Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 7

1 – Governance of commonly used artefacts • • Active collaboration Freedom of extension Planning and coordination Standardisation: No duplication Stability and pro-activity Freedom of application & scope Re-usability Accountability: Versioning and change management • Transparency • Close relationships with users 5 October 2017 SDMX Global Conference 2017 Capacity Building 8

2 – Global registry content policy 1. 2. Governance Global registry content policy 3. 4. 5. 6. 7. Versioning of artefacts Code lists Non-calendar year reporting Confidentiality and embargo Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 9

2 – Global registry content policy • Global DSDs + related artefacts • Shared DSDs + related artefacts – Under certain conditions – Following SDMX principles • Ownership Group with maintenance agreement • Only final versions, following versioning policy • Use guidelines, cross domain artefacts • Content submission procedure 5 October 2017 SDMX Global Conference 2017 Capacity Building 10

3 – Versioning of SDMX artefacts 1. 2. Governance Global registry content policy 3. 4. 5. 6. 7. Versioning of artefacts Code lists Non-calendar year reporting Confidentiality and embargo Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 11

3 – Versioning of SDMX artefacts • MAJOR. MINOR. PATCH • 0. x for drafts, starting with 1. 0 for final • MAJOR: not backward compatible • MINOR: not forward compatible • PATCH: no technical impact • Parents replicate from children when updated – Code list 1. 4 2. 0 ► DSD 1. 7 2. 0 5 October 2017 SDMX Global Conference 2017 Capacity Building 12

3 – Versioning of SDMX artefacts • MAJOR. MINOR. PATCH • 0. x for drafts, starting with 1. 0 for final • MAJOR: not backward compatible – Add or remove DSD dimension – Delete a code from a code list –… 5 October 2017 SDMX Global Conference 2017 Capacity Building 13

3 – Versioning of SDMX artefacts • MAJOR. MINOR. PATCH • 0. x for drafts, starting with 1. 0 for final • MINOR: not forward compatible – Add a code to a code list – Add an optional attribute to a DSD –… 5 October 2017 SDMX Global Conference 2017 Capacity Building 14

3 – Versioning of SDMX artefacts • MAJOR. MINOR. PATCH • 0. x for drafts, starting with 1. 0 for final • PATCH: no technical impact – Correction of a typo in a label – Adding a new language for a description –… 5 October 2017 SDMX Global Conference 2017 Capacity Building 15

4 – Creating and management of code lists 1. 2. Governance Global registry content policy 3. 4. 5. 6. 7. Versioning of artefacts Code lists Non-calendar year reporting Confidentiality and embargo Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 16

4 – Creating and management of code lists • ID, name, description for each code – e. g. GB, United Kingdom, The United Kingdom of Great Britain and Northern Ireland – Only ID is used in data messages by machines • ID must be unique, name should be unique • Simple hierarchies can be defined (parent) – e. g. UKM, Scotland (parent UK) • Use international classifications 5 October 2017 SDMX Global Conference 2017 Capacity Building 17

4 – Creating and management of code lists • Use A-Z, 0 -9 and _ and start with a letter • Use generic codes – _T for “Total”, _O for "Other", … • Numeric ranges in code ID – – T for ranges: Y 3 T 9 for "3 to 9 years" _ for combinations: A_F for "A and F" X for except / excluding: _TXA for "Total excluding A" GT / LT for greater / less than: GT 20 for "Greater than 20" • Other practical recommendations 5 October 2017 SDMX Global Conference 2017 Capacity Building 18

5 – Non-calendar year reporting 1. 2. Governance Global registry content policy 3. 4. 5. 6. 7. Versioning of artefacts Code lists Non-calendar year reporting Confidentiality and embargo Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 19

5 – Non-calendar year reporting • All above cases use 2015 as reporting year • Attribute REPYEARSTART or REPYEAREND start / end – XML notation xs: Month. Day; e. g. case 3 : "--04 -05" – REPYEARSTART 1 st January (--01 -01) as default • ISO 8601 time interval at observation level for more precision 5 October 2017 SDMX Global Conference 2017 Capacity Building 20

5 – Non-calendar year reporting 1. 2. Governance Global registry content policy 3. 4. 5. 6. 7. Versioning of artefacts Code lists Non-calendar year reporting Confidentiality and embargo Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 21

6 – Confidentiality and embargo 5 October 2017 SDMX Global Conference 2017 Capacity Building 22

6 – Time transformations 1. 2. Governance Global registry content policy 3. 4. 5. 6. 7. Versioning of artefacts Code lists Non-calendar year reporting Confidentiality and embargo Time transformations 5 October 2017 SDMX Global Conference 2017 Capacity Building 23

6 – Time transformations • Time series operation within the time series – Growth rate, cumulative sum, moving average, … • Expressing a time transformation: 1. 2. 3. T Type of transformation P Number of periods F Length of each period 5 October 2017 SDMX Global Conference 2017 Capacity Building 24

6 – Time transformations TRANS_TYPE N G 5 October 2017 SDMX Global Conference 2017 Capacity Building 25