ADBESCAP Pilot Project Implementation of Global SDMX Data

ADB/ESCAP Pilot Project: Implementation of Global SDMX Data Structure Definitions in Asia-Pacific Region Putting SDMX into practice MSIS, Manila, 14 -16 April 2014 Artur Andrysiak, Statistician Denis Ward, Consultant Asian Development Bank

Overview • SDMX background • Asia – Pacific pilot project Ø Background Ø Objectives Ø Scope and focus Ø Implementation • Consultation aims: Country and SDMX partners • Consultation outcomes to date: Country and SDMX partners • Need for a structured implementation process

Background: SDMX • Many international organizations collect statistics from NSOs, CBs, Mo. Fs and other line ministries in Asia-Pacific region • Data collection is often complex and inefficient: multiplicity of data flows between organisations; reliant on use of questionnaires; often results in a loss of metadata • Statistical Data and Metadata Exchange (SDMX) standards and guidelines provide a standard way to describe data and metadata as part of an exchange and allows information systems from separate organizations to “talk to each other” • Use of SDMX can significantly improve the efficiency of data and metadata exchange from perspectives of both data providers and data users

Background: Pilot Project • Need for work in this area arose out of: deliberations of ESCAP Committee on Statistics (2012); and outcomes of MSIS (2013) • Currently limited capacity in the region in the area of SDMX • SDMX recognized as one of the key priority areas – network of experts to be established • Recent adoption of global DSDs for Bo. P and National Accounts helped provide impetus for a regional initiative In response, ADB and UNESCAP initiated a Pilot Project: Putting SDMX into practice to improve efficiency of data/metadata exchanges between statistical organizations

Pilot Project: Objectives • Promote the use of SDMX standard and guidelines among NSSs in Asia-Pacific region • Build regional capacities in applying SDMX to improve [among other things] the efficiency of data and metadata exchange across the region for both developed and developing countries Ø Required tools will be developed or adapted from existing SDMX implementations (web services, national SDMX data repository tools and/or mapping tools, DSDs, MSDs) Ø Link into existing networks

Pilot Project: Scope and focus • Statistical domain scope will be indicators collected by ADB for the preparation of statistical publication Key indicators for Asia and the Pacific and related data products • Initial focus of pilot will be based on global SDMX DSDs for Bo. P and National Accounts • Participating countries (NSOs, CBs, other parts of NSSs): Malaysia, Thailand, Australia and New Zealand (with the later two playing the roles of technical advisors, as they already have systems that are SDMX enabled) • Project will extend over 2014

Pilot Project: Implementation • Literature review of existing SDMX documentation – websites, presentations, etc • Country consultations to obtain national perspectives on SDMX implementation • Consultations with key SDMX partners on identified SDMX implementation issues • Identification of relevant SDMX implementation tools • Capacity development • Technical assistance – including adaptation of systems • Knowledge sharing – Virtual networks Discussions still continuing

Country consultations Aims • To obtain picture of national understanding of SDMX and its possible use(s) across NSS: data/metadata exchange; dissemination; data warehousing • Identify [possible] national implementation objectives • Identify statistical, IT and institutional barriers to implementation • Identify national capacity development needs and options for delivery • To identify interest in participating in virtual SDMX network • Scope for possible jointly developed action plans/work plans for SDMX implementation – with structured implementation steps Want perspectives of both developed and developing countries

SDMX partner consultations Aims • Identify relevant implementation tools that could be used by heterogeneous group of countries in A-P region • Availability of documentation, training options • Obtain a feel of the relevance of the tools developed by sponsoring agencies for countries in region [developed and developing] • Understanding of interoperability of the tools • Access tools: initially for pilot project; subsequently by other countries in region

Outcomes: Issues from national perspective identified to date • Knowledge of SDMX is partial and fragmented • There a range of issues need to be considered beforehand by national agencies Ø Objectives of SDMX implementation Ø What statistical domains to include Ø Who would be the main drivers within organisation / across NSS Ø Implementation barriers to capacity development Ø Current proposed IT environment – linkage issues Ø Current metadata environment • Heterogeneity across Asia-Pacific region development, etc. No one-size fits all solution • How / where to start? Need for structured process for capacity development in terms of

Outcomes: SDMX related issues (1) • A wide range of SDMX implementations have been developed by sponsoring agencies and national agencies using SDMX standards and guidelines • Most relevant and comprehensive sets of tools for multistatistical domains identified to date are: Ø Ø • Eurostat’s SDMX-RI IMF’ s SDDS+ and ODP (with Af. DB) Need to further clarify issues related to systems compatibility and systems requirements for these tools.

Outcomes: SDMX related issues (2) • Available SDMX information / resources, partial, fragmented – need for Global SDMX Registry paramount – [Virtual network? ] • Information on SDMX artifacts needs to reach a broader audience at national level involved in implementation • More information on existing SDMX tools – especially on issues such as interoperability • Better articulation of current and future SDMX development activities • Need for coordinated development of global DSDs / MSDs

Need for more structured implementation process • To make use of existing SDMX resources – perhaps more clearly structured [work with partner organisations to achieve] • Country implementation processes envisaged could entail: Ø Ø Step 1: Acquisition of an understanding of key SDMX artifacts by national agencies in both developed and developing countries Step 2: Articulation of issues to be considered by countries prior to embarking on SDMX implementation Step 3: Identification of SDMX implementation barriers – IT, statistical, institutional Step 4: Determining which set(s) of implementation tools to use based on needs, level of development, etc Ø Step 5: Capacity development: National; support from national partner organisations / I/Os Ø Step 6: Access and use of relevant SDMX implementation tools [How? ] Ø Step 7: Participation in virtual SDMX network [Link to global networks]

Thank you