IMF Statistics Department Streamline Standardize and Automate Statistical

  • Slides: 18
Download presentation
IMF Statistics Department Streamline, Standardize and Automate Statistical Data Processing - Case Study Andreas

IMF Statistics Department Streamline, Standardize and Automate Statistical Data Processing - Case Study Andreas Hake April 14, 2014 The views expressed herein are those of the author and should not be attributed to the IMF, its Executive Board, or its management. Reproductions of this material, or any parts of it, should refer to the IMF Statistics Department as the source.

IMF Statistics Department Business Context § In 2009 the international community identified important §

IMF Statistics Department Business Context § In 2009 the international community identified important § § § data gaps that needed to be addressed by the IMF and other international organizations A report on these information gaps was prepared by the FSB and IMF staff, and endorsed by the G-20 Finance Ministers and CB Governors in Nov 2009 (G-20 Data Gaps Initiative) As a result, it is anticipated that the volume of data processed by the IMF Statistics Department will increase by a factor of four over the next five years To cope with this significant increase, the IMF Statistics Department needs to redesign its business processes and extend the capabilities, scalability, accuracy, reliability and timeliness of strategic business operations 2

IMF Statistics Department Goal: standardized business processes § Strategy strongly recommends a generalized, flexible

IMF Statistics Department Goal: standardized business processes § Strategy strongly recommends a generalized, flexible and § § scalable approach that could be reused across statistical products An exercise of this magnitude will span across multiple years, impacting people, processes and tools with a significant investment, which makes it critical for achieving the desired results Design principles: • • business process change and not IT tools implementation Based on an enterprise data and metadata model Reduction of manual steps through automation and standardization Preparation of IT tools 3

IMF Statistics Department Production Interface Collection Interface Organizational Specialization and Operational Independence Disseminatio n

IMF Statistics Department Production Interface Collection Interface Organizational Specialization and Operational Independence Disseminatio n Standards, Processes and Technology 4

IMF Statistics Department Production Standards, Processes and Technology Interface Collection Interface Process Automation and

IMF Statistics Department Production Standards, Processes and Technology Interface Collection Interface Process Automation and Resource allocation (To-be) Dissemination

IMF Statistics Department Standard Production Process Template 6

IMF Statistics Department Standard Production Process Template 6

IMF Statistics Department Goal: support increased demands and improve timeliness of data delivery §

IMF Statistics Department Goal: support increased demands and improve timeliness of data delivery § To validate the approach for streamlining, it was § recommended to implement the new processes on a pilot dataset. Two possible options for the pilot • • Parallel run to compare and validate an existing dataset; or New dataset. § First approach would be safer but could result in possible delays due to conflicting priorities, while the later approach poses high risks by relying solely on new processes and tools. 7

IMF Statistics Department Pilot selection § The Coordinated Portfolio Investment Survey (CPIS) § §

IMF Statistics Department Pilot selection § The Coordinated Portfolio Investment Survey (CPIS) § § § dataset required a major change due to the expanded coverage, which almost doubled its size The change was impacting all full data process including collection, processing and dissemination Analysis confirmed that the existing tools and processes would not be able to deliver the desired results in the expected timeframe Hence the expanded CPIS was taken up as the pilot implementation for the new streamlining exercise 8

IMF Statistics Department Pilot implementation § Support for increased data demand (data coverage expanded

IMF Statistics Department Pilot implementation § Support for increased data demand (data coverage expanded to approx. 34, 000 series per country from 17, 000) • • • Reduce the size of report collection forms Just in time processing Readiness to disseminate data real-time § Automation and easy data validation: The new § § implementation has eliminated most of the manual steps by implementation of automated workflows Transparent workflow through data workflow dashboards Performance improvements and access to business user tools 9

IMF Statistics Department Pilot results - Collection Before After Time series Collected 17, 000

IMF Statistics Department Pilot results - Collection Before After Time series Collected 17, 000 34, 000 File Size 10 -20 Mb 1 -2 Mb ICS Processing Time > 1 hour < 5 minutes Correspondent Download speeds 2 x faster Download required before Upload Yes No Correspondent-side errors Some No errors to date File Formats supported Report Form only Report Form, CSV Future: ODP, SDMX 10

IMF Statistics Department Pilot results - Processing Before After Submission Processing Manual Automated Data

IMF Statistics Department Pilot results - Processing Before After Submission Processing Manual Automated Data Transformations Overnight Automatic upon receipt of submission Submission Review Manual Semi-Automated On-demand Management reports No Yes Validation Before After Validation Reports Static, Excel-based Dynamic, Integrated Other data sources No Integrated Metadata No Integrated Charts No Yes Diagnostic Summary No Yes 11

IMF Statistics Department Submission status reports 12

IMF Statistics Department Submission status reports 12

IMF Statistics Department Work in Production - Validation Charts Cross-Database Comparisons Diagnostic Summary Detailed

IMF Statistics Department Work in Production - Validation Charts Cross-Database Comparisons Diagnostic Summary Detailed Diagnostics OLAP Analytics Metadata Integration 13

IMF Statistics Department Pilot results – Dissemination Before After Publication Review End of cycle

IMF Statistics Department Pilot results – Dissemination Before After Publication Review End of cycle In cycle Data Publication Manual Automated Early access for Fund Staff No Available upon departmental approval Future: Need to Re-review Outputs in EDD Staging Yes No Future: Portals No Yes Future: Report/Portal Creation Double work One time creation 14

IMF Statistics Department Success indicators § Business ownership at end user level § Strategic

IMF Statistics Department Success indicators § Business ownership at end user level § Strategic buy-in from Senior management § Allocation of budgets for capital investment Sentiments in the business community “Can we be next? ” 15

IMF Statistics Department Critical areas identified § The successful pilot implementation demonstrated the §

IMF Statistics Department Critical areas identified § The successful pilot implementation demonstrated the § benefits of standardization and automation Key areas to be addressed for full implementation: • • • Organizational structure People change management Outreach and communication Governance Plan overall at high level, but detailed for next six months Share success and celebrate 16

IMF Statistics Department Next Steps § Establish steering group to oversee and govern the

IMF Statistics Department Next Steps § Establish steering group to oversee and govern the § § § change process Detail the overall high-level plan for the coming months Adjust the organizational structure Communicate, communicate… 17

IMF Statistics Department Thank You Andreas Hake ahake@imf. org +1 (202) 623 8130 18

IMF Statistics Department Thank You Andreas Hake ahake@imf. org +1 (202) 623 8130 18