Data and Information Framework Principles Sue Barrell Bureau

Data and Information Framework: Principles Sue Barrell Bureau of Meteorology, Australia CBS-Ext. (14), Asuncion, September 2014

Data Insight Value • Applied wisdom insight and value • Science, numerical models, reports, national accounts, assessments, policies • Forecasts, warnings, outlooks; Climate record; Metadata about observations, data, products • Environmental observations: land, oceans, water, atmosphere, space Ref. Robert Logan (2012)

Observing the environment • Measure, monitor, observe, sense the environment in which we live • Snapshots, transects, trends, processes Ø Ubiquitous sensing, immediate sharing Ø Increasingly massive data flows & datasets Ø Meeting insatiable science & service needs

Global Observing Systems Global Regional National

Process, integrate, model data • Use science to model, understand, interpret, predict, inform • Using technology, tools, storage, compute power to enable • Data generating data • More power, more speed, more capacity Ø More detail, more knowledge, more data Ø More challenge

Continuous Improvement in Numerical Weather Prediction

Apply, inform, decide Demand for instantaneous information • Services designed & delivered to meet user demands Personal interface, locally relevant info Structured emergency management Ø Increasing demand Corporate imperatives (i. e. Royal Commissions) Science & technology advances Lower acceptable risk Vulnerability of built environment Increasing population More climate extremes

Demand for services via Web

Share, access and combine to address diverse requirements • Global/national data sharing and exchange - • Access, combine and/or compare observations from one source or system with those from another To achieve this, we need: • • Maximise value of data, diversify sources of data, quid pro quo - Metadata & Standards - Policies & Frameworks - Collaboration and more Through interoperable systems, we turn observations and information into effective data, products, services & insight that meet real user needs

Data: Lifeblood and legacy • The Bureau's lifeblood and enduring legacy - Flows through all Bureau products and services - Essential to delivering value and valued services to our users - Basis of the climate record and reference datasets • International obligations - WMO Res 40 and 25 - Traceability, discoverability and standards • Deliver value to Australian community - Discovery, access, interoperability, usability - Strategic (government) investment and asset - Open Public Sector Information, Government ICT Strategy

Bureau data challenges • Operational 24/7 data: weather, flood forecasts & warnings • Long-term archive: climate, water • Volume and diversity: increasing demands • Integration: across space, time, domains, users • Managing expectations: quality and uncertainty • Metadata: observations, provenance, discovery • Stakeholders: international, Bureau • Obligations: exchange, continuity, traceability

Environmental Data Lifecycle Model Problem/ Need Verify Evaluate Assess DATA LIFECYCLE Apply Inform Decide Observe Monitor Collect Transmit Access Share Process Integrate Model

Environmental Data Lifecycle Model: it's not just about IT costing monitor licensing Why? policy Who? security Verify Evaluate Assess attribution disposal back-up channels disaster recovery Problem/ Need DATA LIFECYCLE Apply Inform Decide Integrate standards stewardship Observe Monitor Collect exchange governance Transmit Access Share Process Integrate Model record formats metadata storage provenance archive discovery

Environmental Data Lifecycle Model Data Framework Problem/ Need Verify Evaluate Assess DATA LIFECYCLE Apply Inform Decide Observe Monitor Collect Transmit Access Share Process Integrate Model

The journey so far • Reviewed Bureau's approach to data policy and data management - Bureau data use, policies, practices, needs - All types of scientific data • Developed concept of Bureau Data and Information Framework - Principles-driven approach that spans all aspects of data lifecycle - Assuring value from/through data, both for internal & external users • Established governance and responsibility • Collaboration across agencies and internationally • Realigned Bureau's organization structure, with data and information as key focus Information Systems and Services Division

Data and Information Framework

Data and Information Framework • Provides foundation for an enterprise approach to all aspects of data acquisition, management, use, access, archival and disposal • Respects data assets as a critical national resource that must be managed effectively for current and future generations

Data and Information Principles http: //www. bom. gov. au/inside/Bo. MData. Framework_Final. pdf • Strategic alignment – with • Discoverable & useable – make Bureau's wider strategic directions, D&I easily discoverable and key government & international useable over time directions • Robust management and • Authoritative & trusted – ensure governance – strong standardsthe Bureau is a trusted, based governance and practices authoritative & reliable source of to achieve efficient, effective and environmental information secure lifetime management of D&I • Deliver value – maximise its value by applying D&I to the needs of • Innovation and leadership – government, community, industry nationally and internationally, from and stakeholders compliance to innovation

Implementing the Bureau's Data Framework • High-level governance: - Data and Information Governance Consultative Committee - Data and Information Reference Group • Environment Information Management Branch - Implement & manage the framework, policies, procedures, tools… • Early priorities: 'Audit' of extant data/information policies and life cycle requirements Metadata – categories, definitions, requirements, identification, profiles Arrangements for externally sourced data Focus on scientific data, but framework includes administrative data Archives Act compliance; develop records authorities Integrated data life cycle/archival plans Tiered data/networks/quality Data management guidelines & policies Licensing Operational data catalogue

Key Messages • An increased focus on data and information management - fundamental to harnessing the value of data and information held by the Bureau, now and for the long-term - improve discovery, access, interoperability, and usability - serve internal and external stakeholders • The Data and Information Framework provides a principles-based approach - for effective data and information management and governance - to support collaboration, enhanced sharing and use of data and information • Data delivers value only through being well-managed through its life, accessible, usable and used – the framework will help us achieve this

Thank you Problem/ Need Verify Evaluate Assess Data Framework Observe Monitor Collect DATA Apply Inform Decide Transmit Access Share Process Integrate Model