Gliders IOOS Glider 101 Maintained by Becky Baltes
Gliders
IOOS Glider 101 Maintained by: Becky Baltes| Updated: 3/23/18
Gliders Goal: Provide a forum for glider user engagement and development and serve as the US glider Data Assembly Center (DAC) for glider operators to share and disseminate glider data. Latest Progress: Community Town Hall and technical sessions at Ocean Sciences Meeting to advance UG 2. Future plans/Goals: - Coordination with Navy and Shell to share data for 20 glider deployment in the Gulf of Mexico - Plan Best Practices Workshop in 2019 in partnership with EGO https: //gliders. ioos. us/ becky. baltes@noaa. gov 3 km 1000 m Image from Kongsberg Seaglider
Three-Slide Deeper Dive Maintained by: Becky Baltes| Updated: 3/23/18
Gliders Goal: Improve glider success rates; increase subsurface obs; meet operational requirements and stakeholder needs Partners: RAs, Canada glider operators, OOI glider data managers https: //gliders. ioos. us/ becky. baltes@noaa. gov
Gliders Feb ‘ 18 https: //gliders. ioos. us/ becky. baltes@noaa. gov
Gliders Future Plans/Updates: - Coordinate Best Practices Workshop, possibly with EGO in the US in 2019 - Webinars to share operational and DMAC strategies - Dev and upgrades to UG 2 site to ensure resource for community - Develop/advance DAC - Delayed Mode Tool testing Raw File Upload Tool New variable acceptance - Update 2014 White Paper https: //gliders. ioos. us/ becky. baltes@noaa. gov
Supplemental Slides Maintained by: Becky Baltes| Updated: 3/23/18
U. S. IOOS Underwater Gliders > Flexible Platform with an established coordination network in place > 50000 glider days with capabilities in all 11 IOOS regional associations 3 km 1000 m Image from Kongsberg Seaglider Sustained climate and ecosystem monitoring Fast response to crisis: Deepwater Horizon Understanding the ocean’s role in hurricane intensification
Profiling Glider Missions Climate/Ecosystem/Fisheries Management/Water Quality HAB Cal. COFI So. Cal Niño Index Fish Tracking Hurricane Forecasting Hypoxia Response to Oil Spill Exercising the Network Deep Water Horizon 10 10 Alaska
Summary of Glider Days for 2008 -2016 Year Glider-day = 1 glider in Of glider days report, the water collecting how many completed data for 1 day outside of the EEZ 2008 2009 2010 2011 2012 2013 2014 2015 2016 2008 - 2016 4013 4744 4973 5740 6292 7647 4154 5546 3603 46712 890 1132 1329 1663 1793 3538 307 1681 1770 14103 Of reported, supported by IOOS or IOOS RA funds for O&M only 349 337 990 772 715 990 1224 1015 902 7294 * Glider Days provided with support from Federal Agencies including NSF, ONR, NOAA, EPA, state and local governments and private foundations. 11 11
Glider DAC • National standards to ease exchange of data from regional glider operators • Real-time distribution to non-federal and federal partners (GTS) • Archiving (NCEI) • QC processing • Share your data 12 12
Glider DAC FY 18 Outlook • Evaluate automatic QC implementation • Add raw-data parser to facilitate data provider participation • Maintain real-time distribution (GTS), access, Archive (NCEI) • Evaluate delayedmode data acceptance 13 13
Links of Interest IOOS Glider Network Whitepaper: http: //www. ioos. noaa. gov/glider/strategy/glider_network_wh itepaper_final. pdf Underwater Glider User Group: https: //gliders. ioos. us/ Glider DAC: https: //gliders. ioos. us/data/ 14
U. S. Integrated Ocean Observing System National Glider Data Assembly Center Rebecca Baltes 2, John Kerfoot 1 , Robert Fratantonio 3, Ben Adams 3, Luke Campbell 4 1 Rutgers University, New Brunswick, NJ 08901 2 U. S. IOOS, Silver Spring, MD 20910 3 RPS/Applied Science Associates, South Kingston, RI 02879, 4 General Dynamics Information Technology, Middletown RI, 02842 Introduction The U. S. Integrated Ocean Observing System (IOOS®) initiated the design and construction of the National Glider Data Assembly Center (NGDAC) in 2013. The NGDAC had five original goals: Data Access & Distribution Datasets uploaded to the DAC by individual data providers are made available to the public via ERDDAP and THREDDS data servers. 1. Develop a Climate and Forecast (CF) compliant Net. CDF file format and collect real-time glider data sets from data providers (COMPLETE) 2. Provide a base line measure of quality control (QC) on submitted datasets (COMPLETE) 3. Distribute data sets via established web services (COMPLETE) 4. Transmit data to the Global Telecommunications System (GTS) (COMPLETE) 5. Work with partner agencies to provide a permanent archive of the data sets (COMPLETE) As of Jan 2018, the NGDAC is operational and has fully satisfied these requirements, recognizing that the construction process is an iterative process that will evolve over time to continue meet the needs of the glider community. 28 data providers Background Deployment Registration 1. Data providers register with the DAC. 2. Data provider deployment registration via web-based form a. Glider name b. Deployment date c. Attribution/funding agencies d. Request WMO id from NDBC 272 Deployments 17, 934 glider days ERDDAP and THREDDS provide open-source data and download (via a wide-variety of formats) access as well as allowing users to quickly create deployment track maps, profile and time-series plots for examining the available datasets. Data Archiving IOOS has partnered with the National Centers for Environmental Information (NCEI) to archive all glider data sets uploaded to the National Glider Data Assembly Center, providing a permanent archive of the real-time datasets. Enhancements The following enhancements to the DAC are anticipated to be completed in 2018. 156, 827 GTS Profiles Delayed Mode Datasets While the initial goal of the National Glider Data Assembly Center was to provide access to realtime profile observations, the data center is currently adding the ability to receive, process and store the delayed mode data sets as well. The datasets, typically of higher temporal and spatial resolution, will also be permanently archived by NCEI. Data Flow 1. Deployment is registered by the data provider 2. NGDAC-compliant Net. CDF files (1 per profile) are written and submitted by the data provider via ftp. 3. Net. CDF files are scanned by the NGDAC for compliance 4. A deployment dataset is created (XML) using a backend ERDDAP server. 5. Datasets are retrieved from the backend aggregation ERDDAP server and written to disk, either as Contiguous Ragged Array or Multidimensional Array trajectory profile Net. CDF datasets. 6. Public access to the datasets is provided via THREDDS and ERDDAP data servers. 7. The National Data Buoy Center harvests the datasets from the public ERDDAP and transmits to the Global Telecommunication System (GTS). Quality Control Application of automated software algorithms developed by the oceanographic community to provide a measure of Quality Control (QC) to real-time and delayed mode glider data sets. 1. 2 options: 1. QC applied by data providers using local knowledge of the operating environment. 2. If QC not applied by data providers, the DAC will apply the tests described in the IOOS QARTOD Manual for Quality Control of Temperature and Salinity Data Observations from Gliders. 2. Tests: 1. Timing/Gap Test - Required 2. Syntax Test - Required 3. Location Test - Required 4. Gross Range Test - Required 5. Pressure Test - Required 6. Climatology Test – Strongly Recommended 7. Spike Test – Strongly Recommended 8. Rate of Test – Strongly Recommended 9. Flat Line Test – Strongly Recommended The Underwater Glider Network Mapping website, built on a stack of open-source libraries, provides users with the ability to identify and/or view all or a sub-set of available datasets: 1. Map-based views 2. Searchable by region and deployment window 3. Plotting of CTD time-series cross-sections 4. View attribution and funding agencies and sources for each submitted deployment GTS: Global Telecommunication System The Global Telecommunication System (GTS) is a global network for the transmission of meteorological and oceanographic from weather stations, satellites, floats, buoys and numerical weather prediction centers. Data transmitted to the GTS, including glider observations, is available for model validation and/or data assimilation. The National Data Buoy Center (NDBC): 1. Harvests new profile observations from the NGDAC’s public ERDDAP server 2. Encodes to the observations to BUFR format 3. Transmits them to the GTS To date, 156, 827 glider profile observations have been released on the GTS. Native File Format Upload & Processing In hopes of enabling national and international data provider participation, the data assembly center is also implementing the ability to receive native glider file formats and process them to DAC-compliant Net. CDF files. This functionality requires metadata that will be provided by the data providers via a set of web forms: 1. Data providers log in 2. Data provider creates metadata records or load metadata records from previously registered deployments. The metadata fields are taken from a combination of CF and Attribute Convention for Dataset Discovery (ACDD) conventions. 3. Data provider uploads the glider data in native format. 4. Data files are processed, adding appropriate metadata and QC. Conclusions 1. The IOOS U. S. National Glider Data Assembly Center provides a centralized location for glider data sets. 2. All datasets submitted to the NGDAC are quality controlled (QC) using QARTOD standardized tests. 3. All datasets submitted to the NGDAC are made accessible to the public via standardized data formats (THREDDS and ERDDAP). 4. All datasets submitted to the NGDAC are permanently archived at NCEI. 5. Profiles transmitted to GTS, providing additional data for model assimilation/validation. Acknowledgements Funding provided by the U. S. Integrated Ocean Observing System. Additional thanks to Bob Simons for development and support of ERDDAP.
- Slides: 15