Managing XBT Data in the Global TemperatureSalinity Profile
Managing XBT Data in the Global Temperature–Salinity Profile Program (GTSPP) Data Base Charles Sun, Norman Hall and Melanie Hamilton NOAA/National Oceanographic Data Center XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 1
Outline What is GTSPP? n GTSPP Best Copy Data and Data Formats n Logic for the Depth Correction Process n XBT Probe Types Status n General Discussion n XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 2
What’s GTSPP? GTSPP = Global Temperature Salinity Profile Program n n n GTSPP is a joint WMO-IOC program designed to provide improved access to the highest resolution, highest quality data as quickly as possible. GTSPP began as an official IODE pilot project in 1989. It went into operation in November 1990. XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 3
GTSPP Partners n Major partners include Australia, Canada, France and USA. – Australia: Delay-Mode Data Assembly and QC – Canada: Real-Time/Delay-Mode data assembly, QC and Duplicate management – France: Delayed-Mode Data Assembly and QC – USA/AOML: NOAA SEAS Real-time (delayed mode in preparation) – USA/NODC: Continuously managed database (CMD) n n n n Delayed mode data QC Data Matching (Real-time / Delayed / Best Copy) Data available as monthly files Web Database Access Offline Data Delivery New Partners include the National Marine Data and Information Service (NMDIS) of China and the Federal Maritime, Hydrographic Agency (BSH) of Germany and Argentina INIDEP. Contributing countries include those making at sea profile observations. XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 4
GTSPP Best Copy Data and Data Formats http: //www. nodc. noaa. gov/GTSPP/ n http: //data. nodc. noaa. gov/gtspp/ n ftp: //ftp. nodc. noaa. gov/pub/data. nodc /gtspp n GTSPP Data Formats n – (MEDS) ASCII Format – Net. CDF Format XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 5
Logic for the depth correction process - I n n n NODC worked with ISDM (formerly MEDS) and CSIRO to develop logic for the depth correction process of archived XBT data. NODC does not make depth corrections on the archived XBT data. Corrections to the depth would be applied only to the data that were placed on the WOCE DVDs (final version). XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 6
Logic for the depth correction process - II n If the data centers did make depth corrections, NODC preserves the uncorrected depths but loads the new corrected depths to a separate linked table in the database and will allow retrieval of those corrected depths on special request. XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 7
Logic for the depth correction process - III Two new codes will be created to retain depth correction information in the surface codes structure. n The "DPC$" indicates the status of depth correction and n The "FRA$" will retain the conversion factor of 1. 0336. n XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 8
Procedures for Setting DPC$ Values Based on inspection of PLAT, PEQ$, PFR$, PRT$ and FRE$ values n n Inspect the values of Data Type = ‘BA’, ‘XB’, or ‘DT’, Check non-XBT PLAT codes, Compare to tables of known correctable and non-correctable types, and Set the values of DPC$ accordingly. XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 9
Depth Correction (DPC$) Status The "DPC$" code will have the following states: – 01 = Known Probe Type, Needs Correction, – 02 = Known Probe Type, No Need to Correct – 03 = Unknown Probe Type, Not enough information to know what to do, leave alone, – 04 = Known XBT Probe Type, Correction was done, and – 05 = Unknown Probe Type, but a correction was done. XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 10
Parameter Codes Surface Codes Group Parameter Codes History Groups Parameter Codes Surface Codes Group n DPC$ | XBT depth correction status n FRA$ | Fall rate (correction factor for XBT probes) n FRE$ | Code for fall rate equation used. See IGOSS code table. n PEQ$ | XBT fall rate equation (WMO code 1770) n PFR$ | XBT probe type and fall rate equation n PRT$ | XBT probe type (WMO code 4770) XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 Processing Step (PRC_Code) n ld 08 | NODC program to build DPC$ for all stations with datatype= XB, BA, or DT n ld 07 | NODC program to fix XBT depth corrected and original values n SQLP | NODC procedures to fix various database problems using SQL Parameter Codes for Histories (Act_Parm in History group) n ADDP | NODC code for adding DPC$ value. n ADPF | NODC code for adding PFR$ value. n ADPQ | NODC SQL procedure for Adding a PEQ$ value to the surfacecodes table n ADPR| NODC SQL procedure for Adding a PRT$ value to the surfacecodes table n CHDP | NODC code for updating DPC$ value. n CHPF | NODC code for updating the PFR$ value. n CHPQ | NODC code for updating PEQ$ n DTP$ | NODC SQL Procedure indicating erroneous Datatype based on matching CTD data n FXPF | NODC SQL procedure to Fix a PFR$ value from surfacecodes table n FXPQ | NODC SQL procedure to Fix a PEQ$ value from surfacecodes table n FXPR | NODC SQL procedure to Fix a PRT$ value from surfacecodes table n RMPQ | NODC SQL procedure to Remove a PEQ$ value from surfacecodes table n RMPR | NODC SQL procedure to Remove a PRT$ value from surfacecodes table n RMD$ = NODC SQL Procedure for removing DPC$ 11
Bathy Depth Corrected by CSIRO Example 1: CSIRO Depth Corrected data --- WOCE UOT CD Meta-data (Surface Codes Group) n FRA$ 1. 0336 n DPC$ 04 History Group: STATION SEQ ID PRCC VERS PRC_DATE AC ACTP AUXID PREVVAL ---------- ------- -- --------1777155 2 CS CSCB 1. 0 20020709 DP DEPH 0. 0 999 XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 12
Corrected Depths Table vs. Observation Table SQL> desc corrected_depths; Name Null? Type ----------------STATION NUMBER(38) PROFILE NUMBER(38) SEQ NUMBER(38) DEPTHPRESS CHAR(6) DEPRESQ CHAR(1) PROFPARM CHAR(9) PROFQPARM CHAR(1) STATION PROFILE SEQ DEPTHP D PROFPARM P ---------- ------ - ----- 1777155 0 0 0 1 0. 0 1 2. 1 1 29. 000 2 2 STATION PROFILE SEQ DEPTHP D PROFPARM P ---------- ------ - ----- 1777155 0 0 0. 0 1 29. 000 1777155 0 1 29. 000 2 2 ……continued …. . Continued 1777155 SQL> desc observation; Name Null? Type -------------STATION NOT NULL NUMBER(38) PROFILE NOT NULL NUMBER(38) SEQ NOT NULL NUMBER(38) DEPTHPRESS CHAR(6) DEPRESQ CHAR(1) PROFPARM CHAR(9) PROFQPARM CHAR(1) 0 0 XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 59 122. 0 1 22. 100 60 124. 0 1 21. 500 2 2 1777155 0 0 59 118. 0 1 22. 100 60 120. 0 1 21. 500 2 2 13
Example 2: BATHY’s matched to CTD Build meta-data designating CTD, generate audit trail of changes to the database (Number found of this type: 1320) -------------------------------DBID D DT A SC HIS DP PF PFVAL ACTION ----- --- ---------2070 R BA Y 10 14 9 -1 xxxxx -DPC +PFR +HIS 2085 R BA Y 10 14 9 -1 xxxxx -DPC +PFR +HIS 2091 R BA Y 10 14 9 -1 xxxxx -DPC +PFR +HIS 2032802 R BA Y 9 8 8 0 ///99 m. PFR -DPC +HIS DBID -- The Station Number D -- dmode value (R or D) DT -- datatype (BA or XB) A -- Active (Y, N, or H) SC -- nsurfc HIS – numhists DP -- seq for DPC$ surface code PF -- seq for PFR$ surface code PFVAL -- value of PFR$, if any ( xxxxx for filler where none) XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 ACTION -- Recommended action to take STUB -- stub station, take no action ISBT -- Is an XBT, according to PFR$, so take no action m. PFR -- Modify the existing PFR$ -DPC -- Remove the existing DPC$ +PFR -- Add a PFR$ group +HIS -- Add a history for the action 14
Archived XBT Probe States As of 4 March 2008 1, 078, 900 XBT stations (profiles) out of 4, 212, 422 active stations ~= 25. 6% of total active stations are XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 15
Where we go from here? Keep GTSPP informed regarding the XBT fall rate changes. n GTSPP would like to get XBT metadata via its connections with JCOMM and IODE. n XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 16
Charles. Sun@noaa. gov XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, 2008 17
- Slides: 17