GSICS Collaboration Servers Status 2013 Peter Miu EUMETSAT

GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET, USGS, WMO 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 1

GSICS Collaboration Servers What are the GSICS Collaboration Servers? v Individually, the servers are also known as Data and Product servers provide a set of services for the GSICS user community to support data exchange and access to relevant products to support the calibration of satellite data. Who has implemented one of these servers? v EUMETSAT has an operational server receiving comparable satellite data sets from the EUMETSAT and JMA. Pre-operational and demonstration GSICS products are regularly received by the server for access by the GSICS community. Pre-operational GEO LEO IR products received are expected to be operational soon and archived by the EUMETSAT Data Centre. v NOAA has an operational server regularly receiving NESDIS-produced GSICS products. The metadata for these products following ISO-19115 -2 standards, has links to the associated product documentation and human friendly data set information viewers. NRTC product files can either be accessed individually or as a virtual single dataset. v CMA is developing their server for operations. This server is scheduled to be available as part of the Collaboration Server Network in 2013. Work to be performed: Directory structures issues, standard look & feel, transfers of GSICS product across the collaboration server network and standardise THREDDS meta-data for the data sets. 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 2

GSICS Data and Product Server Design 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 3

GSICS Collaboration Server Network 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 4

EUMETSAT’s GSICS Server Updates v The EUMETSAT GSICS server has improved its look and feel of the THREDDS user interface. v In addition to this, its now offering addition services to access the data; HTTP server download, Open. DAP service, ISO, NCML and UDDC. v GSICS products following the agreed product schema can be viewed using the GSICS plotting tool accessible from the THREDDS meta-data web page for a product. v Additional disk space has been requested to store additional source data sets from EUMETSAT’s Meteosat 10 and Metop-B satellites. v Preparation work is in progress to archive GSICS products into the EUMETSAT Data Centre Archive 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 5

EUMETSAT’s GSICS Server 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 6

What Data Sets are on the Servers v Source Data Sets from EUMETSAT: § § § MET 7 MVIRI net. CDF data sets (20 days rolling archive) MSG 1 SEVIRI net. CDF data sets (20 days rolling archive) MSG 2 SEVIRI net. CDF data sets (20 days rolling archive) MSG 3 SEVIRI net. CDF data sets (20 days rolling archive) Met. Op-A IASI net. CDF data sets (20 days rolling archive) Met. Op-B IASI net. CDF data sets (20 days rolling archive) Hardware upgrades in 2013 for this server shall provide a 30 days rolling archive plus additional storage of intermediate data sets and GSICS products. v Intermediate Data Sets from JMA to support the comparisons: § § MTSAT 2 Imager – Met. Op. A IASI collocated net. CDF data sets (Since 2010 -09 -09) MTSAT 2 Imager – Aqua AIRS collocated net. CDF data sets (Since 2010 -09 -09) v GRWG input is needed to define some Data Management Requirements: § § § Is the 30 days rolling archive enough? How long do we keep the intermediate data sets? Do we need to archive the intermediate data sets? Should all GSICS products be distributed amongst all collaboration servers? Should all GSICS products remain on the collaboration server i. e. are never deleted? Should the GSICS products be archived and if so, who is responsible for archiving these products? 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 7

What Products are on the Servers v NTRC and RAC Demo Products (Monitored Instrument – Reference Instrument): § § § § MET 7 MVIRI - Met. Op. A IASI NRTC demo product (since 2010 -09 -08). MSG 1 SEVIRI - Met. Op. A IASI NRTC demo product (since 2010 -11 -08). MSG 2 SEVIRI - Met. Op. A IASI NRTC demo product (since 2011 -01 -14). Met. Op. A HIRS - Met. Op. A IASI NRTC demo product (since 2011 -12 -12). MTSAT 2 Imager - Aqua AIRS NRTC demo product (since 2012 -02 -15). MTSAT 2 Imager - Aqua AIRS - Met. Op. A IASI NRTC demo product (since 2012 -02 -15). MTSAT 2 Imager - Met. Op. A IASI NRTC demo product (since 2012 -02 -15). § § § § MET 7 MVIRI - Met. Op. A IASI RAC demo product (since 2008 -06 -01). MSG 1 SEVIRI - Met. Op. A IASI RAC demo product (since 2008 -06 -01). MSG 2 SEVIRI - Met. Op. A IASI RAC pre-operational product (since 2008 -06 -01, preop 2013 -01 -23). Met. Op-A HIRS - Met. Op. A IASI RAC demo product (since 2009 -05 -13). MTSAT 2 Imager - Aqua AIRS RAC demo product (since 2011 -10 -04). MTSAT 2 Imager - Aqua AIRS - Met. Op. A IASI RAC demo product (since 2010 -09 -08). MTSAT 2 Imager - Met. Op. A IASI RAC demo product (since 2010 -09 -08). NRTC – Near Real Time Correction. RAC – Re-Analysis Correction. v Validation of these products is done according to the Procedure for Product Acceptance (finalised? ? ). 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 8

GSICS Product Use v Once the EUMETSAT GSICS GEO LEO IR product is operational, the calibration information will be included in the operational High Rate SEVIRI Level 1. 5 Image Data. 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 9

GDWG Servers Discussions 2013 Agenda items where actions are needed: v Fix the directory structures or not ? v Proposed standard look and feel of the server pages. v Standardise THREDDS metadata pages for: § Documentation § Access § Keywords § Creators/Publishers § Viewers v How Products can be regularly and securely transferred across the Collaboration Network. v Manual or automated implementation of these tasks. v GSICS Server Documentation. 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 10

Related Servers Issues 2013 Agenda items where actions are needed: v GSICS Product Schemas. v GSICS Product Plotting Tool; improvement? v GSICS Documentation; GSICS document format, GSICS logo, storage location, etc. v Procedure for Product Acceptance; improvements? v Product Catalogue; improvements? 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 11

New GDWG Discussion Points 2013 Agenda items: v GSICS Operations; service specification? v Satellite event history. v GSICS Climate and Forecast Standard Names and Units. v GSICS work plan definition. 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 12

End of Presentation: Thank you for your attention WMO GSICS Portal http: //gsics. wmo. int GSICS Coordination Centre http: //www. star. nesdis. noaa. gov/smcd/GCC/index. php GSICS Product Catalog http: //www. star. nesdis. noaa. gov/smcd/GCC/Product. Catalog. php EUMETSAT’s Data and Management Server http: //gsics. eumetsat. int 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 13

Backup GSICS document slide v The following documents have been presented on the GSICS mailing lists (http: //groups. google. com/group/gsics-data-wg? hl=en) for some time: § GSICS Data Management Server User Guide, Draft. § GSICS Data Management Server Operations Service Specification (and supporting documentation) Action GDWG 03_22, Draft. § EUMETSAT Archive Net. CDF Format Proposal, Draft. These are EUMETSAT documents, should be converted to GSICS documents. v Where should the Procedure for Procedure Acceptance document be located? v Where should the operational Algorithm Theoretical Baseline Documents (ATBDs) be located? A GSICS associated location should be available to store GSICS documents when GSICS logos etc. 2013 GSICS Joint Meeting, Williamsburg VA, USA, 04 -08 March 2013 14