The HDF Group HDF OPe NDAP update Kent
- Slides: 19
The HDF Group HDF OPe. NDAP update Kent Yang The HDF Group July 8 – 11, 2014 ESIP Summer Meeting 1 www. hdfgroup. org
Why OPe. NDAP? • Check metadata remotely (in various forms) • Obtain the subset of data easily and efficiently • Hide the original data sources • net. CDF, HDF 4, HDF 5 or Geo. Ti. FF, GRIB • Many popular earth science tools can visualize and analyze the data via OPe. NDAP • OPe. NDAP output(including subsets) can be downloaded as other formats July 8 – 11, 2014 ESIP Summer Meeting 2 www. hdfgroup. org
What makes HDF OPe. NDAP support special? • The visualization of HDF(5) data by OPe. NDAP • What users request the most July 8 – 11, 2014 ESIP Summer Meeting 3 www. hdfgroup. org
Access HDF via OPe. NDAP Aqua/Aura Users HDF Handlers(CF) AIRS/OMI HDF DAP Clients July 8 – 11, 2014 HDF Files Servers ESIP Summer Meeting 4 www. hdfgroup. org
HDF 4 handler update • Add TRMM 7 support • level 1 and level 2 swath • Level 3 grid • Improve the performance to handle AIRS version 6 grid and MOD 08_M 3 products • Improve the performance to handle MODIS products with no-CF scale and offset rules • Reduce the number of file open/close calls when using file net. CDF module to access HDF data • Map HDF 4 char array to DAP String July 8 – 11, 2014 ESIP Summer Meeting 5 www. hdfgroup. org
MOD 08_M 3 and AIRS version 6 Performance • Disable the generation of Struct. Metadata as a DAP attribute for the CF option • Use the special features in these products to efficiently build DDS and DAS July 8 – 11, 2014 ESIP Summer Meeting 6 www. hdfgroup. org
TRMM 7 Demo – swath(level 1 B) July 8 – 11, 2014 ESIP Summer Meeting 7 www. hdfgroup. org
TRMM 7 Demo – swath(level 2 A 25) July 8 – 11, 2014 ESIP Summer Meeting 8 www. hdfgroup. org
TRMM 7 Demo multi-grid(level 3 A 25) July 8 – 11, 2014 ESIP Summer Meeting 9 www. hdfgroup. org
TRMM 7 Demo grid(level 3 B 43) July 8 – 11, 2014 ESIP Summer Meeting 10 www. hdfgroup. org
HDF 5 handler update • Support GPM level-1 products • Make the products follow CF • Reduce the number of file open/close calls when using file net. CDF module to access HDF data July 8 – 11, 2014 ESIP Summer Meeting 11 www. hdfgroup. org
GPM HDF 5 structure July 8 – 11, 2014 ESIP Summer Meeting 12 www. hdfgroup. org
HDF 5 handler demo: GPM level 1 A July 8 – 11, 2014 ESIP Summer Meeting 13 www. hdfgroup. org
HDF 5 handler demo: GPM level 1 B July 8 – 11, 2014 ESIP Summer Meeting 14 www. hdfgroup. org
Hyrax file-net. CDF module • Can work with HDF handlers to convert HDF files to net. CDF-3 or net. CDF-4 classic files that follow the CF conventions • We also help debug and provide fixes for this module to help NASA July 8 – 11, 2014 ESIP Summer Meeting 15 www. hdfgroup. org
File net. CDF module demo • Can use besstandalone program • End users can install Hyrax and use this program to convert HDF 4 and HDF 5 files to net. CDF 3 or net. CDF 4 ESIP Summer Meeting 16 www. hdfgroup. org
More challenges • CF conventions evolve and tools evolve • New versions of existing HDF products and new HDF products may require significant updates • The data aggregation service requires decent performance of the data service per file July 8 – 11, 2014 ESIP Summer Meeting 17 www. hdfgroup. org
Future - Performance • Reduce the DDS and DAS access time • Provide a caching mechanism in the handler level July 8 – 11, 2014 ESIP Summer Meeting 18 www. hdfgroup. org
The HDF Group Earth Science Group Ted Habermann Aleksandar Jelenak H. Joe Lee Joel Plutchak John Readey Kent Yang July 8 – 11, 2014 ESIP Summer Meeting 19 www. hdfgroup. org
