Connecting HDF And ISO Metadata Ted Habermann NASAESDIS

Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF Group

Layers of Access HDF/net. CDF GIS Mat. Lab, IDL, IDV, Ferret, GMT Arc. Map, Arc. IMS, WFS, WCS OPe. NDAP GML, KML, Simple. Features Climate Forecast Conventions Community Data Models, Open GIS Specifications HDF & Net. CDF Library SQL HDF 5 Data Geospatial Database

The ISO Metadata Standard (19115) <<Data. Type>> CI_Responsible. Party + individual. Name [0. . 1]: Character. String + organisation. Name [0. . 1]: Character. String + position. Name [0. . 1]: Character. String + contact. Info [0. . 1]: CI_Contact + role: CI_Role. Code LI_Lineage <<Data. Type>> CI_Citation + statement [0. . 1] : Character. String + source [0. . *]: LI_Source + process. Step [0. . *]: LE_Process. Step + title : Character. String + alternate. Title [0. . *] : Character. String + date [1. . *] : CI_Date + edition [0. . 1] : Character. String + edition. Date [0. . 1] : Date + identifier [0. . *] : MD_Identifier + cited. Responsible. Party [0. . *] : CI_Responsible. Party + presentation. Form [0. . *] : CI_Presentation. Form. Code + series [0. . 1] : CI_Series <<Data. Type>> + other. Citation. Details [0. . 1] : Character. String CI_Online. Resource + collective. Title [0. . 1] : Character. String + ISBN [0. . 1] : Character. String + linkage : URL + ISSN [0. . 1] : Character. String + protocol [0. . 1] : Character. String + application. Profile [0. . 1] : Character. String + name [0. . 1] : Character. String + description [0. . 1] : Character. String + function [0. . 1] : CI_On. Line. Function. Code

People/Organizations <<Data. Type>> CI_Responsible. Party + individual. Name [0. . 1]: Character. String + organisation. Name [0. . 1]: Character. String + position. Name [0. . 1]: Character. String + contact. Info [0. . 1]: CI_Contact + role: CI_Role. Code <group name="contact_1"> <attribute name="uuid" value="UUID"/> <attribute name="role" value="point. Of. Contact"/> <attribute name="individual. Name" value="Ted Habermann"/> <attribute name="organisation. Name" value="NOAA National Geophysical Data Center"/> <attribute name="electronic. Mail. Address" value="ted. habermann@noaa. gov"/> <group name="online. Resource_1"> <attribute name="uuid" value="UUID"/> <attribute name="linkage" value="http: //www. ngdc. noaa. gov/"/> <attribute name="function" value="information"/> <<Data. Type>> </group> CI_Online. Resource </group> + linkage : URL + protocol [0. . 1] : Character. String + application. Profile [0. . 1] : Character. String + name [0. . 1] : Character. String + description [0. . 1] : Character. String + function [0. . 1] : CI_On. Line. Function. Code

Citations <<Data. Type>> CI_Citation + title : Character. String + alternate. Title [0. . *] : Character. String + date [1. . *] : CI_Date + edition [0. . 1] : <group Character. String name="citation_1"> + edition. Date [0. . 1]<attribute : Date name="uuid" value="UUID"/> + identifier [0. . *] : <attribute MD_Identifier name="title" value="Insightful Metadata Ideas"/> + cited. Responsible. Party [0. . *] : CI_Responsible. Party <attribute name="identifier" value="Short. Name DOI"/> + presentation. Form [0. . *] : CI_Presentation. Form. Code <attribute name="edition" value="Version. ID"/> + series [0. . 1] : CI_Series <group name="date_1"> + other. Citation. Details [0. . 1] : Character. String <attribute name="date" value=""/> + collective. Title [0. . 1] : Character. String <attribute name="date. Type" value="publication"/> + ISBN [0. . 1] : Character. String </group> + ISSN [0. . 1] : Character. String <group name="cited. Responsible. Party_1"> <attribute name="uuid" value="UUID"/> <attribute name="role" value="originator"/> <attribute name="individual. Name" value="Ted Habermann"/> <attribute name="organisation. Name" value="NOAA National Geophysical Data Center"/> <attribute name="electronic. Mail. Address" value="ted. habermann@noaa. gov"/> <group name="online. Resource_1"> <attribute name="uuid" value="UUID"/> <attribute name="linkage" value="http: //www. ngdc. noaa. gov/"/> <attribute name="function" value="information"/> </group>

ISO Lineage Model Source Step Source Step Processing and Algorithm Descriptions Source Step Product

Lineage LI_Lineage + statement [0. . 1] : Character. String + source [0. . *]: LI_Source + process. Step [0. . *]: LE_Process. Step LE_Source + description [0. . 1] : Character. String + scale. Denominator [0. . 1] : MD_Representative. Fraction + source. Reference. System [0. . 1] : MD_Reference. System + source. Citation [0. . 1] : CI_Citation + source. Extent [0. . *] : EX_Extent + processed. Level[0. . 1] : MD_Identifier + resolution[0. . 1] : LE_Nominal. Resolution + sourcemetadata [0. . *] : MD_Reference LE_Process. Step + description : Character. String + rationale [0. . 1] : Character. String + date. Time [0. . 1] : Date. Time + processor [0. . *] : CI_Responsible. Party + extent [0. . *] : EX_Extent + reference [0. *] : CI_Citation LE_Processing + identifier : MD_Identifier + software. Reference[0. . *] : CI_Citation + procedure. Description[0. . 1] : Character. String + documentation[0. . *] : CI_Citation + run. Time. Parameters[0. . 1] : Character. String <group name="lineage"> <group name="process. Step_1"> <attribute name="uuid" value="UUID"/> <attribute name="date. Time" value="Production. Date. Time"/> <group name="processor_1"> <attribute name="uuid" value="UUID"/> <attribute name="role" value="processor"/> <attribute name="organisation. Name" value="Production. Location. Code"/> </group> <attribute name="source" value="UUID, UUID"/> <group name="processing. Information_1"> <attribute name="identifier" value="SPSIdentifier"/> <group name="algorithm_1"> <attribute name="description" value="Algorithm. Descriptor"/> <group name="citation_1"> <attribute name="uuid" value="UUID"/> <attribute name="title" value="Algorithm. Title"/> <attribute name="identifier" value="Algorithm. Package. Maturity. Code"/> <attribute name="edition" value="Algorithm. Package. Version. ID"/> <group name="date_1"> <attribute name="date. Type" value="publication"/> </group> <attribute name="output" value="UUID, UUID"/> </group> <group name="source_1"> <attribute name="uuid" value="UUID"/> <attribute name="description" value="Radar Level 1 A Product Description"/> <group name="source. Citation_1"> <attribute name="uuid" value="UUID"/> <attribute name="title" value="http: //smap. jpl. nasa. gov/Radar. Level 1 AProduct. h 5"/> <attribute name="edition" value="Radar Level 1 A Product Edition"/> <group name="date_1"> <attribute name="date. Type" value="creation"/> </group>

Multiple Dialects: THREDDS Metadata Server Data Server OPe. NDAP Nc. ML WMS ISO WCS Rubric Data(Nc. ISO) Extract Metadata THREDDS Catalog file 1. nc file 2. nc file 3. nc THREDDS Catalog file 4. nc file 1. nc file 2. nc THREDDS Catalog file. nc

THREDDS Metadata Server

Documentation in Three Dialects https: //geo-ide. noaa. gov/ wiki/index. php? title=Nc. ISO http: //groups. google. com/ group/ncisometadata Nc. ML ISO ACDD

Documentation in Multiple Dialects Open Provenance Model, PROV net. CDF (Nc. ML) 10101010111110010010 110100100 10001001 Documentation 0101001001 Repository 00101010010 ISO 19115, 19115 -2, 19119 001010010 and extensions 1010101010001001 0101000010100 DIF, FGDC, Data. Gov Sensor. ML WCS, WMS, WFS, SOS THREDDS KML

Conventions Discovery Unidata Attribute Convention for Data Discovery ISO Conventions Climate-Forecast (CF) Conventions Use / Mashup Standard variable names and data organizations Understanding ISO Conventions

Where Are Citations? application schema algorithm Documentation dataset / resource keyword thesaurus & ontology standard specification feature catalog evaluation procedure XML format specification constraints reference feature catalog Metadata metadata & service standard additional documentation process reference & documentation software reference alternate metadata source metadata associated resource name/metadata

Questions? ted. habermann@noaa. gov

The Design Process SMAP. xml The content of these two files must match ISO 2 NCML. xsl ISO 2 NCML. xml 1. SMAP. xml: an ISO compliant XML file that contains the metadata elements identified in the SMAP metadata model. This is the content that must traverse the system into and out of the HDF 5 file. 2. ISO 2 NCML. xsl: an xsl file that transforms ISO metadata into a candidate Nc. ML representation. This representation is used because it is intuative and easy to read. It also provides a connection to the net. CDF/CF community. 3. ISO 2 NCML. xml: an Nc. ML file that contains an extract of the SMAP content in net. CDF 4 compliant Nc. ML. 4. NCML 2 h 5 py. xsl: an xsl that transforms NCML into python that is compliant with the python HDF 5 library (h 5 py). The python that comes out of this transform instantiates the group structure from ISO 2 NCML. xml in HDF 5 5. NCML 2 h 5 py. py: The python program that, when executed, instantiates the structure from ISO 2 NCML. xml into HDF 5. 6. SMAP. h 5: the HDF 5 file created using NCML 2 h 5 py. py 7. SMAPHDF. xml: the XML representation of the content of SMAP. h 5 8. HDF 2 ISO. xsl: an xsl that transforms the HDF/XML into ISO 19139 9. SMAP 2. xml: the output of the process that should match the original (SMAP. xml). NCML 2 h 5 py. xsl NCML 2 h 5 py. py SMAP. h 5 dump SMAPHDF. xml HDF 2 ISO. xsl SMAP 2. xml