The HDF Group HDF 5 Tools Tutorial 101715

  • Slides: 16
Download presentation
The HDF Group HDF 5 Tools Tutorial 10/17/15 ICALEPCS 2015 1 www. hdfgroup. org

The HDF Group HDF 5 Tools Tutorial 10/17/15 ICALEPCS 2015 1 www. hdfgroup. org

HDF 5 Tools • Supported by The HDF Group https: //www. hdfgroup. org/tools/ •

HDF 5 Tools • Supported by The HDF Group https: //www. hdfgroup. org/tools/ • GUI-based Browsers • HDF Compass (prototype) • HDFView • HDF 5 command-line tools • Distributed with the HDF 5 library • h 5 dump, h 5 ls, h 5 repack, h 5 diff, h 5 jam, h 5 copy, h 5 debug • Distributed as stand-alone tools • h 5 check, converters between HDF 4 and HDF 5 • Supported on variety of platforms 10/17/15 ICALEPCS 2015 2 www. hdfgroup. org

Aside: UNIX commands can be useful! • head • View superblock • strings •

Aside: UNIX commands can be useful! • head • View superblock • strings • View character data (attributes, datasets) • View some HDF 5 metadata • hexdump • The last resort to troubleshoot issues 10/17/15 ICALEPCS 2015 3 www. hdfgroup. org

HDF Compass https: //github. com/HDFGroup/hdf-compass/ Please try it and let us know what do

HDF Compass https: //github. com/HDFGroup/hdf-compass/ Please try it and let us know what do you think! 10/17/15 ICALEPCS 2015 4 www. hdfgroup. org

HDFView • Java-based tool to access HDF 4 and HDF 5 • Used for

HDFView • Java-based tool to access HDF 4 and HDF 5 • Used for • Viewing and modifying file content • Creating data in HDF files • Exporting and importing data • Getting data to/from Excel • Supports features used in the JPSS files • User block • Supports object and region references 10/17/15 ICALEPCS 2015 5 www. hdfgroup. org

The HDF Group HDF 5 command-line tools 10/17/15 ICALEPCS 2015 6 www. hdfgroup. org

The HDF Group HDF 5 command-line tools 10/17/15 ICALEPCS 2015 6 www. hdfgroup. org

HDF 5 command-line tools info See HDF 5 Reference Manual https: //www. hdfgroup. org/HDF

HDF 5 command-line tools info See HDF 5 Reference Manual https: //www. hdfgroup. org/HDF 5/doc/RM/Tools. ht ml Flag -V (--version) -h (--help) --enable-error-stack 10/17/15 Used for Printing version of the HDF 5 library Displaying online help Troubleshooting ICALEPCS 2015 7 www. hdfgroup. org

h 5 dump • Displays HDF 5 file according Data Description Language (DDL) •

h 5 dump • Displays HDF 5 file according Data Description Language (DDL) • Human readable and most comprehensive Flag Used for -H (--header) Suppressing data printing -p (--properties) Displaying properties of the objects, e. g. , compression ratio -B Printing superblock to find user block info -M (--packedbits) Displaying JPSS quality flags -R (--region) Displaying data pointed by region reference -N Searching for the object specified by “name” 10/17/15 ICALEPCS 2015 8 www. hdfgroup. org

h 5 ls • Provides some internal information, such as objects offsets in the

h 5 ls • Provides some internal information, such as objects offsets in the file to pass to h 5 debug Flag(s) -v -g Used for Verbose output Displaying information about the group -r -d Listing objects recursively Printing data for the dataset 10/17/15 ICALEPCS 2015 9 www. hdfgroup. org

h 5 jam/h 5 unjam • Adds/removes user block h 5 unjam -i <Input

h 5 jam/h 5 unjam • Adds/removes user block h 5 unjam -i <Input HDF 5 File> -o <Output HDF 5 File> -u <User Block File> 10/17/15 ICALEPCS 2015 10 www. hdfgroup. org

h 5 repack • Creates new file with different properties Flag(s) No flags -l

h 5 repack • Creates new file with different properties Flag(s) No flags -l -f 10/17/15 Used for Deleting non-used space in the file Changing storage layout of the datasets in the file Applying (or removing) compression ICALEPCS 2015 11 www. hdfgroup. org

h 5 diff • Finds differences in two files • Not good at comparing

h 5 diff • Finds differences in two files • Not good at comparing file structures Flag(s) -N (--nan) ---exclude-path 10/17/15 Used for Disabling Na. N detection Disabling comparison of specified objects ICALEPCS 2015 12 www. hdfgroup. org

h 5 diff • Finds differences in two files Flag(s) -l Used for Changing

h 5 diff • Finds differences in two files Flag(s) -l Used for Changing storage layout of the datasets in the file -f Applying (or removing) compression 10/17/15 ICALEPCS 2015 13 www. hdfgroup. org

h 5 copy • Copies a specified content within an HDF 5 file or

h 5 copy • Copies a specified content within an HDF 5 file or to a new HDF 5 file • Easy to extract data to the new HDF 5 file • Limitation – cannot copy to “/” root group Flag(s) -f -f ref 10/17/15 Used for Controlling “copy” options Coping references and the objects they referenced ICALEPCS 2015 14 www. hdfgroup. org

h 5 check • Uses file specification to checks file format consistency • Useful

h 5 check • Uses file specification to checks file format consistency • Useful with corrupted files to see if any data can be salvaged 10/17/15 ICALEPCS 2015 15 www. hdfgroup. org

The HDF Group Thank You! Questions? 10/17/15 ICALEPCS 2015 16 www. hdfgroup. org

The HDF Group Thank You! Questions? 10/17/15 ICALEPCS 2015 16 www. hdfgroup. org