MISR Products and Tools Life of an HDFEOS

  • Slides: 31
Download presentation
MISR Products and Tools “Life of an HDF-EOS Science Data Product. A gritty, behind-the-scenes

MISR Products and Tools “Life of an HDF-EOS Science Data Product. A gritty, behind-the-scenes exclusive!” Brian Rheingans and Kyle Miller MISR Instrument Team Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 1

MISR, EOS-Terra Instrument http: //www-misr. jpl. nasa. gov Science Data Processing Workshop, Greenbelt, MD.

MISR, EOS-Terra Instrument http: //www-misr. jpl. nasa. gov Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 Multi-angle Imaging Spectro-Radiometer 9 cameras, 4 spectral channels, pushbroom CCD. Continuous daylight swath acquisition. 150 TB of HDF at the Langley DAAC. ~50 product types, hundreds of fields. 2

Multi-angle Concept Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 3

Multi-angle Concept Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 3

You Are Here Only 3% of the Length of One MISR Swath shown Science

You Are Here Only 3% of the Length of One MISR Swath shown Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 4

MISR Swath 400 km swath width. Several product types > 2 GB uncompressed. HUGE

MISR Swath 400 km swath width. Several product types > 2 GB uncompressed. HUGE extent of latitude/longitude. Stringent science constraints on distortion and geolocation. Ambitious algorithms. Stringent size, and computing restraints. HDF-EOS on HDF 4 Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 5

HDF-EOS Stacked-Block Grid 180 blocks per path; fixed locations. Same-size, rectangular in SOM. Each

HDF-EOS Stacked-Block Grid 180 blocks per path; fixed locations. Same-size, rectangular in SOM. Each block is compressed as a separate chunk. HDF-EOS Grid meta describes top block. Other blocks offset to follow ground track; part of MISR-unique ext. of HDF-EOS. Foundation of 2 mil. Lines of science code Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 6

HDF-EOS File vs. Aligned Image Red Channel Grid SDS (180 Stacked Blocks) Sample dim

HDF-EOS File vs. Aligned Image Red Channel Grid SDS (180 Stacked Blocks) Sample dim sample Line dim SOM X: 10, 000 m Y: 450, 000 m ( path-specific) Block dimension -SOM coordinates of top-block corners part of Grid metadata. -Projection and orbital parameters part of Grid Metadata -Offsets of each block from the one above part of Stacked-block grid extension metadata. Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 7

Where does this pixel belong? Lat/Lon not stored in product. In the SDS pixel

Where does this pixel belong? Lat/Lon not stored in product. In the SDS pixel = (block, line, sample) Conversion <-> SOM <-> Lat/Lon require: • • Several different metadata reads. Custom code to do some offset arithmetic. HDF-EOS grid api and use of the GCTP map proj. lib. Lots of Patience. Described in the MISR Data Product Specification, Appendix A. Or BIG ancillary dataset, OR Tools! Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 8

Mapping Data Users to Tools Use only MISR-specific GUI tools: • If you are

Mapping Data Users to Tools Use only MISR-specific GUI tools: • If you are a MISR-centric scientist with nearly zero tolerance for anything digital. • If you are a curious individual who want to fiddle with MISR data or learn about MISR file structure. Also use geotiff converters: • If you analyze a lot of MISR data. • If you like Photoshop, GIS tools and reprojections. • If you want to co-locate MISR images with other data. Also use custom GIS converters: • If you want to do serious data analysis involving MISR science data values (vs images) and other data in a GIS environment. Also use DPS doc and stacked-block grid api • If you must read lots of MISR data into your custom software and you possess some programming savvy • If you are a Tool Writer/Vendor. Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 9

Path/Orbit-based Web Browse Tool http: //eosweb. larc. nasa. gov See images before Ordering them.

Path/Orbit-based Web Browse Tool http: //eosweb. larc. nasa. gov See images before Ordering them. Explore path, orbit And geographic Coverage. Browse images Are jpg and aren’t Full resolution. Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 10

How can I get at MISR Metadata easily? FORTRAN GUTS Tcl-Tk GUI USERS: Beginner

How can I get at MISR Metadata easily? FORTRAN GUTS Tcl-Tk GUI USERS: Beginner who Wants to learn about MISR file structure. Expert when chasing A problem. • Displays HDF-EOS structures and all metadata easily. • Allows minor editing of the HDF-EOS file. • Performs some statistics on the data. • Can only visualize single un-assembled blocks. Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 11

Hdfscan – Main Menu Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 12

Hdfscan – Main Menu Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 12

Hdfscan Image with Histogram Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 13

Hdfscan Image with Histogram Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 13

MISRView USER: REQUIRES IDL !!! MISR-CENTRIC SCIENCE DATA ANALYST • Maps path/orbit to time

MISRView USER: REQUIRES IDL !!! MISR-CENTRIC SCIENCE DATA ANALYST • Maps path/orbit to time and date • Assembles multiple MISR blocks • Reports Lat/Lon via static lookup table. • Displays true color MISR imagery • Can reproject MISR imagery Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 • Perspective tool • Band slider tool • Scroll tool • Vector overlay tool 14

MISRView – Main Menu Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 15

MISRView – Main Menu Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 15

MISRView – L 1 B 2 Radiance Data Science Data Processing Workshop, Greenbelt, MD.

MISRView – L 1 B 2 Radiance Data Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 16

MISRView – MISR Vision (R-Ba, G-An, B-Bf) Science Data Processing Workshop, Greenbelt, MD. February

MISRView – MISR Vision (R-Ba, G-An, B-Bf) Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 17

ERDAS Imagine 8. 5 Custom import routines to convert MISR HDF-EOS files into Imagine

ERDAS Imagine 8. 5 Custom import routines to convert MISR HDF-EOS files into Imagine files preserving geolocation via projection parameters. SGI Irix utilities for most MISR Grid and some MISR Swath files. Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 18

Imagine – Full Swath/Full Res. Geo-linked Science Data Processing Workshop, Greenbelt, MD. February 28,

Imagine – Full Swath/Full Res. Geo-linked Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 19

ERDAS Imagine – Raster/Vector Overlay Science Data Processing Workshop, Greenbelt, MD. February 28, 2002

ERDAS Imagine – Raster/Vector Overlay Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 20

ERDAS Imagine – GIS Data Analysis Science Data Processing Workshop, Greenbelt, MD. February 28,

ERDAS Imagine – GIS Data Analysis Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 21

ERDAS Imagine – Mount Enta Perspective DEM Overlay Science Data Processing Workshop, Greenbelt, MD.

ERDAS Imagine – Mount Enta Perspective DEM Overlay Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 22

L 1 B 2_to_geotiff Conversion Tool Convert MISR imagery into generic format readable by

L 1 B 2_to_geotiff Conversion Tool Convert MISR imagery into generic format readable by any preferred GIS tool: tiff / geotiff format Preserve geolocation / projection information Reproject to any GCTP-supported projection Facilitate subset and mosaic procedures. Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 23

L 1 B 2_to_geotiff – Ross Ice Shelf SOM Path 51 Oribt 5089 Science

L 1 B 2_to_geotiff – Ross Ice Shelf SOM Path 51 Oribt 5089 Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 24

L 1 B 2_to_geotiff – Ross Ice Shelf SOM Path 50 Oribt 5220 Science

L 1 B 2_to_geotiff – Ross Ice Shelf SOM Path 50 Oribt 5220 Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 25

L 1 B 2_to_geotiff – Ross Ice Shelf Polar Stereographic Path 51 Oribt 5089

L 1 B 2_to_geotiff – Ross Ice Shelf Polar Stereographic Path 51 Oribt 5089 Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 26

L 1 B 2_to_geotiff – Ross Ice Shelf Polar Stereographic Path 50 Oribt 5220

L 1 B 2_to_geotiff – Ross Ice Shelf Polar Stereographic Path 50 Oribt 5220 Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 27

L 1 B 2_to_geotiff – Pine Island Glacier Time Series Science Data Processing Workshop,

L 1 B 2_to_geotiff – Pine Island Glacier Time Series Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 28

Lambert Conformal Conic Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 29

Lambert Conformal Conic Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 29

Interrupted Goode Homolosine Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 30

Interrupted Goode Homolosine Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 30

US/Mexico Geographic Mosaic Courtesy Jim Knighton, JPL Multiple MISR Swaths were Reprojected with L

US/Mexico Geographic Mosaic Courtesy Jim Knighton, JPL Multiple MISR Swaths were Reprojected with L 1 B 2_to_geotiff Prior to custom Mosaic, cloud Removal and Equalizations. Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 31