Committee on Earth Observation Satellites Landsat Archive Cloud
Committee on Earth Observation Satellites Landsat Archive Cloud Access/Data Policy Session 8: Expanding our work on data democracy U. S. Geological Survey Christopher Barnes CEOS WGCap. D-9 Annual Meeting Sunnyvale, California 10 -12 March 2020 WGCap. D-9 Annual Meeting March 10 -12, 2020
Introduction • For over two years, the Landsat Product Improvements Project has been actively working on processing and enabling access to Landsat in the cloud • This includes the implementation of a new cloud-optimized Landsat data format along with prototyping new search, discovery, access, and download capabilities • Amazon Web Services • Current commercial cloud provider for the USGS Landsat archive • Transformed the way development is undertaken with the availability of Simple Storage Service (S 3) buckets, Elastic Compute Cloud (EC 2) instances, and serverless functionality like Lambda functions WGCap. D-9 Annual Meeting March 10 -12, 2020 2
Cloud Optimized Geo. TIFF (COG) • All Landsat data products (Collection 1 & Collection 2) will be made available in an unbundled, cloud -optimized format with lower resolution overview layers o Uses internal tiling instead of lines to speed up access and support better remote reading o Downsampled overviews are generated when lower resolution data is acceptable o No changes to the underlying pixels o Data is internally compressed o Enables HTTP Get Range requests • Enables users to extract areas of interest and select just the bands they require without downloading the entire scene, which does not impact the integrity of the pixel-level-data • USGS Landsat archive cloud access will be available in mid 2020 WGCap. D-9 Annual Meeting March 10 -12, 2020 3
Landsat. Look Upgrade • USGS Landsat. Look will be replaced with a new web application interface that will harness the power of the cloud o Create custom composites based on user criteria o Render imagery with pre-canned or user defined band combinations or select from available spectral indices o Export user-defined criteria into a time-lapse video for later viewing o Available in mid-2020 WGCap. D-9 Annual Meeting March 10 -12, 2020 4
Data Access • Spatio. Temporal Asset Catalog (STAC) o To enable access in a cloud, environment, a new metadata format, STAC, was initiated by the open-source geospatial community o STAC unifies metadata for programmatic access across multiple platforms and data providers for improved search and discovery utility • Data Access Paradigm Shift o Open-source software tools such as Jupyter Notebooks will allow users to bring their science algorithms to the data o Stream the information instead of downloading, retaining and managing local copies of the data o Scientific algorithms may be shared through notebooks WGCap. D-9 Annual Meeting March 10 -12, 2020 5
Landsat Data Policy • In 2008, the USGS announced “Imagery for Everyone…” which stated that all users will have nocost electronic access to any Landsat scene held in the USGS-managed archive • Removed financial barriers for institutions and researchers to pursue new and previously inconceivable Landsat applications • Prior to 2008 open data policy, researchers were restricted to the data they could afford, rather than the data they required • Landsat downloads just topped 100 million! • USGS Landsat no-cost open data policy remains intact since its inception in 2008 WGCap. D-9 Annual Meeting March 10 -12, 2020 6
Contact/Connect usgs. gov/landsat @USGSLandsat @NASA_Landsat @NASA. Landsat WGCap. D-9 Annual Meeting March 10 -12, 2020 +1 800 -252 -4547 +1 605 -594 -6151 custserv@usgs. gov @usgslandsat Landsat Updates Landsat Headlines 7
- Slides: 7