LANCE AMSR 2 ISS LIS Sherry Harrison sherry

LANCE AMSR 2 / ISS LIS Sherry Harrison (sherry. harrison@uah. edu) Amy Lin (amy. lin@uah. edu) Presented at the LANCE UWG April 17 -18, 2019

AMSR 2 LANCE NRT Products LANCE UWG Meeting 2

U. S. AMSR Science Team Leads Product Algorithm PI Precipitation Kummerow, CSU Atmosphere over Ocean Kummerow, CSU Soil Moisture Jackson, USDA Chan, JPL Sea Ice Markus, GSFC Snow Water Equivalent Tedesco, Columbia U 4/17/19 3

AMSR 2 LANCE NRT Processing Status and Plans AMSR 2 LANCE Product L 2 B Rain/Ocean L 3 Snow L 3 Sea Ice L 2 B Soil Moisture Near Real Time Processing Status and Plans Preliminary NRT product available since March 2015 NRT AMSR 2 v 1 Unified L 3 Global Daily 25 km EASE-Grid Snow Water Equivalent products available since April 2019. (replaced preliminary NRT product that was available since August 2015) NRT AMSR 2 v 2 Unified L 3 Daily (6. 25 km, 12. 5 km, 25 km) Polar Gridded Sea Ice products March 2019. (replaced preliminary NRT product that was available since Dec 2015) NRT AMSR 2 Beta v 2 Unified Level-2 B Half-Orbit 25 km EASE-Grid Surface Soil Moisture products available since April 2018. (replaced preliminary NRT product that was available since June 2016) Planned Algorithm Updates: • AMSR-U 2 Rain and Ocean standard product algorithms are currently in Integration and Test at the AMSR-SIPS. Once they are moved into production at the SIPS, they will be implemented in LANCE within 1 -2 months. 4/17/19 4

New LANCE NRT AMSR 2 and ISS LIS Website 4/17/19 https: //lance. nsstc. nasa. go v 5

New LANCE NRT AMSR 2 Data Recipe LANCE NRT AMSR 2 L 2 B Global Swath Rain Ocean Data Quickview using Python and GIS Data Recipe: A Python-based data recipe enabling users to compile information from a series of NRT AMSR 2 Rain Ocean Swath data files and generate a CSV file containing surface precipitation rates with locations to enable use with other software. The data recipe and associated code may be accessed here: https: //ghrc. nsstc. nasa. gov/home/data-recipes/lance-nrt-amsr 2 -l 2 b-global-swath-rain-ocean-data-quickview-using-python-and-gis 4/17/19 6

LANCE NRT AMSR 2 Data and Hurricanes Hurricane Florence, Tropical Storm Isaac, and Hurricane Helene were clearly visible in Worldview using LANCE NRT AMSR 2 data. The NASA Earth Science Disasters Program also featured our LANCE AMSR 2 data on their website. 4/17/19 7

AMSR 2 LANCE NRT Processing Status and Plans LANCE AMSR 2 net. CDF status: • For most products, we have incorporated net. CDF/CF metadata into the existing HDF-EOS 5 files, leaving data structures and other metadata unchanged, per ESDIS Dataset Interoperability Recommendations for Earth Science: https: //earthdata. nasa. gov/standards/datasetinteroperability-recommendations-for-earth-science • Complex group structure of L 2 Soil Moisture product is not compatible with many net. CDF tools (e. g. , Panoply), so separate net. CDF/CF files were developed. 4/17/19 8

AMSR 2 LANCE NRT Processing Status and Plans • Working Agreement between the US Advanced Microwave Scanning Radiometer (AMSR) Project and the ESDIS Project for Science Data Archive and Distribution Support o. Describes new AMSR Science Team responsibilities § New AMSR Science Team Lead, Chris Kummerow o. Describes AMSR SIPS responsibilities going forward • AMSR-SIPS assumed the AMSR Integration and Testing responsibilities from the SCF on March 1, 2019 in preparation for the retirement of the SCF personnel this summer. 4/17/19 9

ISS LIS LANCE NRT Products LANCE UWG Meeting 10

ISS LIS Overview • ISS LIS was integrated as a hosted payload on Do. D Space Test Program-Houston 5 (STP-H 5) and launched on Space. X CRS-10 on 19 February 2017, with on-orbit activation 27 February, for a nominal 2 year mission. o The ISS LIS mission was extended. • LIS measures global lightning (amount, rate, radiant energy) during day and night, with storm scale resolution, millisecond timing, and high, uniform detection efficiency. Background images are also generated. • ISS LIS will extend TRMM time series observations, expand latitudinal coverage, provide real time data to operational users, and enable cross -sensor calibration. • PI Dr. Richard Blakeslee, NASA MSFC • Near real-time products (available within 2 minutes) are distribute by LANCE and standard products are processed, archived and distributed by the GHRC DAAC. • Data are available in net. CDF-4/CF as well as legacy HDF 4 11 4/17/19

ISS LIS Data Products: Three Quality Levels • Near real-time – available through GHRC DAAC and LANCE • Data available within two minutes of observation • There may be data drop outs due to the nature of RT data transmission • Appropriate for applications requiring low data latency; for scientific research please use the standard data product • Non-quality controlled – now available through GHRC • • Standard products created daily More complete than the near-real time data Data has not been reviewed to assure data quality Appropriate for science and operational applications • Quality controlled – available soon at GHRC • Manual quality control steps preformed to ensure that all bad data are flagged • Appropriate for scientific research and publications 4/17/19 12

Evolution of Products • Initial public release of Beta level data September 2017. • Provisional daily NQC and Real-Time data were publicly released in January 2018. • LIS now has sub-millisecond timing as verified by comparing to one space based and two ground based lightning detection systems (this includes the Geostationary Lightning Mapper, Earth Networks Global Lightning Network, and Vaisala’s GLD 360). • LIS has sub-pixel pointing accuracy with a peak distance offset of 2 to 2. 5 km when compared to GLM, which detects lightning from space using same technique as LIS. • LIS data can be now used in support of science and operational applications. • Provisional version P 0. 2 daily NQC and Real-Time data were publicly released on July 26, 2018. • These new data contain geolocation improvements of lightning flash locations. 4/17/19 13

Validated ISS LIS Products • Improvements to LIS science algorithm are underway in preparation for the release of the Final validated Version 1 dataset in early summer 2019. Some of the improvements include: o Corrections to the background images due to packet loss o Correctly calculating the footprint size o Reporting the radiance values o Correcting partial orbit files (doesn’t affect NRT data) • We have these corrections integrated into the GHRC development software environment for testing. • The goal is to have the Final validated Version 1 ISS LIS dataset published before the ISS LIS End of Prime Mission Review (Eo. PMR) planned for late June, 2019. o Rich plans to request an additional year extension to the ISS LIS mission. o We want to have coincidence data with the new lightning instruments (e. g. , GOES-T, Chinese lightning instrument, European lightning instrument) if possible. 4/17/19 14

New LANCE NRT AMSR 2 and ISS LIS Website 4/17/19 https: //lance. nsstc. nasa. g ov 15

LANCE ISS LIS • Data available within two minutes of observation. • There may be data drop outs due to the nature of RT data transmission. • These data are appropriate for applications requiring low data latency, for scientific research please use the standard data product. • ISS LIS Near Real Time Latest Browse Image (updated every 2 minutes). 4/17/19 16

NRT ISS LIS and Operational Products • Provide NRT ISS LIS data via LDM: • NWS Aviation Weather Center (in progress) o AWC is working with sample data o Sys. Admin setting up LDM • NWS Ocean Prediction Center (in progress) • NOAA National Hurricane Center (planned) • NWS Pacific Region (planned) • High impact weather lake system (HIGHWAY): • HIGHWAY delivers improved early warnings to local communities by using innovative products and leveraging existing scientific expertise of the national meteorological services in the East African Region. • Lake Victoria is the largest fresh water body in Africa and the largest inland fishery in the world. • Up to 5, 000 fishermen and small boat operators die on the lake each year, affecting 40, 000 dependents and compounding the poverty cycle. • Establishing a sustainable early warning system will reduce loss of life and damage to property and drive economic development. • LANCE ISS LIS is providing NRT lightning subsets over the region of interest in Africa. 4/17/19 17

BACK-UP CHARTS AMSR SIPS and LANCE 18

ISS LIS Data Flow Successful NRT end-toend demonstration in GHRC’s Amazon web space. Plan to move to NGAP Sandbox when it’s available to us. 4/17/19 19

LANCE AMSR 2 System NRT L 1 R NOAA NCEI SS GSFC T GMAO (Future ancillary products) • • Worldview AMSR 2 NRT L 2, L 3 daily Science data gwen. nsstc. nasa. gov lance. nsstc. nasa. gov Data Ingest & Processing LANCE Web & FTP Server full res imager y metrics EMS metada ta CMR MSFC/UAH NSSTC -- NASA network gwen. itsc. uah. ed u Data Ingest & Processing lance. itsc. uah. e du LANCE Web & FTP Server UAH Tech Hall – UAH network GIBS LANCE AMSR 2 NRT data products in HDF -EOS 5 and net. CDF-4 Earth. Data Login Registered Users KSAT Svalbard Ground Station JAXA GCOM-W 1 Data Providing Service LANCE AMSR 2 Level 2 and Level 3 processing systems at AMSR SIPS Redundant processing strings on 2 independent networks in different buildings greatly reduces the possibility of data being unavailable due to system outages LANCE AMSR 2 NRT data products are available from AMSR SIPS for 7 -14 days 20

Science Software Integration & Test (LANCE) • Science Software Integration and Test (SSI&T) for initial near real-time products was the responsibility of the SIPS. The process was similar: • Review the science algorithm code • Define and implement ECS-compliant metadata and quality routines • Verify that the algorithm runs as a stand-alone PGE and creates a data product file, metadata, a production history file and a Q/A summary report • Verify that files generated at the SIPS produce the same scientific output as sample files provided by the science team • Prepare software release notes and bundle the PGE, metadata, and QA software into a Delivered Algorithm Package • Going forward, AMSR 2 standard product algorithms will be implemented in LANCE after they are in production at the SIPS • The new DAP is obtained after acceptance at the SIPS • Software is updated as required for LANCE production rules, file names and metadata 4/17/19 21

Hardware Diagram 4/17/19 22

Algorithm Acceptance Test Process SIPS Systems TL-SCF SSI&T: • Algorithm test • metadata, QA Algorithm updates Land Algorithm Snow Teams Rain/Ocean Algorithm updates Interface or production rule changes; new product Initial LANCE Proces s Operations Acceptance Test Install in Production at SIPS Processing Automation dev & test Nominal LANCE Process Sea Ice LANCE SSI&T: • Algorithm test • metadata, QA 4/17/19 Delivered Algorithm Packages (DAPs) DAP LANCE updates DAP LANCE DAP Interface or production rule changes; new product Processing Automation dev & test LANCE Systems Operations Acceptance Test Install in Production at LANCE 23

AMSR-U Processing and Dependencies GEOS 5 FP-IT (GSFC GMAO) Reynolds OISST (NOAA NCEI) Level-1 R Brightness Temperatures (JAXA) Product Generation _____ L 2 B Soil Moisture ~ 29 times (1/2 -orbit) per day L 2 B Rain L 2 B Ocean (1/2 -orbit) L 3 Sea Ice (Daily, 3 Res) L 3 Ocean (Daily) L 3 Snow (Pentad) 4/17/19 L 3 Ocean (Monthly) Once per day Once every five days Once per week L 3 Ocean (Weekly) L 3 Rain (Monthly) L 3 Soil Moisture (Daily) L 3 Snow (Monthly) Once per month 24

AMSR SIPS Data Flows KSAT Svalbard Ground Station 1 L 2 A NOAA NCEI OISS GIBS NSIDC DAAC EMS science algorithms TLSCF Science Software Integration and Test Metadata & QA software science algorithms T GSFC GMAO GEOS-5 FP -IT 4/17/19 data & metadat a metrics (science, metadata, qa, ph, subsets, browse) AMSR-E 2 L 1 A AMSR-E RSS full res imagery AMSR 2 AMSR SIPS L 1 R AMSR-E AMSR L 2 B & L 3 L 1 R Product Generation Land Algorithm Snow Teams Rain Ocean Sea Ice science QA JAXA GCOM-W 1 Data Providing Service Worldview 1 AMSR-U data collection uses Level-1 R brightness temperatures from JAXA as input 2 AMSR-E data collection uses Level-2 A brightness temperatures from RSS as input 25