EOSDIS Status 10162008 Dan Marinelli Science Systems Development

EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office

EOSDIS Context Distributed Active Archive Centers (DAACs) REASo. N ACCESS Instrument Science Team Facilities (SCFs and SIPSs) Data Assimilation Model Adapted from

EOSDIS Mission Profile

Earth Science Data and Information System (ESDIS) Project - GSFC Code 423 • Objective - Develop and Operate Earth Observing System Data and Information System (EOSDIS) – A production capability for standard science data products from EOS instruments – An “active archive” of Earth science data from EOS and other past and present Earth science missions – A distributed information framework (data centers, system elements, interfaces and data model) supporting EOS investigators and other users in science, government, industry, education, and policy • Organizations: ESDIS Project meets its requirements by funding and managing several organizations including – “Large” industrial: Raytheon (EMD) – Distributed Data Centers - NASA Centers (GSFC, JPL, La. RC), other government agencies (EDC, – • ORNL), Universities (ASF, NSIDC, SEDAC) Science Investigator-led Processing Systems (SIPSs) - NASA Centers (GSFC, JPL, La. RC, MSFC), NCAR Project Components: – SDPS - System for ingesting, processing, archiving and distributing data – Data Centers - Science System Operations – EOSDIS Networks - Transportation of mission & science data – SIPS - Systems developed and operated by PIs or Team Leaders for generation of standard data products for delivery to Data Centers • Status – EOSDIS has been successfully supporting EOS missions since 1999 – Volume of data available from EOS missions continues to grow. Current volume at 4. 9 petabytes. – EOSDIS archive contains current as well as legacy Earth science data - more than 2700 datasets – In FY 2007, over 100 million products were distributed to just over 165, 000 unique users; approximately – • 3. 0 million distinct users accessed the EOSDIS data centers. ESDIS Project is working closely with the user community to enhance systems that support and provide access to data Web Site: http: //eos. nasa. gov/eosdis

Monthly Distribution by Products (Sep 2007 - Aug 2008) ASF EDC GSFC JPL La. RC Latis NSIDC ORNL MODAPS GHRC SEDAC Jun-08 Jul-08 20, 000 18, 000 Product Counts (in 1000's) 16, 000 14, 000 12, 000 10, 000 8, 000 6, 000 4, 000 2, 000 0 Sep-07 Oct-07 Nov-07 Dec-07 Jan-08 Feb-08 Mar-08 Month Apr-08 May-08 Aug-08

Month Aug-08 Jul-08 Jun-08 GHRC May-08 Apr-08 MODAPS Mar-08 Feb-08 ORNL Jan-08 Dec-07 NSIDC Nov-07 Oct-07 Latis Sep-07 Aug-07 La. RC Jul-07 Jun-07 JPL May-07 Apr-07 GSFC Mar-07 Feb-07 EDC Jan-07 ASF Dec-06 Nov-06 Oct-06 Sep-06 Product Counts (in 1000's) Monthly Distribution by Products (Sep 2006 - Aug 2008) SEDAC 20, 000 18, 000 16, 000 14, 000 12, 000 10, 000 8, 000 6, 000 4, 000 2, 000 0

0 Month Aug-08 Jul-08 Jun-08 May-08 GHRC Apr-08 MODAPS Mar-08 Feb-08 Jan-08 ORNL Dec-07 NSIDC Nov-07 Oct-07 Latis Sep-07 Aug-07 La. RC Jul-07 Jun-07 JPL May-07 GSFC Apr-07 Mar-07 EDC Feb-07 ASF Jan-07 Dec-06 Nov-06 Oct-06 Sep-06 Volume (TB) Monthly Distribution Volume (Sep 2006 - Aug 2008) SEDAC 250 200 150 100 50

Recent Progress – Transition from EOS Data Gateway (EDG) to ECHO/WIST Underway. NSIDC, Oak Ridge, and Alaska DAACs have completed transition. Over 1600 new users currently accessing EOS data via ECHO/WIST. – Will complete once ECS 7. 21 is operational at all sites • 7. 21 was deployed and includes ingest of all data via Data Pool, conversion to an XML archive for metadata, distribution enhancements

Plans for the next year – ECS Release 7. 22: work underway for final delivery planned under EMD Contract - will include: • Custom code changes to support transition to disk-based archive • Improvements to Bulk Metadata Generation Tool to automate response to error conditions in interface to ECHO • Enhanced Checksumming, including validation of integrity of files in the datapool and archive • Operating System and Compiler Upgrades (including custom code changes) • Code simplification - complete removal of all remnants of Science Data Server and heritage Storage Management components (replaced in Release 7. 21)

EOSDIS Futures • Future spending profile reflects reductions being achieved with evolution – GES DISC off of ECS; MODAPS performs MODIS processing and L 1/atmospheres archive and distribution – ASDC DAAC now supports CERES with their ANGe system; ECS to remain in place through at least 7. 22 for other EOS instruments – ECS evolution development to be complete by March 2009 – has resulted in greatly reduced physical, SLOC footprint, and thus cost to maintain • ECS contract expires May 2009; ESDIS is putting together RFP for the follow-on ECS Evolution and Development Contract • THG grant renewed 7/2008 for 3 years • New NASA guideline implies we may not be able to host this workshop in the future – we’ll keep you posted