EOSDIS Science Operations Jeanne Behnke March 5 2014
EOSDIS: Science Operations Jeanne Behnke March 5, 2014
EOSDIS Facilities Data centers, collocated with centers of science discipline expertise, archive and distribute standard data products produced by Science Investigator-led Processing Systems (SIPSs) ASF DAAC SAR Products Sea Ice, Polar Processes SEDAC CDDIS Crustal Dynamics Solid Earth NCAR, U of Col. HIRDLS, MOPITT, SORCE Key Data Center LP DAAC GES DISC LAADS/ MODAPS La. RC 2 ACRIM Ocean Circulation Air-Sea Interactions GHRC Hydrological Cycle & Severe Weather Atmosphere CERES, SAGE III San Diego PO. DAAC OBPG Ocean Biology & Biogeochemistry ORNL DAAC Biogeochemical Dynamics, EOS Land Validation SIPSs ECS Sites GLAS, MODIS, OMI, OBPG Atmos Composition & Dynamics, Global Modeling, Hydrology, Radiance NSIDC DAAC JPL GSFC Land Processes & Features Cryosphere, Polar Processes MLS, TES Human Interactions in Global Change ASDC GHRC AMSR-E, LIS Radiation Budget, Clouds, Aerosols, Tropo Chemistry
Discipline Specific Data Centers • NASA’s Earth Observing System collects data for specific parameters associated with the 24 EOS measurements as defined by the NASA Earth Science community (through NASA HQ ESMD) • From http: //science. nasa. gov/earth-science/ – A major component of NASA’s Earth Science Division is a coordinated series of satellite and airborne missions for long-term global observations of the land surface, biosphere, solid Earth, atmosphere, and oceans. – This coordinated approach enables an improved understanding of the Earth as an integrated system. • Data Centers (DAACs) are arranged by science discipline and provide unique support and expert services to their user communities. • DAACs provide data and services to the research community for comprehensive cross-discipline studies needed to understand Earth as an inter-related system. • DAACs ensure safe stewardship of NASA’s data
Science Investigator Processing Systems • Perform forward processing and produce standard data products with data from EOS missions Terra, Aqua, and Aura. • Reprocess standard data products to reflect algorithm improvements and ensure consistent time series • Provide sustaining support for all SIPS: MODIS (Terra and Aqua – all except ocean products) – MODAPS/LAADS* at GSFC MODIS (Terra and Aqua – Ocean products) – ODPS* at GSFC, Greenbelt, MD MOPITT (Terra) – NCAR, Boulder, CO AMSR-E (Aqua) – GHRC, Huntsville, AL – ended in final product generation AMSR-2 (GCOM-W) - GHRC, Huntsville, AL – commencing product generation MLS (Aura) – JPL, Pasadena, CA OMI (Aura) – OMIDAPS at GSFC, Greenbelt, MD TES (Aura) – JPL, Pasadena, CA * LAADS and ODPS also responsible for archive and distribution of products to users
Work performed at DAACs • Mission support: new datasets evaluation, expertise in discipline datasets, data conversion/fusion, metadata development/checking, support to Science Team • Software development: specific code for data management systems, error checking, set up automation, integration into existing tools, web presence • Tool and User interface development and testing (e. g. , web presence; mission/discipline/ data specific search and access tools, subsettting tools) • General systems engineering: scheduling, network management, test management, reporting • Archive/distribution/operations: day-to-day monitoring; metrics collection & reporting • User services: documentation, FAQ, outreach, content management system • Infrastructure support: systems admin, web development, security • Management: general support including administrative, resources
Cross-Cutting Functions • ESDIS Project science operations functions include - Management of Interface Documentation including ICDs, IPA, PIPs, etc… - Establish Operations Agreements between DAACs and SIPS and Science Teams - Enable Science Team Interactions - Lead End-to-end testing and Readiness Reviews between instruments and campaigns and the DAACs/SIPs - Development of standards for use with NASA data through the ESDIS Standards Office - Develop DAAC & SIPS systems for new missions - Hold workshops and training sessions for DAACs to support new techniques and software
NASA Earth Science Data Policy • • • NASA commits to the full and open sharing of Earth science data obtained from NASA Earth observing satellites, sub-orbital platforms and field campaigns with all users as soon as such data become available. There will be no period of exclusive access to NASA Earth science data. Following a post-launch checkout period, all data will be made available to the user community. Any variation in access will result solely from user capability, equipment, and connectivity. NASA will make available all NASA-generated standard products along with the source code for algorithm software, coefficients, and ancillary data used to generate these products. All NASA Earth science missions, projects, and grants and cooperative agreements shall include data management plans to facilitate the implementation of these data principles. NASA will enforce a principle of non-discriminatory data access so that all users will be treated equally. For data products supplied from an international partner or another agency, NASA will restrict access only to the extent required by the appropriate Memorandum of Understanding (MOU). http: //science. nasa. gov/earth-science-data/data-informationpolicy/
Understanding and Working with Users • User Working Groups – Each DAAC has a science user working group of advisers • Customer Satisfaction – Evaluation through online survey to evaluate satisfaction • Metrics Collection and Evaluation • User Services Working Group – DAAC user services personnel work together to best service science communities – User feedback – Kayako – Personal interaction with users
UWG = User Working Group • UWGs were conceived by NASA HQ (Martha Maiden) to provide community input into the operation of the DAAC and EOSDIS • They are convened for each DAAC: – Charters were established for each UWG and are reviewed annually for any changes. There is no standard UWG charter, they are customized per DAAC. – UWG members comprise users, data providers, scientists, NASA HQ, data center members, and ESDIS • By invitation from HQ Program Scientist, ESDIS and the DAAC Manager – Recommendations from UWGs are ‘folded’ into DAAC work plans. • Meet in person at least once per year; plan about 2+ telecons per year.
Role of UWGs • assist in defining and accomplishing the DAAC's science goals; • provide guidance on DAAC data management priorities; • provide oversight and guidance on DAAC activities, including data set acquisition, development of value-added products, user support, development activities, and operational functions; • provide recommendations about annual work plans and longrange planning; • coordinate science issues with the ESDIS Project staff and Program Scientists.
11
American Customer Satisfaction Survey • Since 2004, ESDIS has coordinated an independent yearly survey of its users • Contract with the Claes-Fornell Institute (CFI Group) – purveyors of the American Customer Satisfaction Index (ACSI) • http: //www. theacsi. org/the-american-customer-satisfaction-index • The ACSI is the #1 national indicator of customer satisfaction for more than 225 companies and over 130 customer programs and services at federal agencies. • Purpose: – Measure customer satisfaction with NASA Earth Observing System Data and Information System at a national level for each Data Center • Identify the key areas that NASA can leverage across the Data Centers to continuously improve its service to its customers. The results have provided valuable input to help the ESDIS Project and data centers assess current status and improve future services. • Assess the trends in satisfaction with NASA EOSDIS specifically in the following areas: • • • Product Search Product Selection and Order Delivery Product Quality Product Documentation Customer Support
Satisfaction slips. EOSDIS one point to 76 after holding at. Trend 77 since 2008 NASA Customer Satisfaction ACSI 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 n=1016 n=1263 n=2857 n=2291 n=2601 N=3842 n=4390 n=3996 n=4315 n=4146 75 78 74 75 77 77 77 76 (+/-) 0. 9 (+/-) 0. 7 (+/-) 0. 5 (+/-) 0. 6 (+/-) 0. 5 (+/-) 0. 4 79 82 78 80 81 81 81 80 73 73 71 73 74 74 74 73 71 76 72 73 75 75 75 Overall satisfaction How satisfied are you with the data products and services provided by [DAAC]? Expectations To what extent have data products and services provided by [DAAC] fallen short of or exceeded expectations? Ideal How close does [DAAC] come to the ideal organization?
Data Management Coordination • ESDIS coordinates science operations by a combination of meetings, teleconferences and planning guides • Meetings – telecons are not sufficient – – Yearly Face-to-face system engineering & management Technical interchange meetings as needed Regular telecons WIKI forums • Support the Earth Science Data Systems Working Group (ESDSWG) and ESIP Federation – External partnerships and community involvement • Involvement in Standards/Systems definition - ex: HDF, Metadata, FGDC/OGC, NASA Process definition 14
ESDIS Metrics System • ESDIS Project developed and maintains the metrics system (EMS) – Purpose is to collect and report statistics on science data metrics and web activity at the EOSDIS data centers during each Fiscal Year – Annual Report 1990 s through today – https: //earthdata. nasa. gov/about-eosdis/performance – Basic approach is software collection of file access logs that provide metrics on utilization of data sets, data search, and some data formatting services – Uses Net. Insight Web tracking for finding common access patterns, guiding web page re-organization, and enabling more efficient access to data and documentation • Provides characterization of the use of the EOSDIS 15
Archive This table shows the amount of data added to the archive during FY 2013 and includes all products levels. Archive metrics for OBPG and NSIDC V 0 are not available at this time. February 2014 FY 2013 Annual Report 16
Distribution By DAAC Distribution presents the amount of data successfully distributed to Public Users. February 2014 FY 2013 Annual Report 17
Data Distribution - Top 20 Countries * Some products are inherently larger than other files in size and therefore may skew the results. ** When counting # of products, metadata files are excluded. February 2014 FY 2013 Annual Report 18
Web Trends Web metrics data for EOSDIS became available as of FY 2007. Data for FY 2007 is complete for 7 DAACs and FY 2008 is complete for 8 DAACs. Since FY 2009, 11 DAACs provided web metrics. These metrics are for visits of one minute or more. Repeat visitors are counted as 2 or more visits since web activity measurements began for that DAAC. February 2014 FY 2013 Annual Report 19
- Slides: 19