Ameri Flux Data Management Tom Boden Carbon Dioxide
Ameri. Flux Data Management Tom Boden Carbon Dioxide Information Analysis Center Oak Ridge National Laboratory Presented January 31, 2011 at the 2011 Ameri. Flux Science Meeting/3 rd NACP All-Investigators Meeting New Orleans, Louisiana
Ameri. Flux Network Participation Requirements > Make year-round core measurements using the eddy-covariance technique > Submit data to the Carbon Dioxide Information Analysis Center (CDIAC) within 1 year of collection > Participate in Ameri. Flux Science Meetings and synthesis & modeling activities 142 sites in 5 countries; 94 active sites, 48 inactive sites
Ameri. Flux Data Summary http: //public. ornl. gov/ameriflux/viewstatus_ameriflux. cfm 142 Ameri. Flux sites 134 sites have submitted data to CDIAC totaling 745 site-years 20 sites have submitted data for 2010 81 sites with Level 4 data available 71 sites have submitted biological data including 48 site BADMs
Level 1 to Level 2 Data Processing Scheme Level 1 data received from Ameri. Flux site PIs Flux, Meteorological, and Ecological Data Files • • Stored “as received” from investigator File format, parameter names, and units unchanged Add value through automated QA/QC Perform QA/QC Calculate additional parameters, add to network database Incorporate into Web data interface & produce standardized data files & metadata reports • • • Range checks, missing values, check solar elevation and time stamp Basic Statistics (mean, variance, range) Gap Analysis: determine frequency and duration of gaps in record Spike detection, stationarity, diurnal and seasonal pattern Cross checks/correlations (Rg vs. PAR) Graphical Analysis: time series, property vs property, frequency Incorporate into network-wide database • Convert into standard Ameri. Flux units, reporting intervals, and naming conventions • Generate core parameters (e. g. , VPD) where needed Web access to network-wide database • • Querying capabilities – time, measurement parameter, and site Graphics generation and data retrieval capabilities FTP access to standard files • • Standard files with 40 core variables (csv, Net. CDF, tar) Metadata files (html & txt formats) L 1 files available from FTP area | | 5 days | | L 2 data products available via Web interface and from FTP area
La Thuile, Italy FLUXNET Workshop February 18 -22, 2007 Mandatory data: NEE/FC ~60 participants, good representation from regional CO 2/SFC U*/TAU networks and major programs (LBA, TCOS) Rg/PAR 921 site yrs of data from 240 sites worldwide (33 countries) Ta H 2 O/RH/VPD 318 site yrs of data from 77 Ameri. Flux sites · Participation and data response – – – · Resulted in ~60 proposed papers – http: //www. fluxdata. org · Another iteration of the La Thuile database is underway with release in 2011 – provided 83 Ameri. Flux site records (440 site yrs of data) – 23 sites without L 4 products available
Update on gap-filling meteorological data · We have completed developing, implementing and evaluating algorithms to gap-fill meteorological data for Ameri. Flux sites. · A major improvement since the last Ameri. Flux annual meeting was the inclusion of reanalysis data (i. e. , NARR) as an additional gap-filling tool. Now we are better able to fill long gaps (from weeks to months) for some terms, such as incoming solar radiation, soil moisture, and soil temperature. Gap-filling of precipitation records was also improved. · Gap-filled meteorological data sets for Ameri. Flux sites will be officially posted in the coming months. · Please see Bai Yang’s poster for details!!
Ameri. Flux Data System http: //ameriflux. ornl. gov Metadata Site & PI Information, Pubs, & Instruments (e. g. , Fc corrections, instrument calibrations FY 2011 Users Worldwide PHP Interface Flux & Meteorological Data Commenced 8/2009 http: //ameriflux. ornl. gov/edit 12/2008 CDIAC MS SQL 2005 RDBMS Biological Data BADM Reported Variables Flux & Met/Bio 1/2009 3/2009 Leaf Aci ORNL Ameri. Flux & FLUXNET Data Team PHP Interface 3/2010 11/2009 http: //leafweb. ornl. gov Gu EDO methodology & code 7 Web interface/Sharepoint for data submission and dissemination of results
Leaf. Web http: //leafweb. ornl. gov Please see Lianhong Gu’s poster for details!
Ameri. Flux Data System http: //ameriflux. ornl. gov Metadata Site & PI Information, Pubs, & Instruments (e. g. , Fc corrections, instrument calibrations FY 2011 Users Worldwide PHP Interface Flux & Meteorological Data Commenced 8/2009 http: //ameriflux. ornl. gov/edit 12/2008 CDIAC MS SQL 2005 RDBMS Biological Data BADM Reported Variables Flux & Met/Bio 1/2009 3/2009 Leaf Aci ORNL Ameri. Flux & FLUXNET Data Team PHP Interface 3/2010 11/2009 FY 2010 Priorities Data extraction/e-mail notification Load remaining L 2 data, begin loading L 4 data Web migration Inclusion of L 2 & L 4 data in the Earth System Grid Biological data editing functionality http: //leafweb. ornl. gov Gu EDO methodology & code 9 Web interface/Sharepoint for data submission and dissemination of results
http: //ameriflux. ornl. gov ØTool was launched in March 2008 Ø 2010 Additions – loaded L 2 data, search capabilities for biological data, downloading & subsetting functionality, notification features, and links to detailed site descriptions ØSince March 2009, >5600 searches and downloads ØPlease see Misha Krassovski poster/Wed. side meeting for details
Priorities for 2011 Continue to process data and contribute towards synthesis and modeling activities Expand data interface Add gap-filled L 2, L 3 & L 4 data Include visualization capabilities Add additional query capabilities (e. g. , day vs. night) Release Version 1 of the gap-filled met product Review and embellish submitted biological data Quantify uncertainty for flux terms in the L 2 and L 4 data products
Questions http: //public. ornl. gov/ameriflux http: //ameriflux. ornl. gov
Primary FY 2011 CDIAC Ameri. Flux Team Misha Krassovski – data system - (0. 9 FTE) Bai Yang – micrometeorologist [QA/QC] - (0. 8 FTE) Barbara Jackson – SAS programming - (0. 7 FTE) Tom Boden – coordination - (0. 3 FTE) Lianhong Gu – A/Ci analysis – (0. 04 FTE)
Global Network Regional Networks FLUXNET - a network of networks Ameri. Flux Canadian CP Americas CARBOEUROFLUX Asia. Flux Oz. Net Europe Asia - Japan Oceania Nonnetwork sites Tower Sites Architecture of Global / Regional Flux Networks
Ameri. Flux Data Processing & Products Site Investigator & Team Flux/Met Data Biological Data Level 0 Site Proc. CDIAC QA/QC Network-wide 30 min Database Averages Standard Files BADM Level 1 FLUXNET Quality Flags Gap-filled NEP/Re CADM Level 2 Level 3 & 4
Aci/Leaf Photosynthetic Capacity/WUE Web Interface · Approach described in Gu et al. (submitted to Journal of Experimental Biology) · System under development/testing · Previous data submissions used to test system as analysis & paper preparation proceed · Prescribed data format with headers and data blocks (e. g. , leaf temp, internal CO 2 conc. ) that follow standard output from the LI-COR 6400 · Interface Features – On-line data submission & format verification – Results (e. g. , Vcmax, Jmax, Rd) posted to CDIAC FTP area as images & data files · Long-Term Goal : Develop Network-wide Ameri. Flux Leaf-level Database 16 Managed by UT-Battelle for the Department of Energy
Leaf. Web support structure Forcing SFA Modeling / data assimilation Theoretical analysis Numerical solutions Validation of numerical solutions Forcing SFA MOFLUX Web implementation CDIAC Data synthesis Data harvest and management
Data flow through Leaf. Web • Data collected from the user - Core variables - Variables to put the leaf in its environment • User option of Share or not to share data • Graphic capabilities • Results to the user • If the Share option is selected, the data are available to the general public; graphic function is enabled to the user • If not to share, data and results are not archived, no graphic function
C-LAMP The Carbon-Land Model Intercomparison Project (C-LAMP) consists of an experimental protocol, model evaluation metrics, a prototype diagnostics package, model output standards, and a database of model simulation results on the Earth System Grid (ESG). See http: //www. climatemodeling. org/c-lamp In the first set of runs, over 16 ky of simulation and 50 TB of output were generated using the Climate Science End Station INCITE allocation at ORNL. CLM 3. 1 (Community Land Model) combined with CASA´ (Carnegie-Ames-Stanford Approach) and CN (carbon & nitrogen) biogeochemistry modules were evaluated against best-available satellite- and ground-based measurements, and new runs are being used to evaluate CLM 4 performance. C-LAMP will serve as a benchmarking prototype for Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR 5) in conjunction with ESG. Randerson, J. T. , F. M. Hoffman, P. E. Thornton, N. M. Mahowald, K. Lindsay, Y. H. Lee, C. D. Nevison, S. C. Doney, G. B. Bonan, R. Stöckli, C. C. Covey, S. W. Running, and I. Y. Fung. “Systematic Assessment of Terrestrial Biogeochemistry in Coupled Climate-Carbon Models. ” Global Change Biology, in press.
Ameri. Flux Data Are An Important Component of C-LAMP diagnostics include model comparisons with MODIS (Moderate Resolution Imaging Spectroradiometer) leaf area index (LAI) and net primary production (NPP), Globalview amplitude and phase, Ameri. Flux Level 4 energy and carbon fluxes, Free Air CO 2 Enrichment (FACE) site measurements, and various estimates of carbon stocks and transient dynamics. Shown at right is a time series comparison of net ecosystem exchange (NEE), incoming shortwave, latent and sensible heat, gross primary production (GPP), and ecosystem respiration from CLM 3. 1 -CN against measurements from the Morgan Monroe site. C-LAMP diagnostics must be run before any model changes to the CLM biogeophysics or biogeochemistry can be made.
- Slides: 20