CUAHSI Hydrologic Information System Project coPI Collaborator CUAHSI
CUAHSI Hydrologic Information System Project co-PI Collaborator
CUAHSI Hydrologic Information Systems
Environmental Cyberinfrastructure • Part of NSF Cyberinfrastructure program • CUAHSI Hydrologic Information Systems is one of several pilot projects – CUAHSI, CLEANER, ORION, NEON, GEON, …. .
HIS Goals • Data Services for Hydrologists – get me the data I want quickly and painlessly • Support for Observatories – data structure for Digital Watersheds • Advancement of Hydrologic Science – flux coupler, Hydro. Objects • Hydrologic Education – how to get data into the classroom
Digital Watershed Hydrologic Observation Data (Relational database or delimited ascii) Geospatial Data (GIS) Digital Watershed Remote Sensing Data Weather and Climate Data (EOS-HDF) (Net. CDF)
CUAHSI HIS Overview • HIS User Assessment • Hydrology Data Portal • Digital Watershed • Hydrologic Analysis
CUAHSI HIS Overview • HIS User Assessment • Hydrology Data Portal • Digital Watershed • Hydrologic Analysis
HIS User Assessment • First survey done for HIS White Paper (2003) • HIS Symposium in March – 4 institutional surveys and a survey of participants • CUAHSI Web Surveyor – developed by David Tarboton and Christina Bandaragoda (75 responses from 38 institutions) • Summary paper circulated by email yesterday
Value Score (counting 4 for first, 4 for second, 2 for third and 1 for fourth). Please rank these four HIS service categories for helping you. Conclusion: Data services are the highest priority
% of time spent preparing data
Which operating systems do you use for your research? If you use more than one operating system, select all that apply.
Please indicate one dataset that you believe would most benefit from increased ease of access through a Hydrologic Information System (HIS). Conclusion: EPA STORET Water Quality, Streamflow and Remote Sensing Data are perceived to be able to benefit from improved access. I am surprised USGS streamflow is up there. Is this an indication of importance over difficulty?
How we use software (Austin Symposium)
Value Score (counting 3 for first, 2 for second and 1 for third). Which of the following data analysis difficulties are most important for HIS to address? Conclusion: High priorities are: - Data formats - Metadata - Irregular time steps
How we use software (Web Surveyor) • Programming (85% of respondents): Fortran, C/C++, Visual Basic • Data Management (93%): Excel, MS Access • GIS (93%): Arc. GIS • Mathematics/Statistics (98%): Excel, Matlab, SAS, variety of other systems • Hydrologic models (80%): Modflow, HEC models • A general, simple, standard, and open interface that could connect with many systems is the only way to accommodate all these
CUAHSI HIS Overview • HIS User Assessment • Hydrology Data Portal • Digital Watershed • Hydrologic Analysis
Hydrology Data Portal
Hydrologic Observations Data Model Relationships Review conducted by David Tarboton with 22 responses – redesign of this model is now being done
Data Access and Viewing System in Arc. Map
CUAHSI Data Portal
CUAHSI Data Portal
Plot from the Hydrology Data Portal Produced using a CUAHSI Hydrology Web Service: get. Daily. Streamflow. Chart
CUAHSI Hydrology Web Services for NWIS http: //water. sdsc. edu/Hydrologic. Time. Series/NWIS. asmx
Documentation: get. Daily. Streamflow. Chart https: //webspace. utexas. edu/jgoodall/Hydrologic. Time. Series. Web. Services. htm
Applications and Services Web application: Data Portal Your application • Excel, Arc. GIS, Matlab • Fortran, C/C++, Visual Basic • Hydrologic model • ……………. Your operating system • Windows, Unix, Linux, Mac Internet Web Services Library
CUAHSI HIS Overview • HIS User Assessment • Hydrology Data Portal • Digital Watershed • Hydrologic Analysis
Issues 1. Variety of data sources, formats, and data models used in hydrologic sciences 2. Size and scale of data sources – observation databases, terrain models, NEXRAD, river networks, etc. 3. Disconnection between geospatial and temporal information systems
Digital Watershed How can hydrologists integrate observed and modeled data from various sources into a single description of the environment?
Digital Watershed Hydrologic Observation Data (Relational database or delimited ascii) Geospatial Data (GIS) Digital Watershed Remote Sensing Data Weather and Climate Data (EOS-HDF) (Net. CDF) A digital watershed is a synthesis of hydrologic observation data, geospatial data, remote sensing data and weather and climate data into a connected database for a hydrologic region
Digital Watershed: An implementation of the CUAHSI Hydrologic Data Model for a particular region Created first for the Neuse basin
Neuse Atmospheric Water • Daily precipitation data from NCDC gages • Nexrad daily rainfall rasters • Land surface – atmosphere fluxes from North American Regional Reanalysis of climate
Neuse Surface Water • Streamflow, water quality hydrologic observational data • GIS: River network, water bodies, watersheds, monitoring points • Land cover, soils, • MODIS remote sensing (Praveen Kumar) MODIS Terrain and Land Cover
http: //neuse. crwr. utexas. edu/ Arc. IMS Web Server displaying data compiled in Neuse HO Planning Study
Neuse Basin: Coastal aquifer system Section line Beaufort Aquifer * From USGS, Water Resources Data Report of North Carolina for WY 2002
Neuse Groundwater Geovolumes of hydrogeologic units from US Geological survey (GMS)
Create a 3 dimensional representation Geovolume Each cell in the 2 D representation is transformed into a 3 D object Geovolume with model cells
Page 3 The Demands Numerical Models Prediction Air-Q Sensor Arrays HSPF MM 5 NCDC METADATA USGS NWIS NCEP NWS Data Centers Drexel University, College of Engineering NGDC Individual Samples
Page 21 Hydrologic Metadata Upper Hydrologic Ontology We currently What we need have is Many More ISO 19108 Temporal Objects ARCHydro Many More ISO 19115 Geospatial ISO 19103 Units/Conversion USGS Hydrologic Unit Code Hydrologic Processes Sedimentation Many More Michael Piasecki is our expert in this subject! Drexel University, College of Engineering Many More Ontology Examples
CUAHSI HIS Overview • HIS User Assessment • Hydrology Data Portal • Digital Watershed • Hydrologic analysis
Hydrologic Analysis Hydrologic Process Modeling Statistics and Hypothesis Testing Digital Watershed Visualization Data Mining and Knowledge Discovery
Data Driven Discovery Tools Praveen Kumar is our expert on this subject!
Time Series Analysis D Geostatistics Data to Knowledge Multivariate analysis Jan Feb 4 -D Data Model Time, T Image to Knowledge D Space, L Variables, V Data Files
Hydrologic Flux Coupler Hydrologic Fluxes and Flows Digital Watershed (Atmospheric, surface and subsurface water) We want to do water, mass, energy and water balances
Neuse Observatory Prototype Study
Hydro. Volumes Take a watershed and extrude it vertically into the atmosphere and subsurface A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed”
Watershed Hydrovolumes Hydrovolume Geovolume is the portion of a hydrovolume that contains solid earth materials USGS Gaging stations
Stream channel Hydrovolumes
Atmospheric science – hydrology • Weather and climate fields are the drivers – continuous in space and time across the nation • Local watersheds are the reactors – each behaving according to its location and characteristics
Geo. Temporal Reference Frame • A defined geospatial coordinate system for (x, y, z) • A defined time coordinate system (UTC, Eastern Standard Time, …. ) • A set of variables, V Variables, V • Data values v(x, y, z, t) Time, t v – data values Space (x, y, z) Data Cube
Continuous Space-Time Model -Net. CDF Time, T Coordinate dimensions {X} D Space, L Variables, V Variable dimensions {Y}
Discrete Space-Time Data Model Time, TSDate. Time TSValue Space, Feature. ID Variables, TSType. ID
Geospatial Time Series Properties (Type) Value A Value-Time array Time Shape A time series that knows what geographic feature it describes and what type of time series it is
Neuse Water Balance Define the fluxes and flows associated with each hydrovolume Evaporation Precipitation Streamflow Groundwater recharge
Coupling Table – Connects fluxes and flows with hydrovolumes Coupling Feature. ID Source. Sink. ID TSType. ID Hydrovolume object Direction Feature. ID Source. Sink. ID TSType. ID Direction 1 02092500 1 -1 1 1 2 1 1 1 3 -1 1 1 4 1 TSType. ID Variable 1 Daily Streamflow 2 Daily Precipitation 3 Daily Evaporation 4 Daily Subsurface Recharge A geospatial time series object vector
Monthly Fluxes and Flows Q P, E, R
Net Inflow and Cumulative Storage Monthly water balance for one watershed hydrovolume for 2001 Storage Net Inflow This water balance does not close very well – we need better data!
Hydro. Objects Class Library Custom Models Web Services Arc. GIS Excel Matlab Hydro. Objects API Remote and local Data sources Backbone of a Hydrologic Information System
Conclusions • Hydrology Data Portal is a common data window on point observation data sources • CUAHSI web services library supports the data portal and local applications on your In production computer • Digital watershed is a data fusion of point observations, GIS, remote sensing and In development weather and climate grids • Hydro. Objects are custom-built to function over the Digital Watershed In research
Next Steps • Neuse workshop – 11 -13 July, 2005, to solidify the conceptual model and science applications of the Neuse Digital Watershed and Hydro. Objects • Expansion of the Hydrology Data Portal and Hydrology Web Services Library • Building Digital Watersheds with HO teams – lets get on with it!
- Slides: 60