CUAHSI http his cuahsi org HIS Sharing hydrologic

  • Slides: 31
Download presentation
CUAHSI http: //his. cuahsi. org/ HIS Sharing hydrologic data Sharing Hydrologic Data using the

CUAHSI http: //his. cuahsi. org/ HIS Sharing hydrologic data Sharing Hydrologic Data using the CUAHSI Hydrologic Information System Part I: Catalog and Server The CUAHSI HIS is Supported by NSF Grant# EAR 0622374

Introducing the “Knowing Generation” “Just type it in your phone, Daddy. ”

Introducing the “Knowing Generation” “Just type it in your phone, Daddy. ”

What’s a Lobster?

What’s a Lobster?

SOA = Enabling the Knowing Generation

SOA = Enabling the Knowing Generation

CUAHSI HIS SOA = Enabling Water Science Data Discovery HIS Central Data Discovery and

CUAHSI HIS SOA = Enabling Water Science Data Discovery HIS Central Data Discovery and Integration platform Se rvi es ic n v r e io S tra tin a t a egis ves t d er a t e vic M Ser Hydro. Server Data Publication platform Like web servers lo ta Ca Like search portals Google, Yahoo, Bing g r a gh Data Services ce Me an ta d d da Da ata t ta S ta hem ea car r ts e me ch tad ata Water Data Services Spatial Data Services Like HTML Hydro. Desktop Data Synthesis and Research platform Like browsers

CUAHSI Consortium of Universities for the Advancement of Hydrologic Science, Inc. • 111 US

CUAHSI Consortium of Universities for the Advancement of Hydrologic Science, Inc. • 111 US University members • 7 affiliate members • 19 International affiliate members An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U. S. HIS = Hydrologic Information System

What is HIS? • The CUAHSI* Hydrologic Information System (HIS) provides web services, tools,

What is HIS? • The CUAHSI* Hydrologic Information System (HIS) provides web services, tools, standards and procedures that enhance access to more and better data for hydrologic analysis. • http: //his. cuahsi. org

CUAHSI HIS The CUAHSI Hydrologic Information System (HIS) is an internet based system to

CUAHSI HIS The CUAHSI Hydrologic Information System (HIS) is an internet based system to support the sharing of hydrologic data. It is comprised of hydrologic databases and servers connected through web services as well as software for data publication, discovery and access. HIS Central Data Discovery and Integration platform Se rvi es ic n v r e io S tra tin a t a egis ves t d er a t e vic M Ser Hydro. Server Data Publication platform Like web servers lo ta Ca Like search portals Google, Yahoo, Bing g r a gh Data Services ce Me an ta d d da Da ata t ta S ta hem ea car r ts e me ch tad ata Water Data Services Spatial Data Services Like HTML Hydro. Desktop Data Synthesis and Research platform Like browsers

Remember the Observations Data Model… Sites Values and Time Variables Horsburgh, J. S. ,

Remember the Observations Data Model… Sites Values and Time Variables Horsburgh, J. S. , D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), "A Relational Model for Environmental and Water Resources Data, " Water Resour. Res. , 44: W 05406, doi: 10. 1029/2007 WR 006392.

Our approach thus far… ODM sits on a server and we connect to it

Our approach thus far… ODM sits on a server and we connect to it through SQL, Python, etc. ODM Database Internet Python & SQL

Our approach thus far… ODM sits on our computer, but we still use SQL,

Our approach thus far… ODM sits on our computer, but we still use SQL, Python, etc. Through a local internet… ODM Database “Internet” Python & SQL

Hydro. Server Approach ODM Database Web Services Server Web Services Translation layer XML Internet

Hydro. Server Approach ODM Database Web Services Server Web Services Translation layer XML Internet XML

Hydro. Server Goals • A platform for organizing and publishing space -time hydrologic datasets

Hydro. Server Goals • A platform for organizing and publishing space -time hydrologic datasets that: – Provides local control of data Put the data service as close to the data producer as possible. – Makes data universally available Share the data as widely and openly as possible. – Is autonomous – e. g. , functional independent of the rest of HIS Serve as a useful data store regardless of the fate of CUAHSI HIS.

ODM 1. 1. 1

ODM 1. 1. 1

Publishing Data in an ODM Database Water. ML and Water. One. Flow Water. ML

Publishing Data in an ODM Database Water. ML and Water. One. Flow Water. ML is an XML schema for communicating water data Water. One. Flow is a set of web services based on Water. ML • Set of query functions • Returns data in Water. ML Slide from David Valentine

For example: to get a site, send this “SOAP” request to the server: Specify

For example: to get a site, send this “SOAP” request to the server: Specify the site and an optional authorization token

Get this response: Result returns in this string.

Get this response: Result returns in this string.

Water. One. Flow A vocabulary for asking for information about the data

Water. One. Flow A vocabulary for asking for information about the data

1. 2. 3. 4. 5. Go to: http: //worldwater. byu. edu/ Click “databases” Click

1. 2. 3. 4. 5. Go to: http: //worldwater. byu. edu/ Click “databases” Click Sandbox Click web services Click SOAP Services • What are the services available? • What do they do? 1. 2. 3. 4. 5. Go back one page Click “REST Web Services Test” Try “Get Sites” Look at the output Try formatting the output using http: //www. freeformatter. com/xmlformatter. html

Water. ML An XML structure for transferring water timeseries data (back to the client)

Water. ML An XML structure for transferring water timeseries data (back to the client)

KEY Hydro. Server Functionality: • Read ODM • Share it with Web. Services Add

KEY Hydro. Server Functionality: • Read ODM • Share it with Web. Services Add on Visualization Capabilities Database Configuration Tool Water. One. Flow ODM Water. One. Flow Services Water. One. Flow ODM Water. One. Flow Hydro. Server Capabilities Database Spatial Services Add on GIS Services through Arc. GIS Server ODM Databases and Web Services Arc. GIS Server Spatial Data Services

2 Flavors of Hydro. Server: Hydro. Server (. NET) • Hydro. Server (. NET):

2 Flavors of Hydro. Server: Hydro. Server (. NET) • Hydro. Server (. NET): • http: //hydroserver. codeplex. com • Model implementation of the Hydro. Server CUAHSI HIS specification • Runs on Windows servers • Requires Microsoft SQL Server • Uses Arc. GIS Server • Uses Streaming Data Loader, Data Loader and SQL tools to manage the database.

2 Flavors of Hydro. Server • Original Hydro. Server: • http: //hydroserver. codeplex. com

2 Flavors of Hydro. Server • Original Hydro. Server: • http: //hydroserver. codeplex. com • Model implementation of the Hydro. Server CUAHSI HIS specification • Runs on Windows servers • Requires Microsoft SQL Server • Uses Arc. GIS Server • Uses Streaming Data Loader, Data Loader and SQL tools to manage the database. • Hydro. Server Lite: • https: //github. com/CUAHSI/Hydro. Server. L ite Simplified implementation of the CUAHSI HIS specification (all required services are supported). • Runs on the free LAMP stack (Linux, Apache, My. SQL, PHP) • Uses front end web pages to load data in the database.

Hydro. Server PHP (Hydro. Server Lite) • Hydro. Server Lite: • https: //github. com/CUAHSI/Hydro.

Hydro. Server PHP (Hydro. Server Lite) • Hydro. Server Lite: • https: //github. com/CUAHSI/Hydro. Server. Lite • Simplified implementation of the CUAHSI HIS specification (all required services are supported). • Runs on the free LAMP stack (Linux, Apache, My. SQL, PHP) • Uses front end web pages to load data in the database.

What is Hydro. Server Lite? • PHP and My. SQL mean easy/fast/cheap setup •

What is Hydro. Server Lite? • PHP and My. SQL mean easy/fast/cheap setup • Focus on easy extends to user interfaces. • Developer community at http: //hydroserverlite. codeplex. com/ • Let’s try it out: http: //worldwater. byu. edu/ • Browse data from any database, upload data using the “sandbox” database.

Can Citizen Science Data be Shared and Intermingled with “Real Data”?

Can Citizen Science Data be Shared and Intermingled with “Real Data”?

Data Input Water. ML 2 Output Interactive Map Time Series Graph Open Source/ Light

Data Input Water. ML 2 Output Interactive Map Time Series Graph Open Source/ Light Weight PHP and My. SQL Water. ML Hydro. Server

Hydro. Servers for the Developing World • http: //worldwater. byu. edu • Custom PHP-based

Hydro. Servers for the Developing World • http: //worldwater. byu. edu • Custom PHP-based Catalog for Developing Countries

Internationalization Effort

Internationalization Effort

Try it… • • • Go to worldwater. byu. edu Databases Sandbox Create a

Try it… • • • Go to worldwater. byu. edu Databases Sandbox Create a new site Add some data.

Assignment • Build your own Hydro. Server instance on worldwater. byu. edu • Upload

Assignment • Build your own Hydro. Server instance on worldwater. byu. edu • Upload your own observations • Write a brief report…