Who is TPAC TPAC Tasmanian Partnership for Advanced

Who is TPAC? TPAC • Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science (ESS) Provides expertise & educational programs, as well as HPC facilities • Located at University of Tasmania, Hobart • Partnership between: University of Tasmania CSIRO Atmospheric Research CSIRO Marine Research Australian Maritime College Australian Antarctic Division Antarctic Climate & Ecosystems CRC Bureau of Met. Research Centre

Overview TPAC § Brief overview of TPAC Grid Program § TPAC – NDG Federation § Development of LAS Web Map Service § Development of server-side analysis service (Steve Phipps)

ESS Grid Project TPAC § ESS Data Grid - making ESS datasets transparently available to users of the APAC National Grid - developing a range of grid-based services that allow users to better utilise these datasets § ESS Compute Grid porting ESS models/applications to the APAC National Grid

The Vision TPAC Discovery P Visualisation P Crawler P OPe. NDAP P Job/Data Management IVEC SAPAC AC 3 VPAC APAC Grid APAC NF Digital Repository P Analysis / Models P APAC National Grid Infrastructure

TPAC OPe. NDAP Network TPAC AC 3 Facility (Sydney) Land surface datasets APAC NF (Canberra) International IPCC model results (10 -50 Tb) TPAC 1/8 degree ocean simulations (7 Tb) Met Bureau Research Centre (Melbourne) Near real-time LAPS analyses products (<1 Gb) Sea- and sub-surface temperature products CSIRO HPSC (Melbourne) IPCC CSIRO Mk 3 model results (6 Tb) CSIRO Marine Research (Hobart) Ocean colour products & climatologies (1 Tb) Satellite altimetry data (<1 Gb) Argo float data (<1 Gb), MSLA data (5 Gb) University of Tasmania (Hobart) NCEP 2 (150 Gb), WOCE 3 Global (90 Gb) Antarctic AWS (150 Gb), Climate modelling (4 Gb) ASPe. CT sea-ice data (<1 Gb)

http: //digitallibrary. tpac. org. au Portal: Main Page TPAC

Grid Project: Current Status TPAC Grid Users Gridsphere Portal GIS Users Discovery Portlet Web Services Application Layer Data Layer Hardware Layer OAI Library Search API (Java) Meta data Traditional Users Data Retrieval Portlet Visualisation Portlet Analysis/Model Portlet Web Coverage Service Web Map Service Web Processing Service OPe. NDAP Server Live Access Server (LAS) Gr. ADS Server/Models Crawler Digital Repository Config Meta data Compute Engine

TPAC – NDG Federation TPAC A data Grid linking climate data resources in Australia and the UK § Metadata harvesting protocol – Open Archives Initiative (OAI) § Metadata schema – Directory Interchange Format (DIF) § Deployed for TPAC data holdings § TPAC imposes no metadata standards re data holdings

Mapping TPAC Metadata to DIF TPAC DIF element TPAC metadata Data_Center/Data_Center_Name/Short_Name[5] AU/UTAS/TPAC Data_Center/Data_Center_Name/Long_Name Tasmanian Partnership for Advanced Computing Data_Center/Data_Center_URL http: //www. tpac. org. au Data_Center/Data_Set_ID (Same as Entry_ID) TPAC_category. Id<category_Id>_dataset. Id<dataset. Id> Data_Center/Personnel/Role Data Center Contact Data_Center/Personnel/First_Name <Dataset. maintainer. Name> (first name) Data_Center/Personnel/Last_Name <Dataset. maintainer. Name> (last name) Data_Center/Personnel/Email <Dataset. maintainer. Email> Data_Center/Personnel/Contact_Address/Address GPO Box 80 Data_Center/Personnel/Contact_Address/City Hobart Data_Center/Personnel/Contact_Address/State TAS Data_Center/Personnel/Contact_Address/Postal_Code 7001 Data_Center/Personnel/Contact_Address/Country Australia Distribution/Distribution_Media[6] Online Internet (HTTP) Summary <Category. brief. Description><Dataset. description> Related_URL/URL_Content_Type[7] DODS_DIR Related_URL/URL <Dataset. dataset. URL> ***DIG LIB URL? ? ? *** Metadata_Name CEOS IDN DIF Metadata_Version 9. 4 DIF_Creation_Date of creation of DIF record. Last_DIF_Revision_Date of last revision. DIF_Revision_History Revision history.

Mapping TPAC Metadata to DIF TPAC DIF element TPAC metadata Entry_ID TPAC_category. Id<category_Id>_dataset. Id<dataset. Id> Entry_Title <Category. title> >> <Dataset. title> Data_Set_Citation/Dataset_Creator Tasmanian Partnership for Advanced Computing Data_Set_Citation/Dataset_Title <Dataset. title> Data_Set_Citation/Dataset_Series_Name <Category. title> Data_Set_Citation/Dataset_Release_Date <Dataset. last. Modified. Date> Data_Set_Citation/Dataset_Publisher Tasmanian Partnership for Advanced Computing Data_Set_Citation/Online_Resource <Dataset. dataset. URL> Personnel/Role TECHNICAL CONTACT Personnel/First_Name Glenn Personnel/Last_Name Hyland Personnel/Email Glenn. Hyland@utas. edu. au Discipline/Discipline_Name[1] EARTH SCIENCE Parameters/{Category, Topic, Term, Variable}[2] GCMD valids best matching DODS variable ‘long_name’ attributes. Manual ISO_Topic_Category[3] Probably climatology. Meteorology. Atmosphere or oceans. Manual Temporal. Coverage/Start_Date May be possible to derive from DODS variables or attribute values. Manual Temporal. Coverage/Stop_Date May be possible to derive from DODS variables or attribute values. Manual Data_Set_Progress Complete Spatial_Coverage For some datasets, may be possible to derive from DODS variables or attribute values. Elements are optional if not relevant. Manual Location/Location_Name[4] Global Data_Resolution May be possible to derive from DODS variables or attribute values. Manual cont …

Discovery Results TPAC http: //ndg. nerc. ac. uk/discovery

Grid Project: Current Status TPAC Grid Users Gridsphere Portal GIS Users Discovery Portlet Web Services Application Layer Data Layer Hardware Layer OAI Library Search API (Java) Meta data Traditional Users Data Retrieval Portlet Visualisation Portlet Analysis/Model Portlet Web Coverage Service Web Map Service Web Processing Service OPe. NDAP Server Live Access Server (LAS) Gr. ADS Server/Models Crawler Digital Repository Config Meta data Compute Engine

LAS Architecture TPAC § The Live Access Server (LAS) is a highly configurable open-source Web server designed to provide flexible access to geo-referenced scientific data (mainly oceanographic and atmospheric datasets). server configuration metadata (XML) browser LAS UI server LAS data server UI LAS request (XML) commands data back end application ucts d pro (java/script)

Server-side Visualisation Services TPAC

Server-side Visualisation Services TPAC

Server-side Visualisation Services TPAC

Server-side Visualisation Services TPAC

LAS – WMS Wrapper TPAC 1. Maps from LAS metadata to the WMS ‘capabilities XML’ (i. e. metadata returned in response to a WMS Get. Capabilities request). wrapper server configuration metadata (XML) LAS UI+ server LAS data server data back end application LAS XML LAS–WMS converter servlet Capabilities XML WMS Client UI WMS Get. Cap.

LAS – WMS Wrapper TPAC 2. Maps from a WMS Get. Map request to a LAS data request. server configuration metadata (XML) wrapper LAS UI+ server LAS data server LAS–WMS LAS request (XML) commands+ data back end application WMS Client ts duc pro converter servlet UI WMS Get. Map

Mapping WMS to LAS Requests TPAC § WMS request A WMS request for air temperature data for the COADS dataset would look like: http: //LAS-WMS-Host/WMSpath? VERSION=1. 3. 0&REQUEST=Get. Map&CRS=CRS: 84&BBOX=180, -90, 180, 190&WIDTH=800&HEIGHT=600&LAYERS=airt&STYLES=&FORMAT=image/gif § LAS request The corresponding LAS request would look like: <las. Request href="file: las. xml"> <link match="/lasdata/operations/shade"/> <args> <link match="/lasdata/datasets/coads_climatology_cdf/variables/airt"/> <region> <range type="x" low="-180" high="180"/> <range type="y" low="-90" high="90"/> </region> </args> </las. Request>

TPAC

TPAC

TPAC

TPAC