SAS FP ESAESRIN Frascati ITALY 10 Nov 2009

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 meeo Meteorological and Environmental Earth Observation SAS : Final presentation MODIS Data Catalogue Service Alan Beccati - MEEO - SAS Project Manager This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 MEEO MODIS Data Catalogue Ø Scope • User interface • Architectural model • Lessons learned This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 MODIS Data Catalogue • Purpose – Find and retrieve MODIS datasets from connected catalogues • User Perspective – Browse a MODIS catalogue to select images • AOI, start and end dates, platform, day/night coverage – Order selected images • Product specification (1 KM, HKM, QKM, GEO) – Download ordered images • Service Provider Perspective – Chain MODIS data sources to their own processing services This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 MODIS Data Catalogue • Free service with open access • Multiple datasets with single order • Data availability driven by MOD 03 – Terra Platform: 8 -12 hours – Aqua Platform: 12 -32 hours This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 MEEO MODIS Data Catalogue ü Scope Ø User interface • Architectural model • Lessons learned This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 EOLI Operations • EOLI Search – Browse MODIS data by • Time range, AOI, Platform and Day/Night flag • EOLI Present – Get Details about a search result • Including Day/Night flag and online availability This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 EOLI Search This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 s. EARCH RESULTS This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 EOLI Present This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 SSE Operations • SSE Order – Order dataset contents • Ground Sampling Distance: 1 Km HKm QKm • Detailed Geolocation: MOD 03 – Retrieve dataset files directly from Data Provider server • FTP links to NASA Laadsweb repository • Flexible XML schema for results This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 SSE Order This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Order result 1/2 This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Order result 2/2 This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 MEEO MODIS Data Catalogue ü Scope ü User interface Ø Architectural model • Lessons learned This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Service context User accesses SSE pages PM Orchestrates operations: SSE Order Search, Present Tests actual data availability Periodically syncs with actual data on the FTP server Direct database access This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Benefits of integration • SSE Chainable MODIS Data source – EOLI operations to locate data – XML Order results with detailed status information Hold entire dataset status and identification information Hold subset level access and identification information This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Order output SOAP INTERFACE Element Name Type Purpose dataset. Links XML Holds the link elements to dataset’s files. @status string complete | incomplete | empty @id string matches the image identifier of the dataset. string The FTP address of a dataset’s file token specifies archive Content type (e. g. HKM). link @data. Type • Resulting datasets. Links in dedicated namespace to be reused in chained services: http: //services. meeo. it/mass/data. Order. Services This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Service chaining • Detailed results schema with status information allows to – Detect incomplete dataset provision – Programmatic management of data at single dataset component level – Full automation to locate and access data from another service This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Lessons learned & improvements Ø Technical • Functional • User Community This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 EOLI catalogue • Default EOLI Search WF strips away custom search attributes – Custom Search workflow to enable searching on extended attributes (i. e. day. Night flag) • Provide default Search with custom XSL – Checkbox “generate default work flow” in custom catalogue registration – Default style sheet download from SSE to be customized This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 EOLI catalogue • Search results page (EOLI) – Number of total hits for the search – Current display information and page browser • Results 31 -50 of 245 • Page 3 of 23 or 1 2 3 4 … 23 This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 EOLI catalogue • Present layout can be improved (smoothed) for extended attributes This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Service debug log • Provide detailed information to service provider eases service development – SSE Portal • Style sheet processing errors – Process manager - BPEL • Exception trace or cause (with source line) • Log excerpts by process – expression evaluation issues This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 TOOLBOX Features • Deployment configuration parameters – Choice of configuration parameters during setup • JVM / Tomcat memory allocation • Independent FTP server management – Restart server without restarting TOOLBOX • FTP tags “wrapping” for other FTP servers – Two TOOLBOX servers with different configuration – Popular FTP servers • Vsftp, File. Zilla, IIS, Pure. FTP, Cerberus This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Lessons learned & improvements ü Technical Ø Functional • User Community This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 SLA Policy • Enforce SLA acceptance by users – Service use is subject to the SLA, also provides information for correct usage (input/output formats) • Providers side – Allow uploading the SLA directly form the service page (compute SLA checksum) • Users side – Provide direct link to download / view the SLA – Accept the SLA before accessing the service (track checksum, require new acceptance if changed) This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 Service interface • Automate style sheet generation (wizard) – Based on service schema for simple inputs – Allowing the SP to build it from the wizard after uploading the schema • For each input parameter – Text box with label (default) – Drop down select for string restrictions (enumerations) • SP could then download and customize the xsl if needed This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.

SAS FP – ESA-ESRIN Frascati - ITALY - 10 Nov. 2009 CONTACTS Via Saragat, 9 I-44122 Ferrara ITALY Tel: +39 0532 1861501 Fax: +39 0532 1861637 info@meeo. it Skype-id: meeosnc www. meeo. it This document is proprietary. Any dispatch or disclosure of content is authorized only after written authorization by MEEO S. r. l.