Deutscher Wetterdienst DWD GISC Node Current Status Deutscher

Deutscher Wetterdienst DWD GISC Node Current Status

Deutscher Wetterdienst Agenda è Welcome è Current status: Overview based on functional blocks è High Level Architecture è Web Interface è DAR Component èCatalogue systems, Metadata and identified issues è GISC-to-GISC communication èExperience with Blog solution and AFD èSchema for GISC backup scenario è Data Components èMSS, AFD and subscription management è Live Demo è Challenges during the Implementation è Q&A DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Functional blocks Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst HLA: Web Interface (User/Admin/Customer) Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst HLA: Web Interface (User/Admin/Customer) è Web. Werdis è Redesign of Web. Werdis èNavigation structure / search functions èInternationalization èIntegrate logging framework (necessary for monitoring) èCode clean-up èIntegration with Geonetwork è Customization of GUI DWD GISC Node - Current Status

Deutscher Wetterdienst HLA: Web Interface (User/Admin/Customer) è Search by URL – ISO 23950 è Timo (WMO Secretariat) did a SRU implementation in Geonetwork è Solution is running in DWD DMZ è 3 day implementation workshop with Timo about SRU and jzkit at DWD è Direct integration into DWD GISC node DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Metadata Management Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst High level architecture: Metadata Management è DAR Catalogue è Did extensively Performance Tests (Geonetwork 2. 2, terra. Catalog 2. 3) èDWD formulated test cases èContracted external partner for tests è Functional Tests è DAR Generator / Importer è Developed DAR metadata generator (template driven architecture) è External review of DAR metadata è Developed DAR importer è Issues we identified during our work è Tested DAR catalogues fulfilled most, but not all INSPIRE and WMO requirements è DAR Metadata èPaper with Request for Clarification (JMA, CMA and DWD) èSchematron rules for validating WMO profile would be very helpful DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Metadata Management è Metadata Harvesting è CMA and DWD did several functional tests with OAI-PMH in 09/09 è Different implementations of OAI-PMH could not harvest each other è Deleted metadata records: different implementations è Standard vanilla implementations modify harvested metadata è Ongoing tests between CMA and DWD èStarted January 2010 èInitial tests showed 1 record ~ 1 second space for improvement è Backup strategy è Exchange of metadata files as products DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Metadata Management DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: G 2 G communication Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst HLA: GISC-to-GISC communication è Collaboration CMA and DWD è Memorandum of Understanding signed end of last year è Two Workshops held è GISC-to-GISC communication tests with CMA è CMA and DWD installed Blog solution and AFD solution è Data sets with appropriated time profile (issue warning during model transfer) è Blog solution è CMA and DWD did several improvements on publishing and polling components è Usage of tar minimize latency of transfer è Necessary to include size of “metadata” (Atom. Feed) into calculation of transfer volume è Identified several further improvements like prioritization, Atom. Feed handling, logging è JMA has provided a new improved solution in 10/2009 è AFD solution è Average transport time between 4 -5 sec during 24 hour continuously test, warnings between 3 -4 sec è In case of unsecured connection sometimes corrupted data occur DWD GISC Node - Current Status

Deutscher Wetterdienst HLA: GISC-to-GISC communication backup è Technical specification requires a bilateral agreement from 2 GISC for a backup scenario è CMA and DWD prepared proposal for priorities in DAR metadata è First common draft of dissemination metadata (XML schema) è Need to prove in practice DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Delivery components Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst High level architecture: Delivery components è Message Switching System è REST Web-Service to manage and control Moving Weather è First proposal for generic Interface è Integration into Web. Werdis (still under work) è Subscription Management è Controller: time and event triggered management (still under work) è Customization according to GISC-to-GISC backup necessary DWD GISC Node - Current Status

Deutscher Wetterdienst Live Demonstration DWD GISC Node - Current Status

Deutscher Wetterdienst TC 5 - Maintenance of Users, Roles, Authorization and Authentication è Search metadata è Access data è Show difference between authorized and unauthorized User è User and Customer management è Subscription è View historic transactions DWD GISC Node - Current Status

Deutscher Wetterdienst Metadata Management – TC 1 è Show metadata editor è Fully integration open because of separation between Intranet and DMZ è Authorization required to add/modify/delete metadata DWD GISC Node - Current Status

Deutscher Wetterdienst Metadata Management – TC 2, TC 6 è A WIS Centre provides new metadata records è Show that GISC Geonetwork doesn’t contains new metadata records è Show that GISC_PRODUCTS is empty è Copy new metadata records to remote provider, reindex è GISC harvests new metadata records è Update of GISC Geonetwork and j. OAI Provider è Show update of Geonetwork with SRU query è Show update of GISC_PRODUCTS DWD GISC Node - Current Status

Deutscher Wetterdienst Challenges during the Implementation è Metadata generation è See paper “Questions on Metadata” from CMA, JMA and DWD from 11. 2009 è WIS Specification is open – what is good! DWD GISC Node - Current Status

Deutscher Wetterdienst Q&A DWD GISC Node - Current Status