Deutscher Wetterdienst DWD GISC Node Current Status Deutscher

  • Slides: 14
Download presentation
Deutscher Wetterdienst DWD GISC Node Current Status

Deutscher Wetterdienst DWD GISC Node Current Status

Deutscher Wetterdienst Agenda è Welcome è Current status: Overview based on functional blocks è

Deutscher Wetterdienst Agenda è Welcome è Current status: Overview based on functional blocks è High Level Architecture è Web Interface è DAR Component èCatalogue systems, Metadata and identified issues è GISC-to-GISC communication èExperience with Blog solution and AFD èSchema for GISC backup scenario è Data Components èMSS, AFD and subscription management è Topics for further collaborations è Q&A DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Functional blocks Logging, Monitoring and Reporting Authorisation/Authentication services Subscription

Deutscher Wetterdienst High level architecture: Functional blocks Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst HLA: Web Interface (User/Admin/Customer) Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management

Deutscher Wetterdienst HLA: Web Interface (User/Admin/Customer) Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst HLA: Web Interface (User/Admin/Customer) è Web. Werdis è Redesign of Web. Werdis

Deutscher Wetterdienst HLA: Web Interface (User/Admin/Customer) è Web. Werdis è Redesign of Web. Werdis èNavigation structure / search functions èInternationalization èIntegrate logging framework (necessary for monitoring) èCode clean-up èIntegration with Geonetwork è Customization of GUI DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Metadata Management Logging, Monitoring and Reporting Authorisation/Authentication services Subscription

Deutscher Wetterdienst High level architecture: Metadata Management Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst High level architecture: Metadata Management è DAR Catalogue è Did extensively Performance

Deutscher Wetterdienst High level architecture: Metadata Management è DAR Catalogue è Did extensively Performance Tests (Geonetwork 2. 2, terra. Catalog 2. 3) èDWD formulated test cases èContracted external partner for tests è Functional Tests è DAR Generator / Importer è Developed DAR metadata generator (template driven architecture) è External review of DAR metadata è Prototype DAR importer è Issues we identified during our work è Tested DAR catalogues fulfilled most, but not all INSPIRE and WMO requirements è DAR Metadata èPaper with Request for Clarification (JMA, CMA and DWD) èSchematron rules for validating WMO profile would be very helpful DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Metadata Management è Metadata Harvesting è CMA and DWD

Deutscher Wetterdienst High level architecture: Metadata Management è Metadata Harvesting è CMA and DWD did several functional tests with OAI-PMH in 09/09 è Different implementations of OAI-PMH could not harvest each other è Deleted metadata records: different implementations è Standard vanilla implementations modify harvested metadata è Ongoing tests between CMA and DWD èStarted January 2010 èInitial tests showed 1 record ~ 1 second space for improvement è Backup strategy è Exchange of metadata files as products DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: G 2 G communication Logging, Monitoring and Reporting Authorisation/Authentication

Deutscher Wetterdienst High level architecture: G 2 G communication Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst HLA: GISC-to-GISC communication è Collaboration CMA and DWD è Memorandum of Understanding

Deutscher Wetterdienst HLA: GISC-to-GISC communication è Collaboration CMA and DWD è Memorandum of Understanding signed end of last year è Two Workshops held è GISC-to-GISC communication tests with CMA è CMA and DWD installed Blog solution and AFD solution è Data sets with appropriated time profile (issue warning during model transfer) è Blog solution è CMA and DWD did several improvements on publishing and polling components è Usage of tar minimize latency of transfer è Necessary to include size of “metadata” (Atom. Feed) into calculation of transfer volume è Identified several further improvements like prioritization, Atom. Feed handling, logging è JMA has provided a new improved solution in 10/2009 è AFD solution è Average transport time between 4 -5 sec during 24 hour continuously test, warnings between 3 -4 sec è In case of unsecured connection sometimes corrupted data occur DWD GISC Node - Current Status

Deutscher Wetterdienst HLA: GISC-to-GISC communication backup è Technical specification requires a bilateral agreement from

Deutscher Wetterdienst HLA: GISC-to-GISC communication backup è Technical specification requires a bilateral agreement from 2 GISC for a backup scenario è CMA and DWD prepared proposal for priorities in DAR metadata è First common draft of dissemination metadata (XML schema) è Need to prove in practice DWD GISC Node - Current Status

Deutscher Wetterdienst High level architecture: Delivery components Logging, Monitoring and Reporting Authorisation/Authentication services Subscription

Deutscher Wetterdienst High level architecture: Delivery components Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Delivery tools • Moving Weather • AFD • controller Gray List Container Datapool(s) • controller/manager • access adapter • data sources WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic DWD GISC Node - Current Status DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

Deutscher Wetterdienst High level architecture: Delivery components è Message Switching System è REST Web-Service

Deutscher Wetterdienst High level architecture: Delivery components è Message Switching System è REST Web-Service to manage and control Moving Weather è First proposal for generic Interface è Integration into Web. Werdis (still under work) è AFD è Web-Service to manage and control AFD (in consideration) è Manage Atom. Feed (in consideration) è Subscription Management è Controller: time and event triggered management (still under work) è Customization according to GISC-to-GISC backup necessary DWD GISC Node - Current Status

Deutscher Wetterdienst Q&A DWD GISC Node - Current Status

Deutscher Wetterdienst Q&A DWD GISC Node - Current Status