Workshop on Information Access Enablers Mto France Strategy

Workshop on Information Access Enablers Météo France Strategy Geneva 17 -18 May 2010 Jacques Roumilhac

Information access in Météo France § Stage 1: Current status – Okapi production platform (finalized products) with a Web portal – IAA (Random Access on Legacy databases) with a bespoke language via ftp § Stage 2: Information system evolution – – § SOA (with a part of OGC services) Information model with geographic references Spatial databases Light and smart client (forecaster station project) Stage 2 bis: WIS solution – Open. WIS developed with UKMO – Metadata generator

Stage 1: Production Service Okapi - IAA § OKAPI: Three software bricks, loosely linked : – Okapi production platform (products factory). – Internal production portal : Okapimet (For web and webservice customers). – production portal : Climatheque (For web and webservice customers). § IAA – – Random access On the legacy databases Archive access possible With a bespoke language

System schema

orchestration, traffic shaping § § Traffic shaping mechanisms Balanced charge. Product factory (close WTS) Identity management (authorization, authentication)

Stage 2: New project Synopsis: Forecaster tools based on SOA § Two main requirements § SOA – – – Development efforts factorization Processing and data pool access Standard interfaces Management of different topologies (local or remote server, standalone) WMO needs and INSPIRE recommendation § Client station – – – Last technologies Deployment and support easy Light or smart client Scalable, efficient Multi-platforms

Technical choices § Synopsis Server : – Linux 64 bits : • Re-use of current services in different systems • Use of programs and libraries of ECMWF – Use of bricks Open. Source • • Databases: Postgre. SQL, Post. GIS Image processing: GDAL, Proj 4 Mapserver : services OGC Geonetwork for the catalogue

The services § Different service levels – – § Metadata access (catalogue) Data access Business processing (graphic processing) Presentation services (images, maps, graphics…); Interoperability for the map services – So : WMS (Web Map Service) et CSW (Web Catalog Service) § For INSPIRE, interoperability also on data and processing services (transformation and downloading) – So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep processing Service) ….

SOA : Reference architecture Application composite Engine Orchestration Application composite BPM Application composite Business process Supervision Services Registry SAM Bus for messages Data access Business services Processing / Transformation CRUD Administration Plate -Form CRUD SAM : Service Activity Monitoring Legacy databases BAM : Business Activity Monitoring BPM : Business Process Management CRUD : Create Read Update Delete

Interoperability § Strategic target § Use of the standards § OGC standards for geo-referenced data Web Feature Server Web Map Server Web Coverage Server Web Map Service (WMS) Web Feature Service (WFS) Web Coverage Service (WCS) Catalogue (CSW) Geography Markup Language (GML) Web Map Context (WMC) OGC KML Others…

SOA : Architecture interoperability on legacy databases with geographic extension Administration Plate -Form Client SYNOPSIS Java Web Start Supervision Plate form Client SYNOPIS Full Web Interface HPOV Other applications composites Bus of messages JMS Data Service WFS BDMO WCS CSW Processing service SOS WPS BDI BDEPI SPS Presentation service WMS BDE BDAP Geo-ext Geoextension BDMO BDI BDEPI BDE BDAP Ref) Ref Ref Legacy databases Catalogue FPS

Data Access Services WFS Web Feature Service Coast map lines Objects : Anasyg Services de DONNEES Pi, Sympo 2, Aeronautic OACI Annex 3 WCS WFS SOS

Portrayal Services WMS Web Map Service Static geographic layers Services PRESENTATION Images Radar, Sat Observation Models plots WMS FPS Objects : Anasyg Pi, Sympo 2, Aeronautic OACI Annex 3

Different clients Client VGISC OKAPI Advanced Production Client SYNOPIS INSPIRE answer Light (Full Web) Client SYNOSIS Smart CATALOGUE Service CSW Data access services VGISC Processing services (CRUD) WCS WFS WPS SOS SPS Presentation services FPS BDMO BDI BDEPI BDE BDAP Extension Extension BDMO BDI BDEPI BDE BDAP Ref) Ref Ref Legacy databases WMS

General Architecture § Data and services catalogue (standard) – On line products and services discovery. – Message bus • Balanced flow (cluster services) • Loosely link between server and client § Spatial database – Using Map. Server and other OGC implementations § Standard interfaces used by the clients – Possibility to access to extern services (without guarantee of performances) – Useful for a wandering forecaster

Prototype Architecture Client SYNOPSIS Full Web Client SYNOPSIS JAVA Web Start Network (IP) WMS (cartes) Frontal SYNOPSIS (Syn. Front) CSW HTTP -> JMS CATALOGUE Middleware ( bus JMS ) WMS Geonetwork ISO 19115 -19119 Server SYNOPSIS (Syn. Serv) Business service Map. Script Servlet Executable Ma g i c s + + Map. Server JMS CGI Services on cluster Metadata ISO 19115 ISO 19119 Soprano Transmet File System BD Spatiale (Syn. Base) Pos. GIS Retim Alimentation BD (Syn. DATA)

Premières maquettes

Architecture Target (Back Office) WMS WCS WFS WPS Présentation Access Object access Processing cartes Images PI, SYMPO 2 CRS transf. AERO (WXXM) … Modèles Client Synopsis WEB Front End Clients Client Synopsis JAVA Client Production CSW bus JMS internal “Backbone” of services (ESB ? ) CLUSTER Serveur SYNOPSIS Servers Monitoring Administration Sécurity BD’s Spatiales Post. GIS BDEPI BDE BDI « new » BD spatiale (Syn. Base) BD’s SOPRANO BDM BDCLIM BDAP BDI CATALOGUE Post. GIS Geonetwork ISO 19115 -19119 WMS Présentation RMDCN Cartes SOS WMS SOS WPS Access Présentation Processing Obs validated Maps Stats SPS CEP WEB High availability Obs Front End Obs & time series Front End CBD [OKAPI ? ]

Stage 2 bis: WIS Approach § Open. WIS development : – – § Information fetching: Different use cases Open. WIS: Open interfaces Request or subscription Météo France use two diffusion systems Metadata GTS generator – To populate the WIS catalogue – Mapping between Volume C 1 and Core Metadata Profile – Close the prompting question on information sources

Ad-hoc Request for a product in the Cache – dissemination via the FSS (GISC function) 7 bis: the user receives the products. 5 bis: the user obtains the products from the shopping cart. 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. 4: The product type is part of the global dataset. The 2: the user is authenticated (several steps) 1: the user discovers local product type in the catalogue requested products are extracted from the Cache. Portal DAR subscriptions (user profile) Open. WIS MSS Routing 5: Storage in the shopping cart for an online distrbution, or preparation of the dissemination instructions: they are constructed from the user profile, among other elements. 6: the products and instructions are forwarded. FSS 7: Dissemination according to instructions.

Ad-hoc Request for a local product – dissemination via the FSS (NC or DCPC function) 8 bis: the user receives the products. 6 bis: the user obtains the products from the shopping cart. 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. 2: the user is authenticated (several steps) 1: the user discovers local product type in the catalogue 4: the product type is owned by a local NC or DCPC. Portal DAR subscriptions (user profile) Open. WIS 6: Storage in the online shopping cart, or preparation for dissemination. 7: the products and instructions are forwarded. 5: the required products are extracted and returned. MSS Routing SOURCE FSS 8: Dissemination according to instructions.

Arrival of a new GTS product at the MSS (GISC function) 6 bis: the user receives the product. 4 bis: the user obtains the product from the shopping cart. 3: Is someone subscribed to this type of product ? Portail 2 bis: the product is collected and inserted in the GISC Cache DAR subscriptions (user profile) Open. WIS MSS 1: the MSS receives a new product Routing 4: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. 5: the product and instructions are forwarded FSS 2: the MSS routes the product according to its routing table 6: Dissemination according to instructions.

New local product available (NC or DCPC WIS function) 7 bis: the user receives the product. 5 bis: the user obtains the product from the shopping cart. Portal 5: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. 3: Is someone subscribed to this type of product ? 2: Notification of the product availability DAR subscriptions (user profile) Open. WIS 6: the product and instructions are forwarded 4: the required products are extracted and returned. TRANSMET SOURCE FSS 7: Dissemination according to instructions Routage 1: New local product

DARMet A 2 A 4 Security Service Authentication User Interface (web portal) Make / Follow Request Metadata service Authorisation Catalogue Access A 1 A 3 Metadata Catalogue Synchro & Harvesting Browse / Search DAR Admin / Monitoring Data service Manage Requests A 1 A 3 A 5 Cache A 6 Monitoring & Control Service Monitoring Collection « Ad Hoc » User & Data Policies A 7 External Interface Routine « Push » Replication Administration A 1 A 3 A 5 POSSIBLE CHOICES MSS/FSS DIFF A 1 A 5 Local System Open. WIS UK Met. Office A 1 SIMDAT base Geo. Network base Sun Open. SSO base MSS SMART / GEMS

GTS Metadata Generator Close to prompting question on digitization