The EUMETSAT Satellite Application Facility on Nowcasting and

The EUMETSAT Satellite Application Facility on Nowcasting and Very Short Range Forecasting 1 st International Precipitation Working Group Workshop Madrid, 23 -27 September 2002 L. F. López Cotín – IOP NWC SAF Manager (INM) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

BACKGROUND NWC SAF Consortium General Objectives Phases DEVELOPMENT PHASE OUTPUTS Products Outputs INITIAL OPERATIONS PHASE: Plans & Services IOP NWC SAF Objectives Planed Activities Primary Services Software Upgrades Support Services 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

The NWC SAF Consortium • INM: Leading Institute (Spain) • Météo-France (France) • SMHI (Sweden) • ZAMG (Austria) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

NWC SAF General Objectives Provide tools for the operational services to ensure the optimum use of meteorological satellite data on support to Nowcasting and Very Short Range Forecasting activities Both MSG & PPS Development, distribution and maintenance of appropriate SW Packages as well as of all related tasks for user's support Type A SAF Products will be produced by each SAFNWC User at home basis, running the software packages delivered and supported by the Nowcasting SAF Centre of Excellence for Nowcasting in EUMETSAT 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

The NWC SAF Phases Feb 1997 Feb 2002 Feb 2007 6 months Potential extension Development Phase IOP FOP 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF 5

Development Phase: Products MSG Products • Cloud Mask • Cloud Type • Layer Precipitable • Automated Satellite Water • Cloud Top Interpretation Imagery Temperature & • Stability Air • Rapid Developmet Height Imagery Thunderstorms • Precipitating Clouds • High Resolution • Air Mass Analysis Wind • Convective Rainfall Rate PPS Products • Total Precipitable Water • Cloud Mask • Cloud Type • Cloud Top Temperature/Height • Precipitating Clouds 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

NWC SAF Packages Strategy • Two independent Packages: SAFNWC/MSG: integrated by SAFNWC/PPS : integrated by 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

The IOP NWC SAF Consortium Structure Steering Group IOP Manager [INMLE] Coherence & Synergy System Engineering Integration and Coherence [INM-LE] MSG Manager [INM-LE] PPS Manager [SMHI] INM Sc. Development Scientific Team MF Develop+SW Maint. SMHI MSG Dev+Maint MSG OPS Service [INM-LE] PPS OPS Service [SMHI] - PPS Delta Develp. - Scientific Activities ZAMG Dev+Maint EUMETSAT OPS 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 SAFNWC Users' Group The EUMETSAT SAF on Nowcasting & VSRF 8

Products: Clouds Products • Cloud Mask (Cma) Provide information on the possible occurrence of clouds within each pixel. The central aim is to delineate all absolutely cloudfree pixels in a satellite scene with a high degree of confidence • Cloud Type (CT) The main objective of this product is to support detailed cloud analysis • Cloud Top Temperature & Height (CTTH) Contains information on the cloud top temperature and height for all pixels identified as cloudy in the satellite scene with the highest possible spatial and temporal resolution 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Products: Precipitation Products • Precipitating Clouds (Pc) Provides information on the probability of weak, moderate and strong precipitation • Convective Rainfall Rate (CRR) Provides the maximum level of information on convective rainfall from the SEVIRI channels 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Products: Precipitation Clouds PC Based on SMHI’s long experience on precipitating cloud products As output of the SCANDIA cloud classification scheme Stadistical scheme making use of IR/VIS channel and forcing parameters from the NWP data Channels used: VIS 0. 6, VIS 0. 8, NIR 1. 6, IR 3. 9, IR 10. 8, IR 1. 0 Scientific Report on www. inm. es/wwg and www. smhi. se 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Products: Convective Rainfall Rate CRR Based on RAINSAT methodology statistical relationship between satellite (multi-band imagery) and rainfall rate data obtained using radar data. CRR value for each pixel is obtained from calibration matrices. Calibration matrices are different if a pixel belongs to day or night mask. Day pixels CRR calibration data is a matrix 3 -D (bands: IR 10. 8, WV 6. 2, VIS 0. 6. ) Night pixels calibration values are stored in a 2 -D matrix (bands: IR 10. 8, WV 6. 2. ) Normalised visible counts are obtained using Binder algorithm. Smoothing process performed to eliminate stratiform rain data not associated with convective clouds. The obtained CRR significant data are set to zero if all the nearest pixels in a box of 14 x 14 do not have an equal or higher value than 3 mm/h. 1 st IPWG Workshop. The EUMETSAT SAF on Madrid 23 -27 Sep 2002 Nowcasting & VSRF

Products: Convective Rainfall Rate CRR The “RAINSAT” output is used as the input to the Auto-estimator algorithm proccess, This included adjusdtements by -humidity: TPW x HR -Orography -Clod top area evolution -Cloud top gradient -Etc 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Products: Clear Air Mass Products • Total Precipitable Water (TPW) Total atmospheric water vapour in a column of air extending from the Earth's surface to the "top" of the atmosphere • Layer Precipitable Water (LPW) Atmospheric water vapour contained in a vertical column of unit cross-sectional area in three layers in the troposphere • Stability Air Imagery LI index summarising the information of the SEVIRI channels • Air Mass Analysis Evaluates basic quantities that describe air masses (upper and middle level humidity, mean temperature, atmospheric stability, cloud pattern, etc) and to combine them into one integrated classification of the air mass 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Products: Winds and Conceptual Model Products • High Resolution Wind (HRW) Provides information on mesoscale wind vectors using data from the HRVIS channel at two spatial resolution: 25 and 10 km. • Rapid Development Thunderstorm (RDT) Twofold objectives: identification, monitoring and tracking of intense convective systems, and detection of rapidly developing convective cells • Automated Satellite Interpretation Imagery (ASII ) Provides an automatic interpretation of features seen on satellite images. Hence, the product identifies fronts, wave structures, areas of intensification at fronts by jet streak crossing, position of the jet axis, comma clouds, enhanced convection areas, etc. 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Products: Products Dependencies 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Main SW Requirements • All (MSG/PPS) modules shall be integrated in a single SW (MSG/PPS) applications • The (MSG/PPS) applications shall be fully configurable –Products to be generated –Geographical Area / Full Frame –Execution priorities (PGE / regions) • The (MSG/PPS) packages shall be robust –Execution will not need human assistance –Schedule of tasks automatically fixed by the Task Manager –Information will be logged to monitor the processing and to extract statistics • The (MSG/PPS) applications shall permit the processing of realtime and archived data 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Architecture Design Meteorological Product and Engineering SW development shall be as de-coupled as possible: Task Manager NWCLIB (Common functions) PGEs (Product Generation Elements) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Task Manager • Interface between the user and the SAFNWC/MSG product generation • Initialise and set-up of the system according the configuration • Drive and optimise the execution of the PGEs – Execute pre-processing tasks required by the PGEs – Schedule the execution of the PGEs according their dependencies and priorities – Monitor the processing and logs information and statistics – Execute other programmable activities defined by the user 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF 19

NWCLIB • The NWCLIB common library provides common functionalities for the SAFNWC/MSG product generation 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF 20

PGEs • Implements the scientific algorithms in charge of extracting the Meteorological Products • Coded as stand-alone applications, supported by the NWCLIB functions • Fully configurable – Region – Parameters used by the algorithms • Common External Interface PGEnn <YYYYMMDDhhmm> <region conf. file> <model conf. file> nn: PGE number YYYYMMDDhhmm: nominal date of the SEVIRI slot to be processed <region conf. file> Name of the Region Configuration File <model conf. file> Name of the Model Configuration File (model parameters) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF 21

Development Phase: MSG Outputs SW SAFNWC / MSG version 0. 0 • Task Manager: TM • Common Library: NWCLIB • Product Generation Elements: PGE 01, . . . PGE 12 Documentation Scientific: Plans and Reports on prototypes SW Engineering: SRD, ADD (System and PGE level), SVD, Tests Reports, Test Results. Users Manuals: Master, Engineering, Scientific parts 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

MSG Outputs - characteristics SAFNWC / MSG version 0. 0 MSG Launch delay impact Engineering purposes Supported on SUN Current committed Platforms: SUN, HP, DEC-Alpha, SGI Portability tasks on stable version 1. 0 (validated with SEVIRI data) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF 23

Development Phase: PPS Outputs SW SAFNWC / PPS • Product Generation Elements: PGE 01, . . . PGE 04 • SMHI specific library functions and scripting environment to run PGE’s Documentation Scientific: Plans and Reports on prototypes SW Engineering: SRD, ADD, ICD’s (PGE level), SUM 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

PPS Outputs - characteristics • NOAA satellite data was available during Development phase • Resources for software package development (common library functions and task manager) made available for IOP • PPS PGE’s scientifically mature, no initial tuning needed • Software engineering at different stages than for MSG • Different content for early PPS / MSG release version numbers 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

INITIAL OPERATIONS PHASE: Objectives 1/3 Complete the development of the MSG products, up to their validation and tuning using real SEVIRI data, as available from the MSG-1 mission; Validate the SAFNWC/MSG products with real SEVIRI data; Improve the SAFNWC/MSG products and plans according to the results of the validation activities; 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

INITIAL OPERATIONS PHASE: Objectives 2/3 Complete the engineering of the SAFNWC/PPS package: common SW developments and integration into a single package; Adjust PPS software and algorithms to be able to process EPS/MHS data when Met. Op is available Validate the SAFNWC/PPS products. Improve the SAFNWC/PPS products and plans according to the results of the validation activities; 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

INITIAL OPERATIONS PHASE: Objectives 3/3 Deliver updated SW Packages for SAFNWC/MSG and SAFNWC/PPS during IOP as necessary to support maintenance and planned improvements; Give support to users by means of a Help Desk (web site) and training activities; Perform Quality Control on the Nowcasting SAF Production and Services; Collect new User Requirements for further developments; Implement new developments according to the upgraded User Requirement Document; and Be a reference for Nowcasting aspects for EUMETSAT. 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

INITIAL OPERATIONS PHASE: Planned Activities • No homogeneous activities planned along the IOP Life Cycle; therefore sub-phases are identified with different durations and specific objectives • Sub-phase Outputs are upgraded SW versions • Management Control of Services and Progress of the project are ensured by means of Technical Revisions (upgraded SW deliveries)and Management Reviews (yearly) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF 29

INITIAL OPERATIONS PHASE: Primary Services The Nowcasting SAF will deliver upgraded versions and related documentation Software Maintenance: Corrective Adaptive Perfective Evolutive 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

INITIAL OPERATIONS PHASE: Algorithm Improvements Associated to Perfective and Evolutive SW maintenance concept Based on current products improvements or new products developments Performed by the Development Teams as planned, and considering users’ inputs Supported through the Visiting Scientist Programme 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

INITIAL OPERATIONS PHASE: Software Upgrades March 2002 End 2003 Development + Preparations March 2005 Scientific validation + Requirements Seeking MSG 0. 1 PPS 1. 0 Mid 2003 MSG 1. 0 MSG 1. 1 Upgrading According New Requirements MSG 1. 2 PPS 1. 1 SEVIRI 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 July 2006 The EUMETSAT SAF on Nowcasting & VSRF Additional validation+ FOP preparations MSG 2. 0 PPS 2. 0 EPS Feb 2007 MSG 2. 1 PPS 2. 1 32

SAFNWC/MSG 0. 1: System Validated (Engineering) Purpose: Relevant inputs: Upgraded according planned scientific developments and system validation Real SEVIRI data Feedback from Beta-testers Mid 2003 Planned Scientific Outputs Characte ritics: Not operational Running on SUN platform System validated Upgraded in line with the planned scientific development 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/MSG 1. 0: Scientifically checked Purpose: First version delivered to users Relevant inputs: Data-set of stable and well calibrated real SEVIRI data Characte ritics: Operational Supported on SUN platform Scientifically checked and first tunned Upgraded according maintenance activities Intended to be portable (not completely ensured) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF End 2003

SAFNWC/MSG 1. 1: Full portable Purpose: Ensured full portable Relevant inputs: Real SEVIRI data Characte ritics: Operational Feedback from Beta-testers Beg 2004 Fully portable on committed plattforms Upgraded in line with the planned scientific development Not delivered if 1. 0 is fully portable 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/MSG 1. 2: Scientifically validated Purpose: Improve product quality, refining algorithms in accordance with the validation results Relevant inputs: 1 year of real, stable, validated SEVIRI data Characte ritics: Operational Reports on Product (Scientific) Validation Spring 2005 Fully portable on committed plattforms Refined algorithms according validation reports Upgraded perfective (+ corrective, adaptive) maintenance 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/MSG 2. 0: New User Requirements Purpose: Relevant inputs: Implement improvements according the upgraded URD Feedback from Users PAR outcomes (Product Assessment Review) Summer 2006 Updated URD Characte ritics: Operational Fully portable on (new? ) committed OS/plattforms Upgraded in line with new scientific development Upgraded according perfective, adaptive, corrective, evolutive maintenances 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/MSG 2. 1: Tunned new upgrades Purpose: Check new implementations of SAFNWC/MSG 2. 0 Relevant inputs: Feedback from Users Characte ritics: Operational Validation reports Fully portable on committed OS/plattforms Upgraded according maintenance procedure 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF Feb 2007

SAFNWC/PPS 0. 20: Beta release August 2002 Purpose: First release to beta testers to address portability issues Relevant inputs: AVHRR/AMSU up to NOAA 16 Characte ritics: Not operational, but scientifically correct NWCLIB developed under IOP No Task Manager CTTH for opaque clouds only 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF Aug 2002

SAFNWC/PPS 0. 2 x: Beta release, planned updates 2002 Purpose: Gradually ensure full functionality of PPS package Relevant inputs: Software problem reports from Beta users Characte ritics: Capable to process NOAA 17 planned software developments Taskmanager included Bug fixes and minor software updates 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/PPS 1. 0: Fully functional and portable Purpose: First version delivered to users Relevant inputs: Feedback from betatesters Characte ritics: Operational ORR acceptance Mid 2003 Portable on comitted platforms (HP Unix possibly open if no beta tester is found) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/PPS 1. 1: Scientifically validated Purpose: Improve product quality, refining/tuning algorithms in accordance with the validation results Relevant inputs: Reports on Product (Scientific) Validation Characte ritics: Operational Spring 2005 Refined algorithms according to validation reports and planned improvements Upgraded perfective (+ corrective, adaptive) maintenance 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/PPS 2. 0: New User Requirements & adapted to EPS data Purpose: Implement improvements according the upgraded URD adapt software to EPS data Relevant inputs: Feedback from Users & updated URD PAR outcomes (Product Assessment Review) Summer 2006 Frozen EPS specifications/ EPS simulated data Characte ritics: EPS/MHS Operationalreal data Fully portable on (new? ) committed OS/plattforms Upgraded in line with new scientific development Upgraded according perfective, adaptive, corrective, evolutive maintenances 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

SAFNWC/PPS 2. 1: Tunned new upgrades Purpose: Check new implementations of SAFNWC/PPS 2. 0 Validated with real EPS data Relevant inputs: Feedback from Users Characte ritics: Operational Validation reports Fully portable on committed OS/plattforms Upgraded according maintenance procedure 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF Feb 2007

INITIAL OPERATIONS PHASE: Support Services The User’s Support will be based on: Help Desk Facility Training Activities 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Support Services: Users • EUMETSAT Central Facility • EUMETSAT members states and cooperant states National Meteorological Services • Other official duties Institutions of EUMETSAT members states and cooperant states • Potential users of WMO RA I EUMETSAT Users Data Policy applied 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Support Services: SAFNWC Users’ Group The support to users will be carried out by the Operations Leading Entity to all targeted users through the SAFNWC Users' Group, which is the group of people nominated to act as focal points at User Sites 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

User’s roles and responsibilities • Three different categories of SAFNWC/MSG "users" are foreseen –System Administrator: responsible of the operational execution of the SAFNWC/MSG application –Scientific Administrator: in charge of configuring all the scientific aspects of the system and adjusting the generation of the meteorological products according the needs of the final users –Final Users (forecasters), who will receive the products as they are for analysis and exploitation 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Support Services: SAFNWC Users’ Group Interfaces NOWCASTING SAF SW Distribution Software Reports SPR /SMR Mail Box Information Training Inquiry on User Req. & Product Applicability Survey Docs CD RO M Workshops & STM Docs CD RO M Help Desk SAFNWC Users' Group 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF Users Workshop

Support Services: Help Desk Strategy Status: Upgrading information in the Current Web Page Requirement of Help Desk defined Help Desk Development on going Plans Help Desk Development Completion; but Help Desk Functions will be implemented progressively. Web Site Areas: Free Access; Restricted to SAFNWC Users’ Group; and Private Area to the Consortium 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Support Services: Training Activities Status PPS Beta Users Workshop Editions 1 and 2 MSG Information Meeting (Beta-testers) MSG PPS December 2001 & April 2002, 13 institutions interested, 11 licence agreement signed, All committed platforms except HP, additionally beta-testers on Linux, Delivered 9 August, Installations (Sun Solaris 8, Linux Debian) completed after one week 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 Very positive Conclusions. Beta testing Activities: On going September 2002, 14 institutions interested, Licence agreement signature process on going, Delivery planned October 2002, Several beta-testers interested on checking on different platforms apart from SUN The EUMETSAT SAF on Nowcasting & VSRF

Support Services: Training Activities Plans 2 Joint MSG-PPS Workshops on major upgraded deliveries: –Version MSG 1. 0 and PPS 1. 0 –Version MSG 2. 0 and PPS 2. 0 Visiting Scientist Activities (Seminars, Workshops, etc. ) 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

Support Services: Upgrading Requirements Plan Based on: PAC Workshop Help Desk VSA Seminars Workshop Mid Term Review Devoted Survey Upgrade URD New URs Implementation planned baseline: versions 2. 0 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF 53

CONCLUSIONS: Based on decentralised EUMETSAT policy MSG Launch delay impact, and EPS future adaptation considered Development concluded, but improvement planned based on products validation, users applicability and new requirements Visiting Scientist Frame for scientific cal/val cooperation Delivery according EUMETSAT data policy User support ensured through the SAFNWC Users’ Group, workshops and training activities 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF

KEEP IN TOUCH WITH NWC SAF: www. inm. es/wwg - l. cotin@inm. es 1 st IPWG Workshop. Madrid 23 -27 Sep 2002 The EUMETSAT SAF on Nowcasting & VSRF