Data services Accessing EURO 4 M and UERRA

Data services: Accessing EURO 4 M and UERRA data in MARS Richard Mládek, Manuel Fuentes (ECMWF) 3 -4. 2. 2016 UERRA Workshop Toulouse 1

ECMWF MARS - (Meteorological Archive and Retrieval System) a managed archive. GRIB, BUFR and ODB (in future Net. CDF). Managed archive means the data has to follow a certain structure, based on archiving and retrieval patterns (needs to know how the data is going to be produced/used before deciding how to store it) Efficient data retrieval – it is important to follow recommendations how to retrieve data especially when requesting large amounts. 3 -4. 2. 2016 UERRA Workshop Toulouse 2

EURO 4 M testbed q q Archive some data from EURO 4 M before UERRA samples are available Solution chosen: Ø Ø q Original data which is available in GRIB 1 (no common definitions of the parameters) for period 2008 -2009 If possible provide 15 selected surface parameters only By the end of 2015 two year sample data was archived from 4 centres Ø Ø 3 -4. 2. 2016 Data is very varying among centres (different parameters, starting times, levels. . ) => difficult to use for inter-comparison Data is available only to authorized users via standard MARS retrieval tools available UERRA Workshop Toulouse 3

EURO 4 M testbed https: //software. ecmwf. int/wiki/display/UER/Progress+status EURO 4 M domain 3 -4. 2. 2016 UERRA Workshop Toulouse 4

EURO 4 M testbed 15 selected surface parameters: q 10 meter u-velocity q Surface air relative humidity q 10 meter v-velocity q Surface air temperature q Convective precipitation q q Large-scale precipitation q Orography q Snow depth water equivalent q Snow fall water equivalent q Surface air maximum temperature q Surface air minimum temperature 3 -4. 2. 2016 q Time-integrated surface net solar radiation Time-integrated surface solar radiation downwards q Total cloud cover q Total precipitation UERRA Workshop Toulouse 5

EURO 4 M testbed Centre UM/4 DVAR (MO) HIRLAM (SMHI) MESCAN (MF) COSMO (DWD) Domain size (projection) 480*384 (rot. latlon) 326*341 (rot. latlon) 1080*1000 (Lamb. conf) 848*824 (rot. latlon) Types fc an / fc an Times 3, 9, 15, 21 h 0, 6, 12, 18 h Steps(fc only) 0, 1, 2. . . 27 h 6, 12… 36 h 6 h Levels ml(71) / pl(20) / sfc sfc Parameters 7(ml)/5(pl)/51(sfc) 5(an) / 15(fc) 3(an) / 4(fc) 0, 1, 2. . . 23 h sfc 16 (fluxes are not accumulated!) ml. . model levels pl. . pressure levels sfc. . surface level 3 -4. 2. 2016 an. . analysis fc. . forecast rot. latlon. . Rotated Latitude/Longitude grid Lamb. conf. . Lambert Conformal UERRA Workshop Toulouse 6

Centre Parameters type=fc level=sfc 3 -4. 2. 2016 EURO 4 M testbed UM/4 DVAR (MO) o 1. 5 m specific humidity o 1. 5 m temperature over land o 10 metre wind gust in the last 24 hours o 10 m U wind over land o 10 m V wind over land o Clear-sky (II) down surface sw flux o Clear-sky (II) up surface sw flux o Convective precipitation (water) o Convective rainfall rate o Convective snowfall rate o Fraction of sea-ice in sea o High cloud cover o Land-sea mask o Large scale rainfall rate o Large scale precipitation o Large scale snowfall rate o Latent heat flux o Long wave radiation flux o Low cloud cover o Maximum temperature at 1. 5 m since previous postprocessing o Mean sea level pressure o Medium cloud cover o Minimum temperature at 1. 5 m since previous postprocessing o Net long-wave radiation flux (surface) o Net short-wave radiation flux (surface) o Orography o Precipitation rate o Relative humidity at 1. 5 m o Sensible heat flux o Short wave radiation flux at surface o Short wave radiation flux at top of atmosphere HIRLAM (SMHI) o Soil temperature layer 1 o Soil temperature layer 2 o Soil temperature layer 3 o Soil temperature layer 4 o Surface pressure o Temperature o Total Cloud Cover o Total Precipitation o Total cloud amount random overlap o Total cloud amount in lw radiation o Total column water vapour o Very low cloud amount o Visibility at 1. 5 m o Volumetric soil water layer 1 o Volumetric soil water layer 2 o Volumetric soil water layer 3 o Volumetric soil water layer 4 UERRA Workshop Toulouse o 10 metre U wind component o 10 metre V wind component o 2 metre temperature o Convective precipitation (water) o Convective snow o Global radiation flux o Large scale precipitation o Large scale snow o Long wave radiation flux o Net long-wave radiation flux (surface) o Net short-wave radiation flux (surface) o Relative humidity o Snow depth, cold snow o Total Cloud Cover o Total precipitation MESCAN (MF) o o 10 metre U wind component 10 metre V wind component Surface solar radiation downwards Surface thermal radiation downwards 7

Centre HIRLAM (SMHI) Parameters o o o type=an level=sfc 3 -4. 2. 2016 EURO 4 M testbed MESCAN (MF) 10 metre U wind component 10 metre V wind component 2 metre temperature Relative humidity Total Cloud Cover COSMO (DWD) o 2 metre temperature o 10 metre U wind component o Relative humidity o 10 metre V wind component o Total precipitation o 2 metre temperature o 2 m Relative Humidity o Convective rain rate o Convective snowfall rate water equivalent o Downward direct short wave radiation flux at surface (mean over forecast time) Initialisation o Geometric Height of the earth surface above sea level o Large scale rain rate o Large scale snowfall rate water equivalent o Max 2 m Temperature (i) Initialisation o Min 2 m Temperature (i) Initialisation o Net short wave radiation flux (at the surface) o Snow depth o Total Cloud Cover o Total Precipitation UERRA Workshop Toulouse 8

EURO 4 M testbed EURO 4 M data in MARS 2 main MARS key words identifying EURO 4 M datasets: q class = rm q expver = 1, 2, 3, 4 1 => UM/4 DVAR (MO) 2 => HIRLAM (SMHI) 3 => MESCAN (MF) 4 => COSMO (DWD) Data volume (13. 4 GB): UM/4 DVAR (MO): 7. 8 GB HIRLAM (SMHI): 4. 1 GB MESCAN (MF): 952 MB COSMO (DWD): 525 MB 3 -4. 2. 2016 UERRA Workshop Toulouse 9

MARS access 1. via MARS batch requests run on unix command line 2. via ECMWF Web. API (an alternative way for downloading MARS data in a programmatic way via Web) ECMWF Web. API is a set of services developed by ECMWF to allow users from the outside to access some internal features and data of the centre. So far 2 services: EURO 4 M 3 -4. 2. 2016 • Access MARS UERRA • Access ECMWF public datasets (TIGGE, S 2 S, ERA 40, UERRA…) UERRA Workshop Toulouse 10

Accessing EURO 4 M (via Access MARS service) Follow 3 easy steps: 1. Install ECMWF Web. API • follow instructions at https: //software. ecmwf. int/wiki/display/WEBAPI/Access+MARS • & download the “mars” sample script 2. Check EURO 4 M data availability • browse MARS web catalogue at http: //apps. ecmwf. int/mars-catalogue/? class=rm • or write MARS list request (mars_list. batch) and run it: mars_list. batch 3. Get the data • Write MARS retrieval request (mars. batch) and run it: 3 -4. 2. 2016 UERRA Workshop Toulouse mars. batch 11

• Check for availability • View MARS request • Estimate download size • Retrieve. . Active request Retrieve now Finished! Download the data

Retrieve. . 3 -4. 2. 2016 UERRA Workshop Toulouse 13

Links q ECMWF Web API tutorial for accessing MARS https: //software. ecmwf. int/wiki/display/WEBAPI Retrieve now 3 -4. 2. 2016 UERRA Workshop Toulouse 14

Done: Summary New GRIB 2 class=ur (uerra) approved by WMO UERRA website at ECMWF Preliminary work on 4 EURO 4 M datasets archiving in MARS In progress: Finish archiving of EURO 4 M Gathering first UERRA data sample 3 -4. 2. 2016 GRIB 2 common definitions and convertion tools to achieve identical UERRA/WMO compliant format for all datasets Data checking tool amendment (tigge_check) TOP PRIORITY: Inventory of all UERRA parameters & datasets' metadata to be able to start MARS and GRIB_API related developments UERRA Workshop Toulouse 15