DelftFEWS Basic Configuration Course Exercises Deltares Delft March
Delft-FEWS Basic Configuration Course - Exercises Deltares, Delft, March 2018
Exercise 0: Preparations (open data account) Open data account • Go to GPM (NASA) and register there based on your e-mail address https: //registration. pps. eosdis. nasa. gov/registration/ • Default is that your username and password are equal to your specified e-mail address • Store/write down your credentials (if needed) • Check the box for Near-Real time Products • You need these credentials in the next step 5 december 2020
Exercise 0: Preparations (adjust configuration) Make sure the Basic Course application Crete_workshop. zip is unzipped on your computer!! This is explained in step 2 on the download page • Navigate to: . . FEWS_BasicConfigModule. Config. FilesImport_GPM_Server. xml • Open this file in a text-editor or xml-editor (like XML-Spy, Xml. Pad) • Complete line 6 as follows (in the <folder> section): • EXAMPLE (if registration was done for: username@gmail. com) • @ character should be replaced by %40 • Replace username and password by YOUR credentials ftp: //username%40 gmail. com: username%40 gmail. com@jsimpson. pps. eosdis. nasa. gov/data/imerg/early/ • Save the file 5 december 2020
Exercise 0: Preparations (Windows Firewall settings) Windows Firewall Settings may have to be changed • If you run into problems (no data visible) in step 5 of exercise 1 (“Importing data” on the next slide) your port settings may have to be adjusted • Go to windows firewall settings / advanced security • Check the inbound rule for Delft. FEWS_Basic_Crete_x 64. exe • Make sure for the TCP protocol ports 21 or 22 are open • Apply changes 5 december 2020
Exercise 1: Start Basic Course Application 05 December 2020 on trati FEWS System Time ons Dem The Basic Course application is provided as zip file Create_workshop. zip” 1. Unzip the zip file to a folder on your computer (if not done already in Exercise 0) 2. Start the application with Crete_workshopApplicationFEWS_BasicDelft. FEWS_Basic_Crete_x 64. exe 3. Allow Access (Windows Firewall message) if prompted 4. Set the System time to midnight “ 00: 00” hours 5. Open the Forecast Tree and select the “Import meteo forecasts” node from the “Data Import and process” folder. 6. Start the Import of meteo forecast data by pressing the Run button 7. Analyse the data with Spatial Display
Exercise 2: Explore the config folder 1. Open Windows Explorer or Total Commander and open the file FEWS_BasicConfigSystem. Config. FilesExplorer. xml in a XML editor or text editor 2. The system. Caption element contains a global. property tag between $ <system. Caption>$EXPLORER_SYSTEMCAPTION$</system. Caption> 3. Open the file FEWS_Basicglobal. properties in a text editor 4. Change the tag EXPLORER_SYSTEMCAPTION to “FEWS Basic Course (Name)”, where Name is your own name. 5. Save the global. properties file and restart you FEWS application 6. Check the changes in the FEWS Explorer name 05 December 2020
Exercise 3: Analyse the import workflow 1. Open the FEWS-Basic Application with the imported data from exercise 1 • The Import meteo forecasts workflow is completed • The Import earth observations workflow is completed 2. Open the Workflow Navigator (CTRL+W) and select the Import meteo forecasts workflow from the Forecast Tree • How many modules are included in the Import_Forecast workflow • What are the parameter ID’s of the imported time series • Select the Import_GFS_Server module instance and press the right mouse button. Open the config file (CTRL+O) • Check the P. forecast time series from the config file, what is the time. Series. Type 3. Repeat the same steps for the Import earth observation workflow • Make sure the FEWS application is allowed to import data from ftp (see exercise sheets on Firewall settings), follow exercise 3 b in next sheet 05 December 2020
Exercise 3 b: Import EO data from local folder When it is not possible to import Earth Observation data from ftp servers (Firewall issue) it is also possible to copy the data locally in an import workflow. 1. Open your Internet Browser or File Explorer and open the GPM ftp site with the correct username and password. • ftp: //jsimpson. pps. eosdis. nasa. gov/data/imerg/early/ • Username and Password are requested in Exercise 0. 2. Select the latest 6 hours of data from the ftp folder 3. Press right mouse button and select ‘Copy to Folder’ 4. Select the FEWS_Basic_Import folder 5. Create a new GPM folder and press OK to copy the files 6. Start the ‘Import earth observations’ workflow 05 December 2020
Exercise 4: Show data in spatial display 1. 2. 3. 4. 5. 6. Open the FEWS-Basic Application with the imported data from exercise 1 Open the Spatial display and select the Display time ( ) from the Toolbar Change the Display time to yesterday 00: 00 Is it possible to see Satellite Precipitation series? Is it possible to see GFS Rainfall Forecast series? Explain the different behaviour between the two time series 05 December 2020
Exercise 5: Add IOC Coastal locations In this exercise we will add 3 coastal locations to the meta data CSV file 1. 2. 3. 4. 5. 6. 7. Open the Map. Layer. FilesCoastal_Stations. csv file in a Text editor or EXCEL Remove the current lines Add the locations and attributes as presented in the table above to the CSV file Restart the FEWS-Basic application or press F 5 Select the Data Viewer and filter Coastal stations Open the Map display to check the 3 stations There will be no data yet! (continue to the next exercise) 05 December 2020
Exercise 6: Import data IOC Coastal locations In this exercise we will import the data of the IOC Coastal stations. 1. Go to the Exercise answers folder: Exercise 6 2. Open the Topology. xml file and inspect the contents 1. Do you understand the contents? 2. Do you recognize the names in the FEWS interface? 3. Copy the Topology. xml file to the Region. Config. Files 4. Refresh the client (F 5) and inspect the change in the “Forecast Tree” 5. Select the “Import IOC Coastal observations” node and open the workflow navigator (ctrl + w) 6. Inspect the Import_GLOSS Module. Instance 7. Run the workflow (press ) 05 December 2020
Exercise 6 b: Import data IOC Coastal locations OPTIONAL 1. Go to http: //www. ioc-sealevelmonitoring. org/map. php 2. Find a coastal observation point near your area of interest. 3. Add this to the FEWS configuration (use the wiki for reference) 1. In the Coastal_Stations. csv 2. In the Import module: ConfigModule. Config. FilesImport_GLOSS. xml 4. Refresh the Delft-FEWS Client (F 5) 5. Run the workflow again 1. Inspect the results in the filters 2. Inspect the results in the database viewer 05 December 2020
Exercise 7 -1: Import Temperature GFS forecast series In this exercise we will import an additional Temperature time series from the GFS forecast 1. Open the Module. Config. FilesImport_GFS_Server. xml file in an editor 2. Add a new timeseries. Set to store the T. forecast time series in the database 3. Add an external unit “<extern. Unit parameter. Id="T. forecast" unit="K"/>” 4. Open the Id. Map. FilesId. Import. GFS. xml file and check the external parameter T. forecast 5. Save the edited files and restart the FEWS-Basic application or press F 5 6. Run the Import meteo forecasts workflow from the Forecast Tree with the same FEWS system time as in Exercise 1 7. Open the Database Lister and check if a new time series is imported 05 December 2020
Exercise 7 -2: Import Water level data In this exercise we will import downloaded scalar data, downloaded from a Website • Water Level for Hoek van Holland Note: For your convenience the data has been downloaded already and is available on the ftp. (You can skip the grey parts on the slides, it’s just there for reference) First we need to download these data from the RWS website and save in CSV format. 1. Open your browser and go to; https: //waterinfo. rws. nl/#!/kaart/waterhoogte-t-o-v-nap/ 2. Select to see the ‘Waterhoogte (t. o. v. NAP)’ data for ‘Hoek van Holland’ 3. Press on the button ‘Meer details’ 05 December 2020
Exercise 7 -2: Import Level and Flow data 4. Press on the button ‘Meer details’ 5. Show data for ’ 28 dagen terug’ and press the ‘Export/Delen’ button 6. Store the data as CSV file in the folder called “ImportCSVLevel” 7. Open the File ‘NVT_WATHTE_HOEK. csv’in a Text editor and analyse the format 8. It is a CSV file with columns for date, time, parameter, location and Value that can be imported with the Delft-FEWS general. CSV import function 05 December 2020
Exercise 7 -2: Import Level and Flow data 9. Copy the files from folder Exercise 7 -2Config to the correct FEWS config folders 10. Copy the data (csv-files) from the ftp to the “ImportCSVLevel” folder 11. Open the file Module. Config. FilesImport_Station. xml in an editor 12. Try to understand the general section of the Import module instance • ID Mapping • Unit mapping 05 December 2020
Exercise 7 -2: Import Level and Flow data 12. Save the edited files and restart the FEWS-Basic application or press F 5 13. Run the ‘Import Dutch observations’ workflow from the Forecast Tree 14. Open the Data Viewer and select location Hoek van Holland with observed water levels 15. Select the Data Display Tab from the FEWS Explorer to show the imported data 05 December 2020
Exercise 7 -3: Import Level and Flow data In this exercise we will import Water level and Flow data for locations Lobith from the same Website (Again skip the grey parts, get the data from the ftp or the exercise answers) 1. Open your browser and go to; https: //waterinfo. rws. nl/#!/kaart/waterhoogte-t-o-v-nap/ 2. Select ‘Waterhoogte (t. o. v. NAP)’ (water level) data for ‘Lobith’ and export 28 days of CSV data 3. Select ‘Waterafvoer’ (discharge) data for ‘Lobith’ and export 28 days of CSV data 4. Copy the data to the folders: “ImportCSVLevel” and “ImportCSVFlow” 5. Copy the files from folder Exercise 7 -3Config to the correct FEWS config folders 6. Save the edited files and restart the FEWS-Basic application or press F 5 7. Run the ‘Import Dutch observations’ workflow from the Forecast Tree 8. Open the Data Viewer and select location Lobith with observed water levels and Discharges 9. Why are the discharges not imported? (answer see next slide) 05 December 2020
Exercise 7 -3: Import Level and Flow data 1. Why are the discharges not imported? 2. Value format is not correct; uses ‘, ’ for thousand separator 3. 4. 5. 6. Copy the same file again in the Import folder (copy from Import. Backup folder) Open Manual Forecast Display and select the ‘Import external Scalar data’ workflow Press F 12 to open the debug options and select to log debug messages. Run the workflow and open the log panel 05 December 2020
Exercise 8: FEWS Explorer Tasks In this exercise we will add a new display the FEWS Explore Tabs 1. Open the System. Config. FilesExplorer. xml file in an editor 2. Go the explorer. Tasks elements and select the ‘Config Metadata’ task 3. Set the option toolbar. Task to true 4. Set the option load. At. Startup to true 5. Save the edited file and restart the FEWS-Basic application or press F 5 6. Select the Data Viewer and select location De Bilt 7. Open the Config Metadata tab and check the information in the display (or click ) 8. This display is very useful when changing the configuration of a FEWS Application 05 December 2020
Exercise 9: Spatial Display In this exercise we will add the Temperature GFS series to the Spatial Display 1. Open the Display. Config. FilesSpatial. Display. xml file in an editor 2. Go the grid. Plot. Group with id GFS 3. Add a new grid. Plot for the GFS temperature time series that is imported in exercise 7. 1 4. Save the edited file and restart the FEWS-Basic application or press F 5 5. Select the Spatial Data display and show the temperature time series 05 December 2020
Exercise 10: Spatial Interpolations In this exercise we will cut a part out of the GPM World grid for Europe and store this as a new GRID in the database 1. Open the Region. Config. FilesGrids. xml file in an editor 2. Change the properties of the IMERG grid to the following 3. Open the Region. Config. FilesModule. Instance. Descriptors. xml file in an editor 4. Add a new module instance Meteo_Preprocess_GPM 05 December 2020
Exercise 10: Spatial Interpolations 5. Open the Display. Config. FilesSpatial. Display. xml file in an editor 6. Add a new grid. Plot for GPM Mediterranean with location IMERG 7. Save the edited file and restart the FEWS-Basic application or press F 5 8. Select the Spatial Data display and show the new GPM time series 9. Enable the Grid Lines option in the Toolbar to check if the new grid is correct 05 December 2020
Exercise 10: Spatial Interpolations 10. Open the Workflow. FilesImport_Earth. Observation. xml file in an editor 11. Add a new activity Meteo_Preprocess_GPM 12. Copy the Meteo_Preprocess_GPM. xml config file from the Exercise answers to the Module. Config. FilesProcess folder (create the folder first) 13. Open the Module. Config. FilesProcessMeteo_Preprocess_GPM. xml file and check the contents 14. Save the edited file and restart the FEWS-Basic application or press F 5 15. Run the ‘Import earth observations workflow from the forecast tree 16. Select the Spatial Data display and show the precipitation time series 05 December 2020
Exercise 10: Spatial Interpolations 17. Open the Database lister and check the size of the new GPM time series for the smaller grid. 18. What is the disk space size of the Europe grid compared with the world grid? 05 December 2020
Exercise 11: CMEMS Data In this exercise you will import the 2 D CMEMS data. We will import the data for Mediterranean sea and store them as a new GRID in the database. 1. Open the Region. Config. FilesGrids. xml file in an editor 2. Create a new grid for the extend of the Mediterranean sea. 3. Register the CMEMS 2 D grid to Delft-FEWS a) Open the ConfigRegion. Config. FilesLocations. xml in editor b) Create a new Location. Id in Locations. xml file using the SAME Location. Id that was used in the step before. The Location. Id of the location must be unique. 05 December 2020
Exercise 11: CMEMS Data 4. The workflow file is called: Import_CMEMS_2 D. xml 5. The Module. Instance file is called: Import_CMEMS_2 D. xml 6. Add these to the moduleinstancedescriptors and workflowdescriptors: 7. Copy the Topology. xml from the Exercise Answers into your own config a) Have a look at the topology. xml. What has been changed? 05 December 2020
Exercise 11: CMEMS Data 8. Copy the Spatial. Display from the Exercise Answers into your own config. 9. Refresh the client and run the workflow from the Forecast Tree: 05 December 2020
Exercise 12: CMEMS Data 3 D In this exercise you will import the 3 D CMEMS data. The 3 D data is much bigger and therefore, we will import the data for a part of the Thracian sea only. 1. Create a new grid for the extend of the Thracian sea. 2. Create a new location for the grid you just specified (in Locations. xml) 3. Open the CMEMS_layers. csv in Exercise answersExercise 12Map. Layer. Files 1. Inspect the content 2. Copy to your config (into the Map. Layer. Files folder) 05 December 2020
Exercise 12: CMEMS Data 3 D 4. Create a new Location. Set using the new grid (CMEMS_2 D_thracian) as parent. Location. Id and the CMEMS_layers. csv as input. 5. The workflow file is called: Import_CMEMS_3 D_Thracian. xml 6. The Module. Instance file is called: Import_CMEMS_3 D_thracian. xml 7. Add these to the workflowdescriptors and moduleinstancedescriptors: 05 December 2020
Exercise 12: CMEMS Data 3 D 8. Copy the Topology. xml from the Exercise Answers into your own config 1. Have a look at the topology. xml. What has been changed? 9. Copy the Spatial. Display from the Exercise Answers into your own config. 10. Refresh the client and run the workflow from the Forecast Tree: 05 December 2020
Exercise 13: Spatial Interpolations Do the same exercise as Exercise 10, this time add a new grid for your country • Do not forget to add a new GRID location in the locations. xml file • Add the Grid geometry in the grids. xml • Add a new spatial interpolation function to the existing GMP processing module instance (not required to register this module instance anymore) • Not required to add the processing module instance to the Import workflow • Add a new grid. Plot to the Spatial display. • Add a new zoom extent for your country. Exercise 14 • Do the same for the GFS forecast series. This time, also add a new module instance to do the Spatial interpolations. 05 December 2020
- Slides: 32