DRIHM Workflow Engine and Job Submission Framework Coordinating

DRIHM Workflow Engine and Job Submission Framework Coordinating person: Eng. Antonio Parodi, Ph. D EGI-DRIHM kick-off meeting E. Danovaro – IMATI CNR 1

DRIHM Workflow – Applications 1/2 • Meteo models (computationally intensive) – WRF-ARF – WRF-NMM – Meso-NH • Stochastic ensemble (light but ensemble) – Rain. FARM • Hydro models (moderate load but ensemble) – RIBS – HBV – Drift 2

DRIHM Workflow – Applications 2/2 • Hydraulic models (. net / windows / linux) – – 1 D Flow Model (MASCARET) 2 D Flood Spreading SOBEK-Flow Delft 3 D-Flow • Impact models (. net / windows) – Property damage 3

DRIHM workflow • Workflow topology is fixed • User can select (a subset of) the nodes • User can select the applications Meteo • WRF-ARW • WRF-NMM • Meso-NH Stochastic ensemble • Rain. FARM Hydro • RIBS • HBV • Drift Hydraulic Impact • MASCARET • Property damage • SOBEK-Flow • Delft 3 D-Flow • TELEMAC-2 D 4

Workflow engine • Based on SCI-BUS (WS-PGRADE) • Workflow not user-editable • Workflow configuration shielded by ad-hoc portlet: – One for composing the framework – One for each application, for setting parameters 5

Job types • Meteo simulations – Large on PRACE resources – Average/small on egi resources • Rain. FARM and Hydro on egi resources • . net/windows jobs on Windows VM with Worker Nodes on Demands Service (WNo. De. S) 6

Job submission • Based on SCI-BUS (WS-PGRADE) • Job submission shielded by ad-hoc portlet • Currently under development will depend on the available grid middleware and/or scheduling tools 7