The DRIHM Portal: architecture, design principles and issues.

Transcription

1 The DRIHM Portal: architecture, design principles and issues. Coordinating person: Eng. Antonio Parodi, PhD Daniele D Agostino (CNR-IMATI)

2 2

3 Terminology Grid Application Developer Develops a grid application with guse Exports it to the local repository of guse Grid Portal Developer Develops an interface (in general a portlet) that fits to the application I/O pattern and the end users needs and associate it with the role Connects the GUI to guse using the programming API of Application Specific Module(ASM) End Users, Scientists execute a copy of the exported application with custom input parameters

4 DRIHM DCI Ideal Architecture Model SW and Static data WPS and critical case data repository Complex run for meteo models HMR Linux-based Models Other data sources Citizen Scientists and proprietary software Testbed HMR Windows Models

5 3.6.2

6 The DRIHMIFICATION process 6

7 The Binary Repository 7

8 A DRIHM Model Chain WPS Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Bridge Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage

9 WPS The Preprocessing of Meteorological Input data Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage 9

10 Meteorological Data Our meteo models are nested in global models which usually run by the main weather forecasting centres like ECMWF or NOAA NOAA databases are accessible for free, not the ECMWF ones For the purpose of the project activities, it was agreed, during an informal meeting at EGU2013, that the initial and boundary conditions files of a limited number of cases can be freely shared on the DDCI In every cases WPS extract from these large databases only the data that will be used for the simulation 10

11 What happens on the DDCI

12 The Meteorological model execution WPS Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Bridge Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage

13 OR

14 WPS-WRF In SHIWA 14

15 The portlet needs to change start.sh $modelname $jobid 15

16 WRF Job Downloaded from the Binary Repository Created by our portlet 16

17 Otherwise But our approach allows the integrated definition of the whole experiment (Metadata validity check) 17

18 One model one portlet 18

19 Wish list 1 myproxy-init -s myproxy.cnaf.infn.it -p l dagostino -m drihm.eu -t 20 It will be supported in a future version 19

20 The hydrological model execution Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Small Scale Meteorological WRF-NMM RainFARM * Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic Impact TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW forecasting is a numerical prediction method that is used to attempt to generate a representative sample of the possible future states. Multiple numerical predictions are conducted using slightly different initial conditions. Property Damage 20

21 Other data sources

22 The Hydraulic-Impact models execution Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage

23 guse is already connected to many cloud types, and the rocci interface of FedCloud will be supported in a future version 23

24 If-Then-Else We try to reduce the number of workflows by exploiting this feature 24

25 Wish List 2 It will be supported in a future version 25

26 Other aspects

27 One final (probably stupid) question Meteo It produced 100 GB of data Scheduled on PRACE or Grid? Hydro Possible ensemble simulation Scheduled on Grid 27

28 Which is the best solution? Meteo Out Out Meteo Out Direct link in a future version via Data Avenue but via portal so far Something.txt SE Downloaded via script In Hydro In Hydro 28