The DRIHM Portal: architecture, design principles and issues. Coordinating person: Eng. Antonio Parodi, PhD Daniele D Agostino (CNR-IMATI)
2
Terminology Grid Application Developer Develops a grid application with guse Exports it to the local repository of guse Grid Portal Developer Develops an interface (in general a portlet) that fits to the application I/O pattern and the end users needs and associate it with the role Connects the GUI to guse using the programming API of Application Specific Module(ASM) End Users, Scientists execute a copy of the exported application with custom input parameters
DRIHM DCI Ideal Architecture Model SW and Static data WPS and critical case data repository Complex run for meteo models HMR Linux-based Models Other data sources Citizen Scientists and proprietary software Testbed HMR Windows Models
3.6.2
The DRIHMIFICATION process 6
The Binary Repository 7
A DRIHM Model Chain WPS Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Bridge Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage
WPS The Preprocessing of Meteorological Input data Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage 9
Meteorological Data Our meteo models are nested in global models which usually run by the main weather forecasting centres like ECMWF or NOAA NOAA databases are accessible for free, not the ECMWF ones For the purpose of the project activities, it was agreed, during an informal meeting at EGU2013, that the initial and boundary conditions files of a limited number of cases can be freely shared on the DDCI In every cases WPS extract from these large databases only the data that will be used for the simulation 10
What happens on the DDCI
The Meteorological model execution WPS Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Bridge Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage
OR
WPS-WRF In SHIWA 14
The portlet needs to change start.sh $modelname $jobid 15
WRF Job Downloaded from the Binary Repository Created by our portlet 16
Otherwise But our approach allows the integrated definition of the whole experiment (Metadata validity check) 17
One model one portlet 18
Wish list 1 myproxy-init -s myproxy.cnaf.infn.it -p 7512 -l dagostino -m drihm.eu -t 20 It will be supported in a future version 19
The hydrological model execution Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Small Scale Meteorological WRF-NMM RainFARM * Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic Impact TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW forecasting is a numerical prediction method that is used to attempt to generate a representative sample of the possible future states. Multiple numerical predictions are conducted using slightly different initial conditions. Property Damage 20
Other data sources
The Hydraulic-Impact models execution Large Scale Meteorological WRF-NMM COSMO-Model Arome EPS Meso-NH Small Scale Meteorological WRF-NMM RainFARM Measured Rainfall Hydrologic HBV HYPROM 2D DRiFt RIBS Hydraulic TELEMAC-2D HYPROM 1D SOBEK-FLOW Delft3D-FLOW Impact Property Damage
guse is already connected to many cloud types, and the rocci interface of FedCloud will be supported in a future version 23
If-Then-Else We try to reduce the number of workflows by exploiting this feature 24
Wish List 2 It will be supported in a future version 25
Other aspects
One final (probably stupid) question Meteo It produced 100 GB of data Scheduled on PRACE or Grid? Hydro Possible ensemble simulation Scheduled on Grid 27
Which is the best solution? Meteo Out Out Meteo Out Direct link in a future version via Data Avenue but via portal so far Something.txt SE Downloaded via script In Hydro In Hydro 28