Skip to main content
SpringerLink
Log in

From Lesson Learned to the Refactoring of the DRIHM Science Gateway for Hydro-meteorological Research

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

A full hydro-meteorological (HM) simulation, from rainfall to impact on urban areas, is a multidisciplinary activity which consists in the execution of a workflow composed by complex and heterogeneous model engines. Moreover an extensive set of configuration parameters have to be selected consistently among the models, otherwise the simulation can fail or produce unreliable results. The DRIHM portal is a Web-based science gateway aiming to support HM researchers in designing, executing and managing HM simulations. The first version of the portal was developed during the DRIHM project using the gUSE science gateway toolkit. The lesson we learned is guiding a refactoring process that, together with a review of the most relevant technologies for the development of a science gateway, represent the focus of this paper. Beside the technological aspects, the need of a strong interplay between ICT and other domain-specific communities clearly emerged, together with coherent policies in the management of data, computational resources and software components that represent the ecosystem of a science gateways.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Seneviratne S.I., Nicholls N., Easterling D., et al.: Changes in climate extremes and their impacts on the natural physical environment. In: Managing the Risks of Extreme Events and Disasters to Advance Climate Change Adaptation, Special Report of the Intergovernmental Panel on Climate Change, pp. 109–230 (2012)

  2. Pappenberger, F., Thielen, J., Del Medico, M.: The impact of weather forecast improvements on large scale hydrology: analysing a decade of forecasts of the european flood alert system. Hydrol. Process. 25(7), 1091–1113 (2011)

    Article  Google Scholar 

  3. Theurich, G., Deluca, C., Campbell, T., et al.: The Earth System Prediction Suite: Toward a Coordinated U.S. Modeling Capability. Bulletin of the American Meteorological Society, in press

  4. Kacsuk, P., Farkas, Z., Kozlovszky, M., Hermann, G., Balasko, Á., Karóczkai, K., Márton, I.: Ws-pgrade/guse generic dci gateway framework for a large variety of user communities. J. Grid Comput. 10, 601–630 (2012)

    Article  Google Scholar 

  5. D’Agostino, D., Danovaro, E., Clematis, A., Roverelli, L., Zereik, G., Parodi, A., Galizia, A.: Lessons learned implementing a science gateway for hydro-meteorological research. Concurrency and Computation: Practice and Experience; Article first published online : 20 SEP 2015. doi:10.1002/cpe.3700

  6. D’Agostino, D., Clematis, A., Galizia, A., et al.: The DRIHM Project: A Flexible Approach to Integrate HPC, Grid and Cloud Resources for Hydro-Meteorological Research. Proceedings of the International Conference For High Performance Computing, Networking, Storage and Analysis 2014 (SC14), 536–546 (2014)

  7. Danovaro, E., Roverelli, L., et al.: Setup an hydro-meteo experiment in minutes: the DRIHM e-infrastructure for hydro-meteorology research. Proceedings of the International Conference on e-Science (e-Science), 47–54 (2014)

  8. Hally, A., Caumont, O., Garrote, L., et al.: Hydrometeorological multi-model ensemble simulations of the 4 November 2011 flash-flood event in Genoa, Italy, in the framework of the DRIHM project. Nat. Hazards Earth Syst. Sci. 15(3), 537–555 (2015)

    Article  Google Scholar 

  9. Hill, C., DeLuca, C., Balaji, V., Suarez, M., Da Silva, A.: Architecture of the earth system modeling framework. Comput. Sci. Eng. 6(1), 18–28 (2004)

    Article  Google Scholar 

  10. Kruger, J., Grunzke, R., Gesing, S., Breuers, S., Brinkmann, A., De la Garza, L., Kohlbacher, O., Kruse, M., Nagel, W.E., Packschies, L., Mller-Pfefferkorn, R., Schafer, P., Scharfe, C., Steinke, T., Schlemmer, T., Warzecha, K.D., Zink, A., Herres-Pawlis, S.: The MoSGrid science gateway ? a complete solution for molecular simulations. J. Chem. Theory Comput. 10(6), 2232–2245 (2014)

    Article  Google Scholar 

  11. Goff, S.A., et al.: The iPlant collaborative: cyberinfrastructure for plant biology. Front. Plant Sci. 2 (2011)

  12. Becciani, U., Sciacca, E., Costa, A., Massimino, P., Pistagna, C., Riggi, S., Vitello, F., Petta, C., Bandieramonte, M., Krokos, M.: Science gateway technologies for the astrophysics community. Concurr. Computat. Pract. Exper. 27, 306–327 (2015). doi:10.1002/cpe.3255

    Article  Google Scholar 

  13. Lawrence, K., Zentner, M., Wilkins-Diehr, N., Wernert, J., Pierce, M., Marru, S., Michael, S.: Science gateways today and tomorrow: positive perspectives of nearly 5,000 members of the research community. Concurr. Comput. Pract. Exper. 27(16), 4252–4268 (2015)

    Article  Google Scholar 

  14. Pierce, M.E., Marru, S., Gunathilake, L., Wijeratne, D.K., Singh, R., Wimalasena, C., Ratnayaka, S., Pamidighantam, S.: Apache Airavata: design and directions of a science gateway framework. Concurr. Computat. Pract. Exper. 27, 4282–4291 (2015)

    Article  Google Scholar 

  15. Dziubecki, P., Grabowski, P., Krysiński, M., Kuczyński, T., Kurowski, K., Szejnfeld, D.: Easy development and integration of science gateways with vine toolkit. J. Grid Comput. 10(4), 631–645 (2012)

    Article  Google Scholar 

  16. Dooley, R., et al.: Software-as-a-Service: The iPlant Foundation API, 5th IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS). IEEE (2012)

  17. McLennan, M., Kennell, R.: HUBzero: a platform for dissemination and collaboration in computational science and engineering. Comput. Sci. Eng. 12(2), 48–52 (2010)

    Article  Google Scholar 

  18. SAGA: A Standardized Access Layer to Heterogeneous Distributed Computing Infrastructure Andre Merzky, Ole Weidner, Shantenu Jha Software-X, 2015 doi:10.1016/j.softx.2015.03.001

  19. Aiftimiei, C., Aimar, A., Ceccanti, A., Cecchi, M., Di Meglio, A., Estrella, F., Fuhrmam, P., Giorgio, E., Konya, B., Field, L., Nilsen, J.K., Riedel, M., White, J.: Towards next generations of software for distributed infrastructures: The European Middleware Initiative. IEEE 8th International Conference on E-Science (e-Science), 1–10 (2012). doi:10.1109/eScience.2012.6404415

  20. EMI Roadmap and DCI Collaborations, Deliverable EMI-NA1-D1.4, 2010, http://cdsweb.cern.ch/record/1277542

  21. Terstyanszky, G., Kukla, T., Kiss, T., Kacsuk, P., Balasko, A., Farkas, Z.: Enabling scientific workflow sharing through coarse-grained interoperability. Future Gener. Comput. Syst. 37, 46–59 (2014). ISSN 0167-739X, doi:10.1016/j.future.2014.02.016

    Article  Google Scholar 

  22. Hajnal, A., Marton, I., Farkas, Z., Kacsuk, P.: Remote storage management in science gateways via data bridging. Concurr. Comput. Pract. Exper. 27(16), 4398–4411 (2015)

    Article  Google Scholar 

  23. Krasner, G.E., Pope, S.T.: A cookbook for using the model-view controller user interface paradigm in smalltalk-80. J. Object Oriented Program. 1(3), 26–49 (1988). SIGS Publications

    Google Scholar 

  24. Position Paper: European Open Science Cloud for Research. doi:10.5281/zenodo.32915

  25. Beck, K., et al.: Manifesto for Agile Software Development. [Online] 2001. http://agilemanifesto.org

Download references

Author information

Authors and Affiliations

  1. Institute for Applied Mathematics and Information Technologies, National Research Council of Italy, Via de Marini 6, 16149, Genoa, Italy

    Daniele D’Agostino, Emanuele Danovaro, Andrea Clematis, Luca Roverelli, Gabriele Zereik & Antonella Galizia

Authors
  1. Daniele D’Agostino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emanuele Danovaro
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andrea Clematis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luca Roverelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gabriele Zereik
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Antonella Galizia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emanuele Danovaro.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

D’Agostino, D., Danovaro, E., Clematis, A. et al. From Lesson Learned to the Refactoring of the DRIHM Science Gateway for Hydro-meteorological Research. J Grid Computing 14, 575–588 (2016). https://doi.org/10.1007/s10723-016-9377-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-016-9377-8

Keywords

Search

Navigation