Skip to main content

Advertisement

SpringerLink
Log in

Validation of Grid Middleware for the European Grid Infrastructure

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

The European Grid Infrastructure (EGI) is providing a sustainable pan–European Computing Grid to support e–Science, integrating more than 350 computing resource centers worldwide. One of its main challenges is that the middleware driving this production infrastructure is constantly evolving, as it adapts to the changing needs of the EGI Community. Since the software is provided by external technology providers, it needs to pass through a quality verification process before it is included in the EGI official release called Unified Middleware Distribution (UMD). Therefore, all software components undergo a release process covering the definition of the functionality and quality criteria, the verification of those criteria, and the testing under production environments. This paper details the design, development and implementation of this software validation process. An analysis is performed on several metrics to evaluate the process impact on the stability of the production infrastructure, by capturing malfunctions and other issues at the initial testing phases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kranzlmüller, D., Marco de Lucas, J., Öster, P.: The european grid initiative (EGI), remote instrumentation and virtual laboratories, pp 61–66. Springer (2010)

  2. Campos Plasencia, I.: EGI.eu the European grid initiative. In: 4th Iberian Grid Infrastructure Conference Proceedings, pp. 5–15 (2010)

  3. Jones, B.: An overview of the EGEE project, peer-to-peer, grid, and service-orientation in digital library architectures. LNCS 3664, 1–8 (2005)

    Google Scholar 

  4. Ferrari, T., Gaido, L.: Resources and services of the EGEE production infrastructure. J. Grid Comput. 9, 119–133 (2011)

    Article  Google Scholar 

  5. Andronico, G., et al.: e–infrastructures for e–science: a global view. J. Grid Comput. 9, 155–184 (2011)

    Article  Google Scholar 

  6. European Middleware Initiative: http://www.eu-emi.eu/. Accessed February 25, 2014

  7. Initiative for Globus in Europe: http://www.ige-project.eu/. Accessed February 25, 2014

  8. Ferrari, T. Annual report on the EGI production infrastructure, EGI-D4.5 (2012) http://documents.egi.eu/document/1059. Accessed February 25, 2014

  9. Burke, S., et al.: HEP applications and their experience with the use of datagrid middleware. J. Grid Comput. 2(4), 369–386 (2004)

    Article  MathSciNet  Google Scholar 

  10. Berger, M., Fahringer, T.: Practical experience from porting and executing the Wien2k application on the EGEE production grid infrastructure. J. Grid Comput. 8, 261–279 (2010)

    Article  Google Scholar 

  11. Fanfani, A., et al.: Distributed analysis in CMS. J. Grid Comput. 8, 159–179 (2010)

    Article  Google Scholar 

  12. Lagouvardos, K., et al.: A grid-enabled regional-scale ensemble forecasting system in the mediterranean area. J. Grid Comput. 8, 181–197 (2010)

    Article  Google Scholar 

  13. Borges, G., et al.: Fostering multi-scientific usage in the iberian production infrastructure. Comput. Inform. 31–1, 61–72 (2012)

    Google Scholar 

  14. Balaz, A., et al.: Development of grid e-Infrastructure in South-Eastern Europe. J. Grid Comput. 9, 135–154 (2011)

    Article  Google Scholar 

  15. Kalmady, R., et al.: Monitoring the availability of grid services using SAM and gridview, grid computing. Int. Symp Grid Comput (ISGC), 163–168 (2009)

  16. Altunay, M., et al.: A science driven production Cyberinfrastructurethe open science grid. J. Grid Comput. 9, 201–218 (2011)

    Article  Google Scholar 

  17. Roy A. on behalf of the OSG consortium. J. Phys. Conf. Ser. 180, 012052 (2009)

    Article  Google Scholar 

  18. Pavlo, A., et al. The NMI build and test laboratory: continuous integration framework for distributed computing software. In: Proceedings of LISA ’06: Twentieth Systems Administration Conference, pp. 263–273

  19. Beckman, P.H.: Building the TeraGrid. Phil. Trans. R. Soc. A 363, 1715–1728 (2005)

    Article  Google Scholar 

  20. Smallen, S., Olschanowski, C., Ericson, K., Bechman, P., Schopf, J.: The Inca test harness and reporting framework. In: Proceedings of the ACM/IEEE SC2004 Conference, pp. 55 (2004)

  21. Gentzsch, W., et al.: DEISA – distributed european infrastructure for supercomputing applications. J. Grid Comput. 9, 259–277 (2011)

    Article  Google Scholar 

  22. Kónya, B.: Advanced resource connector (ARC) – the grid middleware of the NorduGrid, LNCS. Recent Advances in Parallel Virtual Machine and Message Passing Interface. vol. 3241, pp. 22–45. Springer, Heidelberg (2004)

    Google Scholar 

  23. Fuhrmann, P., Gulzow, V.: dCache, storage system for the future, LNCS. Euro-Par 2006 Parallel Processing. vol. 4128, pp. 1106–1113. Springer, Heidelberg (2006)

  24. gLite – lightweight middleware for grid computing: http://glite.cern.ch/. Accessed February 25, 2014

  25. Erwin, D. W., Snelling, D. F.: UNICORE: a grid computing environment, LNCS. In: Euro-Par 2001 Parallel Processing. vol. 2150, pp. 825–834. Springer, Heidelberg (2001)

    Google Scholar 

  26. Globus: http://www.globus.org/. Accessed February 25, 2014

  27. Newhouse, S. UMD Roadmap, EGI-D5.1. http://documents.egi.eu/document/100. Accessed February 25, 2014 (2010)

  28. Schuldt, H.: Multi-tier architecture, encyclopedia of database systems, pp 1862–1865. Springer (2009)

  29. Edmonds, A., Metsch, T., Papaspyrou, A.: Open cloud computing interface in data management-related setups. Grid and Cloud Database Management, pp. 23–48 (2011)

  30. David, M., et al.: Software provisioning process for EGI. Comput. Inform. 31–1, 135–148 (2012)

    Google Scholar 

  31. Antoni, T., et al.: Sustainable support for WLCG through the EGI distributed infrastructure. J. Phys. Conf. Ser. 331, 082009 (2011)

    Article  Google Scholar 

  32. EGI.eu: Service level agreement for the provision of software and support services between EGI.eu and EMI (2011). http://documents.egi.eu/document/461 Accessed 25 Feb. 2014

  33. EGI.eu: Service level agreement between egi.eu and initiative for globus in Europe IGE, EGI Document, 442 (2011). http://documents.egi.eu/document/442. Accessed 25 Feb. 2014

  34. OpenNebula cloud framework: http://www.opennebula.org. Accessed February 25, 2014

  35. Simón, A., et al.: New deployments on EGI Verification and Staged Rollout processes. In: 6th Iberian Grid Infrastructure Conference Proceedings, pp. 3–16 (2012)

Download references

Acknowledgments

This work is partially funded by the EGI-InSPIRE (European Grid Initiative: Integrated Sustainable Pan-European Infrastructure for Researchers in Europe) is a project co-funded by the European Commission (contract number INFSO-RI-261323) as an Integrated Infrastructure Initiative within the 7th Framework Programme. EGI-InSPIRE began in May 2010 and will run for 4 years. Full information is available at: http://www.egi.eu/. Mário David and Gonçalo Borges would like to thank to the Portuguese Foundation for Science and Technology under the context of the Ciência 2007/2008 programs jointly funded by the European Social Fund and by MCTES national funds – through POPH - NSRF-Type 4.2.

Author information

Authors and Affiliations

  1. Laboratório de Instrumentação e Física Experimental de Partículas (LIP), Lisboa, Portugal

    Mário David, Gonçalo Borges, Jorge Gomes & João Pina

  2. Instituto de Física de Cantabria (CSIC), Santander, Spain

    Isabel Campos Plasencia & Enol Fernández-del-Castillo

  3. Fundación Centro de Supercomputación de Galicia (CESGA), Santiago de Compostela, Spain

    Iván Díaz, Carlos Fernandez, Esteban Freire & Álvaro Simón

  4. Greek Research and Technology Network (GRNET), Athens, Greece

    Kostas Koumantaros

  5. Stichting European Grid Infrastructure (EGI.eu), Amsterdam, The Netherlands

    Michel Dreschner, Tiziana Ferrari & Peter Solagna

Authors
  1. Mário David
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gonçalo Borges
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jorge Gomes
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. João Pina
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Isabel Campos Plasencia
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Enol Fernández-del-Castillo
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Iván Díaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Carlos Fernandez
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Esteban Freire
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Álvaro Simón
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Kostas Koumantaros
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Michel Dreschner
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Tiziana Ferrari
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Peter Solagna
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mário David.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

David, M., Borges, G., Gomes, J. et al. Validation of Grid Middleware for the European Grid Infrastructure. J Grid Computing 12, 543–558 (2014). https://doi.org/10.1007/s10723-014-9301-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-014-9301-z

Keywords

Search

Navigation