Skip to main content
Springer Nature Link
Log in

Solving the Interoperability Problem by Means of a Bus

An Experience on the Integration of Grid, Cluster and Cloud Infrastructures

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

In the last years, many institutions have provided themselves with cluster and Grid infrastructures either for intensive computation or research objectives. Each infrastructure having its own and different management operating software, the integration of different platforms becomes a hard and complicated task. Solving the interoperability problem for a set of different computing infrastructures belonging to our institution in order to solve a computation intensive problem was our objective. The paper describes the solution that was applied and the experimental results obtained. The solution uses a platform based on a central bus shared by the involved system components for information exchange. In order to ensure that all computations will succeed, the solution includes cloud infrastructures to deal with situations in which the local computing resources pose some problems. Also a cloud based solution for the bus deployment is explored and empirically compared with a local deployment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Adzigogov, L., Soldatos, J., Polymenakos, L.: EMPEROR: an OGSA Grid meta-scheduler based on dynamic resource predictions. J. Grid Computing 3(1–2), 19–37 (2005). doi:10.1007/s10723-005-9001-9

    Article  Google Scholar 

  2. Altunay, M., Avery, P., Blackburn, K., Bockelman, B., Ernst, M., Fraser, D., Quick, R., Gardner, R., Goasguen, S., Levshina, T., Livny, M., McGee, J., Olson, D., Pordes, R., Potekhin, M., Rana, A., Roy, A., Sehgal, C., Sfiligoi, I., Wuerthwein, F.: A science driven production cyberinfrastructure—the open science Grid. J. Grid Computing 9, 201–218 (2011). doi:10.1007/s10723-010-9176-6

    Article  Google Scholar 

  3. Amazon Elastic Compute Cloud (Amazon EC2): http://aws.amazon.com/ec2/ (2013). Accessed 15 Apr 2013

  4. Amazon Simple Queue Service (Amazon SQS): http://aws.amazon.com/sqs/ (2013). Accessed 15 Apr 2013

  5. Amazon Simple Storage Service (Amazon S3): http://aws.amazon.com/s3/ (2013). Accessed 15 Apr 2013

  6. Amazon Web Services: http://aws.amazon.com (2013). Accessed 15 Apr 2013

  7. Anjomshoaa, A., Brisard, F., Drescher, M., Fellows, D., Ly, A., Mcgough, S., Pulsipher, D., Savva, A.: Job Submission Description Language (JSDL) Specification, Version 1.0. Tech. rep., Global Grid Forum (2005)

  8. Aragón Institute of Engineering Research (I3A): http://i3a.unizar.es (2013). Accessed 15 Apr 2013

  9. Aragón Technology Institute (ITA): http://www.ita.es/ita/ (2013). Accessed 15 Apr 2013

  10. AraGrid: http://www.aragrid.es/ (2013). Accessed 15 Apr 2013

  11. Birkenheuer, G., Brinkmann, A., Hogqvist, M., Papaspyrou, A., Schott, B., Sommerfeld, D., Ziegler, W.: Infrastructure federation through virtualized delegation of resources and services. J. Grid Computing 9, 355–377 (2011). doi:10.1007/s10723-011-9192-1

    Article  Google Scholar 

  12. Boley, H., Athan, T., Paschke, A., Tabet, S., Grosof, B., Bassiliades, N., Governatori, G., Olken, F., David, H.: Rule Markup Language, RuleML Specification. Version 1.0. (2011)

  13. Burstein, M., Bussler, C., Finin, T., Huhns, M., Paoucci, M., Sheth, A., Williams, S., Zaremba, M.: A semantic Web services architecture. IEEE Internet Comput. 9(5), 52–61 (2005)

    Article  Google Scholar 

  14. Cappello, F., Djilali, S., Fedak, G., Herault, T., Magniette, F., Néri, V., Lodygensky, O.: Computing on large-scale distributed systems: Xtremweb architecture, programming models, security, tests and convergence with Grid. Futur. Gener. Comput. Syst. 21(3), 417–437 (2005). doi:10.1016/j.future.2004.04.011

    Article  Google Scholar 

  15. Carriero, N., Gelernter, D.: Linda in context. Commun. ACM 32(4), 444–458 (1989). doi:10.1145/63334.63337

    Article  Google Scholar 

  16. Deelman, E., Singh, G., Su, M.H., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Berriman, G.B., Good, J., Laity, A., Jacob, J.C., Katz, D.S.: Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci. Program. 13(3), 219–237 (2005)

    Google Scholar 

  17. European Grid Initiative (EGI): http://www.egi.eu/ (2013). Accessed 15 Apr 2013

  18. Fabra, J., Álvarez, P., Bañares, J.A., Ezpeleta, J.: RLinda: a Petri net based implementation of the Linda coordination paradigm for Web services interactions. In: Proceedings of the 7th International Conference E-Commerce and Web Technologies, EC-Web ’06, pp. 183–192 (2006)

  19. Fabra, J., Álvarez, P., Ezpeleta, J.: DRLinda: a distributed message broker for collaborative interactions among business processes. In: Proceedings of the 8th International Conference E-Commerce and Web Technologies, EC-Web ’07, pp. 212–221 (2007)

  20. Fabra, J., Hernández, S., Álvarez, P., Ezpeleta, J.: A framework for the flexible deployment of scientific workflows in Grid environments. In: Proceedings of the Third International Conference on Cloud Computing, GRIDs, and Virtualization, CLOUD COMPUTING ’12, pp. 1–8 (2012)

  21. Farkas, Z.: Grid interoperability based on a formal design. J. Grid Computing 9, 479–499 (2011). doi:10.1007/s10723-011-9198-8

    Article  Google Scholar 

  22. FIPA: FIPA ACL Message Structure Specification. Tech. Rep. SC00061G, Foundation for Intelligent Physical Agents (2002)

  23. Foster, I.: What is the Grid? A Three Point Checklist. GRIDToday (2002)

  24. Foster, I., Kesselman, C.: The Grid 2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers Inc., San Francisco, CA (2003)

    Google Scholar 

  25. gLite Middleware: http://glite.cern.ch/ (2013). Accessed 15 Apr 2013

  26. Hernández, S., Fabra, J., Álvarez, P., Ezpeleta, J.: A simulation-based scheduling strategy for scientific workflows. In: Proceedings of the 2nd International Conference on Simulation and Modeling Methodologies, Technologies and Applications, SIMULTECH ’12, pp. 61–70 (2012)

  27. HTCondor Middleware: http://research.cs.wisc.edu/htcondor/ (2013). Accessed 15 Apr 2013

  28. Huedo, E., Montero, R.S., Llorente, I.M.: A framework for adaptive execution in Grids. Software Pract. Exper. 34(7), 631–651 (2004). doi:10.1002/spe.584

    Article  Google Scholar 

  29. Hull, D., Wolstencroft, K., Stevens, R., Goble, C., Pocock, M.R., Li, P., Oinn, T.: Taverna: a tool for building and running workflows of services. Nucleic Acids Res. 34(Web Server issue), W729–732 (2006). doi:10.1093/nar/gkl320

    Article  Google Scholar 

  30. Institute for Biocomputation and Physics of Complex Systems (BIFI): http://bifi.es/en/ (2013). Accessed 15 Apr 2013

  31. Iosup, A., Epema, D.H.J., Tannenbaum, T., Farrellee, M., Livny, M.: Inter-operating Grids through delegated matchmaking. In: Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC ’07, pp. 13:1–13:12 (2007). doi:10.1145/1362622.1362640

  32. Kacsuk, P., Kiss, T., Sipos, G.: Solving the Grid interoperability problem by P-GRADE portal at workflow level. Futur. Gener. Comput. Syst. 24(7), 744–751 (2008). doi:10.1016/j.future.2008.02.008

    Article  Google Scholar 

  33. Kertész, A., Kacsuk, P.: GMBS: a new middleware service for making Grids interoperable. Futur. Gener. Comput. Syst. 26(4), 542–553 (2010). doi:10.1016/j.future.2009.10.007

    Article  Google Scholar 

  34. Klusáček, D., Rudová, H.: Alea 2: job scheduling simulator. In: Proceedings of the 3rd International ICST Conference on Simulation Tools and Techniques, SIMUTools ’10, pp. 61:1–61:10 (2010)

  35. Kummer, O.: Introduction to petri nets and reference nets. Sozionik Aktuell 1, 1–9 (2001)

    Google Scholar 

  36. Kummer, O., Wienberg, F., Duvigneau, M., Schumacher, J., Köhler, M., Moldt, D., Rölke, H., Valk, R.: An extensible editor and simulation engine for petri nets: renew. In: ICATPN ’04, pp. 484–493 (2004). doi:10.1007/978-3-540-27793-4_29

  37. Lama, M., Vidal, J.C., Otero-García, E., Bugarín, A., Barro, S.: Semantic linking of learning object repositories to DBpedia. Educ. Technol. Soc. 15(4), 47–61 (2012)

    Google Scholar 

  38. Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E.A., Tao, J., Zhao, Y.: Scientific workflow management and the Kepler system. Concurr. Comput.-Pract. Exp. 18(10), 1039–1065 (2006). doi:10.1002/cpe.994

    Article  Google Scholar 

  39. Marosi, A., Balaton, Z., Kacsuk, P., Drótos, D.: SZTAKI desktop Grid: adapting clusters for desktop Grids. In: Davoli, F., Meyer, N., Pugliese, R., Zappatore, S. (eds.) Remote Instrumentation and Virtual Laboratories, pp. 133–144. Springer, New York (2010)

    Chapter  Google Scholar 

  40. Myers, D.S., Bazinet, A.L., Cummings, M.P.: Expanding the Reach of Grid Computing: Combining Globus—and BOINC-Based Systems, pp. 71–85. Wiley, New York (2007). doi:10.1002/9780470191637.ch4

    Google Scholar 

  41. Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The Eucalyptus open-source cloud-computing system. In: Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID ’09, pp. 124–131 (2009). doi:10.1109/CCGRID.2009.93

  42. OpenPBS Project: http://www.mcs.anl.gov/research/projects/openpbs/ (2013). Accessed 15 Apr 2013

  43. OpenStack Open Source Cloud Computing Software: http://www.openstack.org/ (2013). Accessed 15 Apr 2013

  44. Östberg, P.O., Elmroth, E.: GJMF—a composable service-oriented Grid job management framework. Futur. Gener. Comput. Syst. 29(1), 144–157 (2013). doi:10.1016/j.future.2012.04.004

    Article  Google Scholar 

  45. Otero-García, E., Vidal, J., Lama, M.A.B., Domenech, J.: Toward enriching course content with linked data. In: Proceedings of the 2011 World Conference on Educational Multimedia, Hypermedia & Telecommunications, ED-MEDIA ’11 (2011)

  46. PireGrid: http://www.piregrid.eu/?idioma=english (2013). Accessed 15 Apr 2013

  47. Platform for Digital Content Innovation and Research of the University of Santiago de Compostela (CIDUS): http://www.usc.es/en/servizos/cidus/cidus.html (2013). Accessed 15 Apr 2013

  48. RabbitMQ: http://www.rabbitmq.com/ (2013). Accessed 15 Apr 2013

  49. Rambadt, M., Wieder, P.: UNICORE-Globus interoperability: getting the best of both worlds. In: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, HPDC ’02, pp. 422–428 (2002). doi:10.1109/HPDC.2002.1029952

  50. Resnick, S., Crane, R., Bowen, C.: Essential Windows Communication Foundation: for .NET Framework 3.5, 1st edn. Addison-Wesley Professional (2008)

  51. Riad, A.M., Hassan, A.E., Hassan, Q.F.: Design of SOA-based Grid computing with enterprise service bus. Adv. Inf. Sci. Serv. Sci. 2(1), 71–82 (2010)

    Google Scholar 

  52. Rodero, I., Corbalán, J., Badia, R.M., Labarta, J.: eNANOS Grid resource broker. In: Proceedings of the 2005 European conference on Advances in Grid Computing, EGC ’05, pp. 111–121. Springer, Berlin, Heidelberg (2005). doi:10.1007/11508380_13

    Chapter  Google Scholar 

  53. Seidel, E., Allen, G., Merzky, A., Nabrzyski, J.: GridLab—a Grid application toolkit and testbed. Futur. Gener. Comput. Syst. 18(8), 1143–1153 (2002). doi:10.1016/S0167-739X(02)00091-2

    Article  MATH  Google Scholar 

  54. The BOINC project: Open-source software for volunteer computing and Grid computing. http://boinc.berkeley.edu/ (2013). Accessed 15 Apr 2013

  55. The Ptolemy Project: http://ptolemy.berkeley.edu/ (2013). Accessed 15 Apr 2013

  56. VMWare Virtualization Software: http://www.vmware.com/ (2013). Accessed 15 Apr 2013

  57. Wu, Q., Zhu, M., Gu, Y., Brown, P., Lu, X., Lin, W., Liu, Y.: A distributed workflow management system with case study of real-life scientific applications on Grids. J. Grid Computing 10, 367–393 (2012). doi:10.1007/s10723-012-9222-7

    Article  Google Scholar 

  58. Zhao, Z., Booms, S., Belloum, A., Laat, C.d., Hertzberger, B.: VLE-WFBus: a scientific workflow bus for multi e-science domains. In: Proceedings of the Second IEEE International Conference on e-Science and Grid Computing, E-SCIENCE ’06, pp. 11–18 (2006). doi:10.1109/E-SCIENCE.2006.154

Download references

Author information

Authors and Affiliations

  1. Aragón Institute for Engineering Research (I3A), Department of Computer Science and Systems Engineering, Universidad de Zaragoza, C/ María de Luna 1, 50018, Zaragoza, Spain

    Javier Fabra, Sergio Hernández, Joaquín Ezpeleta & Pedro Álvarez

Authors
  1. Javier Fabra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sergio Hernández
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joaquín Ezpeleta
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pedro Álvarez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Javier Fabra.

Additional information

This work has been supported by the research project TIN2010-17905, granted by the Spanish Ministry of Science and Innovation, and the regional project DGA-FSE, granted by the European Regional Development Fund (ERDF).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fabra, J., Hernández, S., Ezpeleta, J. et al. Solving the Interoperability Problem by Means of a Bus. J Grid Computing 12, 41–65 (2014). https://doi.org/10.1007/s10723-013-9276-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-013-9276-1

Keywords