Skip to main content
SpringerLink
Log in

Infrastructure Federation Through Virtualized Delegation of Resources and Services

DGSI: Adding Interoperability to DCI Meta Schedulers

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Infrastructure federation is becoming an increasingly important issue for modern Distributed Computing Infrastructures (DCIs): Dynamic elasticity of quasi-static Grid environments, incorporation of special-purpose resources into commoditized Cloud infrastructures, cross-community collaboration for increasingly diverging areas of modern e-Science, and Cloud Bursting pose major challenges on the technical level for many resource and middleware providers. Especially with respect to increasing costs of operating data centers, the intelligent yet automated and secure sharing of resources is a key factor for success. With the D-Grid Scheduler Interoperability (DGSI) project within the German D-Grid Initiative, we provide a strategic technology for the automatically negotiated, SLA-secured, dynamically provisioned federation of resources and services for Grid-and Cloud-type infrastructures. This goal is achieved by complementing current DCI schedulers with the ability to federate infrastructure for the temporary leasing of resources and rechanneling of workloads. In this work, we describe the overall architecture and SLA-secured negotiation protocols within DGSI and depict an advanced mechanism for resource delegation through means of dynamically provisioned, virtualized middleware. Through this methodology, we provide the technological foundation for intelligent capacity planning and workload management in a cross-infrastructure fashion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Alef, M., Fieseler, T., Freitag, S., Garcia, A., Grimm, C., Gürich, W., Mehammed, H., Schley, L., Schneider, O., Volpato, G.: Integration of multiple middlewares on a single computing resource. Future Gener. Comput. Syst. 25(3), 268–274 (2009). doi:10.1016/j.future.2008.05.004

    Article  Google Scholar 

  2. Andreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J.: GLUE Specification v. 2.0 (2009). Grid Forum proposed recommendation GFD.147, available at http://www.ogf.org/documents/GFD.147.pdf

  3. Andrieux, A., Czajkowski, K., Dan, A., Keahey, K., Ludwig, H., Nakata, T., Pruyne, J., Rofrano, J., Tuecke, S., Xu, M.: Web Services Agreement Specification (WS-Agreement). Grid Forum proposed recommendation GFD.107, available at http://www.ogf.org/documents/GFD.107.pdf

  4. Anjomshoaa, A., Brisard, F., Drescher, M., Fellows, D., Ly, A., McGough, S., Pulsipher, D., Savva, A.: Job Submission Description Language (JSDL) Specification v1.0 (2008). Grid Forum recommendation GFD.136, available at http://www.ogf.org/documents/GFD.136.pdf

  5. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.H., Konwinski, A., Lee, G., Patterson, D.A., Rabkin, A., Stoica, I., Zaharia, M.: Above the Clouds: A Berkeley View of Cloud Computing. Tech. rep., EECS Department, University of California, Berkeley (2009)

    Google Scholar 

  6. Battré, D., Hovestadt, M., Wäldrich, O.: Lessons learned from implementing WS-Agreement. In: Wieder, P., Yahyapour, R., Ziegler, W. (eds.) Grids and Service-Oriented Architectures for Service Level Agreements, pp. 23–34. Springer US (2010). doi:10.1007/978-1-4419-7320-7_3

  7. Baur, T., Breu, R., Kálmán, T., Lindinger, T., Milbert, A., Poghosyan, G., Reiser, H., Romberg, M.: An interoperable grid information system for integrated resource monitoring based on virtual organizations. J. Grid Computing 7, 319–333 (2009). doi:10.1007/s10723-009-9134-3

    Article  Google Scholar 

  8. Bazaar: Project Website: https://www.ce-egee.org/weblog/bazaar (2010)

  9. Bolte, M., Sievers, M., Birkenheuer, G., Niehoerster, O., Brinkmann, A.: Non-intrusive virtualization management using libvirt. In: Proceedings of Design, Automation and Test in Europe (DATE). Dresden, Germany (2010)

    Google Scholar 

  10. BREIN—Business Objective Driven Reliable and Intelligent Grids for Real Business: Project Website: http://www.eu-brein.com (2010)

  11. Cornwall, L.A., Jensen, J., Kelsey, D.P., Frohner, Á., Kouřil, D., Bonnassieux, F., Nicoud, S., Lőrentey, K., Hahkala, J., Silander, M., Cecchini, R., Ciaschini, V., dell’Agnello, L., Spataro, F., O’Callaghan, D., Mulmo, O., Volpato, G.L., Groep, D., Steenbakkers, M., McNab, A.: Authentication and authorization mechanisms for multi-domain grid environments. J. Grid Computing 2, 301–311 (2004). doi:10.1007/s10723-004-8182-y

    Article  Google Scholar 

  12. England, D., Weissman, J.B.: Costs and benefits of load sharing in the computational Grid. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) Proceedings of the 10th Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science (LNCS), vol. 3277, pp. 160–175. Springer (2004)

  13. Ernemann, C., Hamscher, V., Schwiegelshohn, U., Streit, A., Yahyapour, R.: On advantages of Grid computing for parallel job scheduling. In: Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID02), pp. 39–46. IEEE Press (2002)

  14. Eucalyptus Systems: Eucalyptus. Website: http://open.eucalyptus.com/ (2010)

  15. Field, L., Laure, E., Schulz, M.: Grid deployment experiences: Grid interoperation. J. Grid Computing 7, 287–296 (2009). doi:10.1007/s10723-009-9128-1

    Article  Google Scholar 

  16. Fölling, A., Grimme, C., Lepping, J., Papaspyrou, A.: Decentralized Grid scheduling with evolutionary fuzzy systems. In: Frachtenberg, E., Schwiegelshohn, U. (eds.) Proceedings of the 14th Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science (LNCS), vol. 5798, pp. 16–36. Springer (2009)

  17. Fölling, A., Grimme, C., Lepping, J., Papaspyrou, A., Schwiegelshohn, U.: Competitive co-evolutionary learning of fuzzy systems for job exchange in computational Grids. Evol. Comput. 17(4), 545–560 (2009)

    Article  Google Scholar 

  18. Gagliardi, F., Jones, B., Grey, F., Begin, M.E., Heikkurinen, M.: Building an infrastructure for scientific Grid computing: status and goals of the EGEE project. Phil. Trans., Ser. A, Math. Phys. Eng. Sci. 363(1833), 1729–1742 (2005)

    Article  Google Scholar 

  19. GRAAP-WG—Grid Resource Allocation Agreement Protocol Working Group): Project Website: https://forge.gridforum.org/projects/graap-wg (2010)

  20. Grimme, C., Lepping, J., Papaspyrou, A.: Prospects of collaboration between compute providers by means of job interchange. In: Frachtenberg, E., Schwiegelshohn, U. (eds.) Proceedings of Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science (LNCS), vol. 4942, pp. 132–151. Springer (2007)

  21. GSA-RG—Grid Scheduling Architecture Research Group: Project Website: https://forge.gridforum.org/projects/gsa-rg (2009)

  22. Iosup, A., Epema, D.H., Tannenbaum, T., Farrellee, M., Livny, M.: Inter-operating Grids through delegated matchmaking. In: Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis (SC07). Reno, NV (2007)

    Google Scholar 

  23. Iyengar, V., Tilak, S., Lewis, M.J., Abu-Ghazaleh, N.B.: Non-uniform information dissemination for dynamic Grid resource discovery. In: NCA ’04: Proceedings of the Network Computing and Applications, Third IEEE International Symposium, pp. 97–106. IEEE Computer Society, Washington, DC (2004)

    Chapter  Google Scholar 

  24. Kota, S.R., Shekhar, C., Kokkula, A., Toshniwal, D., Kartikeyan, M.V., Joshi, R.C.: Parameterized module scheduling algorithm for reconfigurable computing systems. In: ADCOM ’07: Proceedings of the 15th International Conference on Advanced Computing and Communications, pp. 473–478. IEEE Computer Society, Washington, DC (2007)

    Chapter  Google Scholar 

  25. Kurowski, K., Nabrzyski, J., Oleksiak, A., Weglarz, J.: Scheduling jobs on the Grid—multicriteria approach. Comput Methods Sci Technol 12(2), 123–138 (2006)

    Google Scholar 

  26. Libvirt Development Team: Libvirt. Project Website: http://libvirt.org/ (2010)

  27. NextGRID SLA Schema Generalized Specification: http://www.nextgrid.org/GS/management_systems/SLA_management/NextGRID_SLA_schema.pdf (2009)

  28. Nimbus Community: Nimbus. Project Website: http://www.nimbusproject.org/ (2010)

  29. OpenNebula Community: OpenNebula:. Project Website: http://www.opennebula.org/ (2010)

  30. Parkin, M., Badia, R.M., Martrat, J.: A Comparison of SLA Use in Six of the European Commissions FP6 Projects. Tech. Rep. TR-0129, Institute on Resource Management and Scheduling, CoreGRID—Network of Excellence. URL http://www.coregrid.net/mambo/images/stories/TechnicalReports/tr-0129.pdf (2008)

  31. PHOSPHORUS—Lambda User Controlled Infrastructure For European Research:. Project Website: www.ist-phosphorus.eu (2010)

  32. Riedel, M., Terstyanszky, G.: Grid interoperability for e-research. J. Grid Computing 7, 285–286 (2009). doi:10.1007/s10723-009-9138-z

    Article  Google Scholar 

  33. Rings, T., Caryer, G., Gallop, J., Grabowski, J., Kovacikova, T., Schulz, S., Stokes-Rees, I.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Computing 7, 375–393 (2009). doi:10.1007/s10723-009-9132-5

    Article  Google Scholar 

  34. Rumpl, A., Wäldrich, O., Ziegler, W.: Extending WS-Agreement with multi-round negotiation capability. In: Grids and Service-Oriented Architectures for Service Level Agreements, CoreGRID series 13, pp. 89–103. Springer (2010). doi:10.1007/978-1-4419-7320-7_9

  35. Seidel, J., Wäldrich, O., Wieder, P., Yahyapour, R., Ziegler, W.: SLA for resource management and scheduling—a survey. In: Grid Middleware and Services: Challenges and Solutions, CoreGRID Series 8. Springer (2008)

  36. SLA@SOI—Project Website:. Project Website: http://sla-at-soi.eu (2010)

  37. SmartLM—Grid-friendly Software Licensing for Location Independent Application Execution:. Project Website: http://www.smartlm.eu (2010)

  38. SORMA—Self-Organizing ICT Resource Management:. Project Website: http://www.im.uni-karlsruhe.de/sorma (2010)

  39. Subramaniyan, R., Troxel, I., George, A.D., Smith, M.: Simulative analysis of dynamic scheduling heuristics for reconfigurable computing of parallel applications. In: Proceedings of the 2006 ACM/SIGDA 14th International Symposium on Field Programmable Gate Arrays, pp. 230–230. ACM (2006)

  40. Wäldrich, O.: WS-Agreement for JAVA (WSAG4J): Project Website: http://packcs-e0.scai.fraunhofer.de/wsag4j/

  41. IBM Web Service Level Agreements (WSLA) Project: Project Website: http://www.research.ibm.com/wsla

  42. OASIS Web Services Resource Framework (WSRF) TC: Project Website: http://www.oasis-open.org/committees/wsrf

Download references

Author information

Authors and Affiliations

  1. Paderborn Center for Parallel Computing, University of Paderborn, Paderborn, Germany

    Georg Birkenheuer & André Brinkmann

  2. Zuse Institute Berlin, Berlin, Germany

    Mikael Högqvist

  3. Technische Universität Dortmund, Dortmund, Germany

    Alexander Papaspyrou

  4. Platform Computing GmbH, Ratingen, Germany

    Bernhard Schott

  5. Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen, Göttingen, Germany

    Dietmar Sommerfeld

  6. Fraunhofer Institute SCAI, Sankt Augustin, Germany

    Wolfgang Ziegler

Authors
  1. Georg Birkenheuer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. André Brinkmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mikael Högqvist
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alexander Papaspyrou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bernhard Schott
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Dietmar Sommerfeld
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wolfgang Ziegler
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alexander Papaspyrou.

Additional information

This work is supported by the German Federal Ministry of Education and Research under project grant #01IG09009.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Birkenheuer, G., Brinkmann, A., Högqvist, M. et al. Infrastructure Federation Through Virtualized Delegation of Resources and Services. J Grid Computing 9, 355–377 (2011). https://doi.org/10.1007/s10723-011-9192-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-011-9192-1

Keywords

Search

Navigation