Skip to main content
SpringerLink
Log in

Towards Standardized Job Submission and Control in Infrastructure Clouds

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

The submission and management of computational jobs is a traditional part of utility computing environments. End users and developers of domain-specific software abstractions often have to deal with the heterogeneity of such batch processing systems. This lead to a number of application programming interface and job description standards in the past, which are implemented and established for cluster and Grid systems. With the recent rise of cloud computing as new utility computing paradigm, the standardized access to batch processing facilities operated on cloud resources becomes an important issue. Furthermore, the design of such a standard has to consider a tradeoff between feature completeness and the achievable level of interoperability. The article discusses this general challenge, and presents some existing standards with traditional cluster and Grid computing background that may be applicable to cloud environments. We present OCCI-DRMAA as one approach for standardized access to batch processing facilities hosted in a cloud.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Allen, G., Davis, K., Dolkas, K., Doulamis, N., Goodale, T., Kielmann, T., Merzky, A., Nabrzyski, J., Pukacki, J., Radke, T., Russell, M., Seidel, E., Shalf, J., Taylor, I.: Enabling applications on the Grid: a GridLab overview. Int. J. High Perform. Comput. Appl. 4, 449–466 (2003)

    Article  Google Scholar 

  2. Dillaway, B., Humphrey, M., Smith, C., Theimer, M., Wasson, G.: HPC basic profile, Version 1.0. http://www.ogf.org/documents/GFD.114.pdf (2007). Accessed Sept 2013

  3. Distributed Management Task Force (DMTF): Open virtualization format specification version 2.0.1 – DSP 0243 (2013)

  4. Edmonds, A., Metsch, T., Luster, E.: An open, interoperable cloud. http://www.infoq.com/articles/open-interoperable-cloud (2011). Accessed Sept 2013

  5. Erwin, D., Snelling, D.: UNICORE: a Grid computing environment. Lect. Notes Comput. Sci. 2150, 825 (2001)

    Article  Google Scholar 

  6. Fallside, D., Walmsley, P.: XML schema part 0: primer second edition. W3C Recommendation. World Wide Web Consortium. http://www.w3.org/TR/xmlschema-0 (2004). Accessed Sept 2013

  7. Foster, I., Grimshaw, A., Lane, P., Lee, W., Morgan, M., Newhouse, S., Pickles, S., Pulsipher, D., Smith, C., Theimer, M.: OGSA Basic Execution Service v1.0 (GFD-R.108). Open Grid Forum. http://www.ogf.org/documents/GFD.108.pdf (2008). Accessed Sept 2013

  8. Gentzsch, W., Yenier, B.: HPC experiment: round 1 – final report. http://www.hpcexperiment.com/ (2012). Accessed Sept 2013

  9. Goodale, T., Jha, S., Kaiser, H., Kielmann, T., Kleijer, P., Merzky, A., Shalf, J., Smith, C.: A simple API for Grid applications (SAGA) Version 1.1 (GFD-R-P.90). Open Grid Forum. http://www.ogf.org/documents/GFD.90.pdf (2008). Accessed Sept 2013

  10. Lee, C.: A perspective on scientific cloud computing. In: 19th ACM International Symposium on High Performance Distributed Computing, pp. 451–459. ACM, New York, NY, USA (2010)

  11. Memon, S., Yen, E., Riedel, M., Salle, M., Koeroo, O.: EMI cloud strategy. http://indico.egi.eu/indico//contributionDisplay.py?contribId=210&resId=4&confId=452. Accessed September 2013

  12. Metsch, M., Edmonds, A.: Open cloud computing interface - infrastructure. http://www.ogf.org/documents/GFD.184.pdf(2011). Accessed Sept 2013

  13. Metsch, T., Edmonds, A.: Open cloud computing interface - RESTful HTTP rendering. http://www.ogf.org/documents/GFD.185.pdf (2011)

  14. Moreau, J.-J., Ryman, A., Weerawarana, S., Chinnici, R.: Web services description language (WSDL) version 2.0 part 1: core language. World Wide Web Consortium. http://www.w3.org/TR/wsdl20 (2006). Accessed Sept 2013

  15. Nyren, R., Edmonds, A., Papaspyrou, A., Metsch, T.: Open cloud computing interface - core. http://www.ogf.org/documents/GFD.183.pdf (2011)

  16. Riedel, M., Schuller, B., Mallmann, D., Menday, R., Streit, A., Tweddell, B., Memon, M., Memon, A., Demuth, B., Lippert, T.: Web services interfaces and open standards integration into the European UNICORE 6 Grid middleware. In: Eleventh International IEEE EDOC Conference Workshop, pp. 57–60. IEEE Computer Society, Washington, DC, USA (2007)

  17. Rings, T., Caryer, G., Gallop, J., Grabowski, J., Kovacikova, T., Schulz, S., Stokes-Rees, I.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7 (2009). Special issue on Grid interoperability

  18. Snell, J., Glover, T.: Portability and interoperability: Similarities and differences explained. http://www.ibm.com/developerworks/webservices/library/ws-port/ (2003)

  19. Thain, D., Tannenbaum, T., Livny, M.: Condor and the Grid, pp. 299–336. John Wiley & Sons Inc. (2002)

  20. Tröger, P., Brobst, R., Gruber, D., Mamonski, M., Templeton, D.: Distributed resource management application API Version 2 (DRMAA). http://www.ogf.org/documents/GFD.194.pdf (2012). Accessed Sept 2013

Download references

Author information

Authors and Affiliations

  1. Hasso Plattner Institute, University of Potsdam, 14482, Potsdam, Germany

    Peter Tröger

  2. CCT, Louisiana State University, Baton Rouge, LA, 70802, USA

    Andre Merzky

Authors
  1. Peter Tröger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andre Merzky
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Peter Tröger.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tröger, P., Merzky, A. Towards Standardized Job Submission and Control in Infrastructure Clouds. J Grid Computing 12, 111–125 (2014). https://doi.org/10.1007/s10723-013-9275-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-013-9275-2

Keywords

Search

Navigation