Skip to main content
SpringerLink
Log in

Web services based scheduling in OpenCF

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Cloud Computing is emerging as a new computing paradigm which aims to provide reliable, customized and QoS guaranteed dynamic computing environments for end users. The availability of these large, virtualized pools of computing resources raises the possibility of a new computing paradigm for scientific research with many advantages. For research groups, Cloud Computing provides convenient access to reliable, high-performance clusters and storage without the need to purchase and maintain sophisticated hardware. For developers, virtualization allows scientific codes to be optimized and pre-installed on machine images, facilitating control over the computational environment. In these large-scale, heterogeneous and dynamic systems, the efficient execution of parallel computations can require mappings of tasks to computing resources whose performance is both irregular (because of heterogeneity) and variable in time (because of dynamicity). This paper introduces our initial experience with Cloud Computing based on a Python implementation of our OpenCF framework. We propose to show the features provided by OpenCF using the Google Application Engine as a proof of concept.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Almeida F, Barrachina S, Blanco V, Quintana E, Santos A (2006) An open source web service based platform for heterogeneous clusters. In: International Symposium on Parallel and Distributed Processing and Application ISPA06, Sorrento, Italy

  2. Evangelinos C, Hill CN (2008) Cloud computing for parallel scientific HPC applications: feasibility of running coupled atmosphere–ocean climate models on Amazons EC2. In: First Workshop on Cloud Computing and its Applications (CCA’0), Computation Institute and the National Center for Data Mining at UIC, Chicago, USA. http://www.cca08.org

  3. Foster IT, Zhao Y, Raicu I, Lu S (2009) Cloud computing and grid computing 360-degree compared. CoRR abs/0901.0131

  4. Keahey K, Figueiredo R, Fortes J, Freeman T, Tsugawa M (2008) Science clouds: early experiences in cloud computing for scientific applications. In: First Workshop on Cloud Computing and its Applications (CCA’0), Computation Institute and the National Center for Data Mining at UIC, Chicago, USA. http://www.cca08.org

  5. Liu H, Orban D (2008) Gridbatch: Cloud computing for large-scale data-intensive batch applications. In: CCGRID, IEEE Computer Society, pp. 295–305

  6. Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, Zagorodnov D (2008) The eucalyptus open-source cloud-computing system. In: First Workshop on Cloud Computing and its Applications (CCA’0), Computation Institute and the National Center for Data Mining at UIC, Chicago, USA. http://www.cca08.org

  7. Rehr JJ, Gardner JP, Prange M, Svec L, Vila F (2009) Scientific computing in the cloud. CoRR abs/0901.0029

  8. Santos A, Almeida F, Blanco V (2007a) Lightweight web services for high performance computing. In: European Conference on Software Architecture ECSA2007. Lecture Notes in Computer Science, vol 4758. Springer-Verlag, Berlin/Heidelberg

    Google Scholar 

  9. Santos A, Almeida F, Blanco V (2007b) The OpenCF: an Open Source Computational Framework based on Web Services technologies. In: Seventh International Conference on Parallel Processing and Applied Mathematics PPAM2007, Gdansk, Poland

  10. Wang L, Tao J, Kunze M, Rattu D, Canales A (2008) The cumulus project: build a scientific cloud for a data center. In: First Workshop on Cloud Computing and its Applications (CCA’0), Computation Institute and the National Center for Data Mining at UIC, Chicago, USA. http://www.cca08.org

Download references

Author information

Authors and Affiliations

  1. Dpto. Estadística, .I.O. y Computación, Universidad de La Laguna, S/C de Tenerife, Spain

    A. Santos, F. Almeida, V. Blanco & J. C. Castillo

Authors
  1. A. Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. F. Almeida
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. V. Blanco
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. J. C. Castillo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. Santos.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Santos, A., Almeida, F., Blanco, V. et al. Web services based scheduling in OpenCF. J Supercomput 58, 168–176 (2011). https://doi.org/10.1007/s11227-009-0352-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-009-0352-z

Keywords

Search

Navigation