Skip to main content

Preliminary Resource Management for Dynamic Parallel Applications in the Grid

  • Conference paper

Abstract

Dynamic parallel applications such as CFD-OG impose a new problem for distributed processing because of their dynamic resource requirements at run-time. These applications are difficult to adapt in the current distributed processing model (such as the Grid) due to a lack of interface for them to directly communicate with the runtime system and the delay of resource allocation. In this paper, we propose a novel mechanism, the Application Agent (AA) embedded between an application and the underlying conventional Grid middleware to support the dynamic resource requests on the fly. We introduce AA’s dynamic process management functionality and its resource buffer policies which efficiently store resources in advance to maintain the execution performance of the application. To this end, we introduce the implementation of AA.

The original version of this chapter was revised: The copyright line was incorrect. This has been corrected. The Erratum to this chapter is available at DOI: 10.1007/978-3-642-02080-3_28

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. N1 grid engine6 administration guide. Technical report, Sun Microsystems,Inc.

    Google Scholar 

  2. Burns, G., Daoud, R., Vaigl, J.: LAM: An Open Cluster Environment for MPI. In: Proceedings of Supercomputing Symposium, pp. 379–386 (1994)

    Google Scholar 

  3. Condor. Condor online manual version 6.5, http://www.cs.wisc.edu/condor/manual/v6.5

  4. Czajkowski, K., Foster, I.T., Kesselman, C.: Resource co-allocation in computational grids. In: HPDC (1999)

    Google Scholar 

  5. Foster, I.: Designing and Building Parallel Programs: Concepts and Tools for Parallel Software Engineering. Addison-Wesley Longman Publishing Co., Inc., Boston (1995)

    MATH  Google Scholar 

  6. Geist, A., Beguelin, A., Dongarra, J., Jiang, W., Manchek, R., Sunderam, V.S.: PVM: Parallel Virtual Machine: A Users’ Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge (1994)

    MATH  Google Scholar 

  7. Globus Alliance. Globus Toolkit, http://www.globus.org/toolkit/

  8. Goux, J.-P., Kulkarni, S., Linderoth, J., Yoder, M.: An enabling framework for master-worker applications on the computational grid. In: HPDC, pp. 43–50 (2000)

    Google Scholar 

  9. Gropp, W., Lusk, E.: Dynamic process management in an mpi setting. spdp, 530 (1995)

    Google Scholar 

  10. Idl, N.S.: The common object request broker: Architecture and specification

    Google Scholar 

  11. S. Microsystems. Jini network technology. Technical report, http://www.sun.com/software/jini/

  12. Nazir, A., Liu, H., Sørensen, S.-A.: Powerpoint presentation: Steering dynamic behaviour. In: Open Grid Forum 20, Manchester, UK (2007)

    Google Scholar 

  13. Petrone, M., Zarrelli, R.: Enabling pvm to build parallel multidomain virtual machines. In: PDP 2006: Proceedings of the 14th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, Washington, DC, USA, pp. 187–194. IEEE Computer Society Press, Los Alamitos (2006)

    Google Scholar 

  14. Pruyne, J., Livny, M.: Providing resource management services to parallel applications (1995)

    Google Scholar 

  15. Shao, G.: Adaptive scheduling of master/worker applications on distributed computational resources (2001)

    Google Scholar 

  16. Sørensen, S.-A., Bauer, B.: On the dynamics of the kofels sturzstrom. In: Geomorphology (2003)

    Google Scholar 

  17. Sorensen, S.-A., Jones, M.G.W.: The clown network simulator. In: 7th UK Computer and Telecommunications Performance Engineering Workshop, London, UK, pp. 123–130. Springer, Heidelberg (1992)

    Chapter  Google Scholar 

  18. Trac, H., Pen, U.-L.: A primer on eulerian computational fluid dynamics for astrophysics. Publications of the Astronomical Society of the Pacific 115, 303 (2003)

    Article  Google Scholar 

  19. Wolski, R., Spring, N.T., Hayes, J.: The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems 15(5–6), 757–768 (1999)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Liu, H., Nazir, A., Sørensen, SA. (2009). Preliminary Resource Management for Dynamic Parallel Applications in the Grid. In: Vicat-Blanc Primet, P., Kudoh, T., Mambretti, J. (eds) Networks for Grid Applications. GridNets 2008. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 2. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02080-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-02080-3_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-02079-7

  • Online ISBN: 978-3-642-02080-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics