Skip to main content

The Gridkit Distributed Resource Management Framework

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3470))

Abstract

Traditionally, distributed resource management/ scheduling systems for the Grid (e.g. Globus/ GRAM/ Condor-G) have tended to deal with coarsegrained and concrete resource types (e.g. compute nodes and disks), to be statically configured and non-extensible, and to be non-adaptive at runtime. In this paper, we present a new resource management framework that tries to overcome these limitations. The framework, which is part of our ‘Gridkit’ middleware platform, uniformly accommodates an extensible set of resource types that may be both fine-grained (such as threads and TCP/IP connections), and abstract (i.e. represent application-level concepts such as matrix containers). In addition, it is highly configurable and extensible in terms of pluggable strategies, and supports flexible runtime adaptation to fluctuating application demand and resource availability. As a key contribution, the notion of tasks enables resource requirements to be expressed orthogonally to the structure of the application, allowing intuitive application-level QoS/ resource specification, highly flexible mappings of applications to available distributed infrastructures, and also facilitates autonomic adaptation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Blair, L., Blair, G.S., Andersen, A., Coulson, G., Sanchez Ganedo, D.: Supporting Dynamic QoS Management Functions in a Reflective Middleware Platform. IEE Proceedings Software 147(1), 13–21 (2000)

    Article  Google Scholar 

  2. Blair, G.S., Coulson, G., Andersen, A., Blair, L., Clarke, M., Costa, F., Duran-Limon, H., Fitzpatrick, T., Johnston, L., Moreira, R., Parlavantzas, N., Saikoski, K.: The Design and Implementation of OpenORB v2. IEEE DS Online, Special Issue on Reflective Middleware 2(6) (2001)

    Google Scholar 

  3. Brooke, J.M., Coveney, P.V., Harting, J., Jha, S., Pickles, S.M., Pinning, R.L., Porter, A.R.: Computational Steering in RealityGrid. In: Proc. UK e-Science All Hands Meeting (2003), http://www.nesc.ac.uk/events/ahm2003/AHMCD

  4. Chatterjee, S., Sabata, B., Brown, M.: Adaptive QoS Support for Distributed, Java-based Application. In: Proceedings of the IEEE International Symposium on Object-Oriented Real-Time Distributed Computing (ISORK), St-Malo, France (1999)

    Google Scholar 

  5. Cicerre, F., Madeira, E., Buzato, L.: A Hierarchical Process Execution Support for Grid Computing. In: 2nd Intl. Workshop on Middleware for Grid Computing, Toronto, Canada (October 2004)

    Google Scholar 

  6. Clark, M., Blair, G.S., Coulson, G., Parlavantzas, N.: An Efficient Component Model for the Construction of Adaptive Middleware. In: Proc. IFIP Middleware 2001, Heidelberg, Germany (November 2001)

    Google Scholar 

  7. Duran-Limon, H., Blair, G.S.: Reconfiguration of Resources in Middleware. In: 7th IEEE International Symposium on Object-oriented Real-time Dependable Systems (WORDS 2002), San Diego, CA (January 2002)

    Google Scholar 

  8. Frey, J., Tanenbaum, T., Livny, M., Foster, I., Tuecke, S.: Condor-G: A Computation Management Agent for Multi-Instructional Grids. Cluster Computing 5, 237–246 (2001)

    Article  Google Scholar 

  9. Furmento, N., Mayer, A., McGough, S., Newhouse, S., Field, T., Darlington, J.: ICENI: Optimisation of Component Applications within a Grid Environment. Parallel Computing 28(12), 1753–1772 (2002)

    Article  MATH  Google Scholar 

  10. The Globus Project, “Resource Management: The Globus Perspective”, presentation at GlobusWorld 2003 (2003), available at, http://www.globus.org/

  11. Grace, P., Coulson, G., Blair, G., Mathy, L., Yeung, W.K., Cai, W., Duce, D., Cooper, C.: GRIDKIT: Pluggable Overlay Networks for Grid Computing. To appear in Proc. Distributed Objects and Applications (DOA 2004) (June 2004)

    Google Scholar 

  12. Huang, J., Wang, Y., Cao, F.: On Developing Distributed Middleware Service for QoS- and Criticality-Based Resource Negotiation and Adaptation. Special issue on Operating Systems and Services, Journal of Real-Time Systems (1998)

    Google Scholar 

  13. Kumar, R., Talwar, V., Basu, S.: A Resource Management Framework For Interactive Grids. In: 1st Intl. Workshop on Middleware for Grid Computing, Rio de Janeiro, Brazil (June 2003)

    Google Scholar 

  14. Pallickara, S., Fox, G.: NaradaBrokering: A Distributed Middleware Framework and Architecture for Enabling Durable Peer-to-Peer Grids. In: Endler, M., Schmidt, D.C. (eds.) Middleware 2003. LNCS, vol. 2672. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  15. Parlavantzas, N., Coulson, G., Blair, G.S.: An Extensible Binding Framework for Component-Based Middleware. In: Proc. Enterprise Distributed Object Computing Conference (EDOC 2003), Brisbane, Australia (September 2003)

    Google Scholar 

  16. Szyperski, C.: Component Software: Beyond Object-Oriented Programming. Addison-Wesley, Reading (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cai, W., Coulson, G., Grace, P., Blair, G., Mathy, L., Yeung, WK. (2005). The Gridkit Distributed Resource Management Framework. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds) Advances in Grid Computing - EGC 2005. EGC 2005. Lecture Notes in Computer Science, vol 3470. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11508380_80

Download citation

  • DOI: https://doi.org/10.1007/11508380_80

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-26918-2

  • Online ISBN: 978-3-540-32036-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics