Skip to main content

Efficient Management of Grid Resources Using a Bi-level Decision-Making Architecture for “Processable” Bulk Data

  • Conference paper
On the Move to Meaningful Internet Systems 2007: CoopIS, DOA, ODBASE, GADA, and IS (OTM 2007)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4804))

Abstract

The problem of efficient assignment of resources to perform a given bag-of-tasks in a distributed computing environment has been extensively studied by research communities. To develop an efficient resource assignment mechanism, this paper focuses on a particular type of resource intensive tasks and presents a bi-level decision-making architecture in a grid computing environment. In the proposed architecture, the higher decision-making module has the responsibility to select a partition of resources for each of the tasks. The lower decision-making module uses Integer Linear Programming based algorithm to actually assign resources from this selected partition to a particular task from the given set of tasks. This paper analyzes the performance of the proposed architecture at various workload conditions. This architecture can be extended for other types of tasks using the concepts presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Devpura, A.: Scheduling Parallel and Single Batch Machines to Minimize Total Weighted Tardiness, Ph.D. Dissertation, Computer Science Department, Arizona State University (2003)

    Google Scholar 

  2. Sundaram, B., Chapman, B.M.: XML-Based Policy Framework for Usage Policy Management in Grids in Grid. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 194–198. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  3. Verma, D., Sahu, S., Calo, S.B., Beigi, M., Chang, I.: A Policy Service for Grid Computing. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 243–255. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  4. Downey, A.B.: Lognormal and Pareto distributions in the Internet. Computer Communications 28(7), 790–801 (2005)

    Article  Google Scholar 

  5. Ahmad, I., Majumdar, S.: Processable Bulk Data Transfers on a Grid, SCE-OS-17, Technical Report, Department of Systems and Computer Engineering, Carleton University (2005)

    Google Scholar 

  6. Ahmad, I., Majumdar, S.: Policies for Efficient Management of Grid Resources using a Bi-level Decision-making Architecture of “Processable” Bulk Data, Technical Report, Department of Systems and Computer Engineering, Carleton University (2007)

    Google Scholar 

  7. Ahmad, I., Majumdar, S.: An adaptive high performance architecture for ”processable” bulk data transfers on a grid. In: 2nd International Conference on Broadband Networks, vol. 2, pp. 1482–1491 (2005)

    Google Scholar 

  8. Bunn, J., Newman, H.: Data-intensive grids for high energy physics. In: Grid Computing: Making the Global Infrastructure a Reality, John Wiley & Sons, Inc., New York (2003)

    Google Scholar 

  9. Mathur, K., Puri, M.: A bilevel bottleneck programming problem. European Journal of Operational Research 86(2), 337–344 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  10. Yang, K., Galis, A., Todd, C.: Policy-Based Active Grid Management Architecture. In: 10th IEEE International Conference on Networks, pp. 243–248 (2002)

    Google Scholar 

  11. Yavatkar, R., Pendarakis, D., Guerin, R.: A Framework for Policy-Based Admission Control, Request for Comments 2753, IETF (2000)

    Google Scholar 

  12. Sahni, S.: Handbook of Scheduling Algorithms, Models, and Performance Analysis, Chapman & Hall Computer And Information Science Series, CRC Press LLC (2004)

    Google Scholar 

  13. Vazhkudai, S.: Enabling the co-allocation of grid data transfers. In: Grid Computing, Proceedings of Fourth International Workshop on Grid Computing, pp. 44–51 (2003)

    Google Scholar 

  14. Cheng, T., Source Huang, J., Wu, Y.: Research on the models of the distribution of files on the networks. In: International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914), pp. 108–112 (2004)

    Google Scholar 

  15. The European DataGrid Project, http://eu-datagrid.web.cern.ch

  16. Sander, V., Adamson, W., Foster, I., Alain, R.: End-to-End Provision of Policy Information for Network QoS. In: 10th IEEE International Symposium on High Performance Distributed Computing, pp. 115–126 (2001)

    Google Scholar 

  17. Candler, W., Townsley, R.: A linear two-level programming problem. Computers & Operations Research 9(1), 59–76 (1982)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Robert Meersman Zahir Tari

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ahmad, I., Majumdar, S. (2007). Efficient Management of Grid Resources Using a Bi-level Decision-Making Architecture for “Processable” Bulk Data. In: Meersman, R., Tari, Z. (eds) On the Move to Meaningful Internet Systems 2007: CoopIS, DOA, ODBASE, GADA, and IS. OTM 2007. Lecture Notes in Computer Science, vol 4804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76843-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-76843-2_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-76835-7

  • Online ISBN: 978-3-540-76843-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics