Skip to main content
SpringerLink
Log in

Network Bandwidth-aware job scheduling with dynamic information model for Grid resource brokers

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

A resource broker with a user-friendly interface for job submission developed on a platform constructed using the Globus toolkit is proposed. The broker employs a domain-based network information model and dynamic version to measure network statuses, and also monitors and collects resource statuses and network-related information as the basis of its brokerage. A network bandwidth-aware job scheduling algorithm for brokering suitable Grid resources to communication-intensive jobs based on improving and preserving the advantages of our previously developed network information model is also proposed. Using timely information, the resource broker effectively matches Grid resources and user requests, thus improving job execution efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aloisio G, Cafaro M (2002) Web-based access to the grid using the grid resource broker portal. Concurr Comput Pract Exp 14:1145–1160

    Article  MATH  Google Scholar 

  2. Aloisio G, Cafaro M, Carteni G, Epicoco I, Fiore S, Lezzi D, Mirto M, Mocavero S (2007) The grid resource broker portal. Concurr Comput Pract Exp 19(12):1663–1670

    Article  Google Scholar 

  3. Cafaro M, Epicoco I, Mirto M, Lezzi D, Aloisio G (2007) The grid resource broker workflow engine. In: Proceedings of international conference on grid and cooperative computing, 2007

  4. Chen XL, Yang C, Lu SL, Chen GH (2004) An active resource management system for computational grid. In: Proceedings of grid and cooperative computing. Lecture notes in computer science, vol 3251. Springer, Berlin, pp 225–232

    Google Scholar 

  5. Czajkowski K, Fitzgerald S, Foster I, Kesselman C (2001) Grid information services for distributed resource sharing. In: Proceedings of the tenth IEEE international symposium on high-performance distributed computing. IEEE Press, New York

    Google Scholar 

  6. Deelman E, Singh G, Su M, Blythe J, Gil Y, Kesselman C, Mehta G, Vahi K, Berriman GB, Good J, Laity A, Jacob JC, Katz DS (2005) Pegasus: a framework for mapping complex scientific workflows onto distributed systems. J Sci Program 13(3):219–237

    Google Scholar 

  7. Ferreira L, Berstis V, Armstrong J, Kendzierski M, Neukoetter A, Takagi Ma, Bing-Wo R, Amir A, Murakawa R, Hernandez O, Magowan J, Bieberstein N (2003) Introduction to grid computing with Globus. http://www.ibm.com/redbooks

  8. Foster I (2002) The grid: a new infrastructure for 21st century science. Phys Today 55(2):42–47

    Article  Google Scholar 

  9. Foster I, Karonis N (1998) A grid-enabled MPI: message passing in heterogeneous distributed computing systems. In: Proceedings of supercomputing conference, 1998

  10. Foster I, Kesselman C (1997) Globus: a metacomputing infrastructure toolkit. Int J Supercomput Appl 11(2):115–128

    Article  Google Scholar 

  11. Foster I, Kesselman C (2003) The grid 2: blueprint for a new computing infrastructure, 2nd edn. Morgan Kaufmann, San Mateo

    Google Scholar 

  12. Gregor L, Mike H (2005) Workflow concepts of the Java CoG kit. J grid Comput 3(3–4):239–258

    Google Scholar 

  13. Ho LY, Liu PF, Wang CM, Wu JJ (2008) The development of a drug discovery virtual screening application on Taiwan unigrid. In: Proceedings of advances in grid and pervasive computing. Lecture notes in computer science, vol 5036. Springer, Berlin, pp 38–47

    Chapter  Google Scholar 

  14. Karonis NT, Toonen B, Foster I (2003) MPICH-G2: A grid-enabled implementation of the message passing interface. J Parallel Distrib Comput 63(5):551–563

    Article  MATH  Google Scholar 

  15. Krauter K, Buyya R, Maheswaran M (2002) A taxonomy and survey of grid resource management systems for distributed computing. Softw Pract Exp 32:135–164

    Article  MATH  Google Scholar 

  16. Laszewski V, Foster I, Gawor J, Lane P (2001) A Java commodity grid kit. Concurr Comput Pract Exp 13:645–662

    Article  MATH  Google Scholar 

  17. Le H, Coddington P, Wendelborn AL (2004) A data-aware resource broker for data grids. In: Proceedings of the IFIP international conference on network and parallel computing. Lecture notes in computer science, vol 3222. Springer, Berlin, pp 442–453

    Google Scholar 

  18. Leu FY, Li MC, Lin JC, Yang CT (2008) Detection workload in a dynamic grid-based intrusion detection environment. J Parallel Distrib Comput 68:427–442

    Google Scholar 

  19. Nabrzyski J, Schopf JM, Weglarz J (2005) grid resource management. Kluwer Academic, Dordrecht

    Google Scholar 

  20. Park SM, Kim JH (2003) Chameleon: a resource scheduler in a data grid environment. In: Proceedings of the IEEE/ACM international symposium on cluster computing and the grid, 2003, pp 258-265

  21. Penchikala S (2008) Terracotta 2.6 supports cluster visualization tools and Tomcat 6 integration. http://www.infoq.com/news/2008/04/terracotta-2.6-release

  22. Rodero I, Corbalán J, Badia RM, Labarta J (2005) eNANOS grid resource broker. In: Lecture notes in computer science, vol 3470. Springer, Berlin, pp 111–121

    Google Scholar 

  23. Shah SP, He DYM, Sawkins JN, Druce JC, Quon G, Lett D, Zheng GXY, Xu T, Quellette BFF (2004) Pegasys: software for executing and integrating analyses of biological sequences. BMC Bioinform 5:40

    Article  Google Scholar 

  24. Toyama T, Yamada Y, Konishi K (2006) A resource management system for data-intensive applications in desktop grid environments. In: Parallel and distributed computing and systems. Acta Press, Calgary

    Google Scholar 

  25. Venugopal S, Buyya R, Winton L (2006) A grid service broker for scheduling e-science applications on global data grids. Concurr Comput Pract Exp 18:685–699

    Article  Google Scholar 

  26. Yang CT, Lai CL, Shih PC, Li KC (2004) A resource broker for computing nodes selection in grid environments. In: Proceedings of grid and cooperative computing: international conference. Lecture notes in computer science, vol 3251. Springer, Berlin, pp 931–934

    Google Scholar 

  27. Yang CT, Lai CL, Li KC, Hsu CH, Chu WC (2005) On utilization of the grid computing technology for video conversion and 3D rendering. In: Proceedings of parallel and distributed processing and applications: third international symposium. Lecture notes in computer science, vol 3758. Springer, Berlin, pp 442–453

    Google Scholar 

  28. Yang CT, Shih PC, Li KC (2005) A high-performance computational resource broker for grid computing environments. In: Proceedings of the international conference on AINA, vol 2, 2005, pp 333–336

  29. Yang CT, Li KC, Chiang WC, Shih PC (2005) Design and implementation of TIGER grid: an integrated metropolitan-scale grid environment. In: Proceedings of the 6th IEEE international conference on PDCAT, Dec 2005, pp 518–520

  30. Yang CT, Shih PC, Chen SY, Shih WC (2005) An efficient network information modeling using NWS for grid computing environments. In: Proceedings of international conference on grid and cooperative computing. Lecture notes in computer science, vol 3795. Springer, Berlin, pp 287–299

    Google Scholar 

  31. Yang CT, Lin CF, Chen SY (2006) A workflow-based computational resource broker with information monitoring in grids. In: Proceedings of the IEEE international conference on grid and cooperative computing, 2006, pp 199–206

  32. Yang CT, Chen TT, Chen SY (2007) Implementation of monitoring and information service using Ganglia and NWS for grid resource brokers. In: Proceedings of IEEE Asia-Pacific services computing conference, 2007, pp 356–363

  33. Yang CT, Lai KC, Shih PC (2008) Design and implementation of a workflow-based resource broker with information system on computational grids. J Supercomput. doi:10.1007/s11227-008-0201-5

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. High-Performance Computing Laboratory, Department of Computer Science and Information Engineering, Tunghai University, Taichung, 40704, Taiwan, ROC

    Chao-Tung Yang, Fang-Yie Leu & Sung-Yi Chen

Authors
  1. Chao-Tung Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fang-Yie Leu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sung-Yi Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao-Tung Yang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yang, CT., Leu, FY. & Chen, SY. Network Bandwidth-aware job scheduling with dynamic information model for Grid resource brokers. J Supercomput 52, 199–223 (2010). https://doi.org/10.1007/s11227-008-0256-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-008-0256-3

Keywords

Search

Navigation