Skip to main content
Springer Nature Link
Log in

Direction-aware resource discovery in large-scale distributed computing environments

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

As a system scales up, the peer-to-peer (P2P) approach is attractive to distributed computing environments, such as Grids and Clouds, due to the amount of resources increased. The major issue in large-scale distributed systems is to prevent the phenomenon of a communication bottleneck or a single point of failure. Conventional approaches may not be able to apply directly to such environments due to restricted queries and varied resource characteristics. Alternatively, a fully decentralized resource discovery service based on an unstructured overlay, which relies only on the information of resource attributes and characteristics, may be a feasible solution. One major challenge of such service is to locate desired and suitable resources without the global knowledge of distributed sharing resources. As a consequence, the more nodes the resource discovery service involves, the higher the network overhead incurs. In this paper, we proposed a direction-aware strategy which can alleviate the network traffic among unstructured information systems for distributed resource discovery service. Experimental results have demonstrated that the proposed approach achieves higher success rate at low cost and higher scalability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Chervenak A, Foster I, Kesselman C, Salisbury C, Tuecke S (2000) The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. J Netw Comput Appl 23(3):187–200

    Article  Google Scholar 

  2. Foster I, Kesselman C, Tuecke S (2001) The anatomy of the grid: enabling scalable virtual organizations. Int J High Perform Comput Appl 15(3):200–222

    Article  Google Scholar 

  3. Marinos A, Briscoe G (2009) Community cloud computing. In: Proceedings of the 1st international conference on cloud computing, Beijing, China, pp 472–484

    Google Scholar 

  4. Dikaiakos MD, Katsaros D, Mehra P, Pallis G, Vakali A (2009) Cloud computing: distributed Internet computing for IT and scientific research. IEEE Internet Comput 13(5):10–13

    Article  Google Scholar 

  5. Fitzgerald S, Foster I, Kesselman C, Laszewski G, Smith W, Tuecke S (1997) A directory service for configuring high-performance distributed computations. In: Proceedings of the 6th IEEE international symposium on high performance distributed computing, Portland, OR. IEEE Press, New York, pp 365–375

    Google Scholar 

  6. Czajkowski K, Fitzgerald S, Foster I, Kesselman C (2001) Grid information services for distributed resource sharing. In: Proceedings of the 10th IEEE international symposium on high performance distributed computing, San Francisco, CA, USA. IEEE Press, New York, pp 181–194

    Chapter  Google Scholar 

  7. Massie ML, Chun BN, Culler DE (2004) The ganglia distributed monitoring system: design, implementation, and experience. Parallel Comput 30(7):817–840

    Article  Google Scholar 

  8. Zhang X, Freschl JL, Schopf JM (2003) A performance study of monitoring and information services for distributed systems. In: Proceedings of the 12th IEEE international symposium on high performance distributed computing, Washington, DC, USA, pp 270–281

    Google Scholar 

  9. Mastroianni C, Talia D, Verta O (2008) Designing an information system for grids: comparing hierarchical, decentralized P2P and super-peer models. Parallel Comput 34(10):593–611

    Article  MATH  Google Scholar 

  10. Bharambe AR, Agrawal M, Seshan S (2004) Mercury: supporting scalable multi-attribute range queries. In: Proceedings of the 2004 conference on applications, technologies, architectures, and protocols for computer communications, Portland, Oregon, USA. ACM Press, New York, pp 353–366

    Google Scholar 

  11. Cai M, Frank M, Chen J, Szekely P (2004) MAAN: a multi-attribute addressable network for grid information services. J Grid Comput 2(1):3–14

    Article  MATH  Google Scholar 

  12. Oppenheimer D, Albrecht J, Patterson D, Vahdat A (2004) Scalable wide-area resource discovery. Technical Report UCB/CSD-04-1334, EECS UoC, Berkeley

  13. Schmidt C, Parashar M (2008) Squid: enabling search in DHT-based systems. J Parallel Distrib Comput 68(7):962–975

    Article  MATH  Google Scholar 

  14. Gummadi KP, Dunn RJ, Saroiu S, Gribble SD, Levy HM, Zahorjan J (2003) Measurement, modeling, and analysis of a peer-to-peer file-sharing workload. In: Proceedings of the 9th ACM symposium on operating systems principles, Bolton Landing, NY, USA. ACM Press, New York, pp 314–329

    Google Scholar 

  15. Rhea S, Geels D, Roscoe T, Kubiatowicz J (2004) Handling churn in a DHT. In: Proceedings of the annual conference on USENIX annual technical conference, Boston, MA. USENIX Association, Berkeley, pp 127–140

    Google Scholar 

  16. Iamnitchi A, Foster I (2001) On fully decentralized resource discovery in grid environments. In: Proceedings of the second international workshop on grid computing, Denver, CO, pp 51–62

    Google Scholar 

  17. Iamnitchi A, Foster I (2004) A peer-to-peer approach to resource location in grid environments. In: Nabrzyski J, Schopf JM, Weglarz J (eds) Grid resource management. Kluwer Academic, Dordrecht, pp 413–429

    Chapter  Google Scholar 

  18. Foster I, Iamnitchi A (2003) On death, taxes, and the convergence of peer-to-peer and grid computing. In: The 2nd international workshop on peer-to-peer systems, Berkeley, CA, pp 118–128

    Chapter  Google Scholar 

  19. Talia D, Trunfio P (2003) Toward a synergy between P2P and grids. IEEE Internet Comput 7(4):95–96

    Article  Google Scholar 

  20. Chung W-C, Hsu C-J, Lin Y-H, Lai K-C, Chung Y-C (2010) G2G: a meta-grid framework for the convergence of P2P and grids. Int J Grid High Perform Comput 2(3):1–16

    Article  Google Scholar 

  21. Trunfio P, Talia D, Papadakis H, Fragopoulou P, Mordacchini M, Pennanen M, Popov K, Vlassov V, Haridi S (2007) Peer-to-peer resource discovery in grids: models and systems. Future Gener Comput Syst 23(7):864–878

    Article  Google Scholar 

  22. Ranjan R, Harwood A, Buyya R (2008) Peer-to-peer-based resource discovery in global grids: a tutorial. IEEE Commun Surv Tutor 10(2):6–33

    Article  Google Scholar 

  23. Kalogeraki V, Gunopulos D, Zeinalipour-Yazti D (2002) A local search mechanism for peer-to-peer networks. In: Proceedings of the 11th international conference on information and knowledge management, McLean, Virginia, USA. ACM Press, New York, pp 300–307

    Google Scholar 

  24. Yang B, Garcia-Molina H (2002) Improving search in peer-to-peer networks. In: Proceedings of the 22nd international conference distributed computing systems, Vienna, Austria, pp 5–14

    Google Scholar 

  25. Filali I, Huet F (2010) Dynamic TTL-based search in unstructured peer-to-peer networks. In: Proceedings of the 2010 10th IEEE/ACM international conference on cluster, cloud and grid computing, Melbourne, VIC, Australia, pp 438–447

    Chapter  Google Scholar 

  26. Tangpongprasit S, Katagiri T, Kise K, Honda H, Yuba T (2005) A time-to-live based reservation algorithm on fully decentralized resource discovery in grid computing. Parallel Comput 31(6):529–543

    Article  Google Scholar 

  27. Lv Q, Cao P, Cohen E, Li K, Shenker S (2002) Search and replication in unstructured peer-to-peer networks. In: Proceedings of the 16th international conference on supercomputing, New York, USA. ACM Press, New York, pp 84–95

    Chapter  Google Scholar 

  28. Chung W-C, Chang R-S (2009) A new mechanism for resource monitoring in grid computing. Future Gener Comput Syst 25(1):1–7

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to express their gratitude to the anonymous reviewers for their reviews and suggestions. This paper is partially supported by Delta Electronics, Inc. under grant 101F2289A8.

Author information

Authors and Affiliations

  1. Dept. of Computer Science, National Tsing Hua University, Hsinchu, 300, Taiwan

    Wu-Chun Chung, Chin-Jung Hsu & Yeh-Ching Chung

  2. Dept. of Computer Science, National Taichung University, Taichung, 403, Taiwan

    Kuan-Chou Lai

  3. Dept. of Computer Science and Information Engineering, Providence University, Taichung, 433, Taiwan

    Kuan-Ching Li

Authors
  1. Wu-Chun Chung
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Chin-Jung Hsu
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Kuan-Chou Lai
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Kuan-Ching Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Yeh-Ching Chung
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Wu-Chun Chung.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chung, WC., Hsu, CJ., Lai, KC. et al. Direction-aware resource discovery in large-scale distributed computing environments. J Supercomput 66, 229–248 (2013). https://doi.org/10.1007/s11227-013-0899-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-013-0899-6

Keywords