Skip to main content

Design and Implementation of a Hybrid P2P-based Grid Resource Discovery System

  • Chapter

Abstract

Peer-to-peer (P2P) computing is recognized as one of most prominent paradigms to achieve scalability in key components of Grid systems. One of these components is resource discovery, whose duty is to provide system-wide up-to-date information about resources, a task inherently limited in scalability. Unlike typical P2P systems, Grid systems manage not only static resources, but also resources whose characteristics change dynamically over time. To cope with this scenario, recent P2P-based Grid resource discovery systems employ a combination of Distributed Hash Tables (DHTs) to manage static resources, and unstructured (i.e., broadcast-like) search techniques for dynamic resources. In this paper we elaborate on this approach by designing and implementing a Grid resource discovery system that employs a dynamic querying algorithm over a structured DHT-based overlay. The system has been fully implemented and deployed on the Grid'5000 platform for testing and evaluation. The experimental performance results demonstrate the efficiency of the implemented system, both in terms of number of messages and time needed to complete the search.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Globus MDS. http://www.globus.org/toolkit/mds.

  2. D. Talia, P. Trunfio, J. Zeng. Peer-to-Peer Models for Resource Discovery in Large-scale Grids: A Scalable Architecture. VECPAR’06, Rio de Janeiro, Brazil, 2006.

    Google Scholar 

  3. B. Yang, H. Garcia-Molina. Designing a Super-peer Network. Int. Conf. on Data Engi-neering (ICDE 2003), Bangalore, India, 2003.

    Google Scholar 

  4. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, H. Balakrishnan. Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. ACM SIGCOMM’01, San Diego, USA, 2001.

    Google Scholar 

  5. Open Chord. http://open-chord.sourceforge.net.

  6. Grid’5000. http://www.grid5000.fr.

  7. P. Trunfio, D. Talia, H. Papadakis, P. Fragopoulou, M. Mordacchini, M. Pennanen, K. Popov, V. Vlassov, S. Haridi. Peer-to-Peer resource discovery in Grids: Models and systems. Future Generation Computer Systems, vol. 23, n. 7, 2007.

    Google Scholar 

  8. Q. Lv, P. Cao, E. Cohen, K. Li, S. Shenker. Search and Replication in Unstructured Peer-to-Peer Networks. Int. Conf. on Supercomputing (SC 2002), Baltimore, USA, 2002.

    Google Scholar 

  9. C. Gkantsidis, M. Mihail, A. Saberi. Hybrid Search Schemes for Unstructured Peer-to-Peer Networks. IEEE INFOCOM 2005, Miami, USA, 2005.

    Google Scholar 

  10. D. Tsoumakos, N. Roussopoulos. A Comparison of Peer-to-Peer Search Methods. Int. Workshop on the Web and Databases (WebDB 2003), San Diego, USA, 2003.

    Google Scholar 

  11. A. Crespo, H. Garcia-Molina. Routing Indices for Peer-to-peer Systems. Int. Conf. on Distributed Computing Systems (ICDCS’02), Vienna, Austria, 2002.

    Google Scholar 

  12. A. Crespo, H. Garcia Molina. Semantic Overlay Networks for P2P Systems. Int. Conf. on Agents and Peer-to-Peer Computing (AP2PC 2004), New York, USA, 2004.

    Google Scholar 

  13. K. Sripanidkulchai, B. Maggs, H. Zhang. Efficient Content Location using Interest-based Locality in Peer-to-Peer Systems. IEEE INFOCOM 2003, San Franciso, USA, 2003.

    Google Scholar 

  14. A. A. Fisk. Gnutella Dynamic Query Protocol v0.1. http://www.the-gdf.org/wiki/index.php?title=Dynamic-Querying.

  15. H. Papadakis, P. Fragopoulou, E. P. Markatos, M. Dikaiakos, A. Lambrinidis. Divide et Impera: Partitioning Unstructured Peer-to-Peer Systems to Improve Resource Location. 2nd CoreGRID Integration Workshop, Krakow, Poland, 2006.

    Google Scholar 

  16. S. El-Ansary, L. Alima, P. Brand, S. Haridi. Efficient Broadcast in Structured P2P Net-works. 2nd Int. Workshop on Peer-to-Peer Systems (IPTPS’03), Berkeley, USA, 2003.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Papadakis, H., Trunfio, P., Talia, D., Fragopoulou, P. (2008). Design and Implementation of a Hybrid P2P-based Grid Resource Discovery System. In: Making Grids Work. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-78448-9_7

Download citation

  • DOI: https://doi.org/10.1007/978-0-387-78448-9_7

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-78447-2

  • Online ISBN: 978-0-387-78448-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics