skip to main content
10.1145/1341811.1341819acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesmardi-grasConference Proceedingsconference-collections
research-article

Structured peer-to-peer resource discovery for computational grids

Published: 29 January 2008 Publication History

Abstract

Existing resource discovery and monitoring systems, such as Globus GRAM/MDS, are based on a central point of control. This paper proposes a decentralized multilayered resource discovery system implemented over a peer-to-peer structure to address shortcomings associated with current resource discovery systems. Our approach segments Grid nodes into various overlays, with each overlay (namely, layer) made up of nodes contributing the same resource attributes and connected by at least one gateway to allow nodes in the layer to communicate with other layers, to support queries for multiple resource types. This unique logical structure permits fast and effective searches for a given set of resources needed by an incoming job. Our approach disseminates resource information to nodes proximity-close to the distribution node, exhibiting a substantial reduction in traffic overhead of over 35%, without compromising its success rate in resource discovery. It supports queries for multiple resource types efficiently, often without searching associated multiple layers separately.

References

[1]
Anthony Rowstrom and Peter Druschel, "Pastry: Scalable, Decentralized Object Location and Routing for Large-Scale Peer-to-Peer Systems," Proceedings of the 18th IFIP/ACM Int'l Conf. on Distributed Systems Platforms, Nov. 2001.
[2]
Ashwin Bharambe, Mukesh Agrawal and Srinivasan Seshan, "Mercury: Supporting Multi-Attribute Range Queries," Proceedings of ACM Conference on Computer Communications (ACM SIGCOMM), Oct. 2004, pp. 353--366.
[3]
Ben Y. Zhao et al., "Tapestry: A Resilient Global-Scale Overlay for Service Deployment," IEEE Journal on Selected Areas in Communications, vol. 22, Jan. 2004, pp. 41--53.
[4]
Craig Hunt, Chapter 8, TCP/IP Network Administration, O'Reilly Publishers, Jan. 1998, pp 48--78.
[5]
D. Oppenheimer, J. Albrecht, D. Patterson, and A. Vahdat, "Scalable Wide-Area Resource Discovery," TR CSD04-1334, University of California, 2004.
[6]
Dragos Ilie, David Erman and Adrian Popescu, "Transfer Rate Models for Gnutella Signaling Traffic," AICT-ICIW 2006, Washington, DC, USA, 2006.
[7]
Ian Foster and Carl Kesselman, Chapter 8, The Grid2: A Blueprint for a New Computing Infrastructure. Morgan Kaufman Publishers, 2004, pp. 593--622.
[8]
Jared Winick and Sugih Jamin, "Inet-3.0 Topology Generator," University of Michigan Technical Report CSE-TR-433-00, June 2002.
[9]
John Kubiatowicz et al., "OceanStore: An Architecture for Global-Scale Persistent Storage," Proceedings of ACM 9th Int'l Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS-IX), Nov. 2000.
[10]
Karl Czajkowski et al., "Grid Information Services for Distributed Resource Sharing," Proceedings of 10th IEEE International Symp. on High-Performance Distributed Computing, Aug. 2001, pp. 181--194.
[11]
Miguel Castro et al., "Topology-Aware Routing in Structured Peer-to-Peer Overlay Networks," Microsoft Technical Report, MSR-TR-2002-82.
[12]
Peter Druschel and Antony Rowstron, "PAST: A Large-Scale, Persistent Peer-to-Peer Storage Utility," Proceedings of 8th Workshop on Hot Topics in Operating Systems (HotOS-VIII), May 2001.
[13]
S. Zanikolas, and R. Sakellariou, "A Taxonomy of Grid Monitoring Systems," Future Generation Computer Systems, 21(1):163--188, 2005.
[14]
Sujoy Basu, Sujata Banerjee, Puneet Sharma and Sung-Ju Lee, "Nodewiz: Peer-to-Peer Resource Discovery for Grids," Proceedings of 5th IEEE International Workshop on Global and Peer-to-Peer Computing, May 2005, pp. 213--220.

Cited By

View all
  • (2013)Decentralized resource discovery mechanisms for distributed computing in peer-to-peer environmentsACM Computing Surveys (CSUR)10.1145/2501654.250166845:4(1-40)Online publication date: 30-Aug-2013
  • (2009)HiDRA: Statistical multi-dimensional resource discovery for large-scale systems2009 17th International Workshop on Quality of Service10.1109/IWQoS.2009.5201407(1-9)Online publication date: Jul-2009

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MG '08: Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
January 2008
178 pages
ISBN:9781595938350
DOI:10.1145/1341811
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • National e-Science Institute (Edinburgh, UK)
  • Louisiana State University (USA)

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2008

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Funding Sources

Conference

Mardi Gras'08
Sponsor:
Mardi Gras'08: 15th Mardi Gras Conference on Distributed Applications
January 29 - February 3, 2008
Louisiana, Baton Rouge, USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2013)Decentralized resource discovery mechanisms for distributed computing in peer-to-peer environmentsACM Computing Surveys (CSUR)10.1145/2501654.250166845:4(1-40)Online publication date: 30-Aug-2013
  • (2009)HiDRA: Statistical multi-dimensional resource discovery for large-scale systems2009 17th International Workshop on Quality of Service10.1109/IWQoS.2009.5201407(1-9)Online publication date: Jul-2009

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media