Skip to main content

Peer-To-Peer Techniques for Data Distribution in Desktop Grid Computing Platforms

  • Chapter
Making Grids Work

Abstract

In this paper, we discuss how Peer-to-Peer data distribution techniques can be adapted to Desktop Grid computing environments, particularly to the BOINC platform. To date, Desktop Grid systems have focused primarily on utilizing spare CPU cycles, yet have neglected to take advantage of client network capabilities. Leveraging client bandwidth will not only benefit current projects by lowering their overheads but also will facilitate Desktop Grid adoption by data-heavy applications. We propose two approaches to Peer-to-Peer data sharing that could be adapted for volunteer computing platforms: the highly successful BitTorrent protocol and a secure and customizable Peer-to-Peer data center approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. David Anderson. BOINC: A System for Public-Resource Computing and Storage. In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, Pittsburgh, USA, November 2004.

    Google Scholar 

  2. David Anderson. Volunteer Computing: Planting the Flag. PCGrid 2007 Workshop, Long Beach, March 30 2007.

    Google Scholar 

  3. H. Balakrishnan, F. Dabek, M.F. Kaashoek, D.R. Karger, D. Liben-Nowell, R. Morris, and I. Stoica. Chord: a scalable peer-to-peer lookup protocol for Internet applications. Networking, IEEE/ACM Transactions on, 11.

    Google Scholar 

  4. Berkeley Open Infrastructure for Network Computing (BOINC). See web site at: http://boinc.berkeley.edu/.

  5. Danny Bickson and Dahlia Malkhi. The Julia Content Distribution Network. 2nd Usenix Workshop on Real, Large Distributed Systems (WORLDS ’05), San Francisco, USA, December 2005.

    Google Scholar 

  6. F. Cappello, S.Djilali, G.Fedak, T.Herault. F.Magniette, V.Neri, and O.Lodygensky. Com-puting on large-scale distributed systems: XtremWeb architecture, programming models, security, tests and convergence with Grid. FGCS Future Generation Computer Science, 2004.

    Google Scholar 

  7. Bram Cohen. Incentives build robustness in BitTorrent. Proceedings of IPTPS, 2003

    Google Scholar 

  8. Pasquale Cozza, Ian Kelley, Carlo Mastroianni, Domenico Talia, and Ian Taylor. Cache-Enabled Super-Peer Overlays for Multiple Job Submission on Grids. To be published ISC 2007 CoreGrid Workshop, 2007.

    Google Scholar 

  9. Gnutella Project. See web site at: http://www.gnutella.com/ .

  10. M. Izal, G. Urvoy-Keller, E. W. Biersack, P. A. Felber, A. A. Hamra, and L. Garces-Erice. Dissecting BitTorrent: Five Months in a Torrent’s Lifetime. In Proceedings of Passive and Active Measurements (PAM), 2004.

    Google Scholar 

  11. P. Kacsuk, N. Podhorszki, and T. Kiss. Scalable Desktop Grid System. CoreGRID Technical Report TR-0006, MTA SZTAKI, University of Westminster, 2005.

    Google Scholar 

  12. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells and B. Zhao Oceanstore: An architecture for global-scale persistent storage. In the 9th International Conference on Architectural Support for Programming Languages and Operating Systems, 2000.

    Google Scholar 

  13. J. Li, J. Stribling, R. Morris, M. F. Kaashoek, and T. M. Gil. A performance vs. cost framework for evaluating DHT design tradeoffs under churn. IEEE Conference on Computer Communications (INFOCOM), 2005.

    Google Scholar 

  14. J. Liang, R. Kumar, K. W. Ross. The KaZaA Overlay: A Measurement Study. Computer Networks Journal, Oct. 2005.

    Google Scholar 

  15. M. Litzkow, M.Luvby, and M.Mutka. Condor - A Hunter of Idle Workstations. Pages 104-111. 8th International Conference on Distributed Computing Systems (ICDCS). Wash- ington, DC, 1988.

    Google Scholar 

  16. Peer-to-Peer Architecture for Data-Intensive Cycle Sharing (P2P-ADICS). See web site at: http://www.p2p-adics.org/.

  17. Sudharshan S. Vazhkudai, Xiaosong Ma, Vincent W. Freeh, Jonathan W. Strickland, Nan-dan Tammineedi, Stephen L. Scott. FreeLoader: Scavenging Desktop Storage Resources for Scientific Data. sc, p. 56,Ê ACM/IEEE SC 2005 Conference (SC’05),Ê 2005.

    Google Scholar 

  18. J. Verbeke, N. Nadgir, G. Ruetsch, and I. Sharapov. Framework for Peer-to-Peer Distri-bution Computing in a Heterogeneous, Decentralized Environment. Proceedings of the Third International Workshop on Grid Computing, 2002.

    Google Scholar 

  19. Ian Wang. P2PS (Peer-to-Peer Simplified). In Proceedings of 13th Annual Mardi Gras Conference - Frontiers of Grid Applications and Technologies, pages 54-59. Louisiana State University, February 2005.

    Google Scholar 

  20. Baohua Wei, G. Fedak, and F. Cappello. Scheduling independent tasks sharing large data distributed with BitTorrent. pages 219-226. Grid Computing, 2005. The 6thIEEE/ACM International Workshop on, IEEE ComputerSociety, 2005.

    Google Scholar 

  21. B. Y. Zhao, J. Kubiatowicz, and A. Joseph. Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing. UCB Tech Report UCB/CSD-01-1141, University of California, Berkeley, 2001.

    Google Scholar 

  22. List of BOINC projects at: http://boinc.berkeley.edu/projects.php.

  23. Azureus BitTorrent client. See web site at: http://azureus.sourceforge.net/.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Costa, F., Silva, L., Kelley, I., Taylor, I. (2008). Peer-To-Peer Techniques for Data Distribution in Desktop Grid Computing Platforms. In: Making Grids Work. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-78448-9_30

Download citation

  • DOI: https://doi.org/10.1007/978-0-387-78448-9_30

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-78447-2

  • Online ISBN: 978-0-387-78448-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics