skip to main content
10.1145/571825.571861acmconferencesArticle/Chapter ViewAbstractPublication PagespodcConference Proceedingsconference-collections
Article

Squirrel: a decentralized peer-to-peer web cache

Published:21 July 2002Publication History

ABSTRACT

This paper presents a decentralized, peer-to-peer web cache called Squirrel. The key idea is to enable web browsers on desktop machines to share their local caches, to form an efficient and scalable web cache, without the need for dedicated hardware and the associated administrative cost. We propose and evaluate decentralized web caching algorithms for Squirrel, and discover that it exhibits performance comparable to a centralized web cache in terms of hit ratio, bandwidth usage and latency. It also achieves the benefits of decentralization, such as being scalable, self-organizing and resilient to node failures, while imposing low overhead on the participating nodes.

References

  1. F. 180-1. Secure hash standard. Technical Report Publication 180-1, Federal Information Processing Standard (FIPS), National Institute of Standards and Technology, US Department of Commerce, Washington D.C., Apr. 1995.Google ScholarGoogle Scholar
  2. W. J. Bolosky, J. R. Douceur, D. Ely, and M. Theimer. Feasibility of a serverless distributed file system deployed on an existing set of desktop pcs. In Proceedings of ACM SIGMETRICS, pages 34-43, June 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. C. M. Bowman, P. B. Danzig, D. R. Hardy, U. Manber, and M. F. Schwartz. The Harvest information discovery and access system. Computer Networks and ISDN Systems, 28(1-2):119-125, Dec. 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Busari and C. Williamson. On the sensitivity of web proxy cache performance to workload characteristics. In Proceedings of IEEE INFOCOM, Anchorage, Alaska, Apr. 2001.Google ScholarGoogle ScholarCross RefCross Ref
  5. R. Caceres, F. Douglis, A. Feldmann, G. Glass, and M. Rabinovich. Web proxy caching: the devil is in the details. In Proceedings of the Workshop on Internet Server Performance, Madison, WI, May 1999.Google ScholarGoogle Scholar
  6. A. Chankhunthod, P. Danzig, C. Neerdaels, M. F. Schwartz, and K. J. Worrell. A hierarchical Internet object cache. In Proceedings of the 1996 Usenix Technical Conference, San Diego, CA, Jan. 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area cooperative storage with cfs. In Proceedings of the 18th ACM Symposium on Operating Systems Principles, Banff, Canada, Oct. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. Dingle and T. Partl. Web cache coherence. In Proceedings of the fifth International World Wide Web Conference, Paris, May 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. S. Gadde, J. Chase, and M. Rabinovich. A taste of crispy Squid. In Proceedings of the Workshop on Internet Server Performance, Madison, WI, June 1998.Google ScholarGoogle Scholar
  10. M. Kurcewicz, W. Sylwestrzak, and A. Wierzbicki. A distributed WWW cache. Computer Networks And ISDN Systems, 30(22-23):2261-2267, Nov. 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. Nottingham. Caching tutorial for web authors and webmasters. http://www.mnot.net/cache_docs/.Google ScholarGoogle Scholar
  12. V. N. Padmanabhan and K. Sripanidkulchai. The case for cooperative networking. In 1st International Peer To Peer Systems Workshop (IPTPS 2002), Cambridge, MA, Mar. 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker. A scalable content-addressable network. In Proceedings of ACM SIGCOMM, San Diego, CA, Aug. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. P. Romine. LAN-Based web caching for accelerated web access. Mangosoft Technical White Paper, http://www.mangosoft.com/products/cachelink.Google ScholarGoogle Scholar
  15. A. Rowstron and P. Druschel. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In Proceedings of the International Conference on Distributed Systems Platforms (Middleware), Heidelberg, Germany, Nov. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. A. Rowstron and P. Druschel. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In Proceedings of the 18th ACM Symposium on Operating Systems Principles, Banff, Canada, Oct. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. A. Rowstron, A.-M. Kermarrec, M. Castro, and P. Druschel. Scribe: The design of a large-scale event notification infrastructure. In Proceedings of the third International Workshop on Networked Group Communications, London, UK, Nov. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. T. Stading, P. Maniatis, and M. Baker. Peer-to-peer caching schemes to address flash crowds. In 1st International Peer To Peer Systems Workshop (IPTPS 2002), Cambridge, MA, Mar. 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for internet applications. In Proceedings of ACM SIGCOMM, San Diego, California, Aug. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. R. Tewari, M. Dahlin, H. Vin, and J. Kay. Beyond hierarchies: Design considerations for distributed caching on the internet. Technical Report CS98-04, Department of Computer Science, University of Texas at Austin, May 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. References for cacheability of web content. http://www.cs.rice.edu/~ssiyer/r/squirrel/links.html.Google ScholarGoogle Scholar
  22. J. Wang. A survey of web caching schemes for the internet. ACM Computer Communication Review, 29(5):36-46, Oct. 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. D. Wessel. Squid internet object cache. http://squid.nlanr.net/.Google ScholarGoogle Scholar
  24. A. Wolman, G. M. Voelker, N. Sharma, N. Cardwell, A. R. Karlin, and H. M. Levy. On the scale and performance of cooperative web proxy caching. In Proceedings of the 17th ACM Symposium on Operating Systems Principles, Kiawah Island, SC, Dec. 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. B. Y. Zhao, J. D. Kubiatowicz, and A. D. Joseph. Tapestry: An infrastructure for fault-resilient wide-area location and routing. Technical Report UCB//CSD-01-1141, U. C. Berkeley, Apr. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  1. Squirrel: a decentralized peer-to-peer web cache

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            PODC '02: Proceedings of the twenty-first annual symposium on Principles of distributed computing
            July 2002
            307 pages
            ISBN:1581134851
            DOI:10.1145/571825

            Copyright © 2002 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 21 July 2002

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • Article

            Acceptance Rates

            PODC '02 Paper Acceptance Rate43of149submissions,29%Overall Acceptance Rate740of2,477submissions,30%

            Upcoming Conference

            PODC '24

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader