Abstract
Web caches are traditionally organised in a simple tree like hierarchy. In this paper, a new architecture is proposed, where federations of caches are distributed globally, caching data partially. The advantages of the proposed system are that contention on global caches is reduced, while at the same time improving the scalability of the system since extra cache resources can be added on the fly. Among other topics discussed in this papers, is the scalability of the proposed system, the algorithms used to control the federation of Web caches and the approach used to identify the potential Web cache partners. In order to obtain a successful collaborative Web caching system, the formation of federations must be controlled by an algorithm that takes the dynamics of the Internet traffic into consideration. We use the history of Web cache access in order to determine how federations should be formed. Initial performance results of a simulation of a number of nodes are promising.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
M. F. Arlitt and C. L. Williamson, “Trace driven simulation of document caching strategies for internet Web servers,” Simulation, 1997, 23-33.
A. Belloum and L. Hertzberger, “Dealing with one-timer-documents in Web caching,” in Proc. of the Conf. EUROMICRO 98 (Multimedia and Networks), Sweden, August 1998, pp. 544-550.
A. Belloum and L. Hertzberger, “Replacement strategies dedicated to Web caching,” in Proc. of the IEEE Conf. ISIC/CIRA/ISAS 98, Gaithersburg, MD, September 1998, pp. 576-581.
A. Belloum and L. Hertzberger, “Simulation of a two level cache serve,” Technical Report CS-98-01, Computer Science Department of the University of Amsterdam, 1998.
A. Belloum and L. Hertzberger, “The impact of the cache size on the document replacement strategy,” Internal Report, Computer Science Department of the University of Amsterdam, 2000, submitted to Simulation Journal CS-2000-02.
A. Belloum, H. Muller, and L. Hertzberger, “Scalable federations of Web caches,” Internal Report CS-00-03, Computer Science Department of the University of Amsterdam, 2000.
S. J. Caughey, D. B. Ingham, and M. C. Little, “Flexible open caching for the Web,” in Proc. of the WWW Conf., April 1997.
J. Challenger, P. Dantzig, and A. Iyengar, “A scalable system for consistently caching dynamic Web data,” in Proc. of the 18th Annual Joint Conf. of the IEEE Computer and Communications Societies, New York, 1999.
C. Chiang, Y. Li, M. Liu, and M. Muller, “On request forwarding for dynamic Web caching hierarchies,” in Proc. of the 20th Internat. Conf. on Distributed Computing Systems (ICDCS'00), Taipei: Taiwan, April 2000.
C. Faloutos, M. Raganathan, and Y. Manalopoulos, “Fast subsequence matching in time-series databases,” in Proc. of the ACM SIGMOD, June 1994, pp. 419-429.
L. Fan, P. Coa, J. Almeida, and A. Z. Broder, “Wide-area Web caching sharing protocol,” in Proc. of the SIGCOMM 98, 1998, pp. 70-78.
L. Fan, P. Cao, J. Almeida, and A. Z. Broder, “Summary cache: A scalable wide-area Web cache sharing protocol,” IEEE/ACM Trans. Networking J. 8(3), 2000, 281-293.
S. Gadde, M. Rabinovich, and J. Chase, “Reduce, reuse, recycle: An approach to building large Internet caches,” in Proc. of the 6th Workshop on Hot Topics in Operating System, 1997, pp. 93-98.
S. Inohara, Y. Masuoka, J. Min, and F. Noda, “Self-organizing cooperative in WWW caching,” in Proc. of the 18th Conf. on Distributed Computing Systems, 1998, pp. 74-83.
A. Iyengar, M. Squillante, and L. Zhang, “Analysis and characterization of large-scale Web server access patterns and performance,” World Wide Web J., June 1999.
R. T. C. Lee, “Cluster analysis and its applications,” in Advances in Information Sience System, Plenum: New York, 1981, pp. 169-292.
C. Lindemann and O. Waldhorst, “Evaluating cooperative Web caching protocols for emerging network technologies,” in Proc. of the Workshop on Caching, Coherence and Consistency (WC3 '01), Sorrento, Italy, June 2001.
M. Makpangou and E. Berenguier, “Relais: Un protocol de maintien de coherence de caches Web cooperants,” in Proc. of the NoTeRe'97 Colloquium, November 1997.
R. Malpani, J. Lorch, and D. Berger, “Making World Wide Web caching servers cooperate,” in Fourth Internat. WWW Conf., Boston, December 1995.
Microsoft-Corporation, Ache array routing protocol and Microsoft server 2.0, White paper, Microsoft Corporation, 1997.
H. L. Muller, P. W. A. Stallard, and D. H. D. Warren, “Implementing the data diffusion machine using crossbar routers,” in Proc. of the 10th Internat. Parallel Processing Symposium, Honolulu, Hawaii, April 1996, IEEE Computer Soc. Press: Silver Spring, MD, pp. 152-158.
S. Paul and Z. Fei, “Distributed caching with centralized control,” in Proc. of the 5th Internat. Web and Cachign Content Delivery Workshop, Lisbon, Portugal, May 2000.
B. Scott Michel, K. Nikoloudakis, P. Reiher, and L. Zhang, “URL forwarding and compression in adaptive Web caching,” in INFOCOM 2000, 2000, pp. 670-678.
J. Wang, “A survey of Web caching schemes for the Internet,” ACM Comput. Commun. Rev. 29(5), 1999, 36-46.
A. Wolman, G. M. Voelker, N. Sharma, N. Cardwell, A. Karlinm, and H. M. Levy, “On the scale and performance of cooperative Web proxy caching,” in Proc. of the 17th ACM Symposium on Operating Systems Principles (SOSP '99), Kiawah Island Resort, USA, December 1999, pp. 16-31.
K.-L. Wu and P. S. Yu, “Latency-sensitive hashing for collaborative Web caching,” in Proc. of the Conf. on Computer Networks and ISDN, Amsterdam, The Netherlands, May 2000.
L. Zhang, S. Floyd, and V. Jacobson, “Adaptive Web caching,” in Proc. of the Boulder Cache Workshop 97, June 1997
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Belloum, A., Hertzberger, L. & Muller, H. Scalable Federation of Web Cache Servers. World Wide Web 4, 255–275 (2001). https://doi.org/10.1023/A:1015181701674
Issue Date:
DOI: https://doi.org/10.1023/A:1015181701674