ABSTRACT
Planet-scale video Content Delivery Networks (CDNs) deliver a significant fraction of the entire Internet traffic. Effective caching at the edge is vital for the feasibility of these CDNs, which can otherwise incur significant monetary costs and resource overloads in the Internet.
We analyze the challenges and requirements for video caching on these CDNs which cannot be addressed by standard solutions. We develop multiple algorithms for caching in these CDNs: (i) An LRU-based baseline solution to address the requirements, (ii) an intelligent ingress-efficient algorithm, (iii) an offline cache aware of future requests (greedy) to estimate the maximum caching efficiency we can expect from any online algorithm, and (iv) an optimal offline cache (for limited scales). We use anonymized actual data from a large-scale, global CDN to evaluate the algorithms and draw conclusions on their suitability for different settings.
- YouTube statistics. http://www.youtube.com/yt/press/statistics.html.Google Scholar
- S. Agarwal, J. Dunagan, N. Jain, S. Saroiu, A. Wolman, and H. Bhogan. Volley: automated data placement for geo-distributed cloud services. In Proc. of NSDI'10. Google ScholarDigital Library
- V. Almeida, A. Bestavros, M. Crovella, and A. de Oliveira. Characterizing reference locality in the WWW. In Proc. of PDIS'96. Google ScholarDigital Library
- S. Bakiras and T. Loukopoulos. Combining replica placement and caching techniques in content distribution networks. Computer Communications, 28(9):1062--1073, June 2005. Google ScholarDigital Library
- L. Belady. A study of replacement algorithms for a virtual-storage computer. IBM Systems Journal, 5(2):78--101, June 1966. Google ScholarDigital Library
- S. Borst, V. Gupta, and A. Walid. Distributed caching algorithms for content distribution networks. In Proc. of IEEE Infocom'10. Google ScholarDigital Library
- P. Cao and S. Irani. Cost-aware WWW proxy caching algorithms. In Proc. of USENIX USITS'97. Google ScholarDigital Library
- D. Karger et al. Web caching with consistent hashing. Computer Networks, 31(11-16):1203--1213, 1999. Google ScholarDigital Library
- M. Freedman, E. Freudenthal, and D. Mazieres. Democratizing content publication with Coral. In Proc. of ACM/USENIX NSDI'04. Google ScholarDigital Library
- S. Gadde, M. Rabinovich, and J. Chase. Reduce, reuse, recycle: An approach to building large Internet caches. In Proc. of Workshop on Hot Topics in Operating Systems, pages 93--98, April 1997. Google ScholarDigital Library
- P. Gill, M. Arlitt, Z. Li, and A. Mahanti. YouTube traffic characterization: a view from the edge. In Proc. of ACM IMC'07. Google ScholarDigital Library
- Google, Inc. Google Global Cache program. https://peering.google.com/about/ggc.html, 2013.Google Scholar
- S. Jin and A. Bestavros. Popularity-aware greedy dual-size Web proxy caching algorithms. In Proc. of ICDCS'00. Google ScholarDigital Library
- S. Narayana, J. Jiang, J. Rexford, and M. Chiang. To coordinate or not to coordinate? Wide-area traffic management for data centers. Technical Report, Princeton University, 2012.Google Scholar
- J. Ni and D. Tsang. Large scale cooperative caching and application-level multicast in multimedia content delivery networks. IEEE Communications, 43(5):98--105, May 2005. Google ScholarDigital Library
- E. Nygren, R. Sitaraman, and J. Sun. The Akamai network: A platform for high-performance internet applications. ACM SIGOPS Operating Systems Review, 44(3):2--19, July 2010. Google ScholarDigital Library
- E. O'Neil, P. O'Neil, and G. Weikum. The LRU-K page replacement algorithm for database disk buffering. In Proc. of ACM SIGMOD'93. Google ScholarDigital Library
- G. Pallis and A. Vakali. Insight and perspectives for content delivery networks. Communications of the ACM, 49(1):101--106, January 2006. Google ScholarDigital Library
- A. Pathan and R. Buyya. A taxonomy and survey of content delivery networks. Technical Report, University of Melbourne, 2007.Google Scholar
- S. Podlipnig and L. Boszormenyi. A survey of Web cache replacement strategies. ACM Computing Surveys, 35(4):374--398, December 2003. Google ScholarDigital Library
- P. Rodriguez, C. Spanner, and E. Biersack. Analysis of Web caching architectures: hierarchical and distributed caching. IEEE/ACM Transactions on Networking, 9(4):404--418, August 2001. Google ScholarDigital Library
- A. Rousskov and D. Wessels. Cache digests. Computer Networks and ISDN Systems, 30(22-3):2155--2168, November 1998. Google ScholarDigital Library
- Sandvine Inc. Global Internet phenomena report, 2h 2013, November 2013.Google Scholar
- P. Scheuermann, J. Shim, and R. Vingralek. A case for delay-conscious caching of Web documents. In Proc. of WWW'97. Google ScholarDigital Library
- X. Tang and J. Xu. QoS-aware replica placement for content distribution. IEEE Transactions on Parallel and Distributed Systems, 16(10):921--932, October 2005. Google ScholarDigital Library
- P. Wendell, J. Jiang, M. Freedman, and J. Rexford. DONAR: decentralized server selection for cloud services. In Proc. of ACM SIGCOMM'10. Google ScholarDigital Library
- H. Xu and B. Li. Joint request mapping and response routing for geo-distributed cloud services. In Proc. of IEEE Infocom'13.Google Scholar
- M. Zink, K. Su, Y. Gu, and J. Kurose. Watch global, cache local: YouTube network traffic at a campus network - measurements and implications. In Proc. of ACM/IEEE/SPIE MMCN'08.Google Scholar
Index Terms
Caching in video CDNs: building strong lines of defense
Recommendations
RL-Bélády: A Unified Learning Framework for Content Caching
MM '20: Proceedings of the 28th ACM International Conference on MultimediaContent streaming is the dominant application in today's Internet, which is typically distributed via content delivery networks (CDNs). CDNs usually use caching as a means to reduce user access latency so as to enable faster content downloads. Typical ...
Selective Victim Caching: A Method to Improve the Performance of Direct-Mapped Caches
Although direct-mapped caches suffer from higher miss ratios as compared to set-associative caches, they are attractive for today's high-speed pipelined processors that require very low access times. Victim caching was proposed by Jouppi [1] as an ...
Segmentation of multimedia streams for proxy caching
Proxy caching of large multimedia objects on the edge of the Internet has become increasingly important for reducing network latency. For a large media object, such as a two-hour video, treating the whole media as a single object for caching is not ...
Comments