skip to main content
10.1145/2592798.2592817acmconferencesArticle/Chapter ViewAbstractPublication PageseurosysConference Proceedingsconference-collections
research-article

Caching in video CDNs: building strong lines of defense

Published:14 April 2014Publication History

ABSTRACT

Planet-scale video Content Delivery Networks (CDNs) deliver a significant fraction of the entire Internet traffic. Effective caching at the edge is vital for the feasibility of these CDNs, which can otherwise incur significant monetary costs and resource overloads in the Internet.

We analyze the challenges and requirements for video caching on these CDNs which cannot be addressed by standard solutions. We develop multiple algorithms for caching in these CDNs: (i) An LRU-based baseline solution to address the requirements, (ii) an intelligent ingress-efficient algorithm, (iii) an offline cache aware of future requests (greedy) to estimate the maximum caching efficiency we can expect from any online algorithm, and (iv) an optimal offline cache (for limited scales). We use anonymized actual data from a large-scale, global CDN to evaluate the algorithms and draw conclusions on their suitability for different settings.

References

  1. YouTube statistics. http://www.youtube.com/yt/press/statistics.html.Google ScholarGoogle Scholar
  2. S. Agarwal, J. Dunagan, N. Jain, S. Saroiu, A. Wolman, and H. Bhogan. Volley: automated data placement for geo-distributed cloud services. In Proc. of NSDI'10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. V. Almeida, A. Bestavros, M. Crovella, and A. de Oliveira. Characterizing reference locality in the WWW. In Proc. of PDIS'96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. S. Bakiras and T. Loukopoulos. Combining replica placement and caching techniques in content distribution networks. Computer Communications, 28(9):1062--1073, June 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. L. Belady. A study of replacement algorithms for a virtual-storage computer. IBM Systems Journal, 5(2):78--101, June 1966. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. S. Borst, V. Gupta, and A. Walid. Distributed caching algorithms for content distribution networks. In Proc. of IEEE Infocom'10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. P. Cao and S. Irani. Cost-aware WWW proxy caching algorithms. In Proc. of USENIX USITS'97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. D. Karger et al. Web caching with consistent hashing. Computer Networks, 31(11-16):1203--1213, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. Freedman, E. Freudenthal, and D. Mazieres. Democratizing content publication with Coral. In Proc. of ACM/USENIX NSDI'04. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. Gadde, M. Rabinovich, and J. Chase. Reduce, reuse, recycle: An approach to building large Internet caches. In Proc. of Workshop on Hot Topics in Operating Systems, pages 93--98, April 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. P. Gill, M. Arlitt, Z. Li, and A. Mahanti. YouTube traffic characterization: a view from the edge. In Proc. of ACM IMC'07. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Google, Inc. Google Global Cache program. https://peering.google.com/about/ggc.html, 2013.Google ScholarGoogle Scholar
  13. S. Jin and A. Bestavros. Popularity-aware greedy dual-size Web proxy caching algorithms. In Proc. of ICDCS'00. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. Narayana, J. Jiang, J. Rexford, and M. Chiang. To coordinate or not to coordinate? Wide-area traffic management for data centers. Technical Report, Princeton University, 2012.Google ScholarGoogle Scholar
  15. J. Ni and D. Tsang. Large scale cooperative caching and application-level multicast in multimedia content delivery networks. IEEE Communications, 43(5):98--105, May 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. E. Nygren, R. Sitaraman, and J. Sun. The Akamai network: A platform for high-performance internet applications. ACM SIGOPS Operating Systems Review, 44(3):2--19, July 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. E. O'Neil, P. O'Neil, and G. Weikum. The LRU-K page replacement algorithm for database disk buffering. In Proc. of ACM SIGMOD'93. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. G. Pallis and A. Vakali. Insight and perspectives for content delivery networks. Communications of the ACM, 49(1):101--106, January 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. A. Pathan and R. Buyya. A taxonomy and survey of content delivery networks. Technical Report, University of Melbourne, 2007.Google ScholarGoogle Scholar
  20. S. Podlipnig and L. Boszormenyi. A survey of Web cache replacement strategies. ACM Computing Surveys, 35(4):374--398, December 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. P. Rodriguez, C. Spanner, and E. Biersack. Analysis of Web caching architectures: hierarchical and distributed caching. IEEE/ACM Transactions on Networking, 9(4):404--418, August 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. A. Rousskov and D. Wessels. Cache digests. Computer Networks and ISDN Systems, 30(22-3):2155--2168, November 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Sandvine Inc. Global Internet phenomena report, 2h 2013, November 2013.Google ScholarGoogle Scholar
  24. P. Scheuermann, J. Shim, and R. Vingralek. A case for delay-conscious caching of Web documents. In Proc. of WWW'97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. X. Tang and J. Xu. QoS-aware replica placement for content distribution. IEEE Transactions on Parallel and Distributed Systems, 16(10):921--932, October 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. P. Wendell, J. Jiang, M. Freedman, and J. Rexford. DONAR: decentralized server selection for cloud services. In Proc. of ACM SIGCOMM'10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. H. Xu and B. Li. Joint request mapping and response routing for geo-distributed cloud services. In Proc. of IEEE Infocom'13.Google ScholarGoogle Scholar
  28. M. Zink, K. Su, Y. Gu, and J. Kurose. Watch global, cache local: YouTube network traffic at a campus network - measurements and implications. In Proc. of ACM/IEEE/SPIE MMCN'08.Google ScholarGoogle Scholar

Index Terms

  1. Caching in video CDNs: building strong lines of defense

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        EuroSys '14: Proceedings of the Ninth European Conference on Computer Systems
        April 2014
        388 pages
        ISBN:9781450327046
        DOI:10.1145/2592798

        Copyright © 2014 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 14 April 2014

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        EuroSys '14 Paper Acceptance Rate27of147submissions,18%Overall Acceptance Rate241of1,308submissions,18%

        Upcoming Conference

        EuroSys '24
        Nineteenth European Conference on Computer Systems
        April 22 - 25, 2024
        Athens , Greece

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader