Skip to main content
Log in

Popularity prediction–based caching in content delivery networks

  • Published:
Annals of Telecommunications Aims and scope Submit manuscript

Abstract

In content delivery networks (CDNs), caches are resources that must be allocated. For that purpose, videos’ popularity knowledge helps to make efficient decisions about which videos should be cached. Thus, we must be able to anticipate future needs in terms of requested videos. To do this, we rely on the requests history. This paper focuses on predicting the videos’ popularity: the daily number of requests. For that purpose, we propose a two-level prediction approach. At the first level, the experts compute the videos’ popularity, each expert using its own prediction method with its own parameters. At the second level, the forecasters select the best experts and build a prediction based on the predictions provided by these experts. The prediction accuracy is evaluated by a loss function as the discrepancy between the prediction value and the real number of requests. We use real traces extracted from YouTube to compare different prediction methods and determine the best parameter tuning for experts and forecasters. The goal is to find the best trade-off between complexity and accuracy of the prediction methods used. Finally, we apply these prediction methods to caching. Prediction methods are compared in terms of cache hit ratio and update ratio. The gain brought by this two-level prediction approach is compared with that obtained by a single prediction level. The results show that the choice of a two-level prediction approach is justified.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Pathan A, Buyya R (2007) A taxonomy and survey of content delivery networks

  2. Allen MS, Zhao BY, Wolski R (2007) Deploying video-on-demand services on cable networks. In: Proceedings of the 27th international conference on distributed computing systems (ICDCS), pp 63–63

  3. Belady LA (1966) A study of replacement algorithms for a virtual-storage computer. IBM Syst J 5(2):78–101

    Article  Google Scholar 

  4. Megiddo N, Modha DS (2004) Outperforming lru with an adaptive replacement cache algorithm. Computer 37(4):58–65

    Article  Google Scholar 

  5. Koskela T, Heikkonen J, Kaski K (2003) Web cache optimization with nonlinear model using object features. Comput Netw 43(6):805–817

    Article  MATH  Google Scholar 

  6. Kumar C, Norris JB (2008) A new approach for a proxy-level web caching mechanism. Decis Support Syst 46(1):52–60

    Article  Google Scholar 

  7. Robert Chiang I, Goes PB, Zhang Z (2007) Periodic cache replacement policy for dynamic content at application server. Decis Support Syst 43(2):336–348

    Article  Google Scholar 

  8. De Vleeschauwer D, Laevens K (2009) Performance of caching algorithms for iptv on-demand services. IEEE Trans Broadcast 55(2):491–501

    Article  Google Scholar 

  9. Wittevrongel S, Herwig B, Avramova Z, De Vleeschauwer D (2009) Analysis and modeling of video popularity evolution in various online video content systems: power-law versus exponential decay. In: Proceedings of the first international conference on evolving internet, pp 95–100

  10. Szabo G, Huberman BA (2010) Predicting the popularity of online content. Commun ACM 53(8):80–88

    Article  Google Scholar 

  11. Cha M, Kwak H, Rodriguez P, Ahn Y, Moon S (2007) I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. In: Proceedings of the 7th ACM SIGCOMM conference on internet measurement (IMC), pp 1–14

  12. Borghol Y, Mitra S, Ardon S, Carlsson N, Eager D, Mahanti A (2011) Characterizing and modelling popularity of user-generated videos. Perform Eval 68(11):1037–1055

    Article  Google Scholar 

  13. Bandari R, Asur S, Huberman BA (2012) The pulse of news in social media: forecasting popularity. CoRR, abs/1202.0332

  14. Pinto H, Almeida JM, Gonçalves MA (2013) Using early view patterns to predict the popularity of youtube videos. In: Proceedings of the sixth ACM international conference on web search and data mining (WSDM), pp 365–374

  15. Khosla A, Das Sarma A, Hamid R (2014) What makes an image popular?. In: Proceedings of the 23rd international conference on world wide web (WWW), pp 867–876

  16. Xu J, Van der Schaar M, Liu J, Li H (2015) Forecasting popularity of videos using social media. IEEE J Sel Top Sign Proces 9(2):330–343

    Article  Google Scholar 

  17. Petrovic S, Osborne M, Lavrenko V (2011) Rt to win! predicting message propagation in twitter. In: Proceedings of the international AAAI conference on web and social media (ICWSM)

  18. Hong L, Dan O, Davison BD (2011) Predicting popular messages in twitter. In: Proceedings of the 20th international conference companion on world wide web (WWW), pp 57–58

  19. Gelli F, Uricchio T, Bertini M, Bimbo A Del, Chang S-F (2015) Image popularity prediction in social media using sentiment and context features. In: Proceedings of the 23rd ACM international conference on multimedia (MM), pp 907–910

  20. Wu B, Cheng W, Zhang Y, Mei T (2016) Time matters: multi-scale temporalization of social media popularity. In: Proceedings of the 24th ACM international conference on multimedia, pp 1336–1344

  21. Wu B, Mei T, Cheng W, Zhang Y (2016) Unfolding temporal dynamics: predicting social media popularity using multi-scale temporal decomposition. In: AAAI association for the advancement of artificial intelligence, pp 272–278

  22. Al-Turjman FM (2017) Information-centric sensor networks for cognitive IoT: an overview. Ann Telecommun 72(1-2):3–18

    Article  Google Scholar 

  23. Ali W, Shamsuddin SM (2009) Intelligent client-side web caching scheme based on least recently used algorithm and neuro-fuzzy system. In: Proceedings of the 6th international symposium on neural networks (ISNN), pp 70–79

  24. Cobb J, ElAarag H (2008) Web proxy cache replacement scheme based on back-propagation neural network. J Syst Softw 81:1539–1558

    Article  Google Scholar 

  25. Romano S, ElAarag H (2011) A neural network proxy cache replacement strategy and its implementation in the squid proxy server. Neural Comput & Applic 20:59–78

    Article  Google Scholar 

  26. Sulaiman S, Shamsuddin SM, Forkan FB, Abraham A (2008) Intelligent web caching using neurocomputing and particle swarm optimization algorithm. In: Proceedings of the second Asia international conference on modelling and simulation (AMS), pp 642–647

  27. Crane R, Sornette D (2008) Robust dynamic classes revealed by measuring the response function of a social system. Natl Acad Sci Lett 105:15649–15653

    Article  Google Scholar 

  28. Trzcinski T, Rokita P (2017) Predicting popularity of online videos using support vector regression. IEEE Trans Multimedia 19:2561–2570

    Article  Google Scholar 

  29. Cha M, Kwak H, Rodriguez P, Ahn Y, Moon S (2009) Analyzing the video popularity characteristics of large-scale user generated content systems. IEEE/ACM Trans Networking 17(5):1357– 1370

    Article  Google Scholar 

  30. Tsagkias M, Weerkamp W, de Rijke M (2010) News comments: exploring, modeling, and online prediction. In: Proceedings of the advances in information retrieval, pp 191–203

  31. Ahmed M, Spagna S, Huici F, Niccolini S (2013) A peek into the future: predicting the evolution of popularity in user generated content. In: Proceedings of the sixth ACM international conference on web search and data mining (WSDM), pp 607–616

  32. Minet P, Ben Hassine N, Marinca D, Barth D (2016) Expert-based on-line learning and prediction in content delivery networks. In: Proceedings of the 12th international wireless communications and mobile computing conference (IWCMC), pp 182–187

  33. Ben Hassine N, Marinca D, Minet P, Barth D (2016) Caching strategies based on popularity prediction in content delivery networks. In: Proceedings of the 12th international conference on wireless and mobile computing, networking and communications (WiMob), pp 1–8

  34. Ben Hassine N, Minet P, Marinca D, Barth D (2015) Popularity prediction in content delivery networks. In: Proceedings of the 26th international symposium on personal, indoor, and mobile radio communications (PIMRC), pp 2083–2088

  35. Yu H, Zheng D, Zhao BY, Zheng W (2006) Understanding user behavior in large-scale video-on-demand systems. ACM SIGOPS Operating Systems Review 40(4):333–344

    Article  Google Scholar 

  36. Gorry PA (1990) General least-squares smoothing and differentiation by the convolution (savitzky-golay) method. Anal Chem 62(6):570–573

    Article  Google Scholar 

  37. Mattson RL, Gecsei J, Slutz DR, Traiger IL (1970) Evaluation techniques for storage hierarchies. IBM Syst J 9(2):78–117

    Article  MATH  Google Scholar 

  38. Van Roy B (2007) A short proof of optimality for the MIN cache replacement algorithm. Inf Process Lett 106(5):219–220

    MathSciNet  Google Scholar 

  39. Michaud P (2016) Some mathematical facts about optimal cache replacement. ACM Transactions on Architecture and Code Optimization 13(4):50:1–50:19

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pascale Minet.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ben Hassine, N., Minet, P., Marinca, D. et al. Popularity prediction–based caching in content delivery networks. Ann. Telecommun. 74, 351–364 (2019). https://doi.org/10.1007/s12243-018-00700-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12243-018-00700-8

Keywords

Navigation