Skip to main content
SpringerLink
Log in

Pre-allocation based flash crowd mitigation algorithm for large-scale content delivery system

  • Published:
Peer-to-Peer Networking and Applications Aims and scope Submit manuscript

Abstract

A burst of requests may starve the upload capacity of server and degrade the Quality of Service (QoS) when a popular or time-critical content is released in content delivery system. With an enormous volume of popular content available in the network, as well as the growing size of online users, the previous improvement of download protocol is far from enough to handle the flash crowd in large-scale system. In this paper, a novel flash crowd mitigation algorithm called Peer Assisted Pre-allocation (PAPA) is proposed from a new perspective, in which “proactive” strategies are provided to handle sudden workload of the system. Through numerical simulation and practical experiment in download platform of Tencent, it is proved that benefited from the collaboration of servers and helpers, PAPA is able to save the peak server bandwidth by over 30 % and thus greatly reduce the operating costs of system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Yu T, Tian C, Jiang H, Liu W (2011) Measurements and analysis of an unconstrained user generated content system. In: IEEE international conference on communications (ICC). IEEE, pp 1–5

  2. Shaikh A, Sahu S, Rosu MC, Shea M, Saha D (2006) On demand platform for online games. IBM Syst J 45(1):7–19

    Article  Google Scholar 

  3. Huang Y, Fu TZJ, Chiu DM, Lui J, Huang C (2008) Challenges, design and analysis of a large-scale p2p-vod system. In: ACM SIGCOMM computer communication review, vol 38. ACM, pp 375–388

  4. Legout A, Urvoy-Keller G, Michiardi P (2006) Rarest first and choke algorithms are enough. In: Proceedings of the 6th ACM SIGCOMM conference on internet measurement. ACM, pp 203–216

  5. Zhang B, Iosup A, Pouwelse J, Epema D (2011) Identifying, analyzing, and modeling flashcrowds in bittorrent. In: IEEE international conference on peer-to-peer computing (P2P). IEEE, pp 240–249

  6. D’Acunto L, Vinkó T, Sips H (2011) Bandwidth allocation in bittorrent-like vod systems under flashcrowds. In: IEEE international conference on peer-to-peer computing (P2P). IEEE, pp 192–201

  7. Wu CJ, Li CY, Yang KH, Ho JM, Chen MS (2009) Time-critical data dissemination in cooperative peer-to-peer systems. In: Global Telecommunications Conference. (GLOBECOM 2009). IEEE, pp 1–6

  8. Huang Y, Li Z, Liu G, Dai Y (2011) Cloud download: using cloud utilities to achieve high-quality content distribution for unpopular videos. In: Proceedings of the 19th ACM international conference on multimedia, MM ’11

  9. Yingying X, Ao N, Huang D, Zhao Y, Changjia C (2013) Advanced user-based interaction model in cloud. China Commun 10(4):126–134

    Article  Google Scholar 

  10. Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 426–434

  11. Tan CW, Chiu DM, Lui JCS, Yau DKY (2007) A distributed throttling approach for handling high bandwidth aggregates. IEEE Trans Parallel Distrib Syst 18(7):983–995

    Article  Google Scholar 

  12. Xie L, Smith P, Hutchison D, Banfield M, Leopold H, Jabbar A, Sterbenz JPG (2008) From detection to remediation: a self-organized system for addressing flash crowd problems. In: IEEE international conference on communications. ICC’08. IEEE, pp 5809–5814

  13. Chen Y, Zhang B, Chen C (2011) Modeling and performance analysis of p2p live streaming systems under flash crowds. In: IEEE international conference on communications (ICC). IEEE, pp 1–5

  14. Chang L, Pan J (2012) Towards the optimal caching strategies of peer-assisted vod systems with hd channels. In: 2012 20th IEEE international conference on network protocols (ICNP). IEEE, pp 1–10

  15. Weijie W, Lui JCS (2012) Exploring the optimal replication strategy in p2p-vod systems: characterization and evaluation. IEEE Trans Parallel Distrib Syst 23(8):1492–1503

    Article  Google Scholar 

  16. Qiu D, Srikant R (2004) Modeling and performance analysis of bittorrent-like peer-to-peer networks. In: ACM SIGCOMM computer communication review, vol 34. ACM, pp 367–378

  17. Tencent (2013) The qqcyclone platform. http://xf.qq.com/

Download references

Acknowledgments

This work was supported in part by the National Science Foundation of China under Grant No. 61271199 and the Fundamental Research Funds in Beijing Jiaotong University under Grant No. W11JB00630.

Author information

Authors and Affiliations

  1. Network and Information Security Research Department, Electronic Technology Information Research Institute, MIIT, No. 35, Lugu Road, Shijingshan District, Beijing, 100040, China

    Dan Huang

  2. Technology Innovation Center, China Telecom, East Place, Tianyin Building A, Xicheng District, Beijing, 100031, China

    Min Zhang

  3. Network Technology Research Institute, China United Network Communications Corporation Limited, No. 9, Shouti Nanlu, Haidian District, Beijing, 100048, China

    Yi Zheng

  4. School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing, 100044, China

    Changjia Chen

  5. Tencent Research, Shanghai, China

    Yan Huang

Authors
  1. Dan Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Changjia Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yan Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dan Huang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, D., Zhang, M., Zheng, Y. et al. Pre-allocation based flash crowd mitigation algorithm for large-scale content delivery system. Peer-to-Peer Netw. Appl. 8, 493–500 (2015). https://doi.org/10.1007/s12083-014-0272-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12083-014-0272-4

Keywords

Search

Navigation