Yipeng Zhou
Skip Abstract Section
Abstract
Content distribution, especially the distribution of video content, unavoidably consumes bandwidth resources heavily. Internet content providers invest heavily in purchasing content distribution network (CDN) services. By deploying tens of thousands of edge servers close to end users, CDN companies are able to distribute content efficiently and effectively, but at considerable cost. Thus, it is of great importance to develop a new system that distributes content at a lower cost but comparable service quality. In lieu of expensive CDN systems, we implement a crowdsourcing-based content distribution system, Thunder Crystal, by renting bandwidth for content upload/download and storage for content cache from agents. This is a large-scale system with tens of thousands of agents, whose resources significantly amplify Thunder Crystal’s content distribution capacity. The involved agents are either from ordinary Internet users or enterprises. Monetary rewards are paid to agents based on their upload traffic so as to motivate them to keep contributing resources. As far as we know, this is a novel system that has not been studied or implemented before. This article introduces the design principles and implementation details before presenting the measurement study. In summary, with the help of agent devices, Thunder Crystal is able to reduce the content distribution cost by one half and amplify the content distribution capacity by 11 to 15 times.
- Henrik Abrahamsson and Mattias Nordmark. 2012. Program popularity and viewer behaviour in a large TV-on-Demand system. In Proceedings of the 2012 ACM Conference on Internet Measurement. ACM, New York, NY, 199--210. Google Scholar
Digital Library
- Vijay Kumar Adhikari, Yang Guo, Fang Hao, Matteo Varvello, Volker Hilt, Moritz Steiner, and Zhi-Li Zhang. 2012. Unreeling Netflix: Understanding and improving multi-CDN movie delivery. In Proceedings of the 2012 Annual IEEE International Conference on Computer Communications. IEEE, New York, NY, 1620--1628.Google ScholarCross Ref
- Athula Balachandran, Vyas Sekar, Aditya Akella, and Srinivasan Seshan. 2013. Analyzing the potential benefits of CDN augmentation strategies for Internet video workloads. In Proceedings of the 2013 ACM Conference on Internet Measurement. ACM, New York, NY, 43--56. Google ScholarDigital Library
- Zachary S. Bischof, John S. Otto, Mario A. Sánchez, John P. Rula, David R. Choffnes, and Fabián E. Bustamante. 2011. Crowdsourcing ISP characterization to the network edge. In Proceedings of the 1st ACM SIGCOMM Workshop on Measurements Up the Stack. ACM, New York, NY, 61--66. Google ScholarDigital Library
- Meeyoung Cha, Haewoon Kwak, Pablo Rodriguez, Yong-Yeol Ahn, and Sue Moon. 2007. I tube, you tube, everybody tubes: Analyzing the world’s largest user generated content video system. In Proceedings of the 2007 ACM Conference on Internet Measurement. ACM, New York, NY, 1--14. Google ScholarDigital Library
- Liang Chen, Yipeng Zhou, and Dah Ming Chiu. 2014. A lifetime model of online video popularity. In Proceedings of the 2014 Conference on Computer Communication and Networks. IEEE, Los Alamitos, CA, 1--8.Google ScholarCross Ref
- Liang Chen, Yipeng Zhou, Mi Jing, and Richard T. B. Ma. 2015. Thunder Crystal: A novel crowdsourcing-based content distribution platform. In Proceedings of the 2015 ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. ACM, New York, NY, 43--48. Google ScholarDigital Library
- Xiaowei Chen, Yixin Jiang, and Xiaowen Chu. 2010. Measurements, analysis and modeling of private trackers. In Proceedings of the 2010 IEEE 10th International Conference on Peer-to-Peer Computing. IEEE, Los Alamitos, CA, 1--10.Google ScholarCross Ref
- Cisco. 2012. Cisco Visual Networking Index: Forecast and Methodology, 2011--2016. White Paper. Cisco, San Jose, CA.Google Scholar
- Bram Cohen. 2003. Incentives build robustness in BitTorrent. In Proceedings of the Workshop on Economics of Peer-to-Peer Systems, Vol. 6. 68--72.Google Scholar
- Adriano Faggiani, Enrico Gregori, Luciano Lenzini, Valerio Luconi, and Alessio Vecchio. 2013. Network sensing through smartphone-based crowdsourcing. In Proceedings of the 2013 ACM Conference on Embedded Networked Sensor Systems. ACM, New York, NY, 1--2. Google ScholarDigital Library
- Bin Fan, Dah-Ming Chiu, and John Lui. 2006. The delicate tradeoffs in bittorrent-like file sharing protocol design. In Proceedings of the 2006 IEEE International Conference on Network Protocols. IEEE, Los Alamitos, CA, 239--248. Google ScholarDigital Library
- Tobias Hoßfeld, Michael Seufert, Matthias Hirth, Thomas Zinner, Phuoc Tran-Gia, and Raimund Schatz. 2011. Quantification of YouTube QoE via crowdsourcing. In Proceedings of the 2011 IEEE International Symposium on Multimedia. IEEE, Los Alamitos, CA, 494--499. Google ScholarDigital Library
- Cheng Huang, Angela Wang, Jin Li, and Keith W. Ross. 2008b. Measuring and evaluating large-scale CDNs. In Proceedings of the 2008 ACM Conference on Internet Measurement, Vol. 8. 15--29. Google Scholar
- Yan Huang, Tom Z. J. Fu, Dah-Ming Chiu, John Lui, and Cheng Huang. 2008a. Challenges, design and analysis of a large-scale P2P-VoD system. ACM SIGCOMM Computer Communication Review 38, 4, 375--388. Google ScholarDigital Library
- Adele Lu Jia, Raziur Rahman, Tamas Vinko, Johan A. Pouwelse, and Dick H. J. Epema. 2013. Systemic risk and user-level performance in private P2P communities. IEEE Transactions on Parallel and Distributed Systems 24, 12, 2503--2512. Google ScholarDigital Library
- Lorenzo Keller, Anh Le, Blerim Cici, Hulya Seferoglu, Christina Fragouli, and Athina Markopoulou. 2012. MicroCast: Cooperative video streaming on smartphones. In Proceedings of the 2012 International Conference on Mobile Systems, Applications, and Services. ACM, New York, NY, 57--70. Google ScholarDigital Library
- Rupa Krishnan, Harsha V. Madhyastha, Sridhar Srinivasan, Sushant Jain, Arvind Krishnamurthy, Thomas Anderson, and Jie Gao. 2009. Moving beyond end-to-end path information to optimize CDN performance. In Proceedings of the 2009 ACM Conference on Internet Measurement. ACM, New York, NY, 190--201. Google ScholarDigital Library
- Zhengye Liu, Prithula Dhungel, Di Wu, Chao Zhang, and Keith W. Ross. 2010a. Understanding and improving ratio incentives in private communities. In Proceedings of the 2010 IEEE International Conference on Distributed Computing Systems. IEEE, Los Alamitos, CA, 610--621. Google ScholarDigital Library
- Zimu Liu, Chuan Wu, Baochun Li, and Shuqiao Zhao. 2010b. UUSee: Large-scale operational on-demand streaming with random network coding. In Proceedings of the 2010 Annual IEEE International Conference on Computer Communications. IEEE, Los Alamitos, CA, 1--9. Google ScholarDigital Library
- George Pallis and Athena Vakali. 2006. Insight and perspectives for content delivery networks. Communications of the ACM 49, 1, 101--106. Google ScholarDigital Library
- Andrea Passarella. 2012. A survey on content-centric technologies for the current Internet: CDN and P2P solutions. Computer Communications 35, 1, 1--32. Google ScholarDigital Library
- Rameez Rahman, Tamás Vinkó, David Hales, Johan Pouwelse, and Henk Sips. 2011. Design space analysis for modeling incentives in distributed systems. ACM SIGCOMM Computer Communication Review 41, 4, 182--193. Google ScholarDigital Library
- Bo Tan and Laurent Massoulié. 2013. Optimal content placement for peer-to-peer video-on-demand systems. IEEE/ACM Transactions on Networking 21, 2, 566--579. Google ScholarDigital Library
- Stefano Traverso, Mohamed Ahmed, Michele Garetto, Paolo Giaccone, Emilio Leonardi, and Saverio Niccolini. 2013. Temporal locality in today’s content caching: Why it matters and how to model it. ACM SIGCOMM Computer Communication Review 43, 5, 5--12. Google ScholarDigital Library
- Chen-Chi Wu, Kuan-Ta Chen, Yu-Chun Chang, and Chin-Laung Lei. 2013. Crowdsourcing multimedia QoE evaluation: A trusted framework. IEEE Transactions on Multimedia 15, 5, 1121--1137. Google ScholarDigital Library
- Di Wu, Chao Liang, Yong Liu, and Keith Ross. 2009. View-upload decoupling: A redesign of multi-channel P2P video systems. In Proceedings of the 2009 International Conference on Computer Communications. IEEE, Los Alamitos, CA, 2726--2730.Google ScholarCross Ref
- Weijie Wu, Richard T. B. Ma, and John C. S. Lui. 2014. Distributed caching via rewarding: An incentive scheme design in P2P-VoD systems. IEEE Transactions on Parallel and Distributed Systems 25, 3, 612--621. Google ScholarDigital Library
- Libin Yang and Wei Lou. 2012. Pricing, competition and innovation: A profitable business model to resolve the tussle involved in peer-to-peer streaming applications. In Proceedings of the 2012 IEEE 20th International Workshop on Quality of Service. 1--9. Google ScholarDigital Library
- Hao Yin, Xuening Liu, Tongyu Zhan, Vyas Sekar, Feng Qiu, Chuang Lin, Hui Zhang, and Bo Li. 2009. Design and deployment of a hybrid CDN-P2P system for live video streaming: Experiences with LiveSky. In Proceedings of the 2009 International Conference on Multimedia. ACM, New York, NY, 25--34. Google ScholarDigital Library
- Cong Zhang and Jiangchuan Liu. 2015. On crowdsourced interactive live streaming: A Twitch.TV-based measurement study. In Proceedings of the 2015 ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. ACM, New York, NY, 55--60. Google ScholarDigital Library
- Bridge Qiao Zhao, John C. S. Lui, and Dah-Ming Chiu. 2012. A mathematical framework for analyzing adaptive incentive protocols in P2P networks. IEEE/ACM Transactions on Networking 20, 2, 367--380. Google ScholarDigital Library
- Yipeng Zhou, Liang Chen, Chunfeng Yang, and Dah Ming Chiu. 2015. Video popularity dynamics and its implication for replication. IEEE Transactions on Multimedia 17, 8, 1273--1285.Google ScholarDigital Library
- Yipeng Zhou, Tom Z. J. Fu, and Dah Ming Chiu. 2013. On replication algorithm in P2P VoD. IEEE/ACM Transactions on Networking 21, 1, 233--243. Google ScholarDigital Library
- Yipeng Zhou, Tom Z. J. Fu, and Dah Ming Chiu. 2015. A unifying model and analysis of P2P VoD replication and scheduling. IEEE/ACM Transactions on Networking 23, 4, 1163--1175. Google ScholarDigital Library
Index Terms
- Design, Implementation, and Measurement of a Crowdsourcing-Based Content Distribution Platform
Recommendations
Efficient content location algorithm for content distribution networks based on distributed construction of search tree from contents of proximal nodes
DBA'06: Proceedings of the 24th IASTED international conference on Database and applicationsContent distribution networks (CDNs) are a type of distributed database using geographically dispersed servers to efficiently distribute large multimedia contents. Among various kinds of CDNs are those resembling peer-to-peer (P2P) networks in which all ...
Comments