research-article

Exploring interest correlation for peer-to-peer socialized video sharing

Authors:

Jiangchuan LiuAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 8, Issue 1

Article No.: 5, Pages 1 - 20

https://doi.org/10.1145/2071396.2071401

Published: 03 February 2012 Publication History

Abstract

The last five years have witnessed an explosion of networked video sharing, represented by YouTube, as a new killer Internet application. Their sustainable development however is severely hindered by the intrinsic limit of their client/server architecture. A shift to the peer-to-peer paradigm has been widely suggested with success already shown in live video streaming and movie-on-demand. Unfortunately, our latest measurement demonstrates that short video clips exhibit drastically different statistics, which would simply render these existing solutions suboptimal, if not entirely inapplicable.

Our long-term measurement over five million YouTube videos, on the other hand, reveals interesting social networks with strong correlation among the videos, thus opening new opportunities to explore. In this article, we present NetTube, a novel peer-to-peer assisted delivering framework that explores the user interest correlation for short video sharing. We address a series of key design issues to realize the system, including a bi-layer overlay, an efficient indexing scheme, a delay-aware scheduling mechanism, and a prefetching strategy leveraging interest correlation. We evaluate NetTube through both simulations and prototype experiments, which show that it greatly reduces the server workload, improves the playback quality and scales well.

References

[1]

Aggarwal, V., Caldebank, R., Gopalakrishnan, V., Jana, R., Ramakrishnan, K., and Yu, F. 2009. The effectiveness of intelligent scheduling for multicast video-on-demand. In Proceedings of the 17th ACM International Conference on Multimedia (MM). ACM, New York, NY, 421--430.

Digital Library

[2]

Albert, R., Jeong, H., and Barabási, A.-L. 1999. The diameter of the World Wide Web. Nature 401, 130--131.

[3]

Alexa. 2010. Youtube.com site info. http://www.alexa.com/siteinfo/youtube.com.

[4]

Benevenuto, F., Rodrigues, T., Cha, M., and Almeida, V. 2009. Characterizing user behavior in online social networks. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 49--62.

Digital Library

[5]

Blog, O. Y. 2009. Zoinks&excl; 20 hours of video uploaded every minute&excl; http://youtube-global.blogspot.com/2009/05/zoinks-20-hours-of-video-uploaded-every_20.html.

[6]

Bloom, B. 1970. Space/time trade-offs in hash coding with allowable errors. Comm. ACM 13, 7, 422--426.

Digital Library

[7]

Carter, L. 2008. Web could collapse as video demand soars. http://www.telegraph.co.uk/news/uknews/1584230/Web-could-collapse-as-video -demand-soars.html.

[8]

Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.-Y., and Moon, S. 2007. I tube, you tube, everybody tubes: Analyzing the world's largest user generated content video system. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 1--14.

Digital Library

[9]

Cha, M., Rodriguez, P., Crowcroft, J., Moon, S., and Amatriain, X. 2008. Watching television over an IP network. In Proceedings of the 8th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 71--84.

Digital Library

[10]

Cheng, X., Dale, C., and Liu, J. 2008. Statistics and social network of YouTube videos. In Proceedings of the 16th International Workshop on Quality of Service (IWQoS). IEEE, Los Alamitos, CA, 229--238.

[11]

Cheng, X. and Liu, J. 2009. NetTube: Exploring social networks for peer-to-peer short video sharing. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1152--1160.

[12]

Cheng, X., Liu, J., and Dale, C. 2010. Understanding the characteristics of internet short video sharing: A YouTube-based measurement study. IEEE Trans. Multimedia.

[13]

Corbett, C. 2006. Peering of video. http://www.nanog.org/mtg-0606/pdf/bill.norton.3.pdf.

[14]

Gill, P., Arlitt, M., Li, Z., and Mahanti, A. 2007. YouTube traffic characterization: A view from the edge. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 15--28.

Digital Library

[15]

Gopalakrishnan, V., Bhattacharjeey, B., Ramakrishnan, K., Jana, R., and Srivastava, D. 2009. CPM: Adaptive video-on-demand with cooperative peer assists and multicast. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 91--99.

[16]

Huang, C., Li, J., and Ross, K. 2007. Can internet video-on-demand be profitable&quest; In Proceedings of ACM SIGCOMM. ACM, New York, NY, 133--144.

Digital Library

[17]

Huang, Y., Fu, T. Z., Chiu, D.-M., Lui, J. C., and Huang, C. 2008. Challenges, design and analysis of a large-scale P2P-VoD system. In Proceedings of the ACM SIGCOMM. ACM, New York, NY, 375--388.

Digital Library

[18]

La Monica, P. R. 2006. Google to buy YouTube for $1.65 billion. http://money.cnn.com/2006/10/09/technology/googleyoutube_deal.

[19]

Lai, K. and Wang, D. 2010. The implication of external links on video sharing sites: Measurement and analysis. In Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY.

Digital Library

[20]

Liang, C., Guo, Y., and Liu, Y. 2009. Investigating the scheduling sensitivity of P2P video streaming: An experimental study. IEEE Trans. Multimedia 11, 3, 348--360.

Digital Library

[21]

Liu, J., Rao, S. G., Li, B., and Zhang, H. 2008. Opportunities and challenges of peer-to-peer Internet Video Broadcast. Proc. IEEE 96, 1, 11--24.

[22]

Liu, Z., Wu, C., Li, B., and Zhao, S. 2009. Distilling superior peers in large-scale P2P streaming systems. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 82--90.

[23]

Magharei, N. and Rejaie, R. 2009a. Overlay monitoring and repair in swarm-based peer-to-peer streaming. In Proceedings of the 19th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 25--30.

Digital Library

[24]

Magharei, N. and Rejaie, R. 2009b. PRIME: Peer-to-peer receiver-driven mesh-based streaming. IEEE/ACM Trans. Netw. 17, 4, 1052--1065.

Digital Library

[25]

Mislove, A., Marcon, M., Gummadi, K., Dreschel, P., and Bhattacharjee, B. 2007. Measurement and analysis of online social networks. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 29--42.

Digital Library

[26]

O'Reilly, T. 2005. What Is Web 2.0: Design patterns and business models for the next generation of software. http://www.oreilly.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html.

[27]

Qiu, X., Wu, C., Lin, X., and Lau, F. C. 2009. InstantLeap: Fast neighbor discovery in P2P VoD streaming. In Proceedings of the 19th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 19--24.

Digital Library

[28]

Rao, L. 2010. comScore: YouTube reaches all-time high of 14.6 billion videos viewed in May. http://techcrunch.com/2010/06/24/comscore-youtube-reaches-all-time-high-of-14-6-billion-videos-viewed-in-may.

[29]

Saxena, M., Sharan, U., and Fahmy, S. 2008. Analyzing video services in Web 2.0: A global perspective. In Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 39--44.

Digital Library

[30]

Schneider, F., Feldmann, A., Krishnamurthy, B., and Willinger, W. 2009. Understanding Online Social Network Usage from a Network Perspective. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 35--48.

Digital Library

[31]

Song, H. H., Cho, T. W., Dave, V., Zhang, Y., and Qiu, L. 2009. Scalable Proximity Estimation and Link Prediction in Online Social Networks. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 322--335.

Digital Library

[32]

Venkataraman, V., Yoshida, K., and Francis, P. 2006. Chunkyspread: Heterogeneous unstructured tree-based peer-to-peer multicast. In Proceedings of the 14th IEEE International Conference on Network Protocols (ICNP). IEEE, Los Alamitos, CA, 2--11.

Digital Library

[33]

Wang, F., Liu, J., and Xiong, Y. 2008. Stable peers: Existence, importance, and application in peer-to-peer live video streaming. In Proceedings of the 27th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1364--1372.

[34]

Watts, D. 1999. Small Worlds: the Dynamics of Networks Between Order and Randomness. Princeton University Press, Princeton, NJ.

Digital Library

[35]

Wu, C., Li, B., and Zhao, S. 2008. Multi-channel live P2P streaming: Refocusing on servers. In Proceedings of the 27th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1355--1363.

[36]

Wu, D., Liang, C., Liu, Y., and Ross, K. 2009. View-upload decoupling: A redesign of multi-channel P2P video systems. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 2726--2730.

[37]

Yen, Y.-W. 2008. YouTube looks for the money clip. http://techland.blogs.fortune.cnn.com/2008/03/25/youtube-looks-for-the-money-clip.

[38]

Yin, H., Liu, X., Qiu, F., Xia, N., Lin, C., Zhang, H., Sekar, V., and Min, G. 2009. Inside the bird's Nest: Measurements of large-scale live VoD from the 2008 Olympics. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 442--455.

Digital Library

[39]

Zhang, X., Liu, J., Li, B., and Yum, T.-S. P. 2005. CoolStreaming/DONet: A data-driven overlay network for peer-to-peer live media streaming. In Proceedings of the 24th IEEE Conference on Computer Communications (INFOCOM). Vol. 3. IEEE, Los Alamitos, CA, NJ, 2102--2111.

Cited By

Tran HWon YKim J(2017)An efficient hybrid push-pull methodology for peer-to-peer video live streaming system on mobile broadcasting social mediaMultimedia Tools and Applications10.1007/s11042-016-3249-x76:2(2557-2568)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1007/s11042-016-3249-x
Maqsood TKhalid OIrfan RMadani SKhan S(2016)Scalability Issues in Online Social NetworksACM Computing Surveys10.1145/296821649:2(1-42)Online publication date: 16-Sep-2016
https://dl.acm.org/doi/10.1145/2968216
Zuo XIamnitchi A(2016)A Survey of Socially Aware Peer-to-Peer SystemsACM Computing Surveys10.1145/289476149:1(1-28)Online publication date: 12-May-2016
https://dl.acm.org/doi/10.1145/2894761
Show More Cited By

Index Terms

Exploring interest correlation for peer-to-peer socialized video sharing
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Peer-to-peer delivery system for short video sharing
SpringSim '10: Proceedings of the 2010 Spring Simulation Multiconference

Peer-to-peer streaming applications are recently emerged successes that are able to serve users adequately on large scales. Recently, multimedia streaming of the user generated media content has been highly demanded for instance on YouTube. P2P systems ...
Interest-Intended Piece Selection in BitTorrent-like peer-to-peer file sharing systems

BitTorrent is a popular peer-to-peer file sharing system and a target file shared through BitTorrent is partitioned into pieces and downloaded from multiple peers in parallel in order to shorten the download process. However, due to peer dynamics in P2P ...
An alliance based peering scheme for peer-to-peer live media streaming
P2P-TV '07: Proceedings of the 2007 workshop on Peer-to-peer streaming and IP-TV

Peer-to-Peer (P2P) streaming has emerged as a scalable method for media distribution in recent years. While recent measurement studies have shown the effectiveness of P2P network in media streaming, there have been questions raised about the Quality of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 8, Issue 1

January 2012

149 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2071396

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 February 2012

Accepted: 01 July 2010

Revised: 01 June 2010

Received: 01 February 2010

Published in TOMM Volume 8, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
529
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tran HWon YKim J(2017)An efficient hybrid push-pull methodology for peer-to-peer video live streaming system on mobile broadcasting social mediaMultimedia Tools and Applications10.1007/s11042-016-3249-x76:2(2557-2568)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1007/s11042-016-3249-x
Maqsood TKhalid OIrfan RMadani SKhan S(2016)Scalability Issues in Online Social NetworksACM Computing Surveys10.1145/296821649:2(1-42)Online publication date: 16-Sep-2016
https://dl.acm.org/doi/10.1145/2968216
Zuo XIamnitchi A(2016)A Survey of Socially Aware Peer-to-Peer SystemsACM Computing Surveys10.1145/289476149:1(1-28)Online publication date: 12-May-2016
https://dl.acm.org/doi/10.1145/2894761
Hu HWen YChua THuang JZhu WLi X(2016)Joint Content Replication and Request Routing for Social Video Distribution Over Cloud CDN: A Community Clustering MethodIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2015.245571226:7(1320-1333)Online publication date: Jul-2016
https://doi.org/10.1109/TCSVT.2015.2455712
Cheng XFatourechi MMa XZhang CZhang LLiu J(2014)Insight Data of YouTube from a Partner's ViewProceedings of Network and Operating System Support on Digital Audio and Video Workshop10.1145/2597176.2578274(73-78)Online publication date: 19-Mar-2014
https://dl.acm.org/doi/10.1145/2597176.2578274
Cheng XFatourechi MMa XZhang CZhang LLiu J(2014)Insight Data of YouTube from a Partner's ViewProceedings of Network and Operating System Support on Digital Audio and Video Workshop10.1145/2578260.2578274(73-78)Online publication date: 19-Mar-2014
https://dl.acm.org/doi/10.1145/2578260.2578274
Qingbo Hu Guan Wang Yu P(2014)Assessing the longevity of online videos: A new insight of a video's quality2014 International Conference on Data Science and Advanced Analytics (DSAA)10.1109/DSAA.2014.7058044(1-10)Online publication date: Oct-2014
https://doi.org/10.1109/DSAA.2014.7058044
Le Chang Jianping Pan Min Xing (2013)Effective Utilization of User Resources in PA-VoD Systems with Channel HeterogeneityIEEE Journal on Selected Areas in Communications10.1109/JSAC.2013.SUP.051302031:9(227-236)Online publication date: Sep-2013
https://doi.org/10.1109/JSAC.2013.SUP.0513020
Yu HChang Y(2013)How to Influence the Brand Attitude of the Audience by Micro-FilmsJournal of Promotion Management10.1080/10496491.2013.83924219:5(674-686)Online publication date: Nov-2013
https://doi.org/10.1080/10496491.2013.839242
Chang LPan J(2012)Towards the optimal caching strategies of peer-assisted VoD systems with HD channelsProceedings of the 2012 20th IEEE International Conference on Network Protocols (ICNP)10.1109/ICNP.2012.6459975(1-10)Online publication date: 30-Oct-2012
https://dl.acm.org/doi/10.1109/ICNP.2012.6459975

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents