skip to main content
10.1145/3123266.3123384acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

When Cloud Meets Uncertain Crowd: An Auction Approach for Crowdsourced Livecast Transcoding

Published: 19 October 2017 Publication History

Abstract

In the emerging crowd sourced live cast services, numerous amateur broadcasters live stream their video contents to worldwide viewers and constantly interact with them through chat messages. Live video contents are transcoded into multiple quality versions to better service viewers with different network and device configurations. Cloud computing becomes a natural choice to handle these computational intensive tasks due to its elasticity and the "pay-as-you-go" billing model. However, given the significantly large number of concurrent channel numbers and the diverse viewer geo-distributions in this new crowd sourced live cast service, even the cloud becomes significantly expensive to cover the whole community and inadequate in fulfilling the latency requirement. In this paper, after observing the abundant computational resources residing in end viewers, we propose a Cloud-Crowd collaborative system, C2, which combines end viewers with cloud to perform video transcoding in a cost-efficient way. To quantify the heterogeneity and uncertainty of viewers and pass the asymmetric information barrier, we incorporate statistical descriptions into our bidding language and design truthful auctions to recruit stable viewers with appropriate incentives. We further tailor redundancy strategies for workloads with different Quality of Service requirements to improve the stability of our system. Desirable economic properties, like social efficiency, ex-post incentive compatibility, individual rationality, are proved to be guaranteed in our studied scenarios. Using traces captured from the popular Twitch platform, we show that C2 achieves up to 93% more cost saving than a pure cloud-based solution, and significantly outperforms other baseline approaches in both social welfare and system stability.

References

[1]
Technical Report. https://goo.gl/qAS9wk.
[2]
Twitch Audience Statistics. http://twitchadvertising.tv/audience/, 2015.
[3]
Wowza Live Transcoding Engine. https://www.wowza.com/products/capabilities/live-transcoding, 2015.
[4]
Wowza Transcoder Performance Benchmark. https://www.wowza.com/docs/wowza-transcoder-performance-benchmark, 2015.
[5]
The iPhone's new chip should worry Intel. http://www.theverge.com/2016/9/16/12939310/iphone-7-a10-fusion-processor-apple-intel-future, 2016.
[6]
Twitch Retrospective. https://www.twitch.tv/year/2016, 2016.
[7]
Uploads Open Beta: Help shape the future of Uploads on Twitch. https://blog.twitch.tv/uploads-open-beta-now-live-aec0e1925989'sf37518783=1, 2016.
[8]
Steam Hardware Survey: March 2017. http://store.steampowered.com/hwsurvey, 2017.
[9]
R. K. Ahuja, T. L. Magnanti, and J. B. Orlin. Network flows: theory, algorithms, and applications. 1993.
[10]
R. Aparicio-Pardo, K. Pires, A. Blanc, and G. Simon. Transcoding live adaptive video streams at a massive scale in the cloud. 2015.
[11]
F. Chen, C. Zhang, F. Wang, and J. Liu. Crowdsourced live streaming over the cloud. In Proc. IEEE INFOCOM, 2015.
[12]
Y. Chen, J. Zhang, K. Wu, and Q. Zhang. Tames: A truthful auction mechanism for heterogeneous spectrum allocation. In Proc. IEEE INFOCOM, pages 180--184, 2013.
[13]
Z. Feng, Y. Zhu, Q. Zhang, L. M. Ni, and A. V. Vasilakos. Trac: Truthful auction for location-aware collaborative sensing in mobile crowdsourcing. In Proc. IEEE INFOCOM, pages 1231--1239, 2014.
[14]
G. Gao, H. Hu, Y. Wen, and C. Westphal. Resource provisioning and profit maximization for transcoding in clouds: A two-timescale approach. IEEE Trans. Multimedia, 2016.
[15]
G. Gao, Y. Wen, and C. Westphal. Dynamic resource provisioning with qos guarantee for video transcoding in online video sharing service. In Proc. ACM MM, pages 868--877, 2016.
[16]
P. Garcia Lopez, A. Montresor, D. Epema, A. Datta, T. Higashino, A. Iamnitchi, M. Barcellos, P. Felber, and E. Riviere. Edge-centric computing: Vision and challenges. ACM SIGCOMM Computer Communication Review, 45(5):37--42, 2015.
[17]
K. Gardner, S. Zbarsky, S. Doroudi, M. Harchol-Balter, and E. Hyytia. Reducing latency via redundant requests: Exact analysis. ACM SIGMETRICS Performance Evaluation Review, 43(1):347--360, 2015.
[18]
Q. He, C. Zhang, and J. Liu. Crowdtranscoding: Online video transcoding with massive viewers. IEEE Transactions on Multimedia, 19(6):1365--1375, 2017.
[19]
S. Ko, S. Park, and H. Han. Design analysis for real-time video transcoding on cloud systems. In Proc. ACM SAC, pages 1610--1615, 2013.
[20]
D. K. Krishnappa, M. Zink, and R. K. Sitaraman. Optimizing the video transcoding workflow in content delivery networks. In Proc. ACM MMSys, pages 37--48, 2015.
[21]
Z. Li, G. Xie, M. A. Kaafar, and K. Salamatian. User behavior characterization of a large-scale mobile live streaming system. In Proc. ACM WWW, pages 307--313, 2015.
[22]
H. Ma, B. Seo, and R. Zimmermann. Dynamic scheduling on video transcoding for mpeg dash in the cloud environment. In Proc. ACM MMSys, 2014.
[23]
M. Ma, L. Zhang, J. Liu, Z. Wang, W. Li, G. Hou, and L. Sun. Characterizing user behaviors in mobile personal livecast. In ACM NOSSDAV, pages 43--48, 2017.
[24]
B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas. Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics, pages 1273--1282, 2017.
[25]
N. Nisan and A. Ronen. Computationally feasible vcg mechanisms. J. Artif. Intell. Res.(JAIR), 29:19--47, 2007.
[26]
N. Nisan, T. Roughgarden, E. Tardos, and V. V. Vazirani. Algorithmic game theory, volume 1. Cambridge University Press Cambridge, 2007.
[27]
J. B. Orlin. A faster strongly polynomial minimum cost flow algorithm. Operations research, 41(2):338--350, 1993.
[28]
N. B. Shah, K. Lee, and K. Ramchandran. When do redundant requests reduce latency? IEEE Trans. Commu., 64(2):715--722, 2016.
[29]
S. Stein, E. Gerdinga, A. Rogersa, K. Larson, and N. Jennings. Algorithms and mechanisms for procuring services with uncertain durations using redundancy. Artificial Intelligence, 175:2021--2060, 2011.
[30]
Twitch. Twitch retrospective 2015. https://www.twitch.tv/year/2015, 2015.
[31]
A. Vulimiri, P. B. Godfrey, R. Mittal, J. Sherry, S. Ratnasamy, and S. Shenker. Low latency via redundancy. In Proc. ACM CoNEXT, pages 283--294, 2013.
[32]
B. Wang, X. Zhang, G. Wang, H. Zheng, and B. Y. Zhao. Anatomy of a personalized livestreaming system. In Proc. ACM IMC, pages 485--498, 2016.
[33]
H. Wang, R. Shea, X. Ma, F. Wang, and J. Liu. On design and performance of cloud-based distributed interactive applications. In Proc. IEEE ICNP, pages 37--46, 2014.
[34]
Z. Wang, L. Sun, C. Wu, W. Zhu, and S. Yang. Joint online transcoding and geo-distributed delivery for dynamic adaptive streaming. In Proc. IEEE INFOCOM, 2014.
[35]
J.-C. Wu, P. Huang, J. J. Yao, and H. H. Chen. A collaborative transcoding strategy for live broadcasting over peer-to-peer iptv networks. IEEE Transactions on Circuits and Systems for Video Technology, 21(2):220--224, 2011.
[36]
C. Zhang and J. Liu. On crowd sourced interactive live streaming: a twitch. tv-based measurement study. In ACM NOSSDAV, 2015.
[37]
W. Zhang, Y. Wen, J. Cai, and D. O. Wu. Toward transcoding as a service in a multimedia cloud: Energy-efficient job-dispatching algorithm. IEEE Trans. vehicular technology, 63(5):2002--2012, 2014.

Cited By

View all
  • (2023)Cost-Effective, Quality-Oriented Transcoding of Live-Streamed Video on Edge-ServersIEEE Transactions on Services Computing10.1109/TSC.2023.325642516:4(2503-2516)Online publication date: 1-Jul-2023
  • (2021)Augmented Queue-Based Transmission and Transcoding Optimization for Livecast Services Based on Cloud-Edge-Crowd IntegrationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.304785931:11(4470-4484)Online publication date: Nov-2021
  • (2021)A Universal Transcoding and Transmission Method for Livecast with Networked Multi-Agent Reinforcement LearningIEEE INFOCOM 2021 - IEEE Conference on Computer Communications10.1109/INFOCOM42981.2021.9488868(1-10)Online publication date: 10-May-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '17: Proceedings of the 25th ACM international conference on Multimedia
October 2017
2028 pages
ISBN:9781450349062
DOI:10.1145/3123266
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. auction mechanism
  2. cloud computing
  3. crowdsourced livecast transcoding
  4. edge computing
  5. uncertainty

Qualifiers

  • Research-article

Conference

MM '17
Sponsor:
MM '17: ACM Multimedia Conference
October 23 - 27, 2017
California, Mountain View, USA

Acceptance Rates

MM '17 Paper Acceptance Rate 189 of 684 submissions, 28%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Cost-Effective, Quality-Oriented Transcoding of Live-Streamed Video on Edge-ServersIEEE Transactions on Services Computing10.1109/TSC.2023.325642516:4(2503-2516)Online publication date: 1-Jul-2023
  • (2021)Augmented Queue-Based Transmission and Transcoding Optimization for Livecast Services Based on Cloud-Edge-Crowd IntegrationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.304785931:11(4470-4484)Online publication date: Nov-2021
  • (2021)A Universal Transcoding and Transmission Method for Livecast with Networked Multi-Agent Reinforcement LearningIEEE INFOCOM 2021 - IEEE Conference on Computer Communications10.1109/INFOCOM42981.2021.9488868(1-10)Online publication date: 10-May-2021
  • (2021)Collaborative Framework of Cloud Transcoding and Distribution Supporting Cost-Efficient Crowdsourced Live Streaming2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS53394.2021.00122(931-938)Online publication date: Dec-2021
  • (2020)Leveraging QoE Heterogenity for Large-Scale Livecaset SchedulingProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413918(3678-3686)Online publication date: 12-Oct-2020
  • (2020)When Crowd Meets Big Video Data: Cloud-Edge Collaborative Transcoding for Personal LivecastIEEE Transactions on Network Science and Engineering10.1109/TNSE.2018.28733117:1(42-53)Online publication date: 1-Jan-2020
  • (2019)Dynamic Priority-Based Resource Provisioning for Video Transcoding With Heterogeneous QoSIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.284035129:5(1515-1529)Online publication date: May-2019
  • (2018)Characterizing User Behaviors in Mobile Personal LivecastACM Transactions on Multimedia Computing, Communications, and Applications10.1145/321975114:3s(1-24)Online publication date: 31-Jul-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media