research-article

Learning-based Fuzzy Bitrate Matching at the Edge for Adaptive Video Streaming

Authors:

Yong JiangAuthors Info & Claims

WWW '22: Proceedings of the ACM Web Conference 2022

Pages 3289 - 3297

https://doi.org/10.1145/3485447.3511944

Published: 25 April 2022 Publication History

Abstract

The rapid growth of video traffic imposes significant challenges on content delivery over the Internet. Meanwhile, edge computing is developed to accelerate video transmission as well as release the traffic load of origin servers. Although some related techniques (e.g., transcoding and prefetching) are proposed to improve edge services, they cannot fully utilize cached videos. Therefore, we propose a Learning-based Fuzzy Bitrate Matching scheme (LFBM) at the edge for adaptive video streaming, which utilizes the capacity of network and edge servers. In accordance with user requests, cache states and network conditions, LFBM utilizes reinforcement learning to make a decision, either fetching the video of the exact bitrate from the origin server or responding with a different representation from the edge server. In the simulation, compared with the baseline, LFBM improves cache hit ratio by 128%. Besides, compared with the scheme without fuzzy bitrate matching, it improves Quality of Experience (QoE) by 45%. Moreover, the real-network experiments further demonstrate the effectiveness of LFBM. It increases the hit ratio by 84% compared with the baseline and improves the QoE by 51% compared with the scheme without fuzzy bitrate matching.

References

[1]

2016. dash.js. https://github.com/Dash-Industry-Forum/dash.js.

[2]

2018. Apache Traffic Server 8.0. https://trafficserver.apache.org/.

[3]

2019. LFBM. https://github.com/lfbmpaper/lfbm.

[4]

Zahaib Akhtar, Yun Seong Nam, Ramesh Govindan, Sanjay Rao, Jessica Chen, Ethan Katz-Bassett, and et.al Ribeiro. 2018. Oboe: Auto-Tuning Video ABR Algorithms to Network Conditions. In ACM SIGCOMM.

[5]

Daniel S Berger, Ramesh K Sitaraman, and Mor Harchol-Balter. 2017. AdaptSize: Orchestrating the Hot Object Memory Cache in a Content Delivery Network. In USENIX NSDI.

[6]

Muhammad Bilal and Shin-Gak Kang. 2014. Time Aware Least Recent Used (TLRU) Cache Management Policy in ICN. In IEEE ICACT.

[7]

Meeyoung Cha, Haewoon Kwak, Pablo Rodriguez, Yong-Yeol Ahn, and Sue Moon. 2007. I Tube, You Tube, Everybody Tubes: Analyzing the World’s Largest User Generated Content Video System. In ACM SIGCOMM.

[8]

Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A Scalable Tree Boosting System. In ACM SIGKDD.

Digital Library

[9]

Brent Chun, David Culler, Timothy Roscoe, Andy Bavier, Larry Peterson, Mike Wawrzoniak, and Mic Bowman. 2003. Planetlab: An Overlay Testbed for Broad-Coverage Services. ACM SIGCOMM Computer Communication Review 33, 3 (2003), 3–12.

Digital Library

[10]

VNI Cisco. 2018. Cisco Visual Networking Index: Forecast and Trends, 2017–2022. White Paper 1(2018), 1.

[11]

Federal Communications Commission. 2018. Measuring Broadband America - Eighth Report.

[12]

Mostafa Dehghan, Laurent Massoulie, Don Towsley, Daniel Menasche, and Yong Chiang Tay. 2019. A Utility Optimization Approach to Network Cache Design. IEEE/ACM Transactions on Networking 27, 3 (2019), 1013–1027.

Digital Library

[13]

Josep Domenech, Jose A Gil, Julio Sahuquillo, and Ana Pont. 2010. Using Current Web Page Structure to Improve Prefetching Performance. Elsevier Computer Networks 54, 9 (2010), 1404–1417.

Digital Library

[14]

Guanyu Gao, Weiwen Zhang, Yonggang Wen, Zhi Wang, and Wenwu Zhu. 2015. Towards Cost-Efficient Video Transcoding in Media Cloud: Insights Learned from User Viewing Patterns. IEEE Transactions on Multimedia 17, 8 (2015), 1286–1296.

Digital Library

[15]

Chithra D Gracia and S Sudha. 2016. A Case Study on Memory Efficient Prediction Models for Web Prefetching. In IEEE ICETETS.

[16]

Arthur E Hoerl and Robert W Kennard. 1970. Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics 12, 1 (1970), 55–67.

[17]

Wen Hu, Yichao Jin, Yonggang Wen, Zhi Wang, and Lifeng Sun. 2018. Towards Wi-Fi AP-Assisted Content Prefetching for On-Demand TV Series: A Reinforcement Learning Approach. IEEE TCSVT 28, 7 (2018), 1665–1676.

[18]

Tianchi Huang, Chao Zhou, Rui-Xiao Zhang, Chenglei Wu, Xin Yao, and Lifeng Sun. 2019. Comyco: Quality-Aware Adaptive Video Streaming via Imitation Learning. In ACM International Conference on Multimedia (MM).

Digital Library

[19]

Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2015. A Buffer-Based Approach to Rate Adaptation: Evidence from A Large Video Streaming Service. ACM SIGCOMM Computer Communication Review 44, 4 (2015), 187–198.

Digital Library

[20]

Yichao Jin, Yonggang Wen, and Cedric Westphal. 2015. Optimal Transcoding and Caching for Adaptive Streaming in Media Cloud: An Analytical Approach. IEEE Transactions on Circuits and Systems for Video Technology 25, 12(2015), 1914–1925.

Digital Library

[21]

Jaeyeon Jung, Arthur W Berger, and Hari Balakrishnan. 2003. Modeling TTL-Based Internet Caches. In IEEE INFOCOM.

[22]

Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. Lightgbm: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems.

[23]

Danny H Lee, Constantine Dovrolis, and Ali C Begen. 2014. Caching in HTTP Adaptive Streaming: Friend or Foe?. In ACM NOSSDAV.

[24]

Chenglin Li, Laura Toni, Junni Zou, Hongkai Xiong, and Pascal Frossard. 2018. QoE-Driven Mobile Edge Caching Placement for Adaptive Video Streaming. IEEE Transactions on Multimedia 20, 4 (2018), 965–984.

Digital Library

[25]

Zhenhua Li, Yan Huang, Gang Liu, Fuchen Wang, Zhi-Li Zhang, and Yafei Dai. 2012. Cloud Transcoder: Bridging the Format and Resolution Gap between Internet Videos and Mobile Devices. In ACM NOSSDAV.

Digital Library

[26]

Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In ACM SIGCOMM.

[27]

Cezar Pleşca, Vincent Charvillat, and Wei Tsang Ooi. 2016. Multimedia Prefetching with Optimal Markovian Policies. Journal of Network and Computer Applications 69 (2016), 40–53.

Digital Library

[28]

Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2013. Commute Path Bandwidth Traces from 3G Networks: Analysis and Applications. In ACM Multimedia Systems Conference (MMSys).

Digital Library

[29]

Aameek Singh, Abhishek Trivedi, Krithi Ramamritham, and Prashant Shenoy. 2004. PTC: Proxies that Transcode and Cache in Heterogeneous Web Client Environments. World Wide Web 7, 1 (2004), 7–28.

Digital Library

[30]

Kevin Spiteri, Rahul Urgaonkar, and Ramesh K Sitaraman. 2016. BOLA: Near-Optimal Bitrate Adaptation for Online Videos. In IEEE INFOCOM.

[31]

Yi Sun, Xiaoqi Yin, Junchen Jiang, Vyas Sekar, Fuyuan Lin, Nanshu Wang, Tao Liu, and Bruno Sinopoli. 2016. CS2P: Improving Video Bitrate Selection and Adaptation with Data-Driven Throughput Prediction. In ACM SIGCOMM.

[32]

Wei-Guang Teng, Cheng-Yue Chang, and Ming-Syan Chen. 2005. Integrating Web Caching and Web Prefetching in Client-Side Proxies. IEEE Transactions on Parallel and Distributed Systems 16, 5 (2005), 444–455.

Digital Library

[33]

Robert Tibshirani. 1996. Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society: Series B (Methodological) 58, 1(1996), 267–288.

[34]

Guohui Wang and TS Eugene Ng. 2010. The Impact of Virtualization on Network Performance of Amazon EC2 Data Center. In IEEE INFOCOM.

[35]

Yumei Wang, Xiaojiang Zhou, Mengyao Sun, Lin Zhang, and Xiaofei Wu. 2017. A New QoE-Driven Video Cache Management Scheme with Wireless Cloud Computing in Cellular Networks. Mobile Networks and Applications 22, 1 (2017), 72–82.

Digital Library

[36]

Zhi Wang, Lifeng Sun, Chuan Wu, Wenwu Zhu, and Shiqiang Yang. 2014. Joint Online Transcoding and Geo-Distributed Delivery for Dynamic Adaptive Streaming. In IEEE INFOCOM.

[37]

Susie J Wee and John G Apostolopoulos. 2001. Secure Scalable Video Streaming for Wireless Networks. In IEEE ICASSP.

[38]

T. Wiegand, G.J. Sullivan, G. Bjontegaard, and A. Luthra. 2003. Overview of the H.264/AVC Video Coding Standard. IEEE Transactions on Circuits and Systems for Video Technology 13, 7 (jul 2003), 560–576. https://doi.org/10.1109/tcsvt.2003.815165

Digital Library

[39]

Cheng-Zhong Xu and Tamer I Ibrahim. 2004. A Keyword-Based Semantic Prefetching Approach in Internet News Services. IEEE Transactions on Knowledge and Data Engineering 16, 5(2004), 601–611.

Digital Library

[40]

Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. ACM SIGCOMM Computer Communication Review 45, 4 (2015), 325–338.

Digital Library

[41]

Chen Zhong, M Cenk Gursoy, and Senem Velipasalar. 2018. A Deep Reinforcement Learning-Based Framework for Content Caching. In IEEE CISS.

Cited By

Hou BYang SLi FZhu LChen XWang YFu X(2024)NOVA: Neural-Optimized Viewport Adaptive 360-Degree Video Streaming at the EdgeIEEE Transactions on Services Computing10.1109/TSC.2024.345123717:6(4027-4040)Online publication date: Nov-2024
https://doi.org/10.1109/TSC.2024.3451237
Yaqoob AMuntean G(2024)FReD-ViQ: Fuzzy Reinforcement Learning Driven Adaptive Streaming Solution for Improved Video Quality of ExperienceIEEE Transactions on Network and Service Management10.1109/TNSM.2024.345001421:5(5532-5547)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1109/TNSM.2024.3450014
He QTan SChen FXu XQi LHei XJin HYang YChen HDuh WHuang HKato MMothe JPoblete B(2023)EDIndex: Enabling Fast Data Queries in Edge Storage SystemsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591676(675-685)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3591676
Show More Cited By

Index Terms

Learning-based Fuzzy Bitrate Matching at the Edge for Adaptive Video Streaming

Index terms have been assigned to the content through auto-classification.

Recommendations

Reinforcement Learning-Based HTTP Adaptive Streaming Scheme in Edge Computing Environments
Abstract
Dynamic Adaptive Streaming over HTTP (DASH) is a representative scheme to improve Quality of Experience (QoE) of video streaming users. However, the QoE fairness is degraded when multiple users stream videos over the same network. The reasons of ...
RL-based HTTP adaptive streaming with edge collaboration in multi-client environment
Abstract
Hypertext Transfer Protocol (HTTP) adaptive streaming aims to achieve high Quality of Experience (QoE) in video streaming. However, when multiple clients stream videos, QoE fairness and overall QoE deteriorate due to the lack of consideration for ...
Highlights
- Traditional HTTP adaptive streaming is inefficient in multi-client and dynamic network.
- Edge Collaboration can support HTTP Adaptive Streaming on a multi-client basis.
- Reinforcement learning-based quality adaptation can improve ...
HTTP adaptive streaming scheme based on reinforcement learning with edge computing assistance
Abstract
As the number of users and the types of videos viewed increase, seamless video streaming services are becoming more important. Adaptive streaming aims to achieve high Quality of Experience (QoE) in time-varying network conditions. ...
Highlights
- HTTP Adaptive Streaming.
- Edge Computing Assistance.

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Proceedings of the ACM Web Conference 2022

April 2022

3764 pages

ISBN:9781450390965

DOI:10.1145/3485447

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Elena Simperl
King’s College London, UK
,
Deepak Agarwal
Pinterest, USA
,
Aristides Gionis
KTH Royal Institute of Technology, Sweden
,
Ivan Herman
W3C / retired
,
Lionel Médini
Université Lyon 1, France

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Natural Science Foundation of China
Shenzhen Key Lab of Software Defined Networking
China Postdoctoral Science Foundation
Key-Area Research and Development Program of Guangdong Province
Social Science Fund of Shenzhen

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
367
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hou BYang SLi FZhu LChen XWang YFu X(2024)NOVA: Neural-Optimized Viewport Adaptive 360-Degree Video Streaming at the EdgeIEEE Transactions on Services Computing10.1109/TSC.2024.345123717:6(4027-4040)Online publication date: Nov-2024
https://doi.org/10.1109/TSC.2024.3451237
Yaqoob AMuntean G(2024)FReD-ViQ: Fuzzy Reinforcement Learning Driven Adaptive Streaming Solution for Improved Video Quality of ExperienceIEEE Transactions on Network and Service Management10.1109/TNSM.2024.345001421:5(5532-5547)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1109/TNSM.2024.3450014
He QTan SChen FXu XQi LHei XJin HYang YChen HDuh WHuang HKato MMothe JPoblete B(2023)EDIndex: Enabling Fast Data Queries in Edge Storage SystemsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591676(675-685)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3591676
Lin JWang S(2023)Improving robustness of learning-based adaptive video streaming in wildly fluctuating networks2023 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME55011.2023.00307(1787-1792)Online publication date: Jul-2023
https://doi.org/10.1109/ICME55011.2023.00307
Kong FCao TQian ZWang XZhao MWang LLin Z(2023)Joint Video Transcoding and Representation Selection for Edge-Assisted Multi-party Video ConferencingAlgorithms and Architectures for Parallel Processing10.1007/978-981-97-0834-5_22(380-400)Online publication date: 20-Oct-2023
https://dl.acm.org/doi/10.1007/978-981-97-0834-5_22

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten