ABSTRACT
We report XLINK, a multi-path QUIC video transport solution with experiments in Taobao short videos. XLINK is designed to meet two operational challenges at the same time: (1) Optimized user-perceived quality of experience (QoE) in terms of robustness, smoothness, responsiveness, and mobility and (2) Minimized cost overhead for service providers (typically CDNs). The core of XLINK is to take the opportunity of QUIC as a user-space protocol and directly capture user-perceived video QoE intent to control multi-path scheduling and management. We overcome major hurdles such as multi-path head-of-line blocking, network heterogeneity, and rapid link variations and balance cost and performance.
To the best of our knowledge, XLINK is the first large-scale experimental study of multi-path QUIC video services in production environments. We present the results of over 3 million e-commerce product short-video plays from consumers who upgraded to Taobao android app with XLINK. Our study shows that compared to single-path QUIC, XLINK achieved 19 to 50% improvement in the 99-th percentile video-chunk request completion time, 32% improvement in the 99-th percentile first-video-frame latency, 23 to 67% improvement in the re-buffering rate at the expense of 2.1% redundant traffic.
Supplemental Material
Available for Download
XLINK: QoE-Driven Multi-Path QUIC Transport in Large-scale Video Services: Public Review
- Amazon product videos. https://videoreviewlabs.com/amazon-product-videos/, 2020.Google Scholar
- Target China. WHAT IS "INTERNET CELEBRITY ECONOMY" IN CHINA. https://targetchina.com.au/article/internet-celebrity, 2020.Google Scholar
- Wikipedia. Ryan's World. https://en.wikipedia.org/wiki/Ryan%27s_World, 2020.Google Scholar
- Alan Ford, Costin Raiciu, Mark J. Handley, and Olivier Bonaventure. TCP Extensions for Multipath Operation with Multiple Addresses. RFC 6824, January 2013.Google ScholarDigital Library
- Ashkan Nikravesh, Yihua Guo, Xiao Zhu, Feng Qian, and Z Morley Mao. Mp-h2: a client-only multipath solution for http/2. In The 25th Annual International Conference on Mobile Computing and Networking, pages 1--16, 2019.Google ScholarDigital Library
- Costin Raiciu, Christoph Paasch, Sebastien Barre, Alan Ford, Michio Honda, Fabien Duchene, Olivier Bonaventure, and Mark Handley. How hard can it be? designing and implementing a deployable multipath {TCP}. In 9th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 12), pages 399--412, 2012.Google Scholar
- Quentin De Coninck and Olivier Bonaventure. Multipath Extensions for QUIC (MP-QUIC). Internet-Draft draft-deconinck-quic-multipath-06, Internet Engineering Task Force, November 2020. Work in Progress.Google Scholar
- Yihua Ethan Guo, Ashkan Nikravesh, Z Morley Mao, Feng Qian, and Subhabrata Sen. Accelerating multipath transport through balanced subflow completion. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking, pages 141--153, 2017.Google ScholarDigital Library
- List of Android smartphones. https://en.wikipedia.org/wiki/List_of_Android_smartphones, 2020.Google Scholar
- Adam Langley, Alistair Riddoch, Alyssa Wilk, Antonio Vicente, Charles Krasic, Dan Zhang, Fan Yang, Fedor Kouranov, Ian Swett, Janardhan Iyengar, et al. The quic transport protocol: Design and internet-scale deployment. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication, pages 183--196, 2017.Google ScholarDigital Library
- Yanmei Liu, Yunfei Ma, Christian Huitema, Qing An, and Zhenyu Li. Multipath Extension for QUIC. Internet-Draft draft-liu-multipath-quic-02, Internet Engineering Task Force, December 2020. Work in Progress.Google Scholar
- Quentin De Coninck and Olivier Bonaventure. Multipath quic: Design and evaluation. In Proceedings of the 13th international conference on emerging networking experiments and technologies, pages 160--166, 2017.Google ScholarDigital Library
- Christian Huitema. QUIC Multipath Negotiation Option. Internet-Draft draft-huitema-quic-mpath-option-00, Internet Engineering Task Force, October 2020. Work in Progress.Google Scholar
- IETF mail archive. https://mailarchive.ietf.org/arch/browse/quic/, 2020.Google Scholar
- Spencer Dawkins. Questions for Multiple Paths In QUIC. Internet-Draft draft-dawkins-quic-multipath-questions-01, Internet Engineering Task Force, January 2021. Work in Progress.Google Scholar
- Improving Network Reliability Using Multipath TCP. https://developer.apple.com/documentation/foundation/urlsessionconfiguration/improving_network_reliability_using_multipath_tcp, 2020.Google Scholar
- Li Li, Ke Xu, Tong Li, Kai Zheng, Chunyi Peng, Dan Wang, Xiangxiang Wang, Meng Shen, and Rashid Mijumbi. A measurement study on multi-path tcp with multiple cellular carriers on high speed rails. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, SIGCOMM '18, 2018.Google ScholarDigital Library
- Yeon-sup Lim, Erich M. Nahum, Don Towsley, and Richard J. Gibbens. Ecf: An mptcp path scheduler to manage heterogeneous paths. In Proceedings of the 13th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT '17, 2017.Google Scholar
- S. Ferlin, Ö. Alay, O. Mehani, and R. Boreli. Blest: Blocking estimation-based mptcp scheduler for heterogeneous networks. In 2016 IFIP Networking Conference (IFIP Networking) and Workshops, 2016.Google ScholarCross Ref
- Hang Shi, Yong Cui, Xin Wang, Yuming Hu, Minglong Dai, Fanzhao Wang, and Kai Zheng. STMS: Improving MPTCP throughput under heterogeneous networks. In 2018 USENIX Annual Technical Conference (USENIX ATC 18), 2018.Google Scholar
- Keith Winstein, Anirudh Sivaraman, and Hari Balakrishnan. Stochastic forecasts achieve high throughput and low delay over cellular networks. In Presented as part of the 10th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 13), pages 459--471, 2013.Google Scholar
- Apple uses Multipath TCP. http://blog.multipath-tcp.org/blog/html/2018/12/15/apple_and_multipath_tcp.html, 2018.Google Scholar
- ACM code of ethics and professional conduct. https://www.acm.org/code-of-ethics, 2020.Google Scholar
- A.O. Scott. Two minute geniuses. https://www.nytimes.com/interactive/2020/12/09/magazine/tiktok-twitter-internet-video.html, 2020.Google Scholar
- Promote your eBay items with videos. https://www.thebalancesmb.com/promote-your-items-with-ebay-videos-1140577, 2019.Google Scholar
- Redfin. https://www.redfin.com/, 2020.Google Scholar
- S. Shunmuga Krishnan and Ramesh K. Sitaraman. Video stream quality impacts viewer behavior: Inferring causality using quasi-experimental designs. In Proceedings of the 2012 Internet Measurement Conference, IMC '12, 2012.Google ScholarDigital Library
- Recommended video bitrates for HDR uploads. https://support.google.com/youtube/answer/1722171?hl=en#zippy=%2Cbitrate, 2020.Google Scholar
- Jan Rüth, Ingmar Poese, Christoph Dietzel, and Oliver Hohlfeld. A first look at quic in the wild. In International Conference on Passive and Active Network Measurement, pages 255--268. Springer, 2018.Google ScholarCross Ref
- How Facebook is bringing QUIC to billions. https://engineering.fb.com/2020/10/21/networking-traffic/how-facebook-is-bringing-quic-to-billions, 2020.Google Scholar
- Multipath TCP and load balancers. http://blog.multipath-tcp.org/blog/html/2018/10/04/mptcp_load_balancers.html, 2018.Google Scholar
- Quentin De Coninck and Olivier Bonaventure. Observing network handovers with multipath tcp. In Proceedings of the ACM SIGCOMM 2018 Conference on Posters and Demos, pages 54--56, 2018.Google ScholarDigital Library
- Alireza Keshavarz-Haddad, Ehsan Aryafar, Michael Wang, and Mung Chiang. Hetnets selection by clients: convergence, efficiency, and practicality. IEEE/ACM Transactions on Networking, 25(1):406--419, 2016.Google ScholarDigital Library
- Jana Iyengar and Martin Thomson. QUIC: A UDP-Based Multiplexed and Secure Transport. Internet-Draft draft-ietf-quic-transport-33, Internet Engineering Task Force, December 2020. Work in Progress.Google Scholar
- Mansoor Shafi, Andreas F Molisch, Peter J Smith, Thomas Haustein, Peiying Zhu, Prasan De Silva, Fredrik Tufvesson, Anass Benjebbour, and Gerhard Wunder. 5g: A tutorial overview of standards, trials, challenges, deployment, and practice. IEEE journal on selected areas in communications, 35(6):1201--1221, 2017.Google Scholar
- Dongzhu Xu, Anfu Zhou, Xinyu Zhang, Guixian Wang, Xi Liu, Congkai An, Yiming Shi, Liang Liu, and Huadong Ma. Understanding operational 5g: A first measurement study on its coverage, performance and energy consumption. In Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication, pages 479--494, 2020.Google ScholarDigital Library
- 5G vs. Wi-Fi 6: A Powerful Combination for Wireless. https://www.intel.com/content/www/us/en/wireless-network/5g-technology/5g-vs-wifi.html, 2020.Google Scholar
- 3GPP release 16. https://www.3gpp.org/release-16, 2020.Google Scholar
- Mohamed Boucadair, Olivier Bonaventure, Maxime Piraux, Quentin De Coninck, Spencer Dawkins, Mirja Kühlewind, Markus Amend, Andreas Kassler, Qing An, Nicolas Keukeleire, and SungHoon Seo. 3GPP Access Traffic Steering Switching and Splitting (ATSSS) - Overview for IETF Participants. Internet-Draft draft-bonaventure-quic-atsss-overview-00, Internet Engineering Task Force, May 2020. Work in Progress.Google Scholar
- Ravi Netravali, Anirudh Sivaraman, Somak Das, Ameesh Goyal, Keith Winstein, James Mickens, and Hari Balakrishnan. Mahimahi: Accurate record-and-replay for {HTTP}. In 2015 {USENIX} Annual Technical Conference ({USENIX}{ATC} 15), pages 417--429, 2015.Google Scholar
- Sadjad Fouladi, John Emmons, Emre Orbay, Catherine Wu, Riad S Wahby, and Keith Winstein. Salsify: Low-latency network video through tighter integration between a video codec and a transport protocol. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18), pages 267--282, 2018.Google Scholar
- Amazon CloudFront pricing. https://aws.amazon.com/cloudfront/pricing/, 2020.Google Scholar
- Shuo Deng, Ravi Netravali, Anirudh Sivaraman, and Hari Balakrishnan. Wifi, lte, or both? measuring multi-homed wireless internet performance. In Proceedings of the 2014 Conference on Internet Measurement Conference, pages 181--194, 2014.Google ScholarDigital Library
- Martin Duke and Nick Banks. QUIC-LB: Generating Routable QUIC Connection IDs. Internet-Draft draft-duke-quic-load-balancers-06, Internet Engineering Task Force, November 2019. Work in Progress.Google Scholar
- XQUIC is the Alibaba's implementation of the IETF QUIC protocol. https://xquic.org/, 2020.Google Scholar
- Bo Han, Feng Qian, Lusheng Ji, and Vijay Gopalakrishnan. Mp-dash: Adaptive video streaming over preference-aware multipath. In Proceedings of the 12th International on Conference on Emerging Networking EXperiments and Technologies, CoNEXT '16, pages 129--143, 2016.Google ScholarDigital Library
- Bo Han, Feng Qian, Shuai Hao, and Lusheng Ji. An anatomy of mobile web performance over multipath tcp. In Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies, CoNEXT '15, 2015.Google ScholarDigital Library
- . https://developer.android.com/reference/android/os/BatteryManager, 2020.Google Scholar
- QUIC at 10,000 feet. https://docs.google.com/document/d/1gY9-YNDNAB1eip-RTPbqphgySwSNSDHLq9D5Bty4FSU/edit, 2020.Google Scholar
- QUIC IETF working group. https://datatracker.ietf.org/wg/quic/about/, 2020.Google Scholar
- Spencer Dawkins. What To Do With Multiple Active Paths in QUIC. Internet-Draft draft-dawkins-quic-what-to-do-with-multipath-03, Internet Engineering Task Force, January 2021. Work in Progress.Google Scholar
- T. Viernickel, A. Froemmgen, A. Rizk, B. Koldehofe, and R. Steinmetz. Multipath quic: A deployable multipath transport protocol. In 2018 IEEE International Conference on Communications (ICC), 2018.Google ScholarCross Ref
- Quentin De Coninck, François Michel, Maxime Piraux, Florentin Rochet, Thomas Given-Wilson, Axel Legay, Olivier Pereira, and Olivier Bonaventure. Pluginizing quic. In Proceedings of the ACM Special Interest Group on Data Communication, SIGCOMM '19, 2019.Google ScholarDigital Library
- Yung-Chih Chen, Yeon-sup Lim, Richard J. Gibbens, Erich M. Nahum, Ramin Khalili, and Don Towsley. A measurement-based study of multipath tcp performance over wireless networks. In Proceedings of the 2013 Conference on Internet Measurement Conference, IMC '13, 2013.Google ScholarDigital Library
- Swetank Kumar Saha, Shivang Aggarwal, Rohan Pathak, Dimitrios Koutsonikolas, and Joerg Widmer. Musher: An agile multipath-tcp scheduler for dual-band 802.11ad/ac wireless lans. In The 25th Annual International Conference on Mobile Computing and Networking, MobiCom '19, 2019.Google ScholarDigital Library
- HyunJong Lee, Jason Flinn, and Basavaraj Tonshal. Raven: Improving interactive latency for the connected car. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking, MobiCom '18, 2018.Google Scholar
- Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. Neural adaptive video streaming with pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication, SIGCOMM '17, 2017.Google ScholarDigital Library
- Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. A control-theoretic approach for dynamic adaptive video streaming over http. 2015.Google ScholarDigital Library
- Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. In Proceedings of the 2014 ACM Conference on SIGCOMM, SIGCOMM '14, 2014.Google ScholarDigital Library
- Anfu Zhou, Huanhuan Zhang, Guangyuan Su, Leilei Wu, Ruoxuan Ma, Zhen Meng, Xinyu Zhang, Xiufeng Xie, Huadong Ma, and Xiaojiang Chen. Learning to coordinate video codec with transport protocol for mobile video telephony. In The 25th Annual International Conference on Mobile Computing and Networking, pages 1--16, 2019.Google ScholarDigital Library
- Xavier Corbillon, Ramon Aparicio-Pardo, Nicolas Kuhn, Géraldine Texier, and Gwendal Simon. Cross-layer scheduler for video streaming over mptcp. In Proceedings of the 7th International Conference on Multimedia Systems, MMSys '16, 2016.Google ScholarDigital Library
- Damon Wischik, Costin Raiciu, Adam Greenhalgh, and Mark Handley. Design, implementation and evaluation of congestion control for multipath tcp. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, NSDI'11, 2011.Google ScholarDigital Library
- R. Netravali A. Sivaraman and K. J. Winstein. Mpshell. https://github.com/ravinet/mahimahi/releases/tag/old%2Fmpshell_scripted, 2020.Google Scholar
- Keith Winstein, Anirudh Sivaraman, and Hari Balakrishnan. Stochastic forecasts achieve high throughput and low delay over cellular networks. In 10th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 13), pages 459--471, 2013.Google Scholar
Index Terms
- XLINK: QoE-driven multi-path QUIC transport in large-scale video services
Recommendations
WTCP: a reliable transport protocol for wireless wide-area networks
Selected Papers from Mobicom'99Wireless wide-area networks (WWANs) are characterized by very low and variable bandwidths, very high and variable delays, significant non-congestion related losses, asymmetric uplink and downlink channels, and occasional blackouts. Additionally, the ...
Quickly Starting Media Streams Using QUIC
PV '18: Proceedings of the 23rd Packet Video WorkshopOriginally proposed by Google, QUIC is a low-latency transport protocol currently being developed and specified in the IETF. QUIC's low-latency, improved congestion control, multiplexing features are promising and may help improve viewer experience in ...
Not so QUIC: A Performance Study of DASH over QUIC
NOSSDAV'17: Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and VideoDespite known QoE shortcomings, Dynamic Adaptive Streaming over HTTP (DASH) has been tied with TCP for many years now. The advent of HTTP/2 powered by transport protocols such as QUIC provides an excellent opportunity to revisit adaptive bitrate ...
Comments