Matthew K. Mukerjee
David Naylor
Junchen Jiang
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Live video delivery is expected to reach a peak of 50 Tbps this year. This surging popularity is fundamentally changing the Internet video delivery landscape. CDNs must meet users' demands for fast join times, high bitrates, and low buffering ratios, while minimizing their own cost of delivery and responding to issues in real-time. Wide-area latency, loss, and failures, as well as varied workloads ("mega-events" to long-tail), make meeting these demands challenging.
An analysis of video sessions concluded that a centralized controller could improve user experience, but CDN systems have shied away from such designs due to the difficulty of quickly handling failures, a requirement of both operators and users. We introduce VDN, a practical approach to a video delivery network that uses a centralized algorithm for live video optimization. VDN provides CDN operators with real-time, fine-grained control. It does this in spite of challenges resulting from the wide-area (e.g., state inconsistency, partitions, failures) by using a hybrid centralized+distributed control plane, increasing average bitrate by 1.7x and decreasing cost by 2x in different scenarios.
Supplemental Material
- Ooyala global video index q3 2013. http://go.ooyala.com/rs/OOYALA/images/Ooyala-Global-Video-Index-Q3--2013.pdf.Google Scholar
- Private conversation with Bruce Maggs, vice president, research at Akamai.Google Scholar
- Private conversation with Hui Zhang, chief executive officer, at Conviva.Google Scholar
- Twitch. http://twitch.tv.Google Scholar
- Twitch is 4th in peak us internet traffic. http://blog.twitch.tv/2014/02/twitch-community-4th-in-peak-us-internet-traffic/.Google Scholar
- I. Sodagar. The MPEG-DASH Standard for Multimedia Streaming Over the Internet. IEEE Multimedia (2011). Google ScholarDigital Library
- Akamai. Akamai investor summit: 2013. http://www.akamai.com/dl/investors/2013_ir_summit_presentation.pdf.Google Scholar
- Amazon. Amazon Elastic Compute Cloude (Amazon EC2). http://aws.amazon.com/ec2/.Google Scholar
- Balachandran, A., Sekar, V., Akella, A., Seshan, S., Stoica, I., and Zhang, H. A quest for an internet video quality-of-experience metric. In Proceedings of the 11th ACM Workshop on Hot Topics in Networks (New York, NY, USA, 2012), HotNets-XI, ACM, pp. 97--102. Google ScholarDigital Library
- Balachandran, A., Sekar, V., Akella, A., Seshan, S., Stoica, I., and Zhang, H. Developing a predictive model of quality of experience for internet video. In Proc. ACM SIGCOMM (2013), ACM, pp. 339--350. Google ScholarDigital Library
- Bashore, A. Twitch stats. http://stats.twitchapps.com/.Google Scholar
- Castro, M., Druschel, P., Kermarrec, A.-M., Nandi, A., Rowstron, A., and Singh, A. Splitstream: high-bandwidth multicast in cooperative environments. In ACM SIGOPS Operating Systems Review (2003), vol. 37, ACM, pp. 298--313. Google ScholarDigital Library
- Chowdhury, M., Zaharia, M., Ma, J., Jordan, M. I., and Stoica, I. Managing data transfers in computer clusters with orchestra. SIGCOMM CCR 41, 4 (2011), 98. Google ScholarDigital Library
- Chu, Y., Rao, S., Seshan, S., and Zhang, H. Enabling conferencing applications on the internet using an overlay muilticast architecture. ACM SIGCOMM computer communication review 31, 4 (2001), 55--67. Google ScholarDigital Library
- Fortz, B., Rexford, J., and Thorup, M. Traffic engineering with traditional ip routing protocols. Communications Magazine, IEEE 40, 10 (2002), 118--124. Google ScholarDigital Library
- Foundation, A. Apache HTTP Server Project.\ http://httpd.apache.org/.Google Scholar
- Frank, B., Poese, I., Lin, Y., Smaragdakis, G., Feldmann, A., Maggs, B., Rake, J., Uhlig, S., and Weber, R. Pushing cdn-isp collaboration to the limit. ACM SIGCOMM CCR 43, 3 (2013). Google ScholarDigital Library
- Freedman, M. J. Experiences with coralcdn: A five-year operational view. In Proc. USENIX NSDI (2010). Google ScholarDigital Library
- Ganjam, A., Siddiqui, F., Zhan, J., Liu, X., Stoica, I., Jiang, J., Sekar, V., and Zhang, H. C3: Internet-scale control plane for video quality optimization. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15) (Oakland, CA, May 2015), USENIX Association, pp. 131--144. Google ScholarDigital Library
- Ghorbani, S., and Caesar, M. Walk the line: consistent network updates with bandwidth guarantees. In Proc. HotSDN (2012), ACM, pp. 67--72. Google ScholarDigital Library
- Gurobi. Gurobi optimization. http://www.gurobi.com/.Google Scholar
- Han, D., Andersen, D., Kaminsky, M., Papagiannaki, D., and Seshan, S. Hulu in the neighborhood. In Proc. COMSNETS (Jan. 2011), pp. 1 --10.Google ScholarCross Ref
- Hong, C.-Y., Kandula, S., Mahajan, R., Zhang, M., Gill, V., Nanduri, M., and Wattenhofer, R. Achieving high utilization with software-driven wan. In Proc. ACM SIGCOMM (2013). Google ScholarDigital Library
- Huang, C., Wang, A., Li, J., and Ross, K. W. Measuring and evaluating large-scale cdns. In Proc. ACM IMC (2008). Google Scholar
- Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., Venkata, S., Wanderer, J., Zhou, J., Zhu, M., et al. B4: Experience with a globally-deployed software defined wan. In Proc. ACM SIGCOMM (2013). Google ScholarDigital Library
- Jannotti, J., Gifford, D. K., Johnson, K. L., Kaashoek, M. F., et al. Overcast: reliable multicasting with on overlay network. In Proc. 4th conference on Symposium on Operating System Design & Implementation (2000). Google ScholarDigital Library
- Jiang, J., Sekar, V., and Zhang, H. Improving fairness, efficiency, and stability in http-based adaptive video streaming with festive. In Proc. ACM CoNEXT (2012). Google ScholarDigital Library
- Katta, N. P., Rexford, J., and Walker, D. Incremental consistent updates. In Proc. HotSDN (2013), ACM. Google ScholarDigital Library
- Kontothanassis, L., Sitaraman, R., Wein, J., Hong, D., Kleinberg, R., Mancuso, B., Shaw, D., and Stodolsky, D. A transport layer for live streaming in a content delivery network. Proceedings of the IEEE 92, 9 (2004), 1408--1419.Google ScholarCross Ref
- Kostić, D., Rodriguez, A., Albrecht, J., and Vahdat, A. Bullet: High bandwidth data dissemination using an overlay mesh. In ACM SIGOPS Operating Systems Review (2003), vol. 37, ACM, pp. 282--297. Google ScholarDigital Library
- Lamport, L. The part-time parliament. ACM Trans. Comput. Syst. 16, 2 (May 1998), 133--169. Google ScholarDigital Library
- Liu, X., Dobrian, F., Milner, H., Jiang, J., Sekar, V., Stoica, I., and Zhang, H. A case for a coordinated internet video control plane. In Proc. ACM SIGCOMM (2012), pp. 359--370. Google ScholarDigital Library
- Liu, Y., Zhang, H., Gong, W., and Towsley, D. On the interaction between overlay routing and underlay routing. In INFOCOM 2005. 24th Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings IEEE (2005), vol. 4, IEEE, pp. 2543--2553.Google Scholar
- McGeer, R. A safe, efficient update protocol for openflow networks. In Proc. HotSDN (2012), ACM, pp. 61--66. Google ScholarDigital Library
- Nygren, E., Sitaraman, R. K., and Sun, J. The akamai network: a platform for high-performance internet applications. ACM SIGOPS Operating Systems Review 44, 3 (2010), 2--19. Google ScholarDigital Library
- Prasad, R., Dovrolis, C., Murray, M., and Claffy, K. Bandwidth estimation: metrics, measurement techniques, and tools. Network, IEEE 17, 6 (2003), 27--35. Google ScholarDigital Library
- Sandvine. Global internet phenomena report: 1h 2014. https://www.sandvine.com/downloads/general/global-internet-phenomena/2014/1h-2014-global-internet-phenomena-report.pdf.Google Scholar
- Spangler, T. World cup sets new internet-video streaming records for espn, univision, and akamai. http://variety.com/2014/digital/news/world-cup-sets-new-internet-video-streaming-record-1201221997/.Google Scholar
- Strauss, J., Katabi, D., and Kaashoek, F. A measurement study of available bandwidth estimation tools. In Proceedings of the 3rd ACM SIGCOMM Conference on Internet Measurement (New York, NY, USA, 2003), IMC '03, ACM, pp. 39--44. Google ScholarDigital Library
- Su, A.-J., and Kuzmanovic, A. Thinning akamai. In Proc. ACM IMC (2008). Google ScholarDigital Library
- Team, T. How twitch fits in amazon's strategy. http://www.forbes.com/sites/greatspeculations/2014/08/28/how-twitch-fits-in-amazons-strategy/.Google Scholar
- Wang, L., Park, K., Pang, R., Pai, V. S., and Peterson, L. L. Reliability and security in the codeen content distribution network. In Proc. USENIX ATC, General Track (2004). Google ScholarDigital Library
- Xu, D., Kulkarni, S. S., Rosenberg, C., and keung Chai, H. A cdn-p2p hybrid architecture for cost-effective streaming media distribution. Computer Networks 44 (2004), 353--382. Google ScholarDigital Library
- YouTube. Live encoder settings, bitrates and resolutions. https://support.google.com/youtube/answer/2853702?hl=en.Google Scholar
- Yu, M., Jiang, W., Li, H., and Stoica, I. Tradeoffs in cdn designs for throughput oriented traffic. In Proc. ACM CoNEXT (2012), ACM, pp. 145--156. Google ScholarDigital Library
Index Terms
- Practical, Real-time Centralized Control for CDN-based Live Video Delivery
Recommendations
Practical, Real-time Centralized Control for CDN-based Live Video Delivery
SIGCOMM '15: Proceedings of the 2015 ACM Conference on Special Interest Group on Data CommunicationLive video delivery is expected to reach a peak of 50 Tbps this year. This surging popularity is fundamentally changing the Internet video delivery landscape. CDNs must meet users' demands for fast join times, high bitrates, and low buffering ratios, ...
Enabling near real-time central control for live video delivery in CDNs
SIGCOMM'14User-created live video streaming is marking a fundamental shift in the workload of live video delivery. However, live-video-specific challenges and the viral nature of user-created content makes it difficult for current CDNs to deliver 1) high-quality, ...
Enabling near real-time central control for live video delivery in CDNs
SIGCOMM '14: Proceedings of the 2014 ACM conference on SIGCOMMUser-created live video streaming is marking a fundamental shift in the workload of live video delivery. However, live-video-specific challenges and the viral nature of user-created content makes it difficult for current CDNs to deliver 1) high-quality, ...
Comments