Abstract
Even though people of all social standings use current mobile devices in the wide spectrum of purpose from entertainment tools to communication means, some issues with real-time video streaming in hostile wireless environment still exist. In this article, we introduce CoSA, a link-aware real-time video streaming system for mobile devices. The proposed system utilizes a 3D camera to distinguish the region of importance (ROI) and non-ROI region within the video frame. Based on the link-state feedback from the receiver, the proposed system allocates a higher bandwidth for the region that is classified as ROI and a lower bandwidth for non-ROI in the video stream by reducing the video's bit rate. We implemented CoSA in a real test-bed where the IEEE 802.11 is employed as a medium for wireless networking. Furthermore, we verified the effectiveness of the proposed system by conducting a thorough empirical study. The results indicate that the proposed system enables real-time video streaming while maintaining a consistent visual quality by dynamically reconfiguring video coding parameters according to the link quality.
- Nasir Ahmed, T. Natarajan, and Kamisetty R. Rao. 1974. Discrete cosine transform. IEEE Trans. Comput. 100, 1, 90--93. Google ScholarDigital Library
- Saamer Akhshabi, Ali C. Begen, and Constantine Dovrolis. 2011. An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems. ACM, 157--168. Google ScholarDigital Library
- Istemi Ekin Akkus, Oznur Ozkasap, and M. Reha Civanlar. 2011. Peer-to-peer multipoint video conferencing with layered video. J. Network Comput. Appl. 34, 1, 137--150. Google ScholarDigital Library
- Paolo Bellavista, Marcello Cinque, Domenico Cotroneo, and Luca Foschini. 2009. Self-adaptive handoff management for mobile streaming continuity. IEEE Trans. Network Serv. Manage. 6, 2, 80--94. Google ScholarDigital Library
- Paolo Bellavista, Antonio Corradi, and Carlo Giannelli. 2011. Differentiated management strategies for multi-hop multipath heterogeneous connectivity in mobile environments. IEEE Trans. Network Serv. Manage. 8, 3, 190--204.Google ScholarCross Ref
- E. J. Delp and O. R. Mitchell. 1979. Image compression using block truncation coding. IEEE Trans. Commun. 27, 9, 1335--1342. DOI:http://dx.doi.org/10.1109/TCOM.1979.1094560Google ScholarCross Ref
- EBU. 2010. High Definition (HD) Image formats for television production. Tech. Rep., EBU-TECH 3299. EBU, Geneva.Google Scholar
- Mohammad H. Hajiesmaili, Ahmad Khonsari, Ali Sehati, and Mohammad Sadegh Talebi. 2012. Content-aware rate allocation for efficient video streaming via dynamic network utility maximization. J. Network Comput. Appl. 35, 6, 2016--2027. Google ScholarDigital Library
- M. A. Haleem and Rajarathnam Chandramouli. 2005. Adaptive downlink scheduling and rate selection: A cross-layer design. IEEE J. Sel. Areas Commun. 23, 6, 1287--1297. Google ScholarDigital Library
- Cheng-Hsin Hsu and Mohamed Hefeeda. 2011. A Framework for Cross-layer Optimization of Video Streaming in Wireless Networks. ACM Trans. Multimedia Comput. Commun. Appl. 7, 1, Article 5. DOI:http://dx.doi.org/10.1145/1870121.1870126 Google ScholarDigital Library
- Chih-Lin Hu and Chien-An Cho. 2011. User-provided multimedia content distribution architecture in mobile and ubiquitous communication networks. J. Network Comput. Appl. 34, 1, 121--136. Google ScholarDigital Library
- Q. Huynh-Thu and M. Ghanbari. 2008. Scope of validity of PSNR in image/video quality assessment. Electron. Lett. 44, 13, 800--801. DOI:http://dx.doi.org/10.1049/el:20080522Google ScholarCross Ref
- ITU-T Recommendation J.247. 2008. Objective perceptual multimedia video quality measurement in the presence of a full-reference. http://www.itu.int/rec/T-REC-J.247-200808-I/en.Google Scholar
- Szymon Jakubczak, Hariharan Rahul, and Dina Katabi. 2009. One-size-fits-all wireless video. In Proceedings of the 8th ACM SIGCOMM HotNets Workshop. Google ScholarDigital Library
- Wen Ji, Min Chen, Xiaohu Ge, Peng Li, and Yiqiang Chen. 2011. A perceptual macroblock layer power control for energy scalable video encoder based on just noticeable distortion principle. J. Network Comput. Appl. 34, 5, 1489--1497. Google ScholarDigital Library
- Hari Kalva, Velibor Adzic, and Borko Furht. 2012. Comparing MPEG AVC and SVC for adaptive HTTP streaming. In Proceedings of the IEEE International Conference on Consumer Electronics. IEEE, 158--159.Google ScholarCross Ref
- Hwangnam Kim, Jennifer C. Hou, Chunyu Hu, and Ye Ge. 2007. QoS provisioning in IEEE 802.11-compliant networks: Past, present, and future. Comput. Networks 51, 8, 1922--1941. Google ScholarDigital Library
- Hyun Soon Kim, Eugene Kim, and Hwangnam Kim. 2012. QoE-driven Wi-Fi selection mechanism for next generation smartphones. In Proceedings of the 1st IEEE Workshop on Enabling Technologies for Smartphone and Internet of Things. IEEE, 13--18.Google Scholar
- M. Kouadio and U. Pooch. 2002. Technology on social issues of videoconferencing on the Internet: A survey. J. Network Comput. Appl. 25, 1, 37--56. Google ScholarDigital Library
- Didier Le Gall. 1991. MPEG: A video compression standard for multimedia applications. Commun. ACM 34, 4, 46--58. Google ScholarDigital Library
- Suk Kyu Lee, Jihoon Ryoo, Seungho Yoo, Jongtack Jung, Woonghee Lee, and Hwangnam Kim. 2013. CoSA: Adaptive link-aware real-time streaming for mobile devices. In Proceedings of the IEEE 9th International Conference on Wireless and Mobile Computing, Networking and Communications. IEEE, 681--686.Google ScholarCross Ref
- Yan Li, Athina Markopoulou, John Apostolopoulos, and Nicholas Bambos. 2008. Content-aware playout and packet scheduling for video streaming over wireless links. IEEE Trans. Multimedia 10, 5, 885--895. Google ScholarDigital Library
- Günther Liebl, Mark Kalman, and Bernd Girod. 2005. Deadline-aware scheduling for wireless video streaming. In Proceedings of the. IEEE International Conference on Multimedia and Expo. IEEE, 4--pp.Google ScholarCross Ref
- Bangalore S. Manjunath, Philippe Salembier, and Thomas Sikora. 2002. Introduction to MPEG-7: Multimedia Content Description Interface. Vol. 1, John Wiley & Sons. Google ScholarDigital Library
- D. Marpe, H. Schwarz, and T. Wiegand. 2003. Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard. IEEE Trans. Circuits Syst. Video Technol. 13, 7 (2003), 620--636. DOI:http://dx.doi.org/10.1109/TCSVT.2003.815173 Google ScholarDigital Library
- Anush K. Moorthy, Kalpana Seshadrinathan, Rajiv Soundararajan, and Alan Conrad Bovik. 2010. Wireless video quality assessment: A study of subjective scores and objective algorithms. IEEE Trans. Circuits Syst. Video Technol. 20, 4, 587--599. Google ScholarDigital Library
- MPEG. 2014. The moving picture experts group. http://mpeg.chiariglione.org/.Google Scholar
- Pengpeng Ni, Ragnhild Eg, Alexander Eichhorn, Carsten Griwodz, and Pål Halvorsen. 2011. Flicker effects in adaptive video streaming to handheld devices. In Proceedings of the 19th ACM International Conference on Multimedia. ACM, 463--472. Google ScholarDigital Library
- Vít Novotnỳ and Dan Komosnỳ. 2008. Large-scale RTCP feedback optimization. J. Networks 3, 3, 1--10.Google ScholarCross Ref
- OpenNI. 2011. OpenNI SDK. (2011). http://www.openni.org/openni-sdk/.Google Scholar
- Tanır Ozçelebi, M. Oguz Sunay, A. Murat Tekalp, and M. Reha Civanlar. 2007. Cross-layer optimized rate adaptation and scheduling for multiple-user wireless video streaming. IEEE J. Sel. Areas Commun. 25, 4, 760--769. Google ScholarDigital Library
- Paul Patras, Albert Banchs, and Pablo Serrano. 2012. A control theoretic scheme for efficient video transmission over IEEE 802.11e EDCA WLANs. ACM Trans. Multimedia Comput. Commun. Appl. 8, 3, Article 29. DOI:http://dx.doi.org/10.1145/2240136.2240142 Google ScholarDigital Library
- Massimo Piccardi. 2004. Background subtraction techniques: A review. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 4, IEEE, 3099--3104.Google ScholarCross Ref
- Margaret H. Pinson and StephenWolf. 2004. A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50, 3, 312--322.Google ScholarCross Ref
- Iain E. Richardson. 2004. H. 264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia. Wiley.com.Google Scholar
- Haakon Riiser, Tore Endestad, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2012. Video streaming using a location-based bandwidth-lookup service for bitrate planning. ACM Trans. Multimedia Comput. Commun. Appl. 8, 3, 24. Google ScholarDigital Library
- Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2011. Bitrate and video quality planning for mobile streaming scenarios using a GPS-based bandwidth lookup service. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, 1--6. Google ScholarDigital Library
- Jonathan Rosenberg and Henning Schulzrinne. 1998. Timer reconsideration for enhanced RTP scalability. In Proceedings of the 17th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'98). Vol. 1. IEEE, 233--241.Google ScholarCross Ref
- Jonathan Rosenberg, Henning Schulzrinne, Gonzalo Camarillo, et al. 2002. SIP: Session initiation protocol. Tech. Rep., RFC 3261, Internet Engineering Task Force. Google ScholarDigital Library
- R. Sudhakar, R. Karthiga, and S. Jayaraman. 2005. Image compression using coding of wavelet coefficients: A survey. ICGST Int. J. Graphics Vision Image Process. 5, 6, 25--38.Google Scholar
- Heiko Schwarz, Detlev Marpe, and Thomas Wiegand. 2007. Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17, 9, 1103--1120. Google ScholarDigital Library
- Eric Setton, Taesang Yoo, Xiaoqing Zhu, Andrea Goldsmith, and Bernd Girod. 2005. Cross-layer design of ad-hoc networks for real-time video streaming. IEEE Wirel. Commun. 12, 4, 59--65. Google ScholarDigital Library
- Thomas Stockhammer. 2011. Dynamic adaptive streaming over HTTP--: standards and design principles. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems. ACM, 133--144. Google ScholarDigital Library
- Wai-Tian Tan and Avideh Zakhor. 1999. Real-time Internet video using error resilient scalable compression and TCP-friendly transport protocol. IEEE Trans. Multimedia 1, 2, 172--186. Google ScholarDigital Library
- Samira Tavakoli, Kjell Brunnström, Kun Wang, Börje Andrén, Muhammad Shahid, and Narciso Garcia. 2014. Subjective quality assessment of an adaptive video streaming model. Proc. SPIE, vol. 9016, International Society for Optics and Photonics, 90160K--90160K.Google Scholar
- Gary A. Thom. 1996. H. 323: the multimedia communications standard for local area networks. IEEE Commun. Mag. 34, 12, 52--56. Google ScholarDigital Library
- Yubing Wang. 2006. Survey of objective video quality measurements. Tech. Rep., EMC Corporation.Google Scholar
- Andrew B. Watson. 1994. Image compression using the discrete cosine transform. Mathematica J. 4, 81--88.Google Scholar
- Shinuk Woo and Hwangnam Kim. 2013. An empirical interference modeling for link reliability assessment in wireless networks. IEEE/ACM Trans Networking 21. Google ScholarDigital Library
- Weiwen Zhang, Yonggang Wen, Zhenzhong Chen, and Ashish Khisti. 2013. QoE-driven cache management for HTTP adaptive bit rate streaming over wireless networks. IEEE Trans. Multimedia 15, 6, 1431--1445. Google ScholarDigital Library
- Li Zhao, Qi Wang, Yuwen He, Shiqiang Yang, and Yuzhuo Zhong. 2001. A novel content-based video streaming algorithm for fine granular scalable coding. In Management of Multimedia on the Internet, Ehab S. Al-Shaer and Giovanni Pacifici (Eds.). Lecture Notes in Computer Science, vol. 2216, Springer, 210--214. DOI:http://dx.doi.org/10.1007/3-540-45508-617 Google ScholarDigital Library
- Liang Zhou, XinbingWang, Wei Tu, G. Muntean, and Benoit Geller. 2010. Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks. IEEE J. Sel. Areas Commun. 28, 3, 409--419. Google ScholarDigital Library
Index Terms
Link-Aware Reconfigurable Point-to-Point Video Streaming for Mobile Devices
Recommendations
Video streaming to mobile handheld devices: challenges in decoding, adaptation, and browsing
MCAM'07: Proceedings of the 2007 international conference on Multimedia content analysis and miningGrowing popularity and richer functionality of contemporary mobile handheld devices such as PDAs and smart phones have enabled emerging video streaming applications to these devices via various wireless networks. However, these handheld devices are ...
Integrated approach of streaming 3d multimedia contents in real-time for mobile devices
It is popular to watch a 3D video through a 3D display nowadays. However, it is still difficult to enjoy the 3D multimedia contents with a mobile device even if a mobile device with a 3D display is currently introduced into the market. The main ...
Cloud Streaming Brings Video to Mobile Devices
For wireless adoption to continue growing, mobile devices' capabilities may have to expand, particularly in areas such as video streaming, gaming, and graphics-intensive applications. Cloud streaming promises to let resource-constrained mobile devices ...
Comments