skip to main content
research-article

Link-Aware Reconfigurable Point-to-Point Video Streaming for Mobile Devices

Published:24 August 2015Publication History
Skip Abstract Section

Abstract

Even though people of all social standings use current mobile devices in the wide spectrum of purpose from entertainment tools to communication means, some issues with real-time video streaming in hostile wireless environment still exist. In this article, we introduce CoSA, a link-aware real-time video streaming system for mobile devices. The proposed system utilizes a 3D camera to distinguish the region of importance (ROI) and non-ROI region within the video frame. Based on the link-state feedback from the receiver, the proposed system allocates a higher bandwidth for the region that is classified as ROI and a lower bandwidth for non-ROI in the video stream by reducing the video's bit rate. We implemented CoSA in a real test-bed where the IEEE 802.11 is employed as a medium for wireless networking. Furthermore, we verified the effectiveness of the proposed system by conducting a thorough empirical study. The results indicate that the proposed system enables real-time video streaming while maintaining a consistent visual quality by dynamically reconfiguring video coding parameters according to the link quality.

References

  1. Nasir Ahmed, T. Natarajan, and Kamisetty R. Rao. 1974. Discrete cosine transform. IEEE Trans. Comput. 100, 1, 90--93. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Saamer Akhshabi, Ali C. Begen, and Constantine Dovrolis. 2011. An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems. ACM, 157--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Istemi Ekin Akkus, Oznur Ozkasap, and M. Reha Civanlar. 2011. Peer-to-peer multipoint video conferencing with layered video. J. Network Comput. Appl. 34, 1, 137--150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Paolo Bellavista, Marcello Cinque, Domenico Cotroneo, and Luca Foschini. 2009. Self-adaptive handoff management for mobile streaming continuity. IEEE Trans. Network Serv. Manage. 6, 2, 80--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Paolo Bellavista, Antonio Corradi, and Carlo Giannelli. 2011. Differentiated management strategies for multi-hop multipath heterogeneous connectivity in mobile environments. IEEE Trans. Network Serv. Manage. 8, 3, 190--204.Google ScholarGoogle ScholarCross RefCross Ref
  6. E. J. Delp and O. R. Mitchell. 1979. Image compression using block truncation coding. IEEE Trans. Commun. 27, 9, 1335--1342. DOI:http://dx.doi.org/10.1109/TCOM.1979.1094560Google ScholarGoogle ScholarCross RefCross Ref
  7. EBU. 2010. High Definition (HD) Image formats for television production. Tech. Rep., EBU-TECH 3299. EBU, Geneva.Google ScholarGoogle Scholar
  8. Mohammad H. Hajiesmaili, Ahmad Khonsari, Ali Sehati, and Mohammad Sadegh Talebi. 2012. Content-aware rate allocation for efficient video streaming via dynamic network utility maximization. J. Network Comput. Appl. 35, 6, 2016--2027. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. A. Haleem and Rajarathnam Chandramouli. 2005. Adaptive downlink scheduling and rate selection: A cross-layer design. IEEE J. Sel. Areas Commun. 23, 6, 1287--1297. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Cheng-Hsin Hsu and Mohamed Hefeeda. 2011. A Framework for Cross-layer Optimization of Video Streaming in Wireless Networks. ACM Trans. Multimedia Comput. Commun. Appl. 7, 1, Article 5. DOI:http://dx.doi.org/10.1145/1870121.1870126 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Chih-Lin Hu and Chien-An Cho. 2011. User-provided multimedia content distribution architecture in mobile and ubiquitous communication networks. J. Network Comput. Appl. 34, 1, 121--136. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Q. Huynh-Thu and M. Ghanbari. 2008. Scope of validity of PSNR in image/video quality assessment. Electron. Lett. 44, 13, 800--801. DOI:http://dx.doi.org/10.1049/el:20080522Google ScholarGoogle ScholarCross RefCross Ref
  13. ITU-T Recommendation J.247. 2008. Objective perceptual multimedia video quality measurement in the presence of a full-reference. http://www.itu.int/rec/T-REC-J.247-200808-I/en.Google ScholarGoogle Scholar
  14. Szymon Jakubczak, Hariharan Rahul, and Dina Katabi. 2009. One-size-fits-all wireless video. In Proceedings of the 8th ACM SIGCOMM HotNets Workshop. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Wen Ji, Min Chen, Xiaohu Ge, Peng Li, and Yiqiang Chen. 2011. A perceptual macroblock layer power control for energy scalable video encoder based on just noticeable distortion principle. J. Network Comput. Appl. 34, 5, 1489--1497. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hari Kalva, Velibor Adzic, and Borko Furht. 2012. Comparing MPEG AVC and SVC for adaptive HTTP streaming. In Proceedings of the IEEE International Conference on Consumer Electronics. IEEE, 158--159.Google ScholarGoogle ScholarCross RefCross Ref
  17. Hwangnam Kim, Jennifer C. Hou, Chunyu Hu, and Ye Ge. 2007. QoS provisioning in IEEE 802.11-compliant networks: Past, present, and future. Comput. Networks 51, 8, 1922--1941. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Hyun Soon Kim, Eugene Kim, and Hwangnam Kim. 2012. QoE-driven Wi-Fi selection mechanism for next generation smartphones. In Proceedings of the 1st IEEE Workshop on Enabling Technologies for Smartphone and Internet of Things. IEEE, 13--18.Google ScholarGoogle Scholar
  19. M. Kouadio and U. Pooch. 2002. Technology on social issues of videoconferencing on the Internet: A survey. J. Network Comput. Appl. 25, 1, 37--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Didier Le Gall. 1991. MPEG: A video compression standard for multimedia applications. Commun. ACM 34, 4, 46--58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Suk Kyu Lee, Jihoon Ryoo, Seungho Yoo, Jongtack Jung, Woonghee Lee, and Hwangnam Kim. 2013. CoSA: Adaptive link-aware real-time streaming for mobile devices. In Proceedings of the IEEE 9th International Conference on Wireless and Mobile Computing, Networking and Communications. IEEE, 681--686.Google ScholarGoogle ScholarCross RefCross Ref
  22. Yan Li, Athina Markopoulou, John Apostolopoulos, and Nicholas Bambos. 2008. Content-aware playout and packet scheduling for video streaming over wireless links. IEEE Trans. Multimedia 10, 5, 885--895. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Günther Liebl, Mark Kalman, and Bernd Girod. 2005. Deadline-aware scheduling for wireless video streaming. In Proceedings of the. IEEE International Conference on Multimedia and Expo. IEEE, 4--pp.Google ScholarGoogle ScholarCross RefCross Ref
  24. Bangalore S. Manjunath, Philippe Salembier, and Thomas Sikora. 2002. Introduction to MPEG-7: Multimedia Content Description Interface. Vol. 1, John Wiley & Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. D. Marpe, H. Schwarz, and T. Wiegand. 2003. Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard. IEEE Trans. Circuits Syst. Video Technol. 13, 7 (2003), 620--636. DOI:http://dx.doi.org/10.1109/TCSVT.2003.815173 Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Anush K. Moorthy, Kalpana Seshadrinathan, Rajiv Soundararajan, and Alan Conrad Bovik. 2010. Wireless video quality assessment: A study of subjective scores and objective algorithms. IEEE Trans. Circuits Syst. Video Technol. 20, 4, 587--599. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. MPEG. 2014. The moving picture experts group. http://mpeg.chiariglione.org/.Google ScholarGoogle Scholar
  28. Pengpeng Ni, Ragnhild Eg, Alexander Eichhorn, Carsten Griwodz, and Pål Halvorsen. 2011. Flicker effects in adaptive video streaming to handheld devices. In Proceedings of the 19th ACM International Conference on Multimedia. ACM, 463--472. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Vít Novotnỳ and Dan Komosnỳ. 2008. Large-scale RTCP feedback optimization. J. Networks 3, 3, 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  30. OpenNI. 2011. OpenNI SDK. (2011). http://www.openni.org/openni-sdk/.Google ScholarGoogle Scholar
  31. Tanır Ozçelebi, M. Oguz Sunay, A. Murat Tekalp, and M. Reha Civanlar. 2007. Cross-layer optimized rate adaptation and scheduling for multiple-user wireless video streaming. IEEE J. Sel. Areas Commun. 25, 4, 760--769. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Paul Patras, Albert Banchs, and Pablo Serrano. 2012. A control theoretic scheme for efficient video transmission over IEEE 802.11e EDCA WLANs. ACM Trans. Multimedia Comput. Commun. Appl. 8, 3, Article 29. DOI:http://dx.doi.org/10.1145/2240136.2240142 Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Massimo Piccardi. 2004. Background subtraction techniques: A review. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 4, IEEE, 3099--3104.Google ScholarGoogle ScholarCross RefCross Ref
  34. Margaret H. Pinson and StephenWolf. 2004. A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50, 3, 312--322.Google ScholarGoogle ScholarCross RefCross Ref
  35. Iain E. Richardson. 2004. H. 264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia. Wiley.com.Google ScholarGoogle Scholar
  36. Haakon Riiser, Tore Endestad, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2012. Video streaming using a location-based bandwidth-lookup service for bitrate planning. ACM Trans. Multimedia Comput. Commun. Appl. 8, 3, 24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2011. Bitrate and video quality planning for mobile streaming scenarios using a GPS-based bandwidth lookup service. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, 1--6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Jonathan Rosenberg and Henning Schulzrinne. 1998. Timer reconsideration for enhanced RTP scalability. In Proceedings of the 17th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'98). Vol. 1. IEEE, 233--241.Google ScholarGoogle ScholarCross RefCross Ref
  39. Jonathan Rosenberg, Henning Schulzrinne, Gonzalo Camarillo, et al. 2002. SIP: Session initiation protocol. Tech. Rep., RFC 3261, Internet Engineering Task Force. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. R. Sudhakar, R. Karthiga, and S. Jayaraman. 2005. Image compression using coding of wavelet coefficients: A survey. ICGST Int. J. Graphics Vision Image Process. 5, 6, 25--38.Google ScholarGoogle Scholar
  41. Heiko Schwarz, Detlev Marpe, and Thomas Wiegand. 2007. Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17, 9, 1103--1120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Eric Setton, Taesang Yoo, Xiaoqing Zhu, Andrea Goldsmith, and Bernd Girod. 2005. Cross-layer design of ad-hoc networks for real-time video streaming. IEEE Wirel. Commun. 12, 4, 59--65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Thomas Stockhammer. 2011. Dynamic adaptive streaming over HTTP--: standards and design principles. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems. ACM, 133--144. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Wai-Tian Tan and Avideh Zakhor. 1999. Real-time Internet video using error resilient scalable compression and TCP-friendly transport protocol. IEEE Trans. Multimedia 1, 2, 172--186. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Samira Tavakoli, Kjell Brunnström, Kun Wang, Börje Andrén, Muhammad Shahid, and Narciso Garcia. 2014. Subjective quality assessment of an adaptive video streaming model. Proc. SPIE, vol. 9016, International Society for Optics and Photonics, 90160K--90160K.Google ScholarGoogle Scholar
  46. Gary A. Thom. 1996. H. 323: the multimedia communications standard for local area networks. IEEE Commun. Mag. 34, 12, 52--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Yubing Wang. 2006. Survey of objective video quality measurements. Tech. Rep., EMC Corporation.Google ScholarGoogle Scholar
  48. Andrew B. Watson. 1994. Image compression using the discrete cosine transform. Mathematica J. 4, 81--88.Google ScholarGoogle Scholar
  49. Shinuk Woo and Hwangnam Kim. 2013. An empirical interference modeling for link reliability assessment in wireless networks. IEEE/ACM Trans Networking 21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Weiwen Zhang, Yonggang Wen, Zhenzhong Chen, and Ashish Khisti. 2013. QoE-driven cache management for HTTP adaptive bit rate streaming over wireless networks. IEEE Trans. Multimedia 15, 6, 1431--1445. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Li Zhao, Qi Wang, Yuwen He, Shiqiang Yang, and Yuzhuo Zhong. 2001. A novel content-based video streaming algorithm for fine granular scalable coding. In Management of Multimedia on the Internet, Ehab S. Al-Shaer and Giovanni Pacifici (Eds.). Lecture Notes in Computer Science, vol. 2216, Springer, 210--214. DOI:http://dx.doi.org/10.1007/3-540-45508-617 Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Liang Zhou, XinbingWang, Wei Tu, G. Muntean, and Benoit Geller. 2010. Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks. IEEE J. Sel. Areas Commun. 28, 3, 409--419. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Link-Aware Reconfigurable Point-to-Point Video Streaming for Mobile Devices

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Multimedia Computing, Communications, and Applications
            ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 12, Issue 1
            August 2015
            220 pages
            ISSN:1551-6857
            EISSN:1551-6865
            DOI:10.1145/2816987
            Issue’s Table of Contents

            Copyright © 2015 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 24 August 2015
            • Accepted: 1 April 2015
            • Revised: 1 August 2014
            • Received: 1 April 2014
            Published in tomm Volume 12, Issue 1

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader