research-article

Energy-efficient multicasting of multiview 3D videos to mobile devices

Authors:

Mohamed HefeedaAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 8, Issue 3s

Article No.: 45, Pages 1 - 25

https://doi.org/10.1145/2348816.2348824

Published: 16 October 2012 Publication History

Abstract

Multicasting multiple video streams over wireless broadband access networks enables the delivery of multimedia content to large-scale user communities in a cost-efficient manner. Three dimensional (3D) videos are the next natural step in the evolution of digital media technologies. In order to provide 3D perception, 3D video streams contain one or more views that greatly increase their bandwidth requirements. Due to the limited channel capacity and variable bit rate of the videos, multicasting multiple 3D videos over wireless broadband networks is a challenging problem. In this article, we consider a 4G wireless access network in which a number of 3D videos represented in two-view plus depth format and encoded using scalable video coders are multicast. We formulate the optimal 3D video multicasting problem to maximize the quality of rendered virtual views on the receivers' displays. We show that this problem is NP-complete and present a polynomial time approximation algorithm to solve it. We then extend the proposed algorithm to efficiently schedule the transmission of the chosen substreams from each video in order to maximize the power saving on the mobile receivers. Our simulation-based experimental results show that our algorithm provides solutions that are within 0.3 dB of the optimal solutions while satisfying real-time requirements of multicast systems. In addition, our algorithm results in an average power consumption reduction of 86%.

References

[1]

ABI Research. 2010. 3D Mobile devices. http://www.abiresearch.com/research/1006094.

[2]

Akar, G., Tekalp, A., Fehn, C., and Civanlar, M. 2007. Transport methods in 3DTV—a survey. IEEE Trans. Circ. Syst. Video Tech. 17, 11, 1622--1630.

Digital Library

[3]

Arican, Z., Yea, S., Sullivan, A., and Vetro, A. 2009. Intermediate view generation for perceived depth adjustment of stereo video. Appl. Digital Image Proc. XXXII 7443, 1, 74430U.

[4]

Bosc, E., Jantet, V., Pressigout, M., Morin, L., and Guillemot, C. 2011. Bit-rate allocation for multi-view video plus depth. In Proceedings of the 3DTV Conference: The True Vision—Capture, Transmission and Display of 3D Video (3DTV-CON). 1--4.

[5]

Chen, Y., Wang, Y.-K., Ugur, K., Hannuksela, M., Lainema, J., and Gabbouj, M. 2009. The emerging MVC standard for 3D video services. EURASIP J. Adv. Sig. Proc. 2009.

Digital Library

[6]

Cheung, G., Velisavljevic, V., and Ortega, A. 2011. On dependent bit allocation for multiview image coding with depth-image-based rendering. IEEE Trans. Image Proc. 20, 11, 3179--3194.

Digital Library

[7]

CPLEX 2011. IBM ILOG CPLEX Optimizer. http://www.ibm.com/software/integration/optimization/cplex-optimizer/.

[8]

de Diego Balaguer, E., Fitzek, F., Olsen, O., and Gade, M. 2005. Performance evaluation of power saving strategies for DVB-H services using adaptive MPE-FEC decoding. In Proceedings of the IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC'05). Vol. 4. 2221--2226.

[9]

De Silva, D., Ekmekcioglu, E., Abdul-Hameed, O., Fernando, W., Worrall, S., and Kondoz, A. 2010. Performance evaluation of 3D-TV transmission over WiMAX broadband access networks. In Proceedings of the International Conference on Information and Automation for Sustainability (ICIAFs). 298--303.

[10]

Dodgson, N. 2005. Autostereoscopic 3D displays. IEEE Computer 38, 8, 31--36.

Digital Library

[11]

Dyer, M. 1984. An O(n) algorithm for the multiple-choice knapsack linear program. Mathemat. Prog. 29, 57--63.

Digital Library

[12]

Fehn, C. 2004. Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. Stereoscop. Displ. Virt. Reality Syst. XI 5291, 1, 93--104.

[13]

Gotfryd, M., Wegner, K., and Domański, M. 2008. View Synthesis Software and Assessment of Its Performance. ISO/IEC JTC1/SC29/WG11, MPEG 2008/M15672.

[14]

Harrison, D. 2010. Hockey Night in Canada offers games in 3D. http://www.cbc.ca/sports/hockey/story/2010/09/29/sp-hockey-night-panasonic.html.

[15]

Hefeeda, M. and Hsu, C.-H. 2008. Energy optimization in mobile TV broadcast networks. In Proceedings of the International Conference on Innovations in Information Technology. 430--434.

[16]

Hsu, C.-H. and Hefeeda, M. 2010. Achieving viewing time scalability in mobile video streaming using scalable video coding. In Proceedings of the 1st ACM SIGMM Conference on Multimedia Systems (MMSys'10). 111--122.

Digital Library

[17]

Informa Telecoms and Media. 2010. 22.5 million homes will tune into 3D by 2015. http://shop.informatm.com/itmgcontent/icoms/s/press-releases/20017774108.html.

[18]

Järvinen, K., Bouazizi, I., Laaksonen, L., Ojala, P., and Rämö, A. 2010. Media coding for the next generation mobile system LTE. Comput. Comm. 33, 16, 1916--1927.

Digital Library

[19]

JSVM 2011. Joint Scalable Video Model (JSVM)—Reference Software. http://ip.hhi.de/imagecom_G1/savce/downloads/SVC-Reference-Software.htm.

[20]

Kauff, P., Atzpadin, N., Fehn, C., Müller, M., Schreer, O., Smolic, A., and Tanger, R. 2007. Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Sig. Proc. Image Comm. 22, 2, 217--234.

Digital Library

[21]

Kellerer, H., Pferschy, U., and Pisinger, D. 2004. Knapsack Problems. Springer-Verlag.

[22]

Kim, W., Ortega, A., Lai, P., Tian, D., and Gomila, C. 2010. Depth map coding with distortion estimation of rendered view. Proc. SPIE 7543.

[23]

Kimata, H., Kitahara, M., Kamikura, K., Yashima, Y., Fujii, T., and Tanimoto, M. 2004. System design of free viewpoint video communication. In Proceedings of the IEEE International Conference on Computer and Information Technology. 52--59.

Digital Library

[24]

Kumar, A. 2008. Mobile Broadcasting with WiMAX: Principles, Technology, and Applications. Elsevier Inc.

Digital Library

[25]

Liu, Y., Huang, Q., Ma, S., Zhao, D., and Gao, W. 2009. Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model. Signal Proc. Image Comm. 24, 8, 666--681.

Digital Library

[26]

MasterImage. 2012. MasterImage 3D Autostereoscopic 3D LCD. http://masterimage3d.com/products/3d-lcd.

[27]

Mathew, R. and Taubman, D. 2010. Quad-tree motion modeling with leaf merging. IEEE Trans. Circ. Syst. Video Tech. 20, 10, 1331--1345.

Digital Library

[28]

Merkle, P., Smolic, A., Müller, K., and Wiegand, T. 2007. Efficient prediction structures for multiview video coding. IEEE Trans. Circ. Syst. Video Tech. 17, 11, 1461--1473.

Digital Library

[29]

Müller, K., Merkle, P., and Wiegand, T. 2011. 3-D video representation using depth maps. Proc. IEEE 99, 4, 643--656.

[30]

Multimedia Scalable 3D for Europe (MUSCADE) Project. 2010. Mission scenarios and service requirements. http://www. muscade.eu/deliverables/MUS.RP.00001.EBU&percnt;20D1.1.1.pdf.

[31]

Petrovic, G., Do, L., Zinger, S., and de With, P. H. N. 2010. Virtual view adaptation for 3d multiview video streaming. Stereoscopic Displays and Appl. XXI 7524, 1, 752410.

[32]

Philips Electronics. 2012. Philips WOWvx Autostereoscopic Display. http://www.business-sites.philips.com/3dsolutions/home/index.page.

[33]

Pilkington, E. 2010. ESPN viewers can watch World Cup matches in 3D—at a price. http://www.guardian.co.uk/technology/2010/jan/06/espn-3d-world-cup-ces.

[34]

Schwarz, H., Marpe, D., and Wiegand, T. 2007. Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circ. Syst. Video Tech. 17, 9, 1103--1120.

Digital Library

[35]

Sequans Communications. 2007. Datasheet: SQN1130 System-on-Chip for WiMAX Moblie Stations. http://www.sequans.com/products-solutions/mobile-wimax/sqn1130/.

[36]

Shao, F., Jiang, G., Yu, M., Chen, K., and Ho, Y.-S. 2012. Asymmetric coding of multi-view video plus depth based 3-D video for view rendering. IEEE Trans. Multimed. 14, 1, 157--167.

Digital Library

[37]

Su, G.-M., Lai, Y.-C., Kwasinski, A., and Wang, H. 2011. 3D video communications: Challenges and opportunities. Int. J. Comm. Syst. 24, 10, 1261--1281.

Digital Library

[38]

Tanimoto, M., Fujii, T., Suzuki, K., Fukushima, N., and Mori, Y. 2008. Reference Softwares for Depth Estimation and View Synthesis. ISO/IEC JTC1/SC29/WG11, MPEG2008/M15377.

[39]

Uehara, S., Hiroya, T., Kusanagi, H., Shigemura, K., and Asada, H. 2008. 1-inch diagonal transflective 2D and 3D LCD with HDDP arrangement. In Proc. SPIE. 6803. 68030O.

[40]

Urey, H., Chellappan, K. V., Erden, E., and Surman, P. 2011. State of the art in stereoscopic and autostereoscopic displays. Proc. IEEE 99, 4.

[41]

Vetro, A., Matusik, W., Pfister, H., and Xin, J. 2004. Coding approaches for end-to-end 3D TV systems. In Proceedings of the 23rd Picture Coding Symposium (PCS'04). 319--324.

[42]

Vetro, A., Wiegand, T., and Sullivan, G. 2011. Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard. Proc. IEEE 99, 4, 626--642.

[43]

Wang, Z., Bovik, A., Sheikh, H., and Simoncelli, E. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Proc. 13, 4, 600--612.

Digital Library

[44]

Wearden, G. 2010. 3D TV dominates IFA electronics show. http://www.guardian.co.uk/technology/blog/2010/sep/02/3d-television-ifa-2010.

[45]

Yang, X., Song, Y., Owens, T., Cosmas, J., and Itagaki, T. 2004. Performance analysis of time slicing in DVB-H. In Proceedings of the Joint Ist Workshop on Mobile Future, and the Symposium on Trends in Communications (SympoTIC'04). 183--186.

[46]

Yuan, G., Zhang, X., Wang, W., and Yang, Y. 2010. Carrier aggregation for LTE-advanced mobile communication systems. IEEE Comm. Mag. 48, 2, 88--93.

Digital Library

[47]

Yuan, H., Chang, Y., Huo, J., Yang, F., and Lu, Z. 2011. Model-based joint bit allocation between texture videos and depth maps for 3-D video coding. IEEE Trans. Circ. Syst. Video Tech. 21, 4, 485--497.

Digital Library

[48]

Zemel, E. 1984. An O(n) algorithm for the linear multiple choice knapsack problem and related problems. Inf. Proc. Lett. 18, 123--128.

Digital Library

Cited By

Chiang SWang CYang DLiao WChen W(2024)Online Multicast Traffic Engineering for Multi-View Videos With View Synthesis in SDNIEEE/ACM Transactions on Networking10.1109/TNET.2024.336616632:4(2778-2793)Online publication date: Aug-2024
https://doi.org/10.1109/TNET.2024.3366166
Shi YKuo WHuang CChou YFang SYang D(2024)Cross-Layer Video Synthesizing and Antenna Allocation Scheme for Multi-View Video Provisioning Under Massive MIMO NetworksIEEE Transactions on Mobile Computing10.1109/TMC.2022.322777023:1(327-340)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMC.2022.3227770
Lu JLu BXu JSong LZhang W(2024)A Priority Aware Free Viewpoint Video Transmit Scheme Based on QUIC2024 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB62888.2024.10608226(1-6)Online publication date: 19-Jun-2024
https://doi.org/10.1109/BMSB62888.2024.10608226
Show More Cited By

Index Terms

Energy-efficient multicasting of multiview 3D videos to mobile devices

Recommendations

A comparison study between the TLS-based security framework and IKEv2 when protecting DSMIPv6 signaling

This paper presents a comparison study between the TLS-based security for DSMIPv6 and IKEv2 when establishing Security Associations between MN and HA. The network transmission and processing costs are examined for each protocol using different ...
Energy-efficient network selection with mobility pattern awareness in an integrated WiMAX and WiFi network

To provide wireless Internet access, WiFi networks have been deployed in many regions such as buildings and campuses. However, WiFi networks are still insufficient to support ubiquitous wireless service due to their narrow coverage. One possibility to ...
Multi standard system level simulation framework for evaluation of mobile broadband networks
CNS '11: Proceedings of the 14th Communications and Networking Symposium

IEEE 802.16m and 3GPP LTE-Advanced mobile broadband communication systems represent the most promising technologies for providing high speed mobile broadband access to the Internet in the years to come. Many research groups, communication equipment ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 8, Issue 3s

Special section of best papers of ACM multimedia 2011, and special section on 3D mobile multimedia

September 2012

173 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2348816

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2012

Accepted: 01 May 2012

Revised: 01 May 2012

Received: 01 January 2012

Published in TOMM Volume 8, Issue 3s

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
459
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chiang SWang CYang DLiao WChen W(2024)Online Multicast Traffic Engineering for Multi-View Videos With View Synthesis in SDNIEEE/ACM Transactions on Networking10.1109/TNET.2024.336616632:4(2778-2793)Online publication date: Aug-2024
https://doi.org/10.1109/TNET.2024.3366166
Shi YKuo WHuang CChou YFang SYang D(2024)Cross-Layer Video Synthesizing and Antenna Allocation Scheme for Multi-View Video Provisioning Under Massive MIMO NetworksIEEE Transactions on Mobile Computing10.1109/TMC.2022.322777023:1(327-340)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMC.2022.3227770
Lu JLu BXu JSong LZhang W(2024)A Priority Aware Free Viewpoint Video Transmit Scheme Based on QUIC2024 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB62888.2024.10608226(1-6)Online publication date: 19-Jun-2024
https://doi.org/10.1109/BMSB62888.2024.10608226
Shen HLi XJi HZhang H(2023)DIBR-Based Collaborative Computation in Edge Network for Multiplayer Online VR Game2023 IEEE International Conference on Communications Workshops (ICC Workshops)10.1109/ICCWorkshops57953.2023.10283486(1451-1456)Online publication date: 28-May-2023
https://doi.org/10.1109/ICCWorkshops57953.2023.10283486
Yeh MWang CYang DLee JLiao W(2022)Mobile Proxy Caching for Multi-View 3D Videos With Adaptive View SelectionIEEE Transactions on Mobile Computing10.1109/TMC.2020.304771421:8(2909-2921)Online publication date: 1-Aug-2022
https://doi.org/10.1109/TMC.2020.3047714
Shi YKuo WHuang CChou YFang SYang D(2020)Cross-Layer Allocation Scheme for Multi-View Videos in Massive MIMO NetworksICC 2020 - 2020 IEEE International Conference on Communications (ICC)10.1109/ICC40277.2020.9148824(1-6)Online publication date: Jun-2020
https://doi.org/10.1109/ICC40277.2020.9148824
Yeh MWang CYang DLiao W(2019)Efficient Caching for 360° Videos with Dynamic View Selection2019 IEEE/CIC International Conference on Communications in China (ICCC)10.1109/ICCChina.2019.8855943(225-230)Online publication date: Aug-2019
https://doi.org/10.1109/ICCChina.2019.8855943
Chen MHu KChung IChou C(2019)Towards VR/AR Multimedia Content Multicast over Wireless LAN2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC)10.1109/CCNC.2019.8651772(1-6)Online publication date: Jan-2019
https://doi.org/10.1109/CCNC.2019.8651772
Ballout AGhaddar AWehbi H(2019)MMVS/COEMultimedia Tools and Applications10.1007/s11042-018-6564-678:8(10753-10772)Online publication date: 25-May-2019
https://dl.acm.org/doi/10.1007/s11042-018-6564-6
Lee JYang DChen YLiao W(2018)Efficient Multi-View 3D Video Multicast with Depth-Image-Based Rendering in LTE-Advanced Networks with Carrier AggregationIEEE Transactions on Mobile Computing10.1109/TMC.2017.270741617:1(85-98)Online publication date: 1-Jan-2018
https://doi.org/10.1109/TMC.2017.2707416
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents