ABSTRACT
Increasing throughput rates and technical developments in video streaming over the Internet offer an attractive solution for the distribution of immersive 3D multi-view. Nevertheless, robustness of video streaming is subject to its utilisation of efficient error resiliency and content aware adaptation techniques. Dynamic network characteristics resulting in frequent congestions may prevent video packets from being delivered in a timely manner. Packet delivery failures may become prominent, degrading 3D immersive video experience significantly. In order to overcome this problem, a novel view recovery technique for 3D free-viewpoint video is introduced to maintain 3D video quality in a cost-effective manner. In this concept, the undelivered (discarded) views as a result of adaptation in the network are recovered with high quality at the receiver side, using Side Information (SI) and the delivered frames of neighbouring views. The proposed adaptive 3D multi-view video streaming scheme is tested using Dynamic Adaptive Streaming over HTTP (MPEG-DASH) standard. Tests using the proposed adaptive technique have revealed that the perceptual 3D video quality under adverse network conditions is significantly improved thanks to the utilisation of the extra side information in view recovery.
- C.-M. Cheng, .-S.-J. Lin, and S.-H. Lai. Spatio-temporally consistent novel view synthesis algorithm from video-plus-depth sequences for autostereoscopic displays. Broadcasting, IEEE Trans. on, 57:523--532, 2011.Google Scholar
- E. Christensen et al. Web services description language (wsdl) 1.1, 2001.Google Scholar
- C. Gurler, S. Savas, and A. Tekalp. Quality of experience aware adaptation strategies for multi-view video over p2p networks. In Image Processing (ICIP), 2012 19th IEEE International Conference on, pages 2289--2292, 2012.Google ScholarCross Ref
- T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu. An efficient k-means clustering algorithm: Analysis and implementation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(7):881--892, 2002. Google ScholarDigital Library
- P. Merkle, A. Smolic, K. Muller, and T. Wiegand. Efficient prediction structures for multiview video coding. Circuits and Systems for Video Technology, IEEE Transactions on, 17(11):1461--1473, 2007. Google ScholarDigital Library
- K. Muller, A. Smolic, K. Dix, P. Merkle, P. Kauff, and T. Wiegand. View synthesis for advanced 3d video systems. EURASIP J. Image and Video Processing, 2008, 2008.Google Scholar
- I. Recommendation. Methodology for the subjective assessment of the quality of television pictures,recommendation itu-r bt. 500--11. ITU Telecom. Standardization Sector of ITU, 2002.Google Scholar
- I. Sodagar. The mpeg-dash standard for multimedia streaming over the internet. MultiMedia, IEEE, 18(4):62--67, 2011. Google ScholarDigital Library
- T. Stockhammer. Dynamic adaptive streaming over http --: standards and design principles. In Proceedings of the second annual ACM conference on Multimedia systems, MMSys '11, pages 133--144, New York, NY, USA, 2011. ACM. Google ScholarDigital Library
- Y. Sugiyama. An algorithm for solving discrete-time wiener-hopf equations based upon euclid's algorithm. Information Theory, IEEE Transactions on, 32(3):394--409, 1986. Google ScholarDigital Library
- G. J. Sullivan and R. L. Baker. Efficient quadtree coding of images and video. Image Processing, IEEE Transactions on, 3(3):327--331, 1994. Google ScholarDigital Library
- G. Tech, H. Schwarz, K. Muller, and T. Wiegand. 3d video coding using the synthesized view distortion change. In Picture Coding Symposium (PCS), 2012, pages 25--28. IEEE, 2012.Google ScholarCross Ref
- A. Vetro, T. Wiegand, and G. Sullivan. Overview of the stereo and multiview video coding extensions of the h.264/mpeg-4 avc standard. Proceedings of the IEEE, 99(4):626--642, 2011.Google ScholarCross Ref
- T. Wiegand and G. Sullivan. The h.264/avc video coding standard {standards in a nutshell}. Signal Processing Magazine, IEEE, 24(2):148--153, 2007.Google ScholarCross Ref
- Y. Zhao and L. Yu. A perceptual metric for evaluating quality of synthesized sequences in 3dv system. In Proc. of SPIE Vol, volume 7744, pages 77440X-1, 2010.Google Scholar
Index Terms
- Dynamic adaptive 3D multi-view video streaming over the internet
Recommendations
Adaptive delivery of immersive 3D multi-view video over the Internet
The increase in Internet bandwidth and the developments in 3D video technology have paved the way for the delivery of 3D Multi-View Video (MVV) over the Internet. However, large amounts of data and dynamic network conditions result in frequent network ...
Adaptive quality of service management for video streaming delivery over the internet: UDP protocol
TELE-INFO'08: Proceedings of the 7th WSEAS International Conference on Telecommunications and InformaticsQuality of Service (QoS) of video streams over IP networks depends on several factors such as video transmission rate, packet loss rate, and end-to-end transmission delay. There are three main obstacles in video streaming over the Internet. The first is ...
Smooth control of adaptive media playout for video streaming
Client-side data buffering is a common technique to deal with media playout interruptions of streaming video caused by network jitters and packet losses of best-effort networks. How-ever, stronger playout interruption protection inevitably amounts to ...
Comments