Abstract
Achieving high-performance coding for a depth map is one of the most important challenges in 3D video coding. In this paper, a quality enhancement method is proposed to accomplish better coding efficiency. A new technique separating contour and flat regions is designed, and a contour-aware quality enhancement algorithm is presented to improve depth map quality. We also propose a fast mode decision process to reduce computational complexity. The proposed fast algorithm uses similarity between texture video and depth map coding. The encoding process for a depth map is terminated early by using coded information from a texture video. Experimental results show that the quality of the depth map is improved by 0.11–0.59 dB, which translates into a bit rate saving of 2.19–8.19 %. The proposed fast algorithm saves encoding time, on average, by 36.4 %.
Access this article
We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Similar content being viewed by others
References
Willner, K., Ugur, K., Salmimaa, M., Hallapuro, A., Lainema, J.: Mobile 3D video using MVC and N800 internet tablet. In: Proceedings of IEEE 3DTV Conference True Vision—Capture, Transmission and Display of 3D Video, pp. 69–72 (2008)
Smolic, Müller, K., Dix, K., Merkle, P., Kauff, P., Wiegand, T.: Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems. In: Proceedings of IEEE International Conference on Image Processing (ICIP), San Diego, CA (2008)
Liu, H., Chen, S., Kubota, N.: Intelligent video systems and analytics: a survey. IEEE Trans. Ind. Inform. 9(3), 1222–1233 (2013)
Vetro, Wiegand, T., Sullivan, G.J.: Overview of the stereo and multiview video coding extensions of the H.264/AVC standard. In: Proceedings of IEEE, Special Issue 3D Media Displays, vol. 99, no. 4, pp. 626–642 (2011)
ITU-T and ISO/IEC JTC 1: “Final Draft Amendment 3”, Amendment 3 to ITU-T Recommendation H.262 and ISO/IEC 13818-2 (MPEG-2 Video), ISO/IEC JTC 1/SC 29/WG 11 (MPEG) Doc. N1366 (1996)
Muller, K., Merkle, P., Tech, G., Wiegand, T.: 3D video formats and coding methods. In Proceedings of the IEEE (2010)
ISO/IEC JTC1/SC29/WG11 W8019: Description of Core Experiments in MVC (2006)
ISO/IEC JTC1/SC29/WG11 N12036: Call for Proposals on 3D Video Coding Technology. Geneva (2011)
JCT-3V and ISO/IEC JTC1/SC29/WG11: 3D-AVC Draft Text 8. Geneva (2013)
JCT-VC and ISO/IEC JTC1/SC29/WG11: High efficiency video coding (HEVC) text specification draft 6. San Jose, CA, USAN (2012)
Silva, D.V.S.X., Fernando, W.A.C., Yasakethu, S.L.P.: Object based coding of depth maps for 3D video coding. IEEE Trans. Consum. Electron. 55(3), 1699–1706 (2009)
Oh, K.J., Vetro, A., Ho, Y.S.: Depth Coding using a boundary reconstruction filter for 3D video systems. IEEE Trans. Circuits Syst. Video Technol. 21(3), 350–359 (2011)
Wiegand, T., Schwarz, H., Joch, A., Kossentini, F., Sullivan, G.J.: Rate-constrained coder control and comparison of video coding standards. IEEE Trans. Circuits Syst. Video Technol 13, 688–703 (2003)
Cernigliaro, G., Jaureguizar, F., ortega, A., Cabrera, J., Garcia, N.: Fast mode decision for multiview video coding based on depth maps. In: Proceedings of SPIE Visual Communications and Image Processing, vol. 7257, no. 1 (2009)
Zhu, W., Tian, X., Zhou, F., Chen, Y.: Fast intermode decision based on textural segmentation and correlations for multiview video coding. IEEE Trans. Consum. Electron. 56(3), 1696–1704 (2010)
Shen, L., Liu, Z., Yan, T., Zang, Z., An, P.: View-adaptive motion estimation and disparity estimation for low complexity multiview video coding. IEEE Trans. Circuits Syst. Video Technol. 20(6), 925–930 (2010)
De Silva, D., Fernando, W., Arachchi, H.: A new mode selection technique for coding depth maps of 3D video. In: ICASSP of IEEE, pp. 686-689 (2010)
Zhang, Q., An, P., Zhang, Y., Shen, L., Zhang, Z.: Low complexity multiview video plus depth coding. IEEE Trans. Consum. Electron. 57(4), 1857–1865 (2011)
Shen, L., Zhang, Z., Liu, Z.: Inter mode selection for depth map coding in 3D video. IEEE Trans. Consum. Electron. 58(3), 926–931 (2012)
Shen, L., An, P., Liu, Z., Zhang, Z.: Low complexity depth coding assisted by coding information from color video. IEEE Trans. Broadcast. 60(1), 128–133 (2014)
Shen, L., Liu, Z., Zhang, X., Zhao, W., Zhang, Z.: An effective CU size decision method for HEVC encoders. IEEE Trans. Multimed. 15(2), 465–470 (2013)
Mora, E.G., Jung, J., Cagnazzo, M.: Initialization, limitation, and predictive coding of the depth and texture quadtree in 3D-HEVC. IEEE Trans. Circuits Syst. Video Technol. 24(9), 1554–1565 (2014)
Kang, J., Chung, K.: A fast mode decision using texture information for intra depth coding in 3DVC. In: Proceedings of IEEE Symposium on Computers and Communication (ISCC) (2014)
3DV-ATM reference software version 13.3. http://mpeg3dv.nokiaresearch.com/svn/mpeg3dv/tags/3DV-ATMv13.3/
JCT-3V and ISO/IEC JTC1/SC29/WG11 E1100: Common test conditions of 3DV core experiments. Vienna (2013)
Bjontegaard, G.: Calculation of average PSNR differences between RD-curves, ITU-T SG16/Q.6 document VCEG-M33. Austin, TX, USA (2001)
ISO/IEC JTC1/SC29/WG11 N12188: 3DV depth estimation and view synthesis software package (2011)
ISO/IEC JTC1/SC29/WG11 N12347: Report of subjective test results from the call for proposals on 3D video coding technology (2011)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kang, J., Chung, K. High-performance depth map coding for 3D-AVC. SIViP 10, 1017–1024 (2016). https://doi.org/10.1007/s11760-015-0853-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-015-0853-6