Skip to main content
Log in

High-performance depth map coding for 3D-AVC

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Achieving high-performance coding for a depth map is one of the most important challenges in 3D video coding. In this paper, a quality enhancement method is proposed to accomplish better coding efficiency. A new technique separating contour and flat regions is designed, and a contour-aware quality enhancement algorithm is presented to improve depth map quality. We also propose a fast mode decision process to reduce computational complexity. The proposed fast algorithm uses similarity between texture video and depth map coding. The encoding process for a depth map is terminated early by using coded information from a texture video. Experimental results show that the quality of the depth map is improved by 0.11–0.59 dB, which translates into a bit rate saving of 2.19–8.19 %. The proposed fast algorithm saves encoding time, on average, by 36.4 %.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Willner, K., Ugur, K., Salmimaa, M., Hallapuro, A., Lainema, J.: Mobile 3D video using MVC and N800 internet tablet. In: Proceedings of IEEE 3DTV Conference True Vision—Capture, Transmission and Display of 3D Video, pp. 69–72 (2008)

  2. Smolic, Müller, K., Dix, K., Merkle, P., Kauff, P., Wiegand, T.: Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems. In: Proceedings of IEEE International Conference on Image Processing (ICIP), San Diego, CA (2008)

  3. Liu, H., Chen, S., Kubota, N.: Intelligent video systems and analytics: a survey. IEEE Trans. Ind. Inform. 9(3), 1222–1233 (2013)

    Article  Google Scholar 

  4. Vetro, Wiegand, T., Sullivan, G.J.: Overview of the stereo and multiview video coding extensions of the H.264/AVC standard. In: Proceedings of IEEE, Special Issue 3D Media Displays, vol. 99, no. 4, pp. 626–642 (2011)

  5. ITU-T and ISO/IEC JTC 1: “Final Draft Amendment 3”, Amendment 3 to ITU-T Recommendation H.262 and ISO/IEC 13818-2 (MPEG-2 Video), ISO/IEC JTC 1/SC 29/WG 11 (MPEG) Doc. N1366 (1996)

  6. Muller, K., Merkle, P., Tech, G., Wiegand, T.: 3D video formats and coding methods. In Proceedings of the IEEE (2010)

  7. ISO/IEC JTC1/SC29/WG11 W8019: Description of Core Experiments in MVC (2006)

  8. ISO/IEC JTC1/SC29/WG11 N12036: Call for Proposals on 3D Video Coding Technology. Geneva (2011)

  9. JCT-3V and ISO/IEC JTC1/SC29/WG11: 3D-AVC Draft Text 8. Geneva (2013)

  10. JCT-VC and ISO/IEC JTC1/SC29/WG11: High efficiency video coding (HEVC) text specification draft 6. San Jose, CA, USAN (2012)

  11. Silva, D.V.S.X., Fernando, W.A.C., Yasakethu, S.L.P.: Object based coding of depth maps for 3D video coding. IEEE Trans. Consum. Electron. 55(3), 1699–1706 (2009)

  12. Oh, K.J., Vetro, A., Ho, Y.S.: Depth Coding using a boundary reconstruction filter for 3D video systems. IEEE Trans. Circuits Syst. Video Technol. 21(3), 350–359 (2011)

    Article  Google Scholar 

  13. Wiegand, T., Schwarz, H., Joch, A., Kossentini, F., Sullivan, G.J.: Rate-constrained coder control and comparison of video coding standards. IEEE Trans. Circuits Syst. Video Technol 13, 688–703 (2003)

    Article  Google Scholar 

  14. Cernigliaro, G., Jaureguizar, F., ortega, A., Cabrera, J., Garcia, N.: Fast mode decision for multiview video coding based on depth maps. In: Proceedings of SPIE Visual Communications and Image Processing, vol. 7257, no. 1 (2009)

  15. Zhu, W., Tian, X., Zhou, F., Chen, Y.: Fast intermode decision based on textural segmentation and correlations for multiview video coding. IEEE Trans. Consum. Electron. 56(3), 1696–1704 (2010)

    Article  Google Scholar 

  16. Shen, L., Liu, Z., Yan, T., Zang, Z., An, P.: View-adaptive motion estimation and disparity estimation for low complexity multiview video coding. IEEE Trans. Circuits Syst. Video Technol. 20(6), 925–930 (2010)

    Article  Google Scholar 

  17. De Silva, D., Fernando, W., Arachchi, H.: A new mode selection technique for coding depth maps of 3D video. In: ICASSP of IEEE, pp. 686-689 (2010)

  18. Zhang, Q., An, P., Zhang, Y., Shen, L., Zhang, Z.: Low complexity multiview video plus depth coding. IEEE Trans. Consum. Electron. 57(4), 1857–1865 (2011)

    Article  Google Scholar 

  19. Shen, L., Zhang, Z., Liu, Z.: Inter mode selection for depth map coding in 3D video. IEEE Trans. Consum. Electron. 58(3), 926–931 (2012)

    MathSciNet  Google Scholar 

  20. Shen, L., An, P., Liu, Z., Zhang, Z.: Low complexity depth coding assisted by coding information from color video. IEEE Trans. Broadcast. 60(1), 128–133 (2014)

    Article  Google Scholar 

  21. Shen, L., Liu, Z., Zhang, X., Zhao, W., Zhang, Z.: An effective CU size decision method for HEVC encoders. IEEE Trans. Multimed. 15(2), 465–470 (2013)

    Article  Google Scholar 

  22. Mora, E.G., Jung, J., Cagnazzo, M.: Initialization, limitation, and predictive coding of the depth and texture quadtree in 3D-HEVC. IEEE Trans. Circuits Syst. Video Technol. 24(9), 1554–1565 (2014)

    Article  Google Scholar 

  23. Kang, J., Chung, K.: A fast mode decision using texture information for intra depth coding in 3DVC. In: Proceedings of IEEE Symposium on Computers and Communication (ISCC) (2014)

  24. 3DV-ATM reference software version 13.3. http://mpeg3dv.nokiaresearch.com/svn/mpeg3dv/tags/3DV-ATMv13.3/

  25. JCT-3V and ISO/IEC JTC1/SC29/WG11 E1100: Common test conditions of 3DV core experiments. Vienna (2013)

  26. Bjontegaard, G.: Calculation of average PSNR differences between RD-curves, ITU-T SG16/Q.6 document VCEG-M33. Austin, TX, USA (2001)

  27. ISO/IEC JTC1/SC29/WG11 N12188: 3DV depth estimation and view synthesis software package (2011)

  28. ISO/IEC JTC1/SC29/WG11 N12347: Report of subjective test results from the call for proposals on 3D video coding technology (2011)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jinmi Kang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kang, J., Chung, K. High-performance depth map coding for 3D-AVC. SIViP 10, 1017–1024 (2016). https://doi.org/10.1007/s11760-015-0853-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-015-0853-6

Keywords

Navigation