Skip to main content
SpringerLink
Log in

Fast intra mode decision for depth coding in 3D-HEVC

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

The emergent 3D High Efficiency Video Coding (3D-HEVC) is an extension of the High Efficiency Video Coding (HEVC) standard for the compression of the multi-view texture videos plus depth maps format. Since depth maps have different statistical properties compared to texture video, various new intra tools have been added to 3D-HEVC depth coding. In current 3D-HEVC, new intra tools are utilized together with the conventional HEVC intra prediction modes for depth coding. This technique achieves the highest possible coding efficiency, but leads to an extremely high computational complexity which limits 3D-HEVC from practical applications. In this paper, we propose a fast intra mode decision algorithm for depth coding in 3D-HEVC. The basic idea of the proposed algorithm is to utilize the depth map characteristics to predict the current depth prediction mode and skip some specific depth intra modes rarely used in 3D-HEVC depth coding. Based on this analysis, two fast intra mode decision strategies are proposed including reduction of the number of conventional intra prediction modes, and simplification of depth modeling modes (DMMs). Experimental results demonstrate that the proposed algorithm can save 30 % coding runtime on average while maintaining almost the same rate-distortion (RD) performance as the original 3D-HEVC encoder.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Bjontegaard, G. (2001). Calculation of average PSNR difference between RD-curves, 13th VCEG Meeting, Doc. VCEG-M33, Austin, TX.

  • Cernigliaro, G., Jaureguizar, F., Cabrera, J., & García, N. (2013). Low complexity mode decision and motion estimation for H.264/AVC based depth maps encoding in free viewpoint video. IEEE Transactions on Circuits and Systems for Video Technology, 23(5), 769–783.

    Article  Google Scholar 

  • Chen, Y., Tech, G., Wegner, K. & Yea, S. (2014). Test Model 10 of 3D-HEVC and MV-HEVC, Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) document JCT3V-J1003, 10th Meeting: Strasbourg, FR.

  • Chen, Y., Hannuksela, M. M., Suzuki, T., & Hattori, S. (2014). Overview of the MVC + D 3D video coding standard. Journal of Visual Communication and Image Representation, 25(4), 679–688.

    Article  Google Scholar 

  • Chen, Y., & Vetro, A. (2014). Next-Generation 3D formats with depth map support. IEEE MultiMedia, 21(2), 90–94.

    Article  Google Scholar 

  • Fehn, C., & Fehn, C. (2004). Depth-Image-Based Rendering (DIBR), Compression, and Transmission for a New Approach on 3D-TV. Bellingham, WA: SPIE.

    Book  Google Scholar 

  • Gu, Z., Zheng, J., Ling, N., & Zhang, P. (2013). Fast depth modeling mode selection for 3D HEVC depth intra coding. In Proceedings 2013 IEEE International Conference on Multimedia and Expo Workshops (pp. 1–4).

  • Gu, Z., Zheng, J., Ling, N., & Zhang, P. (2014). Fast bi-partition mode selection for 3D HEVC depth intra coding. In Proceedings 2014 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1–6).

  • https://hevc.hhi.fraunhofer.de/svn/svn_3DVCSoftware/branches/HTM-DEV-2.0-dev0/cfg/3D-HEVC/

  • Lainema, J., Bossen, F., Han, W.-J., Min, J., & Ugur, K. (2012). Intra coding of the HEVC standard. IEEE Transactions on Circuits and Systems for Video Technology, 22(12), 1792–1801.

    Article  Google Scholar 

  • Lee, J. Y., Wey, H.-C., & Park, D.-S. (2011). A fast and efficient multi-view depth image coding method based on temporal and inter-view correlations of texture images. IEEE Transactions on Circuits and Systems for Video Technology, 21(12), 1859–1868.

    Article  Google Scholar 

  • Lei, J., Li, S., Zhu, C., Sun, M., & Hou, C. (2015). Depth coding based on depth-texture motion and structure similarities. IEEE Transactions on Circuits and Systems for Video Technology, 25(2), 275–286.

    Article  Google Scholar 

  • Lei, J., Sun, J., Pan, Z., Kwong, S., Duan, J., & Hou, C. (2015). Fast mode decision using inter-view and inter-component correlations for multiview depth video coding. IEEE Transactions on Industrial Informatics, 11(4), 978–986.

    Article  Google Scholar 

  • Merkle, P., & Müller, K. (2014). CE5 related: DMM1 signaling based onintra direction, Joint Collaborative Team on 3D Video CodingExtensions (JCT-3V) document JCT3V-G0108, 7th Meeting: San José, US (pp. 11–17).

  • Mueller, K., & Vetro, A. (2014). Common test conditions of 3DV core experiments, Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) document JCT3V-G1100, 7th Meeting: San José, US.

  • Müller, K., Merkle, P., & Wiegand, T. (2011). 3-D video representation using depth maps. Proceedings of the IEEE, 99(4), 643–656.

    Article  Google Scholar 

  • Müller, K., Schwarz, H., Marpe, D., Bartnik, C., Bosse, S., Brust, H., et al. (2013). 3D high efficiency video coding for multi-view video and depth data. IEEE Transactions on Image Processing, 22(9), 3366–3378.

    Article  MathSciNet  Google Scholar 

  • Pan, Z., Kwong, S., Sun, M., & Lei, J. (2014). Early MERGE mode decision based on motion estimation and hierarchical depth correlation for HEVC. IEEE Transactions on Broadcasting, 60(2), 405–412.

    Article  Google Scholar 

  • Park, C. (2015). Edge-based intramode selection for depth-map coding in 3D-HEVC. IEEE Transactions on Image Processing, 24(1), 155–162.

    Article  MathSciNet  Google Scholar 

  • Sanchez, G., Saldanha, M., Balota, G., Zatt, B., Porto, M., & Agostini, L. (2014). A complexity reduction algorithm for depth maps intra prediction on the 3D-HEVC. In Proceedings 2014 IEEE Visual Communications and Image Processing Conference (VCIP) (pp. 137–140).

  • Sanchez, G., Saldanha, M., Balota, G., Zatt, B., Porto, M., & Agostini, L. (2014). Complexity reduction for 3D-HEVC depth maps intra-frame prediction using simplified edge detector algorithm. In Proceedings 2014 IEEE International Conference on Image Processing (ICIP) (pp. 3209–3213).

  • Shen, L., Zhang, Z., & Liu, Z. (2012). Inter mode selection for depth map coding in 3D video. IEEE Transactions on Consumer Electronics, 58(3), 1857–1865.

    Google Scholar 

  • Shen, L., An, P., Liu, Z., & Zhang, Z. (2014). Low complexity depth coding assisted by coding information from color video. IEEE Transactions on Broadcasting, 60(1), 128–133.

    Article  Google Scholar 

  • Shen, L., An, P., Zhang, Z., Hu, Q., & Chen, Z. (2015). A 3D-HEVC fast mode decision algorithm for real time applications. ACM Transactions on Multimedia Computing, Communications, and Applications, 11(3), 34.

    Article  Google Scholar 

  • Shen, L., & Zhang, Z. (2014). Efficient depth coding in 3D video to minimize coding bitrate and complexity. Multimedia Tools and Applications, 72(2), 1639–1652.

    Article  Google Scholar 

  • Song, Y., & Ho, Y. (2013). Simplified inter-component depth modeling in 3D-HEVC. In Proceedings IEEE 11th IVMSP Workshop (pp. 1–4).

  • Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012). Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on Circuits and Systems for Video Technology, 22(12), 1649–1668.

    Article  Google Scholar 

  • Sullivan, G., Boyce, J., Chen, Y., Ohm, J.-R., Segall, C., & Vetro, A. (2013). Standardized extensions of high efficiency video coding (HEVC). IEEE Journal of Selected Topics in Signal Processing, 7(6), 1001–1016.

    Article  Google Scholar 

  • Tanimoto, M., Fujii, T., & Suzuki, K. (2008). View Synthesis Algorithmin View Synthesis Reference Software 2.0 (VSRS 2.0), ISO/IEC JTC1/SC29/WG11 M16090, Lausanne, Switzerland.

  • Vetro, Anthony., & Müller, Karsten. (2012). Description of Coreexperiments in 3D video coding, ISO/IEC JTC1/SC29/WG11 document W12746, Geneva, Switzerland.

  • Vetro, A., & Müller, K. (2012). Description of Core experiments in 3Dvideo coding, ISO/IEC JTC1/SC29/WG11 document W12746, Geneva, Switzerland.

  • Wang, M., Jin, X., & Goto, S. (2010). Difference detection based early mode termination for depth map coding in MVC. In Proceedings 28th Picture Coding Symposium (pp. 502–505).

  • Yoon, D. H., & Ho, Y. S. (2011). Fast mode decision algorithm for depth coding in 3-D video systems using H.264/AVC. In Proceedings 5th Pacific-Rim Symposium Image Video Technology (pp. 25–35).

  • Zeng, H., Wang, Y., Wei, Z., & Cai, C. (2014). Efficient two-stage early SKIP mode termination for depth video coding. Computers and Electrical Engineering, 40(4), 1344–1352.

    Article  Google Scholar 

  • Zhang, M., Zhao, C., Xu, J., & Bai, H. (2013). A fast depth-map wedgelet partitioning scheme for intra prediction in 3D video coding. In Proceedings IEEE International Symposium on Circuits and Systems(ISCAS) (pp. 2852–2855).

  • Zhang, Q., An, P., Zhang, Y., Shen, L., & Zhang, Z. (2011). Low complexity multiview video plus depth coding. IEEE Transactions on Consumer Electronics, 57(4), 1857–1865.

    Article  Google Scholar 

  • Zhang, Q., Li, N., Huang, L., & Gan, Y. (2014). Effective early termination algorithm for depth map intra coding in 3D-HEVC. Electronics Letters, 50(14), 994–996.

    Article  Google Scholar 

  • Zhang, Q., Wu, Q., Wang, X., & Gan, Y. (2014). Early SKIP mode decision for three-dimensional high efficiency video coding using spatial and interview correlations. Journal of Electronic Imaging, 23(5), 053017-1–053017-8.

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank the editors and anonymous reviewers for their valuable comments. This work was supported in part by the National Natural Science Foundation of China under Grant No. 61302118, 61402422, 61401404, 61403349, 61502435 and 61572445, the Scientific and Technological Project of Zhengzhou under Grant No. 141PPTGG360, the Key Projects of Scientific and Technological of the Education Department of Henan Province No. 14B520066, and 15A520033, and in part by the Doctorate Research Funding of Zhengzhou University of Light Industry, under Grant No. 2013BSJJ047.

Author information

Authors and Affiliations

  1. College of Computer and Communication Engineering, Zhengzhou University of Light Industry, No. 5 Dongfeng Road, Zhengzhou, 450002, China

    Qiuwen Zhang, Yongshuang Yang, Huawen Chang, Weiwei Zhang & Yong Gan

Authors
  1. Qiuwen Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongshuang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huawen Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weiwei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yong Gan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qiuwen Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Q., Yang, Y., Chang, H. et al. Fast intra mode decision for depth coding in 3D-HEVC. Multidim Syst Sign Process 28, 1203–1226 (2017). https://doi.org/10.1007/s11045-016-0388-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11045-016-0388-1

Keywords

Search

Navigation