Skip to main content
Springer Nature Link
Log in

Fast intra-mode decision for depth map coding in 3D-HEVC

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

3D-high efficiency video coding (3D-HEVC) contains more encoding viewpoints than traditional HEVC, resulting in a significant increase of coding complexity. In this paper, we propose a low complexity intra mode decision algorithm to reduce the number of intra modes by detecting the flat area and texture direction of the depth map. The corresponding intra prediction modes are skipped when the flat region condition is satisfied. Otherwise, the direction of the edge is detected to decrease the number of angle modes in rough mode decision, which can reduce the intra-coding complexity and coding time cost. Experimental results demonstrate that the proposed algorithm achieves on average 36.48% time saving with negligible degradation of coding performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Tech, G., Chen, Y., Muller, K., Ohm, J., Vetro, A., Wang, Y.: Overview of the multiview and 3D extensions of high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 26(1), 35–49 (2016). https://doi.org/10.1109/TCSVT.2015.2477935

    Article  Google Scholar 

  2. Sullivan, G., Ohm, J., Han, W., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012). https://doi.org/10.1109/TCSVT.2012.2221191

    Article  Google Scholar 

  3. Muller, K., Merkle, P., Wiegand, T.: 3-D video representation using depth maps. Proc. IEEE 99(4), 643–656 (2011). https://doi.org/10.1109/JPROC.2010.2091090

    Article  Google Scholar 

  4. Kauff, P., Atzpadin, N., Fehn, C., Müller, M., Schreer, O., Smolic, A.: Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Signal Process Image Commun 22(2), 217–234 (2007)

    Article  Google Scholar 

  5. Vetro, A., Chen, Y., Mueller, K.: HEVC-compatible extensions for advanced coding of 3D and multiview video. In: 2015 data compression conference, Snowbird, UT, pp. 13–22 (2015)

  6. Müller, K., Schwarz, H., Marpe, D., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Rhee, H., Tech, G., Winken, M., Wiegand, T.: 3D high-efficiency video coding for multi-view video and depth data. IEEE Trans. Image Process. 22(9), 3366–3378 (2013). https://doi.org/10.1109/TIP.2013.2264820

    Article  MathSciNet  MATH  Google Scholar 

  7. Schwarz, H., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Müller, K., Rhee, H., Tech, G., Winken, M., Marpe, D., Wiegand, T.: Extension of high efficiency video coding (HEVC) for multiview video and depth data. In: IEEE international conference on image processing, Orlando, Florida, USA, pp. 205–208 (2012)

  8. Saldanha, M., Sanchez, G., Zatt, B., Porto, M., Agostini L.: Complexity reduction for the 3D-HEVC depth maps coding. IEEE International Symposium on Circuits and Systems (ISCAS), Lisbon, Portugal, 2015, pp. 621-624, https://doi.org/10.1109/iscas.2015.7168710

  9. Park, C.: Edge-based intramode selection for depth-map coding in 3D-HEVC. IEEE Trans. Image Process. 24(1), 155–162 (2015). https://doi.org/10.1109/TIP.2014.2375653

    Article  MathSciNet  MATH  Google Scholar 

  10. Zhang, Q., Huang, K., Wang, X., Jiang, B., Gan, Y.: Efficient multiview video plus depth coding for 3D-HEVC based on complexity classification of the treeblock. J. Real-Time Image Process 4, 1–18 (2017). https://doi.org/10.1007/s11554-017-0692-5

    Article  Google Scholar 

  11. Li, T., Yu, L., Wang, S., Wang, H.: Simplified depth intra coding based on texture feature and spatial correlation in 3D-HEVC. In: 2018 data compression conference, Snowbird, UT, pp. 421–421 (2018)

  12. Irwin, S.: An isotropic 3 × 3 image gradient operator. Presentation at Stanford A.I. Project 1968 (2014)

  13. Marpe, D., Schwarz, H., Bosse, S., Bross, B., Helle, P., Hinz, T., Kirchhoffer, H., Lakshman, H., Nguyen, T., Oudin, S., Siekmann, M., Suhring, K., Winken, M., Wiegand, T.: Video compression using nested quadtree structures, leaf merging, and improved techniques for motion representation and entropy coding. IEEE Trans. Circuits Syst. Video Technol. 20(12), 1676–1687 (2010)

    Article  Google Scholar 

  14. Lainema, J., Ugur, K., Bici, O.: Planar intra coding for improved subjective video quality. In: Document JCTVC-D326, 4th JVT-VC meeting, Daegu, KR. [Online]. http://phenix.int-evry.fr/jct (2011)

  15. Liu, P., He G., Xue, S. Li, Y.: A fast mode selection for depth modelling modes of intra depth coding in 3D-HEVC. In: Visual communications and image processing (VCIP), Chengdu, China, pp. 1–4 (2016)

  16. Sanchez, G., Agostini, L., Marcon, C.: Complexity reduction by modes reduction in RD-list for intra-frame prediction in 3D-HEVC depth maps. In: IEEE international symposium on circuits and systems (ISCAS), Baltimore, Maryland, pp. 1–4 (2017)

  17. Zhao, L., Zhang, L., Zhao, X., Ma, S., Zhao, D., Gao, W.: Further encoder improvement of intra mode decision. In: Document JCTVC-D283, 4th JVT-VC meeting, Daegu, KR. [Online]. Available: http://phenix.int-evry.fr/jct (2011)

  18. Zhang, H., Fu, C., Chan, Y., Tsang, S., Siu, W.: Probability-based depth intra-mode skipping strategy and novel VSO metric for DMM decision in 3D-HEVC. IEEE Trans Circuits Syst Video Technol 28(2), 513–527 (2018)

    Article  Google Scholar 

  19. Boseen. F.: 3D-HEVC software HTM16.0 [Online]. https://hevc.hhi.fraunhofer.de/svn/svn_3DVCSoftware/tags/HTM-16.0 (2015)

  20. Dong, X., Li, M., Miao, J., Wang, Z.: Edge detection operator for underwater target image. In: 2018 IEEE 3rd international conference on image, vision and computing (ICIVC), Chongqing, pp. 91–95 (2018)

  21. Long, X., Wu, X., Yang, X.: Remaining edges linking method of motion segmentation based on edge detection. In: 2012 9th international conference on fuzzy systems and knowledge discovery, Sichuan, pp. 1895–1899 (2012)

  22. Mueller, K., Vetro, A.: Common test conditions of 3DV core experiments. In: Document JCT3V-G1100, 7th JVT-3V meeting, San José [Online]. http://phenix.int-evry.fr/jct3v (2014)

  23. Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Prentice Hall, Upper Saddle River (2002)

    Google Scholar 

  24. Bjøntegaard, G.: Calculation of average PSNR differences between RD curves. In: Document VCEG-M33, 13th ITU-T SG16/Q6 VCEG meeting, Austin, Texas, USA (2001)

  25. Song, Y., Jia K., Wu, Q.: Low complexity texture mode decision method for 3D-HEVC. In: 2015 IEEE international conference on signal processing, communications and computing (ICSPCC). pp. 1–4. Ningbo (2015)

Download references

Acknowledgements

This paper is supported by the Project for the National Natural Science Foundation of China under Grants no. 61672064, the Beijing Natural Science Foundation under Grant no. 4172001, and Beijing Laboratory of Advanced Information Networks under Grants no. PXM2019_014204_500029.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

    Ruyi Zhang, Kebin Jia, Pengyu Liu & Zhonghua Sun

  2. Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing, 100124, China

    Ruyi Zhang, Kebin Jia, Pengyu Liu & Zhonghua Sun

Authors
  1. Ruyi Zhang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Kebin Jia
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Pengyu Liu
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Zhonghua Sun
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by RZ and KJ. The first draft of the manuscript was written by RZ and all authors commented on previous versions of the manuscript. The authors (PL and ZS) added after the revision of the manuscript are mainly verify the validity of the new algorithm and edit and review the revised manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kebin Jia.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, R., Jia, K., Liu, P. et al. Fast intra-mode decision for depth map coding in 3D-HEVC. J Real-Time Image Proc 17, 1637–1646 (2020). https://doi.org/10.1007/s11554-019-00920-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-019-00920-8

Keywords