Skip to main content
SpringerLink
Log in

Complexity and compression efficiency assessment of 3D-HEVC encoder

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a complexity and compression efficiency assessment of the 3D-High Efficiency Video Coding (3D-HEVC) encoder. An experimental evaluation was carried out to identify the encoding tools with the highest impact on the computational complexity of 3D-HEVC. The evaluated tools were firstly divided into three categories: HEVC, multiview, and depth maps tools. Thus, incremental analyses with a set of 28 encoder configurations were performed to point out the compression efficiency and the computational complexity of each encoding tool individually. Experimental results demonstrated different compression-complexity operation points for the 3D-HTM reference software, providing relevant information for the implementation of 3D-HEVC encoders with different tradeoff possibilities between compression efficiency and complexity. The obtained results also allowed identifying encoding tools that can be further optimized in future works.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Muller K, Schwarz H, Marpe D, Bartnik C, Bosse S, Brust H, Hinz T, Lakshman H, Merkle P, Rhee F, Tech G, Winken M, Wiegand T (2013) 3D high-efficiency video coding for multi-view video and depth data. IEEE Trans Image Proc 22:3366–3378. https://doi.org/10.1109/TIP.2013.2264820

    Article  MathSciNet  MATH  Google Scholar 

  2. Tech G, Chen Y, Muller K, Ohm J, Vetro A, Wang Y (2016) Overview of the multiview and 3D extensions of high efficiency video coding. IEEE Trans Circuits Syst Video Technol 26:35–49. https://doi.org/10.1109/TCSVT.2015.2477935

    Article  Google Scholar 

  3. Sullivan G, Ohm J, Han W, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22:1649–1668. https://doi.org/10.1109/TCSVT.2012.2221191

    Article  Google Scholar 

  4. Kauff P, Atzpadin N, Fehn C, Muller M, Schreer O, Smolic A, Tanger R (2007) Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Signal Process Image Commun 22:217–234. https://doi.org/10.1016/j.image.2006.11.013

    Article  Google Scholar 

  5. Bossen F, Bross B, Suhring K, Flynn D (2012) HEVC complexity and implementation analysis. IEEE Trans Circuits Syst Video Technol 22:1685–1696. https://doi.org/10.1109/TCSVT.2012.2221255

    Article  Google Scholar 

  6. Correa G, Assuncao P, Agostini L, Cruz L (2012) Performance and computational complexity assessment of high-efficiency video encoders. IEEE Trans Circuits Syst Video Technol 22:1899–1909. https://doi.org/10.1109/TCSVT.2012.2223411

    Article  Google Scholar 

  7. Vanne J, Viitanen M, Hamalainen T, Hallapuro A (2012) Comparative rate-distortion-complexity analysis of HEVC and AVC video codecs. IEEE Trans Circuits Syst Video Technol 22:1885–1898. https://doi.org/10.1109/TCSVT.2012.2223013

    Article  Google Scholar 

  8. Sebai D (2020) Performance analysis of HEVC scalable extension for depth maps. J Sign Process Syst 92:1–15. https://doi.org/10.1007/s11265-020-01521-6

    Article  Google Scholar 

  9. Sanchez G, Silveira J, Agostini L, Marcon C (2018) Performance analysis of depth intra coding in 3D-HEVC. IEEE Trans Circuits Syst Video Technol 29:2509–2520. https://doi.org/10.1109/TCSVT.2018.2865645

    Article  Google Scholar 

  10. Vetro A, Wiegand T, Sullivan G (2011) Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard. Proc IEEE 99:626–642. https://doi.org/10.1109/JPROC.2010.2098830

    Article  Google Scholar 

  11. Merkle P, Muller K, Smolic A, Wiegand T (2006) Efficient compression of multi-view video exploiting inter-view dependencies based on H.264/MPEG4-AVC. IEEE Int Conf Multimed Expo. https://doi.org/10.1109/ICME.2006.262881

  12. Merkle P, Muller K, Marpe D, Wiegand T (2015) Depth intra coding for 3D video based on geometric primitives. IEEE Trans Circuits Syst Video Technol 26:570–582. https://doi.org/10.1109/TCSVT.2015.2407791

    Article  Google Scholar 

  13. Lee J, Park M, Kim C (2015) 3D-CE1: depth intra Skip (DIS) mode. http://phenix.int-evry.fr/jct3v/doc_end_user/documents/11_Geneva/wg11/JCT3V-K0033-v4.zip. Accessed 3 March 2020

  14. Liu H, Chen Y (2015) Generic segment-wise DC for 3D-HEVC depth intra coding. IEEE Int Conf Image Proc. https://doi.org/10.1109/ICIP.2014.7025651

  15. Zhang L, Kang J, Zhao X, Chen Y, Joshi R (2013) Neighboring block based disparity vector derivation for 3D-AVC. Visual Commun Image Process. https://doi.org/10.1109/VCIP.2013.6706401

  16. Chen Y, Zhao X, Zhang L, Kang J (2016) Multiview and 3D video compression using neighboring block based disparity vectors. IEEE Trans Multimedia 18:576–589. https://doi.org/10.1109/TMM.2016.2525010

    Article  Google Scholar 

  17. Li X, Zhang L, Ying C (2014) Advanced residual predction in 3D-HEV. IEEE Int Conf Image Proc. https://doi.org/10.1109/ICIP.2013.6738360

  18. Liu H, Jung J, Sung J, Jia J, Yea S (2012) 3D-CE2.H: results of illumination compensation for inter-view prediction. http://phenix.int-evry.fr/jct3v/doc_end_user/documents/2_Shanghai/wg11/JCT3V-B0045-v7.zip. Accessed 3 March 2020

  19. Jager F (2013) Depth-based block partitioning for 3D video coding picture coding Symp. https://doi.org/10.1109/PCS.2013.6737770

  20. Jager F (2012) Simplified depth map intra coding with an optional depth lookup table. Int. Conf. 3D imaging. https://doi.org/10.1109/IC3D.2012.6615142

  21. Winken M, Schwarz H, Wiegand T (2012) Motion vector inheritance for high efficiency 3D video plus depth coding. Picture Coding Symp. https://doi.org/10.1109/PCS.2012.6213284

  22. Mora E, Cagnazzo M, Pesquet-Popescu B (2014) Initialization, limitation, and predictive coding of the depth and texture Quadtree in 3D-HEVC. IEEE Trans Circuits Syst Video Technol 24:1554–1565. https://doi.org/10.1109/TCSVT.2013.2283110

    Article  Google Scholar 

  23. Muller K, Merkle P, Tech G, Wiegand T (2012) 3D video coding with depth modeling modes and view synthesis optimization. IEEE Asia Pacific Signal Information Proc Association Annual Summit Conf.

  24. Helle P, Oudin S, Bross B, Marpe D, Bici M, Ugur K, Jung J, Clare G, Wiegand T (2012) Block merging for Quadtree-based partitioning in HEVC. IEEE Trans Circuits Syst Video Technol 22:1720–1731. https://doi.org/10.1109/TCSVT.2012.2223051

    Article  Google Scholar 

  25. Lainema J, Bossen F, Han W, Min J, Ugur K (2012) Intra coding of the HEVC standard. IEEE Trans Circuits Syst Video Technol 22:1792–1801. https://doi.org/10.1109/TCSVT.2012.2221525

    Article  Google Scholar 

  26. 3D-HEVC Test Model. https://hevc.hhi.fraunhofer.de/svn/svn_3DVCSoftware/tags/HTM-16.0/. Accessed 3 March 2020.

  27. Muller K, Vetro A (2014) Common Test Conditions of 3DV Core Experiments ISO/IEC JTC1/SC29/WG11 MPEG2011/N12745. http://phenix.int-evry.fr/jct3v/doc_end_user/documents/7_San%20Jose/wg11/JCT3V-G1100-v1.zip. Accessed 3 March 2020

  28. Bjontegaard G (2001) Calculation of Average PSNR Differences Between RD Curves. http://wftp3.itu.int/av-arch/video-site/0104_Aus/VCEG-M33.doc. Accessed 3 March 2020

  29. Norkin A, Bjontegaard G, Fuldseth A, Narroschke M, Ikeda M, Andersson K, Zhou M, Auwera G (2012) HEVC Deblocking Filter. IEEE Trans Circuits Syst Video Technol 22:1746–1754. https://doi.org/10.1109/TCSVT.2012.2223053

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Video Technology Research Group (ViTech), Federal University of Pelotas (UFPel), Pelotas, Brazil

    Mário Saldanha, Ruhan Conceição, Giovanni Avila, Altamiro Susin, Marcelo Porto, Bruno Zatt, Guilherme Correa & Luciano Agostini

  2. Federal University of Rio Grande do Sul (UFRGS), Porto Alegre, Brazil

    Vladimir Afonso

Authors
  1. Mário Saldanha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruhan Conceição
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vladimir Afonso
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Giovanni Avila
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Altamiro Susin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marcelo Porto
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Bruno Zatt
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Guilherme Correa
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Luciano Agostini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mário Saldanha.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saldanha, M., Conceição, R., Afonso, V. et al. Complexity and compression efficiency assessment of 3D-HEVC encoder. Multimed Tools Appl 79, 25723–25746 (2020). https://doi.org/10.1007/s11042-020-09257-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09257-y

Keywords

Search

Navigation