Abstract
The new generation of 3D video coding standard, denoted as 3D High Efficiency Video Coding (3D-HEVC), uses Multi-view Video Plus Depth (MVD) format to represent stereo videos. Due to the reason that the fringe information of depth maps has great influence on the video quality of synthesized views, Depth Modeling Modes (DMMs) are introduced to maintain the quality of depth maps, while causing computational complexity increase tremendously. Therefore, a multi-strategy depth intra mode decision algorithm is proposed in this paper. It incorporates early rough mode decision (RMD) termination strategy, candidate mode reduction strategy and fast DMM decision strategy. The experimental results indicate that the proposed algorithm can obtain an average encoding time reduction of 34.38% for depth map coding, with just 0.43% BDBR increase.
Similar content being viewed by others
References
Bjontegarrd G (2001) Calculation of average PSNR differences between RD-curves. VCEG-M33
Chen J, Wang BH, Zeng HQ, Cai CH, Ma KK (2017) Sum-of-gradient based fast intra coding in 3d-hevc for depth map sequence (sog-fdic). J Vis Commun Image Represent 48:329–339
Correa G, Assuncao PA, Agostini LV, da Sliva LA (2015) Fast HEVC encoding decisions using data mining. IEEE Trans Circ Syst Video Technol 25(4):660–673
Da-Silva TL, Agostini LV, Da-Silva CLA (2015) Fast mode selection algorithm based on texture analysis for 3D-HEVC intra prediction. IEEE Int Conf Multimed Expo (ICME):1–6
Duch MM, Varas D, Rubió JRM, Ruiz-Hidalgo J, Marques F (2018) 3D hierarchical optimization for multi-view depth map coding. Multimed Tools Appl 77(15):19869–19894
Fan J, Li Q, Song J (2016) A fast depth intra mode selection algorithm. In: International conference on artificial intelligence and industrial engineering
Fehn C (2004) Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. Int Soc Opt Photo 5291:93–105
Fu CH, Zhao YW, Zhang HB, Chan YL, Siu WC (2017) Depth modelling mode decision for depth intra coding via good feature. IEEE Int Conf Image Proc:4018–4022
Gu Z, Zheng J, Ling N, Zhang P (2013) Fast intra prediction mode selection for intra depth map coding. ISO/IEC JTC1/SC29/WG11 MPEG2011 N, 12745
Guo L, Tian X, Chen Y (2016) Simplified depth intra coding for 3D-HEVC based on gray-level co-occurrence matrix. IEEE Int Conf Sign Image Proc (ICSIP):328–332
Kauff P, Atzpadin N, Fehn C, Müller M, Schreer O, Smolic A, Tanger R (2007) Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Signal Process Image Commun 22(2):217–234
Lainema J, Bossen F, Han WJ, Min J, Ugur K (2012) Intra coding of the HEVC standard. IEEE Trans Circ Syst Video Technol 22(12):1792–1801
Ma S, Lin Y, Zhu C, Zheng J, Yu L, Wang X (2014) Improved segment-wise DC coding for HEVC intra prediction of depth maps. IEEE Int Conf Sign Inform Proc Assoc Ann Summ Conf (APSIPA):1–4
Merkle P, Müller K, Wiegand T (2013) Coding of depth signals for 3D video using wedgelet block segmentation with residual adaptation. IEEE Int Conf Multimed Expo (ICME):1–6
Müller K, Vetro A (2014) Common test conditions of 3DV Core experiments, document JCT3V-G1100. CA, USA, San Jose
Müller K, Schwarz H, Marpe D, Bartnik C, Bosse S, Brust H, Tech G (2013) 3D high-efficiency video coding for multi-view video and depth data. IEEE Trans Image Process 22(9):3366–3378
Park CS (2015) Edge-based intramode selection for depth-map coding in 3D-HEVC. IEEE Trans Image Process 24(1):155–162
Sanchez G, Agostini L, Marcon C (2017) Complexity reduction by modes reduction in RD-list for intra-frame prediction in 3D-HEVC depth maps. IEEE Int Symp Circ Syst (ISCAS):1–4
Sullivan GJ, Ohm J, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circ Syst Video Technol 22(12):1649–1668
Sullivan GJ, Boyce JM, Chen Y, Ohm JR, Segall CA, Vetro A (2013) Standardized extensions of high efficiency video coding (HEVC). IEEE J Select Topics Sign Proc 7(6):1001–1016
Sze V, Budagavi M, Sullivan GJ (2014) High efficiency video coding (HEVC). Integrated circuit and systems. Algo Architect 39:40
Tech G, Wegner K, Chen Y, Yea S (2013) 3D-HEVC test model 3. Document: JCT3V-C1005, draft 3 of 3D-HEVC test model description, Geneva
Zhang QW, An P, Zhang Y, Zhang ZY (2011) Depth map intra coding based on virtual view rendering distortion estimation. J Electron Inf Technol 33(11):2541–2546
Zhang Q, Li N, Huang L, Gan Y (2014) Effective early termination algorithm for depth map intra coding in 3D-HEVC. Electron Lett 50(14):994–996
Zhang HB, Tsang SH, Chan YL, Fu CH, Su WM (2015) Early determination of intra mode and segment-wise DC coding for depth map based on hierarchical coding structure in 3D-HEVC. Proc APSIPA Ann Summ Conf:374–378
Zhang HB, Fu CH, Chan YL, Tsang SH, Siu WC (2018) Probability-based depth intra mode skipping strategy and novel VSO metric for DMM decision in 3D-HEVC. IEEE Trans Circ Syst Video Technol 28(2):513–527
Acknowledgements
This paper is supported by the Fujian Provincial Natural Science Foundation (2016 J01306), the Research and Innovation Project for College Graduates of Huaqiao University (1511301035).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, C., Feng, G., Cai, C. et al. Multi-strategy depth intra mode decision algorithm in 3D-HEVC. Multimed Tools Appl 79, 8841–8861 (2020). https://doi.org/10.1007/s11042-019-7715-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-7715-0