Skip to main content

Advertisement

Log in

Energy-aware scheme for the 3D-HEVC depth maps prediction

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper presents an energy-aware scheme to reduce the energy consumption on the 3D high-efficiency video coding (3D-HEVC) depth maps prediction. Besides, a qualitative discussion is presented for intra- and inter-frame predictions that conduced to the proposition of a simple energy-aware scheme. Through our analysis, the HEVC intra-prediction is applied over homogeneous regions, whereas bipartition modes are preferred to encode edge regions. Based on this fact, the Simplified Edge Detector (SED) is proposed to employ a fast intra-mode decision. The SED anticipates the blocks that are likely to be better predicted by the HEVC intra-prediction, avoiding evaluations of bipartition modes. On inter-prediction, the TZ Search (TZS) is employed in the 3D-HEVC reference software (HTM) to encode both texture frames and depth maps. However, considering the depth maps properties, lightweight fast algorithms should be considered instead of TZS. Thus, fast algorithms such as Diamond Search, Small Diamond Search (SDSP), and One-at-a-Time Search were evaluated in this paper, aiming to reduce the complexity and energy, whereas sustaining good coding efficiency. By analyzing the depth channel, this scheme (considering intra- and inter-predictions) is able to provide an encoding time reduction of 21.2–23.1 %. As drawback, the combined solution increases the BD-rate in 0.62–0.87 %, in the synthesized views. When considering general-purpose processors, our solution is capable of providing a reduction in the energy consumption ranging between 9.85 and 10.41 %, according to our software analysis using the running average power limit. By using the SDSP combined of SED algorithm instead of HTM-10.2 baseline solution, it is possible to achieve a reduction of about 54 % in the energy consumption, and about 1.8 times in the power dissipation, when running on a dedicated hardware design. Considering that depth maps are only used for view synthesis, a subjective quality assessment was performed using synthesized views, and the results demonstrate that our solution presents minimum quality losses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Yasakethu, S.L.P., Fernando, W.A.C, Kamolrat, B., Kondoz, A.: Analyzing perceptual attributes of 3D video. IEEE Transactions on Consumer Electronics 55(2), 864–872 (2009)

  2. JCT-3V. Available at: http://phenix.int-evry.fr/jct2/, Access in Aug. 2015

  3. Zhang, L., et al.: 3D HEVC Test model 6. Document: JCT3V-F1005. Draft 6 of 3D-HEVC Test Model Description, Geneva (2013)

  4. H.265: High Efficiency Video Coding. Available at: http://www.itu.int/rec/T-REC-H.265. Access in 2015

  5. Smolic, A., et al.: Coding algorithms for 3DTV-A survey. IEEE TCSVT 17(11), 1606–1621 (2007)

    Google Scholar 

  6. Kauff, P., et al.: Depth map creation and image based rendering for advanced 3DTV services providing interoperability and scalability. Signal Process. Image Commun. 22(2), 217–234 (2007)

    Article  Google Scholar 

  7. Smolic, A., et al.: Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems. In: Proceedings of IEEE International Conference on Image Processing, San Diego, USA, pp. 2448–2451 (2008)

  8. Rusanovskyy, D., et al.: Common test conditions of 3DV experimentation. ISO/IEC JTC1/SC29/WG11 MPEG2011/N12745, Geneva, Switzerland (2012)

  9. Tang, X.L., Dai, S.K., Cai, C.H.: An Analysis of TZ Search Algorithm in JMVC, ICGCS, pp. 516–520 (2010)

  10. Ahn, S., Lee, B., Kim M.: A Novel Fast CU Encoding Scheme based on Spatio-Temporal Encoding Parameters for HEVC Inter Coding. IEEE TCSVT 25(3), 422–435 (2014)

  11. Zhang N., et al.: Fast encoder decision for texture coding in 3D-HEVC. Signal Process. Image Commun. 29(9), 951–961 (2014)

  12. Shen, L.; et al.: Effective CU size decision for HEVC intracoding. IEEE Trans. Image Process. 23(10),  4232–4241 (2014)

  13. Zhang, J., et al.: An efficient fast mode decision method for inter prediction in HEVC. IEEE Trans. Circuits Syst. Video Technol. (2015)

  14. Gu, Z., et al.: Fast depth modeling mode selection for 3D HEVC depth intra coding. IEEE International Conference on Multimedia and Expo Workshops (ICMEW), San Jose (2013)

  15. Mora, E., et al.: Initialization, limitation and predictive coding of the depth and texture quadtree in 3D-HEVC. IEEE TCSVT 24(9), 1554–1565 (2013)

  16. Medhat, A., et al.: Fast Center Search Algorithm with Hardware Implementation for Motion Estimation in HEVC Encoder. ICECS, Marseille (2014)

    Book  Google Scholar 

  17. Sinangil, M.E., et al.: Hardware-aware motion estimation search algorithm development for high-efficiency video coding (HEVC) standard. IEEE International Conference on Image Processing (ICIP), Orlando (2012)

  18. Zhao, L., et al.: Fast Mode Decision Algorithm For Intra Prediction in HEVC, Visual Communications and Image Processing (VCIP), IEEE (2011)

  19. Zhu, S., Ma, K.: A new diamond search algorithm for fast block-matching motion estimation. IEEE TIP 9(2), 287–290 (2000)

    Google Scholar 

  20. Zhu, C., Lin, X., Chau, L.: Hexagon-based pattern for fast block motion estimation. IEEE Trans. Circuits Syst. Video Technol. 12(5), 349–355 (2002)

  21. Sanchez, G., et al.: DMPDS: a fast motion estimation algorithm targeting high resolution videos and its FPGA implementation. IJRC 2012, 1–12 (2012)

    Google Scholar 

  22. Sanchez, G., et al.: Complexity reduction for 3D-HEVC depth maps intra-frame prediction using simplified edge detector algorithm. In: 2014 IEEE ICIP, Paris (2014)

  23. Srinivasan, R., Rao, K.R.: Predictive coding based on efficient motion estimation. IEEE Trans. Commun. COM- 33(8), 888–896 (1985)

    Article  Google Scholar 

  24. Sanchez, G., et al.: Hardware-Friendly HEVC Motion Estimation: New Algorithms and Efficient VLSI Designs Targeting High Definition Videos. ALOG (Dordrecht. Online) 82(1), 135–146  (2014)

  25. BJØNTEGAARD, G.: Calculation of average PSNR differences between RD curves. Document: VCEG-M33. Austin (2001)

  26. David, H., et al.: RAPL: Memory Power Estimation and Capping. Austin (2010)

  27. ITU - International Telecommunication Union. P.910: Subjective Video Quality Assessment Methods for Multimedia Applications, (2009)

  28. Zatt, B., et al.: 3D Video Coding for Embedded Devices: Energy Efficient Algorithms and Architectures. Springer, New York (2013)

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mário Saldanha.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saldanha, M., Sanchez, G., Zatt, B. et al. Energy-aware scheme for the 3D-HEVC depth maps prediction. J Real-Time Image Proc 13, 55–69 (2017). https://doi.org/10.1007/s11554-016-0597-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-016-0597-8

Keywords

Navigation