Skip to main content
SpringerLink
Log in

Fast SHVC inter-coding based on Bayesian decision with coding depth estimation

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

The scalable extension of the high efficiency video coding standard named SHVC supports flexible access for various terminals in heterogeneous networks. However, it is difficult to use in real-time scenarios because of the high complexity of the hierarchical coding structure. In this paper, a novel method for SHVC inter-coding is proposed to reduce the coding complexity in a manner that is compatible with quality scalability and spatial scalability. First, the depth range of the coding tree units is estimated from a reference table generated from a statistical probability distribution based on the correlation between the current coding unit (CU) and its adjacent CUs. Within this depth range, a fast CU partitioning method based on Bayesian minimum risk and a fast prediction unit (PU) selection method based on Bayesian maximum probability are adopted to improve time efficiency. Three different methods, namely, histogram estimation, Gaussian modelling and neighbouring prediction, are used to calculate the conditional probabilities for discrete or continuous features in the Bayesian decision method. The significant advantage of the proposed method is that the time savings in the enhancement layer for each sequence exceeds 60% with negligible quality loss.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6 
Fig. 7 

Similar content being viewed by others

References

  1. Schwarz, A., Marpe, D., Wiegand, T.: Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1103–1120 (2007)

    Article  Google Scholar 

  2. Ohm, J.R., Sullivan, G.J., Schwarz, H., Tan, T.K., Wiegand, T.: Comparison of the coding efficiency of video coding standards including high efficiency video coding (HEVC). IEEE Trans. Circuits Syst. Video Technol. 22(12), 1669–1684 (2012)

    Article  Google Scholar 

  3. Sullivan, G.J., Ohm, J.R., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)

    Article  Google Scholar 

  4. Chen J., Boyce J., Ye Y., Hannuksela M., Sullivan G.J., Wang Y.K.: HEVC Scalable Extensions (SHVC) Draft Text 7, JCTVC-R1008, In: Joint Collaborative Team on Video Coding (JCT-VC) 16th Meeting, Sapporo, Japan, June 30-July 9 (2014)

  5. Boyce, J., Ye, Y., Chen, J., Ramasubramonian, A.: Overview of SHVC: scalable extensions of the high efficiency video coding standard. IEEE Trans. Circuits Syst. Video Technol. 26(1), 20–34 (2016)

    Article  Google Scholar 

  6. Goswami, K., Lee, J., Kim, B.: Fast algorithm for the high efficiency video coding (HEVC) encoder using texture analysis. Inf. Sci. 364, 72–90 (2016)

    Article  Google Scholar 

  7. Sun, X., Chen, X., Xu, Y., Xiao, Y., Wang, Y., Yu, D.: Fast CU size and prediction mode decision algorithm for HEVC based on direction variance. J. Real-Time Image Proc. 16(5), 1731–1744 (2019)

    Article  Google Scholar 

  8. Cebrian-Marquez, G., Martinez, J., Cuenca, P.: A motion-based partitioning algorithm for HEVC using a pre-analysis stage. IEEE Trans. Circuits Syst. Video Technol. 29(5), 1448–1461 (2019)

    Article  Google Scholar 

  9. Wu, J., Guo, B., Hou, J., Yan, Y., Jiang, J.: Fast CU encoding schemes based on Merge mode and motion estimation for HEVC inter prediction. KSII Trans. Internet Inf. Syst. 10(3), 1195–1211 (2016)

    Google Scholar 

  10. Podder, P., Paul, M., Murshed, M.: A novel motion classification based intermode selection strategy for HEVC performance improvement. Neurocomputing 173, 1211–1220 (2016)

    Article  Google Scholar 

  11. Kibeya, H., Belghith, F., Ayed, M.A.B., Masmoudi, N.: Fast coding unit selection and motion estimation algorithm based on early detection of zero block quantified transform coefficients for high-efficiency video coding standard. IET Image Proc. 10(5), 371–380 (2016)

    Article  Google Scholar 

  12. Kim, T.S., Rhee, C.E., Lee, H.-J., Chae, S.-I.: Fast integer motion estimation with bottom-Up motion vector prediction for an HEVC encoder. IEEE Trans. Circuits Syst. Video Technol. 28(12), 3398–3411 (2018)

    Article  Google Scholar 

  13. Yuan, H., Guo, C., Liu, J., Wang, X., Kwong, S.: Motion-homogeneous- based fast transcoding method from H.264/AVC to HEVC. IEEE Trans. Multimedia 19(7), 1416–1430 (2017)

    Article  Google Scholar 

  14. Tariq, J., Kwong, S., Yuan, H.: Spatial/temporal motion consistency based MERGE mode early decision for HEVC. J. Vis. Commun. Image Represent. 44, 198–213 (2017)

    Article  Google Scholar 

  15. Tariq, J., Kwong, S., Yuan, H.: HEVC intra mode selection based on Rate Distortion (RD) cost and Sum of Absolute Difference (SAD). J. Vis. Commun. Image Represent. 35, 112–119 (2016)

    Article  Google Scholar 

  16. Lei, J., Duan, J., Wu, F., Ling, N., Hou, C.: Fast mode decision based on grayscale similarity and inter-view correlation for depth map coding in 3D-HEVC. IEEE Trans. Circuits Syst. Video Technol. 28(3), 706–718 (2018)

    Article  Google Scholar 

  17. Shang, X., Wang, G., Fan, T., Li, Y.: Statistical and spatiotemporal correlation based low-complexity video coding for high-efficiency video coding. J. Electron. Imaging 24(2), 023006 (2015)

    Article  Google Scholar 

  18. Lee, J.-H., Goswami, K., Kim, B.-G., Jeong, S., Choi, J.S.: Fast encoding algorithm for high-efficiency video coding (HEVC) system based on spatio-temporal correlation. J. Real-Time Image Proc. 12(2), 407–418 (2016)

    Article  Google Scholar 

  19. Fernandez, D.G., Del Barrio, A.A., Botella, G., Garcia, C.: Fast and effective CU size decision based on spatial and temporal homogeneity detection. Multimedia Tools Appl. 77(5), 5907–5927 (2018)

    Article  Google Scholar 

  20. Kim, B.-G.: Fast coding unit (CU) determination algorithm for high-efficiency video coding (HEVC) in smart surveillance application. J. Supercomput. 73(3), 1063–1084 (2017)

    Article  Google Scholar 

  21. Lu, Y., Liu, H., Lin, Y., Shen, L., Yin, H.: Efficient coding mode and partition decision for screen content intra coding. Signal Process.: Image Commun. 68, 249–257 (2018)

    Google Scholar 

  22. Zhu, L., Zhang, Y., Kwong, S., Wang, X., Zhao, T.: Fuzzy SVM-based coding unit decision in HEVC. IEEE Trans. Broadcast. 64(3), 681–694 (2018)

    Article  Google Scholar 

  23. Li, N., Zhang, Y., Zhu, L., Luo, W., Kwong, S.: Reinforcement learning based coding unit early termination algorithm for high efficiency video coding. J. Vis. Commun. Image Represent. 60, 276–286 (2019)

    Article  Google Scholar 

  24. Chen, F., Liu, S., Peng, Z., Hu, Q., Jiang, G., Yu, M.: Bayesian-theory-based fast CU size and mode decision algorithm for 3D-HEVC depth video inter-coding. KSII Trans. Internet Inf. Syst. 12(4), 1730–1747 (2018)

    Google Scholar 

  25. Lu, Y., Huang, X., Liu, H., Zhou, Y., Yin, H., Shen, L.: Hierarchical classification for complexity reduction in HEVC inter coding. IEEE Access 8, 41690–41704 (2020)

    Article  Google Scholar 

  26. Khairy, M., Hamdy, A., Elsayed, A., Farouk, H.: Efficient enhancement for spatial scalable video coding transmission. Math. Probl. Eng. 2017(1), 1–13 (2017)

    Article  Google Scholar 

  27. Ge, Q., Hu, D.: Fast encoding method using CU depth for quality scalable HEVC. In: IEEE Workshop on Advanced Research and Technology in Industry Applications, Ottawa, ON, Canada, pp 1366–1370, September 29–30 (2014)

  28. Tohidypour, H.R., Pourazad, M.T., Nasiopoulos, P.: An encoder complexity reduction scheme for quality/fidelity scalable HEVC. IEEE Trans. Broadcast. 62(3), 664–674 (2016)

    Article  Google Scholar 

  29. Wang, D., Zhu, C., Sun, Y., Dufaux, F., Huang, Y.: Efficient multi-strategy intra prediction for quality scalable high efficiency video coding. IEEE Trans. Image Process. 28(4), 2063–2074 (2019)

    Article  MathSciNet  Google Scholar 

  30. Wang, D., Sun, Y., Li, W., Zhu, C., Dufaux, F.: Fast inter mode predictions for SHVC. In: IEEE International Conference on Multimedia and Expo, Shanghai, China, pp 1696–1701, July 8–12 (2019)

  31. Tohidypour, H.R., Pourazad, M.T., Nasiopoulos, P.: Adaptive search range method for spatial scalable HEVC. In: IEEE International Conference on Consumer Electronics, Las Vegas, NV, United States, pp 191–192, January 10–13 (2014)

  32. Li, X., Chen, M., Qu, Z., Xiao, J., Gabbouj, M.: An effective CU size decision method for quality scalability in SHVC. Multimedia Tools Appl. 76(6), 8011–8030 (2017)

    Article  Google Scholar 

  33.  Katayama, T., Shi, W., Song, T., Shimamoto, T.: Low-complexity intra coding algorithm in enhancement layer for SHVC. In: IEEE International Conference on Consumer Electronics, Las Vegas, NV, United states, pp. 419–422, January 7–11 (2016)

  34. Li, Y., Wang, F.: An intra complexity reduction algorithm for quality scalable SHVC. In: 3rd IEEE International Conference on Information Communication and Signal Processing, Shanghai, China, pp. 300–305, September 12–15 (2020)

  35. Kim, T., Yoo, J., Hong, J., Suh, J.: Fast mode decision algorithm for scalable video coding based on luminance coded block pattern. Opt. Eng. 52(1), 017401 (2013)

    Article  Google Scholar 

  36. Shen, L., Feng, G.: Content-based adaptive SHVC mode decision algorithm. IEEE Trans. Multimedia 21(11), 2714–2725 (2019)

    Article  Google Scholar 

  37. Tohidypour, H.R., Pourazad, M.T., Nasiopoulos, P.: Probabilistic approach for predicting the size of coding units in the quad-tree structure of the quality and spatial scalable HEVC. IEEE Trans. Multimedia 18(2), 182–195 (2016)

    Article  Google Scholar 

  38. Shen, L., Feng, G., An, P.: SHVC CU processing aided by a feedforward neural network. IEEE Trans. Industr. Inf. 15(11), 5803–5815 (2019)

    Article  Google Scholar 

  39. Shen, L., An, P., Feng, G.: Low-complexity scalable extension of the High-Efficiency Video Coding (SHVC) encoding system. ACM Trans. Multimedia Comput. Commun. Appl. 15(2) 44, 1–23 (2019)

    Google Scholar 

  40. Prangnell L., Sanchez V.: Adaptive quantization matrices for HD and UHD resolutions in scalable HEVC, In: Data Compression Conference, Snowbird, UT, United States, pp. 626-626, March 30- April 1 (2016)

  41. Balaji, L., Thyagharajan, K.K.: An enhanced performance for H.265/SHVC based on combined AEGBM3D filter and back-propagation neural network. Signal Image Video Process. 12(5), 809–817 (2018)

    Article  Google Scholar 

  42. Dhanalakshmi, A., Nagarajan, G.: Convolutional Neural Network-based deblocking filter for SHVC in H.265. Signal Image Video Process 14(8), 1635–1645 (2020)

    Article  Google Scholar 

  43. Seregin V., He Y.: Common SHM test conditions and software reference configuration, JCTVC-P1009, In: Joint Collaborative Team on Video Coding (JCT-VC) 16th Meeting, San José, CA, United States, January 9–17 (2014)

  44. Bjöntegaard G.: Calculation of average PSNR differences between RD-curves, VCEG-M33, In: The 13th ITU-T SG16/Q6 VCEG Meeting, Austin, TX, United States, April 2–4 (2001)

  45. Li B., Sullivan G., Xu J.: Comparison of compression performance of HEVC working draft 5 with AVC high profile, JCTVC-H0360, In: Joint Collaborative Team on Video Coding (JCT-VC) 8th Meeting, San José, CA, United states, February 1–10 (2012)

Download references

Acknowledgements

This work is supported in part by the Zhejiang Provincial Natural Science Foundation of China under Grant No. LY18F010015, in part by the National Natural Science Foundation of China under Grants 61671282 and 61972123.

Author information

Authors and Affiliations

  1. School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, 310018, China

    Yu Lu, Xudong Huang & Haibing Yin

  2. School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, OR, 97331, USA

    Yu Lu & Huaping Liu

  3. School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China

    Liquan Shen

Authors
  1. Yu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xudong Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huaping Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Haibing Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Liquan Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yu Lu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, Y., Huang, X., Liu, H. et al. Fast SHVC inter-coding based on Bayesian decision with coding depth estimation. J Real-Time Image Proc 18, 2269–2285 (2021). https://doi.org/10.1007/s11554-021-01112-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-021-01112-z

Keywords

Search

Navigation