Skip to main content
SpringerLink
Log in

Fast CU size decision and PU mode decision algorithm for quality SHVC inter coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

As a scalable extension of the High Efficiency Video Coding (HEVC), the Scalable High Efficiency Video Coding (SHVC) encoder needs to encode multiple HEVC layers with Inter-layer predictions, which causes the significant increase in coding complexity. In this paper, we proposed a novel Inter prediction scheme to effectively reduce computational complexity in Quality SHVC. The new features of the proposed algorithm include: First, spatial and Inter-layer depth correlations are used to predict the most possible coding unit (CU) depth level candidates. Second, a statistical test method on the current CU depth level is introduced to examine whether the residual coefficients within its block present similar distribution to terminate depth selection early. Finally, during Inter prediction selection from 8 Prediction Unit (PU) sizes, spatial and Inter-layer correlations are combined with residual coefficients distribution to determine the PU partitioning mode is Symmetric Motion Partitioning (SMP) or Asymmetric Motion Partitioning (AMP). Experimental results demonstrate that the proposed algorithm can save an average of 65.33% coding time of enhancement layer (EL) while achieving a better rate distortion (RD) performance over other state-of-the-art work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Bailleul R, De Cock J, Van De Walle R (2014) Fast mode decision for SNR scalability in SHVC digest of technical papers. In: 2014 IEEE International Conference on consumer electronics (ICCE). IEEE, pp 193–194

  2. Bjøntegaard G (2001) Calculation of average PSNR differences between RD-curves. In: ITU-T Q. 6/SG16 VCEG, 15th Meeting, Austin, Texas, USA, April, 2001

  3. Bossen F (2011) Common test conditions and software reference configurations. In: Joint Collaborative team on video coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th meeting Jan. 2011

  4. Boyce JM, Ye Y, Chen J, Ramasubramonian AK (2016) Overview of SHVC: scalable extensions of the high efficiency video coding standard. IEEE Trans Circ Syst Vid Technol 26(1):20–34

    Article  Google Scholar 

  5. Chen B, Yang Z, Huang S, et al. (2017) Cyber-physical system enabled nearby traffic flow modelling for autonomous vehicles. In: 2017 IEEE 36th International on performance computing and communications conference (IPCCC). IEEE, pp 1–6

  6. Cho S, Kim M (2013) Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding. IEEE Trans Circ Syst Vid Technol 23(9):1555–1564

    Article  Google Scholar 

  7. Corrêa G, Assuncao P, Agostini L, da Silva Cruz LA (2012) Performance and computational complexity assessment of high-efficiency video encoders. IEEE Trans Circ Syst Vid Technol 22(12):1899–1909

    Article  Google Scholar 

  8. Cui J, Liu Y, Xu Y, et al. (2013) Tracking generic human motion via fusion of low-and high-dimensional approaches. IEEE Trans Syst Man Cybern Syst 43 (4):996–1002

    Article  Google Scholar 

  9. Hu N, Yang E-H (2014) Fast motion estimation based on confidence interval. IEEE Trans Circ Syst Vid Technol 24(8):1310–1322

    Article  Google Scholar 

  10. Kailath T (1967) The divergence and Bhattacharyya distance measures in signal selection. IEEE Trans Commun Technol 15(1):52–60

    Article  Google Scholar 

  11. Kang M, Ma R, Li Z, Hu X, An P (2016) Fast mode decision algorithm for quality scalable HEVC. In: International forum of digital TV and wireless multimedia communication. Springer, pp 349–357

  12. Katayama T, Shi W, Song T, Shimamoto T (2016) Early depth determination algorithm for enhancement layer intra coding of SHVC. In: 2016 Region 10 Conference (TENCON). IEEE, pp 3079–3082

  13. Li X, Chen M, Qu Z, Xiao J, Gabbouj M (2017) An effective CU size decision method for quality scalability in SHVC. Multimed Tools Appl 76(6):8011–8030

    Article  Google Scholar 

  14. Lim K, Lee J, Kim S, Lee S (2015) Fast PU skip and split termination algorithm for HEVC intra prediction. IEEE Trans Circ Syst Video Technol 25(8):1335–1346

    Article  Google Scholar 

  15. Liu Y, Nie L, Han L, et al. (2015) Action2activity: recognizing complex activities from sensor data. In: IJCAI 2015, vol 2015, pp 1617–1623

  16. Liu Y, Nie L, Liu L, et al. (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115

    Article  Google Scholar 

  17. Liu Y, Zhang L, Nie L, et al. (2016) Fortune teller: predicting your career path. In AAAI 2016, vol 2016, pp 201–207

  18. Liu Y, Zheng Y, Liang Y, et al. (2016) Urban water quality prediction based on multi-task multi-view learning

  19. Min B, Cheung RCC (2015) A fast CU size decision algorithm for the HEVC intra encoder. IEEE Trans Circ Syst Vid Technol 25(5):892–896

    Article  Google Scholar 

  20. Pan Z, Kwong S, Sun M-T, Lei J (2014) Early MERGE mode decision based on motion estimation and hierarchical depth correlation for HEVC. IEEE Trans BroadCasting 60(2):405–412

    Article  Google Scholar 

  21. Seregin V, He Y (2014) Common SHM test conditions and software reference configurations. Document JCTVCQ1009, pp 1–4

  22. Shen L, Zhang Z, An P (2013) Fast CU size decision and mode decision algorithm for HEVC intra coding. IEEE Trans Consum Electron 59(1):207–213

    Article  Google Scholar 

  23. Shen L, Zhang Z, Liu Z (2014) Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatiotemporal correlations. IEEE Trans Circ Syst Vid Technol 24(10):1709–1722

    Article  Google Scholar 

  24. SHM-11.0. https://hevc.hhi.fraunhofer.de/svn/svn_SHVCSoftware/tags/SHM-11.0, Accessed 3 Jan 2018

  25. Sullivan GJ, Ohm J-R (2012) Joint call for proposals on scalable video coding extensions of high efficiency video coding (HEVC). ITU-T Study Group 16

  26. Sullivan GJ, Ohm J, Han W-J, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circ Syst Vid Technol 22 (12):1649–1668

    Article  Google Scholar 

  27. Sullivan GJ, Boyce JM, Chen Y, Ohm J-R, Segall CA, Vetro A (2013) Standardized extensions of high efficiency video coding (HEVC). IEEE J Select Topics Signal Process 7(6):1001–1016

    Article  Google Scholar 

  28. Sze V, Budagavi M, Sullivan GJ (2014) High efficiency video coding (HEVC). Integr Circ Syst Algor Architect, 1–375

  29. Tai K-H, Hsieh M-Y, Chen M-J, Chen C-Y, Yeh C-H (2017) A fast HEVC encoding method using depth information of collocated CUs and RD cost characteristics of PU modes. IEEE Transactions on Broadcasting

  30. Tang M, Chen X, Gu J, Han Y, Wen J, Yang SQ (2017) Accelerating HEVC encoding using early-split. IEEE Signal Processing Letters

  31. Tohidypour HR, Pourazad MT, Nasiopoulos P (2013) Content adaptive complexity reduction scheme for quality/fidelity scalable HEVC. In: 2013 IEEE International conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 1744–1748

  32. Tohidypour HR, Pourazad MT, Nasiopoulos P (2016) An encoder complexity reduction scheme for quality/fidelity scalable HEVC. IEEE Trans Broadcast 62(3):664–674

    Article  Google Scholar 

  33. Tohidypour HR, Pourazad MT, Nasiopoulos P (2016) Probabilistic approach for predicting the size of coding units in the quad-tree structure of the quality and spatial scalable HEVC. IEEE Trans Multimed 18(2):182–195

    Article  Google Scholar 

  34. Tohidypour HR, Bashashati H, Pourazad MT, Nasiopoulos P (2017) Online-learning-based mode prediction method for quality scalable extension of the high efficiency video coding (hevc) standard. IEEE Trans Circ Syst Vid Technol 27 (10):2204–2215

    Article  Google Scholar 

  35. Vanne J, Viitanen M, Hämäläinen TD (2014) Efficient mode decision schemes for HEVC inter prediction. IEEE Trans Circ Syst Vid Technol 24(9):1579–1593

    Article  Google Scholar 

  36. Wang D, Zhu C, Sun Y, Dufaux F, Huang Y (2017) Efficient multi-strategy intra prediction for quality scalable high efficiency video coding. IEEE Transactions on Image Processing

  37. Wien M (2015) High efficiency video coding. Coding Tools and Specification

  38. Yan S, Hong L, He W, Wang Q (2012) Group-based fast mode decision algorithm for intra prediction in HEVC. In: 2012 Eighth International conference on signal image technology and internet based systems (SITIS). IEEE, pp 225–229

  39. Yang Z, Bhimani J, Wang J, et al. (2017) Automatic and scalable data replication manager in distributed computation and storage infrastructure of cyber-physical systems. J Scalable Comput Special Issue Commun Comput Network Cyber-Phys Syst, 18(4)

  40. Yang Z, Hoseinzadeh M, Andrews A, et al. (2017) AutoTiering: automatic data placement manager in multi-tier all-flash datacenter. In: 36th IEEE International performance computing and communications conference. IEEE

  41. Zhang H, Ma Z (2014) Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans Circ Syst Video Technol 24(4):660–668

    Article  Google Scholar 

  42. Zhao W, Onoye T, Song T (2015) Hierarchical structure-based fast mode decision for h.265/HEVC. IEEE Trans Circ Syst Vid Technol 25(10):1651–1664

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China (No. 61571071) and Nature Science Foundation Project of Chongqing (No. cstc2016jcyjA0543 and No. cstc2017jcyjXB0037). The authors also would like to thank all reviewers for their valuable comments and suggestions to improve the quality of this paper.

Author information

Authors and Affiliations

  1. Chongqing Key Laboratory of Signal and Information Processing, Chongqing University of Posts and Telecommunication, Chongqing, China

    Qiang Li, Bo Liu & Dayong Wang

Authors
  1. Qiang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dayong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bo Liu.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, Q., Liu, B. & Wang, D. Fast CU size decision and PU mode decision algorithm for quality SHVC inter coding. Multimed Tools Appl 78, 7819–7839 (2019). https://doi.org/10.1007/s11042-018-6527-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6527-y

Keywords

Search

Navigation