Skip to main content
Springer Nature Link
Log in

Fast mode decision and early termination based on perceptual visual quality for HEVC encoders

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper presents an early termination and fast mode decision for the HEVC encoder with a perceptual visual quality. For early termination of residual quad-tree, if the predicted errors for a transform block are not visible in terms of perceptual quality, the block is coded as the all-zero block and the transforms for the block and smaller blocks are skipped in RDO process. In addition, when a coding mode in the RDO-based mode decision stage is satisfactory in terms of visual quality, the coding mode is selected and the remaining coding modes requiring more bits are skipped. The proposed fast encoding algorithm is designed by pruning many coding modes when the coding errors with a coding mode having a small number of bits are not perceived by the human visual system. In addition, the proposed perceptual quality-based fast encoding algorithms can work with the existing objective quality-based fast decision algorithms. We found that the proposed algorithm can achieve 1.77 times acceleration of HM-16.8 with minimal perceptual visual degradation and objective quality distortion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Sullivan, G.J., Ohm, J.-R., Han, W.-J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1648–1667 (2012)

    Article  Google Scholar 

  2. Bross, B., Han, W.-J., Ohm, J.-R., Sullivan, G. J., Wang, Y.-K., Wiegand, T.: High efficiency video coding (HEVC) text specification draft 10 (for FDIS & consent). Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-L1003, January (2013)

  3. Ahn, Y.-J., Han, W.-J., Sim, D. G.: Study of decoder complexity for HEVC and AVC standards based on tool-by-tool comparison. Proc. SPIE 8499 Applications of Digital Image Processing XXXV, vol. 8499, San Diego, CA, August (2012)

  4. Wien, M.: High efficiency video coding: coding tools and specification. Springer, Berlin (2014)

    Google Scholar 

  5. Sze, V., Budagavi, M., Sullivan, G.J.: High efficiency video coding (HEVC): algorithms and architectures. Springer, Berlin (2014)

    Book  Google Scholar 

  6. Kim, I.-K., Min, J., Lee, T., Han, W.-J., Park, J.-H.: Block partitioning structure in the HEVC standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1697–1706 (2012)

    Article  Google Scholar 

  7. Yuan, Y., Kim, I.-K., Zheng, X., Liu, L., Cao, X., Lee, S., Cheon, M.-S., Lee, T., He, Y., Park, J.-H.: Quadtree based nonsquare block structure for inter frame coding in high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 22(1), 1707–1719 (2012)

    Article  Google Scholar 

  8. Sole, J., Joshi, R., Nquyen, N., Ji, T., Karczewicz, M., Clare, G., Henry, F., Duenas, A.: Transform coefficient coding in HEVC. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1765–1777 (2012)

    Article  Google Scholar 

  9. Bross, B., Jung, J., Huang, Y.W., Tan, Y.H., Kim, I.K., Sugio, T., Zhou, M., Tan, T.K., Francois, E., Kazui, K., Chien, W.J., Sekiguchi, S., Park, S., Wan, W.: BoG report of CE9: MV Coding and skip/merge operation. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-E0481, Geneva, March (2011)

  10. Helle, P., Oudin, S., Bross, B., Marpe, D., Bici, M., Ugur, K., Jung, J., Clare, G., Wiegan, T.: Block merging for quadtree-based partitioning in HEVC. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1720–1731 (2012)

    Article  Google Scholar 

  11. Norkin, A., Bjontegaard, G., Fuldseth, A., Narroschke, M., Ikeda, M., Andersson, K., Zhoud, M., Van der Auwera, G.: HEVC deblocking filter. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1746–1754 (2012)

    Article  Google Scholar 

  12. Fu, C.-M., Alshina, E., Alshin, A., Huang, Y.-W., Chen, C.-Y., Tsai, C.-Y., Hsu, C.-W., Lei, S., Park, J.H., Han, W.-J.: Sample adaptive offset in the HEVC standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1755–1764 (2012)

    Article  Google Scholar 

  13. Ohm, J.-R., Sullivan, G.J., Schwarz, H., Tan, T.K., Wiegand, T.: Comparison of the coding efficiency of video coding standards-including high efficiency video coding (HEVC). IEEE Trans. Circuits Syst. Video Technol. 22(12), 1669–1684 (2012)

    Article  Google Scholar 

  14. Kim, B.-G., Psannis, K., Jun, D.-S.: Special issue on architectures and algorithms of high-efficiency video coding (HEVC) standard for real-time video applications. J. Real-Time Image Process. 12(2), 215–218 (2016)

    Article  Google Scholar 

  15. Ryu, H., Ahn, Y.-J., Mok, J.-S., Sim, D.: Performance analysis of HEVC parallelization methods for high-resolution videos. IEIE Trans. Smart Process. Comput. 4(1), 28–34 (2015)

    Article  Google Scholar 

  16. McCann, K., Bross, B., Han, W.-J., Kim, I.-K., Sugimoto, K., Sullivan, G.J.: High efficiency video coding (HEVC) test model 12 (HM 12) encoder description. Joint Collaborative Team on Video Coding (JCT-VC), Document JCTVC-N1002, Vienna, July (2013)

  17. Kim, S., Lee, D., Ahn, Y.-J., Hwang, T., Sim, D., Oh, S.-J.: DCT-based interpolation filter for HEVC on graphics processing units. ITC-CSCC 2013, Yeosu, South Korea, June (2013)

  18. Lee, D., Sim, D., Cho, K., Oh, S.-J.: Fast motion estimation for HEVC on graphics processing unit (GPU). J. Real-Time Image Process. 12(2), 549–562 (2016)

    Article  Google Scholar 

  19. Jo, H.-H., Ahn, Y.-J., Kang, D.-B., Ji, B., Sim, D.-G., Lee, J.-J.: Flexible multi-core platform for a multiple-format video decoder. J. Signal Process. Syst. Signal Image Video Technol. 80(2), 163–179 (2015)

    Article  Google Scholar 

  20. Ahn, Y.-J., Hwang, T.-J., Sim, D.-G., Han, W.-J.: Complexity model based load-balancing algorithm for parallel tools of HEVC. Visual Communications and Image Processing (VCIP), 2013 IEEE, Kuching, Malaysia, November (2013)

  21. Marzuki, I., Ahn, Y.-J., Lim, W., Sim, D.: Tile level rate control for multi core platform. Joint Collaborative Team on Video Coding (JCT-VC), JCTVVC-V0088, Geneva, CH, October (2015)

  22. Gweon, R. H., Lee, Y.-L., Lim, J.: Early termination of CU encoding to reduce HEVC complexity. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-F045, Torino, IT, July (2011)

  23. Choi, K., Jang, E.S.: Coding tree pruning based on CU early termination. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-F092, Torino, IT, July (2011)

  24. Wang, J., Kim, J., Won, K., Lee, H., Jeon, B.: Early skip detection for HEVC. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-G543, Geneva, CH, November (2011)

  25. Ahn, Y.-J., Sim, D.: Square-type-first inter-CU tree search algorithm for acceleration of HEVC encoder. J. Real-Time Image Process. 12(2), 419–432 (2016)

    Article  Google Scholar 

  26. Ahn, S., Lee, B., Kim, M.: A novel fast CU encoding scheme based on spatio-temporal encoding parameters for HEVC inter coding. IEEE Trans. Circuits Syst. Video Technol. 25(3), 422–435 (2014)

    Article  Google Scholar 

  27. Shen, L., Zhang, Z., Liu, Z.: Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatio-temporal correlations. IEEE Trans. Circuits Syst. Video Technol. 24(10), 1709–1722 (2014)

    Article  Google Scholar 

  28. Lee, J., Kim, S., Lim, K., Lee, S.: A fast CU size decision algorithm for HEVC. IEEE Trans. Circuits Syst. Video Technol. 25(3), 411–421 (2015)

    Article  Google Scholar 

  29. Vanne, J., Vitanen, M., Hamalainen, T.: Efficient mode decision schemes for HEVC inter prediction. IEEE Trans. Circuits Syst. Video Technol. 24(9), 1579–1593 (2014)

    Article  Google Scholar 

  30. Lee, J.-H., Goswami, K., Kim, B.-G.: Fast encoding algorithm for high-efficiency video coding (HEVC) system based on spatio-temporal correlation. J. Real-Time Image Process. 12(2), 407–418 (2016)

    Article  Google Scholar 

  31. Rhee, C.E.: Depth-of-interest-based bypass coding-unit algorithm for inter-prediction in High-efficiency Video Coding. IEIE Trans. Smart Process. Comput. 4(6), 231–234 (2016)

    Article  Google Scholar 

  32. Campbell, F.W., Robson, J.G.: Application of fourier analysis to the visibility of gratings. J. Physiol. 197(3), 551 (1968)

    Article  Google Scholar 

  33. Robson, J.G.: Spatial and temporal contrast sensitivity functions of the visual system. J. Opt. Soc. Am. 56(8), 1141–1142 (1966)

    Article  Google Scholar 

  34. Chou, C.-H., Li, Y.-C.: A perceptual tuned subband image coder based on the measure of just-noticeable-distortion profile. IEEE Trans. Circuits Syst. Video Technol. 5(6), 467–476 (1995)

    Article  Google Scholar 

  35. Wang, Z., Bovic, A.C.: Modern image quality assessment. Synth. Lect. Image Video Multimed. Process. 2(1), 1–156 (2006)

    Article  Google Scholar 

  36. Bossen, F.: Common HM test conditions and software reference configurations. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-L1100, Geneva, CH, February (2013)

  37. Recommendation ITU-R BT.500-11.: Methodology for the subjective assessment of the quality of television pictures. Recommendation ITU-R BT.500-11, ITU-Telecommunication Standardization Sector of ITU (2002)

Download references

Acknowledgements

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2014R1A2A1A11052210).

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Kwangwoon University, 20, Gwangun-ro, Nowon-gu, Seoul, Korea

    Yong-Jo Ahn & Donggyu Sim

Authors
  1. Yong-Jo Ahn
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Donggyu Sim
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Donggyu Sim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahn, YJ., Sim, D. Fast mode decision and early termination based on perceptual visual quality for HEVC encoders. J Real-Time Image Proc 16, 1927–1942 (2019). https://doi.org/10.1007/s11554-017-0694-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-017-0694-3

Keywords