Skip to main content
SpringerLink
Log in

Fast all zero block detection algorithm for versatile video coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The new generation versatile video coding (VVC) standard brings extremely high compression efficiency. Meanwhile, the complexity of the encoder is also greatly increased. In view of this, this paper proposes a fast algorithm for all zero block detection to speed up the quantization process, thereby reducing the complexity of the encoder. The method proposed in this paper consists of three parts. Firstly, genuine all zero blocks are detected based on a fixed threshold which is derived by hard decision quantization formula. Secondly, parts of pseudo all zero blocks are detected based on an adaptive threshold which is derived by analyzing the positions of transform coefficients under a certain condition. Finally, for the remaining pseudo all zero blocks, machine learning is introduced and the decision is made through the fully connected neural network. Experimental results show that the proposed fast algorithm achieves up to 7.505% and 7.049% coding time saving under Low Delay B and Random Access configurations with only 0.470% and 0.578% performance loss on average, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Algorithm 1
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Bjontegaard G (2001) Calculation of average psnr differences between rd-curves. VCEG-M33

  2. Bossen F, Boyce J, Li X, Seregin V, Shring K (2019) Jvet-n1010: jvet common test conditions and software reference configurations for sdr video. Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Tech rep

  3. Bossen F, Boyce J, Li X, Seregin V, Shring K (2020) Algorithm description for versatile video coding and test model 10 (vtm 10). Joint Video Exploration Team (JVET), document JVET-S2002, Jul

  4. Bross B, Chen J, Liu S, Wang YK (2020) Working draft 10 of versatile video coding. In: Joint video experts team (JVET) of ITU-T SG6 WP3 and ISO/IEC JTC1/SC29/WG11, 19th meeting: teleconference, pp 14–24

  5. Bross B, Wang YK, Ye Y, Liu S, Chen J, Sullivan GJ, Ohm JR (2021) Overview of the versatile video coding (vvc) standard and its applications. IEEE Trans Circuits Syst Video Technol

  6. Chen J, Karczewicz M, Huang YW, Choi K, Ohm JR, Sullivan GJ (2019) The joint exploration model (jem) for video compression with capability beyond hevc. IEEE Trans Circuits Syst Video Technol 30(5):1208–1225

    Article  Google Scholar 

  7. Cui J, Wang S, Wang S, Zhang X, Ma S, Gao W (2017) Hybrid laplace distribution-based low complexity rate-distortion optimized quantization. IEEE Trans Image Process 26(8):3802–3816

    Article  MathSciNet  MATH  Google Scholar 

  8. Cui J, Xiong R, Zhang X, Wang S, Wang S, Ma S, Gao W (2018) Hybrid all zero soft quantized block detection for hevc. IEEE Trans Image Process 27(10):4987–5001

    Article  MathSciNet  Google Scholar 

  9. Everett IIIH (1963) Generalized lagrange multiplier method for solving problems of optimum allocation of resources. Oper Res 11(3):399–417

    Article  MathSciNet  MATH  Google Scholar 

  10. Fan H, Wang R, Ding L, Xie X, Jia H, Gao W (2016) Hybrid zero block detection for high efficiency video coding. IEEE Trans Multimed 18 (3):537–543

    Article  Google Scholar 

  11. Fu T, Zhang H, Mu F, Chen H (2019) Two-stage fast multiple transform selection algorithm for vvc intra coding. In: 2019 IEEE international conference on multimedia and expo (ICME). IEEE, pp 61–66

  12. Hong Z, Lin J, Jiang D, Yin J (2019) Improve the efficiency of low frequency non-separable secondary transform based on implicit multiple transform selection. In: 2019 International conference on artificial intelligence and advanced manufacturing (AIAM). IEEE, pp 148–151

  13. Karczewicz M, Ye Y, Chong I (2008) Rate distortion optimized quantization, document vceg-ah21. ITU-T SG, vol 16

  14. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv:14126980

  15. Lee B, Jung J, Kim M (2016) An all-zero block detection scheme for low-complexity hevc encoders. IEEE Trans Multimed 18(7):1257–1268

    Article  Google Scholar 

  16. Lee K, Lee HJ, Kim J, Choi Y (2013) A novel algorithm for zero block detection in high efficiency video coding. IEEE J Select Topics Signal Process 7(6):1124–1134

    Article  Google Scholar 

  17. Lee H, Yang S, Park Y, Jeon B (2015) Fast quantization method with simplified rate–distortion optimized quantization for an hevc encoder. IEEE Trans Circuits Syst Video Technol 26(1):107–116

    Article  Google Scholar 

  18. Marpe D, Schwarz H, Wiegand T (2003) Context-based adaptive binary arithmetic coding in the h. 264/avc video compression standard. IEEE Trans Circuits Syst Video Technol 13(7):620–636

    Article  Google Scholar 

  19. Pfaff J, Schwarz H, Marpe D, Bross B, De-Luxán-Hernández S, Helle P, Helmrich CR, Hinz T, Lim WQ, Ma J et al (2019) Video compression using generalized binary partitioning, trellis coded quantization, perceptually optimized encoding, and advanced prediction and transform coding. IEEE Trans Circuits Syst Video Technol 30(5):1281–1295

    Article  Google Scholar 

  20. Schwarz H, Nguyen T, Marpe D, Wiegand T (2019) Hybrid video coding with trellis-coded quantization. In: 2019 Data compression conference (DCC). IEEE, pp 182–191

  21. Schwarz H, Nguyen T, Marpe D, Wiegand T, Karczewicz M, Coban M, Dong J (2019) Improved quantization and transform coefficient coding for the emerging versatile video coding (vvc) standard. In: 2019 IEEE international conference on image processing (ICIP). IEEE, pp 1183–1187

  22. Schwing AG, Urtasun R (2015) Fully connected deep structured networks. arXiv:150302351

  23. Sullivan G (2005) Adaptive quantization encoding technique using an equal expected-value rule. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, JVT-N011

  24. Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (hevc) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  25. Sullivan GJ, Wiegand T (1998) Rate-distortion optimization for video compression. IEEE Signal Process Mag 15(6):74–90

    Article  Google Scholar 

  26. (2020). Vvc software vtm-10.0. Accessed 13 Aug 2020. available: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/tags/VTM-10.0/

  27. Wang H, Kwong S (2008) Prediction of zero quantized dct coefficients in h. 264/avc using hadamard transformed information. IEEE Trans Circuits Syst Video Technol 18(4):510–515

    Article  Google Scholar 

  28. Wang M, Xie X, Fan H, Wang S, Li J, Dong S, Xiang G, Jia H (2017a) Fast rate distortion optimized quantization method for hevc. In: 2017 IEEE international symposium on circuits and systems (ISCAS). IEEE, pp 1–4

  29. Wang M, Xie X, Li J, Jia H, Gao W (2017b) Fast rate distortion optimized quantization method based on early detection of zero block for hevc. In: 2017 IEEE third international conference on multimedia big data (BigMM). IEEE, pp 90–93

  30. Wang J, Yin H, Gao Z, Zhang X (2016) Improved rate distortion optimized quantization for hevc with adaptive thresholding. In: 2016 IEEE international symposium on broadband multimedia systems and broadcasting (BMSB). IEEE, pp 1–4

  31. Wen J, Luttrell M, Villasenor J (2000) Trellis-based rd optimal quantization in h. 263+. IEEE Trans Image Process 9(8):1431–1434

    Article  Google Scholar 

  32. Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the h. 264/avc video coding standard. IEEE Trans Circuits Syst Video Technol 13(7):560–576

    Article  Google Scholar 

  33. Xie Z, Liu Y, Liu J, Yang T (2007) A general method for detecting all-zero blocks prior to dct and quantization. IEEE Trans Circuits Syst Video Technol 17(2):237–241

    Article  Google Scholar 

  34. Xu M, Canh TN, Jeon B (2018) Simplified rate-distortion optimized quantization for hevc. In: 2018 IEEE international symposium on broadband multimedia systems and broadcasting (BMSB). IEEE, pp 1–6

  35. Xu M, Canh TN, Jeon B (2019) Simplified level estimation for rate-distortion optimized quantization of hevc. IEEE Trans Broadcast 66(1):88–99

    Article  Google Scholar 

  36. Yang H, Shen L, Dong X, Ding Q, An P, Jiang G (2019) Low-complexity ctu partition structure decision and fast intra mode decision for versatile video coding. IEEE Trans Circuits Syst Video Technol 30(6):1668–1682

    Article  Google Scholar 

  37. Yang E, Yu X (2008) Soft decision quantization for h. 264 with main profile compatibility. IEEE Trans Circuits Syst Video Technol 19(1):122–127

    Article  Google Scholar 

  38. Yin H, Cai H, Yang E, Zhou Y, Wu J (2018) An efficient all-zero block detection algorithm for high efficiency video coding with rdoq. Signal Process Image Commun 60:79–90

    Article  Google Scholar 

  39. Yin H, Yang H, Huang X, Wang H, Yan C (2020) Multi-stage all-zero block detection for hevc coding using machine learning. J Vis Commun Image Represent 73:102945

    Article  Google Scholar 

  40. Zhang Z, Zhao X, Li X, Li Z, Liu S (2019) Fast adaptive multiple transform for versatile video coding. In: 2019 Data compression conference (DCC). IEEE, pp 63–72

  41. Zhang M, Zhou T, Wang W (2008) Adaptive method for early detecting zero quantized dct coefficients in h. 264/avc video encoding. IEEE Trans Circuits Syst Video Technol 19(1):103–107

    Article  Google Scholar 

  42. Zhao Y, Yuan Y (2010) All-zero block detecting algorithm based on look-up threshold tables in h. 264. In: 6th International conference on digital content, multimedia technology and its applications. IEEE, pp 183–187

Download references

Acknowledgements

This work was supported in part by the National Key R&D Program of China (2021ZD0109802), and by the National Natural Science Foundation of China under Grant 61901150, 61931008, and 61972123.

Funding

The authors declare that there is no conflict of interests/competing interests regarding the publication of this article.

Author information

Authors and Affiliations

  1. School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, 310018, China

    Weihong Niu, Xiaofeng Huang, Haibing Yin, Yu Lu & Yang Zhou

  2. School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, China

    Chenggang Yan

Authors
  1. Weihong Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaofeng Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haibing Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yang Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Chenggang Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaofeng Huang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Niu, W., Huang, X., Yin, H. et al. Fast all zero block detection algorithm for versatile video coding. Multimed Tools Appl 82, 33693–33718 (2023). https://doi.org/10.1007/s11042-023-14579-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14579-8

Keywords

Search

Navigation