Skip to main content

Advertisement

Springer Nature Link
Log in

Texture-based fast QTMT partition algorithm in VVC intra coding

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The latest video coding standard is the versatile video coding (VVC) which was developed by JVET in July 2020. In VVC, a quadtree nested with multi-type trees using the binary tree and ternary tree structure can support more flexible CU partitioning. The QTMT structure allows more flexible CU shapes to adopt various local characteristics yet also introduces unprecedentedly high coding complexity for VVC intra coding. To reduce the excessive complexity, in this paper, we use Scharr operator-based gradient to describe texture information and subblock edge difference to describe structure information and then propose a fast QTMT partition method based on them. The fast algorithm includes three parts: the early termination of CU partition, the early decision of CU partition direction, and the early skip of ternary tree split mode. Experimental results show that the proposed algorithm can save 49.05% encoding time than anchor VTM14.0 only with 1.37% increase in BDBR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Data availability

Underlying the results presented in this paper is not publicly available at this time but may be obtained from the authors upon reasonable request.

References

  1. Bross, B.: Versatile Video Coding (Draft 10), document JVET-S2001, Joint Video Exploration Team (JVET), (2020)

  2. Pakdaman, F., Adelimanesh, M.A., Gabbouj, M., Hashemi, M.R.: Complexity analysis Of next-generation VVC encoding and decoding. In: IEEE International Conference on Image Processing (ICIP), IEEE, pp. 3134-3138 (2020)

  3. Li, Y., Yang, G., Song, Y., Zhang, H., Ding, X., Zhang, D.: Early intra CU size decision for versatile video coding based on a tunable decision model. IEEE Trans. Broadcast. 67(3), 710–720 (2021)

    Article  Google Scholar 

  4. Cui, J., Zhang, T., Gu, C., Zhang, X., Ma, S.: Gradient-based early termination of CU partition in VVC intra coding. In: 2020 Data Compression Conf(DCC), pp. 103-112 (2020)

  5. Fan, Y., Chen, J., Sun, H., Katto, J., Jing, M.: A fast QTMT partition decision strategy for VVC intra prediction. IEEE Access. 8, 107900–107911 (2020)

    Article  Google Scholar 

  6. Song, Y., Zeng, B., Wang, M.: An efficient low-complexity block partition scheme for VVC intra coding. J. Real-Time Image Proc. 19, 161–172 (2021)

    Article  Google Scholar 

  7. Peng, S., Peng, Z., Ren, Y., Chen, F.: Fast intra-frame coding algorithm for Versatile Video Coding based on texture feature. In: IEEE International Conference on Real-time Computing and Robotics(RCAR), pp. 65-68 (2019)

  8. Saldanha, M., Sanchez, G., Marcon, C., Agostini, L.: Configurable fast block partitioning for VVC intra coding using light gradient boosting machine. IEEE Trans. Circuits Syst. Video Technol. (2021). https://doi.org/10.1109/TCSVT.2021.3108671

    Article  Google Scholar 

  9. He, Q., Wu, W., Luo, L., Zhu, C., Guo, H.: Random forest based fast CU partition for VVC intra coding. In: IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1-4 (2021)

  10. Wu, G., Huang, Y., Zhu, C., Song, L., Zhang, W.: SVM based fast CU partitioning algorithm for VVC intra coding. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1-5 (2021)

  11. Tang, G., Jing, M., Zeng, X., Fan, Y.: Adaptive CU split decision with pooling-variable CNN for VVC intra encoding. In: IEEE Visual Communications and Image Processing (VCIP), pp. 1-4 (2019)

  12. Zhang, Q., Guo, R., Jiang, B., Su, R.: Fast CU decision-making algorithm based on denseNet network for VVC. IEEE Access. 9, 119289–119297 (2021)

    Article  Google Scholar 

  13. HoangVan, X., NguyenQuang, S., DinhBao, M., DoNgoc, M., Trieu Duong, D.: Fast QTMT for H.266/VVC intra prediction using early-terminated hierarchical CNN model. In: Int. Conf. on Advanced Technologies for Communications (ATC), pp. 195-200 (2021)

  14. Amna, M., Imen, W., Ezahra, S.F., Atri, M.: Fast intra-coding unit partition decision in H.266/FVC based on deep learning. J. Real-Time Image Proc. 17, 1971–1981 (2020)

    Article  Google Scholar 

  15. Zouidi, N., Belghith, F., Kessentini, A., Masmoudi, N.: Complexity reduction of versatile video coding standard: a deep learning approach. J. Electron. Imag. 30, 023002 (2021)

    Article  Google Scholar 

  16. Chen, F., Chen, Y., Peng, Z., Jiang, G., Cui, X.: A fast CU size decision algorithm for VVC intra prediction based on support vector machine. Multimed. Tools Appl. 79, 27923–27939 (2020)

    Article  Google Scholar 

  17. Zhang, Q., Cui, T., Huang, L., Jiang, B., Zhao, J.: Low-complexity intra coding scheme based on Bayesian and L-BFGS. Digital Signal Process. 127, 103539 (2022)

    Article  Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation of China (Grant No.62176035) and the Key Project of Chongqing Educational Commission (Grant no. KJZD-K202100606).

Author information

Authors and Affiliations

  1. School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China

    Qiang Li, Hui Meng & Ya Li

  2. Chongqing Key Laboratory of Signal and Information Processing, Chongqing, 400065, China

    Qiang Li, Hui Meng & Ya Li

Authors
  1. Qiang Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Hui Meng
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Ya Li
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

QL and HM wrote the main manuscript text, all tables, and figures. All authors reviewed the manuscript.

Corresponding author

Correspondence to Hui Meng.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This declaration is not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, Q., Meng, H. & Li, Y. Texture-based fast QTMT partition algorithm in VVC intra coding. SIViP 17, 1581–1589 (2023). https://doi.org/10.1007/s11760-022-02367-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-022-02367-0

Keywords