Skip to main content
SpringerLink
Log in

Fast CU partition strategy based on texture and neighboring partition information for Versatile Video Coding Intra Coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The next generation video coding standard, H.266/Versatile Video Coding (VVC), was released by the Joint Video Exploration Team (JVET) in July 2020. Unlike the previous generation standard H.265/High Efficiency Video Coding (HEVC), VVC introduces a quad-tree coding unit (CU) structure with nested multitype trees (QTMT) and expands the internal prediction patterns from 35 to 67. Although these next-generation techniques improve compression efficiency, the computational complexity in internal coding also increases greatly, leading to a significant increase in coding time. To solve this problem, this paper proposes a fast CU partitioning strategy for VVC internal coding based on texture and neighboring partition information. The main contributions of the proposed algorithm are: 1) we fully explore the texture information and adjacent CU partition information to propose a fast method for CU block partitioning, and the proposed method reduces the computational complexity without significantly degrading the coding performance; 2) by exploring the correlation between texture information and CU partitioning patterns, we design a corresponding fast decision algorithm for different sizes of CUs; 3) based on the correlation between the current CU and correlation between neighboring domains, we guide the fast CU division by combining texture information with the division information of neighboring CUs together. The experimental results show that the coding time of this algorithm is reduced by 44.22% compared with VVC, while BDBR is increased by only 0.93% and BDPSNR is reduced by only 0.04 dB.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

The datasets generated during and/or analysed during the current study are not publicly available due tothe continuing work of this study but are available from the corresponding author on reasonable request.

References

  1. Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the H264/AVC Video Coding Standard. IEEE Trans Circ Syst Video Technol 13(7):560–576

    Article  Google Scholar 

  2. Sullivan GJ, Ohm J, Han W, Wiegand T (2012) Overview of the High Efficiency Video Coding (HEVC) Standard. IEEE Trans Circ Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  3. Saldanha M, Corrêa M, Corrêa G, Palomino D, Porto M, Zatt B, Agostini L (2020) An Overview of dedicated hardware designs for state-of-the-art AV1 and H.266/VVC video codecs. In: 2020 27th IEEE International Conference on Electronics, Circuits and Systems (ICECS), Glasgow,  pp 1–4. https://doi.org/10.1109/ICECS49266.2020.9294862

  4. Bross B, Chen J, Liu S (2018) Versatile video coding (Draft 1), Joint Video Experts Team (JVET), doc. JVET-J1001, San Diego

  5. Abdallah B, Belghith F, Benayed MA et al (2021) Low-complexity QTMT partition based on deep neural network for Versatile Video Coding. Signal Image Video Process (SIViP) 15:1153–1160

    Article  Google Scholar 

  6. Wang Y, Cao J, Wang J, Liang F (2019) Gradient-based fast intra coding decision algorithm for HEVC. In: 2019 IEEE 4th International conference on signal and image processing (ICSIP), Wuxi, pp 870–874

  7. Lu J, Liang F, Xie L, Luo Y (2013) A fast block partition algorithm for HEVC. In: 2013 9th international conference on information, communications & signal processing, pp 1-5

  8. Shen L, Zhang Z, Liu Z (2014) Effective CU Size Decision for HEVC Intracoding. IEEE Trans Image Process 23(10):4232–4241

    Article  ADS  MathSciNet  PubMed  Google Scholar 

  9. Nishikori T, Nakamura T, Yoshitome T, Mishiba K (2013) A fast CU decision using image variance in HEVC intra coding. In: 2013 IEEE symposium on industrial electronics & applications, pp 52–56

  10. Cho S, Kim M (2013) Fast CU Splitting and Pruning for Suboptimal CU Partitioning in HEVC Intra Coding. IEEE Trans Circ Syst Video Technol 23(9):1555–1564

    Article  Google Scholar 

  11. Yun Song, Ye Zeng, Xueyu Li, Biye Cai, Gaobo Yang (2017) Fast CU size decision and mode decision algorithm for intra prediction in HEVC. Multimed Tools Appl 76(2):1–17

    Google Scholar 

  12. Wieckowski A, Ma J, Schwarz H, Marpe D, Wiegand T (2019) Fast partitioning decision strategies for the upcoming versatile video coding (VVC) Standard. In: 2019 IEEE international conference on image processing (ICIP), pp 4130–4134

  13. Zhang Q, Wang Y, Jiang B, Wang X, Su R (2021) Adaptive CU partition and early skip mode detection for H.266/VVC. Multimed Tools Appl 80:13957–13973

    Article  Google Scholar 

  14. Fu T, Zhang H, Mu F, Chen H (2019) Fast CU partitioning algorithm for H.266/VVC intra-frame coding. In: 2019 IEEE international conference on multimedia and expo (ICME), pp 55-60

  15. Zouidi N, Belghith F, Kessentini A, Masmoudi N (2019) Fast intra prediction decision algorithm for the QTBT structure. In: 2019 IEEE international conference on design & test of integrated micro & nano-systems (DTS), pp 1–6

  16. Peng S, Peng Z, Ren Y, Chen F (2019) Fast intra-frame coding algorithm for versatile video coding based on texture feature. In: 2019 IEEE International conference on real-time computing and robotics (RCAR), pp 65-68

  17. Lei M, Luo F, Zhang X, Wang S, Ma S (2019) Look-ahead prediction based coding unit size pruning for VVC intra coding. In: 2019 IEEE international conference on image processing (ICIP), pp 4120-4124

  18. Tang N, Cao J, Liang F, Wang J, Liu H, Wang X, Du X (2019) Fast CTU Partition Decision Algorithm for VVC Intra and Inter Coding. In: 2019 IEEE Asia pacific conference on circuits and systems (APCCAS), p 361–364

  19. Chen J, Sun H, Katto J, Zeng X, Fan Y (2019) Fast QTMT partition decision algorithm in VVC intra coding based on variance and gradient. In: 2019 IEEE Visual communications and image processing (VCIP), pp 1–4

  20. Yang H, Shen L, Dong X, Ding Q, An P, Jiang G (2020) Low-complexity CTU partition structure decision and fast intra mode decision for versatile video coding. IEEE Trans Circ Syst Video Technol 30(6):1668–1682

    Article  Google Scholar 

  21. Wu G, Huang Y, Zhu C, Song L, Zhang W (2021) SVM based fast CU partitioning algorithm for VVC intra coding. In: 2021 IEEE international symposium on circuits and systems (ISCAS), pp 1–5

  22. Bjontegaard G (2001) Calculation of average PSNR differences between RD-curves. ITU-T VCEG-M33, Shanghai

    Google Scholar 

  23. Bjontegaard G (2008) Improvements of the BD-PSNR model. VCEG-AI11, input document of the 35th VCEG meeting, Berlin

  24. Li T, Xu M, Tang R, Chen Y, Xing Q (2021) DeepQTMT: a deep learning approach for fast QTMT-based CU partition of intra-mode VVC. IEEE Trans Image Process 30:5377–5390

    Article  ADS  PubMed  Google Scholar 

  25. Amestoy T, Mercat A, Hamidouche W, Menard D, Bergeron C (2020) Tunable VVC frame partitioning based on lightweight machine learning. IEEE Trans Image Process 29:1313–1328

    Article  ADS  MathSciNet  Google Scholar 

  26. Zhang M, Chen Y, Lu X, Chen H, Zhang Y (2021) Fast coding unit partition decision for intra prediction in versatile video coding. In: Peng Y, Hu SM, Gabbouj M, Zhou K, Elad M, Xu K (eds) Image and graphics. ICIG 2021. Lecture Notes in Computer Science()), vol 12888. Springer: Cham

  27. Lei M, Luo F, Zhang X, Wang S, Ma S (2019) Look-ahead prediction based coding unit size pruning for VVC intra coding. In: 2019 IEEE international conference on image processing (ICIP), Taipei, pp 4120–4124

  28. Bross B (2018) Versatile video coding (draft 1). Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J1001, San Diego

  29. Bossen F, Boyce J, Li X, Seregin V, Suhring K (2019) Jvet common test conditions and software reference configurations for SDR video. Joint Video Experts Team (JVET) ITU-T SG 16:19–27

    Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 62271336&62211530110, the Chengdu City Major Technology Application Demonstration Project (2019-YF09-00120-SN).

Author information

Authors and Affiliations

  1. College of Electronics and Information Engineering, Sichuan University, No.24 South Section 1, Yihuan Road, Chengdu, 610065, China

    Ruolan Yang, Xiaohai He, Shuhua Xiong, Zeming Zhao & Honggang Chen

Authors
  1. Ruolan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaohai He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shuhua Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zeming Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Honggang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaohai He.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, R., He, X., Xiong, S. et al. Fast CU partition strategy based on texture and neighboring partition information for Versatile Video Coding Intra Coding. Multimed Tools Appl 83, 28323–28340 (2024). https://doi.org/10.1007/s11042-023-16601-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16601-5

Keywords

Search

Navigation