Abstract
The latest video coding standard is the versatile video coding (VVC) which was developed by JVET in July 2020. In VVC, a quadtree nested with multi-type trees using the binary tree and ternary tree structure can support more flexible CU partitioning. The QTMT structure allows more flexible CU shapes to adopt various local characteristics yet also introduces unprecedentedly high coding complexity for VVC intra coding. To reduce the excessive complexity, in this paper, we use Scharr operator-based gradient to describe texture information and subblock edge difference to describe structure information and then propose a fast QTMT partition method based on them. The fast algorithm includes three parts: the early termination of CU partition, the early decision of CU partition direction, and the early skip of ternary tree split mode. Experimental results show that the proposed algorithm can save 49.05% encoding time than anchor VTM14.0 only with 1.37% increase in BDBR.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Underlying the results presented in this paper is not publicly available at this time but may be obtained from the authors upon reasonable request.
References
Bross, B.: Versatile Video Coding (Draft 10), document JVET-S2001, Joint Video Exploration Team (JVET), (2020)
Pakdaman, F., Adelimanesh, M.A., Gabbouj, M., Hashemi, M.R.: Complexity analysis Of next-generation VVC encoding and decoding. In: IEEE International Conference on Image Processing (ICIP), IEEE, pp. 3134-3138 (2020)
Li, Y., Yang, G., Song, Y., Zhang, H., Ding, X., Zhang, D.: Early intra CU size decision for versatile video coding based on a tunable decision model. IEEE Trans. Broadcast. 67(3), 710–720 (2021)
Cui, J., Zhang, T., Gu, C., Zhang, X., Ma, S.: Gradient-based early termination of CU partition in VVC intra coding. In: 2020 Data Compression Conf(DCC), pp. 103-112 (2020)
Fan, Y., Chen, J., Sun, H., Katto, J., Jing, M.: A fast QTMT partition decision strategy for VVC intra prediction. IEEE Access. 8, 107900–107911 (2020)
Song, Y., Zeng, B., Wang, M.: An efficient low-complexity block partition scheme for VVC intra coding. J. Real-Time Image Proc. 19, 161–172 (2021)
Peng, S., Peng, Z., Ren, Y., Chen, F.: Fast intra-frame coding algorithm for Versatile Video Coding based on texture feature. In: IEEE International Conference on Real-time Computing and Robotics(RCAR), pp. 65-68 (2019)
Saldanha, M., Sanchez, G., Marcon, C., Agostini, L.: Configurable fast block partitioning for VVC intra coding using light gradient boosting machine. IEEE Trans. Circuits Syst. Video Technol. (2021). https://doi.org/10.1109/TCSVT.2021.3108671
He, Q., Wu, W., Luo, L., Zhu, C., Guo, H.: Random forest based fast CU partition for VVC intra coding. In: IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1-4 (2021)
Wu, G., Huang, Y., Zhu, C., Song, L., Zhang, W.: SVM based fast CU partitioning algorithm for VVC intra coding. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1-5 (2021)
Tang, G., Jing, M., Zeng, X., Fan, Y.: Adaptive CU split decision with pooling-variable CNN for VVC intra encoding. In: IEEE Visual Communications and Image Processing (VCIP), pp. 1-4 (2019)
Zhang, Q., Guo, R., Jiang, B., Su, R.: Fast CU decision-making algorithm based on denseNet network for VVC. IEEE Access. 9, 119289–119297 (2021)
HoangVan, X., NguyenQuang, S., DinhBao, M., DoNgoc, M., Trieu Duong, D.: Fast QTMT for H.266/VVC intra prediction using early-terminated hierarchical CNN model. In: Int. Conf. on Advanced Technologies for Communications (ATC), pp. 195-200 (2021)
Amna, M., Imen, W., Ezahra, S.F., Atri, M.: Fast intra-coding unit partition decision in H.266/FVC based on deep learning. J. Real-Time Image Proc. 17, 1971–1981 (2020)
Zouidi, N., Belghith, F., Kessentini, A., Masmoudi, N.: Complexity reduction of versatile video coding standard: a deep learning approach. J. Electron. Imag. 30, 023002 (2021)
Chen, F., Chen, Y., Peng, Z., Jiang, G., Cui, X.: A fast CU size decision algorithm for VVC intra prediction based on support vector machine. Multimed. Tools Appl. 79, 27923–27939 (2020)
Zhang, Q., Cui, T., Huang, L., Jiang, B., Zhao, J.: Low-complexity intra coding scheme based on Bayesian and L-BFGS. Digital Signal Process. 127, 103539 (2022)
Funding
This work was supported by the National Natural Science Foundation of China (Grant No.62176035) and the Key Project of Chongqing Educational Commission (Grant no. KJZD-K202100606).
Author information
Authors and Affiliations
Contributions
QL and HM wrote the main manuscript text, all tables, and figures. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This declaration is not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, Q., Meng, H. & Li, Y. Texture-based fast QTMT partition algorithm in VVC intra coding. SIViP 17, 1581–1589 (2023). https://doi.org/10.1007/s11760-022-02367-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-022-02367-0