Abstract
Versatile Video Coding (VVC) is the next generation video coding standard. Compared with HEVC/H.265, in order to improve coding efficiency, its complexity of intra coding increases significantly. Too much encoding time makes it difficult for real-time coding and hardware implementation. To tackle this urgent problem, a texture-based fast CU size decision and intra mode decision algorithm is proposed in this paper. The contributions of the proposed algorithm include two aspects. (1) Aiming at the latest adopted QTMT block partitioning scheme in VVC, some redundant splitting tree and direction are skipped according to texture characteristics and differences between sub-parts of CU. (2) A fast intra mode decision scheme is proposed which considers complexity and texture characteristics. Some hierarchical modifications are applied including reducing the number of checked Intra Prediction Modes (IPM) and candidate modes in Rough Modes Decision (RMD) and RD check stage respectively. Compared with the latest VVC reference software VTM-4.2, the proposed algorithm can achieve approximately 46% encoding time saving on average with only 0.91% BD-RATE increase or 0.046 BD-PSNR decrease.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Van der Auwera, G., Seregin, V., Said, A., Ramasubramonian, A.K., Karczewicz, M.: CE3: simplified PDPC (Test 2.4.1), document JVET-K0063. In: Proceedings of 11th JVET Meeting, Ljubljana, SI, July 2018
Chen, H., Yang, H., Chen, J.: CE4: affine motion compensation with fixed sub-block size (Test 1.1), document JVET-K0184. In: Proceedings of 11th JVET Meeting, Ljubljana, SI, July 2018
De-Luxán-Hernández, S., et al.: CE3: Intra sub-partitions coding mode (Tests 1.1.1 and 1.1.2), document JVET -M0102. In: Proceedings of 13th JVET Meeting, Marrakech, MA, Jan 2019
Bross, B.: Versatile video coding (Draft 1), document JVET-J1001. In: Proceedings of 10th JVET Meeting, San Diego, US, Apr 2018
Choi, N., Piao, Y., Choi, K., Kim, C.: CE3.3 related: intra 67 modes coding with 3MPM, document JVET-K0529, JVET-K0368. In: Proceedings of 11th JVET meeting, Ljubljana, SI, July 2018
Chen, J., et al.: Coding tools investigation for next generation video coding, ITU-T SG16 Doc. COM16CC806, Feb 2015
Öztekin, A., Erçelebi, E.: An early split and skip algorithm for fast intra CU selection in HEVC. J. Real-Time Image Process. 12, 273–283 (2016)
Zhang, M., Lai, D., Liu, Z., An, C.: A novel adaptive fast partition algorithm based on CU complexity analysis in HEVC. Multimedia Tools Appl. 78, 1035–1051 (2019)
Jamali, M., Coulombe, S.: Coding unit splitting early termination for fast HEVC intra coding based on global and directional gradients. In: 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP), pp. 1–5 (2016)
Chang, L., Liu, Z., Wang, L., Li, X: Enhance the HEVC fast intra CU mode decision based on convolutional neural network by corner power estimation. In: 2018 Data Compression Conference (DCC), p. 400 (2018)
Ogata, J., Ichige, K.: Fast intra mode decision method based on outliers of DCT coefficients and neighboring block information for H. 265/HEVC. In: 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1–5 (2018)
Jamali, M., Coulombe, S.: Fast HEVC intra mode decision based on RDO cost prediction. IEEE Trans. Broadcast. 65(1), 109–122 (2019)
Jin, Z., An, P., Shen, L.: Fast QTBT partition algorithm for JVET intra coding based on CNN. In: Pacific Rim Conference on Multimedia (PCM), pp. 59–69 (2017)
Lin, T., Jiang, H., Huang, J., Chang, P.: Fast intra coding unit partition decision in H. 266/FVC based on spatial features. J. Real-Time Image Process. 1–18 (2018)
Amestoy, T., Mercat, A., Hamidouche, W., Bergeron, C., Menard, D.: Random forest oriented fast QTBT frame partitioning. In: 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1837–1841 (2019)
Yang, H., Shen, L., Dong, X., Ding, Q., An, P., Jiang, G.: Low complexity CTU partition structure decision and fast intra mode decision for Versatile video coding. In: IEEE Transactions on Circuits and Systems for Video Technology (2019)
VTM-4.2. https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/tree/VTM-4.2
Bjontegaard, G.: Calculation of average PSNR differences between RD curves, document VCEG-M33. Texas, USA (2001)
Acknowledgments
This work is supported by Key R&D Program of Guangdong Province (No. 2019B010135002).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Cao, J., Tang, N., Wang, J., Liang, F. (2020). Texture-Based Fast CU Size Decision and Intra Mode Decision Algorithm for VVC. In: Ro, Y., et al. MultiMedia Modeling. MMM 2020. Lecture Notes in Computer Science(), vol 11961. Springer, Cham. https://doi.org/10.1007/978-3-030-37731-1_60
Download citation
DOI: https://doi.org/10.1007/978-3-030-37731-1_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37730-4
Online ISBN: 978-3-030-37731-1
eBook Packages: Computer ScienceComputer Science (R0)