Skip to main content
SpringerLink
Log in

Block-correlation-based intra prediction for VVC

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The new generation video coding standard Versatile Video Coding (VVC) has been officially released. Many novel technologies were utilized to improve the coding performance. In this paper, we propose an efficient intra prediction algorithm based on block correlation to improve the performance of VVC. First, since the single prediction mode sometimes does not predict very well and the high correlation of neighboring blocks is not fully used, we propose a multi-modes fusion method to merge the modes of adjacent blocks. Second, to better predict complex areas, we design an adaptive template matching method. Different weighting methods are utilized for different size blocks because they show different texture features. In addition, we combine Derived Mode (DM) with Cross-Component Linear Model (CCLM) in an adaptive way to form a new chroma mode which compensates for the shortcomings of single linear prediction. Experimental results indicated the superior performance of our algorithm. Compared with the VVC anchor (VTM 9.1), our proposed algorithm saved the bitrate of 0.78%, 0.87%, and 0.99% on average for Y, Cb, and Cr. Furthermore, the using probabilities of our designed modes were higher than that of many other traditional modes in VVC.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Bjontegaard G (2001) Calculation of average PSNR differences between RD-Curves. Proceedings of the ITU-T Video Coding Experts Group (VCEG) Thirteenth Meeting

  2. Blanch MG, Blasi S, Smeaton AF, O’Connor NE, Mrak M (2021) Attention-based neural networks for Chroma intra prediction in video coding. IEEE J Sel Top Signal Process 15(2):366–377. https://doi.org/10.1109/JSTSP.2020.3044482

    Article  Google Scholar 

  3. Bossen F, Boyce J, Li X, Seregin V, Suhring K (2019) JVET common conditions and software reference configurations for SDT video. JVET-N1010, 14th Meeting, Geneva, CH, 19–27

  4. Bross B, Keydel P, Schwarz H, Marpe D, Wiegand T (2018) Multiple reference line intra prediction. In: Document JVET-L0283

  5. Bross B, Chen J, Liu S, Wang Y-K (2020) Versatile video coding (draft 8). Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-Q2001

  6. Chang Y-J, Jhu H-J, Jiang H-Y, Zhao L, Liu S, Wiegand T (2019) Multiple Reference Line Coding for Most Probable Modes. In: Intra Prediction. 2019 Data Compression Conference (DCC), p. 559. https://doi.org/10.1109/DCC.2019.00071.

  7. Chen J, Ye Y, Kim S-H (2019) Algorithm description for Versatile Video Coding and Test Model 7 (VTM 7). JVET-P2002, Joint Video Exploration Team (JVET)

  8. Coding HEV (2013) Recommendation ITU-T H.265 High efficiency video coding. In Edition 1.0

  9. De Luxan Hernandez S, Schwarz H, Marpe D, Wiegand T (2018) CE3: Line-based intra coding mode. In: Document JVET-K0049, Ljubljana, Slovenia

  10. De Luxán-Hernández S, George V, Ma J, Nguyen T, Schwarz H, Marpe D, Wiegand T (2019) An intra sub-partition coding mode for VVC. In: 2019 IEEE International Conference on Image Processing (ICIP). IEEE, pp. 1203–1207. https://doi.org/10.1109/ICIP.2019.8803777.

  11. Ghaznavi-Youvalari R (2020) Linear Model-Based Intra Prediction in VVC Test Model. In: 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4417–4421. https://doi.org/10.1109/ICASSP40776.2020.9054405

  12. Ghaznavi-Youvalari R, Lainema J (2020) Joint Cross-Component Linear Model For Chroma Intra Prediction. In: 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), pp. 1–5. https://doi.org/10.1109/MMSP48831.2020.9287167.

  13. Huo J, Ma Y, Wan S, Yu Y, Wang M, Zhang K, Zhang L, Liu H, Xu J, Wang Y, Li J, Wang S, Gao W (2019) CE3–1.5: CCLM derived with four neighbouring samples. In: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET N0271

  14. Kidani Y, Kawamura K, Unno K, Naito S (2019) Blocksize-QP Dependent Intra Interpolation Filters. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 4125–4129. https://doi.org/10.1109/ICIP.2019.8803456

  15. Laroche G, Taquet J, Gisquet C, Onno P (2018) CE3–5.1: On cross-component linear model simplification. In: Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0191, Macau, CN

  16. Lei M, Luo F, Zhang X, Wang S, Ma S (2020) Two-Step Progressive Intra Prediction For Versatile Video Coding. In: 2020 IEEE International Conference on Image Processing (ICIP), pp. 1137–1141. https://doi.org/10.1109/ICIP40778.2020.9190915

  17. Li J et al. (2020) Unified Intra Mode Coding Based on Short and Long Range Correlations. In: IEEE Transactions on Image Processing (TIP), vol. 29, pp. 7245–7260. https://doi.org/10.1109/TIP.2020.3000351

  18. Li Y, Yi Y, Liu D et al (2021) Neural-network-based cross-channel intra prediction. ACM Trans Multimedia Comput Commun Appl (TOMM) 17(3):1–23

    Google Scholar 

  19. Racapé F, Rath G, Urban F, Zhao L, Liu S, Zhao X, Li X, Filippov A, Rufitskiy V, Chen J (2018) CE3-related: wide-angle intra prediction for non-square blocks, joint video exploration team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0500, Ljubljana, SL

  20. Rath G, Racape F, Urban F, Leleannec F, Galpin F, Naser K (2021) A general framework for directional intra prediction with varying angle for video coding. In: 2020 28th European Signal Processing Conference (EUSIPCO), pp. 1–4. https://doi.org/10.23919/Eusipco47968.2020.9287723.

  21. Said A, Zhao X, Karczewicz M, Chen J, Zou F (2016) Position Dependent Prediction Combination for Intra-frame Coding. In: IEEE International Conference on Image Processing (ICIP), pp. 534–538, Phoenix, USA. https://doi.org/10.1109/ICIP.2016.7532414.

  22. Schäfer M, Stallenberger B, Pfaff J, Helle P, Schwarz H, Marpe D, Wiegand T (2019) An affifine-linear intra prediction with complexity constraints. In: IEEE International Conference on Image Processing (ICIP), pp. 1089–1093, IEEE. https://doi.org/10.1109/ICIP.2019.8803724

  23. Schäfer M, Merkle P, Helle P, Hinz T, Schwarz H, Marpe D, Wiegand T, Pfaff J, Stallenberger B (2019) Affifine linear weighted intra prediction. In: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: VET-N0217

  24. Schneider J, Mehlem D, Meyer M, Rohlfing C (2021) Sparse Coding-based Intra Prediction in VVC. In: 2021 Picture Coding Symposium (PCS), pp. 1–5. https://doi.org/10.1109/PCS50896.2021.9477474.

  25. Sullivan G, Ohm J-R (2018) Meeting report of the 11th meeting of the joint video experts team (JVET). Joint Video Experts Team (JVET)

  26. Venugopal G, Helle P, Mueller K, Marpe D, Wiegand T (2019) Hardware-friendly intra region-based template matching for VVC. In: 2019 Data Compression Conference (DCC), pp. 606–606. https://doi.org/10.1109/DCC.2019.00118

  27. Venugopal G, Müller K, Marpe D, Wiegand T (2019) A Unified Region-Based Template Matching Approach for Intra and Inter Prediction in VVC. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 4115–4119. https://doi.org/10.1109/ICIP.2019.8803445.

  28. Yoon YU, Park DH, Kim JG, Lee J, Kang J (2019) Most frequent mode for intra-mode coding in video coding. Electron Lett 55(4):188–190

    Article  Google Scholar 

  29. Yoon YU, Park DH, Kim JG (2020) Enhanced derivation of model parameters for cross-component linear model (CCLM) in VVC. IEICE Trans Inf Syst 103(2):469–471

    Article  Google Scholar 

  30. Zhang K, Chen J, Zhang L, Li X, Karczewicz M (2018) Enhanced cross-component linear model for Chroma intra-prediction in video coding. IEEE Trans Image Process 27(8):3983–3997. https://doi.org/10.1109/TIP.2018.2830640

    Article  MathSciNet  MATH  Google Scholar 

  31. Zhao L, Liu S, Zhao X, Li X (2018) CE3-related: Wide angular intra prediction for non-square blocks. In: Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0279, Macau, CN

  32. Zhao X, Seregin V, Said A, Zhang K, Egilmez HE, Karczewicz M (2018) Low Complexity Intra Prediction Refinements for Video Coding. In: IEEE Picture Coding Symposium (PCS), pp. 139–143, San Francisco, USA. https://doi.org/10.1109/PCS.2018.8456305.

  33. Zhao L, Zhao X, Liu S, Li X, Lainema J, Rath G, Urban F, Racapé F (2019) Wide angular intra prediction for versatile video coding. In: 2019 Data Compression Conference (DCC), IEEE, pp 53–62. https://doi.org/10.1109/DCC.2019.00013.

  34. Zhu L, Zhang Y, Wang S, Kwong S, Jin X, Qiao Y (2021) Deep Learning-Based Chroma Prediction for Intra Versatile Video Coding. IEEE Trans Circ Syst Video Technol (TCSVT) 31(8):3168–3181. https://doi.org/10.1109/TCSVT.2020.3035356

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (Grant No. 62271336 and Grant No. 62211530110), and the Fundamental Research Funds for the Central Universities (grant number 2021SCU12061).

Author information

Authors and Affiliations

  1. College of Electronics and Information Engineering, Sichuan University, No.24 South Section 1, Yihuan Road, Chengdu, 610065, China

    Dan Luo, Shuhua Xiong, Xiaohai He, Honggang Chen, Zeng Li & Chao Ren

Authors
  1. Dan Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuhua Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaohai He
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Honggang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zeng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Chao Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaohai He.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luo, D., Xiong, S., He, X. et al. Block-correlation-based intra prediction for VVC. Multimed Tools Appl 82, 23635–23653 (2023). https://doi.org/10.1007/s11042-023-14700-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14700-x

Keywords

Search

Navigation