skip to main content
10.1145/3604078.3604139acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicdipConference Proceedingsconference-collections
research-article

A Fast Affine Motion Estimation Algorithm Based on Motion Vector Difference

Published: 26 October 2023 Publication History

Abstract

In Versatile Video Coding (VVC), Affine Motion Estimation (AME) mode has been introduced for inter frame motion estimation, to improve the accuracy in predicting complex motion. Meanwhile, it brings high computational complexity in deciding AME mode. In this paper, a fast affine motion estimation algorithm based on Motion Vector Difference (MVD) is proposed to solve this problem. Through the statistical analysis, it is observed that there exists notable correlation between the MVD value of the current CU and the skipping affine mode. Therefore, one metric based on MVD of TME (Translational Motion Estimation) is defined to guide the decision of skipping affine mode, which is also used to help SKIP type coding block to skip affine mode, where SKIP type coding block means that its parent CU or neighboring CU is Skip mode in this algorithm. The other metric based on CPMVD (Control Point Motion Vector Difference) of four parameter affine model is defined to skip only six parameter affine mode. The experimental results show that compared with VTM10.0, the total time complexity of the proposed algorithm in Random Access (RA) mode is reduced by 9.77%, the total affine motion estimation time complexity is reduced by 40.65%, and the BDBR coding loss is only 0.07%. In Low Delay B (LDB) mode, the total coding time is reduced by 18.64%, the total affine motion estimation time is reduced by 51.54%, and the BD-BR coding loss is only 0.22%.

References

[1]
M. Saldanha, "An Overview of Dedicated Hardware Designs for State-of-the-Art AV1 and H.266/VVC Video Codecs," 2020 27th IEEE International Conference on Electronics, Circuits and Systems (ICECS), 2020, pp. 1-4.
[2]
H. Meuel and J. Ostermann, "Analysis of Affine Motion-Compensated Prediction in Video Coding," in IEEE Transactions on Image Processing, vol. 29, pp. 7359-7374, 2020.
[3]
D. Jin, J. Lei, B. Peng, W. Li, N. Ling and Q. Huang, "Deep Affine Motion Compensation Network for Inter Prediction in VVC," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 6, pp. 3923-3933, June 2022.
[4]
H. Choi and I. V. Bajić, "Affine Transformation-Based Deep Frame Prediction," in IEEE Transactions on Image Processing, vol. 30, pp. 3321-3334, 2021.
[5]
Soltani Mohammadi, Iman & Ghanbari, Mohammed & Hashemi, Mahmoud. (2022). An Efficient Six-Parameter Perspective Motion Model for VVC. Journal of Visual Communication and Image Representation. 85. 103514. 10.1016/j.jvcir.2022.103514.
[6]
J. Cao, Z. Li, F. Liang and J. Wang, "An Intra-Affine Current Picture Referencing Mode for Screen Content Coding in VVC," 2019 Picture Coding Symposium (PCS), Ningbo, China, 2019, pp. 1-5.
[7]
S. -H. Park and J. -W. Kang, "Fast Affine Motion Estimation for Versatile Video Coding (VVC) Encoding," in IEEE Access, vol. 7, pp. 158075-158084, 2019.
[8]
Jung S, Jun D. Context-Based Inter Mode Decision Method for Fast Affine Prediction in Versatile Video Coding[J]. Electronics, 2021, 10(11): 1243.
[9]
Li X, He J, Li Q, An Adjacency Encoding Information-Based Fast Affine Motion Estimation Method for Versatile Video Coding[J]. Electronics, 2022, 11(21): 3429.
[10]
Ren W, He W, Cui Y . An Improved Fast Affine Motion Estimation Based on Edge Detection Algorithm for VVC[J]. Symmetry, 2020, 12(7):1143.
[11]
A. Duarte, "Fast Affine Motion Estimation for VVC using Machine-Learning-Based Early Search Termination," 2022 IEEE International Symposium on Circuits and Systems (ISCAS), Austin, TX, USA, 2022, pp. 1-5.
[12]
Bjontegaard G. Calculation of average PSNR differences between RD-curves[J]. ITU SG16 Doc. VCEG-M33, 2001.

Index Terms

  1. A Fast Affine Motion Estimation Algorithm Based on Motion Vector Difference

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICDIP '23: Proceedings of the 15th International Conference on Digital Image Processing
    May 2023
    711 pages
    ISBN:9798400708237
    DOI:10.1145/3604078
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Affine motion estimation
    2. Control point motion vector difference (CPMVD)
    3. Inter frame prediction
    4. Motion Vector Difference (MVD)
    5. SKIP type coding block
    6. VVC

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICDIP 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 54
      Total Downloads
    • Downloads (Last 12 months)26
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media