Mengmeng Zhang
ABSTRACT
In Versatile Video Coding (VVC), Affine Motion Estimation (AME) mode has been introduced for inter frame motion estimation, to improve the accuracy in predicting complex motion. Meanwhile, it brings high computational complexity in deciding AME mode. In this paper, a fast affine motion estimation algorithm based on Motion Vector Difference (MVD) is proposed to solve this problem. Through the statistical analysis, it is observed that there exists notable correlation between the MVD value of the current CU and the skipping affine mode. Therefore, one metric based on MVD of TME (Translational Motion Estimation) is defined to guide the decision of skipping affine mode, which is also used to help SKIP type coding block to skip affine mode, where SKIP type coding block means that its parent CU or neighboring CU is Skip mode in this algorithm. The other metric based on CPMVD (Control Point Motion Vector Difference) of four parameter affine model is defined to skip only six parameter affine mode. The experimental results show that compared with VTM10.0, the total time complexity of the proposed algorithm in Random Access (RA) mode is reduced by 9.77%, the total affine motion estimation time complexity is reduced by 40.65%, and the BDBR coding loss is only 0.07%. In Low Delay B (LDB) mode, the total coding time is reduced by 18.64%, the total affine motion estimation time is reduced by 51.54%, and the BD-BR coding loss is only 0.22%.
- M. Saldanha , "An Overview of Dedicated Hardware Designs for State-of-the-Art AV1 and H.266/VVC Video Codecs," 2020 27th IEEE International Conference on Electronics, Circuits and Systems (ICECS), 2020, pp. 1-4, doi: 10.1109/ICECS49266.2020.9294862.Google Scholar
Cross Ref
- H. Meuel and J. Ostermann, "Analysis of Affine Motion-Compensated Prediction in Video Coding," in IEEE Transactions on Image Processing, vol. 29, pp. 7359-7374, 2020, doi: 10.1109/TIP.2020.3001734.Google ScholarDigital Library
- D. Jin, J. Lei, B. Peng, W. Li, N. Ling and Q. Huang, "Deep Affine Motion Compensation Network for Inter Prediction in VVC," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 6, pp. 3923-3933, June 2022, doi: 10.1109/TCSVT.2021.3107135.Google ScholarCross Ref
- H. Choi and I. V. Bajić, "Affine Transformation-Based Deep Frame Prediction," in IEEE Transactions on Image Processing, vol. 30, pp. 3321-3334, 2021, doi: 10.1109/TIP.2021.3060803.Google ScholarDigital Library
- Soltani Mohammadi, Iman & Ghanbari, Mohammed & Hashemi, Mahmoud. (2022). An Efficient Six-Parameter Perspective Motion Model for VVC. Journal of Visual Communication and Image Representation. 85. 103514. 10.1016/j.jvcir.2022.103514.Google Scholar
- J. Cao, Z. Li, F. Liang and J. Wang, "An Intra-Affine Current Picture Referencing Mode for Screen Content Coding in VVC," 2019 Picture Coding Symposium (PCS), Ningbo, China, 2019, pp. 1-5, doi: 10.1109/PCS48520.2019.8954509.Google ScholarCross Ref
- S. -H. Park and J. -W. Kang, "Fast Affine Motion Estimation for Versatile Video Coding (VVC) Encoding," in IEEE Access, vol. 7, pp. 158075-158084, 2019, doi: 10.1109/ACCESS.2019.2950388.Google ScholarCross Ref
- Jung S, Jun D. Context-Based Inter Mode Decision Method for Fast Affine Prediction in Versatile Video Coding[J]. Electronics, 2021, 10(11): 1243.Google ScholarCross Ref
- Li X, He J, Li Q, An Adjacency Encoding Information-Based Fast Affine Motion Estimation Method for Versatile Video Coding[J]. Electronics, 2022, 11(21): 3429.Google ScholarCross Ref
- Ren W , He W , Cui Y . An Improved Fast Affine Motion Estimation Based on Edge Detection Algorithm for VVC[J]. Symmetry, 2020, 12(7):1143.Google ScholarCross Ref
- A. Duarte , "Fast Affine Motion Estimation for VVC using Machine-Learning-Based Early Search Termination," 2022 IEEE International Symposium on Circuits and Systems (ISCAS), Austin, TX, USA, 2022, pp. 1-5, doi: 10.1109/ISCAS48785.2022.9937973.Google ScholarCross Ref
- Bjontegaard G. Calculation of average PSNR differences between RD-curves[J]. ITU SG16 Doc. VCEG-M33, 2001.Google Scholar
Index Terms
- A Fast Affine Motion Estimation Algorithm Based on Motion Vector Difference
Recommendations
Encoding of Affine Motion Vectors
An affine motion model provides better motion representation than a translational motion model. Therefore, it is a good candidate for advanced video compression algorithms, requiring higher compression efficiency than current algorithms. One ...
Motion compensated frame interpolation by new block-based motion estimation algorithm
In this paper, a motion compensated frame interpolation (MCI) algorithm adapting new block-based motion estimation (BME), which is overlapped block-based motion estimation (OBME), is proposed for frame rate up-conversion (FRC). Unlike conventional BME ...
Affine Motion Prediction Based on Translational Motion Vectors
In all of the video coding standards like H.26X and MPEG-X, much of the compression comes from motion compensated prediction (MCP). Translational motion vectors (MVs) poorly model complex motion and thus coders using polynomial or affine MVs have been ...
Comments