Skip to main content
SpringerLink
Log in

Dynamically Adaptive Fast Motion Estimation Algorithm for HD Video

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

This paper presents a novel adaptive Fast Motion Estimation (FME) Algorithm, which reduces the number of search points, computational complexity and therefore lowering power consumption, while providing improved quality per watt in FME. The algorithm minimizes computation and storage and from there, power consumption, while trying to preserve quality as much as possible. It is very suitable for hardware implementation, as in a motion co-processor. The pervasiveness of mobile devices with HD video capabilities demands such low power hardware accelerators. The proposed algorithm is a novel method, that can identify the best search pattern within a given region of the HD video frame, based on its motion dynamics to achieve lower power video encoding. The goal is to achieve the best quality with the minimum number of search iterations. The reduced number of checks translates into power savings. The motivation of the presented algorithm is to learn the motion dynamics within a region from a small subset of blocks within that region and apply that knowledge to the remaining large set of blocks in the same region. This adaptiveness makes it robust with respect to the nature of the video. Thus it works equally well with more dynamic and with less dynamic video sequences. The results show that the proposed algorithm can reduce computations by about 4 times compared to other fixed search patterns algorithms, while staying within 1 dB of PSNR results. That equates to about 75% power savings at the expense of not more than 1 dB of PSNR quality loss.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25

Similar content being viewed by others

References

  1. Wiegand, T., Sullivan, G. J., Bjøntegaard, G., & Luthra, A. (2003). Overview of the H.264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology, 13(7), 560–576.

    Article  Google Scholar 

  2. Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012). Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on Circuits and Systems for Video Technology, 22(12), 1648–1667.

    Article  Google Scholar 

  3. Arnaudov, P., & Arnaudov, T. (2020). Artificially intelligent adaptive search fast motion estimation algorithm for HD video. Journal of Signal Processing Systems, 92(4), 389–408. https://doi.org/10.1007/s11265-019-01466-5.

    Article  Google Scholar 

  4. Li, R., Zeng, B., & Liou, M. L. (1994). A new three-step search algorithm for block motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 4(4), 438–482.

    Article  Google Scholar 

  5. Jing, X., & Chau, L.-P. (2004). An efficient three-step search algorithm for block motion estimation. IEEE Transactions on Multimedia, 6(3), 435–438.

    Article  Google Scholar 

  6. Po, L.-M., & Ma, W.-C. (1996). A novel four-step search algorithm for fast block motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 6(3), 313–317.

    Article  Google Scholar 

  7. Ndili, O. & Ogunfunmi, T. (2010). “Hardware-oriented modified diamond search for motion estimation in H.264/AVC,” in Proc. IEEE ICIP, pp. 749–752.

  8. Ndili, O., & Ogunfunmi, T. (2011). Algorithm and architecture co-Design of Hardware-Oreinted Modified Diamond Search for fast motion estimation in H.264/AVC. IEEE Transactions on Circuits and Systems for Video Technology, 21(9), 1214–1227.

    Article  Google Scholar 

  9. Tham, J. Y., Ranganath, S., Ranganath, M., & Kassim, A. A. (1998). A novel unrestricted center-biased diamond search algorithm for block motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 8(4), 369–377.

    Article  Google Scholar 

  10. Zhu, S., & Ma, K. K. (2000). A new diamond search algorithm for fast block-matching motion estimation. IEEE Trans. Image Processing, 9, 287–290.

    Article  Google Scholar 

  11. Cheung, C. H., & Po, L. M. (2005). Novel cross-diamond-hexagonal search algorithm for fast block motion estimation. IEEE Transactions on Multimedia, 7(1), 16–22.

    Article  Google Scholar 

  12. Zhu, S., & Ma, K.-K. (2000). A new diamond search algorithm for fast-block matching motion estimation. IEEE Transactions on Image Processing, 9(2), 287–290.

    Article  Google Scholar 

  13. Ndili, O. & Ogunfunmi, T. (2008). “A hardware oriented integer pel fast motion estimation algorithm in H.264/AVC,” in Proc. IEEE Conf. DASIP, Nov, pp. 314–320.

  14. Ndili, O., & Ogunfunmi, T. (2009). FPSoC-based architecture for a fast motion estimation algorithm in H.264/AVC. EURASIP Journal on Embedded Systems, 2009(893897), 1–16.

    Google Scholar 

  15. Parmar, N., Sunwoo, M. H (2014). “Enhanced test zone search motion estimation algorithm for HEVC”, Proc. IEEE Int. SoC Des. Conf., pp. 260–261, Nov. 3–6

  16. Jeong, J. H., Parmar, N., Sunwoo, M. H. (2015). “Enhanced test zone search algorithm with rotating pentagon search”, Proc. IEEE Int. SoC Des. Conf., pp. 275–276, Nov. 2–5

  17. Al-Najdawi, N., Al-Najdawi, M. N., & Tedmori, S. (2014). Employing a novel crossdiamond search in a modified hierarchical search motion estimation algorithm for video compression. Information Sciences, 268, 425–435 new Sensing and Processing Technologies for Hand-based Biometrics Authentication. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0020025513005690.

    Article  Google Scholar 

  18. Yu-Shin Cheng, Zhing-Yi Chen, Pao-Chi Chang (2009). “An H.264 spatio-temporal hierarchical fast motion estimation algorithm for high definition video,” IEEE International Symposium on Circuits and Systems, pp. 880–883.

  19. Hosur, P.I. & Ma, K.K. n.d.. “Motion vector field adaptive fast motion estimation,” second international conference on information, communications and signal processing (ICICS ‘99), Singapore, 7–10 Dec’99.

  20. Xudong Song, Tihao Chiang & Ya-Qin Zhang (1998). “A scalable hierarchical motion estimation algorithm for MPEG-2,” Circuits and Systems, 1998. ISCAS ‘98. Proceedings of the 1998 IEEE International Symposium on, Monterey, CA, pp. 126–129 vol.4.

  21. Tourapis, A. M., Au, O. C., & Liou, M. L. (n.d.). Highly efficient predictive zonal algorithms for fast block-matching motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 12(10), 934–947.

  22. Tourapis, H. Y. C. & Tourapis, A. M. (2003). “Fast motion estimation within the H.264 codec,” Multimedia and Expo, 2003. ICME ‘03. Proceedings. 2003 IEEE International Conference on, pp. III-517-20 vol.3.

  23. Arnaudov, P. & Ogunfunmi, T. (2017). “Adaptive search pattern for fast motion estimation in HD video” in 51st Asilomar Conference on Signals, Systems and Computers, pp. 173–177.

  24. Arnaudov, P. & Ogunfunmi, T. (2017), “Low power HD video fast motion estimation algorithm based on signatures” in 10th Intern. Conf. on Ubi-media computing and Workshops, pp. 1–6.

  25. Arnaudov, P. & Ogunfunmi, T. (2017), “A CAM enabled fast video motion estimation based on locality”, IEEE ISCAS Conf., pp. 1–4.

  26. P. Arnaudov & T. Ogunfunmi “An Enhanced fractional Motion Estimation algorithm for HD video” IEEE ICCE’17, pp.221–2.

  27. Arnaudov, P. & Ogunfunmi, T. (2016). “Architecture and Implementation of a Simplified Locality Sensitive Hashed Signatures ” IEEE Intern. Workshop on SiPS, pp. 11–16.

  28. Xipg.org Video Test Media [derf’s collection]. https://media.xiph.org/video/derf/ (HD Content and above) n.d.

  29. Nam, K. M., Kim, J.-S., Park, R.-H., & Shim, Y. S. (1995). A fast hierarchical motion vector estimation algorithm using mean pyramid. IEEE Transactions on Circuits and Systems for Video Technology, 5(4), 344–351.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Santa Clara University, 500 El Camino Real, Santa Clara, CA, 95053, USA

    Pavel Arnaudov & Tokunbo Ogunfunmi

Authors
  1. Pavel Arnaudov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tokunbo Ogunfunmi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Pavel Arnaudov or Tokunbo Ogunfunmi.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Featured Application: Video Compression: Applicable to both HEVC and H.264 video standards.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Arnaudov, P., Ogunfunmi, T. Dynamically Adaptive Fast Motion Estimation Algorithm for HD Video. J Sign Process Syst 92, 1115–1131 (2020). https://doi.org/10.1007/s11265-020-01574-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-020-01574-7

Keywords

Search

Navigation