Skip to main content
SpringerLink
Log in

Fast MPEG-4 Motion Estimation: Processor Based and Flexible VLSI Implementations

  • Published:
Journal of VLSI signal processing systems for signal, image and video technology Aims and scope Submit manuscript

Abstract

MPEG-4 is a new multimedia standard combining interactivity, object-based natural and synthetic digital video, audio and computer-graphics. For the implementation of the video part of the MPEG-4 standard a high degree of flexibility is required, where the motion estimation requires the highest part of the computational power. Therefore, in this paper fast algorithms for MPEG-4 motion estimation are evaluated in terms of visual quality and computational power requirements for processor based implementations. Due to the object-based nature of MPEG-4 also new VLSI architectures for MPEG-4 motion estimation are required. Therefore known motion estimation architectures are evaluated on their capability of being modified for MPEG-4 support. Based on this evaluation a new dedicated, but flexible MPEG-4 motion estimation architecture targeted for low-power handheld applications is presented, which resulted to be advantageous to processor based implementations by magnitudes of order.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. ISO/IEC 14496-2 Information technology-generic coding of moving pictures and associated audio information, Part 2: Visual, 1999.

  2. J. Kneip, S. Bauer, J. Vollmer, B. Schmale, and P. Kuhn, "The MPEG-4 video coding standard-a VLSI point of view," IEEE Workshop on Signal Processing Systems (SiPS), Cambridge, MA, USA, Oct. 1998.

  3. ISO/IEC 11172-2, Information technology-coding of moving pictures and associated audio for digital storage media at up to 1.5 Mbit/s. Part 2: Video.

  4. ISO/IEC 13818-2 Information technology-generic coding of moving pictures and associated audio information. Part 2: Video.

  5. P. Kuhn, Algorithms, Complexity-Analysis and VLSI-Architectures for MPEG-4 Motion Estimation, Kluwer Academic Publishers, Boston/Dordrecht/London, June 1999.

    Book  MATH  Google Scholar 

  6. S. Dutta, W. Wolf, and A. Wolfe, "A methodology to evaluate memory architecture design tradeoffs for video signal processors," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 8, No. 1, pp. 36–53, Feb. 1998.

    Article  Google Scholar 

  7. P. Kuhn, "Instrumentation tools and methods for MPEG-4 VM: review and a new proposal," ISO/IEC JTC1/ SC29/WG11/ MPEG96/M0838, Firence, Italy, 1996.

  8. P. Kuhn, "Complexity analysis of the MPEG-4 video verification model encoder using profiling tools," ISO/IEC JTC1/ SC29/WG11 MPEG96/M0920, Tampere, Finland, 1996.

  9. P. Kuhn, "A portable instruction level profiler for complexity analysis-documentation," ISO/IEC JTC1/SC29/ WG11 MPEG96/M0921, Tampere, Finland, 1996.

  10. P. Kuhn, "A portable instruction level profiler for complexity analysis-software," ISO/IEC JTC1/SC29/WG11 MPEG96/ M1056, Tampere, Finland, 1996.

  11. P. Kuhn, "Complexity analysis of single video tools of the MPEG-4 verification model," ISO/IEC JTC1/SC29/WG11/ M3204, San Jose, USA, Jan. 1998.

  12. P. Kuhn, "A Complexity analysis tool: iprof (version 0.41)," ISO/IEC JTC1/SC29/WG11/M3551, Dublin, Ireland, July 1998.

  13. K. Itoh, K. Sasaki, and Y. Nakagome, "Trends in low-power RAM circuit technologies," Proceedings of the IEEE, Vol. 83, pp. 524–543, April 1995.

    Article  Google Scholar 

  14. H. Schmeck, Analyse von VLSI-Algorithmen, Spektrum-Verlag, Heidelberg, Berlin, Oxford, chap. 3, 1995 <nt>(in German)</nt>.

    MATH  Google Scholar 

  15. Zhong L. He and Ming L. Liou, "Design trade-offs for real-time block-matching motion estimation," Lecture Notes on Computer Science, Image Analysis and Processing, pp. 129–138, 1996.

  16. H.G. Musmann, P. Pirsch, and H.-J. Grallert, "Advances in picture coding," Proceedings of the IEEE, Vol. 73, No. 4, pp. 523–548, April 1985.

    Article  Google Scholar 

  17. B. Furht, J. Greenberg, and R.Westwater, Motion Estimation Algorithms for Video Compression, Kluwer Academic Publishers, Boston/Dordrecht/London, 1997.

    Book  Google Scholar 

  18. F. Dufaux and F. Moscheni, "Motion estimation techniques for digitalTV: a reviewand a newcontribution," Proc. IEEE, Vol. 83, No. 6, pp. 858–876, 1995.

    Article  Google Scholar 

  19. J.-R. Ohm, Digitale Bildcodierung: Repr¨asentation, Kompression und Ubertragung von Bildsignalen," Springer Verlag, 1995 <nt>(in German)</nt>.

  20. M.A. Tekalp, Digital Video Processing, Prentice Hall, 1995.

  21. J.L. Mitchell, W.B. Pennebaker, C.E. Fogg, and D.J. LeGall, MPEG Video Compression Standard, Chapter 13: Motion estimation, Chapman & Hall, pp. 283–311, 1997.

  22. P. Pirsch, N. Demassieux, and W. Gehrke, "VLSI architectures for video compression-a survey," Proceedings of the IEEE, Vol. 83, No. 2, pp. 220–246, Feb. 1995.

    Article  Google Scholar 

  23. P. Kuhn and W. Stechele, "Complexity analysis of the emerging MPEG-4 standard as a basis for VLSI implementation," Vol. SPIE 3309, Visual Communications and Image Processing, San Jose, pp. 498–509, Jan. 1998.

    Article  Google Scholar 

  24. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression, Englewood Cliffs, NJ: Prentice-Hall Elec. Eng. Series, 1971.

    Google Scholar 

  25. V. Bhaskaran and K. Konstantinides, Image and Video Compression Standards: Algorithms and Architectures, Kluwer Academic Publishers, 1995.

  26. B. Girod, "Rate constrained motion estimation,"SPIE Proc. Visual Communications and Image Processing, Vol. 2308, pp. 1026–1034, 1994.

    Article  Google Scholar 

  27. Lung-Kuo Liu, "Rate-constrained motion estimation algorithm for video coding," IEEE International Conference on Image Processing, ICIP 97, 1997.

  28. F. Kossentini, Y.-W. Lee, M.J.T. Smith, and R.K.Ward, "Predictive RD optimized motion estimation for very low bit-rate video coding," IEEE Journal on Selected Areas in Communications, Vol. 15, No. 9, Dec. 1997.

  29. P. Sriram and S. Sudharsanan, "Entropy constrained motion estimation: algorithm and implementation," SPIE 3311MHAMultimedia Hardware Architectures, San Jose, CA, pp. 99–107, 1998.

  30. G.J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Processing Magazine, pp. 74- 90, Nov. 1998.

  31. M.Z. Coban and R.M. Mersereau, "Computationally efficient exhaustive search algorithm for rate-constrained motion estimation," IEEE International Conference on Image Processing, ICIP 97, Santa Barbara, Oct. 1997.

  32. W.C. Chung, F. Kossentini, and M.J.T. Smith, "An efficient motion estimation technique based on a rate-distortion criterion," ICASSP 96, 1996.

  33. Zhongli He and Ming L. Liou, "A high performance fast search algorithm for block matching motion estimation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 5, pp. 826–828, Oct. 1997.

    Article  Google Scholar 

  34. G. Cote, M. Gallant, and F. Kossentini, "Efficient motion vector estimation and coding for H.263-based very low bit rate video compression," ITU-T SG 16, Q15-A-45, June 1997.

  35. K. Lengwehasatit, A. Ortega, A. Basso, and A. Reibmann, "A novel computationally scalable algorithm for motion estimation," SPIE 3309 VCIP Visual Communications and Image Processing, San Jose, CA, pp. 68–79, Jan. 1998.

  36. K.R. Rao and P. Yip, Discrete Cosine Transform-Algorithms, Advantages, Applications, Academic Press, Boston/San Diego/ New York/London/Sydney/Tokyo/Toronto, p. 242ff, 1990.

    MATH  Google Scholar 

  37. H. Gharavi and M. Mills, "Block-matching motion estimation algorithms-new results," IEEE Transactions on Circuits and Systems, Vol. 37, No. 5, pp. 649–651, May 1990.

    Article  Google Scholar 

  38. S. Kappagantula and K. Rao, "Motion compensated interframe image prediction," IEEE Trans. on Communications, Vol. 33, No. 9, pp. 1011–1015, Sept. 1985.

    Article  Google Scholar 

  39. Mei-Juan Chen, Liang-Gee Chen, Tzi-Dar Chiueh, and Yung-Pin Lee, "A new block-matching criterion for motion estimation and its implementation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 5, No. 3, pp. 231–236, June 1995.

    Article  Google Scholar 

  40. Yunju Baek, Hwang-Soek Oh, and Heung-Kyu Lee, "Blockmatching criterion for efficient VLSI implementation for motion estimation," IEE Electronics Letters, Vol. 32, No. 13, pp. 1184–1185, June 1996.

    Article  Google Scholar 

  41. S. Lee and S.-I. Chae, "Motion Estimation algorithm using low resolution quantisation," IEE Electronic Letters, Vol. 32, No. 7, pp. 647–648, March 1996.

    Article  MathSciNet  Google Scholar 

  42. J.R. Jain and A.K. Jain, "Displacement measurement and its application in interframe image coding," IEEE Transactions Commun., Vol. COM-29, pp. 1799–1808, Dec. 1981.

    Article  Google Scholar 

  43. R. Li, B. Zeng, and M.L. Liu, "Anewthree-step search algorithm for block motion estimation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 4, pp. 438–442, Aug. 1994.

    Article  Google Scholar 

  44. Lai-Man Po and Wing-chung Ma, "A novel four-step search algorithm for fast blockmatching," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 3, pp. 313–317, June 1996.

    Article  Google Scholar 

  45. R. Srinivasan and K.R. Rao, "Predictive coding based on effi-cient motion estimation," IEEE Transactions on Communications, Vol. COM-33, No. 8, pp. 888–896, Aug. 1985.

    Article  Google Scholar 

  46. A. Puri, H.M. Hang, and D.L. Schilling, "An efficient blockmatching algorithm for motion compensated coding," Proc. IEEE ICASSP, pp. 2.4.1.–25.4.4., 1987.

  47. Liang-Gee Chen, Wai-Ting Chen, Yeu-Shen Jehng, and Tzi-Dar Chiueh, "An efficient parallel motion estimation algorithm for digital image processing," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 1, No. 4, pp. 378–385, Dec. 1991.

    Article  Google Scholar 

  48. T. Koga, K. Iinuma, A. Hirano, Y. Ijima, and T. Ishiguro, "Motion compensated interframe coding for video conferencing," Proc. NTC 81, pp. C9.6.1–9.6.5.

  49. M. Bierling, "Displacement estimation by hierarchical blockmatching," SPIE, Vol. 1001, Visual Communications and Image Processing, pp. 942–951, May 1988.

    Google Scholar 

  50. Kwon Moon Nam, Joon-Seek Kim Rae-Hong Park, and Young Serk Shim, "A fast hierarchical motion vector estimation algorithm using mean pyramid," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 5, No. 4, pp. 344–351, Aug. 1995.

    Article  Google Scholar 

  51. Minhua Zhou, "A fast motion estimation algorithm for MPEG-2 video encoding," Vol. SPIE 3653, Visual Communications and Image Processing, San Jose, pp. 1487–1495, Jan. 1999.

    Google Scholar 

  52. B. Liu and A. Zaccarin, "New fast algorithms for the estimation of block motion vectors," IEEE Trans. on Circuits and Systems for Video Technology," Vol. 3, No. 2, pp. 148–157, April 1993.

    Article  Google Scholar 

  53. S. Kim, J. Chalidabhongse, and C.-C. JayKuo, "Anewstochastic block matching algorithm (SBMA) for video coding based on modified 3-step search," ICASSP 96, 1996.

  54. Y.-W. Lee, F. Kossentini, M.J.T. Smith, and R. Ward, "Prediction and search techniques for RD-optimized motion estimation in a very low bit rate video coding framework," ICASSP 97, pp. 2861ff, 1997.

  55. Jie-Bin Xu, Lai-Man Po, and Chok-Kwan Cheung, "A new prediction model search algorithm for fast block motion estimation," IEEE International Conference on Image Processing, ICIP 97, Santa Barbara, 1997.

  56. Joon-Seek Kim and Rae-Hong Park, "A fast feature-based block matching algorithm using integral projections," IEEE Journal on Selected Areas in Communications, Vol. 10, No. 5, pp. 968–971, June 1992.

    Article  Google Scholar 

  57. E. Ogura, Y. Ikenaga, Y. Iida. Y. Hosoya, M. Takashima, and K. Yamashita, "A cost effective motion estimation processor LSI using a simple and efficient algorithm," IEEE Transactions on Consumer Electronics, Vol. 41, No. 3, pp. 690–697, Aug. 1995.

    Article  Google Scholar 

  58. K. Sauer and B. Schwartz, "Efficient motion estimation using integral projections," Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 5, pp. 513–518, Oct. 1996.

    Article  Google Scholar 

  59. Sung Bum Pan, Seung Soo Chae, and Rae-Hong Park, "VLSI architectures for block matching algorithms using systolic arrays," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 1, pp. 67–73, Feb. 1996.

    Article  Google Scholar 

  60. M.M. Mizuki, U.Y. Desai, I. Masaki, and A. Chandrakasan, "A binary block matching architecture with reduced power consumptation and silicon area requirement," ICASSP 96, p. 3249ff, 1996.

  61. B. Natarajan, V. Bhaskaran, and K. Konstantinides, "Lowcomplexity block-based motion estimation via one-bit transforms," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 4, pp. 702–706, Aug. 1997.

    Article  Google Scholar 

  62. ISO/IEC JTC1/SC29/WG11/MPEG97/M2915, "Momusys implementation of the VM (VM8-971021)," Fribourg, Oct. 1997.

  63. P. Kuhn, iprof software available under GNU license terms for Sparc and x86-Linux, <nt>email: Peter.Kuhn@computer.org</nt>

  64. B. Girod, "Motion-compensating prediction with fractional pel accuracy," IEEE Transactions on Communications, Vol. 41, No. 4, pp. 604–612, April 1993.

    Article  Google Scholar 

  65. P. Kuhn, G. Diebel, S. Herrmann, A. Keil, H. Mooshofer, A. Karp, R. Mayer, and W. Stechele, "Complexity and PSNRcomparison of several fast motion estimation algorithms for MPEG-4," Vol. SPIE 3460, Applications of Digital Image Processing XXI, San Diego, pp. 486–499, July 1998.

    Article  Google Scholar 

  66. S.Y. Kung, VLSI Array Processors, Prentice Hall, Englewood Cliffs, 1988.

    Google Scholar 

  67. L. DeVos and M. Stegherr, "Paramaterizable VLSI architectures for the full-search block-matching algorithm," IEEE Trans. Circuits Syst., Vol. 36, pp. 1309–1316, Oct. 1989.

    Article  Google Scholar 

  68. T. Komarek and P. Pirsch, "Array architectures for blockmatching algorithms," IEEE Trans. Circuits and Systems, Vol. 36, No. 10, pp. 1301–1308, Oct. 1989.

    Article  Google Scholar 

  69. T. Komarek, "VLSI-Architekturen für Displacementschätzverfahren auf der Basis von Blockmatching-Algorithmenq," Dissertation, Hannover, 1993, VDI Verlag <nt>(in German)</nt>.

  70. L. de Vos, "Dedizierte VLSI-Architekturen für Block Matching Algorithmen," VDI-Verlag, Düsseldorf 1994, Reihe 10 Informatik/Kommunikationstechnik, Nr. 326 <nt>(dissertation, in German)</nt>.

    Google Scholar 

  71. L. de Vos and M. Schöbinger, "VLSI architecture for a flexible block matching processor," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 5, No. 5, pp. 417–428, Oct. 1995.

    Article  Google Scholar 

  72. Yeu-Shen Jehng, Liang-Gee Chen, and Tzi-Dar Chiueh, "An ef-ficient and simple VLSI Tree architecture for motion estimation algorithms," IEEE Transactions on Signal Processing, Vol. 41, No. 2, pp. 889–900, Feb. 1993.

    Article  Google Scholar 

  73. ITU-Telecommunication Standardization Sector-Study Group 16 Video Coding Experts Group: Video Codec Test Model Near Term Version 9.

  74. P. Kuhn, U. Niedermeier, L.-F. Chao, and W. Stechele, "A flexible low power VLSI architecture for MPEG-4 motion estimation," Vol. SPIE 3653, Visual Communications and Image Processing, San Jose, pp. 883–894, Jan. 1999.

    Google Scholar 

  75. Kun-Min Yang, Ming-Ting Sun, and Lancelot Wu, "A family of VLSI designs for the motion compensation block-matching algorithm," IEEE Transactions on Circuits and Systems, Vol. 36, No. 10, pp. 1317–1325, Oct. 1989.

    Article  Google Scholar 

  76. S. Dutta and W. Wolf, "A flexible parallel architecture adapted to block-matching motion-estimation algorithms," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 1, pp. 74–86, Feb. 1996.

    Article  Google Scholar 

  77. Sheu-Chih Cheng and Hsueh-Ming Hang, "A comparison of block-matching algorithms mapped to systolic-array implementation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 5, pp. 741–757, Oct. 1997.

    Article  Google Scholar 

  78. Internet: http://www.sun.com/microelectronics/products/ microproc.html

  79. U. Niedermeier, "Entwurf einer Multi-Mode Search Engine für MPEG-4," Diplomarbeit at the Technical University of Munich, Germany, Sept. 1998 <nt>(in German)</nt>.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Sony Corporation, Tokyo, Japan

    Peter M. Kuhn

Authors
  1. Peter M. Kuhn
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kuhn, P.M. Fast MPEG-4 Motion Estimation: Processor Based and Flexible VLSI Implementations. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 23, 67–92 (1999). https://doi.org/10.1023/A:1008192719838

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008192719838

Search

Navigation