Skip to main content
SpringerLink
Log in

Motion-compensated temporal filtering with optimized motion estimation

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

The lifting-based discrete wavelet transforms applied temporally along the motion trajectory is a powerful tool in scalable video compression. The longer filter is used for motion-compensated temporal filtering (MCTF) for better de-correlation. The bidirectional motion estimation (ME) used for MCTF is the major speed bottleneck. This paper propose two stages motion predictive technique to optimize the ME. In the first stage, zero motion block prediction is carried out using the content of high frequency frame, obtained after TF without motion compensation. In the second stage, the inter-frame and inter-layer prediction technique is applied to skip the coarse search of any fast ME, except for the first pair of frames in a group of pictures. The proposed algorithm is implemented in MC-EZBC. The variations observed in objective or subjective quality of the decoded video is negligible compared to the speed gained.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Schwarz, H., Marpe, D., Wiegand, T.: Overview of scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1103–1120 (2007)

    Article  Google Scholar 

  2. Taubman, D.: Successive refinement of video: fundamental issues, past efforts and new directions. In: International Symposium on Visual Communications and Image Processing (VCIP2003), SPIE, vol. 5150, pp. 791–805

  3. Mehrseresht, N., Taubman, D.: An efficient content-adaptive motion compensated 3-D DWT with enhanced spatial and temporal Scalability. IEEE Trans Image Process. 15(6), 1397–1412 (2006)

    Article  Google Scholar 

  4. Andreopoulis, Y., Munteanu, A., Barbarien, J., Schaar, M. van der: In-band motion compensated temporal filtering. Signal Process. Image Commun. 19(7), 653–673 (2004)

  5. Zgaljic, T., Sprljan, N., Izquierdo, E.: Bit-stream allocation methods for scalable video coding supporting wireless communications. Signal Process. Image Commun. 22, 298–316 (2007)

    Article  Google Scholar 

  6. Girod, B.: The efficiency of motion-compensating prediction for hybrid coding of video sequences. IEEE J. Sel. Areas Commun. 5, 1140–1154 (1987)

    Article  Google Scholar 

  7. Jain, J., Jain, A.: Displacement measurement and its application in inter frame image coding. IEEE Trans. Commun. 29, 1799–1808 (1981)

    Article  Google Scholar 

  8. Li, R., Zeng, B., Liou, M.L.: A new three-step search algorithm for block motion estimation IEEE Trans. Circuits Syst. Video Technol. 4, 438–442 (1994)

    Article  Google Scholar 

  9. Po, L.M., Ma, W.C.: A novel four step search algorithm for fast block motion estimation. IEEE Trans. Circuits Syst. Video Technol. 6, 313–317 (1996)

    Article  Google Scholar 

  10. Zhu, S., Ma, K.K.: A new diamond search algorithm for fast block matching motion estimation. IEEE Trans. Image Process. 9, 287–290 (2000)

    Article  Google Scholar 

  11. Koga, T., Linuma, K.: Motion compensated inter-frame coding for video conferencing. In: Proceedings of National Telecommunication Conference (NTC), pp. G5.3.1–G5.3.5 (1981)

  12. Zhu, C., Lin, X., Chau, L.-P.: Hexagon-based search pattern for fast block motion estimation. IEEE Trans. Circuit Syst. Video Technol. 12, 349–355 (2002)

    Article  Google Scholar 

  13. Secker, A., Taubman, D.: Lifting-based invertible motion adaptive transform (LIMAT) frame work for highly scalable video compression. IEEE Trans. Image Process. 12(12), 1530–1542 (2004)

    Article  Google Scholar 

  14. Ohm, J.R.: Multimedia Communication Technology: Representation, Transmission and Identification of Multimedia Signals. Springer, Berlin (2004)

  15. Cheung, C.-H., Po, L.-M.: A novel cross-diamond search algorithm for fast block motion estimation. IEEE Trans. Circuits Syst. Video Technol. 12(12), 1168–1177 (2002)

    Article  Google Scholar 

  16. Chen, P., Woods, J.W.: Bi-directional MC-EZBC with lifting implementation. IEEE Trans. Circuits Syst. Video Technol. 14(10), 1183–1194 (2004)

    Article  Google Scholar 

Download references

Acknowledgments

Authors are thankful to Dr. John W. Woods, Professor and Director Center for Next Generation Video, Department of Electrical, Computer and Systems Engineering, of Rensselaer Polytechnic Institute, for providing MC-EZBC for academic usage.

Author information

Authors and Affiliations

  1. Department of Information and Communication Technology, Manipal Institute of Technology, Manipal, 576 104, India

    A. K. Karunakar & M. M. Manohara Pai

Authors
  1. A. K. Karunakar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. M. Manohara Pai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. K. Karunakar.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Karunakar, A.K., Pai, M.M.M. Motion-compensated temporal filtering with optimized motion estimation. J Real-Time Image Proc 4, 329–338 (2009). https://doi.org/10.1007/s11554-009-0129-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-009-0129-x

Keywords

Search

Navigation