Skip to main content
SpringerLink
Log in

Error concealment via particle filter by Gaussian mixture modeling of motion vectors for H.264/AVC

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

We use particle filtering for correcting the erroneous motion vectors (MVs), which are derived from the boundary matching algorithm (BMA) in packet video communications. Assuming a two-state Markov channel model for transmission, the error of the extracted MVs by BMA is shown to be modeled by the Gaussian mixture distribution. Formulating the problem in the state space, we deploy particle filtering for denoising the erroneous MVs. The main challenge of using particle filters is high computational complexity that is directly related to the number of particles. The proposed particle filtering scheme is efficient even if the number of particles is decreased. Experimental results are provided to show the efficiency of this filtering approach compared to a recent scheme based on Kalman filtering. The experiments show meaningful increase in the quality of the recovered video sequences in terms of PSNR up to 3 dB compared with the other error concealment techniques. Also, the computational complexity of the proposed scheme is discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. AlMuhit, A., Pickering, M.R., Frater, M.R., Arnold, J.F.: Video coding using elastic motion model and larger blocks. IEEE Trans. Circuits Syst. Video Technol. 20, 661–672 (2010)

    Article  Google Scholar 

  2. Wang, Y., Wenger, S., Wen, J., Katsaggelos, A.K.: Error resilient video coding techniques. IEEE Signal Process. Mag. 17, 61–82 (2000)

    Article  Google Scholar 

  3. Wah, B.W., Su, X., Lin, D.: A survey of error-concealment schemes for real-time audio and video transmissions over the internet. In: Proceedings International Symposium Multimedia Software Engineering, pp. 17–24 (2000)

  4. Zhang, J., Arnold, J.F., Frater, M.R., Pickering, M.R.: Video error concealment using decoder motion vector estimation. In: Proceedings IEEE International Conference on Speech Image Technologies for Computing and Telecommunications, vol. 2, pp. 777–780 (1999)

  5. Hrusovsky, B., Mochnac, J., Marchevsky, S.: Error concealment method based on motion vector prediction using particle filters. Radioengineering 20(3), 692–702 (2011)

    Google Scholar 

  6. Radmehr, A., Ghasemi, A.: A novel video error concealment technique using modified boundary matching algorithm with correlation function. In: 21st Iranian Conference on Electrical Engineering (ICEE) (2013)

  7. Chen, Y., Hu, Y., Au, O.C., Li, H., Chen, C.W.: Video error concealment using spatio-temporal boundary matching and partial differential equation. IEEE Trans. Multimed. 10, 2–15 (2008)

  8. Takahashi, S., Ogawa, T., Tanaka, H., Haseyama, M.: Kalman filter-based error concealment for video transmission. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 28, 779–787 (2009)

    Article  Google Scholar 

  9. Lie, W.N., Gao, Z.W.: Video error concealment by integrating greedy suboptimization and Kalman filtering techniques. IEEE Trans. Circuits Syst. Video Technol. 16, 982–992 (2006)

  10. Seiler, J., Kaup, A.: Reusing the H.264/AVC deblocking filter for efficient spatio-temporal prediction in video coding. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 1049–1052 (2011)

  11. Zhang, Y., Xiang, X., Zhao, D., Ma, S., Gao, W.: Packet video error concealment with auto regressive model. IEEE Trans. Circuits Syst. Video Technol. 22, 12–27 (2012)

    Article  Google Scholar 

  12. Gao, Z.W., Lie, W.N.: Video error concealment by using Kalman filtering technique. In: Proceedings IEEE International Symposium on Circuits and Systems, vol. 2, pp. 26–29 (2004)

  13. Ghanbari, M.: Video Coding: An Introduction to Standard Codecs. IEE Press, London (1999)

    Google Scholar 

  14. Kitagawa, G.: Monte Carlo filter and smoother for non-Gaussian non-linear state space models. J. Comput. Graph. Stat. 5, 1–25 (1996)

    MathSciNet  Google Scholar 

  15. Niemi, J., West, M.: Adaptive mixture modeling metropolis methods for Bayesian analysis of nonlinear state-space models. J. Comput. Graph. Stat. 19, 260–280 (2010)

    Article  MathSciNet  Google Scholar 

  16. Doucet, A., Godsill, S., Andrieu, C.: On sequential Monte Carlo sampling methods for Bayesian filtering. Stat. Comput. 10,197–208 (2000)

  17. Doucet, A., de Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice (Statistics for Engineering and Information Science). Springer, Berlin (2001)

    Book  Google Scholar 

  18. Lam, W.M., Reibman, A.R., Liu, B.: Recovery of lost or erroneously received motion vectors. In: Proceedings IEEE International Conference on Acoustics, Speech, Signal Processing, vol. 3, pp. 417–420 (1993)

  19. Zhang, J., Arnold, J.F., Frater, M.R.: A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans. Circuits Syst. Video Technol. 10, 659–665 (2000)

    Article  Google Scholar 

  20. Cui, S., Cui, H., Tang, K.: Error concealment via Kalman filter for heavily corrupted videos in H.264/AVC. Signal Process. Image Commun. 28, 430–440 (2013)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Electrical and Computer Engineering, K. N. Toosi University of Technology, Tehran, Iran

    Ali Radmehr & Abdorasoul Ghasemi

Authors
  1. Ali Radmehr
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdorasoul Ghasemi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abdorasoul Ghasemi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Radmehr, A., Ghasemi, A. Error concealment via particle filter by Gaussian mixture modeling of motion vectors for H.264/AVC. SIViP 10, 311–318 (2016). https://doi.org/10.1007/s11760-014-0743-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-014-0743-3

Keywords

Search

Navigation