Abstract
We use particle filtering for correcting the erroneous motion vectors (MVs), which are derived from the boundary matching algorithm (BMA) in packet video communications. Assuming a two-state Markov channel model for transmission, the error of the extracted MVs by BMA is shown to be modeled by the Gaussian mixture distribution. Formulating the problem in the state space, we deploy particle filtering for denoising the erroneous MVs. The main challenge of using particle filters is high computational complexity that is directly related to the number of particles. The proposed particle filtering scheme is efficient even if the number of particles is decreased. Experimental results are provided to show the efficiency of this filtering approach compared to a recent scheme based on Kalman filtering. The experiments show meaningful increase in the quality of the recovered video sequences in terms of PSNR up to 3 dB compared with the other error concealment techniques. Also, the computational complexity of the proposed scheme is discussed.





Similar content being viewed by others
References
AlMuhit, A., Pickering, M.R., Frater, M.R., Arnold, J.F.: Video coding using elastic motion model and larger blocks. IEEE Trans. Circuits Syst. Video Technol. 20, 661–672 (2010)
Wang, Y., Wenger, S., Wen, J., Katsaggelos, A.K.: Error resilient video coding techniques. IEEE Signal Process. Mag. 17, 61–82 (2000)
Wah, B.W., Su, X., Lin, D.: A survey of error-concealment schemes for real-time audio and video transmissions over the internet. In: Proceedings International Symposium Multimedia Software Engineering, pp. 17–24 (2000)
Zhang, J., Arnold, J.F., Frater, M.R., Pickering, M.R.: Video error concealment using decoder motion vector estimation. In: Proceedings IEEE International Conference on Speech Image Technologies for Computing and Telecommunications, vol. 2, pp. 777–780 (1999)
Hrusovsky, B., Mochnac, J., Marchevsky, S.: Error concealment method based on motion vector prediction using particle filters. Radioengineering 20(3), 692–702 (2011)
Radmehr, A., Ghasemi, A.: A novel video error concealment technique using modified boundary matching algorithm with correlation function. In: 21st Iranian Conference on Electrical Engineering (ICEE) (2013)
Chen, Y., Hu, Y., Au, O.C., Li, H., Chen, C.W.: Video error concealment using spatio-temporal boundary matching and partial differential equation. IEEE Trans. Multimed. 10, 2–15 (2008)
Takahashi, S., Ogawa, T., Tanaka, H., Haseyama, M.: Kalman filter-based error concealment for video transmission. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 28, 779–787 (2009)
Lie, W.N., Gao, Z.W.: Video error concealment by integrating greedy suboptimization and Kalman filtering techniques. IEEE Trans. Circuits Syst. Video Technol. 16, 982–992 (2006)
Seiler, J., Kaup, A.: Reusing the H.264/AVC deblocking filter for efficient spatio-temporal prediction in video coding. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 1049–1052 (2011)
Zhang, Y., Xiang, X., Zhao, D., Ma, S., Gao, W.: Packet video error concealment with auto regressive model. IEEE Trans. Circuits Syst. Video Technol. 22, 12–27 (2012)
Gao, Z.W., Lie, W.N.: Video error concealment by using Kalman filtering technique. In: Proceedings IEEE International Symposium on Circuits and Systems, vol. 2, pp. 26–29 (2004)
Ghanbari, M.: Video Coding: An Introduction to Standard Codecs. IEE Press, London (1999)
Kitagawa, G.: Monte Carlo filter and smoother for non-Gaussian non-linear state space models. J. Comput. Graph. Stat. 5, 1–25 (1996)
Niemi, J., West, M.: Adaptive mixture modeling metropolis methods for Bayesian analysis of nonlinear state-space models. J. Comput. Graph. Stat. 19, 260–280 (2010)
Doucet, A., Godsill, S., Andrieu, C.: On sequential Monte Carlo sampling methods for Bayesian filtering. Stat. Comput. 10,197–208 (2000)
Doucet, A., de Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice (Statistics for Engineering and Information Science). Springer, Berlin (2001)
Lam, W.M., Reibman, A.R., Liu, B.: Recovery of lost or erroneously received motion vectors. In: Proceedings IEEE International Conference on Acoustics, Speech, Signal Processing, vol. 3, pp. 417–420 (1993)
Zhang, J., Arnold, J.F., Frater, M.R.: A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans. Circuits Syst. Video Technol. 10, 659–665 (2000)
Cui, S., Cui, H., Tang, K.: Error concealment via Kalman filter for heavily corrupted videos in H.264/AVC. Signal Process. Image Commun. 28, 430–440 (2013)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Radmehr, A., Ghasemi, A. Error concealment via particle filter by Gaussian mixture modeling of motion vectors for H.264/AVC. SIViP 10, 311–318 (2016). https://doi.org/10.1007/s11760-014-0743-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-014-0743-3