Skip to main content
SpringerLink
Log in

Motion characteristic differentiated error concealment

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we propose a brand-new motion characteristic differentiated error concealment (MDEC) method based on motion field transfer. Firstly, the FMO checkerboard pattern is used at the encoder, so as to prevent MBs of a large area getting lost. Then at the decoder, Greedy Spread Motion Region Extraction (GSMRE) method is used to distinguish low-motion region from high-motion region in each frame based on different motion characteristic, and apply different strategies to recover regions with different characteristics respectively. Simulation results show that the proposed algorithm reconstructs the lost frame with both a better visual quality and a higher PSNR, comparing to error concealment methods including Joint Model, boundary matching, inpainting, and block motion vector extrapolation as well. For example, the PSNR gain of our approach over boundary matching algorithm reached about 0.6 dB, and 1.4 dB when the packet loss rate is 3 and 7%, respectively, which demonstrates that our method has an good application within a wide scope of packet loss rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Agrafiotis D, Bull DR, Canagarajah N (2006) Spatial error concealment with edge related perceptual considerations. Signal Process, Image Commun 21(2):130–142

    Article  Google Scholar 

  2. Belfiore S, Grangetto M, Magli E, Olmo G (2003) Spatio-temporal video error concealment with perceptually optimized mode selection. In: Proc. IEEE int. conf. acoust., speech and signal processing, vol 5, pp 750–753

  3. Bertalmio M, Bertozzi AL, Sapiro G (2001) Navier–Stokes, fluid dynamics, and image and video inpainting. In: Proc. conf. comp. vision pattern rec., vol I. Hawaii, pp 355–362

  4. Bolot JC (1993) Characterizing end-to-end packet delay and loss in the internet. J High-Speed Networks 2:305–323

    Google Scholar 

  5. Chen Y, Yu K, Li J, Li S (2004) An error concealment algorithm for entire frame loss in video transmission. In: Proceedings of the picture coding symposium. San Francisco, California, USA, pp 389–392

  6. Chen Y, Hu Y, Au O, Li H, Chen C (2008) Video error concealment using spatio-temporal boundary matching and partial differential equation. IEEE Trans Multimedia 10:2–15

    Article  Google Scholar 

  7. Criminisi A, Prez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200–1212

    Article  Google Scholar 

  8. Farnebäck G (2001) Very high accuracy velocity estimation using orientation tensors, parametric motion, and simultaneous segmentation of the motion field. In: Proc. international conference on computer vision, vol 1. Vancouver, Canada, pp 171–177

  9. Hsia S-C, Cheng S-C, Chou S-W (2005) Efficient adaptive error concealment technique for video decoding system. IEEE Trans Multimedia 7(5):860–868

    Article  Google Scholar 

  10. Huang Y-L, Lien H-Y (2005) An edge-based temporal error concealment for MPEG-coded video. In: Proc. soc. photo-optic. instrum. eng. vis. commun. image process., pp 992–1000

  11. Hwang M-C, Kim J-H, Duong DT, Ko S-J (2008) Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Trans Broadcast 54:198–207

    Article  Google Scholar 

  12. Joint Model (2011) The JVT reference software for H.264/AVC. http://iphome.hhi.de/suehring/tml/download

  13. Jung B, Jeon B, Kim M-D, Suh B, Choi S-I (2004) Selective temporal error concealment algorithm for H.264/AVC. In: Proc. IEEE international conference on image processing

  14. Kim W, Koo J, Jeong J (2006) Fine directional interpolation for spatial error concealment. IEEE Trans Consum Electron 54(3):1052–1058

    Google Scholar 

  15. Kim D, Jeong S, Choi J, Jeon G, Kim S, Jeong J (2008) Error concealment using intra-mode information included in H.264/AVC-coded bitstream. ETRI J 30(4):526–535

    Article  Google Scholar 

  16. Kim M, Lee H, Sull S (2008) Spatial error concealment for H.264 using sequential directional interpolation. IEEE Trans Consum Electron 56(4):1811–1818

    Article  Google Scholar 

  17. Lam WM, Reibman AR, LiuB (1993) Recovery of lost or erroneously received motion vectors. In: Proc. IEEE int. conf. acoust. speech signal process., pp 417–420

  18. Lee S, Pattichis MS, Bovik AC (2002) Foveated video quality assessment. IEEE Trans Multimedia 4:129–132

    Article  Google Scholar 

  19. Liu Y, Li ZG, Soh YC (2007) A novel rate control scheme for low delay video communication of H.264/AVC standard. IEEE Trans Circuits Syst Video Technol 17:68–78

    Article  Google Scholar 

  20. Liu M, Chen S, Liu J, Tang X (2009) Video completion via motion guided spatial-temporal global optimization. In: Proceedings of the ACM international conference on multimedia, pp 537–540. Beijing, China

  21. Luo Z, Song L, Zheng S, Xu Y, Yang X (2010) Improved error concealment of region of interest based on the H.264/AVC standard. Opt Eng 49:047003

    Article  Google Scholar 

  22. Ma M, Au OC, Chan SHG, Sun MT (2010) Edge-directed error concealment. IEEE Trans Circuits Syst Video Technol 20:382–395

    Article  Google Scholar 

  23. Open Computer Vision Library (OpenCV) (2011) http://sourceforge.net/projects/opencvlibrary/

  24. Peng Q, Yang T, Zhu C (2002) Block-based temporal error concealment for video packet using motion vector extrapolation. In: Proc. IEEE int. conf. communications, circuits and systems and West Sino expositions, vol 1, pp 10–14

  25. Ranjbar M, Kasaei S (2009) Spatial error concealment: a novel exemplar-based approach using segmentation. Comput Electr Eng 35:536–548

    Article  MATH  Google Scholar 

  26. Ronfu Z, Yuanhua Z, Xiaodong H (2004) Content-adaptive spatial error concealment for video communication. IEEE Trans Consum Electron 52(1):335–341

    Google Scholar 

  27. Shiratori T, Matsushita Y, Kang SB, Tang X (2006) Video completion by motion field transfer. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 411–418

  28. Su C-Y, Tsay S-H, Huang C-H (2006) Error concealment using direction-oriented candidate set and predicted boundary matching criteria. In: Proc. IEEE int. conf. image process., pp 2221–2224

  29. Telea A (2004) An image inpainting technique based on the fast marching method. J Graphics Tools 9(1):23–34

    Article  Google Scholar 

  30. Tourapis A, Shring K, Sullivan G (2007) H.264/MPEG-4 AVC reference software manual. In: 24th JVT meeting, Doc. JVT-X072, Geneva, Switzerland

  31. Venkatachalapathy K, Krishnamoorthy R, Viswanath K (2004) A new adaptive search strategy for fast block based motion estimation algorithms. J Vis Commun Image Represent 15:203–213

    Article  Google Scholar 

  32. Wang Y, Zhu QF (1998) Error control and concealment for video communication: a review. Proc IEEE 86:974–997

    Article  Google Scholar 

  33. Yan B, Gharavi H (2010) A hybrid frame concealment algorithm for H.264/AVC. IEEE Trans Image Process 19:98–107

    Article  MathSciNet  Google Scholar 

  34. Zeng W (2005) Adaptive spatial temporal error concealment with embedded side information. J Vis Commun Image Represent (Special Issue on Visual Communications in Ubiquitous Era) 16(4–5):499–511

    Article  Google Scholar 

  35. Zhang J, Arnold JF, Frater MR (2000) A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans Circuits Syst Video Technol 10:659–665

    Article  Google Scholar 

Download references

Acknowledgement

The research was supported by National 973 Program of China (Grant No. 2005CB321901).

Author information

Authors and Affiliations

  1. State Key Lab of Software Development Environment, New Main Building, BeiHang University, Beijing, Haidian, 100191, China

    Heng Li & YanChun Zhong

Authors
  1. Heng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. YanChun Zhong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Heng Li.

Appendix

Appendix

Fig. 13
figure 13

Visual results of applying different error concealment algorithms on “Foreman_CIF” for one slice loss (encoded with checkerboard pattern, 27th frame, QP = 28)

Full size image
Fig. 14
figure 14

RD curves of different EC algorithms, only first frame is INTRA-frame

Full size image

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, H., Zhong, Y. Motion characteristic differentiated error concealment. Multimed Tools Appl 65, 297–320 (2013). https://doi.org/10.1007/s11042-011-0811-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0811-4

Keywords

Search

Navigation