Skip to main content

Optimization of Spatial Error Concealment for H.264 Featuring Low Complexity

  • Conference paper
Book cover Advances in Multimedia Modeling (MMM 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4903))

Included in the following conference series:

  • 1622 Accesses

Abstract

Transmission of highly compressed video bitstreams can result in packet erasures when channel status is unfavorable. Spatial error concealment (SEC) techniques are very useful in the recovery of impaired video sequences, especially in the presence of scene changes, irregular motion, and appearance or disappearance of objects. As errors occur in the first frame, the corrupted MBs must be recovered by utilizing SEC schemes in order to prevent the propagation of errors to the succeeding inter-coded frames. We propose two SEC methods; one conceals the variances of the different kinds of damaged Macroblocks (MBs) targeted at any condition, and the other is speed-up which utilizes a H.264 coding tool, directional spatial intra prediction, in order to conceal the entire spectrum of damaged MBs targeted at intra-coded block(s). The experimental results show that when compared to other state of the art methods, our proposed SEC techniques significantly improve video quality up to 3.62 – 4.22 dB while reducing computational complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Salama, P., Shroff, N.B., Delp, E.J.: Error concealment in encoded video streams. In: Katsaggelos, A.K., Galatsanos, N.P. (eds.) Signal Recovery Techniques for Image and Video Compression and Transmission. ch. 7, Kluwer, Norwell, MA (1998)

    Google Scholar 

  2. Wang, Y.K., Hannuksela, M.M., Varsa, V., Hourunranta, A., Gabbouj, M.: The error concealment feature in the H.26L test model. In: ICIP, 2nd edn. Proc. Int. Conf. Image Processing, Rochester, New York, USA, pp. 729–732 (September 2002)

    Google Scholar 

  3. Meisinger, K., Kaup, A.: Spatial error concealment of corrupted image data using frequency selective extrapolation. In: ICASSP. Proc. Int. Conf. Acoust., Speech, Signal Process, pp. 209–212 (2004)

    Google Scholar 

  4. Wang, Y., Zhu, Q.F., Shaw, L.: Maximally smooth image recovery in transform coding. IEEE Trans. Commun. 41, 1544–1551 (1993)

    Article  MATH  Google Scholar 

  5. Zhu, Q.F., Wang, Y., Shaw, L.: Coding and cell loss recovery for DCT-based packet video. IEEE Trans. Circuits Syst. Video Technol. 3, 248–258 (1993)

    Article  Google Scholar 

  6. Zhu, W., Wang, Y.: A comparison of smoothness measures for error concealment in transform coding. In: Proc. SPIE Conf. Visual Communication and Image Processing, Taipei, Taiwan, vol. II, pp. 1205–1214 (1995)

    Google Scholar 

  7. Park, J.W., Kim, J.W., Lee, S.U.: DCT coefficients recovery-based error concealment technique and its application to MPEG-2 Bit stream error. IEEE Trans. Circuits and Systems for Video Technology 7, 845–854 (1997)

    Article  Google Scholar 

  8. Hemami, S., Meng, T.: Transform coded image reconstruction exploiting interblock correlation. IEEE Trans. Image Processing 4, 1023–1027 (1995)

    Article  Google Scholar 

  9. Alkachouh, Z., Bellangerh, M.G.: Fast DCT based spatial domain interpolation of blocks in images. IEEE Trans. Image Process. 9(4), 729–732 (2000)

    Article  Google Scholar 

  10. Li, X., Orchard, M.T.: Novel sequential error concealment techniques using orientation adaptive interpolation. IEEE Trans. Circuits Syst. Video Technol. 12(10), 857–864 (2002)

    Article  Google Scholar 

  11. Tsekeridou, S., Pitas, I.: MPEG-2 error concealment based on block matching principles. IEEE Trans. Circuits Syst. Video Technology 10(4), 646–658 (2000)

    Article  Google Scholar 

  12. Tsekeridou, S., Pitas, I., Le Buhan, C.: An error concealment scheme for MPEG-2 coded video sequences. In: Proc. 1997 Int. Symp. Circuits and Systems, vol. 2, pp. 1289–1292 (1997)

    Google Scholar 

  13. Lee, X., Zhang, Y., Leon-Garcia, A.: Information loss recovery for block-based image coding techniques—A fuzzy logic approach. IEEE Trans. Image Processing 4, 259–273 (1995)

    Article  Google Scholar 

  14. Sun, H., Kwok, W.: Concealment of damaged block transform coded images using projection onto convex set. IEEE Trans. Image Processing 4, 470–477 (1995)

    Article  Google Scholar 

  15. Jung, K., Chang, J., Lee, C.: Error concealment technique using projection data for block-based image coding. In: Proc. SPIE Conf. Visual Communication and Image Processing, vol. 2308, pp. 1466–1476 (1994)

    Google Scholar 

  16. Aign, S., Fazel, K.: Temporal and spatial error concealment techniques for hierarchical MPEG-2 video codec. In: Proc. ICC, vol. 3, pp. 1778–1783 (June 1995)

    Google Scholar 

  17. Bajic, I.V.: Adaptive MAP Error Concealment for Dispersively Packetized Wavelet-Coded Images. IEEE Trans. Image Process 15(5), 1226–1235 (2006)

    Article  Google Scholar 

  18. Suh, J.W., Ho, Y.S.: Error concealment based on directional interpolation. IEEE Trans. Consumer Electron 43, 295–302 (1997)

    Article  Google Scholar 

  19. Kwok, W., Sun, H.: Multi-directional interpolation for spatial error concealment. IEEE Trans. Consumer Electron 39(3), 455–460 (1993)

    Article  Google Scholar 

  20. Zeng, W., Liu, B.: Geometric-Structure-Based Error Concealment with Novel Applications in Block-Based Low-Bit-Rate Coding. IEEE Trans. on Circuits and Systems for Video Tech. 9(4), 648–665 (1999)

    Article  Google Scholar 

  21. Kung, W.Y., Kim, C.S., Kuo, C.: A spatial-domain error concealment method with edge recovery and selective directional interpolation. In: Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 5, pp. 6–10 (2003)

    Google Scholar 

  22. Chen, J., Liu, J., Wang, X., Chen, G.: Modified Edge-oriented Spatial Interpolation for Consecutive Blocks Error Concealment. In: ICIP. Proc. of IEEE International Conference, Image Processing, pp. 11–14 (September 2005)

    Google Scholar 

  23. Zhao, Y., Tian, D., Hannukasela, M.M., Gabbouj, M.: Spatial error concealment based on directional decision and intra prediction. In: Proc. ISCAS, pp. 2899–2902 (2005)

    Google Scholar 

  24. Xu, Y., Zhou, Y.: H.264 video communication based refined error concealment schemes. IEEE Trans. Consum. Electron. 50(4), 1135–1141 (2004)

    Article  Google Scholar 

  25. Rongfu, Z., Yuanhua, Z., Xiaodong, H.: Content-adaptive spatial error concealment for video communication. IEEE Trans. Consum. Electron. 50(1), 335–341 (2004)

    Article  Google Scholar 

  26. Wang, Z., Yu, Y., Zhang, D.: Best neighborhood matching: An information loss restoration technique for block-based image coding systems. IEEE Trans. Image Process. 7(7), 1056–1061 (1998)

    Article  Google Scholar 

  27. Agrafiotis, D., Bull, D.R., Canagarajah, C.N.: Enhanced Error Concealment With Mode Selection. IEEE Trans. Circuits Syst. Video Technology 16(8), 960–973 (2006)

    Article  Google Scholar 

  28. Chen, W.L., Leou, J.J.: A New Hybrid Error Concealment Scheme for H.264 Video Transmission. In: Proc. Int. Conf on Communications and mobile computing, Vancouver, Canada (July 2006)

    Google Scholar 

  29. Varsa, V., Hannuksela, M.M., Wang, Y.K.: Nonnormative error concealment algorithms. ITU-T SG16 Doc, VCEGN62, Santa Barbara, CA, USA (September 2001)

    Google Scholar 

  30. Davies, E.R.: Machine Vision. Academic Press Inc., San Diego (1990)

    Google Scholar 

  31. Kang, L.W., Leou, J.J.: A hybrid error concealment scheme for MPEG-2 video transmission based on best neighborhood matching algorithm. J. Vis. Commun. Image Represent 16(3), 288–310 (2005)

    Article  Google Scholar 

  32. Ong, E., Lin, W., Lu, Z., Yao, S., Etoh, M.: Visual distortion assessment with emphasis on spatially transitional regions. IEEE Trans. Circuits Syst. Video Technol. 14(4), 559–566 (2004)

    Article  Google Scholar 

  33. Ran, X., Farvardin, N.: A perceptually motivated three component image model—Part I: description of the model. IEEE Trans. Image Process., 401–415 (April 1995)

    Google Scholar 

  34. Shannon, C.E.: A Mathematical Theory of Communication. Bell Sys. Tech. J. 27, 379–423, 623–656 (1948)

    Google Scholar 

  35. Huang, Y.-W., Hsieh, B.-Y., Chen, T.-C., Chen, L.-G.: Analysis, fast algorithm, and VLSI architecture design for H.264/AVC intra frame coder. IEEE Trans. Circuits Syst. Video Technol. 15, 378–401 (2005)

    Article  Google Scholar 

  36. H.264/AVC Reference Software JM, Available: http://bs.hhi.de/~suehring/tml/

  37. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, Working draft number 2, revision 2 (WD-2), Joint Video Team (JVT) (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Shin’ichi Satoh Frank Nack Minoru Etoh

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Huang, SC., Kuo, SY. (2008). Optimization of Spatial Error Concealment for H.264 Featuring Low Complexity. In: Satoh, S., Nack, F., Etoh, M. (eds) Advances in Multimedia Modeling. MMM 2008. Lecture Notes in Computer Science, vol 4903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77409-9_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-77409-9_37

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-77407-5

  • Online ISBN: 978-3-540-77409-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics