Abstract
Error concealment can recover the video frame which has been corrupted by packet loss over error-prone channel, however, speeding up of error concealment is very important for various real-time applications such as video conferencing, video chatting, etc. A fast spatial error concealment method using prediction mode of the neighboring blocks is presented in this paper. First, the weighting values of edge prediction direction for sixteen 4 × 4 neighboring blocks are calculated considering prediction mode of the opposite neighboring blocks. Second, the significant edges within a corrupted macroblock(MB) are estimated using the sixteen weighting values of edge prediction direction. Finally, the approximations for each corrupted pixel are calculated along each significant edge, then a weighted average of multiple approximations is computed considering prediction mode of the neighboring blocks. Experimental results show that the proposed algorithm speeds up multi-directional interpolation up to 1.17 times while sacrificing image quality for about 0.01 dB on avaerage compared with the previous method.
Similar content being viewed by others
Abbreviations
- AVC:
-
Advanced Video Coding
- BI:
-
Bilinear interpolation
- EC:
-
Error concealment
- MB:
-
macroblock
- MDI:
-
Multi-directional interpolation
- PSNR:
-
Peak signal-to-noise ratio
- QP:
-
quantization parameter
- SEC:
-
Spatial error concealment
- TEC:
-
temporal error concealment
References
Agrafiotis D, Bull DR, Canagarajah CN (2006) Enhanced error concealment with mode selection. IEEE Trans Circuits Syst Video Technol 16(8):960–973
Asheri H, Rabiee HR, Pourdamghani N, Ghanbari M (2012) Multi-Directional Spatial Error Concealment Using Adaptive Edge Thresholding. IEEE Trans Consum Electron 58(3):880–885
Byongsu H, Jonghyon J, Cholsu R (2019) An Improved Multi-directional Interpolation for Spatial Error Concealment. Multimed Tools Appl 78(2):2587–2598
Kwok W, Sun H (1993) Multi-directional interpolation for spatial error concealment. IEEE Trans Consum Electron 39(3):455–460
Lee Y-H, Lin C-H, Chen C-C, Lin S-Y, Huang B-S (2017) The video spatial error concealment algorithm using separately-directional interpolation technique. Journal of Signal Processing Systems 88:13–27
Li C et al (2016) An Adaptive Error Concealment Algorithm Based on Partition Model. Chinese Conference on Image and Graphics Technologies. Springer Singapore, pp. 35–43
Ma M, Au OC, Chan SHG et al (2010) Edge-directed error concealment. IEEE Trans Circuits Syst Video Technol 20(3):382–395
Nemethova O, Al-Moghrabi A, Rupp M (2005) Flexible Error Concealment for H.264 Based on Directional Interpolation. Proceedings of the WirelessCom Conference on Wireless Networks, Communications and Mobile Computing, June 13–16
Suh JW, Ho YS (1997) Error concealment based on directional interpolation. IEEE Trans Consum Electron 43(3):295–302
Wu G-L, Chen C-Y, Wu T-H, Chien S-Y (2010) Efficient spatial-temporal error concealment algorithm and hardware architecture Design for H.264/AVC. IEEE Trans Circuits Syst Video Technol 20(11):1409–1422
Xu Y, Yuanhua Z (2004) H.264 video communication based refined error concealment Schems. IEEE Trans Consum Electron 50(4):1135–1141
Ye S, Lin X, Sun Q (2003) Content Based Error Detection and Concealment for Image Transmission over Wireless Channel. IEEE Trans., pp.II-368-II-371
Ye-KuiWang M Hannuksela M, Varsa V et al (2002) The error concealment feature in the H.26L test model. IEEE International Conference on Image Processing, pp.729–732
Availability of data and materials
The conclusion and comparison data of this article are included within the article.
Author information
Authors and Affiliations
Contributions
PSH proposed the algorithms and drafted the manuscript. JHR performed the whole experiments and analysed the data. YHY reviewed and revised the paper. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Hwang, PS., Ri, JH. & Yun, YH. Method for speeding up spatial error concealment using prediction mode of the neighboring blocks on H.264 video communication. Multimed Tools Appl 82, 13733–13743 (2023). https://doi.org/10.1007/s11042-022-13950-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-13950-5