Skip to main content

Advertisement

SpringerLink
Log in

A hybrid spatial error concealment using human face and image edge over H.264/AVC video sequences

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a human face and image edge-based hybrid spatial error concealment. Though human faces on video sequences are of most interest, the face error concealment is not yet easy in case of loss of face information. And furthermore, when there are bit errors in regular edge shapes in background, it affects more seriously to visual effect than irregular image characteristics. In order to overcome these challenges, the proposed algorithm, at first, classifies the lost block into foreground, boundary and background by using face detection, and then selects adaptively bilinear interpolation(BI) and horizontal symmetrical interpolation(HSI) for foreground, multi-direction filling interpolation(MDFI) for boundary and block division-based interpolation(BDI) for background. HSI, MDFI, Bezier curve-based block division of foreground and background and BDI of background are novel error concealments which are proposed in this paper. Our test reveals that the proposed error concealment can achieve a better PSNR compared with previous works including separate, adaptive or hybrid concealments, in terms of visual effect, PSNR and runtime, etc. The proposed algorithm may be utilized as an effective error resilient tool for real-time video applications, such as telephone conference, mobile telephone conference and wireless multimedia camera networks in which power consumption should be low.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Choe G, Nam C, Chu C (2018) An effective temporal error concealment in H.264 video sequences based on scene change detection-PCA model. Multimed Tools Appl. https://doi.org/10.1007/s11042-018-6184-1

  2. Chung K-L, Huang T-H, Liao P-H (2007) Efficient hybrid error concealment algorithm based on adaptive estimation scheme. J Vis Commun Image Represent 18:331–340

    Article  Google Scholar 

  3. El Khamy SE, Qabel IMA (2007) A new hybrid classification-based adaptive error concealment technique for image transmission through wireless communication channels. 24th National Radio Science Conference (NRSC 2007) March 13–15 c25, pp 1–9

  4. H.264 Software Coordination JM Software, ver. 15.0 January 2009. http://iphome.hhi.de/suehring/tml

  5. Hsia S-C (2004) An edge-oriented spatial interpolation for consecutive block error concealment. IEEE Trans Signal Process 11(6):577–580

    Article  Google Scholar 

  6. Hsia S-C, Hsiao CH (2016) Fast-efficient shape error concealment technique based on block classification. IET Image Process 10(10):693–700

    Article  Google Scholar 

  7. Kung WY, Kim CS, Kuo CC (2003) A spatial-domain error concealment method with edge recovery and selective directional interpolation. In: Proceedings of IEEE International Conference on Acoustics Speech and Signal Processing, vol 5, pp 700–703

  8. Lee Y-H, Lin C-H, Chen C-C, Lin S-Y, Huang B-S (2017) The video spatial error concealment algorithm using separately-directional interpolation technique. J Sign Process Syst 88:13–27

    Article  Google Scholar 

  9. Li X, Orchard MT (2000) New edge-directed interpolation. IEEE Trans Image Process 2:311–314

    Google Scholar 

  10. Li X, Orchard MT (2002) Novel sequential error concealment techniques using orientation adaptive interpolation. IEEE Trans Circuits Video Technol 2(10):857–864

    Google Scholar 

  11. Ma Y, Cai A (2004) A new spatial interpolation method for error concealment. IEEE sixth International symposium on Multimedia Software Engineering, pp 65–69

  12. Nam CM, Ruan QQ, An GY (2010) Color and heuristic-based face detection in H.264 video sequences. Signal Process 10:1288–1292

    Google Scholar 

  13. Nam C, Chu C et al (2020) A novel motion recovery using temporal and spatial correlation for a fast temporal error concealment over H.264 video sequences. Multimed Tools Appl. https://doi.org/10.1007/s11042-019-08176-x

  14. Ogbemhe J, Mpofu K, Tlale NS (2019) Continuous trajectory planning for welding of complex joint using Bezier curve. Procedia Manuf 33:685–692

    Article  Google Scholar 

  15. Peinado AM, Koloda J, Gómez ÁM, Sánchez V (2017) A statistical analysis of the kernel-based MMSE estimator with application to image reconstruction. Signal Process Image Commun 55:41–54. https://doi.org/10.1016/j.image.2017.03.015

    Article  Google Scholar 

  16. Rodrigues L, Borges L, Goncalves LMA (2002) Locally adaptive edge-preserving algorithm for image interpolation. XV Brazilian Symposium on computer Graphics and Image Processing, pp 7–10

  17. Rongfu Z, Yuanhua Z, Xiaodong H (2004) Content-adaptive spatial error concealment for video communication. IEEE Trans Consum Electron 50(1):335–341

    Article  Google Scholar 

  18. Suh JW, Ho YS (1997) Error concealment based on directional interpolation. IEEE Trans Consum Electron 43(3):295–302

    Article  Google Scholar 

  19. Wang Z, Yu YL, Zhang D (1998) Best neighborhood matching: an information loss restoration technique for block-based image coding system. IEEE Trans Image Process (S1057-7149) 7(7):1056–1061

    Article  Google Scholar 

  20. Xu YL, Zhou YH (2004) H.264 video communication based refined error concealment schemes. IEEE Trans Consum Electron 50(6):1135–1141

    Google Scholar 

  21. Agrafiotis D, Bull DR, Canagarajah N (2006) Spatial error concealment with edge related perceptual considerations. Signal Processing: Image Communication 21(2):130–142.

Download references

Author information

Authors and Affiliations

  1. Information and Communication Laboratory, School of Information Science, Kim Il Sung University, Pyongyang, Democratic People’s Republic of Korea

    Cholman Nam, Changgon Chu & Taeguk Kim

  2. Information and Artificial Intelligence Laboratory, School of Information Science, Kim Il Sung University, Pyongyang, Democratic People’s Republic of Korea

    Sun Ryu & Sungran Choe

  3. Visual Information Processing Laboratory, School of Information Science, Kim Il Sung University, Pyongyang, Democratic People’s Republic of Korea

    Jinhyok Choe

Authors
  1. Cholman Nam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sun Ryu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Changgon Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Taeguk Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sungran Choe
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jinhyok Choe
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cholman Nam.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nam, C., Ryu, S., Chu, C. et al. A hybrid spatial error concealment using human face and image edge over H.264/AVC video sequences. Multimed Tools Appl 82, 3769–3799 (2023). https://doi.org/10.1007/s11042-022-13408-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13408-8

Keywords

Search

Navigation