Skip to main content
SpringerLink
Log in

A novel error detection & concealment technique for videos streamed over error prone channels

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In video streaming services and applications, impulse noise occurs due to transmission errors or sometimes it is introduced during signal acquisition. The work presented in this paper proposes a novel impulse noise detection and mitigation (INDAM) method that can significantly recover video frames heavily impaired by impulse noise. The proposed technique uses cyclic redundancy check (CRC) method to create an error mask of the received impaired video frames. This error mask contains pixel-by-pixel error information of the video frames and is exploited further to mitigate the error from the impaired video frame. Each impaired pixel in the video frame is replaced by the average of its corresponding error-free neighboring pixels’ values, hence removing the impaired pixels and replacing them with the newly calculated average. The proposed technique uses the error mask created from the CRC method and uses only those pixels which do not contain error for calculating the averages. Results show that INDAM outperforms other contemporary methods in terms of peak signal to noise ratio (PSNR) and structural similarity index metric (SSIM).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Abreu E, Lightstone M, Mitra SK, Arakawa K (1996) A new efficient approach for the removal of impulse noise from highly corrupted images. IEEE Trans Image Process 5(6):1012–1025

    Article  Google Scholar 

  2. Aiswarya K, Jayaraj V, Ebenezer D (2010) A new and efficient algorithm for the removal of high density salt and pepper noise in images and videos,” in Second Int. Conf. Computer Modeling and Simulation, pp. 409–413

  3. Boyce JM, Stein AJ Video error detection technique using a CRC parity code, US9204167B2, US patent

  4. Chen T, Wu HR (2001) Adaptive impulse detection using center-weighted median filters. IEEE Signal Process. Lett. 8(1):1–3

    Article  Google Scholar 

  5. Esakkirajan S et al (2011) Removal of high density salt and pepper noise through modified decision based unsymmetric trimmed median filter. IEEE Signal processing letters 18(5):287–290

    Article  Google Scholar 

  6. Hwang H, Haddad RA (1995) Adaptive median filters: new algorithms and results. IEEE Trans Signal Process 4(4):499–502

    Google Scholar 

  7. Ko SJ, Lee YH (1991) Center weighted median filters and their applications to image enhancement. IEEE Trans Circuits Syst 38(9):984–993

    Article  Google Scholar 

  8. Lin H, Willson AN (1988) Median filter with adaptive length. IEEE Trans. Circuits Syst. 35(6):675–690

    Article  MathSciNet  Google Scholar 

  9. Liu, Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2Activity: recognizing complex activities from sensor data. In IJCAI (Vol. 2015, pp. 1617–1623)

  10. Liu Y, Zhang L, Nie L, Yan Y, Rosenblum DS (2016) Fortune Teller: Predicting Your Career Path. In AAAI (Vol. 2016, pp. 201–207)

  11. Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115

    Article  Google Scholar 

  12. Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. In AAAI 30:1266–1272

    Google Scholar 

  13. Moorthy AK, Choi LK, Bovik AC, de Veciana G (Oct. 2012) Video quality assessment on mobile devices: subjective, behavioral and objective studies. IEEE J Sel Topics Signal Process 6(6):652–671

    Article  Google Scholar 

  14. Pyun JY (2008) Error concealment aware streaming video system over packet-based mobile networks. IEEE Trans Consum Electron 54(4):1705–1713

    Article  Google Scholar 

  15. Sobolewski JS (2003) Cyclic redundancy check, pp: 476–479

  16. Srinivasan KS, Ebenezer D (2007) A new fast and efficient decision based algorithm for removal of high density impulse noise. IEEE Signal Process Lett 14(3):189–192

    Article  Google Scholar 

  17. Sun T, Neuvo Y (1994) Detail-preserving median based filters in image processing. Pattern Recogn Lett 15:341–347

    Article  Google Scholar 

  18. Takahashi A et al (2010) Report on the validation of video quality models for high definition video content. In: Video Qual. Experts group. Tech. Rep, Boulder

    Google Scholar 

  19. Usman MA, Shin SY, Shahid M, Lövström B (2017) A no reference video quality metric based on jerkiness estimation focusing on multiple frame freezing in video streaming. IETE Tech Rev 34(3):309–320

    Article  Google Scholar 

  20. Usman MA, Usman MR, Shin SY (2018) A Novel No-Reference Metric for Estimating the Impact of Frame Freezing Artifacts on Perceptual Quality of Streamed Videos. IEEE Transactions on Multimedia

  21. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the MSIT (Ministry of Science, ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2019-2014-1-00639) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation).

Author information

Authors and Affiliations

  1. Department of IT Convergence Eng, Kumoh National Institute of Technology, Gumi, 39177, Republic of Korea

    Muhammad Arslan Usman & Soo Young Shin

  2. Union Community co. ltd., Seoul, South Korea

    Chi-Hyeok Seong

  3. EM-Tech co., ltd., Seoul, South Korea

    Man Hee Lee

Authors
  1. Muhammad Arslan Usman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chi-Hyeok Seong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Man Hee Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Soo Young Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Arslan Usman.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Usman, M.A., Seong, CH., Lee, M.H. et al. A novel error detection & concealment technique for videos streamed over error prone channels. Multimed Tools Appl 78, 22959–22975 (2019). https://doi.org/10.1007/s11042-019-7639-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7639-8

Keywords

Search

Navigation