Skip to main content
SpringerLink
Log in

Error concealment with parallelogram partitioning of the lost area

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we proposed a video error concealment algorithm using Motion Vector (MV) recovery for parallelogram partitions in the lost area. Error concealment is inevitable when some video packets are lost during transmission and correction or retransmission is not feasible. In conventional methods, MVs are recovered for the square shaped blocks which are then used for motion compensated temporal replacement. But in our proposed method, by parallelogram partitioning of the lost area, the MVs are found for more general shaped blocks. The parallelograms with various sizes and angles are examined, and then the best combination (size and angle) is selected with the assist of a border matching algorithm and a blind quality assessment method. Experimental results show that our method outperforms the other error concealment algorithms, both subjectively and objectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. [Online]. Available: https://hevc.hhi.fraunhofer.de/trac/hevc/browser

  2. Akbari A, Trocan M, Granado B (2017) Sparse recovery-based error concealment. IEEE Trans Multimed 19(6):1339–1350

    Article  Google Scholar 

  3. Available: http://live.ece.utexas.edu/research/Quality/noreference.htm.

  4. Bellman R (1954) The theory of dynamic programming. Bull Am Math Soc

  5. Byongsu H, Jonghyon J, Cholsu R (2017) An improved multi-directional interpolation for spatial error concealment. Multimed Tools Appl 76(1):397–413

    Article  Google Scholar 

  6. Carreira JFM, Assunção PA, de-Faria SM, Ekmekcioglu E, Kondoz A (2018) Error concealment-aware encoding for robust video transmission. IEEE Trans Broadcast 65(2):282–293

    Article  Google Scholar 

  7. Chang YL, Reznick YA, Chen Z, Cosman PC (2013) Motion compensated error concealment for HEVC based on block-merging and residual energy. In: International packet video workshop (PV)

  8. Choe G, Nam C, Chu C (2018) An effective temporal error concealment in H.264 video sequences based on scene change detection-PCA model. Springer Multimed Tools Appl 77(24):31953–31967

    Article  Google Scholar 

  9. Chung B, Yim C (2019) Bi-sequential video error concealment method using adaptive homography-based registration. IEEE Trans Circ Syst Video Technol. https://doi.org/10.1109/TCSVT.2019.2909564

  10. Dufaux F, Moscheni F (1995) Motion estimation techniques for digital TV: a review and a new contribution. Proc IEEE 83:858–876

    Article  Google Scholar 

  11. Huang Z, Cai Q (2018) A video data recovery algorithm in wireless communication networks. In: IEEE 18th international conference on Communication Technology

  12. Hwang MC, Kim JH, Duong DT, Ko SJ (2008) Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Trans Broadcast 54(2):198–207

    Article  Google Scholar 

  13. Lam WM. Reibman AR, Liu B (1993) Recovery of lost or erroneously received motion vectors. In: Proceedings of IEEE international conference on Acoust. Speech Signal Process, pp 417–420

  14. Li Y, Chen R (2017) Motion vector recovery for video error concealment based on the plane fitting. Springer Multimed Tools Appl 76(13):14993–15006

    Article  Google Scholar 

  15. Lie WN, Lee CM, Yeh CH, Gao ZW (2014) Motion vector recovery for video error concealment by using iterative dynamic-programming optimization. IEEE Trans Mulimed 16(1):216–227

    Google Scholar 

  16. Lin TL, Ding TL, Yang NC, Wu PY, Tung KH, Lai CK, Chang TE (2016) Video motion vector recovery method using decoding partition information. J Disp Technol 12(11):1451–1463

    Article  Google Scholar 

  17. Lin TL, Ding TL, Fan CY, Chen WC (2017) Error concealment algorithm based on sparse optimization. Multimed Tools Appl 76(1):397–413

    Article  Google Scholar 

  18. Liu L, Liu B, Huang H, Bovik AC (2014) No-reference image quality assessment based on spatial and spectral entropies. Signal Process Image Commun 29(8):856–863

    Article  Google Scholar 

  19. Liu X, Zhai D, Zhou J, Wang S, Zhao D, Guo H (2016) Sparsitybased image error concealment via adaptive dual dictionary learning and regularization. IEEE Trans Image Process 26(2):782–796

    Article  Google Scholar 

  20. Moorthy AK, Bovik AC (2010) A two-step framework for constructing blind image quality indices. IEEE Signal Process Lett 17(5):513–516

    Article  Google Scholar 

  21. Oztas B, Pourazad MT, Nasiopoulos P, and Leung VCM (2012) A study on the HEVC performance over Lossy Networks. In: Proceedings of 19th IEEE international conference on Electron. Circuits Syst. (ICECS), pp 785–788

  22. Qian X, Liu G, Wang H (2009) Recovering connected error region based on adaptive error concealment order determination. IEEE Trans Multimed 11(4):683–695

    Article  Google Scholar 

  23. Radmehr A, Ghasemi A (2016) Error concealment via particle filter by Gaussian mixture modeling of motion vectors for H.264/AVC. Springer Sig Image Video Process 10(2):311–318

    Article  Google Scholar 

  24. Saad MA, Bovik AC (2012) Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans Image Process 28(39):3339–3352

    Article  MathSciNet  Google Scholar 

  25. Sankisa A, Punjabi A, Katsaggelos AK (2018) Video error concealment using deep neural networks. In: Proceedings of the IEEE international conference on Image Processing, Athens, Greece, pp 380–384

  26. Shih HC, Wang CT, Huang CL (2018) Spiral-like pixel reconstruction algorithm for spatiotemporal video error concealment. IEEE Access 16:6370–6381

    Article  Google Scholar 

  27. Soundararajan R, Bovik AC (2013) Video quality assessment by reduced reference Spatio-temporal entropic differencing. IEEE Trans Circ Syst Video Technol 23(4):684–694

    Article  Google Scholar 

  28. Suh JW, Ho YS (2002) Error concealment techniques for digital TV. IEEE Trans Broadcast 48(4):299–306

    Article  Google Scholar 

  29. Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the High Efficiency Video Coding (HEVC) standard. IEEE Trans Circ Syst Video Technol 22(12):1648–1667

    Article  Google Scholar 

  30. Usman M., He X, Xu M and Lam KM (2015) Survey of error concealment techniques: research directions and open issues. In: Picture coding symposium (PCS), Cairns, QLD, Australia

  31. Wang Y, Zhu QF (1998) Error control and concealment for video communication: a review. Proc IEEE 86(5):974–999

    Article  Google Scholar 

  32. Xiang C, Xu J, Yan C, Peng Q, (2019) Generative adversarial networks based error concealment for low resolution video. In: IEEE international conference on Acoustics, Speech And Signal Processing (ICASSP)

  33. Yang SH, Chang CW, Chan CC (2015) An object-based error concealment technique for H.264 coded video. Multimed Tools Appl 74(23):10785–10800

    Article  Google Scholar 

  34. Zhang J, Arnold JF, Frater MR (2000) A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans Circ Syst Video Technol 10(4):659–665

    Article  Google Scholar 

  35. Zhang Y, Xiang X, Zhao D, Ma S, Gao W (2011) Packet video error concealment with auto regressive model. IEEE Trans Circ Syst Video Technol 22(1):12–27

    Article  Google Scholar 

  36. Zhou Z, Dai M, Zhao R, Li B, Zhong H, Wen Y (2016) Video error concealment scheme based on tensor model. Springer Multimed Tools Appl 76(14):16045–16061

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering Department, University of Isfahan, Isfahan, 8174673441, Iran

    Sahar Hojati, Mohammad Kazemi & Payman Moallem

Authors
  1. Sahar Hojati
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammad Kazemi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Payman Moallem
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammad Kazemi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hojati, S., Kazemi, M. & Moallem, P. Error concealment with parallelogram partitioning of the lost area. Multimed Tools Appl 79, 7449–7469 (2020). https://doi.org/10.1007/s11042-019-08538-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-08538-5

Keywords

Search

Navigation