Skip to main content
SpringerLink
Log in

No-reference real-time video transmission artifact detection for video signals

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Video signals are a very important part of multimedia applications. Due to limited network bandwidth, video signals are subjected to the compression process, which introduces different compression artifacts. During network transmission, additional artifacts are introduced in video signals due to random bit errors and packet loss (PL). Both mentioned artifact types degrade visual quality of the video signal and thus, it has to be continuously monitored to ensure the required quality of service (QoS) provided to end users. An important component of the video quality monitoring system deals with video transmission artifact detection. In this paper, a no-reference (NR) pixel-based video transmission artifact detection algorithm is proposed, called the packet loss area measure (PLAM) algorithm. When detecting video transmission artifacts, the PLAM algorithm takes into account spatial and temporal information of a video signal. The performance of the proposed PLAM algorithm has been compared to those of the three existing different PL detection algorithms on a broad set of significantly different video signals from two publicly available video databases. One of these databases, called the Referent Packet Loss (RPL) database, has been created within this research and is presented in this paper. The algorithm performance testing results show that PLAM achieves high performance and overcomes other tested algorithms. Furthermore, the results show that the PLAM algorithm is very robust when detecting video transmission artifacts in video signals of different contents, with distinct degradation levels and PL error-concealment methods used in decoder post-processing. Due to its low computational complexity, the PLAM algorithm is capable of processing Full HD and Ultra HD video signals with the frame rate up to 100 and 25 frames per second (fps), respectively, in real time, in the case when high-end CPU is used.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Shabtay, D., Raviv, N., Moshe, Y.: Video packet loss concealment detection based on image content. In: 16th European signal processing conference, Laussane (2008)

    Google Scholar 

  2. Juurlink, B., Alvarez-Mesa, M., Chi, C.C., Azevedo, A., Meenderinck, C., Ramirez, A.: Scallable parallel programming applied to H.264/AVC decoding. Springer, New York (2012)

    Book  Google Scholar 

  3. Lin, T.L., Ding, T.L., Fan, C.Y., Chen, W.C.: Error concealment algorithm based on sparse optimization. Multimedia Tools Appl. 76(1), 397–413 (2017)

    Article  Google Scholar 

  4. Glavota, I., Vranješ, M., Herceg, M., Grbić, R.: Pixel-based statistical analysis of packet loss artifact features. In: Zinc conference, Novi Sad (2016)

    Book  Google Scholar 

  5. Leszczuk, M., Hanusiak, M., Farias, M.C.Q., Wyckens, E., Heston, G.: Recent developments in visual quality monitoring by key performance indicators. Multimedia Tools Appl. 75(17), 10745–10767 (2016)

    Article  Google Scholar 

  6. Paul, S., Pandit, M.K.: A QoS-enhanced intelligent stochastic real-time packet scheduler for multimedia IP traffic. Multimedia Tools Appl. 77(10), 12725–12748 (2018)

    Article  Google Scholar 

  7. Khalifeh, A.F., Al-Taee, M.A., Murshed, A.N.: Network-status aware quality adaptation algorithm for improving real-time video streaming over the internet. Multimedia Tools Appl. 76(24), 26129–26152 (2017)

    Article  Google Scholar 

  8. You, J., Xue, H., Gao, L., Zhang, G., Zhuo, Y., Wang, J.: Predicting the online performance of video service providers on the internet. Multimedia Tools Appl. 76(18), 19017–19038 (2017)

    Article  Google Scholar 

  9. Hu, Z., Zhang, Q.: A new approach for packet loss measurement of video streaming and its application. Multimedia Tools Appl. 77(10), 11589–11608 (2018)

    Article  Google Scholar 

  10. Wang, J., Hou, Y.B.: Packet loss rate mapped to the quality of experience. Multimedia Tools Appl. 77(1), 387–422 (2018)

    Article  Google Scholar 

  11. Orosz, P., Skopko, T., Varga, P.: Towards estimating video QoE based on frame loss statistics of the video streams. In: International symposium on integrated network management, Ottawa (2015)

    Book  Google Scholar 

  12. Babu, R.V., Bopardikar, S., Perkis, A., Hillestad, O.I.: No-reference metrics for video streaming applications. In: 14th international workshop on packet video, Irvine (2004)

    Google Scholar 

  13. Rui, H., Li, C., Qiu, S.: Evaluation of packet loss impairment on streaming video. J Zhejiang Univ. Sci. B 7(1), 131–136 (2006)

    Article  Google Scholar 

  14. Teslić, N., Zlokolica, V., Peković, V., Teckan, T., Temerinac, M.: Packet-loss error detection system for DTV and set-top box functional testing. IEEE Trans. Consum. Electron. 56(3), 1311–1319 (2010)

    Article  Google Scholar 

  15. Ong, E.P., Wu, S., Loke, M.H., Rahardja, S., Tay, J., Tan, C.K., Huang, L.: Video quality monitoring of streamed video. In: IEEE international conference on acoustics, speech and signal processing, Taipei, Taiwan (2009)

  16. Montard, N., Bretillon, P.: Objective quality monitoring issues in digital broadcasting networks. IEEE Trans. Broadcast. 51(3), 269–275 (2005)

    Article  Google Scholar 

  17. Joskowicz, J., Sotelo, R.: Measuring the incidence of packet loss on video quality in digital television. In: IEEE international instrumentation and measurement technology conference (I2MTC), Montevideo, (2014)

    Book  Google Scholar 

  18. Pauliks, R., Slaidins, I., Tretjaks, K., Krauze, A.: Assessment of IP packet loss influence on perceptual quality of streaming video. In: Asia Pacific conference on multimedia and broadcasting, Bali (2015)

    Book  Google Scholar 

  19. Greengrass, J., Evans, J., Begen, A.C.: Not all packets are equal, part 2: the impact of network packet loss on video quality. IEEE Internet Comput. 13(2), 74–82 (2009)

    Article  Google Scholar 

  20. Manasa, K., Manasa Priya, K.V.S.N.L., Channappayya, S.C.: A perceptually motivated no-reference video quality assessment algorithm for packet loss artifacts. In: Quality of multimedia experience, Singapore (2014)

    Book  Google Scholar 

  21. Yamada, T., Miyamoto, Y., Serizawa, M.: No-reference video quality estimation based on error-concealment effectiveness. In: Packet Video, Lausanne (2007)

    Book  Google Scholar 

  22. Zhang, D., Zhou, D., Jin, X.: A content-adaptive video quality assessment method for online media service. Multimedia Tools Appl. 76(5), 7175–7195 (2017)

    Article  Google Scholar 

  23. Wang, Z., Wang, W., Xia, Y., Lin, W.: No-reference hybrid video quality assessment based on partial least squares regression. Multimedia Tools Appl. 74(23), 10277–10290 (2015)

    Article  Google Scholar 

  24. Chen, Z., Liao, N., Gu, X., Wu, F., Shi, G.: Hybrid distortion ranking tuned bitstream-layer video quality assessment. IEEE Trans. Circuits Syst. Video Technol. 26(6), 1029–1043 (2016)

    Article  Google Scholar 

  25. Zhao, S., Jiang, H., Cai, Q., Sherif, S., Tarraf, A.: Hybrid framework for no-reference video quality indication over LTE networks. In: 23rd wireless and optical communication conference, Newark (2014)

    Google Scholar 

  26. Kim, S.J., Chae, C.B., Lee, J.S.: Subjective and objective quality assessment of videos in error-prone network environments. Multimedia Tools Appl. 75(12), 6849–6870 (2016)

    Article  Google Scholar 

  27. Kordelas, A., Politis, I., Dagiuklas, T.: Transport analysis and quality evaluation of MVC video streaming. Multimedia Tools Appl. 75(10), 5619–5644 (2016)

    Article  Google Scholar 

  28. Zhou, S., Lu, Z., Wen, F., Shao, H., Chen, Y.: Bursty interference-oriented video quality assessment method. Multimedia Tools Appl. 75(5), 2741–2768 (2016)

    Article  Google Scholar 

  29. Video multi-method assessment fusion by Netflix (online). https://github.com/Netflix/vmaf. Accessed 6 Sept 2018

  30. Bampis, C.G., Katsavounidis, I., Bovik, A.C.: Recurrent and dynamic models for predicting streaming video quality of experience. IEEE Trans. Image Process. 27(7), 3316–3331 (2018)

    Article  MathSciNet  Google Scholar 

  31. Lin, J.Y., Liu, T.J., Wu, E.C.-H., Kuo, C.-C.J.: A fusion-based video quality assessment (FVQA) index. In: Asia-Pacific signal and information processing association annual summit and conference, Chiang Mai (2014)

    Book  Google Scholar 

  32. Bampis, C.G., Li, Z., Bovik, A.C.: SpatioTemporal feature integration and model fusion for full reference video quality assessment (2018). arXiv:1804.04813

  33. P.910: Subjective video quality assessment methods for multimedia applications (online). https://www.itu.int/rec/T-REC-P.910-200804-I/en. Accessed 25 Feb 2018

  34. Xiph.org: video test media [derf’s collection] (Online). https://media.xiph.org/video/derf. Accessed 25 Feb 2018

  35. Video analysis (Online). http://bbt.rt-rk.com/audiovideo-analysis/. Accessed 25 Feb 2018

Download references

Acknowledgements

This work was supported by Josip Juraj Strossmayer University of Osijek business fund through the internal competition for the research and artistic projects IZIP-2016, via the project “Providing of digital video signal based services in rural and rarely populated areas”.

Author information

Authors and Affiliations

  1. Institute RT-RK LLC for Information Technology, Osijek, Croatia

    Ivan Glavota

  2. Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia

    Zvonimir Kaprocki

  3. Faculty of Electrical Engineering, Computer Science and Information Technology, University of Osijek, Osijek, Croatia

    Mario Vranješ & Marijan Herceg

Authors
  1. Ivan Glavota
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zvonimir Kaprocki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mario Vranješ
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marijan Herceg
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mario Vranješ.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Glavota, I., Kaprocki, Z., Vranješ, M. et al. No-reference real-time video transmission artifact detection for video signals. J Real-Time Image Proc 17, 799–820 (2020). https://doi.org/10.1007/s11554-018-0824-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-018-0824-6

Keywords

Search

Navigation