Skip to main content
Log in

Quality improvement and performance analysis of High Efficiency Video Coding under high quantization parameters and rain streaks

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

High Efficiency Video Coding standard is an advanced and widely used video coding standard in recent high-definition (HD) video application. This video codec faces many challenges during the video transmission over lower bandwidth channel. One of the main challenges is the noise removal from HD video sequences. For noise removal, this video codec has in-loop filters specifically. Although these loop filters are efficient, they are not effective in removing rain pattern from the video sequences. To overcome this problem, a denoising filter has to be added to the loop filters. For denoising, an optimized multi-delay block frequency domain (OMBFD) adaptive filter is presented in this paper. Based on the intensity of raindrop, it is identified from the successive video frames. Then, these predicted raindrops are removed using the existing loop filters. Nevertheless, still, noises present in the frame are removed using the proposed OMBFD filter. To control the process of filtering, the exponential forgetting factor which is used in the proposed denoising filter is optimized using firefly optimization algorithm. Simulation results show the proposed denoising algorithm affords promising performance improvement compared to other denoising filters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Kim, B.G., Psannis, K., Jun, D.S.: Special issue on architectures and algorithms of high-efficiency video coding (HEVC) standard for real time video applications. J. Real-Time Image Proc. 12(2), 215–218 (2016)

    Article  Google Scholar 

  2. Sullivan, G.J., Ohm, J., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)

    Article  Google Scholar 

  3. Sjoberg, R., Chen, Y., Fujibayashi, A., Hannuksela, M.M., Samuelsson, J., Tan, T.K., Wang, Y.K., Wenger, S.: Overview of HEVC high-level syntax and reference picture management. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1858–1870 (2012)

    Article  Google Scholar 

  4. Shen, L., Liu, Z., Zhang, X., Zhao, W., Zhang, Z.: An effective CU size decision method for HEVC encoders. IEEE Trans. Multimed. 15(2), 465–470 (2013)

    Article  Google Scholar 

  5. Shen, L., Zhang, Z., An, P.: Fast CU size decision and mode decision algorithm for HEVC intra coding. IEEE Trans. Consum. Electron. 59(1), 207–213 (2013)

    Article  Google Scholar 

  6. Ding, H., Wang, F., Zhang, W., Zhang, Q.: Adaptive motion search range adjustment algorithm for HEVC inter coding. Optik Int. J. Light Electron Optics 127(19), 7498–7506 (2016)

    Article  Google Scholar 

  7. Brahmasury Jain, H., Rao, K.R.: Fast intra mode decision in high efficiency video coding. Polibits 50, 5–12 (2014)

    Article  Google Scholar 

  8. Wige, E., Yammine, G., Amon, P., Hutter, A., Kaup, A.: In-loop noise-filtered prediction for high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 24(7), 1142–1155 (2014)

    Article  Google Scholar 

  9. Kang, L.-W., Lin, C.-W., Yu-Hsiang, F.: Automatic single-image-based rain streaks removal via image decomposition. IEEE Trans. Image Process. 21(4), 1742–1755 (2012)

    Article  MathSciNet  Google Scholar 

  10. Xu, G., Xu, J., Wang, B., Tian, Y., Ye, Y., Shah, S.G.: Removal of rain in video based on motion and shape characteristics of raindrops. Optik Int. J. Light Electron Optics 125(15), 3926–3930 (2014)

    Article  Google Scholar 

  11. Wang, C., Shen, M., Yao, C.: Rain streak removal by multi-frame-based anisotropic filtering. Multimed. Tools Appl. 76(2), 2019–2038 (2017)

    Article  Google Scholar 

  12. Chen, Duan-Yu., Chen, C.-C., Kang, L.-W.: Visual depth guided color image rain streaks removal using sparse coding. IEEE Trans. Circuits Syst. Video Technol. 24(8), 1430–1455 (2014)

    Article  Google Scholar 

  13. Xu, G., Xu, J., Wang, B., Tian, Y., Ye, Y., Shah, S.: Removal of rain in video based on motion and shape characteristics of raindrops. Optik Int. J. Light Electron Optics 125(15), 3926–3930 (2014)

    Article  Google Scholar 

  14. Wang, C., Shen, M., Yao, C.: Rain streak removal by multi-frame-based anisotropic filtering. Multimed. Tools Appl. 76(2), 2019–2038 (2016)

    Article  Google Scholar 

  15. Tripathi, A., Mukhopadhyay, S.: Video post processing: low-latency spatiotemporal approach for detection and removal of rain. IET Image Proc. 6(2), 181 (2012)

    Article  MathSciNet  Google Scholar 

  16. Tripathi, A., Mukhopadhyay, S.: Meteorological approach for detection and removal of rain from videos. IET Comput. Vis. 7(1), 36–47 (2013)

    Article  Google Scholar 

  17. Yeh, C.H., Lin, C.Y., Muchtar, K., et al.: Rain streak removal based on non-negative matrix factorization. Multimed. Tools Appl. 77(15), 20001–20020 (2018)

    Article  Google Scholar 

  18. Santhaseelan, V., Asari, V.: Utilizing local phase information to remove rain from video. Int. J. Comput. Vis. 112(1), 71–89 (2014)

    Article  Google Scholar 

  19. Immerkær, J.: Fast noise variance estimation. Comput. Vis. Image Underst. 64(2), 300–302 (1996)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Thiyagarajan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Thiyagarajan, J., Gowri Shankar, C. Quality improvement and performance analysis of High Efficiency Video Coding under high quantization parameters and rain streaks. SIViP 14, 387–395 (2020). https://doi.org/10.1007/s11760-019-01565-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01565-7

Keywords

Navigation