Abstract
High Efficiency Video Coding standard is an advanced and widely used video coding standard in recent high-definition (HD) video application. This video codec faces many challenges during the video transmission over lower bandwidth channel. One of the main challenges is the noise removal from HD video sequences. For noise removal, this video codec has in-loop filters specifically. Although these loop filters are efficient, they are not effective in removing rain pattern from the video sequences. To overcome this problem, a denoising filter has to be added to the loop filters. For denoising, an optimized multi-delay block frequency domain (OMBFD) adaptive filter is presented in this paper. Based on the intensity of raindrop, it is identified from the successive video frames. Then, these predicted raindrops are removed using the existing loop filters. Nevertheless, still, noises present in the frame are removed using the proposed OMBFD filter. To control the process of filtering, the exponential forgetting factor which is used in the proposed denoising filter is optimized using firefly optimization algorithm. Simulation results show the proposed denoising algorithm affords promising performance improvement compared to other denoising filters.
Similar content being viewed by others
References
Kim, B.G., Psannis, K., Jun, D.S.: Special issue on architectures and algorithms of high-efficiency video coding (HEVC) standard for real time video applications. J. Real-Time Image Proc. 12(2), 215–218 (2016)
Sullivan, G.J., Ohm, J., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)
Sjoberg, R., Chen, Y., Fujibayashi, A., Hannuksela, M.M., Samuelsson, J., Tan, T.K., Wang, Y.K., Wenger, S.: Overview of HEVC high-level syntax and reference picture management. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1858–1870 (2012)
Shen, L., Liu, Z., Zhang, X., Zhao, W., Zhang, Z.: An effective CU size decision method for HEVC encoders. IEEE Trans. Multimed. 15(2), 465–470 (2013)
Shen, L., Zhang, Z., An, P.: Fast CU size decision and mode decision algorithm for HEVC intra coding. IEEE Trans. Consum. Electron. 59(1), 207–213 (2013)
Ding, H., Wang, F., Zhang, W., Zhang, Q.: Adaptive motion search range adjustment algorithm for HEVC inter coding. Optik Int. J. Light Electron Optics 127(19), 7498–7506 (2016)
Brahmasury Jain, H., Rao, K.R.: Fast intra mode decision in high efficiency video coding. Polibits 50, 5–12 (2014)
Wige, E., Yammine, G., Amon, P., Hutter, A., Kaup, A.: In-loop noise-filtered prediction for high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 24(7), 1142–1155 (2014)
Kang, L.-W., Lin, C.-W., Yu-Hsiang, F.: Automatic single-image-based rain streaks removal via image decomposition. IEEE Trans. Image Process. 21(4), 1742–1755 (2012)
Xu, G., Xu, J., Wang, B., Tian, Y., Ye, Y., Shah, S.G.: Removal of rain in video based on motion and shape characteristics of raindrops. Optik Int. J. Light Electron Optics 125(15), 3926–3930 (2014)
Wang, C., Shen, M., Yao, C.: Rain streak removal by multi-frame-based anisotropic filtering. Multimed. Tools Appl. 76(2), 2019–2038 (2017)
Chen, Duan-Yu., Chen, C.-C., Kang, L.-W.: Visual depth guided color image rain streaks removal using sparse coding. IEEE Trans. Circuits Syst. Video Technol. 24(8), 1430–1455 (2014)
Xu, G., Xu, J., Wang, B., Tian, Y., Ye, Y., Shah, S.: Removal of rain in video based on motion and shape characteristics of raindrops. Optik Int. J. Light Electron Optics 125(15), 3926–3930 (2014)
Wang, C., Shen, M., Yao, C.: Rain streak removal by multi-frame-based anisotropic filtering. Multimed. Tools Appl. 76(2), 2019–2038 (2016)
Tripathi, A., Mukhopadhyay, S.: Video post processing: low-latency spatiotemporal approach for detection and removal of rain. IET Image Proc. 6(2), 181 (2012)
Tripathi, A., Mukhopadhyay, S.: Meteorological approach for detection and removal of rain from videos. IET Comput. Vis. 7(1), 36–47 (2013)
Yeh, C.H., Lin, C.Y., Muchtar, K., et al.: Rain streak removal based on non-negative matrix factorization. Multimed. Tools Appl. 77(15), 20001–20020 (2018)
Santhaseelan, V., Asari, V.: Utilizing local phase information to remove rain from video. Int. J. Comput. Vis. 112(1), 71–89 (2014)
Immerkær, J.: Fast noise variance estimation. Comput. Vis. Image Underst. 64(2), 300–302 (1996)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Thiyagarajan, J., Gowri Shankar, C. Quality improvement and performance analysis of High Efficiency Video Coding under high quantization parameters and rain streaks. SIViP 14, 387–395 (2020). https://doi.org/10.1007/s11760-019-01565-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-019-01565-7