Abstract
Contrast and color of the acquired videos by a visual system are degraded under hazy and foggy weather, which will affect the real-world applications like surveillance system, unmanned vehicle and a driver assistance system. The video fog removal framework is the necessity of vision systems for outdoor real-world applications in bad weather to recover visibility. In this paper, a fog removal framework for videos has proposed for vision enhancement. The proposed framework excludes frame-wise procedure of defogging and adopts a collective approach for the estimation of atmospheric light and depth map estimation from all the video frames to minimize computational burden and to accelerate the process. Weighted Least Square (WLS) filtering and Anisotropic Total Variation (ATV) is implemeted for edge preserving and denoising, respectively. Qualitative and quantitative analysis is used for comparative study and observed the capability of sharp edge preserving. The proposed framework consists of limited number of popular quality parameters that are data driven and constants and remain same irrespective of the image under consideration.
Similar content being viewed by others
References
Anwar MI, Khosla A (2017) Vision enhancement through single image fog removal. Eng Sci Technol 20(3):1075–1083
Carnec M, Le Callet P, Barba D (2008) Objective quality assessment of color images based on a generic perceptual reduced reference. Sig Process Image Commun 23(4):239–256
Chen G, Zhou H, Yan J (2007) A novel method for moving object detection in foggy day. In: Software engineering, artificial intelligence, networking, and parallel/distributed computing, SNPD 2007. Eighth ACIS International Conference on, vol 2, IEEE, pp 53–58
Cho Y, Jeong J, Kim A (2018) Model-assisted multiband fusion for single image enhancement and applications to robot vision. IEEE Robot Autom Lett 3(4):2822–2829
Esedoglu S, Osher SJ (2004) Decomposition of images by the anisotropic rudin-osher-fatemi model. Commun Pure Appl Math 57(12):1609–1626
Fattal R (2008) Single image dehazing. ACM Trans Graph (TOG) 27(3):72
Hashemi S, Kiani S, Noroozi N, Moghaddam ME (2010) An image contrast enhancement method based on genetic algorithm. Pattern Recognit Lett 31(13):1816–1824
Hauti`ere N, Tarel J-P, Aubert D, Dumont E (2011) Blind contrast enhancement assessment by gradient ratioing at visible edges. Image Anal Stereol 27(2):87–95
He K, Sun J, Tang X (2011) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353
ITU-T Recommendation (2016) P.912: Subjective video quality assessment methods for recognition tasks, Recommendations of the ITU, Telecommunication Standardization Sector (2016)
John J, Wilscy M (2008) Enhancement of weather degraded video sequences using wavelet fusion, in: Cybernetic Intelligent Systems, 2008. CIS 2008. 7th IEEE International Conference on, IEEE, pp 1–6
Kim J-H, Jang W-D, Sim J-Y, Kim C-S (2013) Optimized contrast enhancement for real-time image and video dehazing. J Vis Commun Image Represent 24(3):410–425.
Kanti Dhara S, Roy M, Sen D, Kumar Biswas P (2021) Color cast dependent image dehazing via adaptive airlight refinement and non-linear color balancing. IEEE Trans Circuits Syst Video Technol 31(5):2076-2081
Kavanaugh KM, Pinto IM, McGillem MJ, DeBoe SF, Mancini GJ (1990) Effects of video frame averaging, smoothing and edge enhancement on the accuracy and precision of quantitative coronary arteriography. Int J Cardiac Imaging 5(4):233–239
Kumari A, Sahoo SK (2015) Fast single image and video deweathering using look-up-table approach. AEU-Int J Electron Commun 69(12):1773–1782
Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Anal Mach Intell 30(2):228–242
Liu H, Huang D, Hou S, Yue R (2017) Large size single image fast defogging and the real time video defogging fpga architecture. Neurocomputing 269:97–107
Ma Z, Wen J, Hao L et al (2014) Video image defogging algorithm for surface ship scenes. Syst Eng Electron 36(9):1860–1867
Narasimhan SG, Nayar SK (2003) Contrast restoration of weather degraded images. IEEE Trans Pattern Anal Mach Intell 25(6):713–724
Rao Y, Chen L (2012) A survey of video enhancement techniques. J Inf Hiding Multimed Signal Process 3(1):71–99
Sheikh HR, Bovik AC, Cormack L (2005) No-reference quality assessment using natural scene statistics: Jpeg2000. IEEE Trans Image Process 14(11):1918–1927
Shi Y, Chang Q (2013) Efficient algorithm for isotropic and anisotropic total variation deblurring and denoising. J Appl Math 2013:ID 797239
Tan RT (2008) Visibility in bad weather from a single image, in: Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, IEEE, pp 1–8
Tang H, Ni R, Zhao Y (2012) Video copy detection based on median of key frames. In: Signal Processing (ICSP), 2012 IEEE 11th International Conference on, vol 2, IEEE, pp 1184–1187
Tarel J-P, Hautiere N (2009) Fast visibility restoration from a single color or gray level image. In: Computer Vision, 2009 IEEE 12th International Conference on, IEEE, pp 2201–2208
Tripathi A, Mukhopadhyay S (2012) Single image fog removal using anisotropic diffusion. IET Image Proc 6(7):966–975
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Xie B, Guo F, Cai Z (2010) Improved single image dehazing using dark channel prior and multi-scale retinex. In: Intelligent System Design and Engineering Application (ISDEA), 2010 International Conference on, vol 1, IEEE, pp 848–851
Xie B, Guo F, Cai Z (2012) Universal strategy for surveillance video defogging. Opt Eng 51(10):101703
Xu Z, Liu X, Chen X (2009) Fog removal from video sequences using contrast limited adaptive histogram equalization. In: Computational Intelligence and Software Engineering, 2009. CiSE 2009. International Conference on, IEEE, pp 1–4
Yi Z, Liangzhong F (2010) Moving object detection based on running average background and temporal difference. In: Intelligent Systems and Knowledge Engineering (ISKE), 2010 International Conference on, IEEE, pp 270–272
Yoon I, Kim S, Kim D, et al (2012) Adaptive defogging with color correction in the HSV color space for consumer surveillance system. IEEE transactions on consumer electronics 58(1):111–116
Yoshida T (2004) Background differencing technique for image segmentation based on the status of reference pixels. In: Image Processing, 2004. ICIP’04. 2004 International Conference on, vol 5, IEEE, pp 3487–3490
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Anwar, M.I., Khosla, A. Video fog removal using Anisotropic Total Variation de-noising. Multimed Tools Appl 81, 35431–35444 (2022). https://doi.org/10.1007/s11042-022-12318-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12318-z