skip to main content
research-article

Image Defogging Based on Regional Gradient Constrained Prior

Published: 23 October 2023 Publication History

Abstract

Foggy days limit the functionality of outdoor surveillance systems. However, it is still a challenge for existing methods to maintain the uniformity of defogging between image regions with a similar depth of field and large differences in appearance. To address above problem, this article proposes a regional gradient constrained prior (RGCP) for defogging that uses the piecewise smoothing characteristic of the scene structure to achieve accurate estimation and reliable constraint of the transmission. RGCP first derives that when adjacent similar pixels in the fog image are aggregated and spatially divided into regions, clusters of region pixels in RGB space conform to a chi-square distribution. The offset of the confidence boundary of the clusters can be regarded as the initial transmission of each region. RGCP further uses a gradient distribution to distinguish different regional appearances and formulate an interregional constraint function to constrain the overestimation of the transmission in the flat region, thereby maintaining the consistency between the estimated transmission map and the depth map. The experimental results demonstrate that the proposed method can achieve natural defogging performance in terms of various foggy conditions.

References

[1]
Yang You, Cewu Lu, Weiming Wang, and Chi-Keung Tang. 2019. Relative CNN-RNN: Learning relative atmospheric visibility from images. IEEE Trans. Image Process. 28, 1 (2019) 45–55.
[2]
Hai-Miao Hu, Hongda Zhang, Zichen Zhao, Bo Li, and Jin Zheng. 2020. Adaptive single image dehazing using joint local-global illumination adjustment. IEEE Trans. Multimedia 22, 6 (2020) 1485–1495.
[3]
Yuxing Tang, Josiah Wang, Xiaofang Wang, Boyang Gao, Emmanuel Dellandréa, Robert J. Gaizauskas, and Liming Chen. 2018. Visual and semantic knowledge transfer for large scale semi-supervised object detection. IEEE Trans. Pattern Anal. Mach. Intell. 40, 12 (2018), 3045–3058.
[4]
Weixin Luo, Wen Liu, Dongze Lian, Jinhui Tang, Lixin Duan, Xi Peng, and Shenghua Gao. 2021. Video anomaly detection with sparse coding inspired deep neural networks. IEEE Trans. Pattern Anal. Mach. Intell. 43, 3 (2021), 1070–1084.
[5]
Srinivasa G. Narasimhan and Shree K. Nayar. 2003. Contrast restoration of weather degraded images. IEEE Trans. Pattern Anal. Mach. Intell. 25, 6 (2003), 713–724.
[6]
Pei-hsiu Suen, Glenn Healey, and David Slater. 2001. The impact of viewing geometry on vision through the atmosphere. In Proceedings of the 8th International Conference on Computer Vision (ICCV’01), Volume 2. IEEE Computer Society, 2001, 454–459.
[7]
R. Hide. 1977. Optics of the atmosphere: Scattering by molecules and particles. Phys. Bull. 28, 11 (1977).
[8]
Robby T. Tan. 2008. Visibility in bad weather from a single image. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’08). IEEE Computer Society. 1–8.
[9]
Kaiming He, Jian Sun, and Xiaoou Tang. 2011. Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33, 12 (2011), 2341–2353.
[10]
Bo-Hao Chen and Shih-Chia Huang. 2015. An advanced visibility restoration algorithm for single hazy images. ACM Trans. Multim. Comput. Commun. Appl. 11, 4 (2015), 53:1–53:21.
[11]
Bui Minh Trung and Wonha Kim. 2018. Single image dehazing using color ellipsoid prior. IEEE Trans. Image Process. 27, 2 (2018), 999–1009.
[12]
Ping-Juei Liu, Shi-Jinn Horng, Jzau-Sheng Lin, and Tianrui Li. 2019. Contrast in haze removal: Configurable contrast enhancement model based on dark channel prior. IEEE Trans. Image Process. 28, 5 (2019), 2212–2227.
[13]
Yuanyuan Gao, Hai-Miao Hu, Bo Li, Qiang Guo, and Shiliang Pu. 2019. Detail preserved single image dehazing algorithm based on airlight refinement. IEEE Trans. Multimedia 21, 2 (2019), 351–362.
[14]
Gaofeng Meng, Ying Wang, Jiangyong Duan, Shiming Xiang, and Chunhong Pan. 2013. Efficient image dehazing with boundary constraint and contextual regularization. In Proceedings of the IEEE International Conference on Computer Vision (ICCV’13). IEEE Computer Society, 617–624.
[15]
Qingsong Zhu, Jiaming Mai, and Ling Shao. 2015. A fast single image haze removal algorithm using color attenuation prior. IEEE Trans. Image Process. 24, 11 (2015), 3522–3533.
[16]
Dana Berman, Tali Treibitz, and Shai Avidan. 2020. Single image dehazing using haze-lines. IEEE Trans. Pattern Anal. Mach. Intell. 42, 3 (2020), 720–734.
[17]
Hai-Miao Hu, Qiang Guo, Jin Zheng, Hanzi Wang, and Bo Li. 2019. Single image defogging based on illumination decomposition for visual maritime surveillance. IEEE Trans. Image Process. 28, 6 (2019), 2882–2897.
[18]
Baiju P. S. and Sudhish N. George. 2022. TTV regularized LRTA technique for the estimation of haze model parameters in video dehazing. ACM Trans. Multimedia Comput. Commun. Appl. 18, 1 (2022), 4:1–4:22.
[19]
Mading Li, Jiaying Liu, Xiaoyan Sun, and Zhiwei Xiong. 2020. Image/video restoration via multiplanar autoregressive model and low-rank optimization. ACM Trans. Multimedia Comput. Commun. Appl. 15, 4 (2020), 102:1–102:23.
[20]
Lark Kwon Choi, Jaehee You, and Alan C. Bovik. 2015. Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans. Image Process. 24, 11 (2015), 3888–3901.
[21]
Boyi Li, Xiulian Peng, Zhangyang Wang, Jizheng Xu, and Dan Feng. 2017. Aod-net: All-in-one dehazing network. In Proceedings of the IEEE International Conference on Computer Vision (ICCV’17). IEEE Computer Society, 4780–4788.
[22]
Runde Li, Jinshan Pan, Zechao Li, and Jinhui Tang. 2018. Single image dehazing via conditional generative adversarial network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’18). Computer Vision Foundation/IEEE Computer Society, 8202–8211.
[23]
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Zoubin Ghahramani, Max Welling, Corinna Cortes, Neil D. Lawrence, and Kilian Q. Weinberger, editors, Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems, 2672–2680.
[24]
Yanyun Qu, Yizi Chen, Jingying Huang, and Yuan Xie. 2019. Enhanced pix2pix dehazing network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’19). Computer Vision Foundation/IEEE, 8160–8168.
[25]
Xiaohong Liu, Yongrui Ma, Zhihao Shi, and Jun Chen. 2019. Griddehazenet: Attention-based multi-scale network for image dehazing. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV’19). IEEE, 7313–7322.
[26]
Yuanjie Shao, Lerenhan Li, Wenqi Ren, Changxin Gao, and Nong Sang. 2020. Domain adaptation for image dehazing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR’20). Computer Vision Foundation/IEEE, 2805–2814.
[27]
Bolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao. 2016. Dehazenet: An end-to-end system for single image haze removal. IEEE Trans. Image Process. 25, 11 (2016), 5187–5198.
[28]
He Zhang and Vishal M. Patel. 2018. Densely connected pyramid dehazing network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’18). Computer Vision Foundation/IEEE Computer Society, 3194–3203.
[29]
Sanchayan Santra, Ranjan Mondal, and Bhabatosh Chanda. 2018. Learning a patch quality comparator for single image dehazing. IEEE Trans. Image Process. 27, 9 (2018), 4598–4607.
[30]
Wei-Ting Chen, Jian-Jiun Ding, and Sy-Yen Kuo. 2019. Pms-net: Robust haze removal based on patch map for single images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’19). Computer Vision Foundation/IEEE, 11681–11689.
[31]
Ziyi Sun, Yunfeng Zhang, Fangxun Bao, Ping Wang, Xunxiang Yao, and Caiming Zhang. 2022. Sadnet: Semi-supervised single image dehazing method based on an attention mechanism. ACM Trans. Multimedia Comput. Commun. Appl. 18, 2 (2022), 58:1–58:23, 2022.
[32]
M. Storath, A. Weinmann, J. Frikel, and M. Unser. 2014. Joint image reconstruction and segmentation using the potts model. Inv. Probl. 31, 2 (2014), 25003–25031.
[33]
Radhakrishna Achanta, Appu Shaji, Kevin Smith, Aurélien Lucchi, Pascal Fua, and Sabine Süsstrunk. 2012. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34, 11 (2012), 2274–2282.
[34]
Kristofor B. Gibson and Truong Q. Nguyen. 2013. An analysis of single image defogging methods using a color ellipsoid framework. EURASIP J. Image Video Process. 37, (2013), 1–14.
[35]
Gudrun Klinker, Steven A. Shafer, and Takeo Kanade. 1990. A physical approach to color image understanding. Int. J. Comput. Vis. 4, 1 (1990), 7–38.
[36]
Mingye Ju, Can Ding, Charles A. Guo, Wenqi Ren, and Dacheng Tao. 2021. IDRLP: Image dehazing using region line prior. IEEE Trans. Image Process. 30 (2021), 9043–9057.
[37]
Boyi Li, Wenqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhangyang Wang. 2019. Benchmarking single-image dehazing and beyond. IEEE Trans. Image Process. 28, 1 (2019), 492–505.
[38]
N. Hautiere, J. P. Tarel, D. Aubert, and E. Dumont. 2011. Blind contrast enhancement assessment by gradient ratioing at visible edges. Image Anal. Stereol. 27, 2 (2011), 87–95.
[39]
H. Jegou, M. Douze, and C. Schmid. 2008. Hamming embedding and weak geometric consistency for large scale image search. In Proceedings of the European Conference on Computer Vision. 304–317.
[40]
Mingye Ju, Can Ding, Wenqi Ren, Yi Yang, Dengyin Zhang, and Y. Jay Guo. 2021. IDE: Image dehazing and exposure using an enhanced atmospheric scattering model. IEEE Trans. Image Process. 30 (2021), 2180–2192.
[41]
C. O. Ancuti, C. Ancuti, R. Timofte, C. D. Vleeschouwer. 2018. O-HAZE: A dehazing benchmark with real hazy and haze-free outdoor images. In Proceedings of the Conference on Computer Vision and Pattern Recognition Workshops, 754–762.
[42]
C. O. Ancuti, C. Ancuti, M. Sbert, and R. Timofte. 2019. Dense haze: A benchmark for image dehazing with dense-haze and haze-free imagesl. IEEE Int. Conf. Image Process. (2019), 1014–1018.

Index Terms

  1. Image Defogging Based on Regional Gradient Constrained Prior

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Multimedia Computing, Communications, and Applications
    ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 20, Issue 3
    March 2024
    665 pages
    EISSN:1551-6865
    DOI:10.1145/3613614
    • Editor:
    • Abdulmotaleb El Saddik
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 October 2023
    Online AM: 29 August 2023
    Accepted: 20 August 2023
    Revised: 10 July 2023
    Received: 24 January 2023
    Published in TOMM Volume 20, Issue 3

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Image defogging
    2. transmission estimation prior
    3. regional gradient constraint function

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China
    • Joint Equipment Pre Research and Key Fund Project of the Ministry of Education
    • Human Resources and Social Security Bureau Project of Chongqing
    • Guangdong Oppo Mobile Telecommunications Corporation Ltd.
    • Natural Science Foundation of Chongqing, China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 372
      Total Downloads
    • Downloads (Last 12 months)152
    • Downloads (Last 6 weeks)13
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media