Skip to main content

Advertisement

Springer Nature Link
Log in

Subspace-guided GAN for realistic single-image dehazing scenarios

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Single-image haze removal is an essential preprocessing phase in many object detection and segmentation approaches. Recently, end-to-end deep learning-based approaches have dominated the field of single-image dehazing because of their superiority in recovering clear images corrupted by different types of degradation. However, training an effective dehazing network remains challenging, particularly in the absence of high-quality realistic training datasets. In this paper, a novel approach called a subspace-based dehazing generative adversarial network (SuDGAN) is proposed. Traditional training methods attempt to apply changes to pixel intensities, whereas SuDGAN adopts a novel training approach using existing synthetic datasets to learn the adjustment of subspace components related to haze. This approach enables the network to learn more discriminative haze-aware features and focus on adjusting the components that are more affected by haze (luminance) while preserving those that are less influenced by haze (structure). The proposed SuDGAN, along with several state-of-the-art approaches, is evaluated on various challenging synthetic and realistic datasets using haze-related and traditional evaluation metrics. The experimental results demonstrate the efficiency of SuDGAN in removing haze and producing visually pleasing results. Furthermore, the results show that SuDGAN has clear quantitative and qualitative improvements over most state-of-the-art dehazing approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Data availability

The datasets generated and/or analyzed in the current study are available from the corresponding author upon reasonable request.

Code availability

The code developed in the current study is available from the corresponding author upon reasonable request.

Notes

  1. via TensorBoard toolbox.

References

  1. Yu B, Chen Y, Cao S-Y, Shen H-L, Li J (2022) Three-channel infrared imaging for object detection in haze. IEEE Trans Instrum Meas 71:1–13

    Google Scholar 

  2. Berman D, Avidan S, et al (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1674–1682

  3. Huang S-C, Chen B-H, Cheng Y-J (2014) An efficient visibility enhancement algorithm for road scenes captured by intelligent transportation systems. IEEE Trans Intell Transp Syst 15(5):2321–2332

    Article  Google Scholar 

  4. Ren W, Zhang J, Xu X, Ma L, Cao X, Meng G, Liu W (2018) Deep video dehazing with semantic segmentation. IEEE Trans Image Process 28(4):1895–1908

    Article  MathSciNet  Google Scholar 

  5. Lee S, Yun S, Nam J-H, Won CS, Jung S-W (2016) A review on dark channel prior based image dehazing algorithms. EURASIP J Image Video Process 2016(1):1–23

    Article  Google Scholar 

  6. Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z (2019) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28(1):492–505

    Article  MathSciNet  Google Scholar 

  7. Narasimhan SG, Nayar SK (2002) Vision and the atmosphere. Int J Comput Vis 48(3):233–254

    Article  Google Scholar 

  8. Li B, Gou Y, Liu JZ, Zhu H, Zhou JT, Peng X (2020) Zero-shot image dehazing. IEEE Trans Image Process 29:8457–8466

    Article  Google Scholar 

  9. Li R, Pan J, He M, Li Z, Tang J (2020) Task-oriented network for image dehazing. IEEE Trans Image Process 29:6523–6534

    Article  Google Scholar 

  10. Deng Q, Huang Z, Tsai C-C, Lin C-W (2020) Hardgan: a haze-aware representation distillation gan for single image dehazing. In: European conference on computer vision. Springer, pp 722–738

  11. Zhang X, Jiang R, Wang T, Luo W (2021) Single image dehazing via dual-path recurrent network. IEEE Trans Image Process 30:5211–5222

    Article  Google Scholar 

  12. Qu Y, Chen Y, Huang J, Xie Y (2019) Enhanced pix2pix dehazing network. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 8160–8168

  13. Li H, Gao J, Zhang Y, Xie M, Yu Z (2022) Haze transfer and feature aggregation network for real-world single image dehazing. Knowl-Based Syst 251:109309

    Article  Google Scholar 

  14. Zheng C, Zhang J, Hwang J-N, Huang B (2022) Double-branch dehazing network based on self-calibrated attentional convolution. Knowl-Based Syst 240:108148

    Article  Google Scholar 

  15. Wang C, Shen H-Z, Fan F, Shao M-W, Yang C-S, Luo J-C, Deng L-J (2021) Eaa-net: a novel edge assisted attention network for single image dehazing. Knowl-Based Syst 228:107279

    Article  Google Scholar 

  16. Li Y, Cheng D, Zhang D, Wang N, Gao X, Sun J (2022) Single image dehazing with an independent detail-recovery network. Knowl-Based Syst 254:109579

    Article  Google Scholar 

  17. Zhang X, Wang T, Wang J, Tang G, Zhao L (2020) Pyramid channel-based feature attention network for image dehazing. Comput Vis Image Underst 197:103003

    Article  Google Scholar 

  18. Liu Y, Zhu L, Pei S, Fu H, Qin J, Zhang Q, Wan L, Feng W (2021) From synthetic to real: image dehazing collaborating with unlabeled real data. In: Proceedings of the 29th ACM international conference on multimedia, pp 50–58

  19. Zhang X, Wang T, Luo W, Huang P (2020) Multi-level fusion and attention-guided cnn for image dehazing. IEEE Trans Circuits Syst Video Technol 31(11):4162–4173

    Article  Google Scholar 

  20. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  21. Mahajan P, Jakhetiya V, Abrol P, Lehana PK, Subudhi BN, Guntuku SC (2021) Perceptual quality evaluation of hazy natural images. IEEE Trans Industr Inf 17(12):8046–8056

    Article  Google Scholar 

  22. Choi LK, You J, Bovik AC (2015) Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans Image Process 24(11):3888–3901

    Article  MathSciNet  Google Scholar 

  23. Min X, Zhai G, Gu K, Yang X, Guan X (2018) Objective quality evaluation of dehazed images. IEEE Trans Intell Transp Syst 20(8):2879–2892

    Article  Google Scholar 

  24. Min X, Zhai G, Gu K, Zhu Y, Zhou J, Guo G, Yang X, Guan X, Zhang W (2019) Quality evaluation of image dehazing methods using synthetic hazy images. IEEE Trans Multimedia 21(9):2319–2333

    Article  Google Scholar 

  25. Liu W, Zhou F, Lu T, Duan J, Qiu G (2020) Image defogging quality assessment: Real-world database and method. IEEE Trans Image Process 30:176–190

    Article  Google Scholar 

  26. Fattal R (2014) Dehazing using color-lines. ACM Trans Graph (TOG) 34(1):1–14

    Article  Google Scholar 

  27. He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Google Scholar 

  28. Zhu Z, Wei H, Hu G, Li Y, Qi G, Mazur N (2020) A novel fast single image dehazing algorithm based on artificial multiexposure image fusion. IEEE Trans Instrum Meas 70:1–23

    Article  Google Scholar 

  29. Schaul L, Fredembach C, Süsstrunk S (2009) Color image dehazing using the near-infrared. In: 2009 16th IEEE international conference on image processing (ICIP). IEEE, pp 1629–1632

  30. Feng C, Zhuo S, Zhang X, Shen L, Süsstrunk S (2013) Near-infrared guided color image dehazing. In: IEEE international conference on image processing. IEEE 2013, pp 2363–2367

  31. Kaur M, Singh D, Kumar V, Sun K (2020) Color image dehazing using gradient channel prior and guided l0 filter. Inf Sci 521:326–342

    Article  Google Scholar 

  32. Kponou E A, Wang Z, Wei P, Wu M (2017) Fast single image dehazing based on color cube constraint. In: 2017 IEEE 17th international conference on communication technology (ICCT). IEEE, pp 1623–1627

  33. Park D, Park H, Han D K, Ko H (2014) Single image dehazing with image entropy and information fidelity. In: 2014 IEEE international conference on image processing (ICIP). IEEE, pp 4037–4041

  34. Fattal R (2008) Single image dehazing. ACM Trans Graph (TOG) 27(3):1–9

    Article  Google Scholar 

  35. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25(11):5187–5198

    Article  MathSciNet  Google Scholar 

  36. Li B, Peng X, Wang Z, Xu J, Feng D (2017) Aod-net: all-in-one dehazing network. In: Proceedings of the IEEE international conference on computer vision, pp 4770–4778

  37. Guo T, Li X, Cherukuri V, Monga V (2019) Dense scene information estimation network for dehazing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops

  38. Ren W, Pan J, Zhang H, Cao X, Yang M-H (2020) Single image dehazing via multi-scale convolutional neural networks with holistic edges. Int J Comput Vis 128(1):240–259

    Article  Google Scholar 

  39. Liu X, Ma Y, Shi Z, Chen J (2019) Griddehazenet: attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 7314–7323

  40. Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) Ffa-net: feature fusion attention network for single image dehazing. In: Proceedings of the AAAI conference on artificial intelligence 34(07):11 908-11 915

  41. Hong M, Xie Y, Li C, Qu Y (2020) Distilling image dehazing with heterogeneous task imitation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3462–3471

  42. Dong H, Pan J, Xiang L, Hu Z, Zhang X, Wang F, Yang M-H (2020) Multi-scale boosted dehazing network with dense feature fusion. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2157–2167

  43. Zhang X, Wang T, Wang J, Tang G, Zhao L (2020) Pyramid channel-based feature attention network for image dehazing. Comput Vis Image Underst 197:103003

    Article  Google Scholar 

  44. Zheng Z, Ren W, Cao X, Hu X, Wang T, Song F, Jia X (2021) Ultra-high-definition image dehazing via multi-guided bilateral learning. In: 2021 IEEE/CVF conference on computer vision and pattern recognition (CVPR). IEEE, pp 16 180–16 189

  45. Zhao S, Zhang L, Shen Y, Zhou Y (2021) Refinednet: a weakly supervised refinement framework for single image dehazing. IEEE Trans Image Process 30:3391–3404

    Article  Google Scholar 

  46. Dong Y, Liu Y, Zhang H, Chen S, Qiao Y (2020) Fd-gan: generative adversarial networks with fusion-discriminator for single image dehazing. In: Proceedings of the AAAI conference on artificial intelligence 34(07):10 729-10 736

  47. Shao Y, Li L, Ren W, Gao C, Sang N (2020) Domain adaptation for image dehazing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2808–2817

  48. Parihar AS, Singh K, Ganotra A, Yadav A, et al (2022) Contrast aware image dehazing using generative adversarial network. In: 2nd international conference on intelligent technologies (CONIT). IEEE 2022, pp 1–6

  49. Zhu J, Meng L, Wu W, Choi D, Ni J (2021) Generative adversarial network-based atmospheric scattering model for image dehazing. Digital Commun Netw 7(2):178–186

    Article  Google Scholar 

  50. Ren W, Zhou L, Chen J (2023) Unsupervised single image dehazing with generative adversarial network. Multimedia Syst 29(5):2923–2933

    Article  Google Scholar 

  51. Manu CM, Sreeni K (2023) Ganid: a novel generative adversarial network for image dehazing. Vis Comput 39(9):3923–3936

    Article  Google Scholar 

  52. Narwaria M, Lin W (2011) Svd-based quality metric for image and video using machine learning. IEEE Trans Syst Man Cybern Part B Cybern 42(2):347–364

    Article  Google Scholar 

  53. Hu A, Zhang R, Yin D, Zhan Y (2014) Image quality assessment using a svd-based structural projection. Signal Process Image Commun 29(3):293–302

    Article  Google Scholar 

  54. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde -Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Adv Neural Inf Process Syst 27

  55. Isola P, Zhu J-Y, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1125–1134

  56. Liu Z, Xiao B, Alrabeiah M, Wang K, Chen J (2019) Single image dehazing with a generic model-agnostic convolutional neural network. IEEE Signal Process Lett 26(6):833–837

    Article  Google Scholar 

  57. Chen D, He M, Fan Q, Liao J, Zhang L, Hou D, Yuan L, Hua G (2019) Gated context aggregation network for image dehazing and deraining. In: IEEE winter conference on applications of computer vision (WACV). IEEE 2019, pp 1375–1383

  58. Wu H, Qu Y, Lin S, Zhou J, Qiao R, Zhang Z, Xie Y, Ma L (2021) Contrastive learning for compact single image dehazing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 10 551–10 560

  59. Ancuti CO, Ancuti C, Timofte R, Vleeschouwer CD (2018) O-haze: a dehazing benchmark with real hazy and haze-free outdoor images. In: IEEE conference on computer vision and pattern recognition, NTIRE Workshop, ser. NTIRE CVPR’18

  60. Sakaridis C, Dai D, Hecker S, Van Gool L (2018) Model adaptation with synthetic and real data for semantic dense foggy scene understanding. In: Proceedings of the european conference on computer vision (ECCV), pp 687–704

  61. Goodarzi S, Gitizadeh M, Abbasi AR, Lehtonen M (2020) Tight convex relaxation for tep problem: a multiparametric disaggregation approach. IET Gen Transm Distrib 14(14):2810–2817

    Article  Google Scholar 

  62. Abbasi AR, Mohammadi M (2023) Probabilistic load flow in distribution networks: an updated and comprehensive review with a new classification proposal. Electric Power Syst Res 222:109497

    Article  Google Scholar 

  63. Abdar M, Pourpanah F, Hussain S, Rezazadegan D, Liu L, Ghavamzadeh M, Fieguth P, Cao X, Khosravi A, Acharya UR et al (2021) A review of uncertainty quantification in deep learning: techniques, applications and challenges. Inf Fusion 76:243–297

    Article  Google Scholar 

  64. Zou K, Chen Z, Yuan X, Shen X, Wang M, Fu H (2023) A review of uncertainty estimation and its application in medical imaging. arXiv preprint arXiv:2302.08119

Download references

Author information

Authors and Affiliations

  1. CIAD UMR 7533, UTBM, 90010, Belfort, France

    Ibrahim Kajo, Mohamed Kas, Abderrazak Chahi & Yassine Ruichek

Authors
  1. Ibrahim Kajo
    View author publications

    Search author on:PubMed Google Scholar

  2. Mohamed Kas
    View author publications

    Search author on:PubMed Google Scholar

  3. Abderrazak Chahi
    View author publications

    Search author on:PubMed Google Scholar

  4. Yassine Ruichek
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Ibrahim Kajo.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kajo, I., Kas, M., Chahi, A. et al. Subspace-guided GAN for realistic single-image dehazing scenarios. Neural Comput & Applic 36, 17023–17044 (2024). https://doi.org/10.1007/s00521-024-09969-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-024-09969-4

Keywords