Skip to main content
SpringerLink
Log in

Color layers -Based progressive network for Single image dehazing

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

While deep learning-based dehazing methods have achieved significant success in recent years, most emphasize more on dehazing and less on image color recovery. In this paper, we propose a progressive network incorporating color layers. It gradually recovers the image by repeatedly invoking an auxiliary progressive network. The RGBA image information captured by the soft color segmentation is used as the input for the auxiliary learning. Specifically, we first introduce the gated recurrent unit in the feature extraction module, which can effectively extract image features while preventing model overfitting. Next, local features are extracted in the residual learning module by combining the recurrent layer and residual blocks. Finally composite module integrates the features to produce a clean image with rich details. In addition, recursive computation is used in each stage to reduce network parameters while improving performance. Extensive experimental results demonstrate that the proposed method outperforms the state-of-the-arts quantitatively and qualitatively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Akimoto N, Zhu H, Jin Y, Aoki Y (2020) Fast soft color segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 8277–8286

  2. Akimoto N, Zhu H, Jin Y, Aoki Y (2020) Fast soft color segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 8277–8286

  3. Aksoy Y, Aydin TO, Smolić A, Pollefeys M (2017) Unmixing-based soft color segmentation for image manipulation. ACM Transactions on Graphics (TOG) 36:1–19

    Article  Google Scholar 

  4. Aksoy Yaġiz, Oh Tae-Hyun, Paris S, Pollefeys M, Matusik W (2018) Semantic soft segmentation. ACM Transactions on Graphics (TOG) 37:1–13

    Article  Google Scholar 

  5. Anvari Z, Athitsos V (2020) Dehaze-GLCGAN:, unpaired single image de-hazing via adversarial training, arXiv:2008.06632

  6. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25:5187–5198

    Article  MathSciNet  Google Scholar 

  7. Chen W-T, Fang H-Y, Ding J-J, Kuo S-Y (2020) PMHLD: Patch Map Based Hybrid Learning DehazeNet For Single Image Haze Removal. IEEE Transactions on Image Processing

  8. Chen D, He M, Fan Q, Liao J, Zhang L, Hou D, Yuan L, Hua G (2019) Gated context aggregation network for image dehazing and deraining. 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) 1375–1383

  9. Dharejo FA, Zhou Y, Deeba F, Du Y (2019) A color enhancement scene estimation approach for single image haze removal. IEEE Geoscience and Remote Sensing Letters

  10. Dong H, Pan J, Xiang L, Hu Z, Zhang X, Wang F, Yang M-H (2020) Multi-Scale Boosted dehazing network with dense feature fusion. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 2157–2167

  11. Fattal R (2008) Single image dehazing. ACM transactions on graphics (TOG) 27:1–9

    Article  Google Scholar 

  12. Fries R, Modestino J (1979) Image enhancement by stochastic homomorphic filtering. IEEE Transactions on Acoustics Speech, and Signal Processing 27:625–637

    Article  Google Scholar 

  13. He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE transactions on Pattern Analysis and Machine Intelligence 33:2341–2353

    Google Scholar 

  14. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  15. Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694–711

  16. Khatun A, Haque MR, Basri R, Uddin MS et al (2020) Single image dehazing: an analysis on generative adversarial network. Journal of Computer and Communications 8:127

    Article  Google Scholar 

  17. Kim J-Y, Kim L-S, Hwang S-H (2001) An advanced contrast enhancement using partially overlapped sub-block histogram equalization. IEEE Transactions on Circuits and Systems for Video Technology 11:475–484

    Article  Google Scholar 

  18. Kinoshita Y, Kiya H (2020) Hue-Correction Scheme based on Constant-Hue plane for Deep-Learning-Based Color-Image enhancement. IEEE Access 8:9540–9550

    Article  Google Scholar 

  19. Koyama Y, Goto M (2018) Decomposing images into layers with advanced color blending, 397– 407

  20. Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4681–4690

  21. Li J, Feng X, Hua Z (2021) Low-light image enhancement via progressive-recursive network. IEEE Transactions on Circuits and Systems for Video Technology

  22. Li J, Li G, Fan H (2018) Image dehazing using residual-based deep CNN. IEEE Access 6:26831–26842

    Article  Google Scholar 

  23. Li B, Peng X, Wang Z, Xu J, Feng D (2017) An all-in-one network for dehazing and beyond, arXiv:1707.06543

  24. Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z (2017) Reside:, A benchmark for single image dehazing, arXiv:1712.04143, 1

  25. Li M-W, Wang Y-T, Geng J, Hong W-C (2021) Chaos cloud quantum bat hybrid optimization algorithm. Nonlinear Dynamics 103(1):1167–1193

    Article  Google Scholar 

  26. Li B, Zhao J, Fu H (2020) DLT-Net: deep learning transmittance network for single image haze removal. In: Signal Image and Video Processing, pp 1–9

  27. Li L, Zhou Y, Wu J, Qian J, Chen B (2016) Color-Enriched Gradient similarity for retouched image quality evaluation. IEICE Trans Inf Syst 99:773–776

    Article  Google Scholar 

  28. Liu X, Ma Y, Shi Z, Chen J (2019) Griddehazenet: Attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE International Conference on Computer Vision, pp 7314– 7323

  29. Liu Y, Zhao G (2018) Pad-net:, A perception-aided single image dehazing arXiv:1805.03146

  30. Lou W, Li Y, Yang G, Chen C, Yang H, Yu T (2020) Integrating haze density features for fast nighttime image dehazing. IEEE Access 8:113318–113330

    Article  Google Scholar 

  31. Meng G, Wang Y, Duan J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization, 617–624. In: Proceedings of the IEEE international conference on computer vision Proceedings of the IEEE international conference on computer vision

  32. Narasimhan SG, Nayar SK (2000) Chromatic framework for vision in bad weather. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No PR00662), vol 1, pp 598–605

  33. Narasimhan SG, Nayar SK (2003) Contrast restoration of weather degraded images. IEEE Transactions on Pattern Analysis and Machine Intelligence 25:713–724

    Article  Google Scholar 

  34. Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch

  35. Peng Y-T, Lu Z, Cheng F-C, Zheng Y, Huang S-C (2019) Image Haze Removal Using Airlight White Correction, Local light filter, and aerial perspective prior. IEEE Trans Circuits Syst Video Technol 30:1385–1395

    Article  Google Scholar 

  36. Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) FFA-net: Feature fusion attention network for single image dehazing. In: AAAI, pp 11908–11915

  37. Ren W, Pan J, Zhang H, Cao X, Yang M-H (2020) Single image dehazing via multi-scale convolutional neural networks with holistic edges. Int J Comput Vis 128:240–259

    Article  Google Scholar 

  38. Ren D, Zuo W, Hu Q, Zhu P, Meng D (2019) Progressive image deraining networks: a better and simpler baseline. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3937–3946

  39. Silberman N, Hoiem D, Kohli P, Fergus R (2012) Indoor segmentation and support inference from rgbd images. In: European conference on computer vision, pp 746–760

  40. Stark JA (2000) Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Trans Image Process 9:889–896

    Article  Google Scholar 

  41. Tai Y-W, Jia J, Tang C-K (2007) Soft color segmentation and its applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 29:1520–1537

    Article  Google Scholar 

  42. Tan RT (2008) Visibility in bad weather from a single image. 2008 IEEE Conference on Computer Vision and Pattern Recognition, 1–8

  43. Tan J, Echevarria J, Gingold Y (2018) Efficient palette-based decomposition and recoloring of images via RGBXY-space geometry. ACM Transactions on Graphics (TOG) 37:1–10

    Article  Google Scholar 

  44. Tan J, Echevarria J, Gingold Y (2018) Efficient palette-based decomposition and recoloring of images via RGBXY-space geometry. ACM Transactions on Graphics (TOG) 37:1–10

    Article  Google Scholar 

  45. Tangsakul S, Wongthanavasu S (2020) Single image haze removal using deep cellular automata learning. IEEE Access 8:103181–103199

    Article  Google Scholar 

  46. Wang JB, He N, Ke L (2015) A new single image dehazing method with MSRCR algorithm. In: Proceedings of the 7th International Conference on Internet Multimedia Computing and Service , pp 1–4

  47. Wang Z, Yang Y (2018) A non-iterative clustering based soft segmentation approach for a class of fuzzy images. Appl Soft Comput 70:988–999

    Article  Google Scholar 

  48. Wu Q, Zhang J, Ren W, Zuo W, Cao X (2019) Accurate transmission estimation for removing haze and noise from a single image. IEEE Trans Image Process 29:2583–2597

    Article  Google Scholar 

  49. Xie B, Guo F, Cai Z (2010) Improved single image dehazing using dark channel prior and multi-scale retinex. 2010 International Conference on Intelligent System Design and Engineering Application 1:848–851

    Article  Google Scholar 

  50. Yamak PT, Yujian L, Gadosey PK (2019) A Comparison between ARIMA, LSTM, and GRU for Time Series Forecasting. In: Proceedings of the 2019 2nd International Conference on Algorithms, Computing and Artificial Intelligence, pp 49–55

  51. Zhang W, Dong L, Pan X, Zhou J, Qin L, Xu W (2019) Single image defogging based on multi-channel convolutional MSRCR. IEEE Access 7:72492–72504

    Article  Google Scholar 

  52. Zhang Z, Hong W-C (2021) Application of variational mode decomposition and chaotic grey wolf optimizer with support vector regression for forecasting electric loads. Knowl-Based Syst 228: 107297

    Article  Google Scholar 

  53. Zhang T, Yang X, Wang X, Wang R (2020) Deep joint neural model for single image haze removal and color correction. Information Sciences

  54. Zhao S, Zhang L, Huang S, Shen Y, Zhao S (2020) Dehazing evaluation: Real-world Benchmark Datasets. In: Criteria and Baselines, IEEE Transactions on Image Processing

  55. Zhou J, Zhou F (2013) Single image dehazing motivated by Retinex theory. 2013 2nd international symposium on instrumentation and measurement, sensor network and automation (IMSNA) 243– 247

  56. Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24:3522–3533

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

The authors acknowledge the National Natural Science Foundation of China (61772319, 62002200, 61976125 and 61976124), and Shandong Natural Science Foundation of China (ZR2020QF012 and ZR2021MF068).

Author information

Authors and Affiliations

  1. School of Information and Electronic Engineering, Shandong Technology and Business University, Yantai, 264005, China

    Xiaoling Li & Zhen Hua

  2. School of Computer Science and Technology, Shandong Technology and Business University, Yantai, 264005, China

    Jinjiang Li

Authors
  1. Xiaoling Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhen Hua
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jinjiang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhen Hua.

Ethics declarations

Conflict of Interests

All authors declare that there are no conflicts of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, X., Hua, Z. & Li, J. Color layers -Based progressive network for Single image dehazing. Multimed Tools Appl 81, 32755–32778 (2022). https://doi.org/10.1007/s11042-022-12731-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12731-4

Keywords

Search

Navigation