Skip to main content

Advertisement

Log in

Image smog restoration using oblique gradient profile prior and energy minimization

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

Removing the smog from digital images is a challenging pre-processing tool in various imaging systems. Therefore, many smog removal (i.e., desmogging) models are proposed so far to remove the effect of smog from images. The desmogging models are based upon a physical model, it means it requires efficient estimation of transmission map and atmospheric veil from a single smoggy image. Therefore, many prior based restoration models are proposed in the literature to estimate the transmission map and an atmospheric veil. However, these models utilized computationally extensive minimization of an energy function. Also, the existing restoration models suffer from various issues such as distortion of texture, edges, and colors. Therefore, in this paper, a convolutional neural network (CNN) is used to estimate the physical attributes of smoggy images. Oblique gradient channel prior (OGCP) is utilized to restore the smoggy images. Initially, a dataset of smoggy and sunny images are obtained. Thereafter, we have trained CNN to estimate the smog gradient from smoggy images. Finally, based upon the computed smog gradient, OGCP is utilized to restore the still smoggy images. Performance analyses reveal that the proposed CNN-OGCP based desmogging model outperforms the existing desmogging models in terms of various performance metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Li C, Guo J, Cong R, Pang Y, Wang B. Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior. IEEE Transactions on Image Processing, 2016, 25(12): 5664–5677

    Article  MATH  Google Scholar 

  2. Nnolim U A. Partial differential equation-based hazy image contrast enhancement. Computers & Electrical Engineering, 2018, 72: 670–681

    Article  Google Scholar 

  3. Kim J H, Jang W D, Sim J Y, Kim C S. Optimized contrast enhancement for real-time image and video dehazing. Journal of Visual Communication and Image Representation, 2013, 24(3): 410–425

    Article  Google Scholar 

  4. Kim K, Kim S, Kim K S. Effective image enhancement techniques for fog-affected indoor and outdoor images. IET Image Processing, 2018, 12(4): 465–471

    Article  Google Scholar 

  5. Shi Z, Feng Y, Zhao M, Zhang E, He L. Let you see in sand dust weather: a method based on halo-reduced dark channel prior dehazing for sanddust image enhancement. IEEE Access, 2019, 7: 116722–116733

    Article  Google Scholar 

  6. Lai Y, Chen Y, Chiou C, Hsu C. Single-image dehazing via optimal transmission map under scene priors. IEEE Transactions on Circuits and Systems for Video Technology, 2015, 25(1): 1–14

    Article  Google Scholar 

  7. Bui T M, Kim W. Single image dehazing using color ellipsoid prior. IEEE Transactions on Image Processing, 2018, 27(2): 999–1009

    Article  MATH  Google Scholar 

  8. Yu T, Riaz I, Piao J, Shin H. Real-time single image dehazing using block-to-pixel interpolation and adaptive dark channel prior. IET Image Processing, 2015, 9(9): 725–734

    Article  Google Scholar 

  9. Golts A, Freedman D, Elad M. Unsupervised single image dehazing using dark channel prior loss. IEEE Transactions on Image Processing, 2020, 29: 2692–2701

    Article  MATH  Google Scholar 

  10. Zhu M, He B, Wu Q. Single image dehazing based on dark channel prior and energy minimization. IEEE Signal Processing Letters, 2018, 25(2): 174–178

    Article  Google Scholar 

  11. Xiao J, Zhu L, Zhang Y, Liu E, Lei J. Scene-aware image dehazing based on sky-segmented dark channel prior. IET Image Processing, 2017, 11(12): 1163–1171

    Article  Google Scholar 

  12. Singh D, Kumar V, Kaur M. Single image dehazing using gradient channel prior. Applied Intelligence, 2019, 49(12): 4276–4293

    Article  Google Scholar 

  13. Bala J, Lakhwani K. Single image desmogging using oblique gradient profile prior and variational minimization. Multidimensional Systems and Signal Processing, 2020, 31: 1259–1275

    Article  MATH  Google Scholar 

  14. Zhao D, Xu L, Yan Y, Chen J, Duan L Y. Multi-scale optimal fusion model for single image dehazing. Signal Processing: Image Communication, 2019, 74: 253–265

    Google Scholar 

  15. Jiang Y, Sun C, Zhao Y, Yang L. Image dehazing using adaptive bichannel priors on superpixels. Computer Vision and Image Understanding, 2017, 165: 17–32

    Article  Google Scholar 

  16. Wang Y, Huang T Z, Zhao X L, Deng L J, Ji T Y. A convex single image dehazing model via sparse dark channel prior. Applied Mathematics and Computation, 2020, 375: 125085

    Article  Google Scholar 

  17. Gui B, Zhu Y, Zhen T. Adaptive single image dehazing method based on support vector machine. Journal of Visual Communication and Image Representation, 2020, 70: 102792

    Article  Google Scholar 

  18. Yin S, Wang Y, Yang Y H. A novel image-dehazing network with a parallel attention block. Pattern Recognition, 2020, 102: 107255

    Article  Google Scholar 

  19. Liang Z, Wang Y, Ding X, Mi Z, Fu X. Single underwater image enhancement by attenuation map guided color correction and detail preserved dehazing. Neurocomputing, 2021, 425: 160–172

    Article  Google Scholar 

  20. Zhang J, Wang X, Yang C, Zhang J, He D, Song H. Image dehazing based on dark channel prior and brightness enhancement for agricultural remote sensing images from consumer-grade cameras. Computers and Electronics in Agriculture, 2018, 151: 196–206

    Article  Google Scholar 

  21. Emberton S, Chittka L, Cavallaro A. Underwater image and video dehazing with pure haze region segmentation. Computer Vision and Image Understanding, 2018, 168: 145–156

    Article  Google Scholar 

  22. Xiao J, Shen M, Lei J, Zhou J, Klette R, Sui H. Single image dehazing based on learning of haze layers. Neurocomputing, 2020, 389: 108–122

    Article  Google Scholar 

  23. Guo F, Zhao X, Tang J, Peng H, Liu L, Zou B. Single image dehazing based on fusion strategy. Neurocomputing, 2020, 378: 9–23

    Article  Google Scholar 

  24. Gao Y, Li Q, Li J. Single image dehazing via a dual-fusion method. Image and Vision Computing, 2020, 94: 103868

    Article  Google Scholar 

  25. Khan H, Sharif M, Bibi N, Usman M, Haider S A, Zainab S, Shah J H, Bashir Y, Muhammad N. Localization of radiance transformation for image dehazing in wavelet domain. Neurocomputing, 2020, 381: 141–151

    Article  Google Scholar 

  26. Borkar K, Mukherjee S. Single image dehazing by approximating and eliminating the additional airlight component. Neurocomputing, 2020, 400: 294–308

    Article  Google Scholar 

  27. Galdran A. Image dehazing by artificial multiple-exposure image fusion. Signal Processing, 2018, 149: 135–147

    Article  Google Scholar 

  28. Singh D, Kumar V. A novel dehazing model for remote sensing images. Computers & Electrical Engineering, 2018, 69: 14–27

    Article  Google Scholar 

  29. Yuan F, Zhou Y, Xia X, Shi J, Fang Y, Qian X. Image dehazing based on a transmission fusion strategy by automatic image matting. Computer Vision and Image Understanding, 2020, 194: 102933

    Article  Google Scholar 

  30. Wang W, He C, Xia X G. A constrained total variation model for single image dehazing. Pattern Recognition, 2018, 80: 196–209

    Article  Google Scholar 

  31. Alajarmeh A, Salam R, Abdulrahim K, Marhusin M, Zaidan A, Zaidan B. Real-time framework for image dehazing based on linear transmission and constant-time airlight estimation. Information Sciences, 2018, 436: 108–130

    Article  Google Scholar 

  32. Singh D, Kumar V. Dehazing of outdoor images using notch based integral guided filter. Multimedia Tools and Applications, 2018, 77(20): 27363–27386

    Article  Google Scholar 

  33. Basavegowda H S, Dagnew G. Deep learning approach for microarray cancer data classification. CAAI Transactions on Intelligence Technology, 2020, 5(1): 22–33

    Article  Google Scholar 

  34. Singh D, Kumar V. Single image defogging by gain gradient image filter. Science China Information Sciences, 2019, 62(7): 79101

    Article  Google Scholar 

  35. Osterland S, Weber J. Analytical analysis of single-stage pressure relief valves. International Journal of Hydromechatronics, 2019, 2(1): 32–53

    Article  Google Scholar 

  36. Wang R, Yu H, Wang G, Zhang G, Wang W. Study on the dynamic and static characteristics of gas static thrust bearing with micro-hole restrictors. International Journal of Hydromechatronics, 2019, 2(3): 189–202

    Article  Google Scholar 

  37. Qi G, Wang H, Haner M, Weng C, Chen S, Zhu Z. Convolutional neural network based detection and judgement of environmental obstacle in vehicle operation. CAAI Transactions on Intelligence Technology, 2019, 4(2): 80–91

    Article  Google Scholar 

  38. Singh D, Kumar V, Kaur M. Image dehazing using window-based integrated means filter. Multimedia Tools and Applications, 2020, 79: 34771–34793

    Article  Google Scholar 

  39. Kaur M, Singh D, Kumar V, Sun K. Color image dehazing using gradient channel prior and guided l0 filter. Information Sciences, 2020, 521: 326–342

    Article  MATH  Google Scholar 

  40. Singh D, Kumar V. Image dehazing using moore neighborhood-based gradient profile prior. Signal Processing: Image Communication, 2019, 70: 131–144

    Google Scholar 

  41. Wiens T. Engine speed reduction for hydraulic machinery using predictive algorithms. International Journal of Hydromechatronics, 2019, 2(1): 16–31

    Article  Google Scholar 

  42. Levin A, Lischinski D, Weiss Y. A closed form solution to natural image matting. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2006

  43. Singh D, Kumar V, Kaur M. Classification of COVID-19 patients from chest CT images using multi-objective differential evolution-based convolutional neural networks. European Journal of Clinical Microbiology & Infectious Diseases, 2020, 39(7): 1379–1389

    Article  Google Scholar 

  44. Ding R, Dai L, Li G, Liu H. TDD-net: a tiny defect detection network for printed circuit boards. CAAI Transactions on Intelligence Technology, 2019, 4(2): 110–116

    Article  Google Scholar 

  45. Kaur M, Kumar V. Beta chaotic map based image encryption using genetic algorithm. International Journal of Bifurcation and Chaos, 2018, 28(11): 1850132

    Article  MATH  Google Scholar 

  46. Kaur M, Singh D, Uppal R S. Parallel strength pareto evolutionary algorithm-ii based image encryption. IET Image Processing, 2019, 14(6): 1015–1026

    Article  Google Scholar 

  47. Gupta A, Singh D, Kaur M. An efficient image encryption using non-dominated sorting genetic algorithm-III based 4-D chaotic maps. Journal of Ambient Intelligence and Humanized Computing, 2020, 11(3): 1309–1324

    Article  Google Scholar 

  48. Kaur M, Singh D, Sun K, Rawat U. Color image encryption using non-dominated sorting genetic algorithm with local chaotic search based 5D chaotic map. Future Generation Computer Systems, 2020, 107: 333–350

    Article  Google Scholar 

  49. Kaur M, Kumar V, Li L. Color image encryption approach based on memetic differential evolution. Neural Computing and Applications, 2019, 31(11): 7975–7987

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank their organizations especially Teerthanker Mahaveer University, Moradabad, India to provide suitable time and resources to successfully finish this research work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Arpit Jain.

Additional information

Ashok Kumar received the PhD in Computer Science from Gurukula Kangri Vishwavidyalaya Haridwar, India in 2019 and Master’s degree in Computer Applications from Dr. Bhim Rao Ambedkar University Agra, India in 2002. He is an associate professor at the College of Computing Science and Information Technology, Teerthanker Mahaveer University Moradabad, India. He has authored 20 research papers in the International/National Journals and Conferences.

Arpit Jain has competent, diligent & result oriented professional, offering over 16+ years of exposure across teaching in the field of Computer Science; currently spearheading as associate professor with Teerthanker Mahaveer University, India. He received the B Tech degree from UPTU, India in 2006, the M Tech degree from Shobhit Universirt, India and the PhD degrees from the Teerthanker Mahaveer University, India, all in Computer Science and Engineering. His current research interests are in the area of image processing, chip implementation by introducing the concept of Machine learning.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, A., Jain, A. Image smog restoration using oblique gradient profile prior and energy minimization. Front. Comput. Sci. 15, 156706 (2021). https://doi.org/10.1007/s11704-020-9305-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11704-020-9305-8

Keywords