Skip to main content
Springer Nature Link
Log in

A new haze removal approach for sky/river alike scenes based on external and internal clues

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Sky/river alike areas are important parts of natural scenes. The haze of these areas will impact the vividness of natural scenes. More serious, once the haze occurs in navigation of flight and ship, it will threaten the safety. However, previous researches did not dehaze well for these areas. In this paper, a new haze removal approach is presented to improve the dehazing effect for the sky/river alike areas based on our new discovers. Inspired by the two discovers, we define two theoretical clues: the external boundary clue and the internal clue. And then a correction model is constructed to correct the dark channel values in the sky/river alike areas. Finally, an optimization solution is presented to solve this model. Both the visual experiment and the quantitative experiment show that proposed method outperforms the classical dark channel method and the deep learning method in sky/river alike areas.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Achar S, Sankaran B, Nuske S, Scherer S, Singh S (2011) Self-supervised segmentation of river scenes. In: IEEE international conference on robotics and automation, pp 6227–6232

  2. Alajarmeh A, Zaidan AA (2018) A real-time framework for video dehazing using bounded transmission and controlled Gaussian filter. Multimed Tools Appl 77 (20):26315–26350

    Google Scholar 

  3. Ancuti CO, Ancuti C, Hermans C, Bekaert P (2010) A fast semi-inverse approach to detect and remove the haze from a single image. Computer Vision–ACCV 2011:501–514

    Google Scholar 

  4. Berman D, Treibitz T, Avidan S (2016) Non-local image dehazing. In: IEEE conference on computer vision and pattern recognition, pp 1674–1682

  5. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal[J]. IEEE Trans Image Process 25(11):5187–5198

    MathSciNet  MATH  Google Scholar 

  6. Chaudhury KN (2013) Acceleration of the shiftable algorithm for bilateral filtering and nonlocal means[J]. IEEE Trans Image Process 22(4):1291–1300

    MathSciNet  MATH  Google Scholar 

  7. Chen X, He F, Yu H (2019) A matting method based on full feature coverage. Multimed Tools Appl 78(9):11173–11201

    Google Scholar 

  8. Cheng Z, Ding Y, He X, Zhu L, Song X, Kankanhalli M (2017) A3NCF: an adaptive aspect attention model for rating prediction. In: IJCAI, pp 3748–3754

  9. Dilbag S, Vijay K (2018) Dehazing of outdoor images using notch based integral guided filter. Multimed Tools Appl 77(20):27363–27386

    Google Scholar 

  10. Ding M, Tong RF (2013) Efficient dark channel based image dehazing using quadtrees. Science China Information Sciences 56(9):1–9

    Google Scholar 

  11. Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E (2014) DeCAF: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655

  12. Fan X, Wang Y, Tang X, Gao R, Luo Z (2017) Two-layer gaussian process regression with example selection for image dehazing. IEEE Trans Circ Sys Video Technol 27(12):2505–2517

    Google Scholar 

  13. Fattal R (2008) Single image dehazing. ACM Trans Graph 27(3):72

    Google Scholar 

  14. Feng C, Zhuo S, Zhang X, Shen L, Susstrunk S (2013) Near-infrared guided color image dehazing. In: 20th IEEE international conference on image processing, pp 2363–2367

  15. Fu Y, Yan QG, Yang L, Liao J, Xiao C (2018) Texture mapping for 3D reconstruction with RGB-D sensor. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4645–4653

  16. Gao Z, Wang DY, Xue YB, Xu GP, Zhang H, Wang YL (2018) 3D object recognition based on pairwise multi-view convolutional neural networks. Journal of Visual Communication and Image Representation 56:305–315

    Google Scholar 

  17. He K, Sun J, Tang X (2011) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Google Scholar 

  18. He L, Bai H, Jiang Y, Ouyang D, Jiang S (2018) Revised simplex algorithm for linear programming on GPUs with CUDA. Multimed Tools Appl 77 (22):30035–30050

    Google Scholar 

  19. Hong C, Yu J, Wan J, Tao D, Wang M (2015) Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24(12):5659–70

    MathSciNet  MATH  Google Scholar 

  20. Hou N, He F, Zhou Y, Chen Y (2019) An efficient GPU-based parallel tabu search algorithm for hardware/software co-design. Frontiers of Computer Science. https://doi.org/10.1007/s11704-019-8184-3

  21. Kim H, Cha M, Mun D (2017) Shape distribution-based retrieval of 3D CAD models at different levels of detail. Multimed Tools Appl 76(14):15867–15884

    Google Scholar 

  22. Kwon S, Kim BC, Mun D, Han S (2015) Simplification of feature-based 3D CAD assembly data of ship and offshore equipment using quantitative evaluation metrics. Comput Aided Des 59:140–154

    Google Scholar 

  23. Kwon S, Mun D, Kim BC, Han S (2017) Feature shape complexity: a new criterion for the simplification of feature-based 3D CAD models. Int J Adv Manuf Technol 88(5-8):1831–1843

    Google Scholar 

  24. Land EH, McCann JJ (1971) Lightness and retinex theory. Josa 61(1):1–11

    Google Scholar 

  25. Li B, Peng X, Wang Z, Xu J, Feng D (2017) AOD-net: all-in-one dehazing network. In: IEEE international conference on computer vision, pp 4770–4778

  26. Li H, He F, Liang Y, Quan Q (2019) A dividing-based many-objective evolutionary algorithm for large-scale feature selection. https://doi.org/10.1007/s00500-019-04324-5

  27. Li H, He F, Yan X (2019) IBEA-SVM: an indicator-based evolutionary algorithm based on pre-selection with classification guided by SVM. Appl Math-A J Chinese Univ 34(1):1–26

    MathSciNet  MATH  Google Scholar 

  28. Li K, He F, Yu H, Chen X (2019) A parallel and robust object tracking approach synthesizing adaptive Bayesian learning and improved incremental subspace learning. Frontiers of Computer Science 13(5):1116–1135

    Google Scholar 

  29. Luo J, He F, Yong J (2020) An efficient and robust bat algorithm with fusion of opposition-based learning and whale optimization algorithm. Intell Data Anal 24 (3):1–18

    Google Scholar 

  30. Makarau A, Richter R, Muller R, Reinartz P (2014) Haze detection and removal in remotely sensed multispectral imagery. IEEE Trans Geosci Remote Sens 52 (9):5895–5905

    Google Scholar 

  31. McCartney EJ (1976) Optics of the atmosphere: scattering by molecules and particles. New York, Wiley, p 421

    Google Scholar 

  32. Mittal A, Moorthy AK, Bovik AC (2012) No-reference image quality assessment in the spatial domain. IEEE Trans Image Process 21(12):4695–4708

    MathSciNet  MATH  Google Scholar 

  33. Narasimhan SG, Nayar SK (2001) Removing weather effects from monochrome images. In: IEEE computer society conference on computer vision and pattern recognition, pp 186–193

  34. Narasimhan SG, Nayar SK (2002) Vision and the atmosphere. Int J Comput Vis 48(3):233–254

    MATH  Google Scholar 

  35. Pan Y, He F, Yu H (2019) A correlative denoising autoencoder to model social influence for top-N recommender system. Frontiers of Computer Science. https://doi.org/10.1007/s11704-019-8123-3

  36. Pan YT, He FZ, Yu HP (2019) A novel enhanced collaborative autoencoder with knowledge distillation for top-N recommender systems. Neurocomputing 332:137–148

    Google Scholar 

  37. Pei SC, Lee TY (2012) Nighttime haze removal using color transfer pre-processing and dark channel prior. In: 19th IEEE international conference on image processing, pp 957–960

  38. Provenzi E, Carli LD, Rizzi A, Marini D (2005) Mathematical definition and analysis of the Retinex algorithm. JOSA A 22(12):2613–2621

    MathSciNet  Google Scholar 

  39. Raikwar SC, Tapaswi S (2018) An improved linear depth model for single image fog removal. Multimed Tools Appl 77(15):19719–19744

    Google Scholar 

  40. Reinhard E, Ashikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl 21(5):34–41

    Google Scholar 

  41. Saad MA, Bovik AC (2012) Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans Image Process 21(8):3339–3352

    MathSciNet  MATH  Google Scholar 

  42. Sun J, He FZ, Chen YL, Chen X (2016) A multiple template approach for robust tracking of fast motion target. Appl Math-A J Chinese Univ 31(2):177–197

    MathSciNet  MATH  Google Scholar 

  43. Tan HL, He XF, Wang ZJ, Liu GM (2017) Parallel implementation and optimization of high definition video real-time dehazing. Multimed Tools Appl 76 (22):23413–23434

    Google Scholar 

  44. Tan RT (2008) Visibility in bad weather from a single image. In: IEEE computer society conference on computer vision and pattern recognition, pp 1–8

  45. Tarel JP, Hautiere N (2009) Fast visibility restoration from a single color or gray level image. In: 2009 IEEE 12th international conference on computer vision, pp 2201–2208

  46. Wang M, Mai J, Liang Y, Cai R, Fu TZ, Zhang Z (2018) A component-driven distributed framework for real-time video dehazing. Multimed Tools Appl 77(9):11259–11276

    Google Scholar 

  47. Wu YQ, He FZ, Zhang DJ, Li XX (2018) Service-oriented feature-based data exchange for cloud-based design and manufacturing. IEEE Trans Serv Comput 11 (2):341–353

    Google Scholar 

  48. Xiao C, Gan J (2012) Fast image dehazing using guided joint bilateral filter. Vis Comput 28(6-8):713–721

    Google Scholar 

  49. Xu H, Guo J, Liu Q (2012) Fast image dehazing using improved dark channel prior. In: International conference on information science and technology, pp 663–667

  50. Yan Q, Long Y, Chao L, Liu H, Hu R (2016) Geometrically based linear iterative clustering for quantitative feature correspondence. Comput Graph Forum 35 (7):1–10

    Google Scholar 

  51. Yan Q, Yang L, Zhang L, Xiao C (2017) Distinguishing the indistinguishable: exploring structural ambiguities via geodesic context. In: IEEE conference on computer vision and pattern recognition, pp 152–160

  52. Yan XH, He FZ, Hou N, Ai HJ (2018) An efficient particle swarm optimization for large scale hardware/software co-design system. Int J Coop Inf Sys 23 (5):2019–2032

    Google Scholar 

  53. Yang L, Yan Q, Fu Y, Xiao C (2018) Surface reconstruction via fusing sparse-sequence of depth images. IEEE Trans Vis Comput Graph 23(2):1190–1203

    Google Scholar 

  54. Yong J, He F, Li H, Zhou W (2019) A novel bat algorithm based on cross boundary learning and uniform explosion strategy. Applied Mathematics-A Journal of Chinese Universities. https://doi.org/10.1007/s11766-019-3714-1

    MathSciNet  Google Scholar 

  55. Youcef D, Djamel D, Asma B, Philippe FV, Jerry CWL, Ahcene B (2018) Exploiting GPU parallelism in improving bees swarm optimization for mining big transactional databases. Inf Sci. https://doi.org/10.1016/j.ins.2018.06.060

    Google Scholar 

  56. Yu H, He F, Pan Y (2019) A novel segmentation model for medical images with intensity inhomogeneity based on adaptive perturbation. Multimed Tools Appl 78 (9):11779–11798

    Google Scholar 

  57. Yu HP, He FZ, Pan YT (2018) A novel region-based active contour model via local patch similarity measure for image segmentation. Multimed Tools Appl 77 (18):24097–24119

    Google Scholar 

  58. Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Processing 23(5):2019–32

    MathSciNet  MATH  Google Scholar 

  59. Yu J, Tao D, Wang M, Rui Y (2015) Learning to rank using user clicks and visual features for image retrieval. IEEE Trans Cybern 45(4):767–79

    Google Scholar 

  60. Yu J, Yang X, Gao F, Tao D (2017) Deep multimodal distance metric learning using click constraints for image ranking. IEEE Trans Cybern 47(12):4014–24

    Google Scholar 

  61. Zhang S, He F, Ren W, Yao J (2018) Joint learning of image detail and transmission map for single image dehazing. https://doi.org/10.1007/s00371-018-1612-9

    Google Scholar 

  62. Zhou Y, He FZ, Qiu YM (2017) Dynamic strategy based parallel ant colony optimization on GPUs for TSPs. Science China Information Sciences 60(6):068102

    Google Scholar 

  63. Zhu Q, Heng PA, Shao L, Li X (2013) A novel segmentation guided approach for single image dehazing. In: IEEE international conference on robotics and biomimetics, pp 2414–2417

  64. Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24(11):3522–3533

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

We would like to thank all the anonymous reviewers for their valuable comments. This work is supported by the National Key Research and Development Project(Grant No.2016YFC0106305), Science and Technology Department of Hubei Province, China (Grant No.2014CFB383) and Wuhan Sports University Foundation (Grant No.2016QZ07).

Author information

Authors and Affiliations

  1. School of Computer Science, Wuhan University, Wuhan, China

    Jian Zhang, Fazhi He & Yilin Chen

  2. College of Sport Engineering and Information Technology, Wuhan Sports University, Wuhan, China

    Jian Zhang

Authors
  1. Jian Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fazhi He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yilin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fazhi He.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, J., He, F. & Chen, Y. A new haze removal approach for sky/river alike scenes based on external and internal clues. Multimed Tools Appl 79, 2085–2107 (2020). https://doi.org/10.1007/s11042-019-08399-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-08399-y

Keywords