Skip to main content
SpringerLink
Log in

A fast and effective algorithm for specular reflection image enhancement

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Aiming at the problems of image quality degradation and information loss in images affected by reflections in real scenes, this paper proposes a fast and effective specular reflection image enhancement algorithm. This method uses the dark channel prior algorithm to process the specular image, in which the moving window minimum filter is used to estimate the global illumination component of the specular image, and a weighting function based on local pixel chromatic aberration is introduced under the boundary constraints. Then, it uses an improved guided image filtering algorithm to enhance the image, introduces adjustment parameters based on local variance information in the cost function of the guided filtering algorithm, and introduces an adaptive magnification factor in the detail layer. Finally, we compare the algorithm in this paper with the existing algorithms in subjective vision and objective evaluation. The results show that the calculation speed of this method is faster, and it can effectively enhance the information in the reflection image, and simultaneously effectively improve the clarity of the image.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Algorithm 1
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Code Availability

Since we still have to conduct follow-up research,the code and data are not convenient to disclose.

References

  1. Akashi Y, Okatani T (2014) Separation of reflection components by sparse non-negative matrix factorization. Springer, Cham

    Google Scholar 

  2. Chen L, Lin S, Zhou K, Ikeuchi K (2017) Specular highlight removal in facial images. In: IEEE Conference on computer vision and pattern recognition

  3. Fu G, Zhang Q, Song C, Lin Q, Xiao C (2019) Specular highlight removal for real-world images. In: Computer graphics forum, vol 38, pp 253–263. Wiley Online Library

  4. Guo X, Cao X, Ma Y (2014) Robust separation of reflection from multiple images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2187–2194

  5. Guo X, Li Y, Ling H (2016) Lime: Low-light image enhancement via illumination map estimation. IEEE Trans Image Process 26(2):982–993

    Article  MathSciNet  MATH  Google Scholar 

  6. He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Google Scholar 

  7. He K, Sun J, Tang X (2012) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409

    Article  Google Scholar 

  8. Huang Z, Jia Z, Yang J, Kasabov NK (2021) An effective algorithm for specular reflection image enhancement. IEEE Access 9:154513–154523

    Article  Google Scholar 

  9. Jie G, Zhou Z, Wang L (2018) Single image highlight removal with a sparse and Low-Rank reflection model. Computer Vision – ECCV 2018

  10. Kansal I, Kasana SS (2020) Improved color attenuation prior based image de-fogging technique. Multimed Tools Appl 79(17):12069–12091

    Article  Google Scholar 

  11. Kim H, Jin H, Hadap S, Kweon I (2013) Specular reflection separation using dark channel prior. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1460–1467

  12. Kordelas GA, Alexiadis DS, Daras P, Izquierdo E (2015) Content-based guided image filtering, weighted semi-global optimization, and efficient disparity refinement for fast and accurate disparity estimation. IEEE Trans Multimed 18(2):155–170

    Article  Google Scholar 

  13. Li Q, Lin W, Xu J, Fang Y (2016) Blind image quality assessment using statistical structural and luminance features. IEEE Trans Multimed 18 (12):2457–2469

    Article  Google Scholar 

  14. Li Chen, Zhou Kun, Lin Stephen (2015) Simulating makeup through physics-based manipulation of intrinsic image layers. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4621–4629

  15. Liang Z, Xu J, Zhang D, Cao Z, Zhang L (2018) A hybrid l1-l0 layer decomposition model for tone mapping. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4758–4766

  16. Lu Z, Long B, Li K, Lu F (2018) Effective guided image filtering for contrast enhancement. IEEE Signal Process Lett 25(10):1585–1589

    Article  Google Scholar 

  17. Mallick SP, Zickler T, Belhumeur PN, Kriegman DJ (2006) Specularity removal in images and videos: A pde approach. In: European conference on computer vision, pp 550–563. Springer

  18. Mallick SP, Zickler TE, Kriegman DJ, Belhumeur PN (2005) Beyond lambert: Reconstructing specular surfaces using color. In: 2005 IEEE Computer society conference on computer vision and pattern recognition (CVPR’05), vol 2, pp 619–626. Ieee

  19. Meng G, Wang Y, Duan J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. In: Proceedings of the IEEE international conference on computer vision, pp 617–624

  20. Min X, Gu K, Zhai G, Liu J, Yang X, Chen CW (2017) Blind quality assessment based on pseudo-reference image. IEEE Trans Multimedia 20 (8):2049–2062

    Article  Google Scholar 

  21. Ngo D, Lee S, Nguyen Q-H, Ngo TM, Lee GD, Kang B (2020) Single image haze removal from image enhancement perspective for real-time vision-based systems. Sensors 20(18):5170

    Article  Google Scholar 

  22. Nguyen T, Vo QN, Yang HJ, Kim SH, Lee GS (2014) Separation of specular and diffuse components using tensor voting in color images. Appl Opt 53(33):7924–36

    Article  Google Scholar 

  23. Quan L, Shum H-Y, et al. (2003) Highlight removal by illumination-constrained inpainting. In: Proceedings ninth ieee international conference on computer vision, pp 164–169 IEEE

  24. Ramos VS, Júnior LGDQS, Silveira LFDQ (2019) Single image highlight removal for real-time image processing pipelines. IEEE Access 8:3240–3254

    Article  Google Scholar 

  25. Ren W, Tian J, Tang Y (2017) Specular reflection separation with color-lines constraint. IEEE Transactions on image processing

  26. Saha R, Pratim Banik P, Sen Gupta S, Kim KD (2020) Combining highlight removal and low-light image enhancement technique for hdr-like image generation. IET Image Process 14(9):1851–1861

    Article  Google Scholar 

  27. Shen HL, Zhang HG, Shao SJ, Xin JH (2008) Chromaticity-based separation of reflection components in a single image. Pattern Recogn 41(8):2461–2469

    Article  MATH  Google Scholar 

  28. Shen H, Zheng Z (2013) Real-time highlight removal using intensity ratio. Appl Opt 52(19):4483–4493

    Article  Google Scholar 

  29. Son M, Lee Y, Chang HS (2020) Toward specular removal from natural images based on statistical reflection models. IEEE Trans Image Process 29:4204–4218

    Article  MathSciNet  MATH  Google Scholar 

  30. Suo J, An D, Ji X, Wang H, Dai Q (2016) Fast and high quality highlight removal from a single image. IEEE Trans Image Process 25(11):5441–5454

    Article  MathSciNet  MATH  Google Scholar 

  31. Wei Y, Jia Zg, Yang J, Kasabov NK (2021) High-brightness image enhancement algorithm. Appl Sci 11(23):11497

    Article  Google Scholar 

  32. Wei X, Xu X, Zhang J, Gong Y (2018) Specular highlight reduction with known surface geometry. Comput Vis Image Underst 168:132–144

    Article  Google Scholar 

  33. Xia W, Chen ECS, Pautler SE, Peters TM (2019) A global optimization method for specular highlight removal from a single image. IEEE Access 7:125976–125990

    Article  Google Scholar 

  34. Yamamoto T, Nakazawa A (2019) General improvement method of specular component separation using high-emphasis filter and similarity function. ITE Trans Media Technol Appl 7(2):92–102

    Article  Google Scholar 

  35. Yang J, Liu L, Li SZ (2014) Separating specular and diffuse reflection components in the hsi color space. In: 2013 IEEE International conference on computer vision workshops

  36. Yang Q, Tang J, Ahuja N (2014) Efficient and robust specular highlight removal. IEEE Trans Pattern Anal Mach Intell 37(6):1304–1311

    Article  Google Scholar 

  37. Yang Q, Wang S, Ahuja N (2010) Real-time specular highlight removal using bilateral filtering. In: European conference on computer vision, pp 87–100. Springer

  38. Ye X, Jia Z, Yang J, Kasabov NK (2021) Specular reflection image enhancement based on a dark channel prior. IEEE Photonics J 13(1):1–11

    Article  Google Scholar 

  39. Zheng M, Qi G, Zhu Z, Li Y, Wei H, Liu Y (2020) Image dehazing by an artificial image fusion method based on adaptive structure decomposition. IEEE Sensors J 20(14):8062–8072

    Article  Google Scholar 

  40. Zhu Z, Wei H, Hu G, Li Y, Qi G, Mazur N (2020) A novel fast single image dehazing algorithm based on artificial multiexposure image fusion. IEEE Trans Instrum Meas 70:1–23

    Article  Google Scholar 

  41. Zhu T, Xia S, Bian Z, Lu C (2020) Highlight removal in facial images. In: Chinese conference on pattern recognition and computer vision (PRCV), pp 422–433. Springer

Download references

Acknowledgements

This research was funded by the National Natuaral Science Foundation of China with Grant U1803261. We would like to thank the referees for their efforts to review our manuscript, as well as for their valuable suggestions and questions.

Author information

Authors and Affiliations

  1. Key Laboratory of Signal Detection and Processing, College of Information Science and Engineering, Xinjiang University, Urumqi, 830046, China

    Ye Xin, Yifei Wei, Zhuang Huang & Zhenhong Jia

  2. Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, 200400, China

    Jie Yang

  3. Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, 1020, New Zealand

    Nikola K. Kasabov

Authors
  1. Ye Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yifei Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhuang Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhenhong Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jie Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nikola K. Kasabov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenhong Jia.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xin, Y., Wei, Y., Huang, Z. et al. A fast and effective algorithm for specular reflection image enhancement. Multimed Tools Appl 82, 14897–14914 (2023). https://doi.org/10.1007/s11042-022-13706-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13706-1

Keywords

Search

Navigation