Skip to main content
Log in

Low-light image enhancement with a refined illumination map

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

It has become very popular to take photographs in everyone’s daily life. However, the visual quality of a photograph is not always guaranteed due to various factors. One common factor is the low-light imaging condition, which conceals visual information and degenerates the quality of a photograph. It is preferable for a low-light image enhancement model to complete the following tasks: improving contrast, preserving details, and keeping robust to noise. To this end, we propose a simple but effective enhancing model based on the simplified Retinex theory, of which the key is to estimate a good illumination map. In our model, we apply an iterative self-guided filter to refine the initial estimation of an illumination map, making it aware of local structure of image contents. In experiments, we validate the effectiveness of our method in various aspects, and compare our model with several state-of-the-art ones. The results show that our method effectively adjusts the global image contrast, recovers the concealed details and keeps the robustness against noise.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Arici T, Dikbas S, Altunbasak Y (2009) A histogram modification framework and its application for image contrast enhancement. IEEE Trans Image Process 18(9):1921–1935

    Article  MathSciNet  Google Scholar 

  2. Chen J, Paris S, Durand F (2007) Real-time edge-aware image processing with the bilateral grid. ACM Trans Graph 26(3):article 103

    Article  Google Scholar 

  3. Dong X, Wang G, Pang Y (2011) Fast efficient algorithm for enhancement of low lighting video. In: proceedings of Internation conference on Multimedia & Expo (ICME)

  4. Feng Z, Hao S (2017) Low-light image enhancement by refining illumination map with self-guided filtering. In Proceedings of International Conference on Big Knowledge Workshop

  5. Fu X, Zeng D, Huang Y, Liao Y, Ding X, Paisley J (2016) A fusion-based enhancing method for weakly illuminated images. Signal Process 129:82–96

    Article  Google Scholar 

  6. Fu X, Zeng D, Huang Y, Zhang X, Ding X (2016) A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

  7. Guo X, Li Y, Ling H (2017) LIME: low-light image enhancement via illumination map estimation. IEEE Trans Image Process 26(2):982–993

    Article  MathSciNet  Google Scholar 

  8. Hao S, Li G, Wang L, Meng Y, Shen D (2016) Learning based Topological Correction for Infant Cortical Surfaces. In: Proceedings of Medical Image Computing and Computer Assisted Intervention (MICCAI)

  9. Hao S, Pan D, Guo Y, Hong R, Wang M (2016) Image detail enhancement with spatially guided filters. Signal Process 120:789–796

    Article  Google Scholar 

  10. Hao S, Guo Y, Hong R, Wang M (2016) Scale-aware spatially guided mapping. IEEE Multimedia 23(3):34–42

    Article  Google Scholar 

  11. He K, Sun J (2015) Fast guided filter. ArXiv, abs/1505.00996

  12. He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409

    Article  Google Scholar 

  13. Hong R, Zhang L, Tao D (2016) Unified photo enhancement by discovering aesthetic communities from Flickr. IEEE Trans Image Process 25(3):1124–1135

    Article  MathSciNet  Google Scholar 

  14. Hong R, Zhang L, Zhang C, Zimmermann R (2016) Flickr circles: aesthetic tendency discovery by multi-view regularized topic modeling. IEEE Trans Multimedia 18(8):1555–1567

    Article  Google Scholar 

  15. Jobson J, Rahman U, Woodell A (1996) Properties and performance of a center/surround Retinex. IEEE Trans Image Process 6(3):451–462

    Article  Google Scholar 

  16. Jobson J, Rahman U, Woodell A (1997) A multi-scale Retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976

    Article  Google Scholar 

  17. Kim Y (1997) Contrast enhancement using brightness preserving bi-histogram equalization. IEEE Trans Consum Electron 43(1):1–8

    Article  Google Scholar 

  18. Lee C, Lee C, Kim C (2013) Contrast enhancement based on layered difference representation of 2D histograms. IEEE Trans Image Process 22(12):5372–5384

    Article  Google Scholar 

  19. Lee J Y, Sunkavalli K, Lin Z, Shen X, Kweon I S. (2016) Automatic Content-Aware Color and Tone Stylization. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

  20. Lim J, Heo M, Lee C, Kim C (2017) Contrast enhancement of noisy low-light images based on structure-texture-noise decomposition. J Vis Commun Image Represent 45:107–121

    Article  Google Scholar 

  21. Liu C, Gong S, Loy C (2014) On-the-fly feature importance Mining for Person re-Identification. Pattern Recogn 47(4):1602–1615

    Article  Google Scholar 

  22. Lore K, Akintayo A, Sarkar S (2017) LLNet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recogn 61:650–662

    Article  Google Scholar 

  23. Ni B, Xu M, Wang M, Yan S, Tian Q (2013) Learning to photograph: a compositional perspective. IEEE Trans Multimedia 15(5):1138–1151

    Article  Google Scholar 

  24. Reza AM (2004) Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. J VLSI Signal Process Syst 38(1):35–44

    Article  Google Scholar 

  25. Song J, Zhang L, Shen P, Peng X, Zhu G (2016) Single Low-light Image Enhancement Using Luminance Map. In: Proceedings of Chinese Conference of Pattern Recognition (CCPR)

  26. Wang S, Gu K, Ma S, Lin W, Liu X, Gao W (2016) Guided image contrast enhancement based on retrieved images in cloud. IEEE Trans Multimedia 18(2):219–232

    Article  Google Scholar 

  27. Xu L, Yan Q, Xia Y, Jia J (2013) Structure extraction from texture via relative Total variation. ACM Trans Graph 31(6):article 139

    Google Scholar 

  28. Yin W, Mei T, Chen C, Li S (2014) Socialized mobile photography: learning to photograph with social context via mobile devices. IEEE Trans Multimedia 16(1):184–200

    Article  Google Scholar 

  29. Yue H, Yang J, Sun X, Wu F, Hou C (2017) Contrast enhancement based on intrinsic image decomposition. IEEE Trans Image Process 26(8):3981–3994

    Article  MathSciNet  Google Scholar 

  30. Zhang Q, Shen X, Xu L, Jia J (2014) Rolling guidance filter. In: Proceedings of European Conference Computer Vision

  31. Zhang L, Li X, Nie F, Yang Y, Xia Y (2016) Weakly supervised human fixations prediction. IEEE Trans Cybernetics 46(1):258–269

    Article  Google Scholar 

  32. Zhang H, Shang X, Luan HB, Wang M, Chua TS (2016) Learning from collective intelligence: feature learning using social images and tags. ACM Trans Multimed Comput Commun Appl 13(1):Article 1

    Article  Google Scholar 

  33. Zhang H, Kyaw Z, Yu J, Chang S F (2017) PPR-FCN: weakly supervised visual relation detection via parallel pairwise R-FCN, in: proceedings of international conference on computer vision (ICCV)

  34. Zhu Y, Lucey S (2015) Convolutional sparse coding for Rrajectory reconstruction, IEEE transactions on. IEEE Trans Pattern Anal Mach Intell 37(3):529–540

    Article  Google Scholar 

  35. Zhu X, Zhang L, Huang Z (2014) A sparse embedding and least variance encoding approach to hashing. IEEE Trans Image Process 23(9):3737–3750

    Article  MathSciNet  Google Scholar 

  36. Zhu W, Cui P, Wang Z, Hua G (2015) Multimedia Big Data Computing. IEEE Multimedia 22(3):96–100

    Article  Google Scholar 

  37. Zhu X, Li X, Zhang S (2016) Block-row sparse Multiview multilabel learning for image Cassification. IEEE Trans Cybernetics 46(2):450–461

    Article  Google Scholar 

  38. Zhu X, Li X, Zhang S (2017) Robust joint graph sparse coding for unsupervised spectral feature selection. IEEE Trans Neural Netw Learn Syst 28(6):1263–1275

    Article  MathSciNet  Google Scholar 

  39. Zhu Y, Zhu X, Kim M, Yan J, Wu G (2017) A Tensor Statistical Model for Quantifying Dynamic Functional Connectivity. In: Proceedings of Information Processing of Medical Image (IPMI)

Download references

Acknowledgements

The authors sincerely appreciate the useful comments and suggestions from the anonymous reviewers. This work was supported by the National Nature Science Foundation of China under grant number 61772171, and grant number 61702156.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shijie Hao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hao, S., Feng, Z. & Guo, Y. Low-light image enhancement with a refined illumination map. Multimed Tools Appl 77, 29639–29650 (2018). https://doi.org/10.1007/s11042-017-5448-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5448-5

Keywords

Navigation