Skip to main content
SpringerLink
Log in

RDMA: low-light image enhancement based on retinex decomposition and multi-scale adjustment

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Images are often affected by insufficient illumination and suffer from degradation problems such as low brightness, noise, and color distortion, which results in reduced image quality. Existing low-light image enhancement methods based on Retinex theory decompose images into reflectance and illumination components, which are adjusted separately; however, the intrinsic connection between reflectance and illumination during decomposition is not considered, and multi-scale information during subsequent adjustments is inadequately utilized. In this study, we propose a low-light image enhancement network based on Retinex decomposition and multi-scale adjustment (RDMA), which performs initial decomposition followed by subsequent adjustment. We utilized prior knowledge to design the feature interaction module (FIM) and the feature fusion module (FFM) for image decomposition. Furthermore, a coarse-to-fine multi-scale network with residual channel and spatial attention (RCSA) was designed to remove noise from reflectance, suppress color distortion, preserve image details, and adjust the brightness of illumination. An evaluation of various low-light image datasets and comparisons with state-of-the-art methods showed that the proposed network is superior in terms of enhancement results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

The datasets generated and analyzed during the current study are available from the corresponding author upon reasonable request.

References

  1. Wang L, Wang T, Yang D, Fang X, Wan S (2022) Near-infrared fusion for deep lightness enhancement. Int J Mach Learn Cybern 14(5):1–13

    Google Scholar 

  2. Liu C, Wu F, Wang X (2022) Efinet: restoration for low-light images via enhancement-fusion iterative network. IEEE Transactions on Circuits and Systems for Video Technology 32(12):8486–8499

    Article  Google Scholar 

  3. Xu J, Yuan M, Yan D-M, Wu T (2022) Illumination guided attentive wavelet network for low-light image enhancement. IEEE Transactions on Multimedia

  4. Lu Y, Jung S-W (2022) Progressive joint low-light enhancement and noise removal for raw images. IEEE Trans Image Process 31:2390–2404

    Article  Google Scholar 

  5. Wan R, Shi B, Yang W, Wen B, Duan LY, Kot AC (2022) Purifying low-light images via near-infrared enlightened image. IEEE Transactions on Multimedia

  6. Pizer SM, Johnston RE, Ericksen JP, Yankaskas BC, Muller KE (1990) Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the First Conference on Visualization in Biomedical Computing, pp. 337–338. IEEE Computer Society

  7. Liu Y-F, Guo J-M, Lai B-S, Lee J-D (2013) High efficient contrast enhancement using parametric approximation. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2444–2448. IEEE

  8. Land EH (1977) The retinex theory of color vision. Scient Am 237(6):108–129

    Article  Google Scholar 

  9. Jobson DJ, Rahman Z-U, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976

    Article  Google Scholar 

  10. Kimmel R, Elad M, Shaked D, Keshet R, Sobel I (2003) A variational framework for retinex. Int J Comput Vis 52(1):7–23

    Article  Google Scholar 

  11. Wei C, Wang W, Yang W, Liu J (2018) Deep retinex decomposition for low-light enhancement. arXiv preprint arXiv:1808.04560

  12. Lv F, Li Y, Lu F (2021) Attention guided low-light image enhancement with a large scale low-light simulation dataset. Int J Comput Vis 129(7):2175–2193

    Article  Google Scholar 

  13. Tu Z, Talebi H, Zhang H, Yang F, Milanfar P, Bovik A, Li Y (2022) Maxim: Multi-axis mlp for image processing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5769–5780

  14. Zhang Y, Zhang J, Guo X (2019) Kindling the darkness: A practical low-light image enhancer. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 1632–1640

  15. Zhang Y, Guo X, Ma J, Liu W, Zhang J (2021) Beyond brightening low-light images. Int J Comput Vis 129(4):1013–1037

    Article  Google Scholar 

  16. Reddy E, Reddy R (2019) Dynamic clipped histogram equalization technique for enhancing low contrast images. Proceed Natl Acad Sci India Sect A Phys Sci 89(4):673–698

    Article  MathSciNet  Google Scholar 

  17. Sirajuddeen C, Kansal S, Tripathi RK (2020) Adaptive histogram equalization based on modified probability density function and expected value of image intensity. Signal Image Video Process 14(1):9–17

    Article  Google Scholar 

  18. Guo X, Li Y, Ling H (2016) Lime: low-light image enhancement via illumination map estimation. IEEE Trans Image Process 26(2):982–993

    Article  MathSciNet  Google Scholar 

  19. Dabov K, Foi A, Katkovnik V, Egiazarian K (2006) Image denoising with block-matching and 3d filtering. In: Image Processing: Algorithms and Systems, Neural Networks, and Machine Learning. (vol. 6064:606414) International Society for Optics and Photonics

  20. Fu X, Zeng D, Huang Y, Zhang X-P, Ding X (2016) A weighted variational model for simultaneous reflectance and illumination estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2782–2790

  21. He R, Guan M, Wen C (2020) Scens: simultaneous contrast enhancement and noise suppression for low-light images. IEEE Trans Ind Electron 68(9):8687–8697

    Article  Google Scholar 

  22. Lore KG, Akintayo A, Sarkar S (2017) Llnet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recogn 61:650–662

    Article  Google Scholar 

  23. Lv F, Lu F, Wu J, Lim C (2018) Mbllen: low-light image/video enhancement using cnns. In: BMVC 220:4

  24. Lim S, Kim W (2020) Dslr: deep stacked laplacian restorer for low-light image enhancement. IEEE Trans Multimedia 23:4272–4284

    Article  Google Scholar 

  25. Afifi M, Derpanis KG, Ommer B, Brown MS (2021) Learning multi-scale photo exposure correction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9157–9167

  26. Fan G-D, Fan B, Gan M, Chen G-Y, Chen CP (2022) Multiscale low-light image enhancement network with illumination constraint. IEEE Trans Circuits Syst Video Technol 32(11):7403–7417

    Article  Google Scholar 

  27. Jiang Y, Gong X, Liu D, Cheng Y, Fang C, Shen X, Yang J, Zhou P, Wang Z (2021) Enlightengan: deep light enhancement without paired supervision. IEEE Trans Image Process 30:2340–2349

    Article  Google Scholar 

  28. Guo C, Li C, Guo J, Loy CC, Hou J, Kwong S, Cong R (2020) Zero-reference deep curve estimation for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1780–1789

  29. Li C, Guo C, Loy CC (2021) Learning to enhance low-light image via zero-reference deep curve estimation. arXiv preprint arXiv:2103.00860

  30. Jiang Q, Mao Y, Cong R, Ren W, Huang C, Shao F (2022) Unsupervised decomposition and correction network for low-light image enhancement. IEEE Transactions on Intelligent Transportation Systems

  31. Ma L, Ma T, Liu R, Fan X, Luo Z (2022) Toward fast, flexible, and robust low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5637–5646

  32. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-assisted Intervention, pp. 234–241. Springer

  33. Wang W, Wei C, Yang W, Liu J (2018) Gladnet: low-light enhancement network with global awareness. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp. 751–755. IEEE

  34. Wang R, Zhang Q, Fu C-W, Shen X, Zheng W-S, Jia J (2019) Underexposed photo enhancement using deep illumination estimation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6849–6857

  35. Ma K, Zeng K, Wang Z (2015) Perceptual quality assessment for multi-exposure image fusion. IEEE Trans Image Process 24(11):3345–3356

    Article  MathSciNet  Google Scholar 

  36. Wang S, Zheng J, Hu H-M, Li B (2013) Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans Image Process 22(9):3538–3548

    Article  Google Scholar 

  37. Vonikakis V, Andreadis I, Gasteratos A (2008) Fast centre-surround contrast modification. IET Image Process 2(1):19–34

    Article  Google Scholar 

  38. Wang Q, Fu X, Zhang X-P, Ding X (2016) A fusion-based method for single backlit image enhancement. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 4077–4081. IEEE

  39. Liu R, Ma L, Zhang J, Fan X, Luo Z (2021) Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10561–10570

  40. Zhang R, Isola P, Efros AA, Shechtman E, Wang O (2018) The unreasonable effectiveness of deep features as a perceptual metric. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–595

  41. Hordley SD, Finlayson GD (2004) Re-evaluating colour constancy algorithms. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., vol. 1, pp. 76–79. IEEE

  42. Mittal A, Soundararajan R, Bovik AC (2012) Making a “completely blind’’ image quality analyzer. IEEE Signal Process Lett 20(3):209–212

    Article  Google Scholar 

  43. Zhang L, Zhang L, Bovik AC (2015) A feature-enriched completely blind image quality evaluator. IEEE Trans Image Process 24(8):2579–2591

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant 62371015, and in part by Beijing Natural Science Foundation under Grant L211017, and in part by the General Program of Beijing Municipal Education Commission under Grant KM202110005027, and in part by National Natural Science Foundation of China under Grant 61971016 and 61701011.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

    Jiafeng Li, Shuai Hao, Tianshuo Li, Li Zhuo & Jing Zhang

  2. Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing, 100124, China

    Jiafeng Li, Shuai Hao, Tianshuo Li, Li Zhuo & Jing Zhang

Authors
  1. Jiafeng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuai Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tianshuo Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Li Zhuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jing Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiafeng Li.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, J., Hao, S., Li, T. et al. RDMA: low-light image enhancement based on retinex decomposition and multi-scale adjustment. Int. J. Mach. Learn. & Cyber. 15, 1693–1709 (2024). https://doi.org/10.1007/s13042-023-01991-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-01991-7

Keywords

Search

Navigation