Abstract
Logarithm difference is the subtraction of the center pixel and its neighbor in the face local region. The commonly-used assumption of the illumination invariant measure is that illumination intensities of neighbor pixels are approximately equal in the face local region. However, logarithm difference based illumination invariant measure performs unsatisfactorily under severe illumination variations, since severe varying illumination cause differences of illumination intensities are large in the face local region. In this paper, the general logarithm difference model (GLDM) is proposed to tackle severe illumination variations. In spired by the fact that a logarithm difference is the subtraction of two neighbor pixels, which may be a positive or negative numerical value, we divide a face local region into a positive region and a negative region, and the GLDM is developed by integrating positive and negative logarithm differences. Then, the multiscale logarithm difference edge-maps (MSLDE) [7] is employed as the test-bed, and the proposed GLDM is introduced into MSLDE to form General MSLDE (GMSLDE). Further, the proposed GMSLDE method is integrated with the advanced deep learning model VGG to obtain GMSLDE-VGG. Finally, the performance of GMSLDE and GMSLDE-VGG are verified not only on the Extended Yale B and CMU PIE face databases with severe illumination variations, but also on the LFW and our self-built Driver face databases with moderate illumination variations. The experimental results indicate that the proposed GLDM can efficiently improve the performance of logarithm difference edge-map against illumination variations, especially for severe illumination variations.
Similar content being viewed by others
References
Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 12:2037–2041
Baradarani A, Wu Q, Ahmadi M (2013) An efficient illumination invariant face recognition framework via illumination enhancement and DD-DTCWT filtering. Pattern Recogn 46(1):57–72
Cao X, Shen W, Yu L, Wang Y, Yang J, Zhang Z (2012) Illumination invariant extraction for face recognition using neighboring wavelet coefficients. Pattern Recogn 45(4):1299–1305
Chen W, Er MJ, Wu S (2006) Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans Syst Man Cybernet Part B: Cybernet 36(2):458–466
Chen T, Yin W, Zhou XS, Comaniciu D, Huang TS (2006) Total variation models for variable lighting face recognition. IEEE Trans Pattern Anal Mach Intell 28(9):1519–1527
Choi SI, Kim C, Choi CH (2007) Shadow compensation in 2D images for face recognition. Pattern Recogn 40(7):2118–2125
Dandpat S, Kumar S, Ranjith C (2018) Illumination invariant face recognition using Gabor wavelet function. Proceedings of the international conference on electrical, electronics, computers, communication, mechanical and computing, Vellore District, Tamil Nadu, India, 28–29 January, 2018
Deng W, Hu J, Guo J (2012) Extended SRC: Undersampled face recognition via intraclass variant dictionary. IEEE Trans Pattern Anal Mach Intell 34(9):1864–1870
Ding C, Choi J, Tao D, Davis L (2016) Multi-directional multi-level dual-cross patterns for robust face recognition. IEEE Trans Pattern Anal Mach Intell 38(3):518–531
Fang S, Yang J, Liu N, Sun W, Zhao T (2018) Face recognition using weber local circle gradient pattern method. Multimed Tools Appl 77(2):2807–2822
Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660
Horn BKP (1997) Robot vision. MIT Press, Cambridge, MA
Hu C, Lu X, Ye M, Zeng W (2017) Singular value decomposition and local near neighbors for face recognition under varying illumination. Pattern Recogn 64:60–83
Hu C, Lu X, Ye M, Zeng W, Du Y (2017) Illumination robust single sample face recognition based on ESRC. Multimed Tools Appl 76(24):26523–26550
Hu C, Lu X, Liu P, Jing X (2019) Yue D (2018) single sample face recognition under varying illumination via QRCP decomposition. IEEE Trans Image Process 28(5):2624–2638
Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments, University of Massachusetts: 07–49
Jian M, Lam K (2014) Face-image retrieval based on singular values and potential-field representation. Signal Process 100:9–15
Jian M, Lam K (2015) Simultaneous hallucination and recognition of low-resolution faces based on singular value decomposition. IEEE Trans Circ Syst Video Technol 25(11):1761–1772
Jian M, Lam K, Dong J (2013) A novel face-hallucination scheme based on singular value decomposition. Pattern Recogn 46(11):3091–3102
Jian M, Lam K, Dong J (2014) Facial-feature detection and localization based on a hierarchical scheme. Inf Sci 262:1–14
Jian M, Lam K, Dong J (2014) Illumination-insensitive texture discrimination based on illumination compensation and enhancement. Inf Sci 269:60–72
Jian M, Yin Y, Dong J, Zhang W (2018) Comprehensive assessment of non-uniform illumination for 3D heightmap reconstruction in outdoor environments. Comput Ind 99:110–118
Jobson DJ, Rahman Z, Woodell G (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976
Lai Z, Dai D, Ren C, Huang K (2015) Multiscale logarithm difference Edgemaps for face recognition against varying lighting conditions. IEEE Trans Image Process 24(6):1735–1747
Murala S, Maheshwari R, Balasubramanian R (2012) Local tetra patterns: a new feature descriptor for content-based image retrieval. IEEE Trans Image Process 21(5):2874–2886
Ou W, You X, Tao D, Zhang P, Tang Y, Zhu Z (2014) Robust face recognition via occlusion dictionary learning. Pattern Recogn 47(4):1559–1572
Park YK, Park SL, Kim JK (2008) Retinex method based on adaptive smoothing for illumination invariant face recognition. Signal Process 88(8):1929–1945
Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition, Proceedings of the British Machine Vision Conference: 1–12
Qing L, Shan S, Gao W, Du B (2005) Face recognition under generic illumination based on harmonic relighting. Int J Pattern Recognit Artif Intell 19:513–531
Ramamoorthi R, Hanrahan P (2001) A signal-processing framework for inverse rendering, Proceedings of the 28th annual conference on computer graphics and interactive techniques p 117–128
Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering, Proceedings of the IEEE conference on computer vision and pattern recognition: 815–823
Shan S, Gao W, Cao B, Zhao D (2003) Illumination normalization for robust face recognition against varying lighting conditions, Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures: 157–164
Shim H, Luo J, Chen T (2008) A subspace model-based approach to face relighting under unknown lighting and poses. IEEE Trans Image Process 17(8):1331–1341
Sim T, Baker S, Bsat M (2003) The CMU pose, illumination, and expression database. IEEE Trans Pattern Anal Mach Intell 25(12):1615–1618
Wang B, Li W, Yang W, Liao Q (2011) Illumination normalization based on weber's law with application to face recognition. IEEE Signal Process Lett 18(8):462–465
Wu Y, Jiang Y, Zhou Y, Li W, Lu Z, Liao Q (2014) Generalized weber-face for illumination-robust face recognition. Neurocomputing 136:262–267
Xie X, Lam KM (2005) Face recognition under varying illumination based on a 2D face shape model. Pattern Recogn 38:221–230
Xie X, Zheng W, Liao J, Yuen PC, Suen CY (2011) Normalization of face illumination based on large-and small-scale features. IEEE Trans Image Process 20(7):1807–1821
Zhang T, Gang B, Yuan Y, Tang YY, Shang Z, Li D, Lang F (2009) Multiscale facial structure representation for face recognition under varying illumination. Pattern Recogn 42(2):251–258
Zhang T, Tang Y, Fang B, Shang Z, Liu X (2009) Face recognition under varying illumination using gradientfaces. IEEE Trans Image Process 18(11):2599–2606
Zhang Y, Hu C, Lu X (2018) Face recognition under varying illumination based on singular value decomposition and retina modeling, Multimed Tools Appl, 1–20
Zhang W, Zhao X, Morvan JM, Chen L (2019) Improving shadow suppression for illumination robust face recognition. IEEE Trans Pattern Anal Mach Intell 41(3):611–624
Zhu J, Zheng W, Lai J (2013) Logarithm gradient histogram: a general illumination invariant descriptor for face recognition, Proceedings of the 10th IEEE international conference and workshops on automatic face and gesture recognition p 1–8
Zhu J, Zheng W, Lu F, Lai J (2017) Illumination invariant single face image recognition under heterogeneous lighting condition. Pattern Recogn 66:313–327
Acknowledgements
This work was supported by the National Natural Science Foundation of China (Grant No.61802203), Natural Science Foundation of Jiangsu Province (Grant No.BK20180761), China Postdoctoral Science Foundation (Grant No.2019 M651653) and NUPTSF (Grant No.NY218119).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hu, CH., Lu, XB., Wu, F. et al. General logarithm difference model for severe illumination variation face recognition. Multimed Tools Appl 78, 27425–27447 (2019). https://doi.org/10.1007/s11042-019-07830-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-07830-8