Abstract
Because of a large variability in facial appearance of the same person and small sample size for each person under adverse conditions, face recognition is very challenging. In general, a suitable face representation and a powerful classifier must be designed to deal with these challenges. In this chapter, local face representations using various ordinal contrast measures were introduced. Many different types of visual features derived from these measures were overviewed. Depending on the type of application, classifiers using different prior information for face matching were described. Furthermore, some of the ideas suggested to overcome the problem of pose variation were summarised. Finally, we compare some of the remarkable state-of-art systems on FERET and LFW databases with their standard protocols. The reported work offers some insights into the merits of various face representation and classifier methods, as well as their role in dealing with the challenges.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kim, T.K., Kittler, J.: Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 318–327 (2005)
Jain, A.K., Li, S.Z.: Handbook of Face Recognition. Springer-Verlag New York, Inc., Secaucus (2004)
Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Pentland, A., Moghaddam, B., Starner, T.: View-based and modular eigenspaces for face recognition. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1994, pp. 84–91, 21–23 June 1994
Yin, Q., Tang, X., Sun, J.: An associate-predict model for face recognition. In: CVPR, pp. 497–504 (2011)
Cao, Z., Yin, Q., Tang, X., Sun, J.: Face recognition with learning-based descriptor. In: CVPR, pp. 2707–2714 (2010)
Kisku, D.R., Rattani, A., Grosso, E., Tistarelli, M.: Face identification by sift-based complete graph topology. CoRR abs/1002.0411 (2010)
Liao, S., Jain, A.: Partial face recognition: an alignment free approach. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–8 (2011)
Mikolajczyk, K., Schmid, C.: Scale & affine invariant interest point detectors. Int. J. Comput. Vision 60(1), 63–86 (2004)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)
Edwards, G.J., Taylor, C.J., Cootes, T.F.: Interpreting face images using active appearance models. In: FG, pp. 300–305 (1998)
Belhumeur, P.N., Jacobs, D.W., Kriegman, D.J., Kumar, N.: Localizing parts of faces using a consensus of exemplars. In: The 24th IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2011)
Chan, C.H., Kittler, J., Messer, K.: Multi-scale local binary pattern histograms for face recognition. Ph.D. thesis, University of Surrey (2008)
Huang, C., Zhu, S., Yu, K.: Large scale strongly supervised ensemble metric learning, with applications to face verification and retrieval. Technical Report TR115, NEC Laboratories, America (2011)
Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical Report 07–49, University of Massachusetts, Amherst (2007)
Sadr, J., Mukherjee, S., Thoresz, K., Sinha, P.: The fidelity of local ordinal encoding. In: NIPS, pp. 1279–1286 (2001)
Sinha, P.: Qualitative representations for recognition. In: BMCV ’02 Proceedings of the Second International Workshop on Biologically Motivated Computer Vision, pp. 249–262. Springer-Verlag, London (2002)
Thoresz, K.J.: Qualitative representations for recognition. Master’s thesis, MIT (2002)
Liao, S., Lei, Z., Zhu, X., Sun, Z., Li, S.Z., Tan, T.: Face recognition using ordinal features. In: ICB, pp. 40–46 (2006)
Sun, Z., Tan, T., Wang, Y., Li, S.Z.: Ordinal palmprint represention for personal identification. In: CVPR, vol. 1, pp. 279–284 (2005)
Daugman, J.: High confidence visual recognition of persons by a test of statistical independence. IEEE Trans. Pattern Anal. Mach. Intell. 15(11), 1148–1161 (1993)
Zhang, B., Shan, S., Chen, X., Gao, W.: Histogram of gabor phase patterns (hgpp): a novel object representation approach for face recognition. IEEE Trans. Image Process. 16(1), 57–68 (2007)
Ojansivu, V., Heikkilä, J.: Blur insensitive texture classification using local phase quantization. In: ICISP08
Rahtu, E., Heikkilä, J., Ojansivu, V., Ahonen. T.: Local phase quantization for blur-insensitive image analysis. Image and Vision Computing (2012)
Heikkila, J., Ojansivu, V.: Methods for local phase quantization in blur-insensitive image analysis. In: International Workshop on Local and Non-Local Approximation in Image Processing, 2009. LNLA 2009, pp. 104–111 (2009)
Chan, C.H., Kittler, J., Poh, N., Ahonen, T., Pietikainen, M.: (Multiscale) Local phase quantisation histogram discriminant analysis with score normalisation for robust face recognition. In: 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), pp. 633–640, Sept 27, Oct 4 2009
Zabih, R., Woodfill, J.: Non-parametric local transforms for computing visual correspondence. In: ECCV, vol. 2, pp. 151–158 (1994)
Zhang, W., Shan, S., Gao, W., Chen, X., Zhang, H.: Local gabor binary pattern histogram sequence (lgbphs): a novel non-statistical model for face representation and recognition. In: ICCV, pp. 786–791 (2005)
Pietikäinen, M., Ojala, T., Nisula, J., Heikkinen, J.: Experiments with two industrial problems using texture classification based on feature distributions. Intelligent Robots and Computer Vision XIII: 3D Vision, Product Inspection, and Active Vision, vol. 2354 no. 1, pp. 197–204 (1994)
Ahonen, T., Hadid, A., Pietikäinen, M.: Face recognition with local binary patterns. In: ECCV, vol. 1, pp. 469–481 (2004)
Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. In: AMFG. Lecture Notes in Computer Science, vol. 4778, pp. 168–182. Springer, Heidelberg (2007)
Jin, H., Liu, Q., Lu, H., Tong, X.: Face detection using improved lbp under bayesian framework. In: Proceedings of the Third International Conference on Image and Graphics. ICIG ’04, pp. 306–309 (2004)
Mäenpää, T., Pietikäinen, M.: Multi-scale binary patterns for texture analysis. In: SCIA, pp. 885–892 (2003)
Chan, C.H., Kittler, J., Messer, K.: Multi-scale local binary pattern histograms for face recognition. In: Lee, S.W., Li, S.Z. (eds.) ICB. Lecture Notes in Computer Science, vol. 4642, pp. 809–818. Springer (2007)
Liao, S., Zhu, X., Lei, Z., Zhang, L., Li, S.Z.: Learning multi-scale block local binary patterns for face recognition. In: ICB, pp. 828–837 (2007)
Wolf, L., Hassner, T., Taigman, Y.: Descriptor based methods in the wild. In: Real-Life Images workshop at the European Conference on Computer Vision (ECCV) (2008)
Balas, B., Sinha, P.: Dissociated dipoles: image representation via non-local comparisons. In: MIT AIM (2003)
Lei, Z., Li, S.Z., Chu, R., Zhu, X.: Face recognition with local gabor textons. In: ICB, pp. 49–57 (2007)
Coates, A., Ng, A.: The importance of encoding versus training with sparse coding and vector quantization. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11). ICML ’11, pp. 921–928 (2011)
Pietikäinen, M., Ojala, T., Xu, Z.: Rotation-invariant texture classification using feature distributions. Pattern Recogn. 33, 43–52 (2000)
Mäenpää, T., Ojala, T., Pietikäinen, M., Maricor, S.: Robust texture classification by subsets of local binary patterns. In: International Conference on Pattern Recognition, vol. 3, p. 3947. IEEE Computer Society, Los Alamitos, CA, USA (2000)
Liao, S., Law, M.W.K., Chung, A.C.S.: Dominant local binary patterns for texture classification. IEEE Trans. Image Process. 18(5), 1107–1118 (2009)
Ahonen, T., Hadid, A., Pietikäinen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
Su, Y., Shan, S., Chen, X., Gao, W.: Hierarchical ensemble of global and local classifiers for face recognition. In: ICCV, pp. 1–8 (2007)
Shan, S., Zhang, W., Su, Y., Chen, X., Gao, W.: Ensemble of piecewise FDA based on spatial histograms of local (gabor) binary patterns for face recognition. In: ICPR, vol. 4, pp. 606–609 (2006)
Wright, J., Yang, A., Ganesh, A., Sastry, S., Ma, Y.: Robust face recognition via sparse representation. PAMI 31(2), 210–227 (2009)
Wagner, A., Wright, J., Ganesh, A., Zhou, Z., Ma, Y.: Towards a practical face recognition system: robust registration and illumination by sparse representation. In: CVPR, pp. 597–604 (2009)
Chan, C.H., Kittler, J.: Sparse representation of (multiscale) histograms for face recognition robust to registration and illumination problems. In: ICIP, pp. 2441–2444 (2010)
Min, R., Dugelay, J.L.: Improved combination of lbp and sparse representation based classification (SRC) for face recognition. In: 2011 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2011)
Figueiredo, M., Nowak, R., Wright, S.: Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE Signal Process. 1(4), 586–597 (2007)
Zhang, G., Huang, X., Li, S.Z., Wang, Y., Wu, X.: Boosting local binary pattern (LBP)-based face recognition. In: SINOBIOMETRICS, pp. 179–186 (2004)
Cox, D.D., Pinto, N.: Beyond simple features: a large-scale feature search approach to unconstrained face recognition. In: FG, pp. 8–15 (2011)
Guillaumin, M., Verbeek, J., Schmid, C.: Is that you? metric learning approaches for face identification. In: International Conference on Computer Vision, pp. 498–505 (2009)
Nguyen, H.V., Bai, L.: Cosine similarity metric learning for face verification. In: Proceedings of the 10th Asian Conference on Computer Vision—Volume Part II. ACCV’10, pp. 709–720 (2011)
Ying, Y., Li, P.: Distance metric learning with eigenvalue optimization. J. Mach. Learn. Res. 13, 1–26 (2012)
Auckenthaler, R., Carey, M., Lloyd-Thomas, H.: Score normalization for text-independent speaker verification systems. Digital Signal Process. 10(1–3), 42–54 (2000)
Lui, Y.M., Beveridge, J.R., Draper, B.A., Kirby, M.: Image-set matching using a geodesic distance and cohort normalization. In: FG, pp. 1–6 (2008)
Wolf, L., Hassner, T., Taigman, Y.: The one-shot similarity kernel. In: IEEE International Conference on Computer Vision (ICCV) (2009)
Zou, X., Kittler, J., Messer, K.: Illumination invariant face recognition: a survey. In: First IEEE International Conference on Biometrics: Theory, Applications, and Systems, 2007. BTAS 2007, pp. 1–8 (2007)
Pinto, N., DiCarlo, J.J., Cox, D.D.: How far can you get with a modern face recognition test set using only simple features? In: IEEE Computer Vision and Pattern Recognition (2009)
Taigman, Y., Wolf, L.: Leveraging billions of faces to overcome performance barriers in unconstrained face recognition. CoRR abs/1108.1122 (2011)
Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The feret evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)
Phillips, P.J., Moon, H., Rauss, P., Rizvi, S.A.: The feret evaluation methodology for face-recognition algorithms. In: CVPR, p. 137. IEEE Computer Society, Los Alamitos, CA, USA (1997)
Turk, M.A.; Pentland, A.: Face recognition using eigenfaces. In: Proceedings CVPR ’91 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1991, pp. 586–591, 3–6 June 1991
Hussain, S.U., Napoléon, T., Jurie, F.: Face recognition using local quantized patterns. In: Proceedings of the 23rd British Machine Vision Conference, Surrey, England (2012)
Tan, X., Triggs, B.: Fusing gabor and lbp feature sets for kernel-based face recognition. In: AMFG, pp. 235–249 (2007)
Vu, N.S., Caplier, A.: Enhanced patterns of oriented edge magnitudes for face recognition and image matching. IEEE Trans. Image Process. 21(3), 1352–1365 (2012)
Chan, C.H.: Multi-scale local binary pattern histogram for face recognition. PhD thesis, UNIS (2008)
Zhang, W., Shan, S., Qing, L., Chen, X., Gao, W.: Are gabor phases really useless for face recognition? Pattern Analysis and Applications (2008)
Wolf, L., Hassner, T., Taigman, Y.: Similarity scores based on background samples. In: ACCV, vol. 2, pp. 88–97 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Chan, C.h., Kittler, J., Poh, N. (2014). State-of-the-Art LBP Descriptor for Face Recognition. In: Brahnam, S., Jain, L., Nanni, L., Lumini, A. (eds) Local Binary Patterns: New Variants and Applications. Studies in Computational Intelligence, vol 506. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39289-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-39289-4_9
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39288-7
Online ISBN: 978-3-642-39289-4
eBook Packages: EngineeringEngineering (R0)