Skip to main content

Advertisement

Springer Nature Link
Log in

Robust facial landmarking for registration

Localisation robuste de points caractéristiques sur des images faciales

  • Multimodal Biometrics
  • Published:
Annales Des Télécommunications Aims and scope Submit manuscript

Abstract

Finding landmark positions on facial images is an important step in face registration and normalization, for both 2D and 3D face recognition. In this paper, we inspect shortcomings of existing approaches in the literature and compare several methods for performing automatic landmarking on near-frontal faces in different scales. Two novel methods have been employed to analyze facial features in coarse and fine scales successively. The first method uses a mixture of factor analyzers to learn Gabor filter outputs on a coarse scale. The second method is a template matching of block-based Discrete Cosine Transform (DCT) features. In addition, a structural analysis subsystem is proposed that can determine false matches, and correct their positions.

Résumé

Trouver des points de repères est une étape importante pour l’enregistrement et la normalisation des visages et pour la reconnaissance 2D et 3D. Dans cet article, nous allons étudier les faiblesses des travaux existants dans la littérature et comparer plusieurs méthodes pour trouver automatiquement des points de repères sur des figures frontales dans des échelles différentes. Deux nouvelles méthodes furent employées pour analyser les traits faciaux dans des échelles granulaires et précises successivement. La première utilisant un mélange d’analyseurs factoriels pour procéder à des sorties de filtres de Gabor dans l’échelle granulaire. La deuxième utilise des modèles fondés sur des traits de la transformation en cosinus discrète bidimensionnelle (DCT). En plus, un sous-système d’analyse structurale a été proposé pour déterminer les points de repères non concordant et pour corriger leurs positions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Antonini G., Popovici V., Thiran J.P, Independent Component Analysis and Support Vector Machine for Face Feature Extraction, 4th Int. Conf on Audio — and Video-Based Biometric Person Authentication, pp. 111–118, Guildford, UK, 2003.

    Chapter  Google Scholar 

  2. Arca S., Campadelli P., Lanzarotti R., A face recognition system based on automatically determined facial fiducial points, Pattern Recognition, 393, pp. 432–443, 2006.

    Google Scholar 

  3. The BANCA dataset — English part; http://banca.ee.surrey.ac.uk/.

  4. Baskan S., Bulut M.M., Atalay V., Projection Based Method for Segmentation of Human Face and its Evaluation, Pattern Recognition Letters, 23, pp. 1623–1629, 2002.

    MATH  Google Scholar 

  5. Boehnen C., Russ T., A Fast Multi-Modal Approach to Facial Feature Detection, 7th IEEE Workshop on Applications of Computer Vision, pp. 135–142, Breckenridge, USA, 2005.

    Google Scholar 

  6. Bolme D.S., Elastic Bunch Graph Matching, unpublished MS thesis, Colorado State University, 2003.

    Google Scholar 

  7. Brunelli R., Poggio T., Face Recognition: Features versus Templates, IEEE Transactions on Pattern Analysis and Machine Intelligence, 15, pp. 1042–1052, 1993.

    Google Scholar 

  8. Burl C., Perona P., Recognition of Planar Object Classes, in Computer Vision and Pattern Recognition Conference, pp. 223–230, San Francisco, USA, 1996.

    Google Scholar 

  9. Campadelli P., Lanzarotti R., Localization of Facial Features and Fiducial Points, in Proc. IEEE Int. Conf Visualization, Imaging & Image Processing, Malaga, Spain, 2002.

    Google Scholar 

  10. Chang K.I., Bowyer K.W., Flynn P. J., Multi-modal 2D and 3D Biometrics for Face Recognition, in IEEE Workshop on Analysis and Modeling of Faces and Gestures, pp. 187–194, Nice, France, 2003.

    Google Scholar 

  11. Chen L., Zhang L., Zhang H., Abdel-mottaleb M., 3D Shape Constraint for Facial Feature Localization Using Probabilistic-like Output, in 6th IEEE Int. Conf on Automatic Face and Gesture Recognition, pp.302–307, Seoul, Korea, 2004.

    Chapter  Google Scholar 

  12. Chen L., Zhang L., Zhu L., Li M., Zhang H., A Novel Facial Feature Localization Method Using Probabilistic-Like Output, sian Conference on Computer Vision, Jeju Island, Korea, 2004.

    Google Scholar 

  13. Colbry D., Stockman G., Jain AK., Detection of Anchor Points for 3D Face Verification, in Proc. IEEE Workshop on Advanced 3D Imaging for Safety and Security, A3 DISS, San Diego, USA, 2005.

    Google Scholar 

  14. Conde C, Serrano A., Rodriguezaragôn L.J., Cabello E., 3D Facial Normalization with Spin Images and Influence of Range Data Calculation over Face Verification, IEEE Conf Computer Vision and Pattern Recognition, pp. 115, 2005.

    Google Scholar 

  15. Cristinacce D., Coûtes T., Scott I., A multi-stage approach to facial feature detection, in Proc. British Machine Vision Conference, pp. 231–240, 2004.

    Google Scholar 

  16. Çinarakakin H., Salah A.A., Akarun L., Sankur B., 2D/3D Facial Feature Extraction, in Proc. SPIE Conference on Electronic Imaging, pp. 441–452, San Jose, USA, 2006.

    Google Scholar 

  17. Ekenel H.K., Stiefelhagen R., Local Appearance Based Face Recognition Using Discrete Cosine Transform, 13th European Signal Processing Conf., Antalya, Turkey, 2005.

    Google Scholar 

  18. Feris R. S., Gemmell J., Toyama K., Krüger V., Hierarchical Wavelet Networks for Facial Feature Localization, in 5th IEEE Int. Conf on Automatic Face and Gesture Recognition, pp. 125–130, Washington DC, USA, 2002.

    Chapter  Google Scholar 

  19. Gourier N., Hall D., Crowley J.L., Facial Features Detection Robust to Pose, Illumination and Identity, in IEEE Int. Conf on Systems, Man and Cybernetics, 1(10–13), pp. 617–622, 2004.

    Google Scholar 

  20. Gu H., Su G., Du C., Feature Points Extraction from Faces, Conf on Image and Vision Computing, pp. 154–158, New Zealand, 2003.

    Google Scholar 

  21. Gunduz A., Krim H., Facial Feature Extraction Using Topological Methods, in IEEE Int. Conf on Image Processing, 1, pp. 673–676, Barcelona, Spain, 2003.

    Google Scholar 

  22. Herpers R., Michaelis M., Lichtenauer K.-H., Sommer G., Edge and Keypoint Detection in Facial Regions, in 2≫’ Int. Conf on Automatic Face and Gesture Recognition, pp. 212–217, Killington, USA, 1996.

    Google Scholar 

  23. Herpers R., Sommer G., An Attentive Processing Strategy for the Analysis of Facial Features, in Wechsler H. et al. eds., Face Recognition: From Theory to Applications, pp. 457–468, Springer, ASI Series, 1998.

    Google Scholar 

  24. Irfanoglu M.O., Gökberk B., Akarun L., 3D Shape-Based Face Recognition Using Automatically Registered Facial Surfaces, in Int. Conf of Pattern Recognition, 1, pp. 183–186, Cambridge, UK, 2004.

    Google Scholar 

  25. Lades M., Vorbruggen J., Buhmann J. Lange J., Von der malsburg C., Wurtz R., Konen W., Distortion Invariant Object Recognition in the Dynamic Link Architecture, IEEE Transactions on Computers, 42, pp. 300–311,1993.

    Google Scholar 

  26. Lai J. H., Yuen P.C., Chen W.S., Lao S., Kawade M., Robust Facial Feature Point Detection under Nonlinear Illuminations, in IEEE iccv Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, pp. 168–174, Vancouver, Canada, 2001.

    Google Scholar 

  27. Liew A.W.-C., Leung S. H., Lau W. H., Segmentation of Color Lip Images by Spatial Fuzzy Clustering, IEEE Transactions on Fuzzy Systems, 11, pp. 542–549, 2003.

    Google Scholar 

  28. Liu C., Wechsler H., Independent Component Analysis of Gabor Features for Face Recognition, IEEE Transactions on Neural Networks, 14, pp. 919–928, 2003.

    Google Scholar 

  29. Lu X., Jain A.K., Multimodal Facial Feature Extraction for Automatic 3D Face Recognition, Technical Report MSU-cse-05-22, Michigan State University, 2005.

    Google Scholar 

  30. Pan G., Wang Y., Wu Z., Pose-invariant Detection of Facial Features from Range Data, in IEEE Int. Conf. on Systems, Man, and Cybernetics, Washington DC, USA, pp. 4171–4175, 2003.

    Google Scholar 

  31. Ryu Y S., Oh S.Y, Automatic Extraction of Eye and Mouth Fields from a Face Image Using Eigenfeatures and Ensemble Networks, Applied Intelligence, 17, pp. 171–185, 2002.

    MATH  Google Scholar 

  32. Sadeghi M., Kittler J., Messer K., Modelling and Segmentation of Lip Area in Face Images, IEEE Vision, Image, and Signal Processing, 149, n° 3, pp. 179–184, 2002.

    MathSciNet  Google Scholar 

  33. Sahbi H., Boujemaa N., Robust Face Recognition Using Dynamic Space Warping, in Tistarelli M., Bigun J., Jam A.K. (eds.),Biometric Authentication, lncs 2359, pp. 121–132, Springer-Verlag, Berlin, Heidelberg, 2002.

    Google Scholar 

  34. Salah A.A., Alpaydin E., Incremental Mixtures of Factor Analyzers, in Int. Conf on Pattern Recognition, 1, Cambridge, UK, pp. 276–279, 2004.

    Google Scholar 

  35. Salah A.A., Akarun L., 3D Facial Feature Localization for Registration, in Günsel et al. (eds.), Int. Workshop on Multimedia Content Representation, Classification and Security, LHCS vol. 4105/2006, Istanbul Turkey, pp. 338–345, 2006.

    Chapter  Google Scholar 

  36. Shakunaga T., Ogawa K., Oki S., Integration of Eigentemplate and Structure Matching for Automatic Facial Feature Detection, in 3rd Int. Conf. on Automatic Face and Gesture Recognition, Nara, Japan, pp. 94–98, 1998.

    Chapter  Google Scholar 

  37. Shih F.Y., CHUANG C., Automatic Extraction of Head and Face Boundaries and Facial Features, Information Sciences, 158, pp. 117–130, 2004.

    Google Scholar 

  38. Smeraldi F., Bigun J., Retinal Vision Applied to Facial Features Detection and Face Authentication, Pattern Recognition Letters, 23, pp. 463–475, 2002.

    MATH  Google Scholar 

  39. Sobottka K., Pitas I., A Fully Automatic Approach to Facial Feature Detection and Tracking, in Bigun J., Chollet G., Borgefors G. (eds.), Audio- and Video-based Biometric Person Authentication, lncs, 1206, Springer Verlag, pp. 77–84, 1997.

    Google Scholar 

  40. Wang Y., Chua C., Ho Y., Facial Feature Detection and Face Recognition from 2D and 3D Images, Pattern Recognition Letters, 23, n°10, pp. 1191–1202, 2002.

    MATH  Google Scholar 

  41. Wiskott L., Fellous J.-M., Kruger N., Von der malsburg C., Face Recognition by Elastic Bunch Graph Matching, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, n° 7, pp. 775–779, 1997.

    Google Scholar 

  42. Wiskott L., Fellous J.-M., Kruger N., Von der malsburg C., Face Recognition by Elastic Bunch Graph Matching, in Jam L.C. et al. eds., Intelligent Biometrie Techniques in Fingerprint and Face Recognition, pp. 355–396, CRC Press, 1999.

    Google Scholar 

  43. Wong K., Lam K., Siu W., An Efficient Algorithm for Human Face Detection and Facial Feature Extraction under Different Conditions, Pattern Recognition, 34, pp. 1993–2004, 2001.

    MATH  Google Scholar 

  44. Xue Z., Lib S.Z., Teoh E.K., Bayesian Shape Model for Facial Feature Extraction and Recognition, Pattern Recognition, 36, pp. 2819–2833, 2003.

    MATH  Google Scholar 

  45. Yang, M., Ahuja N., Kriegman D., Face Detection Using Mixtures of Linear Subspaces, in 4th Int. Conf on Automatic Face and Gesture Recognition, pp. 70–76, Grenoble, France, 2000.

    Chapter  Google Scholar 

  46. Zobel M., Gebhard A., Paulus D., Denzler J., Niemann H., Robust Facial Feature Localization by Coupled Features, in 4th IEEE Int. Conf on Automatic Face and Gesture Recognition, Grenoble, France, 2000.

    Google Scholar 

  47. Zhu X., Fan J., Elmagarmid A.K., Towards Facial Feature Extraction and Verification for Omni-Face Detection in Video-Images, Image Processing, 2, pp. 113–116, 2002.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Perceptual Intelligence Laboratory, Computer Engineering Department, Boğaziçi University, PK 2TR-34342 Bebek, Istanbul, Turkey

    Albert Ali Salah & Lale Akarun

  2. Signal Processing Laboratory, Electrical and Electronic Engineering Department, Boğaziçi University, Bebek, 80815, Istanbul, Turkey.

    Hatice Çinar & Bülent Sankur

Authors
  1. Albert Ali Salah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hatice Çinar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lale Akarun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bülent Sankur
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ali Salah, A., Çinar, H., Akarun, L. et al. Robust facial landmarking for registration. Ann. Telecommun. 62, 83–108 (2007). https://doi.org/10.1007/BF03253251

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03253251

Key words

Mots clés

Search

Navigation