Skip to main content
Springer Nature Link
Log in

Face Recognition Using 2D and 3D Multimodal Local Features

  • Conference paper
Advances in Visual Computing (ISVC 2006)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 4291))

Included in the following conference series:

Abstract

Machine recognition of faces is very challenging because it is an interclass recognition problem and the variation in faces is very low compared to other biometrics. Global features have been extensively used for face recognition however they are sensitive to variations caused by expressions, illumination, pose, occlusions and makeup. We present a novel 3D local feature for automatic face recognition which is robust to these variations. The 3D features are extracted by uniformly sampling local regions of the face in locally defined coordinate bases which makes them invariant to pose. The high descriptiveness of this feature makes it ideal for the challenging task of interclass recognition. In the 2D domain, we use the SIFT descriptor and fuse the results with the 3D approach at the score level. Experiments were performed using the FRGC v2.0 data and the achieved verification rates at 0.001 FAR were 98.5% and 86.0% for faces with neutral and non-neutral expressions respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE PAMI 19, 711–720 (1997)

    Google Scholar 

  2. Besl, P.J., McKay, N.D.: Reconstruction of Real-world Objects via Simultaneous Registration and Robust Combination of Multiple Range Images. IEEE TPAMI 14(2), 239–256 (1992)

    Google Scholar 

  3. Bowyer, K.W., Chang, K., Flynn, P.: A Survey Of Approaches and Challenges in 3D and Multi-modal 3D + 2D Face Recognition. CVIU 101, 1–15 (2006)

    Google Scholar 

  4. Chua, C.S., Jarvis, R.: Point Signatures: A New Representation for 3D Object Recognition. IJCV 25(1), 63–85 (1997)

    Article  Google Scholar 

  5. Chua, C., Han, F., Ho, Y.: 3D Human Face Recognition Using Point Signatures. IEEE AMFG, 233–238 (2000)

    Google Scholar 

  6. Huang, J., Heisele, B., Blanz, V.: Component-based Face Recognition with 3D Morphable Models. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  7. Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. IEEE TCSVT 14(1), 4–20 (2004)

    Google Scholar 

  8. Jones, M., Viola, P.: Face Recognition using Boosted Local Features. In: IEEE ICCV (2003)

    Google Scholar 

  9. Lowe, D.: Distinctive Image Features from Scale-invariant Key Points. In: IJCV, vol. 60(2), pp. 91–110 (2004), code available at: http://www.cs.ubc.edu.ca/~lowe/

  10. Lu, X., Jain, A.K., Colbry, D.: Matching 2.5D Scans to 3D Models. IEEE TPAMI 28(1), 31–43 (2006)

    Google Scholar 

  11. Mian, A.S., Bennamoun, M., Owens, R.A.: A Novel Representation and Feature Matching Algorithm for Automatic Pairwise Registration of Range Images. IJCV 66, 19–40 (2006)

    Article  Google Scholar 

  12. Mian, A.S., Bennamoun, M., Owens, R.A.: Automatic 3D Face Detection, Normalization and Recognition., 3DPVT (2006)

    Google Scholar 

  13. Mian, A.S., Bennamoun, M., Owens, R.A.: Region-based Matching for Robust 3D Face Recognition. BMVC 1, 199–208 (2005)

    Google Scholar 

  14. Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the Face Recognition Grand Challenge. In: IEEE CVPR (2005)

    Google Scholar 

  15. Turk, M., Pentland, A.: Eigenfaces for Recognition. JOCN 3 (1991)

    Google Scholar 

  16. Xu, C., Wang, Y., Tan, T., Quan, L.: Automatic 3D Face Recognition Combining Global Geometric Features with Local Shape Variation Information. In: IEEE ICPR, pp. 308–313 (2004)

    Google Scholar 

  17. Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face Recognition: A Literature Survey. ACM Computing Survey, 399–458 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Software Engineering, The University of Western Australia, 35 Stirling Highway, Crawley, WA, 6009, Australia

    Ajmal Mian, Mohammed Bennamoun & Robyn Owens

Authors
  1. Ajmal Mian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed Bennamoun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Robyn Owens
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada, Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. Digital Image Research Center, Kingston University, London, UK

    Paolo Remagnino

  6. Intel, 95052, Santa Clara, CA, USA

    Ara Nefian

  7. University of California, 430, Computer Science Building, 92697-3425, Irvine, CA, USA

    Gopi Meenakshisundaram

  8. Institute for Data Analysis and Visualization, P.O. Box

    Valerio Pascucci

  9. Department of Computer Science and Engineering, Czech Technical University in Prague, Czech

    Jiri Zara

  10. Rockwell Scientific, 1049 Camino Dos Rios, 91360, Thousand Oaks, CA, USA

    Jose Molineros

  11. Computer Graphics Group, Bielefeld University, D-33501, Bielefeld, Germany

    Holger Theisel

  12. Hewlett Packard Labs, Palo Alto, CA, USA

    Tom Malzbender

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mian, A., Bennamoun, M., Owens, R. (2006). Face Recognition Using 2D and 3D Multimodal Local Features. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2006. Lecture Notes in Computer Science, vol 4291. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11919476_86

Download citation

  • DOI: https://doi.org/10.1007/11919476_86

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-48628-2

  • Online ISBN: 978-3-540-48631-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics