Skip to main content
SpringerLink
Log in

About 3D Faces

  • Chapter
Registration and Recognition in Images and Videos

Part of the book series: Studies in Computational Intelligence ((SCI,volume 532))

  • 1536 Accesses

Abstract

Identity recognition using 3D scans of the face has been recently proposed as an alternative or complementary solution to conventional 2D face recognition approaches based on still images or videos. In fact, face representations based on 3D data are expected to be much more robust to pose changes and illumination variations than 2D images, thus allowing accurate face recognition also in real-world applications with unconstrained acquisition. Based on these premises, in this Chapter we will first introduce the general and main methodologies for 3D face data acquisition and preprocessing, also presenting some 3D benchmark databases and performance indicators used for evaluation and comparison. Then, we will discuss some of the results recently achieved on this subject, also presenting current trends and challenges of the research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 3DMD: http://www.3dmd.com

  2. Alyüz, N., Gökberk, B., Akarun, L.: 3D face recognition system for expression and occlusion invariance. In: IEEE 2nd International Conferance on Biometrics: Theory, Applications, and Systems, Washington, DC, USA, pp. 1–7 (2008)

    Google Scholar 

  3. Amberg, B., Knothe, R., Vetter, T.: SHREC’08 entry: Shape based face recognition with a morphable model. In: IEEE International Conference on Shape Modeling and Applications, Stoney Brook, NY, pp. 253–254 (2008)

    Google Scholar 

  4. Bagdanov, A.D., Del Bimbo, A., Masi, I.: The Florence 2D/3D hybrid face dataset. In: Joint ACM Workshop on Human Gesture and Behavior Understanding (J-HGBU 2011), Arizona, USA, pp. 79–80 (2011)

    Google Scholar 

  5. Berretti, S., Ben Amor, B., Daoudi, M., del Bimbo, A.: 3D facial expression recognition using SIFT descriptors of automatically detected keypoints. The Visual Computer 27(11), 1021–1036 (2011)

    Article  Google Scholar 

  6. Berretti, S., Del Bimbo, A.: Modeling spatial relationships between 3D objects. In: 18th International Conference on Pattern Recognition (ICPR 2006), Honk-Kong, China, vol. 1, pp. 119–122 (2006)

    Google Scholar 

  7. Berretti, S., Del Bimbo, A., Pala, P.: Description and retrieval of 3D face models using iso-geodesic stripes. In: ACM International Workshop on Multimedia Information Retrieval, Santa Barbara, CA, pp. 13–22 (2006)

    Google Scholar 

  8. Berretti, S., Del Bimbo, A., Pala, P.: 3D face recognition using iso-geodesic stripes. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(12), 2162–2177 (2010)

    Article  Google Scholar 

  9. Berretti, S., Del Bimbo, A., Pala, P.: Facial curves between keypoints for recognition of 3D faces with missing parts. In: IEEE CVPR Workshop on Multi Modal Biometrics, Colorado Springs, Colorado, pp. 49–54 (2011)

    Google Scholar 

  10. Berretti, S., del Bimbo, A., Pala, P.: Real-time expression recognition from dynamic sequences of 3D facial scans. In: Proc. 5th Eurographics/ACM SIGGRAPH Workshop on 3D Object Retrieval (3DOR 2012), Cagliari, Italy, pp. 85–92 (2012)

    Google Scholar 

  11. Berretti, S., Del Bimbo, A., Pala, P.: Superfaces: A super-resolution model for 3D faces. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012 Ws/Demos, Part I. LNCS, vol. 7583, pp. 73–82. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  12. Berretti, S., Del Bimbo, A., Pala, P.: Sparse matching of salient facial curves for recognition of 3d faces with missing parts. IEEE Transactions on Information Forensics and Security (to appear, 2013)

    Google Scholar 

  13. Besl, P.J., Mc Kay, N.D.: A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14(2), 239–256 (1992)

    Article  Google Scholar 

  14. Beumier, C., Acheroy, M.: Face verification from 3D and grey level clues. Pattern Recognition Letters 22(12), 1321–1329 (2001)

    Article  MATH  Google Scholar 

  15. Bowyer, K.W., Chang, K.I., Flynn, P.J.: A survey of approaches to three dimensional face recognition. In: International Conference on Pattern Recognition, Cambridge, United Kingdom, pp. 358–361 (2004)

    Google Scholar 

  16. Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Three dimensional face recognition. International Journal of Computer Vision 64(1), 5–30 (2005)

    Article  Google Scholar 

  17. Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Robust expression-invariant face recognition from partially missing data. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 396–408. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  18. Chang, K.I., Bowyer, K.W., Flynn, P.J.: An evaluation of multimodal 2d+3D face biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(4), 619–624 (2005)

    Article  Google Scholar 

  19. Chang, K.I., Bowyer, K.W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(6), 1695–1700 (2006)

    Article  Google Scholar 

  20. Chen, Y., Medioni, G.: Object modelling by registration of multiple range images. Image and Vision Computing 10(3), 145–155 (1992)

    Article  Google Scholar 

  21. Claes, P., Smeets, D., Hermans, J., Vandermeulen, D., Suetens, P.: SHREC’11 track: Robust fitting of statistical model. In: Eurographics Workshop on 3D Object Retrieval, Llandudno, UK, pp. 89–95 (2011)

    Google Scholar 

  22. Colombo, A., Cusano, C., Schettini, R.: Gappy PCA classification for occlusion tolerant 3D face detection. Journal of Mathematical Imaging and Vision 35(3), 193–207 (2009)

    Article  MathSciNet  Google Scholar 

  23. Cook, J., Chandran, V., Fookes, C.: 3D face recognition using log-gabor templates. In: British Machine Vision Conference, Edinburgh, United Kingdom, vol. 2, pp. 769–778 (2006)

    Google Scholar 

  24. Daoudi, M., ter Haar, F., Veltkamp, R.: SHREC contest session on retrieval of 3D face scans. In: Shape Modeling International, Stoney Brook, NY (2008)

    Google Scholar 

  25. Drira, H., Ben Amor, B., Daoudi, M., Srivastava, A.: Pose and expression-invariant 3D face recognition using elastic radial curves. In: British Machine Vision Conference, Aberystwyth, UK, pp. 1–11 (2010)

    Google Scholar 

  26. Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: A region ensemble for 3D face recognition. IEEE Transactions on Information Forensics and Security 3(1), 62–73 (2008)

    Article  Google Scholar 

  27. Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: Using multi-instance enrollment to improve performance of 3D face recognition. Computer Vision and Image Understanding 112(2), 114–125 (2008)

    Article  Google Scholar 

  28. Farkas, L.G., Munro, I.R.: Anthropometric Facial Proportions in Medicine. Thomas Books, Springfield (1987)

    Google Scholar 

  29. Gupta, S., Markey, M.K., Bovik, A.C.: Anthropometric 3D face recognition. International Journal of Computer Vision 90(3), 331–349 (2010)

    Article  Google Scholar 

  30. Huang, D., Ardabilian, M., Wang, Y., Chen, L.: 3-D face recognition using eLBP-based facial facial description and local feature hybrid matching. IEEE Transactions on Information Forensics and Security 7(5), 1551–1564 (2012)

    Article  Google Scholar 

  31. Huang, D., Zhang, G., Ardabilian, M., Wang, Y., Chen, L.: 3D Face Recognition using Distinctiveness Enhanced Facial Representations and Local Feature Hybrid Matching. In: IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), Washington D.C., USA, pp. 1–7 (2010)

    Google Scholar 

  32. Husken, M., Brauckmann, M., Gehlen, S., Malsburg, C.: Strategies and benefits of fusion of 2d and 3D face recognition. In: IEEE Workshop Face Recognition Grand Challenge, San Diego, CA (2005)

    Google Scholar 

  33. Kakadiaris, I.A., Passalis, G., Toderici, G., Murtuza, N., Lu, Y., Karampatziakis, N., Theoharis, T.: Three-dimensional face recognition in the presence of facial expressions: An annotated deformable approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(4), 640–649 (2007)

    Article  Google Scholar 

  34. Kinect: http://www.xbox.com

  35. Konica Minolta: http://sensing.konicaminolta.us/products/vivid-910-3d-laser-scanner/

  36. Lee, J.C., Milios, E.: Matching range images of human faces. In: International Conference on Computer Vision, Osaka, Japan, pp. 722–726 (1990)

    Google Scholar 

  37. Li, H., Chen, L.: SHREC’11 track: Salient points. In: Eurographics Workshop on 3D Object Retrieval, Llandudno, UK, pp. 89–95 (2011)

    Google Scholar 

  38. Lowe, D.: Distinctive image features from scale-invariant key points. International Journal of Computer Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  39. Lu, X., Jain, A.K.: Deformation modeling for robust 3D face matching. In: Conference on Computer Vision and Pattern Recognition, New York, NY, pp. 1377–1383 (2006)

    Google Scholar 

  40. Maes, C., Fabry, T., Keustermans, J., Smeets, D., Suetens, P., Vandermeulen, D.: Feature detection on 3D face surfaces for pose normalisation and recognition. In: IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), Washington D.C., USA, pp. 1–6 (2010)

    Google Scholar 

  41. Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D-3D hybrid approach to automatic face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(11), 1927–1943 (2007)

    Article  Google Scholar 

  42. Mian, A.S., Bennamoun, M., Owens, R.: Keypoint detection and local feature matching for textured 3D face recognition. International Journal of Computer Vision 79(1), 1–12 (2008)

    Article  Google Scholar 

  43. Moreno, A.B., Sánchez, Á.: Gavabdb: A 3D face database. In: Workshop on Biometrics on the Internet, Vigo, Spain, pp. 75–80 (2004)

    Google Scholar 

  44. Pan, G., Han, S., Wu, Z., Wang, Y.: 3D face recognition using mapped depth images. In: Conference on Computer Vision and Pattern Recognition, San Diego, CA, vol. 3, pp. 175–181 (2005)

    Google Scholar 

  45. Passalis, G., Kakadiaris, I.A., Theoharis, T., Toderici, G., Murtuza, N.: Evaluation of 3D face recognition in the presence of facial expressions: an annotated deformable model approach. In: IEEE Workshop on Face Recognition Grand Challenge Experiments, San Diego, CA, vol. 3, pp. 171–179 (2005)

    Google Scholar 

  46. Passalis, G., Perakis, P., Theoharis, T., Kakadiaris, I.A.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(10), 1938–1951 (2011)

    Article  Google Scholar 

  47. Perakis, P., Passalis, G., Theoharis, T., Toderici, G., Kakadiaris, I.A.: Partial matching of interpose 3D facial data for face recognition. In: International Conference on Biometrics: Theory, Applications, and Systems, Washington, DC, pp. 1–8 (2009)

    Google Scholar 

  48. Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Workshop on Face Recognition Grand Challenge Experiments, San Diego, CA, pp. 947–954 (2005)

    Google Scholar 

  49. Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Worek, W.: Preliminary face recognition grand challenge results. In: International Conference on Automatic Face and Gesture Recognition, Southampton, UK, pp. 15–24 (2006)

    Google Scholar 

  50. Phillips, P.J., Grother, P., Micheals, R.J., Blackburn, D., Tabassi, E., Bone, M.: FRVT 2002: Evaluation report. Tech. rep., National Institute of Standards and Technology, NIST (2003)

    Google Scholar 

  51. Phillips, P.J., Scruggs, W.T., O’Toole, A.J., Flynn, P.J., Bowyer, K.W., Schott, C.L., Sharpe, M.: FRVT 2006 and ICE 2006 large-scale results. Tech. rep., National Institute of Standards and Technology (NIST), Gaithersburg, MD (2007)

    Google Scholar 

  52. Queirolo, C.C., Silva, L., Bellon, O.R., Segundo, M.P.: 3D face recognition using simulated annealing and the surface interpenetration measure. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(2), 206–219 (2010)

    Article  Google Scholar 

  53. Samir, C., Srivastava, A., Daoudi, M.: 3D face recognition using shapes of facial curves. In: International Conference on Acoustics, Speech, and Signal Processing, Toulouse, France, vol. V, pp. 933–936 (2006)

    Google Scholar 

  54. Sandbach, G., Zafeiriou, S., Pantic, M., Rueckert, D.: Recognition of 3D facial expression dynamics. Image and Vision Computing (2012) (in press)

    Google Scholar 

  55. Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BIOID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  56. ter Haar, F., Veltkamp, R.: SHREC’08 entry: 3D face recognition using facial contour curves. In: IEEE International Conference on Shape Modeling and Applications, Stoney Brook, NY, pp. 259–260 (2008)

    Google Scholar 

  57. Tola, E., Lepetit, V., Fua, P.: A fast local descriptor for dense matching. In: International Conference on Computer Vision and Pattern Recognition, Anchorage, AK, pp. 1–8 (2008)

    Google Scholar 

  58. University of Notre Dame Biometrics Datasets (2008), http://www3.nd.edu/~cvrl/CVRL/Data_Sets.html

  59. Veltkamp, R., van Jole, S., Drira, H., Ben Amor, B., Daoudi, M., Li, H., Chen, L., Claes, P., Smeets, D., Hermans, J., Vandermeulen, D., Suetens, P.: SHREC’11 track: 3D face models retrieval. In: Eurographics Workshop on 3D Object Retrieval, Llandudno, UK, pp. 89–95 (2011)

    Google Scholar 

  60. Wang, Y., Chiang, M.C., Thompson, P.M.: Mutual information-based 3D surface matching with applications to face recognition and brain mapping. In: International Conference on Computer Vision, Beijing, China, pp. 527–534 (2005)

    Google Scholar 

  61. Wang, Y., Liu, J., Tang, X.: Robust 3D face recognition by local shape difference boosting. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(12), 1858–1870 (2010)

    Article  Google Scholar 

  62. Wang, Y., Tang, X., Liu, J., Pan, G., Xiao, R.: 3D face recognition by local shape difference boosting. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 603–616. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  63. Xu, D., Hu, P., Cao, W., Li, H.: SHREC’08 entry: 3D face recognition using moment invariants. In: IEEE International Conference on Shape Modeling and Applications, Stoney Brook, NY, pp. 261–262 (2008)

    Google Scholar 

  64. Yan, P., Bowyer, K.W.: A fast algorithm for icp-based 3D shape biometrics. Computer Vision and Image Understanding 107(3), 195–202 (2007)

    Article  Google Scholar 

  65. Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.: A 3d facial expression database for facial behavior research. In: Proc. IEEE Int. Conf. on Automatic Face and Gesture Recognition, Southampton, UK, pp. 211–216 (2006)

    Google Scholar 

  66. Zhang, Z.: Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision 13(2), 119–152 (1994)

    Article  Google Scholar 

  67. Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Survey 35(4), 399–458 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Ingegneria dell’Informazione, University of Firenze, via S.Marta 3, 50139, Firenze, Italy

    Stefano Berretti, Alberto Del Bimbo & Pietro Pala

Authors
  1. Stefano Berretti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alberto Del Bimbo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pietro Pala
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefano Berretti .

Editor information

Editors and Affiliations

  1. University of Cambridge Department of Engineering, Cambridge, United Kingdom

    Roberto Cipolla

  2. Università di Catania Dipartimento di Matematica e Informatica, Catania, Catania, Italy

    Sebastiano Battiato

  3. Università di Catania Dipartimento di Matematica e Informatica, Catania, Italy

    Giovanni Maria Farinella

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Berretti, S., Del Bimbo, A., Pala, P. (2014). About 3D Faces. In: Cipolla, R., Battiato, S., Farinella, G. (eds) Registration and Recognition in Images and Videos. Studies in Computational Intelligence, vol 532. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-44907-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-44907-9_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-44906-2

  • Online ISBN: 978-3-642-44907-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation