Skip to main content
SpringerLink
Log in

Face and Facial Expression Recognition using Three Dimensional Data

  • Reference work entry
Encyclopedia of Multimedia

  • 227 Accesses

Synonyms

3D face identification-authentication; Facial gesture determination

Definition

The establishment of identity and determination of facial expression by means of the three-dimensional shape of the face.

Introduction

As of Aristotle’s time, face appearance is considered to convey deeper cues about the identity, cognitive activity, emotional state, personality and psychopathology of an individual [1]. Early on its development, computer vision has been attracted by this rich information content of the face and automatic face analysis received substantial research interest. Most effort has been dedicated to the determination of the identity and expression of the face. The fruit of this effort has been the development of a plethora of applications in numerous and diverse fields. Behavioral studies and medicine as well as engaging human-computer communication free from obsolete interfaces like keyboards and mice are some of the fields where automatic facial expression recognition has...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 449.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. A. Abate, M. Nappi, D. Riccio, and G. Sabatino, “2D and 3D Face Recognition: A Survey,” Pattern Recognition Letters, Vol. 28, No. 14, 2007, pp. 1885–1906.

    Article  Google Scholar 

  2. J. Russel, “Is There Universal Recognition of Emotion From Facial Expression? A Review of the Cross-Cultural Studies,” Psychological Bulletin, Vol. 115, No. 1, 1994, pp. 102–141.

    Article  Google Scholar 

  3. P. Ekman and W. Friesen, “Facial Action Coding System (FACS): Manual,” Consulting Psychologists Press, Palo Alto, CA, 1978.

    Google Scholar 

  4. K. Jain, P. Flynn, and A.A. Ross, “Handbook of Biometrics,” Springer Science and Business Media, New York, 2008.

    Google Scholar 

  5. P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min and W. Worek, “Overview of the Face Recognition Grand Challenge,” Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition,” June 2005, pp. 947–954.

    Google Scholar 

  6. L. Yin, X. Wei, Y. Sun, J. Wang, and M.J. Rosato, “A 3D Facial Expression Database for Facial Behavior Research,” Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition, April 2007, pp. 211–216.

    Google Scholar 

  7. Notre Dame Biometrics Database, Available at http://www.nd.edu/∼cvrl/UNDBiometricsDatabase.html.

  8. 3D_RMA, Available at http://www.sic.rma.ac.be/∼beumier/DB/3d_rma.html.

  9. BJUT, Available at http://www.bjpu.edu.cn/sci/multimedia/mul-lab/3dface/face_database.htm.

  10. GavabDB, Available at http://gavab.escet.urjc.es.

  11. XM2VTS, Available at http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/.

  12. K. Bowyer, K. Chang, and P. Flynn, “A Survey of Approaches and Challenges in 3D and Multi-Modal 3D + 2D Face Recognition,” Computer Vision and Image Understanding, Vol. 101, 2006, pp. 1–15.

    Article  Google Scholar 

  13. F. Tsalakanidou, S. Malassiotis, and M.G. Strintzis, “Face Localization and Authentication Using Color and Depth Images,” IEEE Transactions on Image Processing, Vol. 14, No. 2, February 2005, pp. 152–168.

    Article  Google Scholar 

  14. T. Russ, C. Boehnen, and T. Peters, “3D Face Recognition Using Alignment for PCA,” Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, 2006, pp. 1391–1398.

    Google Scholar 

  15. P.J. Besl and N.D. McKay, “A Method for Registration of 3-D Shapes,” IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 14, No. 2, February 1992, pp. 239–256.

    Article  Google Scholar 

  16. X. Lu, D. Colbry, and A.K. Jain, “Matching 2.5D Scans for Face Recognition,” Proceedings of the International Conference on Pattern Recognition (ICPR 2004), pp. 362–366, 2004.

    Google Scholar 

  17. X. Lu and A.K. Jain, “Integrating Range and Texture Information for 3D Face Recognition,” Proceedings of the Seventh IEEE Workshop on Application of Computer Vision (WACV/MOTION’05), Vol. 1, 2005, pp. 156–163.

    Article  Google Scholar 

  18. C.S. Chua, F. Han, and Y.K. Ho, “3D human face recognition using point signature,” Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, pp. 233–238, 2000.

    Google Scholar 

  19. C. Conde, A. Serrano, and E. Cabello, “Multimodal 2D, 2.5D & 3D Face Verification,” Proceedings of IEEE International Conference on Image Processing, 2006.

    Google Scholar 

  20. A. Johnson and M. Hebert,“Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 5, 1999, pp. 443–449.

    Google Scholar 

  21. C. Samir, A. Srivastava, and M. Daoudi, “Three-Dimensional Face Recognition Using Shapes Of Facial Curves,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, pp. 1858–1863, 2006.

    Article  Google Scholar 

  22. G. Passalis, I. Kakadiaris, T. Theoharis, G. Toderici, and N. Murtuza, “Evaluation of 3D Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach,” Proceedings of IEEE Workshop Face Recognition Grand Challenge Experiments, June 2005.

    Google Scholar 

  23. I. Kakadiaris, G. Passalis, G. Toderici, M. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, “Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, No. 4, April 2007, pp. 640–649.

    Article  Google Scholar 

  24. K.I. Chang, K.W. Bowyer, and P.J. Flynn, “Adaptive Rigid Multi-Region Selection For Handling Expression Variation In 3d Face Recognition,” Proceedings of IEEE Workshop on Face Recognition Grand Challenge Experiments, June, 2005.

    Google Scholar 

  25. X. Li and H. Zhang, “Adapting Geometric Attributes for Expression-Invariant 3D Face Recognition,” Proceedings of IEEE International Conference on Shape Modeling and Applications, 2007, pp. 21–23.

    Google Scholar 

  26. M. Bronstein, M.M. Bronstein, and R. Kimmel, “Expression-Invariant Representations of Faces,” IEEE Transactions on Image Processing, Vol. 16, No. 1, January 2007.

    Google Scholar 

  27. I. Mpiperis, S. Malassiotis, and M.G. Strintzis, “3D Face Recognition with the Geodesic Polar Representation,” IEEE Transactions on Information Forensics and Security, Vol. 2, No. 3, September 2007, pp. 537–547.

    Article  Google Scholar 

  28. M. Pantic and L.J.M. Rothkrantz, “Automatic Analysis of Facial Expressions: The State of the Art,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 12, December 2000, pp. 1424–1445.

    Article  Google Scholar 

  29. J. Wang, L. Yin, X. Wei, and Y. Sun, “3D Facial Expression Recognition Based on Primitive Surface Feature Distribution,” Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, 2006, pp. 1399–1406.

    Google Scholar 

  30. J. Sung, S. Lee, and D. Kim, “A Real-Time Facial Expression Recognition Using the STAAM,” Proceedings of the 18th International Conference on Pattern Recognition, Vol. 1, 2006, pp. 275–278.

    Google Scholar 

  31. T.F. Cootes, G.J. Edwards, and C.J. Taylor, “Active Appearance Models,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, 2001, pp. 681–685.

    Article  Google Scholar 

  32. S. Gokturk, J.Y. Bouguet, C. Tomasi, and B. Girod, “Model Based Face Tracking for View Indepent Facial Expression Recognition,” Proceedings if IEEE International Conference on Automatic Face and Gesture Recognition, Washington, pp. 272–278, DC, May, 2002.

    Google Scholar 

  33. S. Ramanathan, A. Kassim, and Y.V. Venkatesh, “Human Facial Expression Recognition Using a 3D Morphable Model,” Proceedings of IEEE International Conference on Image Processing, pp. 661–664, October 2006.

    Google Scholar 

  34. I. Mpiperis, S. Malasiotis, V. Petridis, and M.G. Strintzis, “3D Facial Expression Recognition Using Swarm Intelligence,” IEEE International Conference on Accoustics, Speech and Signal Processing, Las Vegas, Nevada, USA, March–April 2008, to appear.

    Google Scholar 

  35. M.A.O. Vasilescu and D. Terzopoulos, “Multilinear Subspace Analysis of Image Ensembles,” Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 93–99, June, 2003.

    Google Scholar 

  36. H. Wang and N. Ahuja, “Facial Expression Decomposition,” Proceedings of the Ninth IEEE International Conference on Computer Vision, Vol. 2, October 2003, pp. 958–965.

    Google Scholar 

  37. J. Tenenbaum and W. Freeman, “Separating Style and Content with Bilinear Models,” Neural Computation, Vol. 12, 2000, pp. 1247–1283.

    Article  Google Scholar 

  38. I. Mpiperis, S. Malassiotis, and M.G. Strintzis, “Bilinear Models for 3D Face and Facial Expression Recognition,” IEEE Transactions on Information Forensics and Security, submitted for publication.

    Google Scholar 

  39. C. Li and A. Barreto, “An Integrated 3D Face-Expression Recognition Approach,” IEEE International Conference on Accoustics, Speech and Signal Processing, Vol. 3, May 2008, pp. 1132–1136.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Informatics and Telematics Institute, Thessaloniki, Greece

    Iordanis Mpiperis, Sotiris Malassiotis & Michael G. Strintzis

Authors
  1. Iordanis Mpiperis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sotiris Malassiotis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael G. Strintzis
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, Florida Atlantic University (FAU), 33431, Boca Raton, FL, USA

    Borko Furht (Department Chair) (Department Chair)

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag

About this entry

Cite this entry

Mpiperis, I., Malassiotis, S., Strintzis, M.G. (2008). Face and Facial Expression Recognition using Three Dimensional Data. In: Furht, B. (eds) Encyclopedia of Multimedia. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-78414-4_21

Download citation

Publish with us

Policies and ethics

Search

Navigation