Skip to main content

A Computational Other-Race-Effect Analysis for 3D Facial Expression Recognition

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9967))

Abstract

This paper investigates the other-race-effects in automatic 3D facial expression recognition, giving the computational analysis of the recognition performance obtained from two races, namely white and east Asian. The 3D face information is represented by local depth feature, and then a feature learning process is used to obtain race-sensitive features to simulate the other-race-effect. The learned features from own race and other race are then used to do facial expression recognition. The proposed analysis is conducted on BU-3DFE database, and the results show that the learned features from one race achieve better recognition performance on the own-race faces. It reveals that the other-race-effect are significant in facial expression recognition problem, which confirms the results of psychological experiment results.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surveys (CSUR) 35(4), 399–458 (2003)

    Article  Google Scholar 

  2. Samal, A., Iyengar, P.A.: Automatic recognition and analysis of human faces and facial expressions: a survey. Pattern Recogn. 25(1), 65–77 (1992)

    Article  Google Scholar 

  3. Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recogn. 36(1), 259–275 (2003)

    Article  MATH  Google Scholar 

  4. Sandbach, G., Zafeiriou, S., Pantic, M., Yin, L.: Static and dynamic 3d facial expression recognition: a comprehensive survey. Image Vis. Comput. 30(10), 683–697 (2012)

    Article  Google Scholar 

  5. Ng, C.B., Tay, Y.H., Goi, B.M.: Vision-based human gender recognition: a survey. arXiv preprint (2012). arXiv:1204.1611

  6. Fu, Y., Guo, G., Huang, T.S.: Age synthesis and estimation via faces: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 32(11), 1955–1976 (2010)

    Article  Google Scholar 

  7. Fu, S., He, H., Hou, Z.G.: Learning race from face: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 36(12), 2483–2509 (2014)

    Article  Google Scholar 

  8. Phillips, P.J., Jiang, F., Narvekar, A., Ayyad, J., O’Toole, A.J.: An other-race effect for face recognition algorithms. ACM Trans. Appl. Percep. (TAP) 8(2), 14 (2011)

    Google Scholar 

  9. Bettadapura, V.: Face expression recognition and analysis: the state of the art. arXiv preprint (2012). arXiv:1203.6722

  10. Dailey, M.N., Joyce, C., Lyons, M.J., Kamachi, M., Ishi, H., Gyoba, J., Cottrell, G.W.: Evidence and a computational explanation of cultural differences in facial expression recognition. Emotion 10(6), 874 (2010)

    Article  Google Scholar 

  11. Huang, D., Ouji, K., Ardabilian, M., Wang, Y., Chen, L.: 3d face recognition based on local shape patterns and sparse representation classifier. In: Lee, K.-T., Tsai, W.-H., Mark Liao, H.-Y., Chen, T., Hsieh, J.-W., Tseng, C.-C. (eds.) MMM 2011, Part. LNCS, vol. 6523, pp. 206–216. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  12. Zhen, Q., Huang, D., Wang, Y., Chen, L.: Muscular movement model based automatic 3d facial expression recognition. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part I. LNCS, vol. 8935, pp. 522–533. Springer, Heidelberg (2015). doi:10.1007/978-3-319-14445-0_45

    Google Scholar 

  13. Yang, X., Huang, D., Wang, Y., Chen, L.: Automatic 3d facial expression recognition using geometric scattering representation. In: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), vol. 1, pp. 1–6. IEEE (2015)

    Google Scholar 

  14. Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3d facial expression database for facial behavior research. In: 7th International Conference on Automatic Face and Gesture Recognition (FGR06), pp. 211–216. IEEE (2006)

    Google Scholar 

  15. Malpass, R.S., Kravitz, J.: Recognition for faces of own and other race. J. Personal. Soc. Psychol. 13(4), 330 (1969)

    Article  Google Scholar 

  16. Jain, A.K., Li, S.Z.: Handbook of Face Recognition. Springer, London (2011)

    MATH  Google Scholar 

  17. Shen, L., Bai, L.: A review on gabor wavelets for face recognition. Pattern Anal. Appl. 9(2–3), 273–292 (2006)

    Article  MathSciNet  Google Scholar 

  18. O’Toole, A.J., Deffenbacher, K., Abdi, H., Bartlett, J.C.: Simulating the other-race effect as a problem in perceptual learning. Connect. Sci. 3(2), 163–178 (1991)

    Article  Google Scholar 

  19. OToole, A.J., Deffenbacher, K., Valentin, D., Abdi, H.: Low-dimensional representation of faces in higher dimensions of the face space. JOSA A 10(3), 405–411 (1993)

    Article  Google Scholar 

  20. O’Toole, A.J., An, X., Dunlop, J., Natu, V., Phillips, P.J.: Comparing face recognition algorithms to humans on challenging tasks. ACM Trans. Appl. Percep. (TAP) 9(4), 16 (2012)

    Google Scholar 

  21. Zulqarnain Gilani, S., Shafait, F., Mian, A.: Shape-based automatic detection of a large number of 3d facial landmarks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4639–4648 (2015)

    Google Scholar 

  22. Xue, M., Mian, A., Liu, W., Li, L.: Fully automatic 3d facial expression recognition using local depth features. In: IEEE Winter Conference on Applications of Computer Vision, pp. 1096–1103. IEEE (2014)

    Google Scholar 

  23. D’Errico, J.R.: Understanding gridfit. Information (2006). http://www.mathworks.com/matlabcentral/fileexchange/loadFile.do

  24. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported by National Natural Science Foundation of China (Grant No. 61370146), Liaoning Science & Technology of Liaoning Province of China (Grant No. 2013405003), Natural Science Foundation of China (Grant No. 61262071) and Application Infrastructure Projects in Yunnan Province (Grant No. 2014FD016).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaodong Duan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Xue, M. et al. (2016). A Computational Other-Race-Effect Analysis for 3D Facial Expression Recognition. In: You, Z., et al. Biometric Recognition. CCBR 2016. Lecture Notes in Computer Science(), vol 9967. Springer, Cham. https://doi.org/10.1007/978-3-319-46654-5_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46654-5_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46653-8

  • Online ISBN: 978-3-319-46654-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics