Skip to main content
SpringerLink
Log in

Static Posed Versus Genuine Smile Recognition

  • Conference paper
  • First Online:
Proceedings of the 10th International Conference on Computer Recognition Systems CORES 2017 (CORES 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 578))

Included in the following conference series:

  • 1071 Accesses

Abstract

Recognition of a posed or fake smile is a vital and challenging research topic and a growing interest has been observed from the computer vision and machine learning community. The state-of-the-art algorithms related to this field focus on the facial expressions dynamics, while several psychologists suggest that the main difference between posed and spontaneous smile should be observed in different muscles contractions in the upper part of the face. Therefore, in this work we evaluate the accuracy of recognition based only on the face appearance using the High-Dimensional Local Binary Patterns. The smile authenticity is analyzed on the set of images extracted at the smile apex phase from the UvA-NEMO database. The obtained results indicate that the analyzed algorithms can spot a fake smile much better than a human, but worse than systems that incorporate the facial dynamics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Calder, A.J., Young, A.W.: Understanding the recognition of facial identity and facial expression? Nat. Rev. Neurosci. 6, 641–651 (2005)

    Article  Google Scholar 

  2. Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3025–3032 (2013)

    Google Scholar 

  3. Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. J. Wavelets Multiresolut. Inf. Process. 02(02), 121–132 (2004)

    Article  Google Scholar 

  4. Dibeklioglu, H., Salah, A., Gevers, T.: Recognition of genuine smiles. IEEE Trans. Multimedia 17(3), 279–294 (2015)

    Article  Google Scholar 

  5. Dibeklioğlu, H., Salah, A.A., Gevers, T.: Are you really smiling at me? Spontaneous versus posed enjoyment smiles. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 525–538. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33712-3_38

    Chapter  Google Scholar 

  6. Duchenne, G.B.: The mechanism of human facial expression or an electro-physiological analysis of the expression of emotions. Cambridge University Press (1990). Original work published 1862

    Google Scholar 

  7. Ekman, P., Davidson, R.J., Friesen, W.V.: The Duchenne smile: emotional expression and brain physiology: II. J. Person. Soc. Psychol. 58(2), 342–353 (1990)

    Article  Google Scholar 

  8. Ekman, P., Friesen, W.: Facial Action Coding System: Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  9. Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. J. Nonverbal Behav. 6(4), 238–252 (1982)

    Article  Google Scholar 

  10. Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: Multi-PIE. Image Vis. Comput. 28(5), 807–813 (2010)

    Article  Google Scholar 

  11. Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4295–4304 (2015)

    Google Scholar 

  12. Hoque, M.E., McDuff, D., Picard, R.: Exploring temporal patterns in classifying frustrated and delighted smiles (extended abstract). In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 505–511 (2015)

    Google Scholar 

  13. Kawulok, M., Nalepa, J., Nurzynska, K., Smolka, B.: In search of truth: analysis of smile intensity dynamics to detect deception. In: Montes-y-Gómez, M., Escalante, H.J., Segura, A., Murillo, J.D. (eds.) IBERAMIA 2016. LNCS, vol. 10022, pp. 325–337. Springer, Cham (2016). doi:10.1007/978-3-319-47955-2_27

    Chapter  Google Scholar 

  14. Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014)

    Google Scholar 

  15. Li, H.D., Xu, Q.S., Liang, Y.Z.: Random frog: an efficient reversible jump Markov chain Monte Carlo-like approach for variable selection with applications to gene selection and disease classification. Analytica Chimica Acta 740, 20–26 (2012)

    Article  Google Scholar 

  16. Liu, H., Wu, P.: Comparison of methods for smile deceit detection by training AU6 and AU12 simultaneously. In: 2012 19th IEEE International Conference on Image Processing, pp. 1805–1808 (2012)

    Google Scholar 

  17. Martinez, B., Valstar, M.F.: Advances, challenges, and opportunities in automatic facial expression recognition. In: Kawulok, M., Celebi, M.E., Smolka, B. (eds.) Advances in Face Detection and Facial Image Analysis, pp. 63–100. Springer, Cham (2016). doi:10.1007/978-3-319-25958-1_4

    Google Scholar 

  18. Mathias, M., Benenson, R., Pedersoli, M., Gool, L.: Face detection without bells and whistles. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 720–735. Springer, Cham (2014). doi:10.1007/978-3-319-10593-2_47

    Google Scholar 

  19. Ojala, T., Pietikainen, M., Harwood, D.: Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, vol. 1 - Conference A: Computer Vision amp; Image Processing, vol. 1, pp. 582–585 (1994)

    Google Scholar 

  20. Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  MATH  Google Scholar 

  21. Porter, S., Korva, N., Baker, A.: Secrets of the human face: new insights into the face and covert emotions. Psychol. Aotearoa 3(2), 94–99 (2011)

    Google Scholar 

  22. Schmidt, K.L., Ambadar, Z., Cohn, J.F., Reed, L.I.: Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling. J. Nonverbal Behav. 30(1), 37–52 (2006)

    Article  Google Scholar 

  23. Suwa, M., Sugie, N., Fujimora, K.: A preliminary note on pattern recognition of human emotional expression. In: International Joint Conference on Pattern Recognition, pp. 408–410 (1978)

    Google Scholar 

  24. Tracy, J.L., Randles, D., Steckler, C.M.: The nonverbal communication of emotions. Curr. Opin. Behav. Sci. 3, 25–30 (2015)

    Article  Google Scholar 

  25. Valstar, M.F., Pantic, M., Ambadar, Z., Cohn, J.F.: Spontaneous vs. posed facial behavior: automatic analysis of brow actions. In: Proceedings of the 8th International Conference on Multimodal Interfaces, pp. 162–170 (2006)

    Google Scholar 

  26. Weker, M.M.: Smile and lie? Why we are able to distinguish false smiles from genuine ones. In: Evers, D., Fuller, M., Runehov, A., Sæther, K.-W. (eds.) Issues in Science and Theology: Do Emotions Shape the World?. ISRPESSST, pp. 59–71. Springer, Cham (2016). doi:10.1007/978-3-319-26769-2_5

    Chapter  Google Scholar 

  27. Wu, P., Liu, H., Zhang, X.: Spontaneous versus posed smile recognition using discriminative local spatial-temporal descriptors. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1240–1244 (2014)

    Google Scholar 

Download references

Acknowledgment

This material is based on work supported by the Polish National Science Center (NCN) under the Grant: DEC-2012/07/B/ST6/0122. This work has received funding from statutory funds (BK/213/RAU1/2017) of the Institute of Automatic Control, Silesian University of Technology, Poland.

Author information

Authors and Affiliations

  1. Insitute of Automatic Control, Silesian University of Technology, Gliwice, Poland

    Krystian Radlak, Natalia Radlak & Bogdan Smolka

Authors
  1. Krystian Radlak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Natalia Radlak
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bogdan Smolka
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Krystian Radlak .

Editor information

Editors and Affiliations

  1. Department of Systems and Computer Networks, Wrocław University of Technology, Wrocław, Poland

    Marek Kurzynski

  2. Department of Systems and Computer Networks, Wrocław University of Technology, Wroclaw, Poland

    Michal Wozniak

  3. Department of Systems and Computer Networks, Wrocław University of Technology , Wroclaw, Poland

    Robert Burduk

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Radlak, K., Radlak, N., Smolka, B. (2018). Static Posed Versus Genuine Smile Recognition. In: Kurzynski, M., Wozniak, M., Burduk, R. (eds) Proceedings of the 10th International Conference on Computer Recognition Systems CORES 2017. CORES 2017. Advances in Intelligent Systems and Computing, vol 578. Springer, Cham. https://doi.org/10.1007/978-3-319-59162-9_44

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59162-9_44

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59161-2

  • Online ISBN: 978-3-319-59162-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation