Skip to main content
SpringerLink
Log in

Cross-Cultural Design of Facial Expressions of Robots

  • Conference paper
  • First Online:
Book cover Cross-Cultural Design. User Experience of Products, Services, and Intelligent Environments (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12192))

Included in the following conference series:

  • 2330 Accesses

Abstract

In this research, the authors succeeded in creating facial expressions made with the minimum necessary elements for recognizing a face. The elements are two eyes and a mouth made using precise circles, which are transformed to make facial expressions geometrically, through rotation and vertically scaling transformation. The facial expression patterns made by the geometric elements and transformations were composed employing three dimensions of visual information that had been suggested by many previous researches, slantedness of the mouth, openness of the face, and slantedness of the eyes. In addition, the relationships between the affective meanings of the visual information also corresponded to the results of the previous researches.

The authors found that facial expressions can be classified into 10 emotions: happy, angry, sad, disgust, fear, surprised, angry*, fear*, neutral (pleasant) indicating positive emotion, and neutral (unpleasant) indicating negative emotion. These emotions were portrayed by different geometric transformations. Furthermore, the authors discovered the “Tetrahedral model,” which can express most clearly the geometric relationships between facial expressions. In this model, each side connecting the face is an axis that controlled the rotational and vertically scaling transformations of the eyes and mouth.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ellis, H.D., Shepherd, J.W., Davis, G.M.: Identification of familiar and unfamiliar face from internal and external features: some implications for theories of face recognition. Perception 8, 431–439 (1979)

    Google Scholar 

  2. Shepherd, J.W., Davis, G.M., Ellis, H.D.: “Studies of cue salienc” Perceiving and Remembering Faces, pp. 105–131. Academic Press, Cambridge (1981)

    Google Scholar 

  3. Young, A.W., Hay, D.C., McWeeny, K.H., Fluid, B.M., Ellis, A.W.: Matching familiar and unfamiliar faces on internal and external features. Perception 14, 737–746 (1985)

    Google Scholar 

  4. Yin, R.K.: Looking at upside-down faces. J. Exp. Psychol. 81, 141–145 (1969)

    Google Scholar 

  5. Diamond, R., Carey, S.: Why faces are and are not special: an effect of expertise. J. Exp. Psychol. 115, 107–117 (1986)

    Google Scholar 

  6. Goren, C., Sartty, M., Wu, P.: Visual scan patterns of rhesus monkeys viewing faces. Perception 11, 133–140 (1975)

    Google Scholar 

  7. Johnson, M.H., Morton, J.: Biology and Cognitive Development: The Case of Face Recognition. Blackwell, Cambridge (1991)

    Google Scholar 

  8. Ekman, P., Friesen, W.V., Ellsworth, P.: What emotion categories or dimensions can observers judge from facial behaviour? In: Goldstein, A.P., Krasner, L. (eds.) Emotion in the Human Face, pp. 39–55. Cambridge University Press, Cambridge (1982)

    Google Scholar 

  9. Smith, C.A., Ellsworth, P.C.: Patterns of cognitive appraisal in emotion. J. Pers. Soc. Psychol. 48(4), 813–838 (1985)

    Google Scholar 

  10. Yamada, H.: Expression model for process of perceptive estimation of facial expression. Jpn. Psychol. Rev. 43(2), 225–245 (2000). (in Japanese)

    Google Scholar 

  11. Darwin, C.: The Expression of the Emotions in Man and Animals. Oxford University Press, Oxford (1998). (original work published 1872)

    Google Scholar 

  12. Ekman, P.: Basic Emotions, Handbook of Cognition and Emotion, pp. 45–60. Wiley, New York (1999)

    Google Scholar 

  13. Russell, J.A.: Reading Emotions from and into Faces: Resurrecting a Dimensional-Contextual Perspective, The Psychology of Facial Expression, pp. 295–320. Cambridge University Press, Cambridge (1997)

    Google Scholar 

  14. Ekman, P.: Basic Emotions. In: Daglesh, T., Power, M. (eds.) Handbook of Cognition and Emotion, pp. 45–60. Wiley, New York (1999)

    Google Scholar 

  15. Ekman, P.: Universals and cultural differences in facial expressions of emotion. Nebr. Symp. Motiv. 19, 207–283 (1972)

    Google Scholar 

  16. Ekman, P.: Cross-cultural studies of facial expression. In: Ekman, P. (ed.) Darwin and Facial Expression: A Century of Research in Review, pp. 169–222. Academic Press, Cambridge (1973)

    Google Scholar 

  17. Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3), 169–200 (1992)

    Google Scholar 

  18. Ekman, P.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17(2), 124–129 (1971)

    Google Scholar 

  19. Ekman, P.: Pan-cultural elements in facial displays of emotions. Science 169, 86–88 (1969)

    Google Scholar 

  20. Ekman, P.: Conceptual ambiguities. In: Goldstein, A.P., Krasner, L. (eds.) Emotion in the Human Face. Cambridge University Press, Cambridge (1982)

    Google Scholar 

  21. Ekman, P.: Universals and cultural differences in the judgments of facial expressions of emotion. J. Pers. Soc. Psychol. 53(4), 712–717 (1987)

    Google Scholar 

  22. Schlosberg, H.: The description of facial expressions in terms of two dimensions. J. Exp. Psychol. 44(4), 229–237 (1952)

    Google Scholar 

  23. Schlosberg, H.: Three dimensions of emotion. Psychol. Rev. 10(5), 81–88 (1954)

    Google Scholar 

  24. Shah, R., Lewis, M.B.: Locating the neutral expression in the facial-emotion space. Vis. Cogn. 1(5), 549–566 (2003)

    Google Scholar 

  25. Takehara, T., Suzuki, N.: Robustness of the two- dimensional structure of recognition of emotionality. Percept. Mot. Skills 93(3), 739–753 (2001)

    Google Scholar 

  26. Yamada, H.: Visual information for categorizing facial expression of emotions. Appl. Cogn. Psychol. 3(7), 252–270 (1993)

    Google Scholar 

  27. Yamada, H., Shibui, S.: The relationship between visual information and affective meanings from facial expressions of emotion. Perception 27, 133 (1998)

    Google Scholar 

  28. Watanabe, N.: Research of distribution of facial expressions in emotional space by using affect grid method. Jpn. Psychol. Res. 65, 274 (2001). (in Japanese)

    Google Scholar 

  29. Yamada, H., Matsuda, T., Watari, C., Suenaga, T.: Dimenson of visual information for categorizing facial expressions of emotion. Jpn. Psychol. Res. 35(4), 172–181 (1993)

    Google Scholar 

  30. Watanabe, N., Suzuki, R., Yamada, H.: Visual information related to facial expression recognition - Research of 3 dimensional structure, The Technical report of The Proceeding of The Institute of Electronics, Information and communication Engineers, vol. 102, no. 598, HCS2002-35, pp. 43–48 (2003)

    Google Scholar 

  31. Watanabe, N., Suzuki, R., Yamada, H.: Re-consideration about relationship between mental and physical information for facial expression recognition. Jpn. Soc. Cogn. Psychol. 3(2), 167–179 (2006). (in Japanese)

    Google Scholar 

  32. Russell, J.A., Weiss, A., Medelsohn, G.A.: Affect grid: a single-item scale of pleasure and arousal. J. Pers. Soc. Psychol. 57(3), 493–502 (1989)

    Google Scholar 

  33. Kawahara, H., Matsumoto, N.: A cognitive analysis to the variety in facial features of prehistoric figurines: an approach from cognitive and esthetic archaeology, Technical report of IEICE. HIP, vol. 107, no. 369, pp. 79-84 (2007)

    Google Scholar 

  34. Carrera, P., Fernandez-Dos, J.M.: Neutral faces in context, Their emotional and their function. J. Nonverbal Behav. 18, 281–299 (1994)

    Google Scholar 

  35. Okamoto, T.: Numerical experiment for assessment of reproducibility of each method of multiple classification analysis. Behav. Soc. Japan 18(2), 47–56 (1991). (in Japanese)

    Google Scholar 

Download references

Acknowledgement

This work was supported by Grant-in-Aid for Scientific Research on Innovative Areas No. 18H04203 “Construction of the Face-Body Studies in Transcultural Conditions”.

Author information

Authors and Affiliations

  1. The University of Nagasaki, Manabino 1-1-1, Nagayo, Nagasaki, Japan

    Ichi Kanaya & Meina Tawaki

  2. Kyoto Institute of Technology, Matsugasaki, Sakyo-ku, Kyoto, Japan

    Keiko Yamamoto

Authors
  1. Ichi Kanaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Meina Tawaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Keiko Yamamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ichi Kanaya .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Pei-Luen Patrick Rau

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kanaya, I., Tawaki, M., Yamamoto, K. (2020). Cross-Cultural Design of Facial Expressions of Robots. In: Rau, PL. (eds) Cross-Cultural Design. User Experience of Products, Services, and Intelligent Environments. HCII 2020. Lecture Notes in Computer Science(), vol 12192. Springer, Cham. https://doi.org/10.1007/978-3-030-49788-0_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49788-0_45

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49787-3

  • Online ISBN: 978-3-030-49788-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation