Skip to main content

Effects of Gender and Luminance Backgrounds on the Recognition of Neutral Facial Expressions

  • Chapter
  • First Online:
Multidisciplinary Approaches to Neural Computing

Abstract

In this study we challenged the universal view of facial emotion perception evaluating the effects of gender and different luminance backgrounds on the recognition accuracy of neutral facial expressions. To this aim, we applied the Ekman standard paradigm for assessing the human ability to decode neutral facial expressions reproduced on black, white and grey backgrounds and portrayed by male and female actors. The exploited stimuli consisted of 10 different neutral faces (5 females) selected from the Dutch Radboud database (Langner et al. Cogn Emot, 2010 [21]) where luminance backgrounds were changed in black, grey and white. The resulted 30 stimuli were assessed by 31 subjects (16 females) who were asked to tag each of them with one of the six primary emotion labels. The data analysis demonstrates a significant gender effect where neutral male faces are less accurately decoded than females ones. On the other hand, no effects of luminance backgrounds have been identified.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Context information is intended here as including the physical, social, individual, and organizational aspects of context surrounding the emotional facial expression that has to be recognized.

  2. 2.

    RGB is an additive color model based on three primary colors: red, green, and blue. Each color is represented by three integers ranging in the numerical set of [0, 255], and representing the intensity of each primary color [32].

  3. 3.

    www.superlab.com/. Copyright 2012 Cedrus Corporation.

  4. 4.

    The signed squares represents the accepted answers: vision (normal vision, glasses, contact lenses), with no learning disabilities, that they are no synaesthete, answering “no” to all questions for participation in the experiment.

References

  1. Aviezer, H., et al.: Angry, disgusted, or afraid? Studies on the malleability of emotion perception. Psychol. Sci. 19(7), 724–732 (2008)

    Article  Google Scholar 

  2. Barrett, L.F.: Variety is the spice of life: a psychological construction approach to understanding variability in emotion. Cogn. Emot. 23(7), 1284–1306 (2009)

    Article  Google Scholar 

  3. Barrett, L.F., Mesquita, B., Gendron, M.: Context in emotion perception. Curr. Dir. Psychol. Sci. 20(5), 286–290 (2011)

    Article  Google Scholar 

  4. Capuano, V., Riviello, M.T., Cordasco, G., Mekyska, J., Faundez-Zanuy, M., Esposito, A.: Assessing natural emotional facial expressions: an evaluation of the I.Vi.T.E. database. In: von Dieter Mehnert, H., Kordon, U., Wolff, M. (eds.) Rüdiger Hoffmann zum, vol. 65, pp. 249–255. Geburtstag Systemtheorie Signalverarbeitung Sprachtechnologie, TUD press. Kartoniert (2013)

    Google Scholar 

  5. Carroll, J.M., Russell, J.A.: Do facial expressions signal specific emotions? Judging emotion from the face in context. J. Pers. Soc. Psychol. 70(2), 205 (1996)

    Article  Google Scholar 

  6. Cheon, Y., Kim, D.: Natural facial expression recognition using differential-AAM and manifold learning. Pattern Recogn. 42(7), 1340–1350 (2009)

    Article  MATH  Google Scholar 

  7. da Pos, O., Green-Armytage, P.: Facial expressions, colours and basic emotions. JAIC-J. Int. Colour Assoc. 1 (2012)

    Google Scholar 

  8. de Gelder, B., Meeren, H.K., Righart, R., Van den Stock, J., van de Riet, W.A., Tamietto, M.: Beyond the face: exploring rapid influences of context on face processing. Prog. Brain Res. 155, 37–48 (2006)

    Google Scholar 

  9. Ekman, P., Cordaro, D.: What is meant by calling emotions basic. Emot. Rev. 3(4), 364–370 (2011). doi:10.1177/1754073911410740

    Article  Google Scholar 

  10. Esposito A, Capuano V, Mekyska J, Faundez-Zanuy M: A naturalistic database of thermal emotional facial expressions and effects of induced emotions on memory. In: Esposito, A., et al. (eds.) Behavioural cognitive systems, LNCS, vol. 7403, pp. 158–173. Springer, Heidelberg (2012). ISBN: 978-3-642-34583-8 e-ISBN 978-3-642-34584-5

    Google Scholar 

  11. Esposito, A.: The situated multimodal facets of human communication. In: Coverbal Synchrony in Human-Machine Interaction, pp. 173–202 (2013a)

    Google Scholar 

  12. Esposito, A.: Emotional expressions: communicative displays or psychological universals?. In: COST Strategic Workshop on Social Robot Booklet-Perception. www.cost.eu/download/38170, p. 32 (2013b)

  13. Esposito, A., Esposito, A.M., Vogel, C.: Needs and challenges in human computer interaction for processing social emotional information. Pattern Recogn. Lett. 66, 41–51 (2015a)

    Article  Google Scholar 

  14. Esposito, A., Palumbo, D., Troncone, A.: Effects of narrative identities and attachment style on the individual’s ability to categorize emotional voices. In: Bassis S. et al. (eds.) Advances in Neural Networks: Computational and Theoretical Issues, Springer International Publishing Switzerland, SIST Series, vol. 37, pp. 265–272 (2015b)

    Google Scholar 

  15. Esposito, A., Jain, L. C.: Modeling Emotions in Robotic Socially Believable Behaving Systems Toward Robotic Socially Believable Behaving Systems, vol. I, pp. 9–14. Springer (2016)

    Google Scholar 

  16. Fridlund, A. J.: The new ethology of human facial expressions. In: The Psychology of Facial Expression, vol. 112, pp. 103–129 (1997)

    Google Scholar 

  17. Hall, E.: The hidden dimension. Garden City, NY: Doubleday (1966)

    Google Scholar 

  18. Izard, C.E.: Innate and universal facial expressions: evidence from developmental and cross-cultural research. Psychol. Bull. 115(2), 288–299 (1994)

    Article  Google Scholar 

  19. Joosten, E., Van Lankveld, G., Spronck, P.: Influencing player emotions using colors. J. Intell. Comput. 3(2), 76–86 (2012)

    Google Scholar 

  20. Lambrecht, L., Kreifelts, B., Wildgruber, D.: Gender differences in emotion recognition: impact of sensory modality and emotional category. Cogn. Emot. 28(3), 452–469 (2014)

    Article  Google Scholar 

  21. Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D.H.J., Hawk, S.T., van Knippenberg, A.: Presentation and validation of the Radboud Faces Database. Cogn. Emot. (2010)

    Google Scholar 

  22. Maldonato, N.M., Dell’Orco, S.: Making decision under uncertainty, emotions, risk and biases. In: Bassis, S., Esposito, A., Morabito, F.C. (eds.) Advances in Neural Networks: Computational and Theoretical Issues, SIST series, vol. 37, pp. 293–302. Springer International Publishing, Switzerland (2015)

    Google Scholar 

  23. Masuda, T., Ellsworth, P.C., Mesquita, B., Leu, J., Tanida, S., Van de Veerdonk, E.: Placing the face in context: cultural differences in the perception of facial emotion. J. Pers. Soc. Psychol. 94(3), 365–381 (2008). doi:10.1037/0022-3514.94.3.365

    Article  Google Scholar 

  24. Masuda, T., Gonzalez, R., Kwan, L., Nisbett, R.E.: Culture and aesthetic preference: comparing the attention to context of East Asians and Americans. Pers. Soc. Psychol. Bull. 34(9), 1260–1275 (2008). doi:10.1177/0146167208320555

    Article  Google Scholar 

  25. Matsumoto, D., Keltner, D., Shiota, M. N., Frank, M. G., O’Sullivan, M.: What’s in a face? Facial expressions as signals of discrete emotions. In: Lewis, M., Haviland, J.M., Feldman Barrett, L. (eds.) Handbook of Emotions, pp. 211–234. Guildford Press, New York (2008)

    Google Scholar 

  26. Matsumoto, D., Seung Hee, Y., Fontaine, J.: Mapping expressive differences around the world: the relationship between emotional display rules and individualism versus collectivism. J. Cross Cult. Psychol. 39(1), 55–74 (2008). doi:10.1177/0022022107311854

    Article  Google Scholar 

  27. Mehu, M., Scherer, K.R.: A psycho-ethological approach to social signal processing. Cogn. Process. 13(2), 397–414 (2012)

    Article  Google Scholar 

  28. Oberascher, L., Gallmetzer, M.: Colour and emotion. In: Proceedings of AIC 2003 Bangkok: Color Communication Management, pp. 370–374 (2003)

    Google Scholar 

  29. Righart, R., de Gelder, B.: Rapid influence of emotional scenes on encoding of facial expressions: an ERP study. Soc. Cogn. Affect. Neurosci. 3(3), 270–278 (2008)

    Article  Google Scholar 

  30. Rosenberg, E.L., Ekman, P.: Conceptual and methodological issues in the judgment of facial expressions of emotion. Motiv. Emot. 19(2), 111–138 (1995)

    Article  Google Scholar 

  31. Simmons, D.R.: Colour and emotion. In: New Directions in Colour Studies, pp. 395–414 (2011)

    Google Scholar 

  32. Tkalcic, M., Tasic, J.F.: Colour spaces: perceptual, historical and applicational background. In: Paper Presented at the Eurocon (2003)

    Google Scholar 

  33. Troncone, A., Palumbo, D., Esposito, A.: Mood effects on the decoding of emotional voices. In: Bassis, S., et al. (eds.) Recent Advances of Neural Network Models and Applications, SIST, vol. 26, pp. 325–332. International Publishing, Switzerland (2014)

    Google Scholar 

  34. Wilson-Mendenhall, C.D., Barrett, L.F., Barsalou, L.W.: Situating emotional experience. Front. Hum. Neurosci. 7 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anna Esposito .

Editor information

Editors and Affiliations

Supplemental Material

Supplemental Material

Observer Questionnaire

Each potential observer completed the following (culture appropriate) questionnaire. We selected only participants that answered to the following questions as reported belowFootnote 4:

Please answer to the following questions

  1. 1.

    Vision

Do you have normal (uncorrected) vision, do you wear glasses or contact lenses, or are you visually impaired?–

☑ Normal vision ☑ Glasses ☑ Contact Lenses ☐ Visually Impaired

  1. 2.

    Laterality

Since the left part of the brain control the right side of the body, and the right part of the brain controls the left side, it is important to know such things as handedness of subjects before running an experiment. Are you left, right-handed or ambidextrous (use both hands equally)?

☐ Left-handed ☑ Right-handed ☐ Ambidextrous

  1. 3.

    Learning disabilities

The term learning disability is used to refer to individuals who show a discrepancy between their apparent capacity to learn and their level of achievement. Specific learning disabilities include difficulties with:

  • reading (dyslexia)

  • writing (dysgraphia)

  • speech and language (dysphasia or aphasia)

  • maths (dyscalcula)

  • motor-planning (dyspraxia)

A learning disability can also be a difficulty with information processing, such as visual and auditory perception (e.g. difficulty recognizing shapes). If you are aware of any learning disability that you may have please specify this here. Do you suffer from learning disability?

☐ Yes ☑ No

  1. 4.

    Synaesthesia

Synaesthetes experience a fascinating phenomenon called synaesthesia, a “joining together” of two senses that are normally experienced separately. There are many, many types of synaesthesia. For example, synaesthetes may perceive colours when they read numbers, letters, or words; the colours may be superimposed on the graphemes themselves or merely perceived in their “mind’s eye”. Synaesthetes may “hear colours”, “see sounds”, or feel touch sensations on their own bodies when they observe others being touched. Likewise, the days of the week or even numbers may appear in a specific location, form, or shape.

Take a look at the following questions and statements. If your answer to any of them is either “yes” or “sometimes”, then you may be a synaesthete.

  • I experience colours when I look at written numbers.

  • I experience colours when I look at written letters.

  • I experience colours when I look at written words.

  • Each number/letter/word has a specific colour.

  • I associate numbers to colours.

  • I associate letters to colours.

  • I associate words to colours.

  • I experience touch on my own body when I look at someone else being touched (i.e., I feel touch sensations on my own body when I observe them on another person’s body).

  • I experience touch on my own body when I look at something else being touched (i.e., I feel touch sensations on my own body when I observe them on objects).

  • I experience touch in response to body postures.

  • Do these experiences have specific locations (i.e., on your body, on words or objects, in front of your eyes) or not (i.e., you just “know” or they feel as though they are in your “mind’s eye”)?

  • Do you think about ANY of the following being arranged in a specific pattern in space (i.e., in a line, a circle, etc.)? ALPHABET, CALENDAR YEAR, DAYS OF THE WEEK, WEEKS, TIME, NUMBERS (NUMBER LINE)

  • Do you think about numbers/letters/words as having personalities or genders?

  • Do you experience colours in response to: SOUNDS, MUSIC, VOICES, TOUCH. If your answer to any of those questions is YES or SOMETIMES, you may be a synaesthete.

Are you a synaesthete? ☐ Yes ☑ No

  1. 5.

    Hearing

Do you have normal hearing, corrected hearing (e.g. cochlear implant) or is your hearing impaired (e.g. tinnitus)?

☑ Normal ☐ Corrected ☐ Impaired

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Cite this chapter

Capuano, V., Cordasco, G., Scibelli, F., Maldonato, M., Faundez-Zanuy, M., Esposito, A. (2018). Effects of Gender and Luminance Backgrounds on the Recognition of Neutral Facial Expressions. In: Esposito, A., Faudez-Zanuy, M., Morabito, F., Pasero, E. (eds) Multidisciplinary Approaches to Neural Computing. Smart Innovation, Systems and Technologies, vol 69. Springer, Cham. https://doi.org/10.1007/978-3-319-56904-8_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56904-8_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56903-1

  • Online ISBN: 978-3-319-56904-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics