Skip to main content
SpringerLink
Log in

Language and Gender Effect in Decoding Emotional Information: A Study on Lithuanian Subjects

  • Conference paper
Recent Advances of Neural Network Models and Applications

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 26))

Abstract

The present work explores how language specificity and gender affect the emotional decoding process. It investigates the ability of Lithuanian male and female subjects to decode emotional information through male and female vocal and visual emotional expressions. The exploited emotional stimuli are based on extracts of American English (a globally spread language), and Italian (a country specific language) movies. The assumption is that the recognition of the emotional states expressed by the actors/actresses will change according to the familiarity of the languages and the subjects’ gender. Results show that Lithuanian subjects recognition accuracy is affected by the language specificity of the stimuli. Moreover, a gender effect occurs in decoding Italian vocal stimuli.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zeng, Z., Pantic, M., Rosiman, G.I., Huang, T.S.: A Survey of Affect Recognition Methods: Audio, visual, and spontaneous expressions. Trans. on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)

    Article  Google Scholar 

  2. Ververidis, D., Kotropoulos, C.: Emotional Speech Recognition: Resources, Features and Methods. Elsevier Speech Communication 48(9), 1162–1181 (2006)

    Article  Google Scholar 

  3. Aubergé, V., Cathiard, M.: Can we hear the prosody of smile? Speech Communication 40, 87–97 (2003)

    Google Scholar 

  4. Attardo, S., Eisterhold, J., Hay, J., Poggi, I.: Multimodal Markers of Irony and Sarcasm, Humor. International Journal of Humor Research 16(2), 243–260 (2003)

    Google Scholar 

  5. Chollet, G., Esposito, A., Gentes, A., Horain, P., Karam, W., Li, Z., Pelachaud, C., Perrot, P., Petrovska-Delacrétaz, D., Zhou, D., Zouari, L.: Multimodal Human Machine Interactions in Virtual and Augmented Reality. In: Esposito, A., Hussain, A., Marinaro, M., Martone, R. (eds.) COST Action 2102. LNCS, vol. 5398, pp. 1–23. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  6. Esposito, A.: The Amount of Information on Emotional States Conveyed by the Verbal and Nonverbal Channels: Some Perceptual Data. In: Stylianou, Y., Faundez-Zanuy, M., Esposito, A. (eds.) COST 277. LNCS, vol. 4391, pp. 249–268. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  7. Wang, Y., Guan, L., Venetsanopoulos, A.N.: Kernel Cross-Modal Factor Analysis for Information Fusion with Application to Bimodal Emotion Recognition. IEEE Transactions on Multimedia 14(3), 1520–9210, 597 – 607 (2012)

    Google Scholar 

  8. Ekman, P.: Strong Evidence for Universals in Facial Expressions: A Reply to Russell’s Mistaken Critique. Psychological Bulletin 115, 268–287 (1994)

    Article  Google Scholar 

  9. Mesquita, B., Frijda, N.H., Scherer, K.R.: Culture and Emotion. In: Berry, J.W., Dasen, P.R., Saraswathi, T.S. (eds.) Handbook of Cross-cultural Psychology. Basic processes and human development, pp. 255–297. Allyn & Bacon, Boston (1997)

    Google Scholar 

  10. Russell, J.A.: Is There Universal Recognition of Emotion from Facial Expression? A Review of the Cross-cultural Studies. Psychological Bulletin 115, 102–141 (1994)

    Article  Google Scholar 

  11. Scherer, K.R., Wallbott, H.G.: Evidence for Universality and Cultural Variation of Differential Emotion Response Patterning. Journal of Personality and Social Psychology 66, 310–328 (1994)

    Article  Google Scholar 

  12. Fridlund, A.J.: The new ethology of human facial expressions. In: Russell, J.A., Fernandez Dols, J. (eds.) The Psychology of Facial Expression, pp. 103–129. Cambridge University Press (1997)

    Google Scholar 

  13. Scherer, K.R., Banse, R., Wallbott, H.G.: Emotion Inferences from Vocal Expression Correlate across Languages and Cultures. Journal of Cross-Cultural Psychology 32, 76–92 (2001)

    Article  Google Scholar 

  14. Esposito, A., Riviello, M.T., Bourbakis, N.: Cultural Specific Effects on the Recognition of Basic Emotions: A Study on Italian Subjects. In: Holzinger, A., Miesenberger, K. (eds.) USAB 2009. LNCS, vol. 5889, pp. 135–148. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  15. Elfenbein, H.A., Ambady, N.: On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin 128, 203–235 (2002), doi:10.1037/0033-2909.128.2.203

    Article  Google Scholar 

  16. Scherer, K.R., Banse, R., Wallbott, H.G.: Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-Cultural Psychology 32, 76–92 (2001)

    Article  Google Scholar 

  17. Riviello, M.T., Esposito, A.: A Cross-Cultural Study on the Effectiveness of Visual and Vocal Channels in Transmitting Dynamic Emotional Information. Acta Polytechnica Hungarica, Journal of Applied Sciences 9(1), 157–170 (2012)

    Google Scholar 

  18. Plant, E.A., Hyde, J.S., Keltner, D., Devine, P.G.: The gender stereotyping of emotions. Psychology of Women Quarterly 24, 81–92 (2000), doi:10.1111/j.1471-6402.2000.tb01024

    Article  Google Scholar 

  19. Brody, L.R., Hall, J.A.: Gender and emotion in context. In: Lewis, M., Haviland-Jones, J. (eds.) Handbook of Emotions, vol. 3, pp. 395–408. Guilford, New York (2008)

    Google Scholar 

  20. Schmid, P.C., Schmid Mast, M., Bombari, D., Mast, F.D.: Gender Effects in Information Processing on a Nonverbal Decoding Task. Springer Science Business Media, LLC (2011)

    Google Scholar 

  21. Crystal, D.: English as a Global Language, 2nd edn. Cambridge University Press, Cambridge (2003)

    Book  Google Scholar 

  22. Riviello, M.T., Chetouani, M., Cohen, D., Esposito, A.: On the perception of emotional “voices”: A cross-cultural comparison among American, French and Italian subjects. In: Esposito, A. (ed.) Communication and Enactment 2010. LNCS, vol. 6800, pp. 368–377. Springer, Heidelberg (2011)

    Google Scholar 

  23. Esposito, A., Riviello, M.T., Bourbakis, N.: Cultural Specific Effects on the Recognition of Basic Emotions: A Study on Italian Subjects. In: Holzinger, A., Miesenberger, K. (eds.) USAB 2009. LNCS, vol. 5889, pp. 135–148. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  24. Esposito, A.: The Perceptual and Cognitive Role of Visual and Auditory Channels in Conveying Emotional Information. Cognitive Computation Journal 1, 268–278 (2009)

    Article  Google Scholar 

  25. Esposito, A.: The Amount of Information on Emotional States Conveyed by the Verbal and Nonverbal Channels: Some Perceptual Data. In: Stylianou, Y., Faundez-Zanuy, M., Esposito, A. (eds.) COST 277. LNCS, vol. 4391, pp. 249–268. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  26. Ekman, P.: An argument for basic emotions. Cognition and Emotion 6, 169–200 (1992)

    Article  Google Scholar 

  27. Izard, C.E.: Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin 115, 288–299 (1994)

    Article  Google Scholar 

  28. Scherer, K.R.: Vocal communication of emotion: A review of research paradigms. Speech Communication 40, 227–256 (2003)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Seconda Università di Napoli, Caserta, Italy

    Maria Teresa Riviello & Anna Esposito

  2. International Institute for Advanced Scientific Studies (IIASS), Salerno, Italy

    Maria Teresa Riviello & Anna Esposito

  3. Information Technology Development Institute, Kaunas Univerisity of Technology, Kaunas, Lithuania

    Rytis Maskeliunas

  4. Kaunas Faculty of Humanities, Vilnius University, Kaunas, Lithuania

    Jadvyga Kruminiene

Authors
  1. Maria Teresa Riviello
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rytis Maskeliunas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jadvyga Kruminiene
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anna Esposito
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maria Teresa Riviello .

Editor information

Editors and Affiliations

  1. Department of Computer Science, University of Milano, Milano, Italy

    Simone Bassis

  2. Department of Psychology, Second University of Naples, Institute for Advanced Scientific Studies (IIASS), Caserta, Italy

    Anna Esposito

  3. Department of Civil, Energy, Environmental, and Materials Engineering, DICEAM, University Mediterranea of Reggio Calabria, Reggio Calabria, Italy

    Francesco Carlo Morabito

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Riviello, M.T., Maskeliunas, R., Kruminiene, J., Esposito, A. (2014). Language and Gender Effect in Decoding Emotional Information: A Study on Lithuanian Subjects. In: Bassis, S., Esposito, A., Morabito, F. (eds) Recent Advances of Neural Network Models and Applications. Smart Innovation, Systems and Technologies, vol 26. Springer, Cham. https://doi.org/10.1007/978-3-319-04129-2_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-04129-2_35

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-04128-5

  • Online ISBN: 978-3-319-04129-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation