Abstract
This paper examines the interaction between the emotion indicated by the content of an utternance and the emotion indicated by the acoustic of an utterance, and considers whether a speaker can hide their emotional state by acting an emotion even though being semantically honest. Three female and two male speakers of Swedish were recorded saying the sentences “Jag har vunnit en miljon pa° lotto” (I have won a million on the lottery), “Det finns böcker i bokhyllan” (There are books on the bookshelf) and “Min mamma har just dött” (my mother just died) as if they were happy, neutral (indifferent), angry or sad. Thirty-nine experimental participants (19 female and 20 male) heard 60 randomly selected stimuli randomly coupled with the question “Do you consider this speaker to be emotionally X?”, where X could be angry, happy, neutral or sad. They were asked to respond yes or no; the listeners’ responses and reaction times were collected. The results show that semantic cues to emotion play little role in the decoding process. Only when there are few specific acoustic cues to an emotion do semantic cues come into play. However, longer reaction times for the stimuli containing mismatched acoustic and semantic cues indicate that the semantic cues to emotion are processed even if they impact little on the perceived emotion.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Vermeulen, N., Luminet, O., Corneille, O.: Alexithymia and the automatic processing of affective information: Evidence from the affective priming paradigm. Cognition and Emotion 20(1), 64–91 (2006)
Morton, J.B., Trehub, S.E.: Children’s understanding of emotion in speech. Child Development 72(3), 834–843 (2001)
Friend, M., Bryant, J.B.: A developmental lexical bias in the interpretation of discrepant messages. Merill-Palmer Quaterly 46, 342–369 (2000)
Bugental, D., Kaswan, J., Love, L.: Perception of contradictory meanings conveyed by verbal and nonverbal channels. Journal of Personality and Social Psychology 16(4), 647–655 (1970)
Mehrabian, A., Wiener, M.: Decoding of inconsistent communications. Journal of Personality and Social Psychology 6(1), 109–114 (1967)
Wurm, L.H., Vakoch, D.A., Strasser, M.R., Calin-Jageman, R., Ross, S.E.: Speech perception and vocal expression of emotion. Cognition and Emotion 15(6), 831–852 (2001)
Nygaard, L., Lunders, E.: Resolution of lexical ambiguity by emotional tone of voice. Memory & Cognition 30(4), 583–593 (2002)
Scherer, K.R.: Vocal communcations of emotion: A review of research paradigms. Speech Communication 40, 227–256 (2003)
Lahti, A., Nilsson, C., Nordbert, J., Karlsson, L.R.L.: Har semantiken betydelse i ett emotionellt uttryck? Cognitive Science term paper, Umeå University, Sweden (2002)
Green, D.M., Swets, J.A.: Signal detection theory and psychophysics. John Wiley and Sons, Inc. New York (1966)
Cowie, R., Cornelius, R.R.: Describing the emotional states that are expressed in speech. Speech Communication 40, 5–32 (2003)
Schirmer, A., Kotz, S.A., Friederici, A.D.: Sex differentiates the role of emotional prosody during word processing. Cognitive Brain Research 14, 228–233 (2002)
Mullennix, J.W., Bihon, T., Bricklemyer, J., Gaston, J., Keener, J.M.: Effects of variation in emotional tone of voice on speech perception. Language and Speech 45(3), 255–283 (2002)
Schirmer, A., Kotz, S.A.: ERP evidence for a sex-specific stroop effect in emotional speech. Journal of Cognitive Neuroscience 15(8), 1135–1148 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Eriksson, E.J., Schaeffler, F., Sullivan, K.P.H. (2007). Acoustic Impact on Decoding of Semantic Emotion. In: Müller, C. (eds) Speaker Classification II. Lecture Notes in Computer Science(), vol 4441. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74122-0_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-74122-0_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74121-3
Online ISBN: 978-3-540-74122-0
eBook Packages: Computer ScienceComputer Science (R0)