Abstract
If speech analysis is to detect a speaker’s emotional state, it needs to derive information from both linguistic information, i.e., the qualitative targets that the speaker has attained (or approximated), conforming to the rules of language; and paralinguistic information, i.e., allowed variations in the way that qualitative linguistic targets are realised. It also needs an appropriate representation of emotional states. The ERMIS project addresses the integration problem that those requirements pose. It mainly comprises a paralinguistic analysis and a robust speech recognition module. Descriptions of emotionality are derived from these modules following psychological and linguistic research that indicates the information likely to be available. We argue that progress in registering emotional states depends on establishing an overall framework of at least this level of complexity.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.: Emotion Recognition in Human-Computer Interaction. IEEE Signal Processing Magazine 18(1), (2001) 32–80
Taylor, J.G. et al: The Emotional Recognition Architecture in the Human Brain. Submitted to ICONIP/ICANN 2003, Istanbul, Turkey (2003)
McGilloway, S., Cowie, R. Douglas-Cowie, E., Gielen, S., Westerdijk and Stroeve, S.: Automatic recognition of emotion from speech: a rough benchmark. Proceedings of ISCA Workshop on Speech and Emotion: A Conceptual framework for research, Belfast: Textflow, (2000) 207–212
Klasmeyer, G.: An automatic description tool for time-contours and long-term average voice features in large emotional speech databases. Proceedings of ISCA Workshop on Speech and emotion: A conceptual framework for research. Belfast:Textflow, (2000) 66–71
Hammarberg, B., Fritzell, B., Gauffin, J., Sundberg, J., Wedin, l.: Perceptual and acousticcorrelates of voice qualities. Acta Otolaryng 90, (1980) 441–451
Pellom, B. L., Hansen, J.H.L.: Voice Analysis in Adverse Conditions: The Centennial Olympic Park Bombing 911 Call, Proceedings of IEEE Midwest Symposium on Circuits & Systems, August (1997) 125–128
Doclo, S., Dologlou, I., Moonen, M.: A novel iterative signal enhancement algorithm for noise reduction in speech, Proceedings of ICSLP, Sydney, Australia, (1998) 1435–1439
Athanaselis, T., Fotinea, S-E., Bakamidis, S., Dologlou, I., Giannopoulos, G.: Signal Enhancement for Continuous Speech Recognition. Submitted to ICONIP/ICANN 2003, Instabul, Turkey (2003)
Young, S.J.: Large Vocabulary Continuous Speech Recognition IEEE Signal Processing Magazine 13(5) (1996) 45–57
Whissel, C.M.: The dictionary of affect in language. In R Plutchik, H Kellerman, eds, Emotion: Theory, Research and Experience: vol 4. The Measurement of Emotions New York: Academic Press (1989)
Russell, J.A. et al: Facial & Vocal Expressions of Emotion. Ann Rev Psychol 54 (2003) 329–349
McNeely, H.E. & Parlow, S.E.: Complimentarity of Linguistic and Prosodic Processes in the Intact Brain. Brain & Language 79 (2001) 473–481
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fotinea, SE. et al. (2003). Emotion in Speech: Towards an Integration of Linguistic, Paralinguistic, and Psychological Analysis. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. ICANN ICONIP 2003 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44989-2_134
Download citation
DOI: https://doi.org/10.1007/3-540-44989-2_134
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40408-8
Online ISBN: 978-3-540-44989-8
eBook Packages: Springer Book Archive