Abstract
If we wish to implement dialogue systems which express emotion, dialogue corpora annotated for emotion would be a valuable resource. In order to develop such corpora we require a reliable annotation scheme. Here we describe an annotation scheme for emotion in dialogue using categorical labels to complement previous work using dimensional scales. The most difficult challenge in developing such a scheme is selecting the categories of emotions that will yield the most expressive yet reliable scheme. We apply a novel approach, using a genetic algorithm to identify the appropriate categories.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Piwek, P.: A flexible pragmatics-driven language generator for animated agents. In: Proceedings of EACL 2003 (2003)
Padgham, L., Taylor, G.: A system for modelling agents having emotion and personality. In: PRICAI Workshop on Intelligent Agent Systems, pp. 59–71 (1996)
Litman, D., Forbes, K.: Recognizing emotions from student speech in tutoring dialogues. In: Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop ASRU (2003)
Narayanan, S.: Towards modeling user behavior in human-machine interaction: Effect of errors and emotions. In: Proceddings of ISLE (2002)
Devillers, L., Vasilescu, I., Lamel, L.: Annotation and detection of emotion in a task-oriented human-human dialog corpus. In: Proceedings of ICSLP 2002 (2002)
Cowie, R.: Describing the emotional states expressed in speech. In: SpeechEmotion-2000 (2000)
Austin, J.: How to do things with words. Oxford University Press, Oxford (1962)
Carletta, J.: Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics 22, 249–254 (1996)
Craggs, R., Wood, M.: Agreement and reliability in discourse and dialogue annotation. In: Submitted to the ACL workshop on discourse annotation (2004)
Ortony, A., Turner, T.J.: What’s basic about basic emotions? Psychological Review 97, 315–331 (1990)
Wood, M., Craggs, R.: Rare dialogue acts common in oncology consultations. In: Proceedings of SIGdia3 (2002)
Krippendorff, K.: Content Analysis: An Introduction to its Methodology. Sage Publications, Beverly Hills (1980)
Craggs, R., Wood, M.M.: A 2 dimensional annotation scheme for emotion in dialogue. In: Proceedings of AAAI Spring Symposium on Exploring Attitude and Affect in Text: Theories and Applications, Stanford University, Stanford (2004)
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.: Emotion recognition in human-computer interaction. IEEE Signal Processing Magazine 18 (2001)
Cowie, R., Douglas-Cowie, E., Savvidou, S., McMahon, E., Sawey, M., Schröder, M.: Feeltrace: An instrument for recording perceived emotion in real time. In: ISCA Workshop on Speech and Emotion, Belfast (2000)
Zitzler, E., Laumanns, M., Thiele, L.: SPEA2: Improving the Strength Pareto Evolutionary Algorithm. Technical Report 103, Swiss Federal Institute of Technology ETII, Zurich, Gloriastrasse 35, CH-8092 Zurich, Switzerland (2001)
Krippendorff, K.: Reliability in content analysis: Some common misconceptions and recommendations. To appear in Human Communication Research (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Craggs, R., McGee Wood, M. (2004). A Categorical Annotation Scheme for Emotion in the Linguistic Content of Dialogue. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds) Affective Dialogue Systems. ADS 2004. Lecture Notes in Computer Science(), vol 3068. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24842-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-24842-2_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22143-2
Online ISBN: 978-3-540-24842-2
eBook Packages: Springer Book Archive