research-article

Exploitation of Contextual Affect-Sensing and Dynamic Relationship Interpretation

Author:

Li ZhangAuthors Info & Claims

Computers in Entertainment (CIE), Volume 8, Issue 3

Article No.: 18, Pages 1 - 16

https://doi.org/10.1145/1902593.1902597

Published: 01 December 2010 Publication History

Abstract

Real-time contextual affect-detection from open-ended text-based dialogue is challenging but essential for the building of effective intelligent user interfaces. In our previous work, an affect-detection component was developed, which was embedded in an intelligent agent interacting with human-controlled characters under the improvisation of loose scenarios. The affect-detection module is capable of detecting 25 basic and complex emotions based on the analysis of pure individual turn-taking input without any contextual inference. In this article, we report developments on equipping the intelligent agent with the abilities of interpreting dynamic inter-relationships between improvisational human-controlled characters and performing contextual affect-sensing, based on the discussion topics, the improvisational “mood” that one has created, relationship interpretation between characters, and the most recent affect profiles of other characters. Evaluation results on the updated affect-detection component are also reported. Overall, the performances of the contextual affect-sensing and dynamic relationship interpretation are promising. The work contributes to the journal themes on affective computing, human-robots/agent interaction, and narrative-based interactive theatre.

References

[1]

Aylett, R., Louchart, S., Dias, J., Paiva, A., Vala, M., Woods, S., and Hall, L. E. 2006. Unscripted narrative for affectively driven characters. IEEE Comput. Graph. Appl. 26, 3, 42--52.

Digital Library

[2]

Boucouvalas, A. C. 2002. Real time text-to-emotion engine for expressive internet communications. In Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments. G. Riva et al. Eds. 305--318.

[3]

Craggs, R. and Wood, M. 2004. A two dimensional annotation scheme for emotion in dialogue. In Proceedings of AAAI Spring Symposium: Exploring Attitude and Affect in Text.

[4]

Egges, A., Kshirsagar, S., and Magnenat-Thalmann, N. 2003. A model for personality and emotion simulation. In Proceedings of Knowledge-Based Intelligent Information and Engineering Systems (KES’03). Lecture Notes in AI. Springer, Berlin, 453--461.

[5]

Elliott, C., Rickel, J., and Lester, J. 1997. Integrating affective computing into animated tutoring agents. In Proceedings of IJCAI’97 Workshop on Intelligent Interface Agents. 113--121.

[6]

Gratch, J. and Marsella, S. 2004. A domain-independent framework for modeling emotion. J. Cognitive Syst. Res. 5, 269--306.

Digital Library

[7]

Liu, H. and Singh, P. 2004. ConceptNet: A practical commonsense reasoning toolkit. BT Technol. J. 22.

Digital Library

[8]

Mateas, M. 2002. Interactive drama, art and artificial intelligence. Ph.D. dissertation, School of Computer Science, Carnegie Mellon University.

Digital Library

[9]

McCrae, R. R. and John, O. P. 1992. An introduction to the five factor model and its application. J. Personality 60, 175--215.

[10]

Mehdi, E. J., Nico, P., Julie, D., and Bernard, P. 2004. Modeling character emotion in an interactive virtual environment. In Proceedings of AISB 2004 Symposium: Motion, Emotion and Cognition.

[11]

Ortony, A., Clore, G. L., and Collins, A. 1988. The Cognitive Structure of Emotions. Cambridge University Press, Cambridge, UK.

[12]

Picard, R. W. 2000. Affective Computing. The MIT Press, Cambridge, MA.

Digital Library

[13]

Prendinger, H. and Ishizuka, M. 2001. Simulating affective communication with animated agents. In Proceedings of 8th IFIP TC.13 Conference on Human--Computer Interaction. 182--189.

[14]

Shaikh, M. A. M., Prendinger, H., and Mitsuru, I. 2007. Assessing sentiment of text by semantic dependency and contextual valence analysis. In Proceedings of ACII 2007. 191--202.

Digital Library

[15]

Sperber, D. and Wilson, D. 1995. Relevance: Communication and Cognition. 2nd Ed. Blackwell, Oxford, UK.

Digital Library

[16]

Sproat, R., Black, A., Chen, S., Kumar, S., Ostendorf, M., and Richards, C. 2001. Normalization of non-standard words. Comput. Speech Lang. 15, 3, 287--333.

Digital Library

[17]

Wilson, D. and Sperber, D. 2003. Relevance theory. In Handbook of Pragmatics. G. Ward and L. Horn Eds. Blackwell, Oxford, UK, 607--632.

[18]

Zhang, L., Barnden, J. A., Hendley, R. J., Lee, M. G., Wallington, A. M., and Wen, Z. 2008a. Affect fetection and metaphor in E-drama. Int. J. Continuing Eng. Edu. Life-Long Learn. 18, 2, 234--252.

[19]

Zhang, L., Gillies, M., and Barnden, J. A. 2008b. EMMA: An automated intelligent actor in E-drama. In Proceedings of the International Conference on Intelligent User Interfaces. 409--412.

Digital Library

[20]

Zhang, L., Gillies, M., Dhaliwal, K., Gower, A., Robertson, D., and Crabtree, B. 2009. E-drama: Facilitating online role-play using an ai actor and emotionally expressive characters. Int. J. Artif. Intell. Edu. 19, 1, 5--38.

Digital Library

[21]

Zhe, X. and Boucouvalas, A. C. 2002. Text-to-emotion engine for real time internet communication. In Proceedings of the International Symposium on Communication Systems, Networks and DSPs. 164--168.

Cited By

Zhang LBarnden J(2013)Towards a Semantic-Based Approach for Affect and Metaphor DetectionInternational Journal of Distance Education Technologies10.4018/jdet.201304010311:2(48-65)Online publication date: Apr-2013
https://doi.org/10.4018/jdet.2013040103
Ptaszynski MDybala PMazur MRzepka RAraki KMomouchi Y(2013)Towards Computational FronesisInternational Journal of Distance Education Technologies10.4018/jdet.201304010211:2(16-47)Online publication date: Apr-2013
https://doi.org/10.4018/jdet.2013040102
Zhang L(2013)Contextual and active learning-based affect-sensing from virtual drama improvisationACM Transactions on Speech and Language Processing (TSLP)10.1145/2407736.24077389:4(1-25)Online publication date: 30-Jan-2013
https://dl.acm.org/doi/10.1145/2407736.2407738
Show More Cited By

Index Terms

Exploitation of Contextual Affect-Sensing and Dynamic Relationship Interpretation
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Discourse, dialogue and pragmatics
      2. Language resources

Recommendations

Metaphorical affect sensing in an intelligent conversational agent
ACE '08: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology

We report new developments of an affect detection component on the processing of several different types of metaphorical affective expressions. The component has been embedded in an intelligent conversational AI agent interacting with human users under ...
Contextual and active learning-based affect-sensing from virtual drama improvisation

Affect interpretation from open-ended drama improvisation is a challenging task. This article describes experiments in using latent semantic analysis to identify discussion themes and potential target audiences for those improvisational inputs without ...
Contextual affect analysis: a system for verification of emotion appropriateness supported with Contextual Valence Shifters

This paper presents a novel method for estimating speaker's affective states based on two contextual features: valence shifters and appropriateness. Firstly, a system for affect analysis is used to recognise specific types of emotions. We improve the ...

Comments

Information & Contributors

Information

Published In

cover image Computers in Entertainment

Computers in Entertainment Volume 8, Issue 3

Theoretical and Practical Computer Applications in Entertainment

December 2010

112 pages

EISSN:1544-3574

DOI:10.1145/1902593

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2010

Published in CIE Volume 8, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
292
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang LBarnden J(2013)Towards a Semantic-Based Approach for Affect and Metaphor DetectionInternational Journal of Distance Education Technologies10.4018/jdet.201304010311:2(48-65)Online publication date: Apr-2013
https://doi.org/10.4018/jdet.2013040103
Ptaszynski MDybala PMazur MRzepka RAraki KMomouchi Y(2013)Towards Computational FronesisInternational Journal of Distance Education Technologies10.4018/jdet.201304010211:2(16-47)Online publication date: Apr-2013
https://doi.org/10.4018/jdet.2013040102
Zhang L(2013)Contextual and active learning-based affect-sensing from virtual drama improvisationACM Transactions on Speech and Language Processing (TSLP)10.1145/2407736.24077389:4(1-25)Online publication date: 30-Jan-2013
https://dl.acm.org/doi/10.1145/2407736.2407738
Ptaszynski MDokoshi HOyama SRzepka RKurihara MAraki KMomouchi Y(2013)Affect analysis in context of characters in narrativesExpert Systems with Applications: An International Journal10.1016/j.eswa.2012.07.02540:1(168-176)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1016/j.eswa.2012.07.025
Zhang L(2013)Contextual Affect Modeling and Detection in Interactive Text-Based Dramatic ImprovisationTransactions on Edutainment X10.1007/978-3-642-37919-2_3(36-52)Online publication date: 2013
https://doi.org/10.1007/978-3-642-37919-2_3
Zhang L(2012)Exploitation in context-sensitive affect sensing from improvisational interactionTransactions on Edutainment VIII10.5555/2363273.2363276(12-23)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.5555/2363273.2363276
Zhang LHossain A(2012)Semantic-inspired Contextual Affect Detection from Drama ImprovisationProcedia Computer Science10.1016/j.procs.2012.06.03910(292-299)Online publication date: 2012
https://doi.org/10.1016/j.procs.2012.06.039
Zhang LHossain A(2012)Contextual affect sensing and metaphor interpretationEntertainment Computing10.1016/j.entcom.2011.12.0023:3(81-88)Online publication date: Aug-2012
https://doi.org/10.1016/j.entcom.2011.12.002
Zhang LBarnden J(2012)Affect Sensing Using Linguistic, Semantic and Cognitive Cues in Multi-threaded Improvisational DialogueCognitive Computation10.1007/s12559-012-9170-34:4(436-459)Online publication date: 19-Jul-2012
https://doi.org/10.1007/s12559-012-9170-3
Zhang L(2012)Exploitation in Context-Sensitive Affect Sensing from Improvisational InteractionTransactions on Edutainment VIII10.1007/978-3-642-31439-1_2(12-23)Online publication date: 2012
https://doi.org/10.1007/978-3-642-31439-1_2
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Issue’s Table of Contents