skip to main content
10.1145/2611040.2611100acmotherconferencesArticle/Chapter ViewAbstractPublication PageswimsConference Proceedingsconference-collections
research-article

Emotional Intelligence and Agents: Survey and Possible Applications

Published: 02 June 2014 Publication History

Abstract

Recently, research on emotional intelligence has advanced significantly from its theoretical basis, analytical studies and processing technology to exploratory application. The main intention of this paper is twofold. First, it will give an overview of the state-of-the-art in emotional intelligence research. Then, it will suggest a systematic order of research activities and steps with the idea of proposing an adequate framework for real-life applications. We recognize that it is necessary to apply specific methods for dynamic data analysis and pattern mining/recognition in order to identify and discover new knowledge from available emotional information and data sets. Finally, the paper will propose research activities in order to design an agent-based architecture, in which agents are capable of reasoning about and displaying some kind of emotions based on emotions detected in human speech, as well as online documents. This kind of virtual emotional agent could be employed in intelligent human-computer interaction, within areas such as tourism, education, and virtual cultural exhibitions.

References

[1]
H. Ai, D. Litman, K. Forbes-Riley, M. Rotaru, J. Tetreault, and A. Purandare. Using systems and user performance features to improve emotion detection in spoken tutoring dialogs. In Proceedings of the 9th International Conference on Spoken Language Processing, pages 797--800, 2006.
[2]
J. M. Alberola, J. M. Such, V. Botti, A. Espinosa, and A. Garcia-Fornes. A scalable multiagent platform for large systems. Computer Science and Information Systems, 10(1):51--77, January 2013.
[3]
C. O. Alm, D. Roth, and R. Sproat. Emotions from text: machine learning for text-based emotion prediction. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language, pages 579--586, 2005.
[4]
K. Anderson and P. W. McOwan. A real-time automated system for the recognition of human facial expressions. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 36(1):96--105, 2006.
[5]
Y. Attabi and P. Dumouchel. Anchor models for emotion recognition from speech. IEEE Transactions on Affective Computing, 4(3):280--290, 2013.
[6]
C. Bădică, Z. Budimac, H.-D. Burkhard, and M. Ivanović. Software agents: Languages, tools, platforms. Computer Science and Information Systems, 8(2):255--298, 2011.
[7]
F. Burkhardt, M. van Ballegooy, K.-P. Engelbrecht, T. Polzehl, and J. Stegmann. Emotion detection in dialog systems: Applications, strategies and challenges. In Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, pages 1--6, 2009.
[8]
Z. J. Chuang and C.-H. Wu. Multi-modal emotion recognition from speech and text. Computational Linguistics and Chinese Language Processing, 9(2):45--62, 2004.
[9]
N. Fragopanagos and J. G. Taylor. Emotion recognition in humanâĂŞcomputer interaction. Neural Networks, 18(4):389--405, 2005.
[10]
S. Heidig and G. Clarebout. Do pedagogical agents make a difference to student motivation and learning? Educational Research Review, 6:27--54, 2011.
[11]
S. V. Ioannou, A. T. Raouzaiou, V. A. Tzouvaras, T. P. Mailis, K. C. Karpouzis, and S. D. Kollias. Emotion recognition through facial expression analysis based on a neurofuzzy network. Neural Networks, 18(4):423--435, 2005.
[12]
M. Ivanović, D. Mitrović, Z. Budimac, and M. Vidaković. Metadata harvesting learning resources -- an agent-oriented approach. In Proceedings of the 15th International Conference on System Theory, Control and Computing, pages 306--311, 2011.
[13]
S. A. Jarvis, D. P. Spooner, H. N. L. C. Keung, J. Cao, S. Saini, and G. R. Nudd. Performance prediction and its use in parallel and distributed computing systems. Future Generation Computer Systems, 22(7):745--754, 2006.
[14]
C. M. Jones and I.-M. Jonsson. Performance analysis of acoustic emotion recognition for in-car conversational interfaces. In Proceedings of the 4th International Conference on Universal Access in Human-Computer Interaction: Ambient Interaction, pages 411--420, 2007.
[15]
S. G. Koolagudi and K. S. Rao. Emotion recognition from speech: a review. International Journal of Speech Technology, 15:99--117, 2012.
[16]
V. Kurbalija, M. Radovanović, Z. Geler, and M. Ivanović. The influence of global constraints on similarity measures for time-series databases. Knowledge-Based Systems, 56:49--67, 2014.
[17]
C. Lee and S. Narayanan. Towards detecting emotions in spoken dialogs. IEEE Transactions on Speech and Audio Processing, 13(2):293--302, 2005.
[18]
W. Li, Y. Zhang, and Y. Fu. Speech emotion recognition in e-learning system based on affective computing. In Proceedings of the 3rd International Conference on Natural Computation, pages 809--813, 2007.
[19]
E. Lorini and F. Schwarzentruber. A logic for reasoning about counterfactual emotions. Artificial Intelligence, 175(3--4):814--847, 2011.
[20]
D. Mitrović, Z. Geler, and M. Ivanović. Distributed distance matrix generator based on agents. In Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics, 2012. Article 40.
[21]
D. Mitrović, M. Ivanović, and Z. Geler. Agent-based distributed computing for dynamic networks. Information Technology and Control, 43(1):88--97, 2014.
[22]
D. Norman. Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York, NY, USA, 2004.
[23]
R. W. Picard. Affective Computing. The MIT Press, Cambridge, MA, USA, 1997.
[24]
P. Salovey and J. D. Mayer. Emotional intelligence. Imagination, Cognition, and Personality, 9:185--211, 1990.
[25]
F. D. Schonbrodt and J. Asendorpf. The challenge of constructing psychologically believable agents. Journal of Media Psychology: Theories, Methods, and Applications, 23(2):100--107, 2011.
[26]
I. Shafran and M. Mohri. A comparison of classifiers for detecting emotion from speech. In Proceedings of the IEEE International Conference on Acoustic Signal and Speech Processing (ICASSP), pages 341--344, 2005.
[27]
S. O. Sood. Emotional computation in artificial intelligence education. In AAAI Artificial Intelligence Education Colloquium, pages 74--78, 2008.
[28]
B. R. Steunebrink, M. Dastani, and C. M. John-Jules. A formal model of emotion triggers: an approach for BDI agents. Synthese, 185(1):83--129, 2012.
[29]
C. Strapparava and R. Mihalcea. Learning to identify emotions in text. In Proceedings of the 2008 ACM Symposium on Applied Computing, pages 1556--1560, 2008.
[30]
D. Ververidis and C. Kotropoulos. Emotional speech recognition: resources, features and methods. Speech Communication, 48:1162--1181, 2006.
[31]
M. Vidaković, M. Ivanović, D. Mitrović, and Z. Budimac. Extensible Java EE-based agent framework -- past, present, future. In M. Ganzha and L. C. Jain, editors, Multiagent Systems and Applications, volume 45 of Intelligent Systems Reference Library, pages 55--88. Springer Berlin Heidelberg, 2013.
[32]
E. Walker, J. Gardner, V. Litvin, and E. Turner. Creating personal adaptive clusters for managing scientific jobs in a distributed computing environment. In Challenges of Large Applications in Distributed Environments, 2006 IEEE, pages 95--103, 2006.
[33]
M. Wooldridge, editor. An Introduction to MultiAgent Systems. John Wiley & Sons Ltd, 2nd edition edition, June 2009.
[34]
C.-H. Wu, Z.-J. Chuang, and Y.-C. Lin. Emotion recognition from text using semantic labels and separable mixture models. ACM Transactions on Asian Language Information Processing, 5(2):165--183, 2006.
[35]
C. Z. and R. Lopez-Cozar. Influence of contextual information in emotion annotation for spoken dialogue systems. Speech Communication, 50(5):416--433, 2008.

Cited By

View all
  • (2023)The Acoustically Emotion-Aware Conversational Agent With Speech Emotion Recognition and Empathetic ResponsesIEEE Transactions on Affective Computing10.1109/TAFFC.2022.320591914:1(17-30)Online publication date: 1-Jan-2023
  • (2022)Recognition of Human Emotions by Voice in the Fight against Telephone FraudНациональная безопасность / nota bene10.7256/2454-0668.2022.5.38782(11-29)Online publication date: May-2022
  • (2022)Game Design, Gender and Personalities in Programming EducationFrontiers in Computer Science10.3389/fcomp.2022.8249954Online publication date: 8-Feb-2022
  • Show More Cited By

Index Terms

  1. Emotional Intelligence and Agents: Survey and Possible Applications

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    WIMS '14: Proceedings of the 4th International Conference on Web Intelligence, Mining and Semantics (WIMS14)
    June 2014
    506 pages
    ISBN:9781450325387
    DOI:10.1145/2611040
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • Aristotle University of Thessaloniki

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 June 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Emotional intelligence
    2. emotion detection
    3. intelligent agents

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    WIMS '14

    Acceptance Rates

    WIMS '14 Paper Acceptance Rate 41 of 90 submissions, 46%;
    Overall Acceptance Rate 140 of 278 submissions, 50%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)36
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)The Acoustically Emotion-Aware Conversational Agent With Speech Emotion Recognition and Empathetic ResponsesIEEE Transactions on Affective Computing10.1109/TAFFC.2022.320591914:1(17-30)Online publication date: 1-Jan-2023
    • (2022)Recognition of Human Emotions by Voice in the Fight against Telephone FraudНациональная безопасность / nota bene10.7256/2454-0668.2022.5.38782(11-29)Online publication date: May-2022
    • (2022)Game Design, Gender and Personalities in Programming EducationFrontiers in Computer Science10.3389/fcomp.2022.8249954Online publication date: 8-Feb-2022
    • (2022)Normative Emotional Agents: A Viewpoint PaperIEEE Transactions on Affective Computing10.1109/TAFFC.2020.302851213:3(1254-1273)Online publication date: 1-Jul-2022
    • (2021)Effect of depression among taekwondo students and its relationship with negative events due to COVID-19Physical education of students10.15561/20755279.2021.010225:1(10-19)Online publication date: 26-Feb-2021
    • (2021)Enhancing the Perceived Emotional Intelligence of Conversational Agents through Acoustic CuesExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451660(1-7)Online publication date: 8-May-2021
    • (2019)An Investigation of the Accuracy of Real Time Speech Emotion RecognitionArtificial Intelligence XXXVI10.1007/978-3-030-34885-4_26(336-349)Online publication date: 19-Nov-2019
    • (2016)T.A.IProceedings of the 2016 ACM Conference on Designing Interactive Systems10.1145/2901790.2901896(281-285)Online publication date: 4-Jun-2016
    • (2015)Augmenting Autonomous Vehicular Communication Using the Appreciation EmotionProceedings of the 2015 13th International Conference on Frontiers of Information Technology (FIT)10.1109/FIT.2015.40(178-184)Online publication date: 14-Dec-2015

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media