Mirjana Ivanović
Miloš Radovanović
ABSTRACT
Recently, research on emotional intelligence has advanced significantly from its theoretical basis, analytical studies and processing technology to exploratory application. The main intention of this paper is twofold. First, it will give an overview of the state-of-the-art in emotional intelligence research. Then, it will suggest a systematic order of research activities and steps with the idea of proposing an adequate framework for real-life applications. We recognize that it is necessary to apply specific methods for dynamic data analysis and pattern mining/recognition in order to identify and discover new knowledge from available emotional information and data sets. Finally, the paper will propose research activities in order to design an agent-based architecture, in which agents are capable of reasoning about and displaying some kind of emotions based on emotions detected in human speech, as well as online documents. This kind of virtual emotional agent could be employed in intelligent human-computer interaction, within areas such as tourism, education, and virtual cultural exhibitions.
- H. Ai, D. Litman, K. Forbes-Riley, M. Rotaru, J. Tetreault, and A. Purandare. Using systems and user performance features to improve emotion detection in spoken tutoring dialogs. In Proceedings of the 9th International Conference on Spoken Language Processing, pages 797--800, 2006.Google Scholar
- J. M. Alberola, J. M. Such, V. Botti, A. Espinosa, and A. Garcia-Fornes. A scalable multiagent platform for large systems. Computer Science and Information Systems, 10(1):51--77, January 2013.Google ScholarCross Ref
- C. O. Alm, D. Roth, and R. Sproat. Emotions from text: machine learning for text-based emotion prediction. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language, pages 579--586, 2005. Google ScholarDigital Library
- K. Anderson and P. W. McOwan. A real-time automated system for the recognition of human facial expressions. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 36(1):96--105, 2006. Google ScholarDigital Library
- Y. Attabi and P. Dumouchel. Anchor models for emotion recognition from speech. IEEE Transactions on Affective Computing, 4(3):280--290, 2013. Google ScholarDigital Library
- C. Bădică, Z. Budimac, H.-D. Burkhard, and M. Ivanović. Software agents: Languages, tools, platforms. Computer Science and Information Systems, 8(2):255--298, 2011.Google ScholarCross Ref
- F. Burkhardt, M. van Ballegooy, K.-P. Engelbrecht, T. Polzehl, and J. Stegmann. Emotion detection in dialog systems: Applications, strategies and challenges. In Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, pages 1--6, 2009.Google ScholarCross Ref
- Z. J. Chuang and C.-H. Wu. Multi-modal emotion recognition from speech and text. Computational Linguistics and Chinese Language Processing, 9(2):45--62, 2004.Google Scholar
- N. Fragopanagos and J. G. Taylor. Emotion recognition in humanâĂŞcomputer interaction. Neural Networks, 18(4):389--405, 2005. Google ScholarDigital Library
- S. Heidig and G. Clarebout. Do pedagogical agents make a difference to student motivation and learning? Educational Research Review, 6:27--54, 2011.Google ScholarCross Ref
- S. V. Ioannou, A. T. Raouzaiou, V. A. Tzouvaras, T. P. Mailis, K. C. Karpouzis, and S. D. Kollias. Emotion recognition through facial expression analysis based on a neurofuzzy network. Neural Networks, 18(4):423--435, 2005. Google ScholarDigital Library
- M. Ivanović, D. Mitrović, Z. Budimac, and M. Vidaković. Metadata harvesting learning resources -- an agent-oriented approach. In Proceedings of the 15th International Conference on System Theory, Control and Computing, pages 306--311, 2011.Google Scholar
- S. A. Jarvis, D. P. Spooner, H. N. L. C. Keung, J. Cao, S. Saini, and G. R. Nudd. Performance prediction and its use in parallel and distributed computing systems. Future Generation Computer Systems, 22(7):745--754, 2006. Google ScholarDigital Library
- C. M. Jones and I.-M. Jonsson. Performance analysis of acoustic emotion recognition for in-car conversational interfaces. In Proceedings of the 4th International Conference on Universal Access in Human-Computer Interaction: Ambient Interaction, pages 411--420, 2007. Google ScholarDigital Library
- S. G. Koolagudi and K. S. Rao. Emotion recognition from speech: a review. International Journal of Speech Technology, 15:99--117, 2012. Google ScholarDigital Library
- V. Kurbalija, M. Radovanović, Z. Geler, and M. Ivanović. The influence of global constraints on similarity measures for time-series databases. Knowledge-Based Systems, 56:49--67, 2014. Google ScholarDigital Library
- C. Lee and S. Narayanan. Towards detecting emotions in spoken dialogs. IEEE Transactions on Speech and Audio Processing, 13(2):293--302, 2005.Google ScholarCross Ref
- W. Li, Y. Zhang, and Y. Fu. Speech emotion recognition in e-learning system based on affective computing. In Proceedings of the 3rd International Conference on Natural Computation, pages 809--813, 2007. Google ScholarDigital Library
- E. Lorini and F. Schwarzentruber. A logic for reasoning about counterfactual emotions. Artificial Intelligence, 175(3--4):814--847, 2011. Google ScholarDigital Library
- D. Mitrović, Z. Geler, and M. Ivanović. Distributed distance matrix generator based on agents. In Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics, 2012. Article 40. Google ScholarDigital Library
- D. Mitrović, M. Ivanović, and Z. Geler. Agent-based distributed computing for dynamic networks. Information Technology and Control, 43(1):88--97, 2014.Google ScholarCross Ref
- D. Norman. Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York, NY, USA, 2004.Google Scholar
- R. W. Picard. Affective Computing. The MIT Press, Cambridge, MA, USA, 1997. Google ScholarDigital Library
- P. Salovey and J. D. Mayer. Emotional intelligence. Imagination, Cognition, and Personality, 9:185--211, 1990.Google Scholar
- F. D. Schonbrodt and J. Asendorpf. The challenge of constructing psychologically believable agents. Journal of Media Psychology: Theories, Methods, and Applications, 23(2):100--107, 2011.Google Scholar
- I. Shafran and M. Mohri. A comparison of classifiers for detecting emotion from speech. In Proceedings of the IEEE International Conference on Acoustic Signal and Speech Processing (ICASSP), pages 341--344, 2005.Google ScholarCross Ref
- S. O. Sood. Emotional computation in artificial intelligence education. In AAAI Artificial Intelligence Education Colloquium, pages 74--78, 2008.Google Scholar
- B. R. Steunebrink, M. Dastani, and C. M. John-Jules. A formal model of emotion triggers: an approach for BDI agents. Synthese, 185(1):83--129, 2012.Google ScholarCross Ref
- C. Strapparava and R. Mihalcea. Learning to identify emotions in text. In Proceedings of the 2008 ACM Symposium on Applied Computing, pages 1556--1560, 2008. Google ScholarDigital Library
- D. Ververidis and C. Kotropoulos. Emotional speech recognition: resources, features and methods. Speech Communication, 48:1162--1181, 2006.Google ScholarCross Ref
- M. Vidaković, M. Ivanović, D. Mitrović, and Z. Budimac. Extensible Java EE-based agent framework -- past, present, future. In M. Ganzha and L. C. Jain, editors, Multiagent Systems and Applications, volume 45 of Intelligent Systems Reference Library, pages 55--88. Springer Berlin Heidelberg, 2013.Google Scholar
- E. Walker, J. Gardner, V. Litvin, and E. Turner. Creating personal adaptive clusters for managing scientific jobs in a distributed computing environment. In Challenges of Large Applications in Distributed Environments, 2006 IEEE, pages 95--103, 2006.Google ScholarCross Ref
- M. Wooldridge, editor. An Introduction to MultiAgent Systems. John Wiley & Sons Ltd, 2nd edition edition, June 2009. Google ScholarDigital Library
- C.-H. Wu, Z.-J. Chuang, and Y.-C. Lin. Emotion recognition from text using semantic labels and separable mixture models. ACM Transactions on Asian Language Information Processing, 5(2):165--183, 2006. Google ScholarDigital Library
- C. Z. and R. Lopez-Cozar. Influence of contextual information in emotion annotation for spoken dialogue systems. Speech Communication, 50(5):416--433, 2008. Google ScholarDigital Library
Index Terms
- Emotional Intelligence and Agents: Survey and Possible Applications
Recommendations
Toward Machine Emotional Intelligence: Analysis of Affective Physiological State
Graph Algorithms and Computer VisionThe ability to recognize emotion is one of the hallmarks of emotional intelligence, an aspect of human intelligence that has been argued to be even more important than mathematical and verbal intelligences. This paper proposes that machine intelligence ...
Towards the improvement of self-service systems via emotional virtual agents
BCS-HCI '12: Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and ComputersAffective computing and emotional agents have been found to have a positive effect on human-computer interactions. In order to develop an acceptable emotional agent for use in a self-service interaction, two stages of research were identified and ...
Exploring Perceived Emotional Intelligence of Personality-Driven Virtual Agents in Handling User Challenges
WWW '19: The World Wide Web ConferenceAn effective virtual agent (VA) that serves humans not only completes tasks efficaciously, but also manages its interpersonal relationships with users judiciously. Although past research has studied how agents apologize or seek help appropriately, there ...
Comments