Abstract
When interacting with robots we show a plethora of affective reactions typical of natural communications. Indeed, emotions are embedded on our communications and represent a predominant communication channel to convey relevant, high impact, information. In recent years more and more researchers have tried to exploit this channel for human robot (HRI) and human computer interactions (HCI). Two key abilities are needed for this purpose: the ability to display emotions and the ability to automatically recognize them. In this work we present our system for the computer based automatic recognition of emotions and the new results we obtained on a small dataset of quasi unconstrained emotional videos extracted from TV series and movies. The results are encouraging showing a recognition rate of about 74%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Boersma, P., Weenink, D.: Praat: doing phonetics by computer (January 2008), http://www.praat.org/
Datcu, D., Rothkrantz, L.: Semantic audio-visual data fusion for automatic emotion recognition. In: Euromedia 2008, Porto (2008)
Davidson, R., Scherer, K., Goldsmith, H.: The Handbook of Affective Science. Oxford University Press, Oxford (March 2002)
Ekman, P., Friesen, W.V.: A new pan cultural facial expression of emotion. Motivation and Emotion 10(2), 159–168 (1986)
Lee, C.-H.J., Kim, K., Breazeal, C., Picard, R.: Shybot: friend-stranger interaction for children living with autism. In: CHI 2008: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, Florence, Italy, pp. 3375–3380. ACM, New York (2008)
Marsella, S., Gratch, J.: Ema: A process model of appraisal dynamics. Cognitive Systems Research 10(1), 70–90 (2009)
Martin, O., Kotsia, I., Macq, B., Pitas, I.: The eNTERFACE 2005 Audio-Visual Emotion Database. In: Proceedings of the 22nd International Conference on Data Engineering Workshops (ICDEW 2006). IEEE, Los Alamitos (2006)
Noble, J.: Spoken emotion recognition with support vector machines. PhD Thesis (2003)
Paleari, M., Benmokhtar, R., Huet, B.: Evidence theory based multimodal emotion recognition. In: Huet, B., Smeaton, A., Mayer-Patel, K., Avrithis, Y. (eds.) MMM 2009. LNCS, vol. 5371, Springer, Heidelberg (2009)
Paleari, M., Chellali, R., Huet, B.: Features for multimodal emotion recognition: An extensive study. In: Proceedings of IEEE CIS 2010 Intl. Conf. on Cybernetics and Intelligence Systems, Singapore (June 2010)
Paleari, M., Huet, B.: Toward Emotion Indexing of Multimedia Excerpts. In: CBMI 2008 Sixth International Workshop on Content-Based Multimedia Indexing, London. IEEE, Los Alamitos (June 2008)
Paleari, M., Huet, B., Chellali, R.: Towards multimodal emotion recognition: A new approach. In: Proceedings of ACM CIVR 2010 Intl. Conf. Image and Video Retrieval, Xi’An, China (July 2010)
Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., de Carolis, B.: GRETA. A Believable Embodied Conversational Agent, pp. 27–45. Kluwer, Dordrecht (2005)
Sapient Nitro, C.: Share happy, project webpage (June 2010), http://www.sapient.com/en-us/SapientNitro/Work.html#/?project=157
Sohail, A., Bhattacharya, P.: Detection of Facial Feature Points Using Anthropometric Face Model. In: Signal Processing for Image Enhancement and Multimedia Processing, vol. 31, pp. 189–200. Springer, US (2007)
Tomasi, C., Kanade, T.: Detection and tracking of point features, CMU-CS-91-132 (April 1991)
Viola, P., Jones, M.: Robust real-time object detection. International Journal of Computer Vision (2001)
Zeng, Z., Pantic, M., Roisman, G., Huang, T.S.: A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transaction on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Paleari, M., Chellali, R., Huet, B. (2010). Bimodal Emotion Recognition. In: Ge, S.S., Li, H., Cabibihan, JJ., Tan, Y.K. (eds) Social Robotics. ICSR 2010. Lecture Notes in Computer Science(), vol 6414. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17248-9_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-17248-9_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17247-2
Online ISBN: 978-3-642-17248-9
eBook Packages: Computer ScienceComputer Science (R0)