ABSTRACT
This keynote introduces recent research on the automated analysis of non-verbal expressive gesture and of expressive social interaction in groups of users, for applications in novel multimodal interfaces and emerging User-Centric Media.
- De Meijer, M., 1989. The contribution of general features of body movement to the attribution of emotions. J. of Nonverbal Behavior, 13, 247--268.Google ScholarCross Ref
- Wallbott H. G., 1998. Bodily expression of emotion. Eur. J. Soc. Psychol, 28:879--896.Google ScholarCross Ref
- Boone R. T., Cunningham J. G., 1998. Children's decoding of emotion in expressive body movement: The development of cue attunement. Developmental Psychology, 34:1007--1016.Google ScholarCross Ref
- Laban R., Lawrence F. C., 1947. Effort. Macdonald & Evans Ltd., London.Google Scholar
- Camurri, A., Lagerlöf, I., Volpe, G., 2003. Recognizing emotion from dance movement: Comparison of spectator recognition and automated techniques. Intl. J. Human-Computer Studies, Elsevier, 59:213--225. Google ScholarDigital Library
- Camurri, A., De Poli, G., Leman, M., Volpe, G., 2005. Toward Communicating Expressiveness and Affect in Multimodal Interactive Systems for Performing Art and Cultural Applications. IEEE Multimedia, 12(1): 43--53, IEEE CS Press. Google ScholarDigital Library
- Kapur, A., Kapur, A., Virji-Babul, N., Tzanetakis, G., Driessen, P. F., 2005. Gesture-Based Affective Computing on Motion Capture Data. LNCS 3784:1, Springer Verlag. Google ScholarDigital Library
- Bernhardt, D., Robinson, P., 2007. Detecting Affect from Non-stylised Body Motions. LNCS 4738:59, Springer Verlag. Google ScholarDigital Library
- Pentland A., 2007. Social signal processing. IEEE Signal Processing Magazine, 24(4):108--111.Google ScholarCross Ref
- A. Vinciarelli, M. Pantic, H. Bourland, and A. Pentland, "Social signals, their function, and automatic analysis: a survey", in Proc. 10th International Conference on Multimodal Interfaces, ICMI08, pp. 61--68. ACM, Oct. 2008. Google ScholarDigital Library
- Dong, W., Lepri, B., Cappelletti, A., Pentland, A., Pianesi, F., Zancanaro, M., 2007. Using the influence model to recognize functional roles in meetings. In Proc. 9th Intl. ACM Conf. on Multimodal Interfaces, 271--278. Google ScholarDigital Library
- De Rosis, F, Cavalluzzi, A., Mazzotta, I., Novielli, N., 2005. Can embodied conversational agents induce empathy in users? In Proceedings of AISB 05, Virtual Social Character Symposium.Google Scholar
- G. Varni, M. Mancini, G. Volpe, A. Camurri (2010) A system for mobile active music listening based on social interaction and embodiment, ACM Mobile Networks and Applications Intl Journal (ACM MONET), (In Press). Google ScholarDigital Library
- G. Varni, G. Volpe, A. Camurri (2010) A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media. IEEE Transactions on Multimedia, Vol.12, No.6, (In Press). Google ScholarDigital Library
- Camurri A., Coglio A., 1998. An Architecture for Emotional Agents. IEEE Multimedia, Oct-Dec 1998, 24--33, IEEE CS Press. Google ScholarDigital Library
Index Terms
- Automated analysis of non-verbal affective and social behaviour
Recommendations
A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media
This paper presents a multimodal system for real-time analysis of nonverbal affective social interaction in small groups of users. The focus is on two major aspects of affective social interaction: the synchronization of the affective behavior within a ...
Towards analysis of expressive gesture in groups of users: computational models of expressive social interaction
GW'09: Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer InteractionIn this paper we present a survey of our research on analysis of expressive gesture and how it is evolving towards the analysis of expressive social interaction in groups of users. Social interaction and its expressive implications (e.g., emotional ...
Changes in verbal and nonverbal conversational behavior in long-term interaction
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interactionWe present an empirical investigation of conversational behavior in dyadic interaction spanning multiple conversations, in the context of a developing interpersonal relationship between a health counselor and her clients. Using a longitudinal video ...
Comments