Abdullah A. M. Al Sokkar
ABSTRACT
This paper reports an empirical study on non-verbal emotional behaviours - facial expressions and body gestures - with the ultimate goal of informing the design of multimodal avatars with authentic emotional expressions for e-commerce websites. In the study 12 salespersons were observed when they were interacting with 29 customers in two furniture retail shops. To facilitate the observational process, we developed a template called NEBOT with a set of common facial expressions and body gestures in human-human communications. Results indicate that neutral facial expressions were more frequently used than expected. Implications for improving the template as a research tool in other contexts and for designing avatars for e-commerce websites are inferred.
- Fabri, M., Elzouki, S. and Moore, D. Emotionally Expressive Avatar for Chatting, Learning and Therapeutic Intervention. Human-Computer Interaction, Part III, HCII 2007, 275--285. Google Scholar
Digital Library
- Argyle, M. Bodily Communication. Methuen & Co, New York, 1988.Google Scholar
- Fabri, M., Moore, D. J., and Hobbs, D. J. Expressive Agent: Non-Verbal communication in collaborative virtual environment. Proc. of Autonomous Agents and Multi-Agent Systems, Bologna, Italy, 2002.Google Scholar
- Noma, T., and Badler, N. I. (1997). A virtual human presenter. Proc. of the IJCAI Workshop on Animated Interface Agents: Making Them Intelligent, 45--51.Google Scholar
- Beskow, J. Animation of Talking agent. ESCA Workshop on Audio-Visual Speech Processing (AVSP'97), (1997). 149--152.Google Scholar
- Cowell, A. and Stanney, K. Manipulation of non-verbal interaction style and demographic embodiment to increase anthropomorphic computer character credibility. Int. J. Human-Computer Studies, 62, 2 (2005), 281--306. Google ScholarDigital Library
- Salem, B., and Earle, N. Designing a non-verbal language for expressive Avatars. CVE 2000, ACM, (2000), 93--101. Google ScholarDigital Library
- Guadagno, R., Swinth, K. and Blascovich, J. Social evaluations of embodied agents and avatars. Computers in Human Behavior. 27 (2011), 2380--2385 Google ScholarDigital Library
- Kuligowska, K. and Lasek, M. Virtual assistants support customer relations and business processes. Information Management, Gdańsk University Press, 2011.Google Scholar
- Baylor, A. The design of motivational agents and avatars. Edu. Tech Research Dev, 59 (2011), 291--300.Google ScholarCross Ref
- Nowak, K. and Ruth, C. The influence of the avatar on online perceptions of anthropomorphism, androgyny, credibility, homophily and attraction. Journal of Computer-Mediated Communication, 11, 1 (2005), 153--178.Google ScholarCross Ref
- Ekman, P. and Friesen, W. V. Facial Action Coding System. Consulting Psych. Press 1978.Google Scholar
- Baledassarri, S., Cerezo, E. (2012) Maxine: Embodied Conversational Agents for Multimodal Emotional Communication. Computer Graphics, InTech, 2012.Google Scholar
- Gazepidis, N. and Rigas, D. Evaluation of Facial Expressions and Body Gestures in Interactive Systems. International Journal of Computers, 2, 1 (2008), 92--97.Google Scholar
- http://depts.washington.edu/adrcweb/UnderstandingAD/BehavMang.shtml (25th, November 2012).Google Scholar
- Alseid, M. and Rigas, D. Efficiency of Multimodal Metaphors in the Presentation of Learning Information. British Computer Society, (2008), 107--110. Google ScholarDigital Library
- Givens, D. B. The nonverbal dictionary of gestures, signs and body language cues, Centre for Nonverbal Studies, Washington, 2002.Google Scholar
- Strickland, B (Ed.). The GALE Encyclopedia of Psychology (http://go.galegroup.com.)Google Scholar
- Baylor, A. and Kim, S. Designing nonverbal communication for pedagogical agents: When less is more. Computers in Human Behavior, 25, 2 (2009), 450--457. Google ScholarDigital Library
- Theonas, G., Hobbs, D., Rigas, D. Employing Virtual Lecturers' Facial Expression in Virtual Educational Environment. International Journal of Virtual Reality, 7, 1 (2008), 31--44.Google Scholar
- Lisetti C. L. and Schiano, D. J. Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect. Pragmatics and Cognition, 8, 1 (2000), 185--235.Google Scholar
- Rigas, D., and Gazepidis, N. A Further Investigation of Facial Expressions and Body Gestures as metaphors in E-Commerce. International Conference on Applied Informatics and Communications, (2007), 148--153. Google ScholarDigital Library
- Bradley M. M. and Lang P. J. Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. .Journal of Behavioral Therapy and Experimental Psychiatry, 25, 1 (1994), 49--59.Google ScholarCross Ref
- Desmet, P. M. A. Measuring emotion; development and application of an instrument to measure emotional responses to products. In: M. A. Blythe, A. F. Monk, K. Overbeeke, & P. C. Wright (Eds.), Funology: from Usability to Enjoyment. Dordrecht: Kluwer. (2003), 111--123. Google ScholarDigital Library
- Heeter, C., Egidio, R., Mishra, P., Winn, B., & Winn. J. Alien Games: Do Girls Prefer Games Designed by Girls? Games and Culture, 4, 1 (2009), 74--100.Google Scholar
- Angrosino, M. Doing Ethnographic and Observational Research. SAGE, London 2007.Google Scholar
- Johnson, W. L., Rickel, J. W., and Lester, J. C. Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education, 11 (2000), 47--78.Google Scholar
- Boyatzis, R. E. Transforming qualitative information: Thematic analysis and code development. SAGE, 1998.Google Scholar
Index Terms
- In situ observations of non-verbal emotional behaviours for multimodal avatar design in e-commerce
Recommendations
Multimodal Analysis and Modeling of Nonverbal Behaviors during Tutoring
ICMI '14: Proceedings of the 16th International Conference on Multimodal InteractionDetecting learning-centered affective states is difficult, yet crucial for adapting most effectively to users. Within tutoring in particular, the combined context of student task actions and tutorial dialogue shape the student's affective experience. As ...
Facial Expression Synthesis Using PAD Emotional Parameters for a Chinese Expressive Avatar
ACII '07: Proceedings of the 2nd international conference on Affective Computing and Intelligent InteractionFacial expression plays an important role in face to face communication in that it conveys nonverbal information and emotional intent beyond speech. In this paper, an approach for facial expression synthesis with an expressive Chinese talking avatar is ...
Annotating non-verbal behaviours in informal interactions
COST'10: Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and EnactmentThis paper deals with the annotations of non-verbal behaviours in a Danish multimodal corpus of naturally occurring interactions between people who are well-acquainted. The main goal of this work is to provide formally annotated data for describing and ...
Comments