Abstract
Agent based interaction in the form of Embodied Conversational Agents (ECAs) has matured over the last decade and agents have become more and more sophisticated in terms of their verbal and nonverbal behavior like facial expressions or gestures. Having such “natural” communication channels available for expressing not only task-relevant but also socially and psychologically relevant information makes it necessary to take influences into account that are not readily implemented like emotions or cultural heuristics. These influences have a huge impact on the success of an interaction but are often neither consciously generated nor consciously interpreted. In this chapter, we focus on culture as a parameter for successful agent interactions and start with an attempt of grasping what is meant by this multiply defined notion. For the remainder of the chapter, we analyze in detail how culture influences the expression of multimodal behavior in agents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aylett, R., Paiva, A., Vannini, N., Enz, S., André, E., Hall, L.: But that was in another country: agents and intercultural empathy. In: Proceedings of 8th International Conferecne on Autonomous Agents and Multiagent Systems (AAMAS), pp. 329–336 (2009)
Bull, P.E.: Posture and Gesture. Pergamon Press (1987)
Carney, D.R., Hall, J.A., LeBeau, L.S.: Beliefs about the non-verbal expression of social power. Journal of Nonverbal Behavior 29(2), 105–123 (2005)
Cassell, J., Nakano, Y.I., Bickmore, T.W., Sidner, C.L., Rich, C.: Non-Verbal Cues for Discourse Structure. In: Meeting of the Association for Computational Linguistics, pp. 106–115 (2001)
de Meijer, M.: The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior 13(4), 247–268 (1989)
Efron, D.: Gesture, Race and Culture. Mouton and Co. (1972)
Ekman, P., Friesen, W.V., O’Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W.A., Pitcairn, T., Ricci-Bitti, P.E., Scherer, K.R., Tomita, M., Tzavaras, A.: Universals and cultural differences in the judgment of facial expressions of emotion. Journal of Personality and Social Psychology 53, 712–717 (1987)
Ekman, P., Friesen, W.: The repertoire of nonverbal behavior: categories, origins, usage and coding. Semiotica 1, 49–98 (1969)
Ekman, P., Rosenberg, E. (eds.): What the Face Reveals: Basic & Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press (1998)
Elfenbein, H.A., Ambady, N.A.: Universals and cultural differences in understanding emotions. Current Directions in Psychological Science 12(5), 159–164 (2003)
Endrass, B., Rehm, M., André, E.: Planning small talk behavior with cultural influences for multiagent systems. Computer, Speech and Language (in press)
Exline, R.V.: Visual behavior as an aspect of power role relationships. In: Pliner, P., Krames, L., Alloway, T. (eds.) Nonverbal communication of aggression, pp. 21–52 (1975)
Fogg, B.J.: Persuasive Technology: Using Computers to Change What We Think and Do. Morgan Kaufmann, San Francisco (2003)
P.E. Gallaher. Individual Differences in Nonverbal Behavior: Dimensions of Style. Journal of Personality and Social Psychology, 63(1):133–145, 1992.
Goodwin, C.: Conversational Organization — Interaction between Speakers and Hearers. Academic Press, New York (1981)
Hall, E.T.: The Silent Language. Doubleday (1959)
Hall, E.T.: The Hidden Dimension. Doubleday (1966)
Hartmann, B., Mancini, M., Buisine, S., Pelachaud, C.: Design and evaluation of expressive gesture synthesis for embodied conversational agents. In: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1095–1096 (2005)
Hofstede, G.: Cultures Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations. Sage Publications, Thousand Oaks (2001)
Hofstede, G.J., Pedersen, P.B., Hofstede, G.: Exploring Culture: Exercises, Stories, and Synthetic Cultures. Intercultural Press, Yarmouth (2002)
Isbister, K., Nakanishi, H., Ishida, T., Nass, C.: Helper agent: designing an assistant for human-human interaction in a virtual meeting space. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 57–64 (2000)
Jack, R.E., Blais, C., Scheepers, C., Schyns, P.G., Caldara, R.: Cultural confusions show facial expressions are not universal. Current Biology 19(18), 1543–1548 (2009)
Jan, D., Herrera, D., Martinovski, B., Novick, D., Traum, D.R.: A Computational Model of Culture-Specific Conversational Behavior. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 45–56. Springer, Heidelberg (2007)
Lewis Johnson, W., Valente, A.: Tactical language and culture training systems: Using artificial intelligence to teach foreign languages and cultures. In: Proceedings of IAAI (2008)
Kendon, A.: Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge Univ Press, Cambridge (1991)
Khaled, R., Barr, P., Fischer, R., Noble, J., Biddle, R.: Factoring Culture into the Design of a Persuasive Game. In: OZCHI 2006, pp. 213–220 (2006)
Khaled, R., Biddle, R., Noble, J., Barr, P., Fischer, R.: Persuasive interaction for collectivist cultures. In: Piekarski, W. (ed.) The Seventh Australasian User Interface Conference (AUIC 2006), pp. 73–80 (2006)
Kluckhohn, F., Strodtbeck, F.: Variations in value orientations. Row, Peterson, New York (1961)
Koda, T., Ruttkay, Z., Nakagawa, Y., Tabuchi, K.: Cross-Cultural Study on Facial Regions as Cues to Recognize Emotions of Virtual Agents. In: Ishida, T. (ed.) Culture And Computing. LNCS, vol. 6259, pp. 16–27. Springer, Heidelberg (2010)
Koda, T., Ishida, T., Rehm, M., André, E.: Avatar Culture: Cross-Cultural Evaluations of Avatar Facial ExpressionsAvatar Culture: Cross-Cultural Evaluations of Avatar Facial Expressions. AI & Society, Special Issue on Enculturating HCI 24(3), 237–250 (2009)
Labarre, W.: Teh cultural basis of emotions and gestures. Journal of Personality 16, 49–68 (1947)
Laga, H., Amaoka, T.: Modeling the spatial behavior of virtual agents in groups for non-verbal communication in virtual worlds. In: Proceedings of the 3rd International Universal Communication Symposium (IUCS), pp. 154–159 (2009)
Chad Lane, H., Hays, M.J.: Getting down to business: Teaching cross-cultural social interaction skills in a serious game. In: Workshop on Culturally Aware Tutoring Systems (CATS), pp. 35–46 (2008)
Lipi, A.A., Nakano, Y., Rehm, M.: A parameter-based model for generating culturally adaptive nonverbal behaviors in embodied conversational agents. In: Stephanidis, C. (ed.) Universal Access in HCI, HCII 2009, pp. 631–640. Springer, Heidelberg (2009)
Lipi, A.A., Nakano, Y., Rehm, M.: Culture and social relationship as factors of affecting communicative non-verbal behaviors. Transactions of the Japanese Society for Artificial Intelligence 25, 6 (inpress)
Matsumoto, D., Ekman, P.: American-japanese cultural differences in intensity ratings. Motivation and Emotion 13, 143–157 (1989)
McNeill, D.: Hand and Mind — What Gestures Reveal about Thought. The University of Chicago Press, London (1992)
Pedica, C., Vilhjálmsson, H.H.: Spontaneous Avatar Behavior for Human Territoriality. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H., et al. (eds.) IVA 2009. LNCS, vol. 5773, pp. 344–357. Springer, Heidelberg (2009)
Reeves, B., Nass, C.: The Media Equation — How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press, Cambridge (1996)
Rehm, M.: Non-symbolic gesture usage for ambient intelligence. In: Human-Centric Interfaces for Ambient Intelligence. Elsevier (2010)
Rehm, M., André, E., Bee, N., Endrass, B., Wissner, M., Nakano, Y., Akhter Lipi, A., Nishida, T., Huang, H.-H.: Creating Standardized Video Recordings of Multimodal Interactions Across Cultures. In: Kipp, M., Martin, J.-C., Paggio, P., Heylen, D., et al. (eds.) Multimodal Corpora. LNCS, vol. 5509, pp. 138–159. Springer, Heidelberg (2009)
Rehm, M., André, E., Nischt, M.: Let’s Come Together — Social Navigation Behaviors of Virtual and Real Humans. In: Maybury, M., Stock, O., Wahlster, W. (eds.) INTETAIN 2005. LNCS (LNAI), vol. 3814, pp. 124–133. Springer, Heidelberg (2005)
Rehm, M., Nakano, Y., André, E., Nishida, T., Bee, N., Endrass, B., Wissner, M., Lipi, A.A., Huang, H.-H.: From Observation to Simulation — Generating Culture Specific Behavior for Interactive Systems. AI & Society 24, 267–280 (2009)
Reitberger, W., Meschtscherjakov, A., Mirlacher, T., Scherndl, T., Huber, H., Tscheligi, M.: A persuasive interactive mannequin for shop windows. In: Proceedings of Persuasive 2009 (2009)
Rodrigues, I.G.: Gesture Space and Gesture Choreography in European Portuguese and African Portuguese Interactions: A Pilot Study of Two Cases. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS, vol. 5934, pp. 23–33. Springer, Heidelberg (2010)
Sanchez-Burks, J., Blount, S., Bartel, C.: Fluidity and performance in intercultural workplace interactions: The role of behavioral mirroring and social sensitivity. Journal of Applied Psychology 94(1), 216–223 (2009)
Scheflen, A.E.: Communicational structure: Analysis of a psychotherapy transaction. Indiana University Press (1973)
Schwartz, S.H., Sagiv, L.: Identifying culture-specifics in the content and structure of values. Journal of Cross-Cultural Psychology 26(1), 92–116 (1995)
Spencer-Oatey, H.: Reconsidering power and distance. Journal of Pragmatics 26, 1–24 (1996)
Ting-Toomey, S.: Communicating Across Cultures. The Guilford Press, New York (1999)
Vossen, S., Ham, J., Midden, C.: Social influence of a persuasive agent: the role of agent embodiment and evaluative feedback. In: Proceedings of Persuasive 2009 (2009)
Yuki, M., Maddux, W.W., Masuda, T.: Are the Windows to the Soul the Same in the East and West? Cultural differences in using the eyes and mouth as cues to recognize emotions in Japan and the United States. Journal of Experimental Social Psychology 43, 303–311 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Rehm, M., Nakano, Y., Koda, T., Winschiers-Theophilus, H. (2012). Culturally Aware Agent Communication. In: Zacarias, M., de Oliveira, J.V. (eds) Human-Computer Interaction: The Agency Perspective. Studies in Computational Intelligence, vol 396. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25691-2_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-25691-2_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25690-5
Online ISBN: 978-3-642-25691-2
eBook Packages: EngineeringEngineering (R0)