Abstract
We address character (personality) expression for a spoken dialogue system in order to accommodate it in particular dialogue tasks and social roles. While conventional studies investigated controlling the linguistic expressions, we focus on spoken dialogue behaviors to express systems’ characters. Specifically, we investigate spoken dialogue behaviors such as utterance amount, backchannel frequency, filler frequency, and switching pause length in order to express three character traits: extroversion, emotional instability, and politeness. In this study, we evaluate this model with a natural spoken dialogue corpus. The results reveal that this model expresses reasonable characters according to the dialogue tasks and the participant roles. Furthermore, it is also shown that this model is able to express different characters among participants given the same role. A subjective experiment demonstrated that subjects could perceive the characters expressed by the model.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Brave S, Nass C, Hutchinson K (2005) Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent. Int J Hum Comput Stud 62(2):161–178
Bunt H, Alexandersson J, Carletta J, Choe JW, Fang AC, Hasida K, Lee K, Petukhova V, Popescu-Belis A, Romary L, Soria C, Traum D (2010) Towards an ISO standard for dialogue act annotation. In: LREC, pp 2548–2555
Costa PT, McCrae RR (1992) Normal personality assessment in clinical practice: the NEO personality inventory. Psychol Assess 4(1):5–13
D Sevin E, Hyniewska SJ, Pelachaud C (2010) Influence of personality traits on backchannel selection. In: IVA, pp 187–193
Den Y, Yoshida N, Takanashi K, Koiso H (2011) Annotation of Japanese response tokens and preliminary analysis on their distribution in three-party conversations. In: Oriental COCOSDA, pp 168–173
DeVault D, Artstein R, Benn G, Dey T, Fast E, Gainer A, Georgila K, Gratch J, Hartholt A, Lhommet M, Lucas G, Marsella S, Morbini F, Nazarian A, Scherer S, Stratou G, Suri A, Traum D, Wood R, Morency LP (2014) Simsensei kiosk: a virtual human interviewer for healthcare decision support. In: AAMAS, pp 1061–1068
Digman JM (1990) Personality structure: Emergence of the five-factor model. Annu Rev Psychol 41(1):417–440
Eysenck H (1947) Dimensions of personality. Oxford (1947)
Fong T, Nourbakhsh I, Dautenhahn K (2003) A survey of socially interactive robots. Robot Auton Syst 42:143–166
Inoue K, Milhorat P, Lala D, Zhao T, Kawahara T (2016) Talking with ERICA, an autonomous android. In: SIGDIAL, pp 212–215
Isbister K, Nass C (2000) Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics. Hum Comput Stud 53(2):251–267
Kawahara T (2018) Spoken dialogue system for a human-like conversational robot ERICA. In: IWSDS
Koiso H, Horiuchi Y, Tutiya S, Ichikawa A, Den Y (1998) An analysis of turn-taking and backchannels based on prosodic and syntactic features in japanese map task dialogs. Lang Speech 41(3–4):295–321
Li J, Galley M, Brockett C, Spithourakis G, Gao J, Dolan B (2016) A persona-based neural conversation model. In: ACL, pp 994–1003
Mairesse F, Walker MA (2011) Controlling user perceptions of linguistic style: trainable generation of personality traits. Comput Ling 37(3):455–488
McCrae RR, John OP (1992) An introduction to the five-factor model and its applications. J Pers 60(2):175–215
McKeown G, Valstar M, Pantic M (2012) The SEMAINE database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Trans Aff Comput 3(1):5–17
Miyazaki C, Hirano T, Higashinaka R, Makino T, Matsuo Y (2015) Automatic conversion of sentence-end expressions for utterance characterization of dialogue systems. In: PACLIC, pp 307–314
Mizukami M, Neubig G, Sakti S, Toda T, Nakamura S (2015) Linguistic individuality transformation for spoken language. In: IWSDS
Nagaoka C, Komori M, Nakamura T, Draguna MR (2005) Effects of receptive listening on the congruence of speakers’ response latencies in dialogues. Psychol Rep 97(1):265–274
Nass C, Moon Y, Fogg BJ, Reeves B, Dryer D (1955) Can computer personalities be human personalities? Hum Comput Stud 43:223–239
Ogawa Y, Miyazawa K, Kikuchi H (2014) Assigning a personality to a spoken dialogue agent through self-disclosure of behavior. In: HAI, pp 331–337
Salem M, Ziadee M, Sakr M (2013) Effects of politeness and interaction context on perception and experience of HRI. In: ICSR, pp 531–541
Serban IV, Lowe R, Henderson P, Charlin L, Pineau J (2018) A survey of available corpora for building data-driven dialogue systems. Dialogue and Discourse 9(1):1–49
Shiwa T, Kanda T, Imai M, Ishiguro H, Hagita N (2009) How quickly should communication robots respond? Int J Social Robot 1:153–160
Sugiyama, H., Meguro, T., Higashinaka, R., Minami, Y.: Large-scale collection and analysis of personal question-answer pairs for conversational agents. In: IVA, pp. 420–433 (2014)
Traum D, Aggarwal P, Artstein R, Foutz S, amd Athanasios Katsamanis JG, Leuski A, Noren D, Swartout W (2012) Ada and Grace: direct interaction with museum visitors. In: IVA, pp 245–251
van Vugt HC, Konijn EA, Hoorn JF, Keur I, Eliëns A (2007) Realism is not all! User engagement with task-related interface characters. Interact Comput 19(2):267–280
Wada S (1996) Construction of the Big Five scales of personality trait terms and concurrent validity with NPI. Jpn J Psychol 67(1):61–67 In Japanese
Watanabe M (2009) Features and roles of filled pauses in speech communication: a corpus-based study of spontaneous speech. Hitsuji Syobo Publishing
Yamamoto K, Inoue K, Nakamura S, Takanashi K, Kawahara T (2018) Dialogue behavior control model for expressing a character of humanoid robots. In: APSIPA ASC, pp 1732–1737
Zhang S, Dinan E, Urbanek J, Szlam A, Kiela D, Weston J (2018) Personalizing dialogue agents: I have a dog, do you have pets too? In: ACL, pp 2204–2213
Acknowledgment
This work was supported by JST ERATO Ishiguro Symbiotic Human-Robot Interaction program (Grant number JPMJER1401) and Grant-in-Aid for Scientific Research on Innovative Areas “Communicative intelligent systems towards a human-machine symbiotic society” (Grant number JP19H05691).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Yamamoto, K., Inoue, K., Nakamura, S., Takanashi, K., Kawahara, T. (2021). A Character Expression Model Affecting Spoken Dialogue Behaviors. In: D'Haro, L.F., Callejas, Z., Nakamura, S. (eds) Conversational Dialogue Systems for the Next Decade. Lecture Notes in Electrical Engineering, vol 704. Springer, Singapore. https://doi.org/10.1007/978-981-15-8395-7_1
Download citation
DOI: https://doi.org/10.1007/978-981-15-8395-7_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8394-0
Online ISBN: 978-981-15-8395-7
eBook Packages: EngineeringEngineering (R0)