Skip to main content

A Character Expression Model Affecting Spoken Dialogue Behaviors

  • Chapter
  • First Online:

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 704))

Abstract

We address character (personality) expression for a spoken dialogue system in order to accommodate it in particular dialogue tasks and social roles. While conventional studies investigated controlling the linguistic expressions, we focus on spoken dialogue behaviors to express systems’ characters. Specifically, we investigate spoken dialogue behaviors such as utterance amount, backchannel frequency, filler frequency, and switching pause length in order to express three character traits: extroversion, emotional instability, and politeness. In this study, we evaluate this model with a natural spoken dialogue corpus. The results reveal that this model expresses reasonable characters according to the dialogue tasks and the participant roles. Furthermore, it is also shown that this model is able to express different characters among participants given the same role. A subjective experiment demonstrated that subjects could perceive the characters expressed by the model.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Brave S, Nass C, Hutchinson K (2005) Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent. Int J Hum Comput Stud 62(2):161–178

    Article  Google Scholar 

  2. Bunt H, Alexandersson J, Carletta J, Choe JW, Fang AC, Hasida K, Lee K, Petukhova V, Popescu-Belis A, Romary L, Soria C, Traum D (2010) Towards an ISO standard for dialogue act annotation. In: LREC, pp 2548–2555

    Google Scholar 

  3. Costa PT, McCrae RR (1992) Normal personality assessment in clinical practice: the NEO personality inventory. Psychol Assess 4(1):5–13

    Article  Google Scholar 

  4. D Sevin E, Hyniewska SJ, Pelachaud C (2010) Influence of personality traits on backchannel selection. In: IVA, pp 187–193

    Google Scholar 

  5. Den Y, Yoshida N, Takanashi K, Koiso H (2011) Annotation of Japanese response tokens and preliminary analysis on their distribution in three-party conversations. In: Oriental COCOSDA, pp 168–173

    Google Scholar 

  6. DeVault D, Artstein R, Benn G, Dey T, Fast E, Gainer A, Georgila K, Gratch J, Hartholt A, Lhommet M, Lucas G, Marsella S, Morbini F, Nazarian A, Scherer S, Stratou G, Suri A, Traum D, Wood R, Morency LP (2014) Simsensei kiosk: a virtual human interviewer for healthcare decision support. In: AAMAS, pp 1061–1068

    Google Scholar 

  7. Digman JM (1990) Personality structure: Emergence of the five-factor model. Annu Rev Psychol 41(1):417–440

    Article  Google Scholar 

  8. Eysenck H (1947) Dimensions of personality. Oxford (1947)

    Google Scholar 

  9. Fong T, Nourbakhsh I, Dautenhahn K (2003) A survey of socially interactive robots. Robot Auton Syst 42:143–166

    Article  MATH  Google Scholar 

  10. Inoue K, Milhorat P, Lala D, Zhao T, Kawahara T (2016) Talking with ERICA, an autonomous android. In: SIGDIAL, pp 212–215

    Google Scholar 

  11. Isbister K, Nass C (2000) Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics. Hum Comput Stud 53(2):251–267

    Article  Google Scholar 

  12. Kawahara T (2018) Spoken dialogue system for a human-like conversational robot ERICA. In: IWSDS

    Google Scholar 

  13. Koiso H, Horiuchi Y, Tutiya S, Ichikawa A, Den Y (1998) An analysis of turn-taking and backchannels based on prosodic and syntactic features in japanese map task dialogs. Lang Speech 41(3–4):295–321

    Article  Google Scholar 

  14. Li J, Galley M, Brockett C, Spithourakis G, Gao J, Dolan B (2016) A persona-based neural conversation model. In: ACL, pp 994–1003

    Google Scholar 

  15. Mairesse F, Walker MA (2011) Controlling user perceptions of linguistic style: trainable generation of personality traits. Comput Ling 37(3):455–488

    Article  Google Scholar 

  16. McCrae RR, John OP (1992) An introduction to the five-factor model and its applications. J Pers 60(2):175–215

    Article  Google Scholar 

  17. McKeown G, Valstar M, Pantic M (2012) The SEMAINE database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Trans Aff Comput 3(1):5–17

    Article  Google Scholar 

  18. Miyazaki C, Hirano T, Higashinaka R, Makino T, Matsuo Y (2015) Automatic conversion of sentence-end expressions for utterance characterization of dialogue systems. In: PACLIC, pp 307–314

    Google Scholar 

  19. Mizukami M, Neubig G, Sakti S, Toda T, Nakamura S (2015) Linguistic individuality transformation for spoken language. In: IWSDS

    Google Scholar 

  20. Nagaoka C, Komori M, Nakamura T, Draguna MR (2005) Effects of receptive listening on the congruence of speakers’ response latencies in dialogues. Psychol Rep 97(1):265–274

    Article  Google Scholar 

  21. Nass C, Moon Y, Fogg BJ, Reeves B, Dryer D (1955) Can computer personalities be human personalities? Hum Comput Stud 43:223–239

    Article  Google Scholar 

  22. Ogawa Y, Miyazawa K, Kikuchi H (2014) Assigning a personality to a spoken dialogue agent through self-disclosure of behavior. In: HAI, pp 331–337

    Google Scholar 

  23. Salem M, Ziadee M, Sakr M (2013) Effects of politeness and interaction context on perception and experience of HRI. In: ICSR, pp 531–541

    Google Scholar 

  24. Serban IV, Lowe R, Henderson P, Charlin L, Pineau J (2018) A survey of available corpora for building data-driven dialogue systems. Dialogue and Discourse 9(1):1–49

    Article  Google Scholar 

  25. Shiwa T, Kanda T, Imai M, Ishiguro H, Hagita N (2009) How quickly should communication robots respond? Int J Social Robot 1:153–160

    Article  Google Scholar 

  26. Sugiyama, H., Meguro, T., Higashinaka, R., Minami, Y.: Large-scale collection and analysis of personal question-answer pairs for conversational agents. In: IVA, pp. 420–433 (2014)

    Google Scholar 

  27. Traum D, Aggarwal P, Artstein R, Foutz S, amd Athanasios Katsamanis JG, Leuski A, Noren D, Swartout W (2012) Ada and Grace: direct interaction with museum visitors. In: IVA, pp 245–251

    Google Scholar 

  28. van Vugt HC, Konijn EA, Hoorn JF, Keur I, Eliëns A (2007) Realism is not all! User engagement with task-related interface characters. Interact Comput 19(2):267–280

    Article  Google Scholar 

  29. Wada S (1996) Construction of the Big Five scales of personality trait terms and concurrent validity with NPI. Jpn J Psychol 67(1):61–67 In Japanese

    Article  Google Scholar 

  30. Watanabe M (2009) Features and roles of filled pauses in speech communication: a corpus-based study of spontaneous speech. Hitsuji Syobo Publishing

    Google Scholar 

  31. Yamamoto K, Inoue K, Nakamura S, Takanashi K, Kawahara T (2018) Dialogue behavior control model for expressing a character of humanoid robots. In: APSIPA ASC, pp 1732–1737

    Google Scholar 

  32. Zhang S, Dinan E, Urbanek J, Szlam A, Kiela D, Weston J (2018) Personalizing dialogue agents: I have a dog, do you have pets too? In: ACL, pp 2204–2213

    Google Scholar 

Download references

Acknowledgment

This work was supported by JST ERATO Ishiguro Symbiotic Human-Robot Interaction program (Grant number JPMJER1401) and Grant-in-Aid for Scientific Research on Innovative Areas “Communicative intelligent systems towards a human-machine symbiotic society” (Grant number JP19H05691).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kenta Yamamoto .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Yamamoto, K., Inoue, K., Nakamura, S., Takanashi, K., Kawahara, T. (2021). A Character Expression Model Affecting Spoken Dialogue Behaviors. In: D'Haro, L.F., Callejas, Z., Nakamura, S. (eds) Conversational Dialogue Systems for the Next Decade. Lecture Notes in Electrical Engineering, vol 704. Springer, Singapore. https://doi.org/10.1007/978-981-15-8395-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-8395-7_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-8394-0

  • Online ISBN: 978-981-15-8395-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics