Skip to main content
SpringerLink
Log in
Book cover

International Conference on Intelligent Virtual Agents

IVA 2017: Intelligent Virtual Agents pp 192–204Cite as

Learning and Reusing Dialog for Repeated Interactions with a Situated Social Agent

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10498))

Abstract

Content authoring for conversations is a limiting factor in creating verbal interactions with intelligent virtual agents. Building on techniques utilizing semi-situated learning in an incremental crowdworking pipeline, this paper introduces an embodied agent that self-authors its own dialog for social chat. In particular, the autonomous use of crowdworkers is supplemented with a generalization method that borrows and assesses the validity of dialog across conversational states. We argue that the approach offers a community-focused tailoring of dialog responses that is not available in approaches that rely solely on statistical methods across big data. We demonstrate the advantages that this can bring to interactions through data collected from 486 conversations between a situated social agent and 22 users during a 3 week long evaluation period.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aylett, R.S., Louchart, S., Dias, J., Paiva, A., Vala, M.: FearNot! – an experiment in emergent narrative. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS, vol. 3661, pp. 305–316. Springer, Heidelberg (2005). doi:10.1007/11550617_26

    Chapter  Google Scholar 

  2. Bohus, D., Rudnicky, A.: The RavenClaw dialog management framework: Architecture and systems. Computer Speech & Language 23(3), 332–361 (2009)

    Article  Google Scholar 

  3. Guo, S., Lenchner, J., Connell, J., Dholakia, M., Muta, H.: Conversational bootstrapping and other tricks of a concierge robot. In: Proc. of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 73–81. ACM (2017)

    Google Scholar 

  4. Kanda, T., Shiomi, M., Miyashita, Z., Ishiguro, H., Hagita, N.: An affective guide robot in a shopping mall. In: 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 173–180. IEEE (2009)

    Google Scholar 

  5. Lasecki, W., Wesley, R., Nichols, J., Kulkarni, A., Allen, J., Bigham, J.: Chorus: a crowd-powered conversational assistant. In: UIST 2013, pp. 151–162. ACM (2013)

    Google Scholar 

  6. Leite, I., Pereira, A., Funkhouser, A., Li, B., Lehman, J.F.: Semi-situated learning of verbal and nonverbal content for repeated human-robot interaction. In: ICMI 2016, pp. 13–20. ACM, New York (2016)

    Google Scholar 

  7. Matsuyama, Y., Bhardwaj, A., Zhao, R., Romero, O.J., Akoju, S.A., Cassell, J.: Socially-aware animated intelligent personal assistant agent. In: 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, p. 224 (2016)

    Google Scholar 

  8. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)

    Google Scholar 

  9. Mori, H., Araki, M.: Selection method of an appropriate response in chat-oriented dialogue systems. In: 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, p. 228 (2016)

    Google Scholar 

  10. Řehůřek, R., Sojka, P.: Software framework for topic modelling with large corpora. In: Proc. of the LREC 2010 Workshop on New Challenges for NLP Frameworks, pp. 45–50 (2010)

    Google Scholar 

  11. Shang, L., Lu, Z., Li, H.: Neural Responding Machine for Short-Text Conversation (2015). CoRR abs/1503.02364

    Google Scholar 

  12. Vinyals, O., Le, Q.: A neural conversational model (2015). arXiv preprint arxiv:1506.05869

  13. Young, S., Gašić, M., Thomson, B., Williams, J.D.: POMDP-based statistical spoken dialog systems: A review. Proc. of the IEEE 101(5), 1160–1179 (2013)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Disney Research, Pittsburgh, PA, 15213, USA

    James Kennedy, Iolanda Leite, André Pereira, Ming Sun, Boyang Li, Rishub Jain, Ricson Cheng, Eli Pincus, Elizabeth J. Carter & Jill Fain Lehman

  2. KTH Royal Institute of Technology, 100 44, Stockholm, Sweden

    Iolanda Leite

  3. Carnegie Mellon University, Pittsburgh, PA, 15213, USA

    Rishub Jain & Ricson Cheng

  4. USC Institute for Creative Technologies, Los Angeles, CA, 90094, USA

    Eli Pincus

Authors
  1. James Kennedy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Iolanda Leite
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. André Pereira
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ming Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Boyang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rishub Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Ricson Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Eli Pincus
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Elizabeth J. Carter
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Jill Fain Lehman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to James Kennedy .

Editor information

Editors and Affiliations

  1. KTH Royal Institute of Technology, Stockholm, Sweden

    Jonas Beskow

  2. KTH Royal Institute of Technology, Stockholm, Sweden

    Christopher Peters

  3. Uppsala University, Uppsala, Sweden

    Ginevra Castellano

  4. Trinity College, Dublin, Ireland

    Carol O'Sullivan

  5. KTH Royal Institute of Technology, Stockholm, Sweden

    Iolanda Leite

  6. University of Bielefeld, Bielefeld, Germany

    Stefan Kopp

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Kennedy, J. et al. (2017). Learning and Reusing Dialog for Repeated Interactions with a Situated Social Agent. In: Beskow, J., Peters, C., Castellano, G., O'Sullivan, C., Leite, I., Kopp, S. (eds) Intelligent Virtual Agents. IVA 2017. Lecture Notes in Computer Science(), vol 10498. Springer, Cham. https://doi.org/10.1007/978-3-319-67401-8_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67401-8_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67400-1

  • Online ISBN: 978-3-319-67401-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation