Abstract
Chat functionality is currently regarded as an important factor in spoken dialogue systems. In this article, we explore the architecture of a chat-oriented dialogue system that can continue a long conversation with users and can be used for a long time. To achieve this goal, we propose a method which combines various types of response generation modules, such as a statistical model-based module, a rule-based module and a topic transition-oriented module. The core of this architecture is a method for selecting the most appropriate response based on a breakdown index and a development index. The experimental results show that the weighted sum of these indexes can be used for evaluating system utterances from the viewpoint of continuous dialogue and long-term usage.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Higashinaka, R., Meguro, T., Imamura, K., Sugiyama, H., Makino, T., Matsuo, Y.: Evaluating coherence in open domain conversational systems. In: Proceedings of Interspeech, pp. 130–134 (2014)
Xiang, Y., Zhang, Y., Zhou, X., Wang, X., Qin, Y.: Problematic situation analysis and automatic recognition for chinese online conversational system. In: Proceedings of the Third CIPS-SIGHAN Joint Conference on Chinese Language Processing, pp. 43–51. Association for Computational Linguistics, Wuhan, China (2014). http://www.aclweb.org/anthology/W14-6808
Banchs, R.E., Li, H.: Iris: a chat-oriented dialogue system based on the vector space model. In: Proceedings of the ACL 2012 System Demonstrations, pp. 37–42. ACL ’12, Association for Computational Linguistics, Stroudsburg, PA, USA (2012). http://dl.acm.org/citation.cfm?id=2390470.2390477
Dybala, P., Ptaszynski, M., Maciejewski, J., Takahashi, M., Rzepka, R., Araki, K.: Multiagent system for joke generation: humor and emotions combined in human-agent conversation. J. Ambient Intell. Smart Environ. 2(1), 31–48 (2010). http://dl.acm.org/citation.cfm?id=1735862.1735867
Onishi, K., Yoshimura, T.: Casual conversation technology achieving natural dialog with computers. NTT DOCOMO Tech. J. 15(4), 16–21 (2014)
Nakano, A., Araki, M.: Topic development method in chat dialogue system using distributed word representation (in Japanese). In: Proceedings of Annual Meeting of The Association for Natural Language Processing, pp. 269–272 (2015)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: ICLR Workshop (2013)
Fleiss, J.L.: Measuring nominal scale agreement among many raters. Psychol. Bull. 76(5), 378–382 (1971)
Acknowledgements
We thank all members of the dialogue task of “Project Next NLP” for the data collection and annotation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Science+Business Media Singapore
About this chapter
Cite this chapter
Mori, H., Yasuda, A., Araki, M. (2017). An Evaluation Method for System Response in Chat-Oriented Dialogue System. In: Jokinen, K., Wilcock, G. (eds) Dialogues with Social Robots. Lecture Notes in Electrical Engineering, vol 427. Springer, Singapore. https://doi.org/10.1007/978-981-10-2585-3_32
Download citation
DOI: https://doi.org/10.1007/978-981-10-2585-3_32
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-2584-6
Online ISBN: 978-981-10-2585-3
eBook Packages: EngineeringEngineering (R0)