Abstract
Human-machine dialogue is the hot spot of current research. In this paper, we proposed an end-to-end dialogue system based on external knowledge, which realized active guidance and topic transfer in multiple rounds of dialogue. Our system is built on the pointer generator model so that the output token in the response can be generated or copied from the conversation history or background knowledge according to a trainable action probability distribution. At the same time, with the data processing and optimization of the model structure, the designed system is capable of generating high quality responses. In the 2019 NLP Language and Intelligence Challenge, our proposed dialogue system ranked third in the automatic evaluation, and ranked fifth in the manual evaluation.
This work was supported by the Science Foundation of China University of Petroleum-Beijing under grant No. 2462018YJRC007.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wu, W., Guo, Z., Zhou, X.: Proactive human-machine conversation with explicit conversation goals. In ACL (2019)
Vinyals, O., Le, Q.V.: A neural conversational model. In ICML (2015)
Shang, L., Lu, Z., Li, H.: Neural responding machine for short-text conversation. In: Proceedings of ACL (2015)
Sordoni, A., et al.: A neural network approach to context-sensitive generation of conversational responses. In: Proceedings of NAACL-HLT (2015)
Wen, T.-H., et al.: Conditional generation and snapshot learning in neural dialogue systems. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) (2016)
Bordes, A., Weston, J.: Learning end-to-end goal-oriented dialog. In: International Conference on Learning Representations, abs/1605.07683 (2017)
Eric, M., Manning, C.: A copy-augmented sequence-to-sequence architecture gives good performance on task-oriented dialogue. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, Valencia, Spain, pp. 468–473, April 2017. Association for Computational Linguistics. http://www.aclweb.org/anthology/E17-2075
Williams, J.D., Young, S.: Partially observable markov decision processes for spoken dialog systems. Comput. Speech Lang. 21(2), 393–422 (2007)
Young, S., Gasic, M., Thomson, B., Williams, J.D.: Pomdp-based statistical spoken dialog systems: a review. Proc. IEEE 101(5), 1160–1179 (2013)
Chen, Y.-N., Hakkani-Tur, D., Gao, J., Deng, L.: End-to-end memory networks with knowledge carryover for multi-turn spoken language understanding (2016)
Wu, C.-S., Madotto, A., Winata, G., Fung, P.: End-to-end dynamic query memory network for entity-value independent task-oriented dialog. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6154–6158, April 2018
Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems (2014)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: Proceedings of the International Conference on Learning Representations (2015)
Seo, M., Kembhavi, A., Farhadi, A., Hajishirzi, H.: Bidirectional attention flow for machine comprehension. In: Proceedings of ICLR (2017)
Wang, S., Jiang, J.: Machine comprehension using match-lstm and answer pointer. In: Proceedings of ICLR (2017)
Vinyals, O., Fortunato, M., Jaitly, N.: Pointer networks. In: Neural Information Processing Systems (2015)
See, A., Liu, P.J., Manning, C.D.: Get to the point: Summarization with pointer-generator networks. arXiv preprint arXiv:1704.04368 (2017)
Ghazvininejad, M., et al.: A knowledge grounded neural conversation model. In: AAAI (2018)
Madotto, A., Wu, C.-S., Fung, P.: Mem2Seq: effectively incorporating knowledge bases into end-to-end task-oriented dialog systems. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 1468–1478. Association for Computational Linguistics (2018)
Wang, F., Peng, J., Wu, H., Lian, R., Xie, M.: Learning to select knowledge for response generation in dialog systems. arXiv preprint arXiv:1902.04911 (2019)
Zhao, Y., Ni, X.: Paragraph-level neural question generation with maxout pointer and gated self-attention networks. In EMNLP (2018)
Tam, Y.-C., Ding, J.: Cluster-based beam search for pointer-generator chatbot grounded by knowledge. In AAAI (2019)
Li, S., Zhao, Z., Hu, R., Li, W., Liu, T., Du, X.: Analogical reasoning on chinese morphological and semantic relations. In: ACL (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhou, H., Chen, C., Liu, H., Qin, F., Liang, H. (2019). Proactive Knowledge-Goals Dialogue System Based on Pointer Network. In: Tang, J., Kan, MY., Zhao, D., Li, S., Zan, H. (eds) Natural Language Processing and Chinese Computing. NLPCC 2019. Lecture Notes in Computer Science(), vol 11839. Springer, Cham. https://doi.org/10.1007/978-3-030-32236-6_66
Download citation
DOI: https://doi.org/10.1007/978-3-030-32236-6_66
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32235-9
Online ISBN: 978-3-030-32236-6
eBook Packages: Computer ScienceComputer Science (R0)
