Abstract
We study on the response selection problem for multi-turn conversation in retrieval-based customer service chatbots. Existing multi-turn context-response matching models do not consider the effect of speaker’s role on utterance semantics. In this paper, we propose a Role-aware Enhanced Matching network (REM) to distinguish utterances from the perspective of speakers’ roles and enrich the semantic features of context with role-aware enhancement. First, the utterances are encoded by different GRUs according to speakers. Then an attention mechanism and an interaction function are employed between two speakers’ utterances to enrich the semantics of context, followed by constructing matching matrices and aggregation. Extensive experiments are conducted on public available e-commerce dialogue dataset and the results show that our proposed model outperforms strong baseline methods by large margins.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Shum, H., He, X., Li, D.: From Eliza to XiaoIce: challenges and opportunities with social chatbots. Front. Inf. Technol. Electron. Eng. 19(1), 10–26 (2018). https://doi.org/10.1631/FITEE.1700826
Li, F.-L., et al.: Alime assist: an intelligent assistant for creating an innovative e-commerce experience. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 2495–2498. ACM (2017)
Zhu, P., Zhang, Z., Li, J., Huang, Y., Zhao, H.: Lingke: a fine-grained multi-turn chatbot for customer service. In: COLING (Demos), pp. 108–112 (2018)
Qiu, M., et al.: AliMe Chat: a sequence to sequence and rerank based chatbot engine. In: ACL, pp. 498–503 (2017)
Wang, H., Lu, Z., Li, H., Enhong, C.: A dataset for research on short-text conversations. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 935–945 (2013)
Ji, Z., Lu, Z., Li, H.: An information retrieval approach to short text conversation. arXiv preprint arXiv:1408.6988 (2014)
Wu, Y., Wu, W., Xing, C., Zhou, M., Li, Z.: Sequential matching network: a new architecture for multi-turn response selection in retrieval-based chatbots. In: ACL, pp. 496–505 (2017)
Zhang, Z., Li, J., Zhu, P., Zhao, H., Liu, G.: Modeling multi-turn conversation with deep utterance aggregation. In: COLING, pp. 3740–3752 (2018)
Yuan, C., et al.: Multi-hop selector network for multi-turn response selection in retrieval-based chatbots. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 111–120 (2019)
Wang, H., Lu, Z., Li, H., Chen, E.: A dataset for research on short-text conversations. In: EMNLP, pp. 935–945 (2013)
Ji, Z., Lu, Z., Li, H.: An information retrieval approach to short text conversation. arXiv preprint arXiv:1408.6988 (2014)
Lowe, R., Pow, N., Serban, I., Pineau, J.: The ubuntu dialogue corpus: a large dataset for research in unstructured multi-turn dialogue systems. In: SIGDIAL Conference, pp. 285–294 (2015)
Chen, Q., Wang, W.: Sequential Attention-based Network for Noetic End-to-End Response Selection. arXiv preprint arXiv:1901.02609 (2019)
Chen, Q., Zhu, X., Ling, Z., Wei, S., Jiang, H., Inkpen, D.: Enhanced LSTM for natural language inference. In: ACL, pp. 1657–1668 (2017)
Zhou, X., et al.: Multi-turn response selection for chatbots with deep attention matching network. In: ACL, pp. 1118–1127 (2018)
Tao, C., Wu, W., Xu, C., Hu, W., Zhao, D., Yan, R.: Multi-Representation fusion network for multi-turn response selection in retrieval-based chatbots. In: WSDM, pp. 267–275 (2019)
Gu, J., Ling, Z., Liu, Q.: Interactive matching network for multi-turn response selection in retrieval-based chatbots. arXiv preprint arXiv:1901.01824 (2019)
Wang, S., Jiang, J.: Compare-aggregate model for matching text sequences. In: ICLR (2017)
Wan, S., Lan, Y., Xu, J., Guo, J., Pang, L., Cheng, X.: Match-SRNN: modeling the recursive matching structure with spatial RNN. In: IJCAI, pp. 2922–2928 (2016)
Wang, S., Jiang, J.: Learning natural language inference with LSTM. In: HLT-NAACL, pp. 1442–1451 (2016)
Nie, Y., Bansal, M.: Shortcut-stacked sentence encoders for multi-domain inference. In: Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP (RepEval@EMNLP), pp. 41–45 (2017)
Zhou, X., et al.: Multi-view response selection for human-computer conversation. In: EMNLP, pp. 372–381 (2016)
Yan, R., Song, Y., Wu, H.: Learning to respond with deep neural networks for retrieval-based human-computer conversation system. In: SIGIR, pp. 55–64 (2016)
Kingma, D.P., Ba, J.: 2014. Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Acknowledgements
The work was supported by the National Key R&D Program of China under grant 2018YFB1004700, National Natural Science Foundation of China (61872074, 61772122), and the Fundamental Research Funds for the Central Universities (N180716010).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhao, G., Zhu, Y., Feng, S., Wang, D., Zhang, Y., Yu, G. (2020). Role-Aware Enhanced Matching Network for Multi-turn Response Selection in Customer Service Chatbots. In: Yang, X., Wang, CD., Islam, M.S., Zhang, Z. (eds) Advanced Data Mining and Applications. ADMA 2020. Lecture Notes in Computer Science(), vol 12447. Springer, Cham. https://doi.org/10.1007/978-3-030-65390-3_49
Download citation
DOI: https://doi.org/10.1007/978-3-030-65390-3_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-65389-7
Online ISBN: 978-3-030-65390-3
eBook Packages: Computer ScienceComputer Science (R0)