Abstract
In customer service (CS), customers pose questions that will be answered by customer service staff, and the communication in CS is a typical multi-round conversation. However, there are no explicit correspondences among conversational utterances, and obtaining the explicit alignments of those utterances not only contributes to dialogue analysis but also provides valuable data for learning intelligent dialogue systems. In this paper, we first present a study on utterance alignment (UA) in CS. We divide the alignment of utterances into four types: None, One-to-One, One-to-Many and Jump. The direct design models such as rule-based and matching-based methods are often only good at solving part of types, and the major reason is that they ignore the interactions of different utterances. Therefore, to model the mutual influence of different utterances as well as their alignments, we propose a joint model which models the UA as a task of joint disambiguation and resolved by integer programming. We conduct experiments on a dataset of an in-house online CS. And the results indicate that it performs better than baseline models, especially for One-to-Many and Jump alignments.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
References
Blunsom, P., Grefenstette, E., Kalchbrenner, N.: A convolutional neural network for modelling sentences. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (2014)
Brown, P.E., Pietra, S.A.D., Pietra, V.J.D., Mercer, R.L.: The mathematics of statistical machine translation: parameter estimation. Comput. Linguist. 19(2), 263–311 (1993). http://www.aclweb.org/anthology/J93-2003
Carlos, C.S., Yalamanchi, M.: Intention analysis for sales, marketing and customer service. In: Proceedings of COLING 2012: Demonstration Papers, pp. 33–40 (2012)
Che, W., et al.: A cascaded syntactic and semantic dependency parsing system. In: CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning, pp. 238–242. Coling 2008 Organizing Committee (2008). http://www.aclweb.org/anthology/W08-2134
Cui, L., Huang, S., Wei, F., Tan, C., Duan, C., Zhou, M.: SuperAgent: a customer service chatbot for e-commerce websites. In: Proceedings of ACL 2017, System Demonstrations, pp. 97–102 (2017)
Herzig, J., et al.: Classifying emotions in customer support dialogues in social media. In: Meeting of the Special Interest Group on Discourse and Dialogue (2016)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735 (1997)
Hu, B., Lu, Z., Li, H., Chen, Q.: Convolutional neural network architectures for matching natural language sentences. In: Advances in Neural Information Processing Systems, pp. 2042–2050 (2014)
Ji, Z., Lu, Z., Li, H.: An information retrieval approach to short text conversation. Comput. Sci. (2014)
Kulkarni, S., Singh, A., Ramakrishnan, G., Chakrabarti, S.: Collective annotation of wikipedia entities in web text. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2009, pp. 457–466. ACM, New York (2009). https://doi.org/10.1145/1557019.1557073
Lu, Y., Castellanos, M., Dayal, U., Zhai, C.: Automatic construction of a context-aware sentiment lexicon: an optimization approach. In: Proceedings of the 20th International Conference on World Wide Web, pp. 347–356. ACM (2011)
Negi, S., Buitelaar, P.: Towards the extraction of customer-to-customer suggestions from reviews. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 2159–2167. Association for Computational Linguistics (2015). https://doi.org/10.18653/v1/D15-1258
Ouchi, H., Tsuboi, Y.: Addressee and response selection for multi-party conversation. In: EMNLP, pp. 2133–2143 (2016)
Punyakanok, V., Roth, D., Yih, W.T., Zimak, D.: Semantic role labeling via integer linear programming inference. In: COLING 2004: Proceedings of the 20th International Conference on Computational Linguistics (2004). http://www.aclweb.org/anthology/C04-1197
Reithinger, N., Klesen, M.: Dialogue act classification using language models. In: EuroSpeech (1997)
Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems, pp. 3104–3112 (2014)
Tamura, A., Watanabe, T., Sumita, E.: Recurrent neural networks for word alignment model. ACL 1(52), 1470–80 (2014)
Tan, M., dos Santos, C., Xiang, B., Zhou, B.: Improved representation learning for question answer matching. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 464–473 (2016)
Vogel, S., Ney, H., Tillmann, C.: Hmm-based word alignment in statistical translation. In: Proceedings of the 16th Conference on Computational Linguistics-Volume 2, pp. 836–841. Association for Computational Linguistics (1996)
Williams, J., Raux, A., Ramachandran, D., Black, A.: The dialog state tracking challenge. In: Proceedings of the SIGDIAL 2013 Conference, pp. 404–413 (2013)
Woodsend, K., Lapata, M.: Automatic generation of story highlights. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 565–574. Association for Computational Linguistics (2010). http://www.aclweb.org/anthology/P10-1058
Yahya, M., Berberich, K., Elbassuoni, S., Ramanath, M., Tresp, V., Weikum, G.: Natural language questions for the web of data. In: Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 379–390 (2012)
Yang, N., Liu, S., Li, M., Zhou, M., Yu, N.: Word alignment modeling with context dependent deep neural network. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 166–175. Association for Computational Linguistics (2013). http://www.aclweb.org/anthology/P13-1017
Zhang, Y., He, S., Liu, K., Zhao, J.: A joint model for question answering over multiple knowledge bases. In: Thirtieth AAAI Conference on Artificial Intelligence, pp. 3094–3100 (2016)
Acknowledgement
This work is supported by the National Natural Science Foundation of China (No.61533018), the Natural Key R&D Program of China (No.2017YFB1002101), the National Natural Science Foundation of China (No.61702512, No.61806201) and the independent research project of National Laboratory of Pattern Recognition. This work was also supported by CCF-DiDi BigData Joint Lab and CCF-Tencent Open Research Fund.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Bai, G., He, S., Liu, K., Zhao, J. (2019). Utterance Alignment in Custom Service by Integer Programming. In: Sun, M., Huang, X., Ji, H., Liu, Z., Liu, Y. (eds) Chinese Computational Linguistics. CCL 2019. Lecture Notes in Computer Science(), vol 11856. Springer, Cham. https://doi.org/10.1007/978-3-030-32381-3_56
Download citation
DOI: https://doi.org/10.1007/978-3-030-32381-3_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32380-6
Online ISBN: 978-3-030-32381-3
eBook Packages: Computer ScienceComputer Science (R0)