Abstract
Nowadays, customer satisfaction prediction (CSP) on e-commerce platforms has become a hot research topic for intelligent customer service. CSP aims to discover customer satisfaction according to the dialogue content of customer and intelligent customer service, for the purpose of improving service quality and customer experience. Previous works have made some progress in many aspects, but they mostly ignore the huge expressional differences between customer questions and customer service answers, and fail to adequately consider the internal relations of these two kinds of personalized expressions. In this paper, we propose a two-stage dialogue-level classification model containing an intra-stage and an inter-stage, to emphasize the importance of modeling customer part (content of customer questions) and service part (content of customer service answers) separately. In the intra-stage, we model customer part and service part separately by using attention mechanism combined with personalized context to obtain a customer state and a service state. Then we interact these two states with each other in the inter-stage to obtain the final satisfaction representation of the whole dialogue. Experiment results demonstrate that our model achieves better performance than several competitive baselines on our in-house dataset and four public datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Kim, Y.: Convolutional neural networks for sentence classification. In: EMNLP (2014)
Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: ICML (2010)
Zhou, X., et al.: Multi-turn response selection for chatbots with deep attention matching network. In: ACL (2018)
Vaswani, A., et al.: Attention is all you need. In: NIPS (2017)
Poria, S., Hazarika, D., Majumder, N., Naik, G., Cambria, E., Mihalcea, R.: MELD: a multimodal multi-party dataset for emotion recognition in conversations. In: ACL (2019)
Zahiri, S.M., Choi, J.D.: Emotion detection on TV show transcripts with sequence-based convolutional neural networks. In: The Workshops of AAAI (2018)
Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929ā1958 (2014)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)
Hashemi, S.H., Williams, K., Kholy, A.E., Zitouni, I., Crook, P.A.: Measuring user satisfaction on smart speaker intelligent assistants using intent sensitive query embeddings. In: CIKM (2018)
Hazarika, D., Poria, S., Zadeh, A., Cambria, E., Morency, L., Zimmermann, R.: Conversational memory network for emotion recognition in dyadic dialogue videos. In: NAACL-HLT (2018)
Ghosal, D., Majumder, N., Poria, S., Chhaya, N., Gelbukh, A.F.: DialogueGCN: a graph convolutional neural network for emotion recognition in conversation. In: EMNLP-IJCNLP (2019)
Shen, W., Wu, S., Yang, Y., Quan, X.: Directed acyclic graph network for conversational emotion recognition. In: ACL/IJCNLP (2021)
Song, K., et al.: Using customer service dialogues for satisfaction analysis with context-assisted multiple instance learning. In: EMNLP-IJCNLP (2019)
Yao, R., et al.: Session-level user satisfaction prediction for customer service chatbot in e-commerce (student abstract). In: AAAI (2020)
Song, K., Gao, W., Chen, L., Feng, S., Wang, D., Zhang, C.: Build emotion lexicon from the mood of crowd via topic-assisted joint non-negative matrix factorization. In: SIGIR (2016)
Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. In: IJCAI (2017)
Song, K., Feng, S., Gao, W., Wang, D., Yu, G., Wong, K.: Personalized sentiment classification based on latent individuality of microblog users. In: IJCAI (2015)
Yang, J., Yang, R., Wang, C., Xie, J.: Multi-entity aspect-based sentiment analysis with context, entity and aspect memory. In: AAAI (2018)
Cerisara, C., Jafaritazehjani, S., Oluokun, A., Le, H.T.: Multi-task dialog act and sentiment recognition on mastodon. In: COLING (2018)
Majumder, N., Poria, S., Hazarika, D., Mihalcea, R., Gelbukh, A.F., Cambria, E.: DialogueRNN: an attentive RNN for emotion detection in conversations. In: EAAI (2019)
Yang, Z., Li, B., Zhu, Y., King, I., Levow, G., Meng, H.: Collaborative filtering model for user satisfaction prediction in spoken dialog system evaluation. In: SLT (2010)
Jiang, J., et al.: Automatic online evaluation of intelligent assistants. In: WWW (2015)
Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: EMNLP (2014)
Kachuee, M., Yuan, H., Kim, Y.B., Lee, S.: Self-supervised contrastive learning for efficient user satisfaction prediction in conversational agents. In: NAACL-HLT (2021)
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: NAACL-HLT (2019)
Xu, Y., Zhao, H.: Dialogue-oriented pre-training. In: Findings of the Association for Computational Linguistics: ACL/IJCNLP (2021)
Acknowledgments
This work was supported in part by the National Natural Science Foundation of China (Grant Nos. U1636211, 61672081, 61370126), and the Fund of the State Key Laboratory of Software Development Environment (Grant No. SKLSDE-2021ZX-18).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, Z. et al. (2023). DialCSP: A Two-Stage Attention-Based Model for Customer Satisfaction Prediction in E-commerce Customer Service. In: Amini, MR., Canu, S., Fischer, A., Guns, T., Kralj Novak, P., Tsoumakas, G. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2022. Lecture Notes in Computer Science(), vol 13715. Springer, Cham. https://doi.org/10.1007/978-3-031-26409-2_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-26409-2_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-26408-5
Online ISBN: 978-3-031-26409-2
eBook Packages: Computer ScienceComputer Science (R0)