Abstract
Dialogue State Tracking is one of the most important component in task-oriented dialog system, which can update the dialogue state and accurately estimate the compact state representation. This paper introduces a multi-level feature combination to capture correlation on the basis of the entire dialog and slots. Based on the Memory-Network [1], which only consider the relevance of current user utterance with historical dialogue context under turn level, we both consider the correlation at the sentence-level and word-level, and give the slot-value pair as input replacing of candidate state pool to estimate the rare slot-value pair. We use Bi-LSTM and self-attention to capture the correlation between internal words from the utterance, the particular slot-value pair and previous unsettled actions, and finally give a confidence degree score to judge whether the particular slot-value pair is the right answer for the current utterance. Our model achieves a good result on the DSTC-2 dataset about 0.74, which is 3% higher than Memory-Network’s 0.71.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Perez, J., Liu, F.: Dialog state tracking, a machine reading approach using memory network. arxiv (2017)
Yoshino, K., Hiraoka, T., Neubig, G., Nakamura, S.: Dialogue state tracking using long short term memory neural networks. arxiv (2014)
Henderson, M., Thomson, B., Young, S.J.: Word-based dialog state tracking with recurrent neural networks. In: Proceedings of SIGDIAL (2014)
Mrksic, N., Seaghdha, D.O.S., Wen, T.H.., Thomson, B., Young, S.J.: Neural belief tracker: data-driven dialogue state tracking. In: Proceedings of ACL (2017)
Serban, I.V., Sordoni, A., Bengio, Y., Courville, A., Pineau, J.: Building end-to-end dialogue systems using generative hierarchical neural network models. arxiv (2015)
Madotto, A., Wu, C., Fung, P.: Mem2Seq: effectively incorporating knowledge bases into end-to-end task-oriented dialog systems. arxiv (2018)
Li, X., Chen, Y., Li, L., Gao, J., Celikyilmaz, A.: End-to-end task-completion neural dialogue systems. arxiv (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zheng, Y., Liu, R., Gao, S. (2020). Multi-level Feature Combination in Dialogue State Tracking. In: Liu, Y., Wang, L., Zhao, L., Yu, Z. (eds) Advances in Natural Computation, Fuzzy Systems and Knowledge Discovery. ICNC-FSKD 2019. Advances in Intelligent Systems and Computing, vol 1074. Springer, Cham. https://doi.org/10.1007/978-3-030-32456-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-32456-8_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32455-1
Online ISBN: 978-3-030-32456-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)