Skip to main content

Dialogue Intent Classification with Long Short-Term Memory Networks

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10619))

Abstract

Dialogue intent analysis plays an important role for dialogue systems. In this paper, we present a deep hierarchical LSTM model to classify the intent of a dialogue utterance. The model is able to recognize and classify user’s dialogue intent in an efficient way. Moreover, we introduce a memory module to the hierarchical LSTM model, so that our model can utilize more context information to perform classification. We evaluate the two proposed models on a real-world conversational dataset from a Chinese famous e-commerce service. The experimental results show that our proposed model outperforms the baselines.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Austin, J.L., Gu, Y.: How to Do Things With Words. Clarendon Press, Oxford (2012)

    Google Scholar 

  2. Liu, C., Xu, P., Sarikaya, R.: Deep Contextual Language Understanding in Spoken Dialogue Systems (2015)

    Google Scholar 

  3. Shen, L., Zhang, J.: Empirical Evaluation of RNN Architectures on Sentence Classification Task (2016)

    Google Scholar 

  4. Bub, T., Schwinn, J.: VERBMOBIL: The Evolution of a Complex Large Speech-to-Speech Translation System, vol. 4, pp. 2371–2374, October 1996

    Google Scholar 

  5. Surendran, D., Levow, G.A.: Dialog act tagging with support vector machines and hidden Markov models. In: Proceedings of INTERSPEECH/ICSLP, pp. 1–28 (2006)

    Google Scholar 

  6. Ali, S.A., Sulaiman, N., Mustapha, A., Mustapha, N.: Improving accuracy of intention-based response classification using decision tree. Inf. Technol. J. 8(6), 923–928 (2009)

    Article  Google Scholar 

  7. Keizer, S.: Dialogue Act Modelling Using Bayesian Networks (2001)

    Google Scholar 

  8. Niimi, Y., Oku, T., Nishimoto, T., Araki, M.: A rule based approach to extraction of topics and dialog acts in a spoken dialog system. In: EUROSPEECH 2001 Scandinavia, European Conference on Speech Communication and Technology, INTERSPEECH Event, Aalborg, Denmark, September, pp. 2185–2188 (2001)

    Google Scholar 

  9. Henderson, M., Thomson, B., Young, S.: Word-based dialog state tracking with recurrent neural networks. In: Meeting of the Special Interest Group on Discourse and Dialogue, pp. 292–299 (2014)

    Google Scholar 

  10. Khanpour, H., Guntakandla, N., Nielsen, R.: Dialogue act classification in domain-independent conversations using a deep recurrent neural network. In: COLING (2016)

    Google Scholar 

  11. Weston, J., Chopra, S., Bordes, A.: Memory networks. Eprint Arxiv (2014)

    Google Scholar 

  12. Peng, B., Yao, K., Jing, L., Wong, K.-F.: Recurrent neural networks with external memory for spoken language understanding. In: Li, J., Ji, H., Zhao, D., Feng, Y. (eds.) NLPCC 2015. LNCS (LNAI), vol. 9362, pp. 25–35. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25207-0_3

    Chapter  Google Scholar 

  13. Sukhbaatar, S., Szlam, A., Weston, J., Fergus, R.: End-to-end memory networks. Comput. Sci. (2015)

    Google Scholar 

  14. Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., Socher, R.: Ask me anything: dynamic memory networks for natural language processing. Comput. Sci. 1378–1387 (2015)

    Google Scholar 

  15. Mikolov, T., Karafiát, M., Burget, L., Cernocký, J., Khudanpur, S.: Recurrent neural network based language model. In: INTERSPEECH 2010, Conference of the International Speech Communication Association, Makuhari, Chiba, Japan, September, pp. 1045–1048 (2010)

    Google Scholar 

  16. Deng, L.Y.: The cross-entropy method: a unified approach to combinatorial optimization, Monte-Carlo simulation, and machine learning. Technometrics 48(1), 147–148 (2006)

    Article  Google Scholar 

  17. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. Comput. Sci. (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lian Meng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Meng, L., Huang, M. (2018). Dialogue Intent Classification with Long Short-Term Memory Networks. In: Huang, X., Jiang, J., Zhao, D., Feng, Y., Hong, Y. (eds) Natural Language Processing and Chinese Computing. NLPCC 2017. Lecture Notes in Computer Science(), vol 10619. Springer, Cham. https://doi.org/10.1007/978-3-319-73618-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73618-1_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73617-4

  • Online ISBN: 978-3-319-73618-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics