Abstract
Recognition of user intent from web queries is required by search engines to improve user experience by adapting search results to the user goals. In this paper we report findings of intent recognition from search queries, using two intent annotated benchmark datasets, ATIS and AOL web query dataset. Both these corpora have been automatically translated from English to Urdu. Through multiple experiments, we analyze and compare performance of four Deep Neural Network (DNN) based models and their architectures, i.e. CNN, LSTM, bi-directional LSTM, and CLSTM (CNN+LSTM). On ATIS dataset, CNN achieves 92.4% accuracy on binary classification. While on AOL dataset, BLSTM performs the best with 83.1% accuracy for 5% test sample proportion for 3 intent classes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Jansen, B.J., Booth, D.: Classifying web queries by topic and user intent. In: Extended Abstracts on Human Factors in Computing Systems, CHI 2010, pp. 4285–4290. ACM, Atlanta (2010)
Urooj, S., Shams, S., Hussain, S., Adeeba, F.: Sense tagged CLE Urdu digest corpus. In: Proceedings of Conference on Language and Technology (CLT 14), Karachi, Pakistan (2014)
Ashkan, A., Clarke, C.L.A., Agichtein, E., Guo, Q.: Classifying and characterizing query intent. In: Boughanem, M., Berrut, C., Mothe, J., Soule-Dupuy, C. (eds.) ECIR 2009. LNCS, vol. 5478, pp. 578–586. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00958-7_53
Mendoza, M., Zamora, J.: Identifying the intent of a user query using support vector machines. In: Karlgren, J., Tarhio, J., Hyyrö, H. (eds.) SPIRE 2009. LNCS, vol. 5721, pp. 131–142. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03784-9_13
Calderón-Benavides, L., González-Caro, C., Baeza-Yates, R.: Towards a deeper understanding of the user’s query intent. In: Workshop on Query Representation and Understanding, SIGIR 2010, Geneva, Switzerland (2010)
González-Caro, C., Baeza-Yates, R.: A multi-faceted approach to query intent classification. In: Grossi, R., Sebastiani, F., Silvestri, F. (eds.) SPIRE 2011. LNCS, vol. 7024, pp. 368–379. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-24583-1_36
Ren, P., Chen, Z., Song, X., Li, B., Yang, H., Ma, J.: Understanding temporal intent of user query based on time-based query classification. In: Zhou, G., Li, J., Zhao, D., Feng, Y. (eds.) NLPCC 2013. CCIS, vol. 400, pp. 334–345. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41644-6_31
Hashemi, H.B., Asiaee, A.H., Kraft, R.: Query intent detection using convolutional neural networks (2016)
Shi, Y., Yao, K., Tian, L., Jiang, D.: Deep LSTM based feature mapping for query classification. In: North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1501–1511. Association of Computational Linguistics, San Diego (2016)
Ravuri, S., Stolcke, A.: Recurrent neural network and LSTM models for lexical utterance classification. In: INTERSPEECH (2015)
Ravuri, S., Stolcke, A.: A comparative study of neural network models for lexical intent classification, pp. 368–374 (2015)
Zhou, C., Sun, C., Liu, Z., Lau, F.: A C-LSTM neural network for text classification. CoRR, abs/1511.08630 (2015)
Broder, A.: A taxonomy of web search. SIGIR Forum 36(2), 3–10 (2002)
Lee, U., Liu, Z., Cho, J.: Automatic identification of user goals in web search. In: Proceedings of the 14th International Conference on World Wide Web, pp. 391–400. ACM, Chiba (2005)
Carlos, C.S., Yalamanchi, M.: Intention analysis for sales, marketing and customer service. In: COLING (2012)
Song, I., Diederich, J.: Intention extraction from text messages. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds.) ICONIP 2010. LNCS, vol. 6443, pp. 330–337. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-17537-4_41
Zhang, H., Song, W., Liu, L., Du, Ch., Zhao, X.: Query classification using convolutional neural networks. In: 10th International Symposium on Computational Intelligence and Design (ISCID), pp. 441–444 (2017)
Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1746–1751. Association for Computational Linguistics, Doha (2014)
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. CoRR, abs/1103.0398 (2011)
Kim, J., Tur, G., Celikyilmaz, A., Cao, B., Wang, Y.: Intent detection using semantically enriched word embeddings. In: 2016 IEEE Spoken Language Technology Workshop (SLT), San Diego, CA, pp. 414–419 (2016)
Fang, I.-T.: Deep learning for query semantic domains classification. In: Annual Conference on Neural Information Processing Systems (NIPS). Microsoft, (2017)
Sreelakshmi, K., Rafeeque, P.C., Sreetha, S., Gayathri, E.S.: Deep bi-directional LSTM network for query intent detection. Proc. Comput. Sci. 143, 939–946 (2018)
Syed, A.Z., Aslam, M., Martinez-Enriquez, A.M.: Associating targets with SentiUnits: a step forward in sentiment analysis of Urdu text. Artif. Intell. Rev. 41(4), 535–561 (2014)
Basit, R.H., Aslam, M., Martinez-Enriquez, A.M., Syed, A.Z.: Semantic similarity analysis of Urdu documents. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Olvera-López, J.A. (eds.) MCPR 2017. LNCS, vol. 10267, pp. 234–243. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59226-8_23
Malik, M.K.: Urdu named entity recognition and classification system using artificial neural network. ACM Trans. Asian Low-Resour. Lang. Inf. Process. 17(1), 1–13 (2017)
Ali, A.R., Ijaz, M.: Urdu text classification. In: Proceedings of the 7th International Conference on Frontiers of Information Technology, pp. 1–7. ACM, Abbottabad (2009)
Adeeba, F., Hussain, S., Akram, Q.: Urdu text genre identification. In: Conference on Language and Technology (CLT 2016), Lahore, Pakistan (2016)
Pass, G., Chowdhury, A., Torgeson, C.: A picture of search. In: Proceedings of the 1st International Conference on Scalable Information Systems, p. 1. ACM, Hong Kong (2006)
Figueroa, A.: Exploring effective features for recognizing the user intent behind web queries. Comput. Ind. 68(C), 162–169 (2015)
Yao, K., Peng, B., Zhang, Y., Yu, D., Zweig, G., Shi, Y.: Spoken language understanding using long short-term memory neural networks. In: 2014 IEEE Spoken Language Technology Workshop (SLT), South Lake Tahoe, NV, pp. 189–194 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Shams, S., Aslam, M., Martinez-Enriquez, A.M. (2019). Lexical Intent Recognition in Urdu Queries Using Deep Neural Networks. In: Martínez-Villaseñor, L., Batyrshin, I., Marín-Hernández, A. (eds) Advances in Soft Computing. MICAI 2019. Lecture Notes in Computer Science(), vol 11835. Springer, Cham. https://doi.org/10.1007/978-3-030-33749-0_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-33749-0_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33748-3
Online ISBN: 978-3-030-33749-0
eBook Packages: Computer ScienceComputer Science (R0)