Abstract
We propose a new method that uses the Hierarchical Dirichlet Process (HDP) to classify a large number of answer types for a question posed using natural language. We used the HDP model to build a classifier that assigns test questions to certain clusters, then computes similarity among the questions within the same cluster. Our answer-type classifier finds the n-best similar training questions to the test questions and classifies the test question’s answer type as the majority of the n-best training question’s answer type. The proposed method achieved similar accuracy and lower sensitivity to the presence of a large number of answer types than existing methods that use classification algorithms with same features. Also, we can guarantee that appropriate answer type can be among the ranked answer types with high recall.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Harabagiu, S.M., Maiorano, S.J., Pasca, M.A.: Open-Domain Textual Question Answering Techniques. Natural Language Engineering 9, 231–267 (2003), http://journals.cambridge.org/abstract_S1351324903003176
Kolomiyets, O., Moens, M.F.: A Survey on Question Answering Technology from an Information Retrieval Perspective, Information Science (2009), http://hmi.ucsd.edu/pdf/HMI_2009_
Ntoulas, A., Cho, J.H., Olston, C.: What’s New on the Web? The Evolution of the Web from a Search Engine Perspective. In: Proceedings of the 13th International Conference on World Wide Web (2004)
Moldovan, D., Harabagiu, S., Pasca, M., Mihalcea, R., Goodrum, R., Girju, R., Rus, V.: Lasso: A Tool for Surfing the Answer net. In: 8th Text REtrieval Conference (1999)
Harabagiu, S., Moldovan, D., Pasca, M., Mihalcea, R., Surdeanu, M., Bunescu, R., Girju, R., Rus, V., Morarescu, P.: Falcon: Boosting knowledge for Answer Engines. In: 9th Text Retrieval Conference (2000)
Lee, G.G., Seo, J.Y., Lee, S.W., Jung, H.M., Cho, B.Y., Lee, C.K., Kwak, B.K., Cha, J.W., Kim, D.S., An, J.H., Kim, H.S., Kim, K.S.: SiteQ: Engineering High performance QA System using Lexico-Semantic Pattern matching and shallow NLP. In: 10th Text Retrieval Conference (2001)
Zhang, D.,, W.: S Lee.: Question Classification using Support Vector Machine, SIGIR (2003)
Huang, Z., Thint, M., Celiylimaz, A.: Investigation of Question Classification in Question Answering, ACL and AFNLP (2009)
Babak, L., Gijs, V.T., Pascal, W., Tax, D., Marco, L.: Question Classification by Weighted Combination of Lexical, Syntactic and Semantic Features, Text-Speech and Dialogue (2011)
K.Vijay, D. Sujatha and C. Soumen.: Enhanced Answer Type Inference from Questions Using Sequential Models. In: Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, Association for Computational Linguistics (2005)
Xin, L., Dan, R.: Learning Question Classifier. In: Proceedings of the 19th International Conference on Computational Linguistics, vol. 1 (2002)
Murdock, J.W., Kalyanpur, A., Welty, C., Fan, J., Ferrucci, D.A., Gondek, D.C., Zhang, L., Kanayama, H.: Typing Candidate Answers Using Type Coercion. IBM Journal (2012)
Teh, Y.W., Jordan, M.I., Beal, M.J., Blei, D.M.: Hierarchical Dirichlet Process. Journal of the American Statistical Association (2006)
Schlaefer, N., Ko, J., Betteridge, J., Sautter, G., Pathak, M., Nyberg, E.: Semantic Extensions of the Ephyra QA system for TREC 2007. In: 16th Text Retrieval Conference (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Park, S. et al. (2014). Hierarchical Dirichlet Process Topic Modeling for Large Number of Answer Types Classification in Open domain Question Answering. In: Jaafar, A., et al. Information Retrieval Technology. AIRS 2014. Lecture Notes in Computer Science, vol 8870. Springer, Cham. https://doi.org/10.1007/978-3-319-12844-3_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-12844-3_36
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12843-6
Online ISBN: 978-3-319-12844-3
eBook Packages: Computer ScienceComputer Science (R0)