Abstract
This paper presents two user interfaces for a pattern-based User Interactive Question Answering system, which are designed to encourage users to ask questions by using semantic patterns. One is a Guide-Based User Interface (GBUI), which can guide users with clear instructions. However, it involves many steps and the operation may become tedious. The other is a Recommendation-Based User Interface (RBUI), which recommends a few relevant patterns containing automatically suggested details for each free-text question. However, the recommended patterns may not always be satisfactory and sometimes the user’s revision is needed. In comparing these two user interfaces, we propose a new Complexity Evaluation Model (CEM) to evaluate the complexity on the basis of user log study and a realistic focused user study. The results of the study user logs, which cover a test set of 1605 users and 488 semantic patterns, show that RBUI can improve the complexity of GBUI by 39.8% on average. The improvement is also confirmed by the user study. It has thus become clear that RBUI can improve the usability of the UIQA system in terms of helping the system accumulate high quality pattern-based questions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baidu Knows, http://zhidao.baidu.com (last accessed at 2011)
Adamic, L.A., Zhang, J., Bakshy, E., Ackerman, M.S.: Knowledge sharing and yahoo answers: everyone knows something. In: Proceeding of WWW, Beijing, China (2008)
Ravichandran, D., Hovy, E.: Learning Surface Text Patterns for a Question Answering System. In: Proceedings of the 40th ACL Conference, Philadelphia (2002)
Hovy, E., Hermjakob, U., Ravichandran, D.: A Question/Answer Typology with Surface Text Patterns. In: Proceedings of the 40th ACL Conference, Philadelphia (2002)
Roussinov, D., Robles, J.: Web Question Answering Through Automatically Learned Patterns. In: Proceedings of the Joint Conference on Digital Libraries, Tucson (2004)
Narayanan, S., Harabagiu, S.: Question Answering Based on Semantic Structures. In: Proceedings of the International Conference on Computational Linguistics, Geneva (2004)
Sneiders, E.: Automated Question Answering Using Question Templates that Cover the Conceptual Model of the Database. In: Proceedings of NLDB, Stockholm (2002)
Hao, T.Y., Hu, D.W., Liu, W.Y., Zeng, Q.T.: Semantic Patterns for User-interactive Question Answering. Journal of Concurrency and Computation-practice & Experience 20(7), 783–799 (2007)
Wu, M., Zheng, X.Y., Michelle, D., Liu, T., Strzalkowski, T.: Question Answering By Pattern Matching, Web-Proofing, Semantic Form Proofing. In: The Twelfth TREC, pp. 578–585 (2003)
Liu, W.Y., Hao, T.Y., Chen, W., Feng, M.: A Web-based Platform for User-Interactive Question-Answering. Journal of World Wide Web 12(2), 107–124 (2009)
BuyAns, http://www.buyans.com (last accessed at 2011)
Saiz-Noeda, M., Suarez, A., Palomar, M.: Semantic Pattern Learning Through Maximum Entropy-based WSD Technique. In: Proceedings of CLL, Toulouse (2001)
Staab, S., Erdmann, M., Maedche, A.: Engineering Ontologies Using Semantic Patterns. In: Proceedings of the IJCAI 2001, Seattle, USA (2001)
Greenwood, M.A., Saggion, H.: A Pattern Based Approach to Answering Factoid, List and Definition Questions. In: Proceedings of the 7th RIAO, Avignon, France (2004)
Sneiders, E.: Automated Question Answering: Pattern-Based Approach. PhD Thesis, Department of Computer and Systems Sciences, Stockholm University, Sweden (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hao, T., Liu, W., Zhu, C. (2012). Semantic Pattern-Based User Interactive Question Answering: User Interface Design and Evaluation. In: Huang, DS., Gan, Y., Gupta, P., Gromiha, M.M. (eds) Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence. ICIC 2011. Lecture Notes in Computer Science(), vol 6839. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25944-9_47
Download citation
DOI: https://doi.org/10.1007/978-3-642-25944-9_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25943-2
Online ISBN: 978-3-642-25944-9
eBook Packages: Computer ScienceComputer Science (R0)