Abstract
This paper reports the performance of Language Computer Corporation’s natural language logic prover for the English and Spanish subtasks of the Answer Validation Exercise. Cogex takes as input a pair of plain English text snippets, transforms them into semantically rich logic forms, automatically generates natural language axioms which will be used during the search for a proof, and determines the degree of entailment between the entailing text snippet and a possible relaxed version of the entailed text. The system labels an input pair as positive entailment if its proof score is above the threshold learned during training. Our semantic logic-based approach achieves 43.93% F-measure for the English data and 60.63% on Spanish.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Allen, J.: Time and Time Again: The Many Ways to Represent Time. Internatinal Journal of Intelligent Systems 4(6), 341–355 (1991)
Bar-Haim, R., Dagan, I., Dolan, B., Ferro, L., Giampiccolo, D., Magnini, B., Szpektor, I.: The Second PASCAL Recognising Textual Entailment Challenge. In: Proceedings of the Second PASCAL Challenges Workshop (2006)
Bos, J., Markert, K.: Recognizing Textual Entailment with Logical Inference. In: Proceedings of HLT/EMNLP 2005, Vancouver, Canada (October 2005)
de Salvo Braz, R., Girju, R., Punyakanok, V., Roth, D., Sammons, M.: An Inference Model for Semantic Entailment in Natural Language. In: Proceedings of AAAI 2005 (2005)
Koehn, P.: Europarl: A Parallel Corpus for Statistical MT. In: MT Summit (2005)
Koehn, P., Och, F.J., Marcu, D.: Statistical Phrase-based Translation. In: Proceedings of HLT/NAACL, Edmonton, Canada (2005)
McCune, W.W.: OTTER 3.0 Reference Manual and Guide (1994)
Moldovan, D., Clark, C., Harabagiu, S.: Temporal Context Representation and Reasoning. In: Proceedings of IJCAI, Edinburgh, Scotland (2005)
Moldovan, D., Clark, C., Harabagiu, S., Maiorano, S.: COGEX A Logic Prover for Question Answering. In: Proceedings of the HLT/NAACL (2003)
Moldovan, D., Novischi, A.: Lexical chains for Question Answering. In: Proceedings of COLING, Taipei, Taiwan (August 2002)
Moldovan, D., Rus, V.: Logic Form Transformation of WordNet and its Applicability to Question Answering. In: Proceedings of ACL, France (2001)
Olteanu, M., Suriyentrakorn, P., Moldovan, D.: Language Models and Reranking for Machine Translation. In: Proceedings of the NAACL Workshop On Statistical Machine Translation (2006)
Tatu, M., Iles, B., Slavick, J., Novischi, A., Moldovan, D.: COGEX at the Second Recognizing Textual Entailment Challenge. In: Proceedings of the Second PASCAL Challenges Workshop (2006)
Tatu, M., Moldovan, D.: A Semantic Approach to Recognizing Textual Entailment. In: Proceedings of HLT/EMNLP (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tatu, M., Iles, B., Moldovan, D. (2007). Automatic Answer Validation Using COGEX. In: Peters, C., et al. Evaluation of Multilingual and Multi-modal Information Retrieval. CLEF 2006. Lecture Notes in Computer Science, vol 4730. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74999-8_59
Download citation
DOI: https://doi.org/10.1007/978-3-540-74999-8_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74998-1
Online ISBN: 978-3-540-74999-8
eBook Packages: Computer ScienceComputer Science (R0)