Abstract
This paper introduces a collection of inference problems intended for use in evaluation of semantic theories and semantic processing systems for Japanese. The problem set categorizes inference problems according to semantic phenomena that they involve, following the general policy of the FraCaS test suite. It consists of multilingual and Japanese subsets, which together cover both universal semantic phenomena and Japanese-specific ones. This paper outlines the design policy used in constructing the problem set and the contents of a beta version, currently available online.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abzianidze, L.: Towards a wide-coverage tableau method for natural logic. In: Murata, T., Mineshima, K., Bekki, D. (eds.) JSAI-isAI 2014. LNCS (LNAI), vol. 9067, pp. 66–82. Springer, Heidelberg (2015). doi:10.1007/978-3-662-48119-6_6
Bentivogli, L., Cabrio, E., Dagan, I., Giampiccolo, D., Leggio, M.L., Magnini, B.: A methodology for isolating linguistic phenomena relevant to inference. In: Proceedings of LREC 2010, pp. 3544–3549, Valletta, Malta (2010)
Bos, J.: Let’s not argue about semantics. In: Proceedings of the 6th Language Resources and Evaluation Conference (LREC 2008), pp. 2835–2840. Marrakech, Morocco (2008)
Chierchia, G., McConnell-Ginet, S.: Meaning and Grammar: An Introduction to Semantics. MIT Press, Cambridge (2000)
Cooper, R., Crouch, D., van Eijck, J., Fox, C., van Genabith, J., Jan, J., Kamp, H., Milward, D., Pinkal, M., Poesio, M., Pulman, S., Briscoe, T., Maier, H., Konrad, K.: Using the framework. Technical report, FraCaS: A Framework for Computational Semantics. FraCaS Deliverable D16 (1996)
Cabrio, E., Magnini, B.: Decomposing semantic inferences. In: Condoravi, C., Zaenen, A. (eds.) Linguistic Issues in Language Technology (LiLT), vol. 9(1). Special Issue on The Semantics of Entailment (2013)
Dagan, I., Glickman, O., Magnini, B.: The PASCAL recognising textual entailment challenge. In: Quiñonero-Candela, J., Dagan, I., Magnini, B., d’Alché-Buc, F. (eds.) MLCW 2005. LNCS (LNAI), vol. 3944, pp. 177–190. Springer, Heidelberg (2006). doi:10.1007/11736790_9
Grice, P.: Studies in the Way of Words. Harvard University Press, Cambridge (1989)
Kadmon, N.: Formal Pragmatics. Blackwell, Oxford (2001)
Kotani, M., Shibata, T., Nakata, T., Kurohashi, S.: Building textual entailment Japanese data sets and recognizing reasoning relations based on synonymy acquired automatically. In: Proceedings of the 14th Annual Meeting of the Association for Natural Language Processing, Tokyo, Japan (2008)
Kuno, S.: Danwa no Bunpoo [grammar of discourse]. Taishukan, Tokyo (1978)
Levinson, S.C.: Presumptive Meanings: The theory of generalized conversational Implicature. MIT Press, Cambridge (2000)
Lewis, M., Steedman, M.: Combining distributional and logical semantics. Trans. Assoc. Comput. Linguist. 1, 179–192 (2013)
MacCartney, B., Manning, C.D.: Natural logic for textual inference. In: Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing, pp. 193–200 (2007)
MacCartney, B., Manning, C.: Modeling semantic containment and exclusion in natural language inference. In: The 22nd International Conference on Computational Linguistics (Coling 2008), Manchester, UK (2008)
Mineshima, K., MartÃnez-Gómez, P., Miyao, Y., Bekki, D.: Higher-order logical inference with compositional semantics. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), Lisbon, Portugal, pp. 2055–2061 (2015)
Potts, C.: The Logic of Conventional Implicatures. Oxford University Press (2005). Sammons 2010 Sammons, M., Vinod Vydiswaran, V.G., Roth, D.: Ask not what textual entailment can do for you.... In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics:1199–1208, Uppsala, Sweden (2010)
Tian, R., Miyao, Y., Matsuzaki, T.: Logical inference on dependency-based compositional semantics. In: Proceedings of ACL, pp. 79–89 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Kawazoe, A., Tanaka, R., Mineshima, K., Bekki, D. (2017). An Inference Problem Set for Evaluating Semantic Theories and Semantic Processing Systems for Japanese. In: Otake, M., Kurahashi, S., Ota, Y., Satoh, K., Bekki, D. (eds) New Frontiers in Artificial Intelligence. JSAI-isAI 2015. Lecture Notes in Computer Science(), vol 10091. Springer, Cham. https://doi.org/10.1007/978-3-319-50953-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-50953-2_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-50952-5
Online ISBN: 978-3-319-50953-2
eBook Packages: Computer ScienceComputer Science (R0)