Skip to main content
SpringerLink
Log in

Using Syntactic-Based Kernels for Classifying Temporal Relations

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Temporal relation classification is one of contemporary demanding tasks of natural language processing. This task can be used in various applications such as question answering, summarization, and language specific information retrieval. In this paper, we propose an improved algorithm for classifying temporal relations, between events or between events and time, using support vector machines (SVM). Along with gold-standard corpus features, the proposed method aims at exploiting some useful automatically generated syntactic features to improve the accuracy of classification. Accordingly, a number of novel kernel functions are introduced and evaluated. Our evaluations clearly demonstrate that adding syntactic features results in a considerable improvement over the state-of-the-art method of classifying temporal relations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Mani I, Marc V, Wellner B, Lee C, Pustejovsky J. Machine learning of temporal relations. In Proc. ACL 2006, Sydney, Australia, Jul. 17-21, 2006, pp. 753–760.

  2. Tatu M, Srikanth M. Experiments with reasoning for temporal relations between events. In Proc. Coling 2008, Manchester, UK, Aug. 18-22, 2008, pp. 857–864.

  3. Allen J F. Towards a general theory of action and time. Artificial Intelligence, 1984, 23(2): 123–154.

    Article  MATH  Google Scholar 

  4. Pustejovsky J, Hanks P, Sauri R, See A, Gaizauskas R, Setzer A, Radev D, Sundheim B, Day D, Ferro L, Lazo M. The TimeBank corpus. In Proc. Corpus Linguistics, Lancaster, UK, Mar. 28-31, 2003, pp. 647–656.

  5. Chklovski T, Pantel P. Global path-based refinement of noisy graphs applied to verb semantics. In Proc. IJCNLP 2005, Jeju Island, Korea, Oct. 11-13, 2005, pp. 792–803.

  6. Torisawa K. Acquiring inference rules with temporal constraints by using Japanese coordinated sentences and nounverb co-occurrences. In Proc. HLT NAACL 2006, Main conference, New York City, USA, Jun. 4-9, 2006, pp. 57–64.

  7. Inui T, Inui K, Matsumoto Y. What kinds and amounts of causal knowledge can be acquired from text by using connective markers as clues? In Proc. 6th International Conference on Discovery Science, Sapporo, Japan, Oct. 17-19, 2003, pp. 180–193.

  8. Zanaotto F M, Pennacchiotti M, Pazienza M T. Discovering asymmetric entailment relations between verbs using selectional preferences. In Proc. ACL 2006, Sydney, Australia, Jul. 17-21, 2006, pp. 849–856.

  9. Chambers N, Wang S, Jurafsky D. Classifying temporal relations between events. In Proc. ACL 2007, Prague, Czech, Jun. 23-30, 2007, pp. 173–176.

  10. Bethard S, Martin J H. Learning semantic links from a corpus of parallel temporal and causal relations. In Proc. ACL 2008, Columbus, USA, Jun. 15-20, 2008, pp. 177–180.

  11. Bethard S, Corvey W, Klingenstein S, Martin J H. Building a corpus of temporal-causal structure. In Proc. Language Resources and Evaluation Conference (LREC2008), Morroco, May 28-30, 2008, pp. 908–915.

  12. Bethard S, Martin J H, Klingenstein S. Finding temporal structure in text: Machine learning of syntactic temporal relations. International Journal of Semantic Computing (IJSC), Dec. 2007, 1(4): 441–457.

    Article  Google Scholar 

  13. Lapata M, Lascarides A. Learning sentence-internal temporal relations. Journal of Artificial Intelligence Research, 2006, 27: 85–117.

    MATH  Google Scholar 

  14. Bethard S, Martin J H, Klingenstein S. Timelines from text: Identification of syntactic temporal relations. In Proc. ICSC, Irvine, USA, Sept. 17-19, 2007, pp. 11–18.

  15. Savova G, Bethard S, Styler W, Martin J H, Palmer M, Masanz J,Ward W. Towards temporal relation discovery from the clinical narrative. In Proc. American Medical Informatics Association, San Francisco, USA, Nov. 14-18, 2009, pp. 568–572.

  16. Lapata, M. Lascarides A. Inferring sentence-internal temporal relations. In Proc. NAACL 2004, Boston, USA, May 2-7, pp. 153–160.

  17. Bethard S, Martin J H. CU-TMP: Temporal relation classification using syntactic and semantic features. In Proc. SemEval 2007, Prague, Czech, Jun. 23-24, 2007, pp. 129–163.

  18. Chambers N, Jurafsky D. Jointly combining implicit constraints improves temporal ordering. In Proc. EMNLP2008, Hawaii, USA, Oct. 25-27, 2008, pp. 698–706.

  19. Puscasu G. Wvali: Temporal relation identification by syntactico-semantic analysis. In Proc. SemEval 2007, Prague, Czech, Jun. 23-24, pp. 484–487.

  20. Bramsen P, Deshpande P, Lee Y K, Barzilay R. Inducing temporal graphs. In Proc. EMNLP2006, Sydney, Australia, Jul. 22-23, 2006, pp. 189–198.

  21. Boguraev B, Ando K. Timeml-compliant text analysis for temporal reasoning. In Proc. IJCAI 2005, Edinburgh, UK, Jul. 30-Aug. 5, 2005, pp. 997–1003.

  22. Bethard S. Finding event, temporal and causal structure in text: A machine learning approach [Ph.D. Dissertation]. University of Colorado at Boulder, 2007.

  23. Mirroshandel S A, Khayyamian M, Ghassem-Sani G R. Using tree kernels for classifying temporal relations between events. In Proc. PACLIC 2009, Hong Kong, China, Dec. 3-5, 2009, pp. 355–364.

  24. Mirroshandel S A, Khayyamian M, Ghassem-Sani G R. Event-time temporal relation classification using syntactic tree kernels. In Proc. the 4th Language and Technology Conference (LTC2009), Poznan, Poland, Nov. 6-8, 2009, pp. 300–304.

  25. Abe S, Inui K, Matsumoto Y. Two-phased event relation acquisition coupling the relation-oriented and argument-oriented approaches. In Proc. Coling 2008, Manchester, UK, Aug. 18-22, 2008, pp. 1–8.

  26. Harris Z. Mathematical Structure of Language. New York: John Wiley & Sons, 1968.

    Google Scholar 

  27. Lin D, Pantel P. DIRT — Discovery of inference rules from text. In Proc. the 7th ACM SIGKDD, San Francisco, USA, Aug. 26-29, 2001, pp. 323–328.

  28. Szpektor I, Tanev H, Dagan I. Scaling Web-based acquisition of entailment relations. In Proc. EMNLP2004, Barcelona, Spain, Jul. 25-26, 2004, pp. 41–48.

  29. Pekar V. Acquisition of verb entailment from text. In Proc. HLT NAACL Main Conference, New York, USA, Jun. 4-9, 2006, pp. 49–56.

  30. Torisawa K. Acquiring inference rules with temporal constraints by using Japanese coordinated sentences and noun-verb co-occurrences. In Proc. the Human Language Technology Conference of the NAACL, Main Conference, New York, New York, USA, Jun. 4-9, 2006, pp. 57–64.

  31. Boser B E, Guyon I M, Vapnik V N. A training algorithm for optimal margin classifiers. In Proc. COLT1992, Pittsburgh, USA, Jul. 27-29, 1992, pp. 144–152.

  32. Cortes C, Vapnik V. Support-vector networks. In Proc. Conference of Machine Learning, Tahoe City, USA, Jul. 9-12, 1995, pp. 273–297.

  33. Collins M, Duffy N. Convolution kernels for natural language. In Proc. NIPS 2001, Vancouver, Canada, Dec. 3-8, 2001, pp. 625–632.

  34. Khayyamian M, Mirroshandel, S A, Abolhassani H. Syntactic tree-based relation extraction using a generalization of Collins and Duffy convolution tree kernel. In Proc. HLT NAACL, Boulder USA, May 31-Jun. 5, 2009, pp. 66–71.

  35. Moschitti A. Syntactic kernels for natural language learning: The semantic role labeling case. In Proc. HLT NAACL, New York, USA, Jun. 4-9, 2006, pp. 97–100.

  36. Zhang M, Zhang J, Su J, Zhou G D. A composite kernel to extract relations between entities with both flat and structured features. In Proc. ACL 2006, Sydney, Australia, Jul. 17-21, 2006, pp. 825–832.

  37. Mani I, Wellner B, Verhagen M, Pustejovsky J. Three approaches to learning Tlinks in TimeML. Technical Report, CS-07-268, Brandeis University, Walthan, USA, 2007.

  38. Chang C C, Lin C J. Libsvm: A library for support vector machines. 2001, http://www.csie.ntu.edu.tw/cjlin/libsvm.

  39. The Stanford Natural Language Processing Group, http://nlp.stanford.edu/software/index.shtml.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Sharif University of Technology, Tehran, 11155-9517, Iran

    Seyed Abolghasem Mirroshandel, Gholamreza Ghassem-Sani & Mahdy Khayyamian

Authors
  1. Seyed Abolghasem Mirroshandel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gholamreza Ghassem-Sani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mahdy Khayyamian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seyed Abolghasem Mirroshandel.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Abolghasem Mirroshandel, S., Ghassem-Sani, G. & Khayyamian, M. Using Syntactic-Based Kernels for Classifying Temporal Relations. J. Comput. Sci. Technol. 26, 68–80 (2011). https://doi.org/10.1007/s11390-011-9416-7

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-011-9416-7

Keywords

Search

Navigation