Skip to main content

Relation Classification in Scientific Papers Based on Convolutional Neural Network

  • Conference paper
  • First Online:
Natural Language Processing and Chinese Computing (NLPCC 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11839))

Abstract

Scientific papers are important for scholars to track trends in specific research areas. With the increase in the number of scientific papers, it is difficult for scholars to read all the papers to extract emerging or noteworthy knowledge. Paper modeling can help scholars master the key information in scientific papers, and relation classification (RC) between entity pairs is a major approach to paper modeling. To the best of our knowledge, most of the state-of-the-art RC methods are using entire sentence’s context information as input. However, long sentences have too much noise information, which is useless for classification. In this paper, a flexible context is selected as the input information for convolution neural network (CNN), which greatly reduces the noise. Moreover, we find that entity type is another important feature for RC. Based on these findings, we construct a typical CNN architecture to learn features from raw texts automatically, and use a softmax function to classify the entity pairs. Our experiment on SemEval-2018 task 7 dataset yields a macro-F1 value of 83.91%, ranking first among all participants.

Z. Yin, S. Wu and Y. Yin have equal contribution to this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://nlp.stanford.edu/software/lex-parser.html.

  2. 2.

    https://www.cs.york.ac.uk/nlp/extvec/wiki_extvec.gz.

References

  1. Angeli, G., Tibshirani, J., Wu, J., Manning, C.D.: Combining distant and partial supervision for relation extraction. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1556–1567 (2014)

    Google Scholar 

  2. Bird, S., et al.: The ACL anthology reference corpus: a reference dataset for bibliographic research in computational linguistics (2008)

    Google Scholar 

  3. Guo, J., Che, W., Wang, H., Liu, T., Xu, J.: A unified architecture for semantic role labeling and relation classification. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 1264–1274 (2016)

    Google Scholar 

  4. Hendrickx, I., et al.: Semeval-2010 task 8: multi-way classification of semantic relations between pairs of nominals. In: Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions, pp. 94–99. Association for Computational Linguistics (2009)

    Google Scholar 

  5. Klein, D., Manning, C.D.: Accurate unlexicalized parsing. In: Proceedings of the 41st Annual Meeting of the Association For Computational Linguistics (2003)

    Google Scholar 

  6. Kozareva, Z.: Cause-effect relation learning. In: Workshop Proceedings of TextGraphs-7 on Graph-Based Methods for Natural Language Processing, pp. 39–43. Association for Computational Linguistics (2012)

    Google Scholar 

  7. QasemiZadeh, B., Schumann, A.K.: The ACL RD-TEC 2.0: a language resource for evaluating term extraction and entity recognition methods. In: LREC (2016)

    Google Scholar 

  8. Qin, L., Zhang, Z., Zhao, H.: A stacking gated neural architecture for implicit discourse relation classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 2263–2270 (2016)

    Google Scholar 

  9. Qin, P., Xu, W., Guo, J.: An empirical convolutional neural network approach for semantic relation classification. Neurocomputing 190, 1–9 (2016)

    Article  Google Scholar 

  10. Schwartz, R., Reichart, R., Rappoport, A.: Minimally supervised classification to semantic categories using automatically acquired symmetric patterns. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 1612–1623 (2014)

    Google Scholar 

  11. SemEval2018: Semeval (2018). https://competitions.codalab.org/competitions/17422

  12. Surdeanu, M., Tibshirani, J., Nallapati, R., Manning, C.D.: Multi-instance multi-label learning for relation extraction. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 455–465. Association for Computational Linguistics (2012)

    Google Scholar 

  13. Xu, K., Feng, Y., Huang, S., Zhao, D.: Semantic relation classification via convolutional neural networks with simple negative sampling. arXiv preprint: arXiv:1506.07650 (2015)

  14. Yin, Z., et al.: IRCMS at SemEval-2018 task 7: evaluating a basic CNN method and traditional pipeline method for relation classification. In: Proceedings of the 12th International Workshop on Semantic Evaluation, New Orleans, Louisiana, pp. 811–815. Association for Computational Linguistics, June 2018. https://doi.org/10.18653/v1/S18-1129, https://www.aclweb.org/anthology/S18-1129

  15. Yin, Z., Tang, J., Ru, C., Wei, L., Luo, Z., Ma, X.: A semantic representation enhancement method for Chinese news headline classification (2017)

    Google Scholar 

  16. Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 2335–2344 (2014)

    Google Scholar 

  17. Zhang, D., Wang, D.: Relation classification via recurrent neural network. arXiv preprint: arXiv:1508.01006 (2015)

Download references

Acknowledgements

Firstly, we would like to thank Bin Mao, Changhai Tian and Yuming Ye for their valuable suggestions on the initial version of this paper, which have helped a lot to improve the paper. Secondly, we want to express gratitudes to the anonymous reviewers for their hard work and kind comments, which will further improve our work in the future. Additionally, this work was supported by the National Natural Science Foundation of China (No. 61602490).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei Luo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yin, Z. et al. (2019). Relation Classification in Scientific Papers Based on Convolutional Neural Network. In: Tang, J., Kan, MY., Zhao, D., Li, S., Zan, H. (eds) Natural Language Processing and Chinese Computing. NLPCC 2019. Lecture Notes in Computer Science(), vol 11839. Springer, Cham. https://doi.org/10.1007/978-3-030-32236-6_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32236-6_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32235-9

  • Online ISBN: 978-3-030-32236-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics