Skip to main content

Dependency Parsing Representation Learning for Open Information Extraction

  • Conference paper
  • First Online:
Knowledge Science, Engineering and Management (KSEM 2021)

Abstract

Open information extraction (OIE) aims to extract structured information from text. Specifically, it extracts arguments and their logical relationships from a sentence. However, as a syntactic feature commonly used in OIE, the tree structure of dependency parsing (DP) is often overlooked. In this paper, we propose a dependency parsing representation learning model for OIE. This model can fully represent the tree structure and edge information of DP. Then we fuse the learned DP embedding in a Graph Convolutional Network-based OIE model. The experiments show that the proposed OIE model outperforms four baselines on three open-sourced data sets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://ltp.ai/.

  2. 2.

    https://1drv.ms/u/s!ApPZx_TWwibImHl49ZBwxOU0ktHv.

  3. 3.

    https://ai.baidu.com/broad/download?dataset=saoke.

  4. 4.

    https://github.com/TJUNLP/COER.

  5. 5.

    https://fasttext.cc/.

References

  1. Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems, pp. 2787–2795 (2013)

    Google Scholar 

  2. Cui, L., Wei, F., Zhou, M.: Neural open information extraction. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 407–413. Association for Computational Linguistics, Melbourne, Australia, July 2018. https://doi.org/10.18653/v1/P18-2065

  3. Del Corro, L., Gemulla, R.: ClausIE: clause-based open information extraction. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 355–366. WWW 2013. Association for Computing Machinery, New York, NY, USA (2013). https://doi.org/10.1145/2488388.2488420

  4. Etzioni, O., Banko, M., Soderland, S., Weld, D.S.: Open information extraction from the web. Commun. ACM 51, 68–74 (2008)

    Article  Google Scholar 

  5. Etzioni, O., Fader, A., Christensen, J., Soderland, S., Mausam, M.: Open information extraction: the second generation. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence - Volume Volume One, pp. 3–10. IJCAI 2011. AAAI Press (2011)

    Google Scholar 

  6. Gashteovski, K., Gemulla, R., del Corro, L.: MinIE: minimizing facts in open information extraction. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 2630–2640. Association for Computational Linguistics, Copenhagen, Denmark, September 2017. https://doi.org/10.18653/v1/D17-1278

  7. Guo, Z., Zhang, Y., Lu, W.: Attention guided graph convolutional networks for relation extraction. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 241–251 (2019)

    Google Scholar 

  8. Harting, T., Mesbah, S., Lofi, C.: LOREM: language-consistent open relation extraction from unstructured text. Proc. Web Conf. 2020, 1830–1838 (2020)

    Google Scholar 

  9. Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (volume 1: Long papers), pp. 687–696 (2015)

    Google Scholar 

  10. Jia, S., Shijia, E., Li, M., Xiang, Y.: Chinese open relation extraction and knowledge base establishment. ACM Trans. Asian Low Resource Lang. Inf. Process. 17(3), 1–22 (2018)

    Article  Google Scholar 

  11. Jia, S., Xiang, Y.: Chinese user service intention classification based on hybrid neural network. J. Phys. Conf. Ser. 1229, 012054 (2019)

    Google Scholar 

  12. Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)

  13. Kolluru, K., Adlakha, V., Aggarwal, S., Mausam, Chakrabarti, S.: OpenIE6: iterative grid labeling and coordination analysis for open information extraction. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 3748–3761. Association for Computational Linguistics, Online, November 2020

    Google Scholar 

  14. Kolluru, K., Aggarwal, S., Rathore, V., Mausam, M., Chakrabarti, S.: IMoJIE: iterative memory-based joint open information extraction. In: The 58th Annual Meeting of the Association for Computational Linguistics (ACL), Seattle, U.S.A, July 2020

    Google Scholar 

  15. Mausam, Schmitz, M., Bart, R., Soderland, S., Etzioni, O.: Open language learning for information extraction. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 523–534. EMNLP-CoNLL 2012. Association for Computational Linguistics, USA (2012)

    Google Scholar 

  16. Mausam, M.: Open information extraction systems and downstream applications, pp. 4074–4077. IJCAI 2016. AAAI Press (2016)

    Google Scholar 

  17. Ro, Y., Lee, Y., Kang, P.: Multi\(^2\)OIE: multilingual open information extraction based on multi-head attention with BERT. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, pp. 1107–1117 (2020)

    Google Scholar 

  18. Roy, A., Park, Y., Lee, T., Pan, S.: Supervising unsupervised open information extraction models. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 728–737. Association for Computational Linguistics, Hong Kong, China, November 2019. https://doi.org/10.18653/v1/D19-1067

  19. Stanovsky, G., Dagan, I.: Creating a large benchmark for open information extraction. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP) (to appear). Association for Computational Linguistics, Austin, Texas, November 2016

    Google Scholar 

  20. Stanovsky, G., Michael, J., Zettlemoyer, L., Dagan, I.: Supervised open information extraction. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long Papers), pp. 885–895 (2018)

    Google Scholar 

  21. Sun, M., Li, X., Wang, X., Fan, M., Feng, Y., Li, P.: Logician: a unified end-to-end neural approach for open-domain information extraction. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 556–564. WSDM 2018. Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3159652.3159712

  22. Xu, K., Li, C., Tian, Y., Sonobe, T., Kawarabayashi, K.I., Jegelka, S.: Representation learning on graphs with jumping knowledge networks. In: International Conference on Machine Learning, pp. 5453–5462. PMLR (2018)

    Google Scholar 

  23. Zhan, J., Zhao, H.: Span model for open information extraction on accurate corpus. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34(05), pp. 9523–9530, April 2020. https://doi.org/10.1609/aaai.v34i05.6497, https://ojs.aaai.org/index.php/AAAI/article/view/6497

  24. Zhang, Y., Qi, P., Manning, C.D.: Graph convolution over pruned dependency trees improves relation extraction. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 2205–2215 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wu Bin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zekun, L., Nianwen, N., Chengcheng, P., Bin, W. (2021). Dependency Parsing Representation Learning for Open Information Extraction. In: Qiu, H., Zhang, C., Fei, Z., Qiu, M., Kung, SY. (eds) Knowledge Science, Engineering and Management. KSEM 2021. Lecture Notes in Computer Science(), vol 12815. Springer, Cham. https://doi.org/10.1007/978-3-030-82136-4_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-82136-4_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-82135-7

  • Online ISBN: 978-3-030-82136-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics