Skip to main content

Contextual Information Augmented Few-Shot Relation Extraction

  • Conference paper
  • First Online:
Knowledge Science, Engineering and Management (KSEM 2023)

Abstract

Few-Shot Relation Extraction is a challenging task that involves extracting relations from a limited number of annotated data. While some researchers have proposed using sentence-level information to improve performance on this task with Prototype Network, most of these methods do not adequately leverage this valuable source of sentence-level information. To address this issue, we propose a novel sentence augmentation method that utilizes abundant relation information to generate additional training data for few-shot relation extraction. In addition, we add a new “None of Above” class for each task, thereby enhancing the model’s classification ability for similar relations and improving its overall performance. Experimental results on the FewRel demonstrate that our method outperforms existing methods on three different few-shot relation extraction tasks. Moreover, our method also provides a new idea for both few-shot learning and data augmentation research.

This work is supported by National Natural Science Foundation of China (No. 61972414), National Key R &D Program of China (No. 2019YFC0312003) and Beijing Natural Science Foundation (No. 4202066).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://competitions.codalab.org/competitions/27980#results.

References

  1. Bach, N., Badaskar, S.: A survey on relation extraction. Lang. Technol. Inst. Carnegie Mellon Univ. 178, 15 (2007)

    Google Scholar 

  2. Brody, S., Wu, S., Benton, A.: Towards realistic few-shot relation extraction. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 5338–5345 (2021)

    Google Scholar 

  3. Chen, X., et al.: Knowprompt: knowledge-aware prompt-tuning with synergistic optimization for relation extraction. In: Proceedings of the ACM Web Conference 2022, pp. 2778–2788 (2022)

    Google Scholar 

  4. Dong, M., Pan, C., Luo, Z.: Mapre: an effective semantic mapping approach for low-resource relation extraction. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 2694–2704 (2021)

    Google Scholar 

  5. Fan, S., Zhang, B., Zhou, S., Wang, M., Li, K.: Few-shot relation extraction towards special interests. Big Data Res. 26, 100273 (2021)

    Article  Google Scholar 

  6. Gao, T., Han, X., Liu, Z., Sun, M.: Hybrid attention-based prototypical networks for noisy few-shot relation classification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 6407–6414 (2019)

    Google Scholar 

  7. Gao, T., et al.: Fewrel 2.0: towards more challenging few-shot relation classification. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 6250–6255 (2019)

    Google Scholar 

  8. Han, J., Cheng, B., Lu, W.: Exploring task difficulty for few-shot relation extraction. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 2605–2616 (2021)

    Google Scholar 

  9. Han, X., et al.: Fewrel: a large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4803–4809 (2018)

    Google Scholar 

  10. He, K., Huang, Y., Mao, R., Gong, T., Li, C., Cambria, E.: Virtual prompt pre-training for prototype-based few-shot relation extraction. Expert Syst. Appl. 213, 118927 (2023)

    Article  Google Scholar 

  11. Kenton, J.D.M.W.C., Toutanova, L.K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT, pp. 4171–4186 (2019)

    Google Scholar 

  12. Liu, Y., Hu, J., Wan, X., Chang, T.H.: A simple yet effective relation information guided approach for few-shot relation extraction. In: Findings of the Association for Computational Linguistics: ACL 2022, pp. 757–763 (2022)

    Google Scholar 

  13. Peng, H., et al.: Learning from context or names? An empirical study on neural relation extraction. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 3661–3672 (2020)

    Google Scholar 

  14. Qu, M., Gao, T., Xhonneux, L.P., Tang, J.: Few-shot relation extraction via Bayesian meta-learning on relation graphs. In: International Conference on Machine Learning, pp. 7867–7876. PMLR (2020)

    Google Scholar 

  15. Snell, J., Swersky, K., Zemel, R.: Prototypical networks for few-shot learning. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 4080–4090 (2017)

    Google Scholar 

  16. Soares, L.B., Fitzgerald, N., Ling, J., Kwiatkowski, T.: Matching the blanks: distributional similarity for relation learning. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 2895–2905 (2019)

    Google Scholar 

  17. Wang, M., Zheng, J., Cai, F., Shao, T., Chen, H.: DRK: discriminative rule-based knowledge for relieving prediction confusions in few-shot relation extraction. In: Proceedings of the 29th International Conference on Computational Linguistics, pp. 2129–2140 (2022)

    Google Scholar 

  18. Wang, Y., Verspoor, K., Baldwin, T.: Learning from unlabelled data for clinical semantic textual similarity. In: Proceedings of the 3rd Clinical Natural Language Processing Workshop, pp. 227–233 (2020)

    Google Scholar 

  19. Yang, K., Zheng, N., Dai, X., He, L., Huang, S., Chen, J.: Enhance prototypical network with text descriptions for few-shot relation classification. In: Proceedings of the 29th ACM International Conference on Information and Knowledge Management, pp. 2273–2276 (2020)

    Google Scholar 

  20. Yang, S., Zhang, Y., Niu, G., Zhao, Q., Pu, S.: Entity concept-enhanced few-shot relation extraction. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 987–991 (2021)

    Google Scholar 

  21. Ye, Z.X., Ling, Z.H.: Multi-level matching and aggregation network for few-shot relation classification. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 2872–2881 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhiguang Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, T., Wang, Z., Wang, R., Li, D., Lu, Q. (2023). Contextual Information Augmented Few-Shot Relation Extraction. In: Jin, Z., Jiang, Y., Buchmann, R.A., Bi, Y., Ghiran, AM., Ma, W. (eds) Knowledge Science, Engineering and Management. KSEM 2023. Lecture Notes in Computer Science(), vol 14117. Springer, Cham. https://doi.org/10.1007/978-3-031-40283-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-40283-8_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-40282-1

  • Online ISBN: 978-3-031-40283-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics