Skip to main content
SpringerLink
Log in

FTMF: Few-shot temporal knowledge graph completion based on meta-optimization and fault-tolerant mechanism

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Traditional knowledge graph completion mainly focuses on static knowledge graph. Although there are efforts studying temporal knowledge graph completion, they assume that each relation has enough entities to train, ignoring the influence of long tail relations. Moreover, many relations only have a few samples. In that case, how to handle few-shot temporal knowledge graph completion still merits further attention. This paper aims to propose a framework for completing few-shot temporal knowledge graph. We use self-attention mechanism to encode entities, use cyclic recursive aggregation network to aggregate reference sets, use fault-tolerant mechanism to deal with error information, and use similarity network to calculate similarity scores. Experimental results show that our proposed model outperforms the baseline models and has better stability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10

Similar content being viewed by others

Data availability

Not applicable.

References

  1. Bollacker K.D., Evans, C., Paritosh, P.K., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of Special Interest Group on Management of Data, pp. 1247–1250 (2008)

  2. Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of Neural Information Processing Systems, pp. 2787–2795 (2013)

  3. Boschee, E., Lautenschläger, J., O’Brien, S., Shellman, S.M., Starz, J., Ward, M.D.: ICEWS coded event data. Harvard Dataverse 12 (2015). https://doi.org/10.7910/DVN/28075

  4. Conneau, A., Kiela, D., Schwenk, H., Barrault, L., Bordes, A.: Supervised learning of universal sentence representations from natural language inference data. In: Proceedings of Empirical Methods in Natural Language Processing, pp. 670–680 (2017)

  5. García-Durán, A., Dumančić, S., Niepert, M.: Learning sequence encoders for temporal knowledge graph completion. In: Proceedings of Empirical Methods in Natural Language Processing, pp. 4816–4821 (2018)

  6. Hamilton, W.L., Ying, Z.H., Leskovec, J.: Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 1025–1035 (2021)

  7. Hasanzadeh, A., Hajiramezanali, E., Narayanan, K., et al.: Variational Graph Recurrent Neural Networks. In: Proceedings of the Advances in Neural Information Processing Systems, pp. 10700–10710 (2019)

  8. He, K., Zhang, X.Y., Ren, S.Q., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

  9. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  10. Ji, G.L., He, S.Z., Xu, L.L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 687–696 (2015)

  11. Jiang, T.S., Liu, T.Y., Ge, T., Sha, L., Li, S.J., Chang, B.B., Sui, Z.F.: Encoding temporal information for time-aware link prediction. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 2350–2354 (2016)

  12. Jiang, Z., Gao, J., Lv, X.: MetaP: Meta Pattern Learning for One-Shot Knowledge Graph Completion. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 2232–2236 (2021)

  13. Jin, W., Zhang, C.L., Szekely, P., Ren, X.: Recurrent event network for reasoning over temporal knowledge graphs. arXiv preprint arXiv:1904.05530 (2019)

  14. Kipf , T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of the 5th International Conference on Learning Representations, pp. 1–14 (2017)

  15. Kumar, S., Zhang, X., Leskovec, J.: Learning dynamic embeddings from temporal interactions. arXiv preprint arXiv.1812.02289. (2018)

  16. Leblay, J., Chekol, M.W.: Deriving validity time in knowledge graph. In: Proceedings of the The Web Conference, pp. 1771–1776 (2018)

  17. Leetaru, K., Schrodt, P.A.: GDELT: global data on events, location, and tone. In: Proceedings of ISA Annual Convention, pp. 1–49 (2013)

  18. Lin, Y.K., Liu, Z.Y., Sun, M.S., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of Twenty-ninth AAAI Conference on Artificial Intelligence, pp. 2181–2187 (2015)

  19. Liu, H.X., Wu, Y.X., Yang, Y.M.: Analogical inference for multi-relational embeddings. In: Proceedings of International Conference on Machine Learning, pp. 2168–2178 (2017)

  20. Ma, Y., Tresp, V., Daxberger, E.A.: Embedding models for episodic knowledge graphs. J. Web Semant. 59, 1–26 (2019)

    Article  Google Scholar 

  21. Manessi, F., Rozza, A., Manzo, M.: Dynamic graph convolutional networks. Pattern Recogn. 97(107000), 1–16 (2020)

    Google Scholar 

  22. Miller, A.: WordNet: A lexical database for English. Commun. ACM 38(11), 39–41 (1995)

    Article  Google Scholar 

  23. Mirtaheri, M., Rostami, M., Ren, X., et al.: One-shot learning for temporal knowledge graphs. arXiv preprint arXiv.2010.12144 (2020)

  24. Nguyen, G.H., Lee, J.B., Rossi, R.A., Ahmed, N.K., Koh, E., Kim, S.: Continuous-Time Dynamic Network Embeddings. In: Proceedings of the The Web Conference, pp. 969–976 (2018)

  25. Nickel, M., Rosasco, L., Poggio, T.: Holographic embeddings of knowledge graphs. In: Proceedings of 30th AAAI Conference on Artificial Intelligence, pp.1955–1961 (2016)

  26. Nickel, M., Tresp, V., Kriegel, H.P.: A three-way model for collective learning on multi-relational data. In: Proceedings of International Conference on Machine Learning, pp. 809–816 (2011)

  27. Niu, G., Li, Y., Tang, C., et al.: Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completion. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 213–222 (2021)

  28. Trivedi, R., Farajtabar, M., Biswal, P., Zha, H.: Dyrep: Learning representations over dynamic graphs. In: Proceedings of the 7th International Conference on Learning Representations, pp. 1–25 (2019)

  29. Sadeghian, A., Rodriguez, M., Wang, D.Z., Colas, A.: Temporal reasoning over event knowledge graphs. In: Proceedings of Workshop on Knowledge Base Construction, Reasoning and Mining, pp. 6669–6683 (2016)

  30. Sheng, J., Guo, S., Chen, Z., Yue, J.W., Wang, L.H., Liu, T.W., Xu, H.B.: Adaptive Attentional Network for Few-Shot Knowledge Graph Completion. In: Proceedings of Empirical Methods in Natural Language Processing, pp. 1681–1691 (2020)

  31. Snell, J., Swersky, K., Zemel, R.S.: Prototypical Networks for Few-shot Learning. In: Proceedings of Neural Information Processing Systems, pp. 4077–4087 (2017)

  32. Socher, R., Chen, D., Manning, C.D., Ng, A.Y.: Reasoning with neural tensor networks for knowledge base completion. In: Proceedings of Advances in Neural Information Processing Systems, pp. 926–934 (2013)

  33. Trivedi, R., Dai, H., Wang, Y., Song, L.: Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In: Proceedings of International Conference on Machine Learning. PMLR, pp. 3462–3471 (2017)

  34. Trouillon, T., Welbl, J., Riedel, S., et al.: Complex embeddings for simple link prediction. In: Proceedings of the 33rd International Conference on Machine Learning. PMLR, pp. 2071–2080 (2016)

  35. Wang, S., Huang, X., Chen, C., et al.: REFORM: Error-Aware Few-Shot Knowledge Graph Completion. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 1979–1988 (2021)

  36. Wang, X., Girshick, R., Gupta, A., et al.: Non-local neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7794–7803 (2018)

  37. Wang, Z., Zhang, J.W., Feng, J.L., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1112–1119 (2014)

  38. Xiao, H., Huang, M., Hao, Y., et al.: Transg: A generative mixture model for knowledge graph embedding. The Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pp. 2316–2325 (2016)

  39. Xiong, C.M., Merity, S., Socher, R.: Dynamic Memory Networks for Visual and Textual Question Answering. In: Proceedings of International Conference on Machine Learning. PMLR, 2016, pp. 2397–2406 (2016)

  40. Xiong, C., Zhong, V., Socher, R.: Dynamic coattention networks for question answering. In: Proceedings of the 5th International Conference on Learning Representations, pp. 1–14 (2017)

  41. Xiong, W., Yu, M., Chang, S., Guo, X.X., Wang, W.Y.: One-shot relational learning for knowledge graphs. In: Proceedings of Empirical Methods in Natural Language Processing, pp. 1980–1990 (2018)

  42. Xu, J., Zhang, J., Ke, X., et al.: P-INT: A Path-based Interaction Model for Few-shot Knowledge Graph Completion. In: Proceedings of the Association for Computational Linguistics. EMNLP 2021, pp. 385–394 (2021)

  43. Yang, B., Yih, W., He, X.D., Gao, J.F., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of International Conference on Learning Representations, pp. Poster (2015)

  44. Zhang, C.X., Yao, H.X., Huang, C., Jing, M., Li, Z.H., Chawla, N.V.: Few-shot knowledge graph completion. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 3041–3048 (2020)

Download references

Funding

The work was supported by the National Natural Science Foundation of China (61402087), the Natural Science Foundation of Hebei Province (F2022501015), the Key Project of Scientific Research Funds in Colleges and Universities of Hebei Education Department (ZD2020402), and in part by the Program for 333 Talents in Hebei Province (A202001066).

Author information

Authors and Affiliations

  1. School of Computer and Communication Engineering, Northeastern University (Qinhuangdao), Qinhuangdao, 066004, China

    Luyi Bai, Mingcheng Zhang, Han Zhang & Heng Zhang

  2. School of Informatics, University of Leicester, Leicester, LE1 7RH, UK

    Luyi Bai

Authors
  1. Luyi Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingcheng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Han Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Heng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Luyi Bai: Conceptualization, Methodology, Formal analysis, Funding acquisition, Writing—original draft, Writing—review & editing; Mingcheng Zhang: Investigation, Validation, Formal analysis, Writing—original draft; Han Zhang: Validation, Formal analysis, Writing—original draft; Heng Zhang: Writing—review & editing.

Corresponding author

Correspondence to Luyi Bai.

Ethics declarations

Ethical approval and consent to participate

Not applicable.

Human and animal ethics

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no potential conflicts of interest with respect to the research, authorship, and publication of this article.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bai, L., Zhang, M., Zhang, H. et al. FTMF: Few-shot temporal knowledge graph completion based on meta-optimization and fault-tolerant mechanism. World Wide Web 26, 1243–1270 (2023). https://doi.org/10.1007/s11280-022-01091-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-022-01091-6

Keywords

Search

Navigation