Skip to main content

Advertisement

NP-FedKGC: a neighbor prediction-enhanced federated knowledge graph completion model

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Knowledge graphs (KGs) are often incomplete, omitting many existing facts. To address this issue, researchers have proposed many knowledge graph completion (KGC) models to fill in the missing triples. A full KG often consists of interconnected local KGs from multiple organizations, forming a cross-domain KG. Federated learning enables the effective utilization of the entire cross-domain KG for training a federated KGC model, rather than relying solely on a local KG from a single client. However, the existing methods often neglect the latent information among local KGs. Therefore, we propose a neighbor prediction-enhanced federated knowledge graph completion (NP-FedKGC) model to improve KGC by mining latent information. Specifically, we first obtain embeddings of entities and relations from multiple clients’ local KGs. Second, we employ the obtained embeddings as labels to train a respective neighbor prediction model for each client. Subsequently, the neighbor prediction model is applied to enhance each client’s local KG. Third, the enhanced local KGs of all clients are used to train the final federated KGC model. Comprehensive experimental results show that the proposed NP-FedKGC model outperforms three baseline models, FedE, FedR, and FedM, at MRR and Hits@1/3/10.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The data used to support the findings of this study is available from the corresponding author upon request.

References

  1. Xiong W, Du J, Wang WY, Stoyanov V (2019) Pretrained encyclopedia: Weakly supervised knowledge-pretrained language model. arXiv preprint arXiv:1912.09637

  2. Yasunaga M, Ren H, Bosselut A, Liang P, Leskovec J (2021) QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering, pp 535–546

  3. Liu J, Duan L (2021) A survey on knowledge graph-based recommender systems. In: 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), pp 2450–2453

  4. Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805

  5. Wang X, Gao T, Zhu Z, Zhang Z, Liu Z, Li J, Tang J (2021) Kepler: A unified model for knowledge embedding and pre-trained language representation. Trans Assoc Comput Linguist 9:176–194

    Article  MATH  Google Scholar 

  6. Chen H, Hu N, Qi G, Wang H, Bi Z, Li J, Yang F (2021) Openkg chain: A blockchain infrastructure for open knowledge graphs. Data Intell 3(2):205–227

    MATH  Google Scholar 

  7. Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp 1247–1250

  8. Lehmann J, Isele R, Jakob M, Jentzsch A, Kontokostas D, Mendes PN, Hellmann S, Morsey M, Van Kleef P, Auer S et al (2015) Dbpedia-a large-scale, multilingual knowledge base extracted from wikipedia. Semantic web 6(2):167–195

    Article  Google Scholar 

  9. Suchanek FM, Kasneci G, Weikum G (2007) Yago: a core of semantic knowledge. In: Proceedings of the 16th International Conference on World Wide Web, pp 697–706

  10. Navigli R, Ponzetto SP (2012) Babelnet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artif Intell 193:217–250

    Article  MathSciNet  MATH  Google Scholar 

  11. Li L, Zhang X, Jin Z, Gao C, Zhu R, Liang Y, Ma Y (2023) Knowledge graph completion method based on quantum embedding and quaternion interaction enhancement. Inf Sci 648:119548

    Article  MATH  Google Scholar 

  12. Baghershahi P, Hosseini R, Moradi H (2023) Self-attention presents low-dimensional knowledge graph embeddings for link prediction. Knowl Based Syst 260:110124

    Article  MATH  Google Scholar 

  13. Le T, Le N, Le B (2023) Knowledge graph embedding by relational rotation and complex convolution for link prediction. Expert Syst Appl 214:119122

    Article  MATH  Google Scholar 

  14. Fang H, Wang Y, Tian Z, Ye Y (2023) Learning knowledge graph embedding with a dual-attention embedding network. Expert Syst Appl 212:118806

    Article  MATH  Google Scholar 

  15. Zhang K, Wang Y, Wang H, Huang L, Yang C, Chen X, Sun L (2022) Efficient federated learning on knowledge graphs via privacy-preserving relation embedding aggregation. In: Findings of the Association for Computational Linguistics: EMNLP 2022, pp 613–621

  16. Chen M, Zhang W, Yuan Z, Jia Y, Chen H (2021) Fede: Embedding knowledge graphs in federated setting. In: Proceedings of the 10th International Joint Conference on Knowledge Graphs, pp 80–88

  17. Jebreel NM, Domingo-Ferrer J (2023) Fl-defender: Combating targeted attacks in federated learning. Knowl Based Syst 260:110178

    Article  MATH  Google Scholar 

  18. Ezzeldin YH, Yan S, He C, Ferrara E, Avestimehr AS (2023) Fairfed: Enabling group fairness in federated learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 37, pp 7494–7502

  19. Zeng D, Liang S, Hu X, Wang H, Xu Z (2023) Fedlab: A flexible federated learning framework. J Mach Learn Res 24(100):1–7

    MathSciNet  MATH  Google Scholar 

  20. Rodríguez-Barroso N, Jiménez-López D, Luzón MV, Herrera F, Martínez-Cámara E (2023) Survey on federated learning threats: Concepts, taxonomy on attacks and defences, experimental study and challenges. Inf Fusion 90:148–173

    Article  Google Scholar 

  21. Hu C, Liu B, Zhang X, Wang Z, Lin C, Luo L (2022) A federated multi-server knowledge graph embedding framework for link prediction. In: 2022 IEEE 34th International Conference on Tools with Artificial Intelligence (ICTAI), pp 366–371. IEEE

  22. Huang W, Liu J, Li T, Ji S, Wang D, Huang T (2022) Fedcke: Cross-domain knowledge graph embedding in federated learning. IEEE Trans Big Data 9:1–12

    MATH  Google Scholar 

  23. Bordes A, Usunier N, Garcia-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data 26:2787–2795

    Google Scholar 

  24. Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp 2181–2187

  25. Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (volume 1: Long Papers), pp 687–696

  26. Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, pp 1112–1119

  27. Sun Z, Deng Z-H, Nie J-Y, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197

  28. Nickel M, Tresp V, Kriegel H-P et al (2011) A three-way model for collective learning on multi-relational data. In: Icml, vol 11, pp 3104482–3104584

  29. Yang B, Yih W-t, He X, Gao J, Deng L (2015) Embedding Entities and Relations for Learning and Inference in Knowledge Bases

  30. Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: International Conference on Machine Learning, pp 2071–2080

  31. Socher R, Chen D, Manning CD, Ng AY (2013) Reasoning with neural tensor networks for knowledge base completion, 926–934

  32. Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2d knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 32, pp 1811–1818

  33. Schlichtkrull M, Kipf TN, Bloem P, Van Den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. In: The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3–7, 2018, Proceedings 15, pp 593–607. Springer

  34. Vashishth S, Sanyal S, Nitin V, Talukdar P (2019) Composition-based multi-relational graph convolutional networks. In: International Conference on Learning Representations

  35. Nathani D, Chauhan J, Sharma C, Kaul M (2019) Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 4710–4723

  36. Bansal T, Juan D-C, Ravi S, McCallum A (2019) A2n: Attending to neighbors for knowledge graph inference. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 4387–4392

  37. Yang Q, Liu Y, Cheng Y, Kang Y, Chen T, Yu H (2019) Federated learning: synthesis lectures on artificial intelligence and machine learning 13:1–207

  38. Li T, Sahu AK, Talwalkar A, Smith V (2020) Federated learning: Challenges, methods, and future directions. IEEE Signal Process Mag 37(3):50–60

    Article  MATH  Google Scholar 

  39. Kairouz P, McMahan HB, Avent B, Bellet A, Bennis M, Bhagoji AN, Bonawitz K, Charles Z, Cormode G, Cummings R et al (2021) Advances and open problems in federated learning. Foundations and Trends® in Machine Learning 14(1–2):1–210

  40. Konečnỳ J, McMahan HB, Yu FX, Richtárik P, Suresh AT, Bacon D (2016) Federated learning: Strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492

  41. Zhang K, Yang C, Li X, Sun L, Yiu SM (2021) Subgraph federated learning with missing neighbor generation. Adv Neural Inf Process Syst 34:6671–6682

    MATH  Google Scholar 

  42. Li H, Li C, Wang J, Yang A, Ma Z, Zhang Z, Hua D (2023) Review on security of federated learning and its application in healthcare. Futur Gener Comput Syst 144:271–290

    Article  MATH  Google Scholar 

  43. Wang H, Zhao H, Wang Y, Yu T, Gu J, Gao J (2022) Fedkc: Federated knowledge composition for multilingual natural language understanding. In: Proceedings of the ACM Web Conference 2022, pp 1839–1850

  44. Bordes A, Weston J, Collobert R, Bengio Y (2011) Learning structured embeddings of knowledge bases. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 25, pp 301–306

Download references

Acknowledgements

This work was supported by the National Key Research and Development Program of China under Grant 2023YFB3308200 and Beijing Natural Science Foundation (L233005).

Funding

This work was supported by the National Key Research and Development Program of China under Grant 2023YFB3308200 and Beijing Natural Science Foundation (L233005).

Author information

Authors and Affiliations

Authors

Contributions

Songsong Liu: Data curation, Conceptualization, Investigation, Methodology, Software, Writing - original draft preparation, Writing - review & editing. Wenxin Li: Investigation, Validation, Visualization, Writing - review & editing. Xiao Song: Supervision, Resources, Project administration, Funding acquisition. Kaiqi Gong: Conceptualization, Investigation, Writing - review & editing.

Corresponding author

Correspondence to Wenxin Li.

Ethics declarations

Conflict of interest

All the authors declare that they have no competing financial interests or personal relationships that could influence the work reported in this paper.

Ethics approval and consent to participate

This article does not contain studies with human participants or animals. Statement of informed consent is not applicable since the manuscript does not contain any patient data.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, S., Li, W., Song, X. et al. NP-FedKGC: a neighbor prediction-enhanced federated knowledge graph completion model. Appl Intell 55, 235 (2025). https://doi.org/10.1007/s10489-024-06201-7

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-06201-7

Keywords