Abstract
Knowledge graphs (KGs) are often incomplete, omitting many existing facts. To address this issue, researchers have proposed many knowledge graph completion (KGC) models to fill in the missing triples. A full KG often consists of interconnected local KGs from multiple organizations, forming a cross-domain KG. Federated learning enables the effective utilization of the entire cross-domain KG for training a federated KGC model, rather than relying solely on a local KG from a single client. However, the existing methods often neglect the latent information among local KGs. Therefore, we propose a neighbor prediction-enhanced federated knowledge graph completion (NP-FedKGC) model to improve KGC by mining latent information. Specifically, we first obtain embeddings of entities and relations from multiple clients’ local KGs. Second, we employ the obtained embeddings as labels to train a respective neighbor prediction model for each client. Subsequently, the neighbor prediction model is applied to enhance each client’s local KG. Third, the enhanced local KGs of all clients are used to train the final federated KGC model. Comprehensive experimental results show that the proposed NP-FedKGC model outperforms three baseline models, FedE, FedR, and FedM, at MRR and Hits@1/3/10.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The data used to support the findings of this study is available from the corresponding author upon request.
References
Xiong W, Du J, Wang WY, Stoyanov V (2019) Pretrained encyclopedia: Weakly supervised knowledge-pretrained language model. arXiv preprint arXiv:1912.09637
Yasunaga M, Ren H, Bosselut A, Liang P, Leskovec J (2021) QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering, pp 535–546
Liu J, Duan L (2021) A survey on knowledge graph-based recommender systems. In: 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), pp 2450–2453
Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805
Wang X, Gao T, Zhu Z, Zhang Z, Liu Z, Li J, Tang J (2021) Kepler: A unified model for knowledge embedding and pre-trained language representation. Trans Assoc Comput Linguist 9:176–194
Chen H, Hu N, Qi G, Wang H, Bi Z, Li J, Yang F (2021) Openkg chain: A blockchain infrastructure for open knowledge graphs. Data Intell 3(2):205–227
Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp 1247–1250
Lehmann J, Isele R, Jakob M, Jentzsch A, Kontokostas D, Mendes PN, Hellmann S, Morsey M, Van Kleef P, Auer S et al (2015) Dbpedia-a large-scale, multilingual knowledge base extracted from wikipedia. Semantic web 6(2):167–195
Suchanek FM, Kasneci G, Weikum G (2007) Yago: a core of semantic knowledge. In: Proceedings of the 16th International Conference on World Wide Web, pp 697–706
Navigli R, Ponzetto SP (2012) Babelnet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artif Intell 193:217–250
Li L, Zhang X, Jin Z, Gao C, Zhu R, Liang Y, Ma Y (2023) Knowledge graph completion method based on quantum embedding and quaternion interaction enhancement. Inf Sci 648:119548
Baghershahi P, Hosseini R, Moradi H (2023) Self-attention presents low-dimensional knowledge graph embeddings for link prediction. Knowl Based Syst 260:110124
Le T, Le N, Le B (2023) Knowledge graph embedding by relational rotation and complex convolution for link prediction. Expert Syst Appl 214:119122
Fang H, Wang Y, Tian Z, Ye Y (2023) Learning knowledge graph embedding with a dual-attention embedding network. Expert Syst Appl 212:118806
Zhang K, Wang Y, Wang H, Huang L, Yang C, Chen X, Sun L (2022) Efficient federated learning on knowledge graphs via privacy-preserving relation embedding aggregation. In: Findings of the Association for Computational Linguistics: EMNLP 2022, pp 613–621
Chen M, Zhang W, Yuan Z, Jia Y, Chen H (2021) Fede: Embedding knowledge graphs in federated setting. In: Proceedings of the 10th International Joint Conference on Knowledge Graphs, pp 80–88
Jebreel NM, Domingo-Ferrer J (2023) Fl-defender: Combating targeted attacks in federated learning. Knowl Based Syst 260:110178
Ezzeldin YH, Yan S, He C, Ferrara E, Avestimehr AS (2023) Fairfed: Enabling group fairness in federated learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 37, pp 7494–7502
Zeng D, Liang S, Hu X, Wang H, Xu Z (2023) Fedlab: A flexible federated learning framework. J Mach Learn Res 24(100):1–7
Rodríguez-Barroso N, Jiménez-López D, Luzón MV, Herrera F, Martínez-Cámara E (2023) Survey on federated learning threats: Concepts, taxonomy on attacks and defences, experimental study and challenges. Inf Fusion 90:148–173
Hu C, Liu B, Zhang X, Wang Z, Lin C, Luo L (2022) A federated multi-server knowledge graph embedding framework for link prediction. In: 2022 IEEE 34th International Conference on Tools with Artificial Intelligence (ICTAI), pp 366–371. IEEE
Huang W, Liu J, Li T, Ji S, Wang D, Huang T (2022) Fedcke: Cross-domain knowledge graph embedding in federated learning. IEEE Trans Big Data 9:1–12
Bordes A, Usunier N, Garcia-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data 26:2787–2795
Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp 2181–2187
Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (volume 1: Long Papers), pp 687–696
Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, pp 1112–1119
Sun Z, Deng Z-H, Nie J-Y, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197
Nickel M, Tresp V, Kriegel H-P et al (2011) A three-way model for collective learning on multi-relational data. In: Icml, vol 11, pp 3104482–3104584
Yang B, Yih W-t, He X, Gao J, Deng L (2015) Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: International Conference on Machine Learning, pp 2071–2080
Socher R, Chen D, Manning CD, Ng AY (2013) Reasoning with neural tensor networks for knowledge base completion, 926–934
Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2d knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 32, pp 1811–1818
Schlichtkrull M, Kipf TN, Bloem P, Van Den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. In: The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3–7, 2018, Proceedings 15, pp 593–607. Springer
Vashishth S, Sanyal S, Nitin V, Talukdar P (2019) Composition-based multi-relational graph convolutional networks. In: International Conference on Learning Representations
Nathani D, Chauhan J, Sharma C, Kaul M (2019) Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 4710–4723
Bansal T, Juan D-C, Ravi S, McCallum A (2019) A2n: Attending to neighbors for knowledge graph inference. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 4387–4392
Yang Q, Liu Y, Cheng Y, Kang Y, Chen T, Yu H (2019) Federated learning: synthesis lectures on artificial intelligence and machine learning 13:1–207
Li T, Sahu AK, Talwalkar A, Smith V (2020) Federated learning: Challenges, methods, and future directions. IEEE Signal Process Mag 37(3):50–60
Kairouz P, McMahan HB, Avent B, Bellet A, Bennis M, Bhagoji AN, Bonawitz K, Charles Z, Cormode G, Cummings R et al (2021) Advances and open problems in federated learning. Foundations and Trends® in Machine Learning 14(1–2):1–210
Konečnỳ J, McMahan HB, Yu FX, Richtárik P, Suresh AT, Bacon D (2016) Federated learning: Strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492
Zhang K, Yang C, Li X, Sun L, Yiu SM (2021) Subgraph federated learning with missing neighbor generation. Adv Neural Inf Process Syst 34:6671–6682
Li H, Li C, Wang J, Yang A, Ma Z, Zhang Z, Hua D (2023) Review on security of federated learning and its application in healthcare. Futur Gener Comput Syst 144:271–290
Wang H, Zhao H, Wang Y, Yu T, Gu J, Gao J (2022) Fedkc: Federated knowledge composition for multilingual natural language understanding. In: Proceedings of the ACM Web Conference 2022, pp 1839–1850
Bordes A, Weston J, Collobert R, Bengio Y (2011) Learning structured embeddings of knowledge bases. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 25, pp 301–306
Acknowledgements
This work was supported by the National Key Research and Development Program of China under Grant 2023YFB3308200 and Beijing Natural Science Foundation (L233005).
Funding
This work was supported by the National Key Research and Development Program of China under Grant 2023YFB3308200 and Beijing Natural Science Foundation (L233005).
Author information
Authors and Affiliations
Contributions
Songsong Liu: Data curation, Conceptualization, Investigation, Methodology, Software, Writing - original draft preparation, Writing - review & editing. Wenxin Li: Investigation, Validation, Visualization, Writing - review & editing. Xiao Song: Supervision, Resources, Project administration, Funding acquisition. Kaiqi Gong: Conceptualization, Investigation, Writing - review & editing.
Corresponding author
Ethics declarations
Conflict of interest
All the authors declare that they have no competing financial interests or personal relationships that could influence the work reported in this paper.
Ethics approval and consent to participate
This article does not contain studies with human participants or animals. Statement of informed consent is not applicable since the manuscript does not contain any patient data.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Liu, S., Li, W., Song, X. et al. NP-FedKGC: a neighbor prediction-enhanced federated knowledge graph completion model. Appl Intell 55, 235 (2025). https://doi.org/10.1007/s10489-024-06201-7
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-06201-7