Skip to main content

Path-KGE: Preference-Aware Knowledge Graph Embedding with Path Semantics for Link Prediction

  • Conference paper
  • First Online:
Web Information Systems Engineering – WISE 2023 (WISE 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14306))

Included in the following conference series:

  • 775 Accesses

Abstract

Knowledge graph embedding (KGE) aims to transfer entities and relations into low-dimensional vector space while preserving underlying semantics in knowledge graph (KG). Some existing models directly learn embeddings based on original triples, while others integrate external information to enhance the limited semantic information in KG. However, most of them ignore latent user preferences in their interactions with real-world KG applications, not even considering the relational semantics implied in historical interaction data, which are practical and essential for many downstream tasks like link prediction. To address these issues, we propose a novel preference-aware knowledge graph embedding with path semantics model Path-KGE, which learns semantic information of relation paths and integrates it into embedding process. First, we mine multi-hop relations with frequent and temporal characteristics as semantic relation paths in user interaction data, to obtain implicit user preference features. Second, we design a path importance function to distinguish the semantic impacts of user preferences on distinct relation paths. Finally, we utilize weight scores as long-term constraints to learn preference-aware embeddings, so that the representation vectors of entity pairs connected by preferred relation paths can remain close distances in vector space as in reality. The experimental results show that our model outperforms state-of-the-art translation-based models on link prediction and triple classification tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Harper, F.M., Konstan, J.A.: The movielens datasets: history and context. ACM Trans. Interact. Intell. Syst. (TIIS) 5(4), 1–19 (2015)

    Google Scholar 

  2. Sun, Z., Yang, J., Zhang, J., Bozzon, A., Huang, L.-K., Xu, C.: Recurrent knowledge graph embedding for effective recommendation. In: Proceedings of the 12th ACM Conference on Recommender Systems, pp. 297–305 (2018)

    Google Scholar 

  3. Wang, X., Wang, D., Xu, C., He, X., Cao, Y., Chua, T.-S.: Explainable reasoning over knowledge graphs for recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 5329–5336 (2019)

    Google Scholar 

  4. Schedl, M.: The LFM-1B dataset for music retrieval and recommendation. In: Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, pp. 103–110 (2016)

    Google Scholar 

  5. Cao, Y., Wang, X., He, X., Hu, Z., Chua, T.-S.: Unifying knowledge graph learning and recommendation: towards a better understanding of user preferences. In: The World Wide Web Conference, pp. 151–161 (2019)

    Google Scholar 

  6. Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1247–1250 (2008)

    Google Scholar 

  7. Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., Mitchell, T.: Toward an architecture for never-ending language learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 24, no. 1, pp. 1306–1313 (2010)

    Google Scholar 

  8. Vrandečić, D., Krötzsch, M.: WikiData: a free collaborative knowledgebase. Commun. ACM 57(10), 78–85 (2014)

    Article  Google Scholar 

  9. Cao, Z., Xu, Q., Yang, Z., Cao, X., Huang, Q.: Geometry interaction knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 5, pp. 5521–5529 (2022)

    Google Scholar 

  10. Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems, vol. 26 (2013)

    Google Scholar 

  11. Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., Bouchard, G.: Complex embeddings for simple link prediction. In: International Conference on Machine Learning, pp. 2071–2080. PMLR (2016)

    Google Scholar 

  12. Wang, H., Li, S., Pan, R.: An adversarial transfer network for knowledge representation learning. In: Proceedings of the Web Conference 2021, pp. 1749–1760 (2021)

    Google Scholar 

  13. Zhang, S., et al.: Page-link: path-based graph neural network explanation for heterogeneous link prediction. arXiv preprint arXiv:2302.12465 (2023)

  14. He, G., Li, J., Zhao, W.X., Liu, P., Wen, J.: Mining implicit entity preference from user-item interaction data for knowledge graph completion via adversarial learning. In: Proceedings of The Web Conference 2020, pp. 740–751 (2020)

    Google Scholar 

  15. Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., Liu, S.: Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379 (2015)

  16. Yang, B., Yih, W.-T., He, X., Gao, J., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint arXiv:1412.6575 (2014)

  17. Xie, R., Liu, Z., Sun, M. Luan, H., Sun, M.: Representation learning of knowledge graphs with hierarchical types. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence 2016, pp. 2965–2971 (2016)

    Google Scholar 

  18. Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph and text jointly embedding. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1591–1601 (2014)

    Google Scholar 

  19. Ostapuk, N., Yang, J., Cudré-Mauroux, P.: Activelink: deep active learning for link prediction in knowledge graphs. In: The World Wide Web Conference, pp. 1398–1408 (2019)

    Google Scholar 

  20. Spitz, A., Dixit, V., Richter, L., Gertz, M., Geiß, J.: State of the union: a data consumer’s perspective on Wikidata and its properties for the classification and resolution of entities. In: Proceedings of the International AAAI Conference on Web and Social Media, vol. 10, no. 2, pp. 88–95 (2016)

    Google Scholar 

  21. Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 28, no. 1 (2014)

    Google Scholar 

  22. Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 29, no. 1 (2015)

    Google Scholar 

  23. Malyshev, S., Krötzsch, M., González, L., Gonsior, J., Bielefeldt, A.: Getting the most out of wikidata: semantic technology usage in Wikipedia’s knowledge graph. In: Vrandečić, D., et al. (eds.) ISWC 2018, Part II. LNCS, vol. 11137, pp. 376–394. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00668-6_23

    Chapter  Google Scholar 

  24. Bonifati, A., Martens, W., Timm, T.: An analytical study of large SPARQL query logs. arXiv preprint arXiv:1708.00363 (2017)

  25. Sun, Y., Han, J., Yan, X., Yu, P.S., Wu, T.: PathSim: meta path-based top-k similarity search in heterogeneous information networks. Proc. VLDB Endow. 4(11), 992–1003 (2011)

    Article  Google Scholar 

  26. Chen, X., Jia, S., Xiang, Y.: A review: knowledge reasoning over knowledge graph. Expert Syst. Appl. 141, 112948 (2020)

    Article  Google Scholar 

  27. Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11) (2008)

    Google Scholar 

  28. Rosso, P., Yang, D., Cudré-Mauroux, P.: Beyond triplets: hyper- relational knowledge graph embedding for link prediction. In: Proceedings of The Web Conference 2020, pp. 1885–1896 (2020)

    Google Scholar 

  29. Xie, R., Liu, Z., Jia, J., Luan, H., Sun, M.: Representation learning of knowledge graphs with entity descriptions. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30, no. 1 (2016)

    Google Scholar 

Download references

Acknowledgements

This work is being supported by the National Natural Science Foundation of China under the Grant No. 62172451, and supported by Open Research Projects of Zhejiang Lab under the Grant No. 2022KG0AB01.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tingxuan Chen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yang, L., Zhao, J., Long, J., Huang, J., Wang, Z., Chen, T. (2023). Path-KGE: Preference-Aware Knowledge Graph Embedding with Path Semantics for Link Prediction. In: Zhang, F., Wang, H., Barhamgi, M., Chen, L., Zhou, R. (eds) Web Information Systems Engineering – WISE 2023. WISE 2023. Lecture Notes in Computer Science, vol 14306. Springer, Singapore. https://doi.org/10.1007/978-981-99-7254-8_32

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-7254-8_32

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-7253-1

  • Online ISBN: 978-981-99-7254-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics