Skip to main content
Springer Nature Link
Log in

Graph attention-based collaborative filtering for user-specific recommender system using knowledge graph and deep neural networks

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Collaborative filtering suffers from the issues of data sparsity and cold start. Due to which recommendation models that only rely on the user–item interaction graph are insufficient to model the latent relationship between complex interaction of users and items. Existing methods utilizing knowledge graphs for recommendation explicitly model the multi-hop neighbors of an entity while ignoring the relation-specific as well as user-specific information. Moreover, a collaborative signal is also crucial to be modeled explicitly besides knowledge graph information. In this work, a novel end-to-end recommendation scenario is presented which jointly learns the collaborative signal and knowledge graph context. The knowledge graph is utilized to provide supplementary information in the recommendation scenario. To have personalized recommendation for each user, user-specific attention mechanism is also utilized. The user and item triple sets are constructed which are then propagated in the knowledge graph to enrich their representation. Extensive experiments are carried out on three benchmark datasets to show the effectiveness of the proposed framework. Empirical results show that the proposed model performs better than the state-of-the-art KG-based recommendation models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. https://grouplens.org/datasets/movielens/20m/.

  2. https://grouplens.org/datasets/hetrec-2011/.

  3. http://www2.informatik.uni-freiburg.de/~cziegler/BX/.

  4. https://github.com/xiangwang1223.

References

  1. Yin C, Wang J, Park JH (2017) An improved recommendation algorithm for big data cloud service based on the trust in sociology. Neurocomputing 256:49–55

    Article  Google Scholar 

  2. Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv (CSUR) 52(1):1–38

    Article  Google Scholar 

  3. Wang H, Zhang F, Zhang M, Leskovec J, Zhao M, Li W, Wang Z (2019) Knowledge-aware graph neural networks with label smoothness regularization for recommender systems, in: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 968–977

  4. Hamilton WL, Ying R, Leskovec J (2017) Inductive representation learning on large graphs, in: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp 1025–1035

  5. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks ArXiv e-prints

  6. Zhang C, Song D, Huang C, Swami A, Chawla NV (2019) Heterogeneous graph neural network, in: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 793–803

  7. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. IEEE Comput 42(8):30–37

    Article  Google Scholar 

  8. He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering in: Proceedings of the 26th international conference on World Wide Web pp 173–182

  9. Tay, Y., Tuan, L.A., Hui, S.C.: Latent relational metric learning via memory-based attention for collaborative ranking, in: Proceedings of the 2018 World Wide Web Conference, 2018. pp. 729–739

  10. Wang X, Wang D, Xu C, He X, Cao Y, Chua TS (2019) Explainable reasoning over knowledge graphs for recommendation. Proc AAAI Conf Artif Intell 33(1):5329–5336

    Google Scholar 

  11. Lin Y, Liu Z, Sun, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion, in: Twenty-ninth AAAI conference on artificial intelligence pp 2181–2187

  12. Huang X, Zhang J, Li D, Li P (2019) Knowledge graph embedding based question answering, in: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining pp 105–113

  13. Wang H, Zhang F, Wang J, Zhao M, Li W, Xie X, Guo M (2018) Ripplenet: propagating user preferences on the knowledge graph for recommender systems, in: Proceedings of the 27th ACM International Conference on Information and Knowledge Management pp 417–426

  14. Cao Y, Wang X, He X, Hu Z, Chua TS (2019) Unifying knowledge graph learning and recommendation: towards a better understanding of user preferences, in: World Wide Web Conference pp 151–161

  15. Yin R, Li K, Zhang G, Lu J (2019) A deeper graph neural network for recommender systems. Knowl Based Syst 185:105020

    Article  Google Scholar 

  16. Zhang F, Yuan NJ, Lian D, Xie X, Ma WY (2016) Collaborative knowledge base embedding for recommender systems, in: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining pp 353–362

  17. Piao G, Breslin JG (2018) Transfer learning for item recommendations and knowledge graph completion in item related domains via a co-factorization model, European Semantic Web Conference, Springer pp 496–511

  18. Wang H, Zhang F, Zhao M, Li W, Xie X, Guo M (2019) Multi-task feature learning for knowledge graph enhanced recommendation, in: World Wide Web Conference pp 2000–2010

  19. Sun Z, Yang J, Zhang J, Bozzon A, Huang LK, Xu C (2018) Recurrent knowledge graph embedding for effective recommendation, in: Proceedings of the 12th ACM Conference on Recommender Systems pp 297–305

  20. Hu B, Shi C, Zhao WX, Yu PS (2018) Leveraging meta-path based context for top-n recommendation with a neural co-attention model, in: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining pp 1531–1540

  21. Yu X, Ren X, Sun Y, Sturt B, Khandelwal U, Gu Q, Norick B, Han J (2013) Recommendation in heterogeneous information networks with implicit user feedback, in: Proceedings of the 7th ACM conference on Recommender systems pp 347–350

  22. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2012) BPR: Bayesian personalized ranking from implicit feedback, ArXiv e-prints

  23. Yu X, Ren X, Sun Y, Gu Q, Sturt B, Khandelwal U,. Norick B, Han J (2014) Personalized entity recommendation: a heterogeneous information network approach, in: Proceedings of the 7th ACM international conference on Web search and data mining pp. 283–292

  24. Shi C, Zhang Z, Luo P, Yu PS, Yue Y, Wu B (2015) Semantic path based personalized recommendation on weighted heterogeneous information networks, in: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management pp 453–462

  25. Dong Y, Chawla NC, Swami A (2017) metapath2vec: Scalable representation learning for heterogeneous networks, in: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining pp 135–144.

  26. Shi C, Hu B, Zhao WX, Philip SY (2018) Heterogeneous information network embedding for recommendation. IEEE Trans Knowl Data Eng 31(2):357–370

    Article  Google Scholar 

  27. Wang H, Zhao M, Xie X, Li W, Guo M (2019) Knowledge graph convolutional networks for recommender systems, in: Proceedings of the World Wide Web Conference pp 3307–3313

  28. Ying R, He R, Chen K, Eksombatchai P, Hamilton WL, Leskovec J (2018) Graph convolutional neural networks for web-scale recommender systems, in: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining pp 974–983

  29. Wang X, He X, Cao Y, Liu M, Chua TS (2019) Kgat: knowledge graph attention network for recommendation, in: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining pp 950–958

  30. Wang Z, Lin G, Tan H, Chen Q, Liu X (2020) CKAN: collaborative knowledge-aware attentive network for recommender systems, in: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 219–228

  31. Zhou J, Cui G, Hu S, Zhang Z, Yang C, Liu Z, Wang L, Li C, Sun M (2020) Graph neural networks: a review of methods and applications. AI Open 1:57–81

    Article  Google Scholar 

  32. Bruna J, Zaremba W, Szlam A, LeCun Y (2013) Spectral networks and locally connected networks on graphs, ArXiv e-prints

  33. Micheli A (2009) Neural network for graphs: a contextual constructive approach. IEEE Trans Neural Networks 20(3):498–511

    Article  MathSciNet  Google Scholar 

  34. Velickovic, P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2017) Graph attention networks, ArXiv e-prints

  35. Zhuang C, Ma Q (2018) Dual graph convolutional networks for graph-based semi-supervised classification, in: Proceedings of the 2018 World Wide Web Conference pp 499–508

  36. Hsu C, Li CT (2021) RetaGNN: relational temporal attentive graph neural networks for holistic sequential recommendation, in: Proceedings of the Web Conference pp 2968–2979

  37. He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: simplifying and powering graph convolution network for recommendation, in: Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval pp 639–648

  38. Liu F, Cheng Z, Zhu L, Gao Z, Nie L (2021) Interest-aware message-passing gcn for recommendation, in: Proceedings of the Web Conference, pp 1296–1305

  39. Guo Q, Zhuang F, Qin C, Zhu H, Xie X, Xiong H, He Q (2020) A survey on knowledge graph-based recommender systems IEEE Transactions Knowl Data Eng

  40. Memisevic R, Zach C, Pollefeys M, Hinton GE (2010) Gated softmax classification. Adv Neural Information Process Syst 23(2010):1603–1611

    Google Scholar 

  41. Sang L, Xu M, Qian S, Wu X (2021) Knowledge graph enhanced neural collaborative recommendation. Expert Syst Appl 164:113992

    Article  Google Scholar 

  42. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization, ArXiv e-prints

  43. Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks, in: Proceedings of the thirteenth international conference on artificial intelligence and statistics, JMLR Workshop and Conference Proceedings 9:249-256

  44. Shani G, Gunawardana A (2011) Evaluating recommendation systems, In: Ricci F, Rokach L, Shapira B, Kantor P (eds) Recommender Systems Handbook. Springer, Boston, MA, pp 257-297

  45. Halim Z, Rehan M (2020) On identification of driving-induced stress using electroencephalogram signals: A framework based on wearable safety-critical scheme and machine learning. Inf Fusion 53:66–79

    Article  Google Scholar 

Download references

Acknowledgements

The authors are indebted to the editor and anonymous reviewers for their helpful comments and suggestions during multiple revisions. The authors would like to thank GIK Institute for providing research facilities. This work was supported by the GIK Institute graduate program research fund under the GA-F scheme.

Author information

Authors and Affiliations

  1. Faculty of Computer Science and Engineering, The Machine Intelligence Research Group (MInG), Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Topi, Pakistan

    Ehsan Elahi & Zahid Halim

Authors
  1. Ehsan Elahi
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zahid Halim
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Zahid Halim.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Elahi, E., Halim, Z. Graph attention-based collaborative filtering for user-specific recommender system using knowledge graph and deep neural networks. Knowl Inf Syst 64, 2457–2480 (2022). https://doi.org/10.1007/s10115-022-01709-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-022-01709-1

Keywords