Skip to main content

Advertisement

Springer Nature Link
Log in

AKUPP: attention-enhanced joint propagation of knowledge and user preference for recommendation systems

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

As knowledge graphs have attracted enormous attention from researchers, much effort has been invested in recommendation systems to mine user preferences effectively. In particular, knowledge graphs, which convey useful side information about users and items, can provide more accurate and explainable recommendations. When it comes to interactions between entities, however, the majority of existing work fails to incorporate high-order relations that ensure recommendation accuracy. This paper proposes attention-enhanced joint knowledge and user preference propagation (AKUPP), which integrates two types of knowledge propagation. The first is propagating user preferences based on the users' history of interacting items through ripple sets. The second propagation employs an attention mechanism to emphasize the important semantics of relations, and with multiple layers, high-order relations are explored. Therefore, we successfully incorporate both side information and high-order relations in the knowledge graph. We show, via extensive experimentation on real-world datasets, that our approach outperforms numerous state-of-the-art baselines in terms of performance and accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. Codes are available at https://github.com/helenma27/AKUPP/.

References

  1. Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ACM SIGKDD, pp 426–434. https://doi.org/10.1145/1401890.1401944

  2. Sun Z, Guo Q, Yang J, Fang H, Guo G, Zhang J, Burke R (2019) Research commentary on recommendations with side information: a survey and research directions. Electron Commer Res Appl 37:100879. https://doi.org/10.1016/j.elerap.2019.100879

    Article  Google Scholar 

  3. Rendle S, Gantner Z, Freudenthaler C, Schmidt-Thieme L (2011) Fast context-aware recommendations with factorization machines. In: SIGIR, pp 635–644

  4. He X, Chua T (2017) Neural factorization machines for sparse predictive analytics. In: SIGIR, pp 355–364

  5. Guo H, Tang R, Ye Y, Li Z, He X (2017) DeepFM: a factorization-machine based neural network for CTR prediction. In: IJCAI, pp 1725–1731. https://doi.org/10.24963/ijcai.2017/239

  6. Guo Q, Zhuang F, Qin C, Zhu H, Xie X, Xiong H, He Q (2020) A survey on knowledge graph-based recommender systems. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2020.3028705

    Article  Google Scholar 

  7. Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multirelational data. In: Advances in neural information processing systems, pp 2787–2795

  8. Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: AAAI, pp 1112–1119

  9. Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. In: AAAI, pp 2181–2187

  10. Yu X, Ren X, Sun Y, Sturt B, Khandelwal U, Gu Q, Norick B, Han J (2013) Recommendation in heterogeneous information networks with implicit user feedback. In: RecSystem, pp 347– 350. https://doi.org/10.1145/2507157.2507230

  11. Sun Z, Yang J, Zhang J, Bozzon A, Huang LK, Xu C (2018) Recurrent knowledge graph embedding for effective recommendation. In: RecSys, pp 297–305. https://doi.org/10.1145/3240323.3240361

  12. Zhao H, Yao Q, Li J, Song Y, Lee DL (2017) Meta-graph based recommendation fusion over heterogeneous information networks. In: SIGKDD, pp 635–644. https://doi.org/10.1145/3097983.3098063

  13. Kipf T, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR 2017

  14. Kipf T, Welling M (2016) Variational graph auto-encoders. In: NIPS 2016

  15. Hamilton WL, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: NeurIPS, pp 1025–1035

  16. Veličković P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2018) Graph attention networks. In: ICLR

  17. Wang H, Zhang F, Wang J, Zhao M, Li W, Xie X, Guo M (2018) Ripplenet: propagating user preferences on the knowledge graph for recommender systems. In: CIKM, pp 417–426. https://doi.org/10.1145/3269206.3271739

  18. Wang X, He X, Cao Y, Liu M, Chua T-S (2019) KGAT: knowledge graph attention network for recommendation. In: SIGKDD, pp 950–958. https://doi.org/10.1145/3292500.3330989

  19. Wang Y, Dong L, Jiang X, Ma X, Li Y, Zhang H (2021) KG2Vec: a node2vec-based vectorization model for knowledge graph. PLoS ONE 16(3):e0248552. https://doi.org/10.1371/journal.pone.0248552

    Article  Google Scholar 

  20. He S, Liu K, Ji G, Zhao J (2015) Learning to represent knowledge graphs with Gaussian embedding. In: CIKM, pp 623–632. https://doi.org/10.1145/2806416.2806502

  21. Zhang F, Yuan NJ, Lian D, Xie X, Ma WY (2016) Collaborative knowledge base embedding for recommender systems. In: ACM SIGKDD, pp 353–362. https://doi.org/10.1145/2939672.2939673

  22. Xin X, He X, Zhang Y, Zhang Y, Jose J (2019) Relational collaborative filtering: modeling multiple item relations for recommendation. In: ACM SIGIR, pp 125–134. https://doi.org/10.1145/3331184.3331188

  23. Yu X, Ren X, Gu Q, Sun Y, Han J (2013) Collaborative filtering with entity similarity regularization in heterogeneous information networks. In: IJCAI

  24. Zhao H, Yao Q, Li J, Song Y, Lee DL (2017) Meta-graph based recommendation fusion over heterogeneous information networks. In: ACM SIGKDD, pp 635–644. https://doi.org/10.1145/3097983.3098063

  25. Hu B, Shi C, Zhao W, Yu PS (2018) Leveraging meta-path based context for Top-N recommendation with a neural co-attention model. In: SIGKDD, pp 1531–1540. https://doi.org/10.1145/3219819.3219965

  26. Wang H, Zhao M, Xie X, Li W, Guo M (2019) Knowledge graph convolutional networks for recommender systems. In: WWW, pp 3307–3313. https://doi.org/10.1145/3308558.3313417

  27. Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: ICLR

  28. Lin Z, Feng M, Nogueira dos Santos C, Yu M, Xiang B, Zhou B, Bengio Y (2017) A structured self-attentive sentence embedding. In: ICRL

  29. Chen J, Zhang H, He X, Nie L, Liu W, Chua T (2017) Attentive collaborative filtering: multimedia recommendation with item- and component-level attention. In: SIGIR, pp 335–344. https://doi.org/10.1145/3077136.3080797

  30. Xiao J, Ye H, He X, Zhang H, Wu F, Chua T (2017) Attentional factorization machines: learning the weight of feature interactions via attention networks. In: IJCAI, pp 3119–3125. https://doi.org/10.24963/ijcai.2017/435

  31. Tang X, Wang T, Yang H, Song H (2019) Akupm: attention enhanced knowledge-aware user preference model for recommendation. In: ACM SIGKDD, pp 1891–1899. https://doi.org/10.1145/3292500.3330705

  32. Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi K, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: ICML, vol 80, pp 5449–5458

  33. McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image based recommendations on styles and substitutes. In: ACM SIGIR, pp 43–52. https://doi.org/10.1145/2766462.2767755

  34. "Last-FM dataset" (2012). https://grouplens.org/datasets/hetrec-2011/

  35. "Yelp challenge dataset" (2013). https://www.yelp.com/dataset/challenge/

  36. Zhao W, He G, Dou H, Huang J, Ouyang S, Wen J (2019) KB4Rec: a dataset for linking knowledge bases with recommender systems. In: Data intelligence, pp 121–136. https://doi.org/10.1162/dint_a_00008

  37. Zhang Y, Ai Q, Chen X, Wang P (2018) Learning over knowledge-base embeddings for recommendation. Algorithms 11(9):137. https://doi.org/10.3390/a11090137

    Article  Google Scholar 

  38. Van den Berg R, Kipf T, Welling M (2017) Graph convolutional matrix completion. In: KDD

  39. Wang X, Wang D, Xu C, He X, Cao Y, Chua T (2019) Explainable reasoning over knowledge graphs for recommendation. In: AAAI, pp 5329–5336

Download references

Acknowledgements

We appreciate the comments from anonymous reviewers which will help further improve our work. This study has been partially supported by National Natural Science Foundation of China (61872164) and Program of Science and Technology Development Plan of Jilin Province of China (20190302032GX).

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Jilin University, Changchun, 130012, China

    Xintao Ma, Liyan Dong, Yuequn Wang & Hao Zhang

  2. Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, 130012, China

    Xintao Ma, Liyan Dong, Yuequn Wang & Hao Zhang

  3. School of Information Science and Technology, Northeast Normal University, Changchun, 130117, China

    Yongli Li

Authors
  1. Xintao Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liyan Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuequn Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yongli Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hao Zhang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, X., Dong, L., Wang, Y. et al. AKUPP: attention-enhanced joint propagation of knowledge and user preference for recommendation systems. Knowl Inf Syst 65, 163–182 (2023). https://doi.org/10.1007/s10115-022-01693-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-022-01693-6

Keywords