Skip to main content

Advertisement

Springer Nature Link
Log in

A cascaded embedding method with graph neural network for multi-behavior recommendation

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

In recommender systems, implicit feedback data is relatively cheap and easy to obtain compared to explicit feedback data, making it widely used in modeling. However, some works consider only single type of user behavior, while in reality, user feedback types are complex and diverse, with great semantic uncertainty. Graph neural networks (GNN) have gradually become a new paradigm in the recommendation field due to their excellent information extraction capabilities and good scalability. The common recommendation models based on GNN have high time complexity and ignore the contribution of different behaviors to user preferences. To address these challenges, we propose a Cascading Embedding method for Multi-Behavior Recommendation to explore high-order multi-relation interaction signals between users and items. Specifically, we associate different user behaviors in a specific order and design a relation-aware gating unit to extract user behavior patterns, learn node (user and item) and relation representations. To investigate the differential effects of different types of behavior on different users, a relation-level attention mechanism is proposed to automatically capture the importance of each behavior to user preferences. Finally, we perform the non-sampling optimization strategy based on the multi-task learning framework to fully utilize auxiliary behaviors in better predicting target behaviors. Experimental results on real datasets demonstrate that the proposed model outperforms current mainstream recommendation methods. Further analysis and verification show that multi-behavior modeling can provide more effective recommendations for users with sparse target behaviors. Our implementation code is available in https://github.com/jsp666/CEMBR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Chen C, Ma W, Zhang M et al (2021) Graph heterogeneous multi-relational recommendation. In: Proceedings of the AAAI conference on artificial intelligence, pp 3958–3966

  2. Chen C, Zhang M, Zhang Y et al (2020b) Efficient heterogeneous collaborative filtering without negative sampling for recommendation. In: Proceedings of the AAAI conference on artificial intelligence, pp 19–26

  3. Chen C, Zhang M, Zhang Y, et al (2020a) Efficient neural matrix factorization without sampling for recommendation. ACM Trans Inf Syst 38(2):14:1–14:28. https://doi.org/10.1145/3373807

  4. Ding J, Yu G, He X et al (2018) Improving implicit recommender systems with view data. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 3343–3349. https://doi.org/10.24963/ijcai.2018/464

  5. Fan W, Ma Y, Li Q et al (2019) Graph neural networks for social recommendation. In: The World Wide Web Conference, pp 417–426. https://doi.org/10.1145/3308558.3313488

  6. Gao C, He X, Gan D et al (2021) Learning to recommend with multiple cascading behaviors. IEEE Trans Knowl Data Eng 33(6):2588–2601. https://doi.org/10.1109/TKDE.2019.2958808

    Article  Google Scholar 

  7. Gao C, Wang X, He X et al (2022) Graph neural networks for recommender system. In: Proceedings of the fifteenth ACM international conference on web search and data mining, pp 1623–1625. https://doi.org/10.1145/3488560.3501396

  8. Guo G, Qiu H, Tan Z et al (2017) Resolving data sparsity by multi-type auxiliary implicit feedback for recommender systems. Knowl-Based Syst 138:202–207. https://doi.org/10.1016/j.knosys.2017.10.005

    Article  Google Scholar 

  9. Hamilton WL, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: Advances in neural information processing systems 30: annual conference on neural information processing systems, pp 1024–1034

  10. He X, Deng K, Wang X et al (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648. https://doi.org/10.1145/3397271.3401063

  11. He X, Liao L, Zhang H et al (2017) Neural collaborative filtering. CoRR arXiv:abs/1708.05031

  12. Huang C, Wang X, He X et al (2022) Self-supervised learning for recommender system. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval, pp 3440–3443. https://doi.org/10.1145/3477495.3532684

  13. Hussain MS, Zaki MJ, Subramanian D (2022) Global self-attention as a replacement for graph convolution. In: Proceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining, pp 655–665. https://doi.org/10.1145/3534678.3539296

  14. Jin B, Gao C, He X et al (2020) Multi-behavior recommendation with graph convolutional networks. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 659–668. https://doi.org/10.1145/3397271.3401072

  15. Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: 5th International conference on learning representations

  16. Klicpera J, Bojchevski A, Günnemann S (2019) Predict then propagate: graph neural networks meet personalized pagerank. In: 7th International conference on learning representations

  17. Krohn-Grimberghe A, Drumond L, Freudenthaler C et al (2012) Multi-relational matrix factorization using bayesian personalized ranking for social network data. In: Proceedings of the Fifth international conference on web search and web data mining, pp 173–182. https://doi.org/10.1145/2124295.2124317

  18. Kumar C, Abuzar M, Kumar M (2023) Mgu-gnn: minimal gated unit based graph neural network for session-based recommendation. Appl Intell:1–19

  19. Li X, Liu Z, Guo S et al (2021) Pre-training recommender systems via reinforced attentive multi-relational graph neural network. In: 2021 IEEE international conference on big data (big data), IEEE, pp 457–468

  20. Li X, Liu Y, Liu Z et al (2022) Time-aware hyperbolic graph attention network for session-based recommendation. In: 2022 IEEE international conference on big data (big data), IEEE, pp 626–635

  21. Liu Z, Li X, Fan Z et al (2020) Basket recommendation with multi-intent translation graph neural network. In: 2020 IEEE international conference on big data (big data), IEEE, pp 728–737

  22. Li X, Zhang M, Wu S et al (2020) Dynamic graph collaborative filtering. In: 2020 IEEE international conference on data mining (ICDM), IEEE, pp 322–331

  23. Loni B, Pagano R, Larson MA et al (2016) Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM conference on recommender systems, pp 361–364. https://doi.org/10.1145/2959100.2959163

  24. Luo X, Wu D, Chen C et al (2021) Criterion-based heterogeneous collaborative filtering for multi-behavior implicit recommendation. CoRR arXiv:abs/2105.11876

  25. Qiu H, Liu Y, Guo G et al (2018) BPRH: Bayesian personalized ranking for heterogeneous implicit feedback. Inf Sci 453:80–98. https://doi.org/10.1016/j.ins.2018.04.027

    Article  Google Scholar 

  26. Schlichtkrull MS, Kipf TN, Bloem P et al (2018) Modeling relational data with graph convolutional networks. In: The semantic web—15th international conference, ESWC 2018, pp 593–607. https://doi.org/10.1007/978-3-319-93417-4_38

  27. Sharma K, Lee Y, Nambi S et al (2022) A survey of graph neural networks for social recommender systems. CoRR arXiv:abs/2212.04481

  28. Singh AP, Gordon GJ (2008) Relational learning via collective matrix factorization. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 650–658. https://doi.org/10.1145/1401890.1401969

  29. van den Berg R, Kipf TN, Welling M (2017) Graph convolutional matrix completion. CoRR arXiv:abs/1706.02263

  30. Vashishth S, Sanyal S, Nitin V et al (2020) Composition-based multi-relational graph convolutional networks. In: 8th International conference on learning representations

  31. Velickovic P, Cucurull G, Casanova A et al (2017) Graph attention networks. CoRR arXiv:abs/1710.10903

  32. Wang X, He X, Cao Y et al (2019b) KGAT: knowledge graph attention network for recommendation. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 950–958. https://doi.org/10.1145/3292500.3330989

  33. Wang X, He X, Wang M et al (2019c) Neural graph collaborative filtering. In: Proceedings of the 42nd International ACM SIGIR conference on research and development in information retrieval, pp 165–174. https://doi.org/10.1145/3331184.3331267

  34. Wang X, Ji H, Shi C et al (2019d) Heterogeneous graph attention network. In: The World Wide Web conference, pp 2022–2032. https://doi.org/10.1145/3308558.3313562

  35. Wang H, Zhao M, Xie X et al (2019a) Knowledge graph convolutional networks for recommender systems. In: The World Wide Web Conference, WWW 2019, San Francisco, CA, USA, May 13–17, 2019, pp 3307–3313. https://doi.org/10.1145/3308558.3313417

  36. Wu L, Sun P, Fu Y et al (2019) A neural influence diffusion model for social recommendation. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 235–244. https://doi.org/10.1145/3331184.3331214

  37. Wu S, Sun F, Zhang W et al (2023) Graph neural networks in recommender systems: a survey. ACM Comput Surv 55(5):97:1–97:37. https://doi.org/10.1145/3535101

  38. Xia L, Huang C, Xu Y et al (2021a) Knowledge-enhanced hierarchical graph transformer network for multi-behavior recommendation. In: Proceedings of the AAAI conference on artificial intelligence, pp 4486–4493

  39. Xia L, Xu Y, Huang C et al (2021b) Graph meta network for multi-behavior recommendation. In: Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, pp 757–766. https://doi.org/10.1145/3404835.3462972

  40. Yi Z, Yiwen Z, Dengcheng Y et al (2023) Revisiting graph-based recommender systems from the perspective of variational auto-encoder. ACM Trans Inf Syst. https://doi.org/10.1145/3573385

    Article  Google Scholar 

  41. Ying R, He R, Chen K et al (2018) Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 974–983. https://doi.org/10.1145/3219819.3219890

  42. Yu L, Sun L, Du B et al (2022) Heterogeneous graph representation learning with relation awareness. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2022.3160208

    Article  Google Scholar 

  43. Zhang M, Chen Y (2020) Inductive matrix completion based on graph neural networks. In: 8th International conference on learning representations

  44. Zhang W, Mao J, Cao Y et al (2020) Multiplex graph neural networks for multi-behavior recommendation. In: Proceedings of the 29th ACM international conference on information & knowledge management, pp 2313–2316. https://doi.org/10.1145/3340531.3412119

  45. Zhang C, Song D, Huang C et al (2019) Heterogeneous graph neural network. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 793–803

  46. Zhao Z, Cheng Z, Hong L et al (2015) Improving user topic interest profiles by behavior factorization. In: Proceedings of the 24th international conference on World Wide Web, pp 1406–1416. https://doi.org/10.1145/2736277.2741656

Download references

Acknowledgements

This work was supported by Handan City Science and Technology Research and Development Program (19422031008-15).

Author information

Authors and Affiliations

  1. School of Information and Electrical Engineering, Hebei University of Engineering, Handan, Hebei, China

    Shaopeng Jiang & Chao Zhao

Authors
  1. Shaopeng Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chao Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All the authors have contributed equally

Corresponding author

Correspondence to Chao Zhao.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, S., Zhao, C. A cascaded embedding method with graph neural network for multi-behavior recommendation. Int. J. Mach. Learn. & Cyber. 15, 2513–2526 (2024). https://doi.org/10.1007/s13042-023-02045-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-02045-8

Keywords