Skip to main content
SpringerLink
Log in

Deep GraphSAGE-based recommendation system: jumping knowledge connections with ordinal aggregation network

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Recommendation systems have become based on graph neural networks (GNN) as many fields, and this is due to the advantages that represent this kind of neural networks compared to the classical ones; notably, the representation of concrete realities by taking the relationships between data into consideration and understanding them in a better way. In this paper, we have proposed an item-based recommender system using a deep GraphSAGE model, which learns item embeddings from the user–item matrix and uses them for recommending items that are similar to the ones that users have interacted with before. Furthermore, we have discussed the common problems that usually arise when using deep GNN-based architectures, and which can negatively affect the performance of our recommender system, in particular, the over-smoothing problem. To this end, we have integrated the Jumping Knowledge connections (JK) strategy in our system, using a new method called Ordinal Aggregation Network (OAN) as a layer aggregator to tackle this kind of problem. To evaluate the recommendations, we have used the required metrics that are designated for this purpose: Hits@n and NDCG@n, and we have also measured the duration of training of every model. The experimental results that we have made show that our method has improved the performance of a recommender system concretely and efficiently compared to other aggregation methods. In addition, they have suggested that deep GraphSAGE with Jumping Knowledge connections (JK) would be empirically promising.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17:734–749

    Article  Google Scholar 

  2. Song Z, Sun Y, Wan J, Huang L, Zhu J (2019) Smart e-commerce systems: current status and research challenges. Electron Mar 29(2):1–18

    Google Scholar 

  3. Park J, Nam K-E (2018) Group recommender system for store product placement. Data Min Knowl Discov 33:204–229

    Article  Google Scholar 

  4. Lin C-Y, Chen H-S (2018) Personalized channel recommendation on live streaming platforms. Multimed Tools Appl 78:1999–2015

    Article  Google Scholar 

  5. Hadida AL, Lampel J, Walls WD, Joshi AM (2020) Hollywood studio filmmaking in the age of Netflix: a tale of two institutional logics. J Cult Econ 45(2):1–26

    Google Scholar 

  6. Raza S, Ding C (2021) News recommender system: a review of recent progress, challenges, and opportunities. Artif Intell Rev 55(1):1–52

    Google Scholar 

  7. Kim K, Kim J, Kim M, Sohn MM (2020) User interest-based recommender system for image-sharing social media. World Wide Web 24(3):1–23

    Google Scholar 

  8. Deng W, Shi Y, Chen Z, Kwak W, Tang H (2019) Recommender system for marketing optimization. World Wide Web 23:1497–1517

    Article  Google Scholar 

  9. El Alaoui D, Riffi J, Aghoutane B, Sabri A, Yahyaouy A, Tairi H (2021) Overview of the main recommendation approaches for the scientific articles. In: Business intelligence. CBI 2021. Lecture Notes in Business Information Processing, vol 416. Springer, Cham, pp 107–118. https://doi.org/10.1007/978-3-030-76508-8_9

  10. Huang T, Zhang D, Bi L (2020) Neural embedding collaborative filtering for recommender systems. Neural Comput Appl 32(22):1–15

    Article  Google Scholar 

  11. Natarajan SR, Vairavasundaram S, Viloria A, Vijayakumar V, Natarajan S (2020) A deep learning-based hybrid model for recommendation generation and ranking. Neural Comput Appl 33(17):1–18

    Google Scholar 

  12. Wu S, Zhang W, Sun F, Cui B, (2020) Graph neural networks in recommender systems: a survey. arXiv: https://arxiv.org/abs/2011.02260

  13. Koren Y, Bell RM, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer (Long. Beach. Calif) 42(8):30–37

    Google Scholar 

  14. Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. In: NIPS

  15. Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: NIPS

  16. Kim D, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems

  17. Wang H, Wang N, Yeung D-Y (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining

  18. Kang W-C, Fang C, Wang Z, McAuley J (2017) Visually-aware fashion recommendation and design with generative image models. In: 2017 IEEE international conference on data min, pp 207–216

  19. Wang S, Wang Y, Tang J, Shu K, Ranganath S, Liu H, (2017) What your images reveal: exploiting visual contents for point-of-interest recommendation. In: Proceedings of the 26th international conference on World Wide Web

  20. He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on World Wide Web

  21. Sedhain S, Menon AK, Sanner S, Xie L (2015) AutoRec: autoencoders meet collaborative filtering. In: Proceedings of the 24th international conference on World Wide Web

  22. Wu Y, DuBois C, Zheng AX, Ester M (2016) Collaborative denoising auto-encoders for Top-N recommender systems. In: proceedings of the ninth ACM international conference on web search data min

  23. Liu X et al (2021) Privacy and security issues in deep learning: a survey. IEEE Access 9:4566–4593

    Article  Google Scholar 

  24. Tramèr F, Zhang F, Juels A, Reiter MK, Ristenpart T (2016) Stealing machine learning models via prediction APIs. In: USENIX security symposium

  25. Wang B, Gong NZ (2018) Stealing hyperparameters in machine learning. In: 2018 IEEE symposium on security and privacy, pp 36–52

  26. Shokri R, Stronati M, Song C, Shmatikov V (2017) membership inference attacks against machine learning models. In: 2017 IEEE symposium on security and privacy, pp 3–18

  27. C. Szegedy et al., (2014) Intriguing properties of neural networks. CoRR. arXiv: https://arxiv.org/abs/1312.6199

  28. Tao Y, Wang C, Yao L, Li W, Yu Y, (2021) Item trend learning for sequential recommendation system using gated graph neural network. Neural Comput, Appl, pp 1–16

  29. He R, McAuley J (2016) Fusing similarity models with markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data min, pp 191–200

  30. Rendle S, Freudenthaler C, Schmidt-Thieme L, (2010) Factorizing personalized Markov chains for next-basket recommendation. In: World Wide Web

  31. Hidasi B, Karatzoglou A (2018) Recurrent neural networks with Top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management

  32. Tan YK, Xu X, Liu Y (2016) Improved recurrent neural networks for session-based recommendations. In: Proceedings of the 1st workshop on deep learning for recommender systems

  33. Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on conference information and knowledge management

  34. Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) STAMP: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery and data mining

  35. Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining, pp 197–206

  36. Sun et al., (2019) BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management

  37. Sarwar BM, Karypis G, Konstan JA, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: World Wide Web

  38. Scarselli F, Gori M, Tsoi AC, Hagenbuchner M, Monfardini G (2009) The graph neural network model. IEEE Trans Neural Netw 20:61–80

    Article  Google Scholar 

  39. Kipf T, Welling M (2017) Semi-supervised classification with graph convolutional networks. arXiv: https://arxiv.org/abs/1609.02907

  40. Hamilton WL, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: NIPS

  41. Velickovic P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2018) Graph attention networks. arXiv: https://arxiv.org/abs/1710.10903

  42. Li Y, Tarlow D, Brockschmidt M, Zemel RS (2016) Gated graph sequence neural networks. In: CoRR. arXiv: https://arxiv.org/abs/1511.05493

  43. Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi K, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: ICML

  44. Chen L, Wu L, Hong R, Zhang K, Wang M (2020) Revisiting graph based collaborative filtering: a linear residual graph convolutional network approach. arXiv: https://arxiv.org/abs/2001.10167

  45. Jin B, Gao C, He X, Jin D, Li Y (2020) Multi-behavior recommendation with graph convolutional networks. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval

  46. Wang X, He X, Wang M, Feng F, Chua T-S (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval

  47. Zhang M, Chen Y (2020) Inductive matrix completion based on graph neural networks. arXiv: https://arxiv.org/abs/1904.12058

  48. Wang X, Jin H, Zhang A, He X, Xu T, Chua T-S (2020) Disentangled graph collaborative filtering. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval

  49. Liu Z, Meng L, Zhang J, Yu PS (2020) Deoscillated graph collaborative filtering. arXiv: https://arxiv.org/abs/2011.02100

  50. Xu Y, Zhang Y, Guo W, Guo H, Tang R, Coates MJ (2020) GraphSAIL: graph structure aware incremental learning for recommender systems. In: Proceedings of the 29th ACM international conference on information and knowledge management

  51. Li C, Jia K, Shen D, Shi C-JR, Yang H (2019) Hierarchical representation learning for bipartite graphs. In: IJCAI

  52. Wu L, Yang Y, Chen L, Lian D, Hong R, Wang M (2020) Learning to transfer graph embeddings for inductive graph based recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval

  53. Ning X, Karypis G (2011) SLIM: sparse linear methods for Top-N recommender systems. In: 2011 IEEE 11th international conference on data mining, pp 497–506

  54. Kabbur S, Ning X, Karypis G (2013) FISM: factored item similarity models for Top-N recommender systems. In: Proc. 19th ACM SIGKDD international conference on knowledge discovery and data mining

  55. Dong L et al (2018) CUNet: A compact unsupervised network for image classification. IEEE Trans Multimed 20:2012–2021

    Google Scholar 

  56. Deshpande M, Karypis G (2004) Item-based top-N recommendation algorithms. ACM Trans Inf Syst 22:143–177

    Article  Google Scholar 

  57. Järvelin K, Kekäläinen J (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Inf Syst 20:422–446

    Article  Google Scholar 

  58. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: bayesian personalized ranking from implicit feedback. In UAI

  59. He R, Kang W-C, McAuley J (2017) Translation-based recommendation. In: Proceedings eleventh ACM conference on recommender system

  60. Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2016) Session-based recommendations with recurrent neural networks. In: CoRR. arXiv:1511.06939

  61. Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2D knowledge graph embeddings. In AAAI

  62. Wang et al., (2018) RippleNet: propagating user preferences on the knowledge graph for recommender systems. In: Proceedings of the 27th ACM international conference on information and knowledge management

  63. van den Berg R, Kipf T, Welling M (2017) Graph convolutional matrix completion. arXiv:1706.02263

  64. Darban ZZ, Valipour MH (2021) GHRS: graph-based hybrid recommendation system with application to movie recommendation. arXiv: https://arxiv.org/abs/2111.11293

  65. Shen et al., (2021) Inductive matrix completion using graph autoencoder. In: Proceedings of the 30th ACM international conference on information and knowledge managements

Download references

Author information

Author notes

  1. Jamal Riffi, Abdelouahed Sabri, Badraddine Aghoutane, Ali Yahyaouy and Hamid Tairi have contributed equally.

Authors and Affiliations

  1. LISAC Laboratory, Department of Informatics, Faculty of Sciences Dhar El Mahraz, Sidi Mohamed Ben Abdellah University, 1796, Fez-Atlas, Fez, Morocco

    Driss El Alaoui, Jamal Riffi, Abdelouahed Sabri, Ali Yahyaouy & Hamid Tairi

  2. Team of Processing and Transformation of Information Polydisciplinary Faculty of Errachidia, Moulay Ismaïl University, 11201, Zitoune Meknes, Morocco

    Badraddine Aghoutane

Authors
  1. Driss El Alaoui
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jamal Riffi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdelouahed Sabri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Badraddine Aghoutane
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ali Yahyaouy
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hamid Tairi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Driss El Alaoui.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

El Alaoui, D., Riffi, J., Sabri, A. et al. Deep GraphSAGE-based recommendation system: jumping knowledge connections with ordinal aggregation network. Neural Comput & Applic 34, 11679–11690 (2022). https://doi.org/10.1007/s00521-022-07059-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07059-x

Keywords

Search

Navigation