Abstract
This paper continues the work by Wang et al. [17]. Its goal is to verify the robustness of the NGCF (Neural Graph Collaborative Filtering) technique by assessing its ability to generalize across different datasets. To achieve this, we first replicated the experiments conducted by Wang et al. [17] to ensure that their replication package is functional. We received sligthly better results for ndcg@20 and somewhat poorer results for recall@20, which may be due to the randomness. Afterward, we applied their framework to four additional datasets (NYC2014, TOKYO2014, Yelp2022, and MovieLens1M) and compared NGCF with HOP-Rec [18] and MF-BPR [14] as in the original study. Our results confirm that NGCF outperforms other models in terms of ndcg@20. However, when considering recall@20, either HOP-Rec or MF-BPR performed better on the new datasets. This finding suggests that NGCF may have been optimized for the datasets used in the original paper. Furthermore, we analyzed the models’ performance using recall@K and ndcg@K, where K was set to 1, 5, 10, and 40. The obtained results support our previous finding. The replication package for this paper can be found in our GitHub repository [1].
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
https://github.com/dariuszkobiela/ngcf-neural-graph-collaborative-filtering
https://snap.stanford.edu/data/loc gowalla.html: Gowalla dataset
Harper, F.M., Konstan., J.A.: The movielens datasets: History and context. ACM Trans. Interact. Intell. Syst.(TiiS) 5, 4, Article 19 (December 2015), 19 (2015). https://doi.org/10.1145/2827872
He, R., McAuley, J.: Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering, pp. 507–517 (2016). https://doi.org/10.1145/2872427.2883037
He, R., McAuley, J.: VBPR: Visual bayesian personalized ranking from implicit feedback, pp. 144–150 (2016)
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.S.: Neural collaborative filtering (2017)
Herlocker, J.L., Konstan, J.A., Borchers, A., Riedl, J.: An algorithmic framework for performing collaborative filtering, pp. 230–237. SIGIR ’99, Association for Computing Machinery, New York, NY, USA (1999). https://doi.org/10.1145/312624.312682
https://recbole.io/dataset_list.html: Recbole dataset list
Karpus., A., Raczyńska., M., Przybylek., A.: Things you might not know about the k-nearest neighbors algorithm, pp. 539–547. INSTICC, SciTePress (2019). https://doi.org/10.5220/0008365005390547
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24–26, 2017, Conference Track Proceedings. OpenReview.net (2017). https://openreview.net/forum?id=SJU4ayYgl
Liang, D., Charlin, L., McInerney, J., Blei, D.M.: Modeling user exposure in recommendation (2015). https://doi.org/10.48550/ARXIV.1510.07025
McAuley, J., Leskovec, J.: Hidden factors and hidden topics: Understanding rating dimensions with review text, pp. 165–172 (10 2013). https://doi.org/10.1145/2507157.2507163
Pan, R. Yu, Q., Xiong, H., Liu, Z.: Recommendation algorithm based on deep graph neural network. J. Comput. Appl. http://www.joca.cn/EN/10.11772/j.issn.1001-9081.2022091361
Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: Bpr: Bayesian personalized ranking from implicit feedback. In: Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence, UAI 2009 (2012)
Sun, W., Chang, K., Zhang, L., Meng, K.: INGCF: An improved recommendation algorithm based on NGCF. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds.) Algorithms and Architectures for Parallel Processing, pp. 116–129. Springer International Publishing, Cham (2022)
Tsai, Y.C., Guan, M., Li, C.T., Cha, M., Li, Y., Wang, Y.: Predicting new adopters via socially-aware neural graph collaborative filtering. In: Tagarelli, A., Tong, H. (eds.) Computational Data and Social Networks, pp. 155–162. Springer International Publishing, Cham (2019)
Wang, X., He, X., Wang, M., Feng, F., Chua, T.S.: Neural graph collaborative filtering, pp. 165–174. SIGIR’19, Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3331184.3331267
Yang, J.H., Chen, C.M., Wang, C.J., Tsai, M.F.: Hop-rec: High-order proximity for implicit recommendation, pp. 140–144. RecSys ’18, Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3240323.3240381
Yaqi, L., Shuzhen, F., Lingyu, W., Chong, H., Ruixue, W.: Neural graph collaborative filtering for privacy preservation based on federated transfer learning 40(6), 729–742 (2022). https://doi.org/10.1108/EL-06-2022-0141
Acknowledgements
Computations were carried out using the computers of Centre of Informatics Tricity Academic Supercomputer & Network (https://task.gda.pl).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kobiela, D., Groth, J., Sieczczyński, M., Wolniak, R., Pastuszak, K. (2023). Neural Graph Collaborative Filtering: Analysis of Possibilities on Diverse Datasets. In: Abelló, A., et al. New Trends in Database and Information Systems. ADBIS 2023. Communications in Computer and Information Science, vol 1850. Springer, Cham. https://doi.org/10.1007/978-3-031-42941-5_54
Download citation
DOI: https://doi.org/10.1007/978-3-031-42941-5_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42940-8
Online ISBN: 978-3-031-42941-5
eBook Packages: Computer ScienceComputer Science (R0)