Skip to main content

Graph Contrastive Learning with Hybrid Noise Augmentation for Recommendation

  • Conference paper
  • First Online:
Advanced Data Mining and Applications (ADMA 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14179))

Included in the following conference series:

  • 769 Accesses

Abstract

Recommendation System is one of the effective tools to solve the problem of information overload in the era of big data, but the data sparsity has greatly affected its performance. Recently, contrastive learning, has attracted great attention and is expected to solve this problem. However, most of the existing graph-based contrastive learning methods perturb the original graph for data enhancement, which may affect the recommended performance. Meanwhile, studies have shown that improving the uniformity of data distribution is more important than data augmentation by graph perturbation. In this paper, in order to improve the uniformity of the data distribution, we propose a Graph Contrastive Learning with Hybrid Noise Augmentation for Recommendation, which is abbreviated as GCLHANRec. Specifically, we add uniform distribution random noise to users and normal distribution random noise to items, to improve the data uniformity while increasing the user’s interest diversity for different items, thereby improving the accuracy and personalization degree of the recommendation system. Additionally, we propose Balanced Bayesian Personalized Ranking (BBPR) as the loss function for recommendation tasks, which is a modification of BPR to better make the model pay more attention to the difference between positive and negative samples, thus performing better in ranking tasks. We conducted extensive experiments using three datasets collected from actual environment, including Movielens, LastFM and Douban-book. The results show that our method outperforms several existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://grouplens.org/datasets/movielens/1m/.

  2. 2.

    http://challenges.2014.eswc-conferences.org/index.php/RecSys.

  3. 3.

    http://www.cp.jku.at/datasets/LFM-1b/.

References

  1. Li, Y., Zhou, T., Yang, K., et al.: Personalized recommender systems based on social relationships and historical behaviors. Appl. Math. Comput. 437, 127549 (2023)

    Article  MathSciNet  Google Scholar 

  2. Liu, T., Wu, Q., Chang, L., et al.: A review of deep learning-based recommender system in e-learning environments. Artif. Intell. Rev. 55(8), 5953–5980 (2022)

    Article  Google Scholar 

  3. Roy, D., Dutta, M., et al.: Optimal hierarchical attention network-based sentiment analysis for movie recommendation. Soc. Netw. Anal. Min. 12(1), 138 (2022)

    Article  Google Scholar 

  4. Zhang, H., Wang, H., Wang, G., et al.: A hyperbolic-to-hyperbolic user representation with multi-aspect for social recommendation. In: ACM International Conference on Information & Knowledge Management, pp. 4667–4671 (2022)

    Google Scholar 

  5. Qiu, Z., Hu, Y., Wu, X.: Graph neural news recommendation with user existing and potential interest modeling. ACM Trans. Knowl. Discov. Data 16(5), 96:1-96:17 (2022)

    Article  Google Scholar 

  6. Tao, Y., Li, Y., Zhang, S., et al.: Revisiting graph based social recommendation: a distillation enhanced social graph network. In: WWW, pp. 2830–2838 (2022)

    Google Scholar 

  7. Wang, J., Chen, Y., Wang, Z., et al.: Popularity-enhanced news recommendation with multi-view interest representation. In: CIKM, pp. 1949–1958 (2021)

    Google Scholar 

  8. Shi, C., Han, X., Song, L., et al.: Deep collaborative filtering with multi-aspect information in heterogeneous networks. IEEE Trans. Knowl. Data Eng. 33(4), 1413–1425 (2021)

    Article  Google Scholar 

  9. Wang, X., He, X., Wang, M., et al.: Neural graph collaborative filtering. In: SIGIR, pp. 165–174 (2019)

    Google Scholar 

  10. Dong, X., Yu, L., Wu, Z., et al.: A hybrid collaborative filtering model with deep structure for recommender systems. In: AAAI, pp. 1309–1315 (2017)

    Google Scholar 

  11. Pérez-Almaguer, Y., Yera, R., Alzahrani, A.A., et al.: Content-based group recommender systems: a general taxonomy and further improvements. Expert Syst. Appl. 115444 (2021)

    Google Scholar 

  12. Peng, Y.: A survey on modern recommendation system based on big data. CoRR, abs/2206.02631 (2022)

    Google Scholar 

  13. Joshi, A., Wong, C., de Oliveira, D.M., et al.: Imbalanced data sparsity as a source of unfair bias in collaborative filtering. In: RecSys, pp. 531–533 (2022)

    Google Scholar 

  14. Elahi, E., Halim, Z.: Graph attention-based collaborative filtering for user-specific recommender system using knowledge graph and deep neural networks. Knowl. Inf. Syst. 64(9), 2457–2480 (2022)

    Article  Google Scholar 

  15. Chen, T., Kornblith, S., Norouzi, M., Hinton, G.E.: A simple framework for contrastive learning of visual representations. In: PMLR, pp. 1597–1607 (2020)

    Google Scholar 

  16. Zeng, J., Xie, P.: Contrastive self-supervised learning for graph classification. In: AAAI, pp. 10824–10832 (2021)

    Google Scholar 

  17. You, Y., Chen, T., Sui, Y., et al.: Graph contrastive learning with augmentations. In: NeurIPS (2020)

    Google Scholar 

  18. Jaiswal, A., Babu, A.B., Zadeh, M.Z., et al.: A survey on contrastive self-supervised learning. CoRR, abs/2011.00362 (2020)

    Google Scholar 

  19. Hassani, K., Khas Ahmadi, A.H.: Contrastive multi-view representation learning on graphs. In: ICML, pp. 4116–4126 (2020)

    Google Scholar 

  20. Yu, J., Yin, H., Xia, X., et al.: Self-supervised learning for recommender systems: a survey. CoRR, abs/2203.15876 (2022)

    Google Scholar 

  21. Liu, Z., Ma, Y., Ouyang, Y., et al.: Contrastive learning for recommender system. CoRR, abs/2101.01317 (2021)

    Google Scholar 

  22. Yu, J., Yin, H., Gao, M., et al.: Socially-aware self-supervised tri-training for recommendation. In: KDD, pp. 2084–2092 (2021)

    Google Scholar 

  23. Wu, J., Wang, X., Feng, F., et al.: Self-supervised graph learning for recommendation. In: SIGIR, pp. 726–735 (2021)

    Google Scholar 

  24. Lin, Z., Tian, C., Hou, Y., et al.: Improving graph collaborative filtering with neighborhood-enriched contrastive learning. In: WWW, pp. 2320–2329 (2022)

    Google Scholar 

  25. Yu, J., Xia, X., Chen, T., et al.: XSimGCL: towards extremely simple graph contrastive learning for recommendation. CoRR, abs/2209.02544 (2022)

    Google Scholar 

  26. Zhang, J., Gao, M., Yu, J., et al.: Double-scale self-supervised hypergraph learning for group recommendation. In: CIKM, pp. 2557–2567 (2021)

    Google Scholar 

  27. Zhou, X., Sun, A., Liu, Y., et al.: SelfCF: a simple framework for self-supervised collaborative filtering. CoRR, abs/2107.03019 (2021)

    Google Scholar 

  28. Ying, R., He, R., Chen, K., et al.: Graph convolutional neural networks for web-scale recommender systems. In: KDD, pp. 974–983 (2018)

    Google Scholar 

  29. Xue, F., He, X., Wang, X., et al.: Deep item-based collaborative filtering for top-n recommendation. ACM Trans. Inf. Syst. 37(3), 33:1-33:25 (2019)

    Article  Google Scholar 

  30. He, X., Deng, K., Wang, X., et al.: LightGCN: simplifying and powering graph convolution network for recommendation. In: SIGIR, pp. 639–648 (2020)

    Google Scholar 

  31. Chen, L., Wu, L., Hong, R., et al.: Revisiting graph based collaborative filtering: a linear residual graph convolutional network approach. In: IAAI, pp. 27–34 (2020)

    Google Scholar 

  32. Huang, T., Dong, Y., Ding, M., et al.: MixgCF: an improved training method for graph neural network-based recommender systems. In: KDD, pp. 665–674 (2021)

    Google Scholar 

  33. Yu, J., Yin, H., Xia, X., et al.: Graph augmentation-free contrastive learning for recommendation. CoRR, abs/2112.08679 (2021)

    Google Scholar 

  34. Rendle, S., Freudenthaler, C., Gantner, Z., et al.: BPR: Bayesian personalized ranking from implicit feedback. In: UAI, pp. 452–461 (2009)

    Google Scholar 

  35. Oord, A.V.D., Li, Y., Vinyals, O.: Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018)

  36. Wang, F., Liu, H.: Understanding the behaviour of contrastive loss. In: CVPR, pp. 2495–2504 (2021)

    Google Scholar 

  37. Koren, Y., Bell, R.M., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 30–37 (2009)

    Google Scholar 

  38. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)

    Google Scholar 

Download references

Acknowledgments

The work reported herein was supported by National Key R &D Program (2020YFB1406900), National Natural Science Foundation of China (62172324, 62102310), Key R &D in Shaanxi Province (2023-YBGY-269, 2022QCY-LL-33HZ).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tao Qin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhu, K., Qin, T., Wang, X., Chen, Z., Ding, J. (2023). Graph Contrastive Learning with Hybrid Noise Augmentation for Recommendation. In: Yang, X., et al. Advanced Data Mining and Applications. ADMA 2023. Lecture Notes in Computer Science(), vol 14179. Springer, Cham. https://doi.org/10.1007/978-3-031-46674-8_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-46674-8_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-46673-1

  • Online ISBN: 978-3-031-46674-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics