Skip to main content

Generative Adversarial Networks Based on Contrastive Learning for Sequential Recommendation

  • Conference paper
  • First Online:
Web and Big Data (APWeb-WAIM 2023)

Abstract

Generative Adversarial Networks(GAN) has made key breakthroughs in computer vision and other fields, so some scholars have tried to apply it to sequential recommendation. However, the recommendation performance of GAN-based algorithms is unsatisfactory. The reason for this is that the discriminator cannot distinguish the original data from the generated data well if it only relies on the target function. Based on this, we propose Generative Adversarial Networks based on Contrastive Learning for sequential recommendation (shortened to CtrGAN). Firstly, the generator generates item sequences that the user may be interested in. Additionally, the true item sequences of the user are subjected to a mask operation, which means that the sequences with mask operation are fake. Therefore, both generative sequences and fake sequences can be used in Contrastive Learning to train the generator. The true sequences and their mask operations are then combined with the generative sequences to employ the discriminator for distinguishing them. Finally, the contrastive loss and discriminative loss are combined to guide the generator to generate item sequences that the user may be interested in. Compared with existing sequential recommendation algorithms, experimental results illustrate that CtrGAN has better recommendation accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://grouplens.org/datasets/movielens/.

  2. 2.

    https://www.tensorflow.org.

References

  1. Bharadhwaj, H., Park, H., Lim, B.: RecGAN: recurrent generative adversarial networks for recommendation systems. In: Proceedings of the 12th ACM Conference on Recommender Systems, pp. 372–376 (2018)

    Google Scholar 

  2. Chae, D., Kang, J., Kim, S., et al.: CFGAN: a generic collaborative filtering framework based on generative adversarial networks. In: Proceedings of the 27th ACM International Conference on Information and Knowledge Management, pp. 137–146 (2018)

    Google Scholar 

  3. Chae, D., Shin, J., Kim, S.: Collaborative adversarial autoencoders: an effective collaborative filtering model under the GAN framework. IEEE Access 7, 37650–37663 (2019)

    Article  Google Scholar 

  4. Chen, X., Li, S., Li, H., et al.: Generative adversarial user model for reinforcement learning based recommendation system. In: Proceedings of the International Conference on Machine Learning, pp. 1052–1061 (2019)

    Google Scholar 

  5. Li, J., Li, J., Wang, C., et al.: Wide and deep generative adversarial networks for recommendation system. Intell. Data Anal. 27(1), 121–136 (2023)

    Article  Google Scholar 

  6. Flanagan, A., Oyomno, W., Grigorievskiy, A., et al.: Federated multi-view matrix factorization for personalized recommendations. In: Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 324–347 (2020)

    Google Scholar 

  7. Li, Y., Wang, Q., Zhang, J.: The theoretical research of generative adversarial networks: an overview. Neurocomputing 435, 26–41 (2021)

    Article  Google Scholar 

  8. Gulrajani, I., Ahmed, F., Arjovsky, M., et al.: Improved training of Wasserstein GANs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 5769–5779 (2017)

    Google Scholar 

  9. He, X., Liao, L., Zhang, H., et al.: Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web, pp. 173–182 (2017)

    Google Scholar 

  10. Hu, B., Shi, C., Zhao, W., et al.: Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1531–1540 (2018)

    Google Scholar 

  11. Huang, M., Li, H., Bai, B., et al.: A federated multi-view deep learning framework for privacy-preserving recommendations. arXiv preprint arXiv:2008.10808(2020)

  12. Kabbur, S., Ning, X., Karypis, G.: FISM: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 659–667 (2013)

    Google Scholar 

  13. Plaat, A., Kosters, W., Preuss, M.: High-accuracy model-based reinforcement learning, a survey. Artif. Intell. Rev. 56(9), 9541–9573 (2023). https://doi.org/10.1007/s10462-022-10335-w

  14. Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)

    Article  Google Scholar 

  15. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)

    Article  Google Scholar 

  16. Lu, G., Zhao, Z., Gao, X., et al.: SRecGAN: pairwise adversarial training for sequential recommendation. In: Proceedings of the International Conference on Database Systems for Advanced Applications, pp. 20–35 (2021)

    Google Scholar 

  17. Peng, S., Zeng, R., Liu, H., et al.: Emotion classification of text based on BERT and broad learning system. In: Proceedings of the APWeb-WAIM International Joint Conference on Web and Big Data, pp. 382–396 (2021)

    Google Scholar 

  18. Karimi, H., Barthe, G., Scholkopf, B.: A survey of algorithmic recourse: contrastive explanations and consequential recommendations. ACM Comput. Surv. 55(5), 1–29 (2022)

    Article  Google Scholar 

  19. Qian, F., Huang, Y., Li, J., et al.: DLSA: dual-learning based on self-attention for rating prediction. Int. J. Mach. Learn. Cybern. 12(7), 1993–2005 (2021)

    Article  Google Scholar 

  20. Qian, F., Li, J., Du, X., et al.: Generative image inpainting for link prediction. Appl. Intell. 50(12), 4482–4494 (2020)

    Article  Google Scholar 

  21. Rendle, S., Freudenthaler, C., Gantner, Z., et al.: BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618(2012)

  22. Sarwar, B., Karypis, G., Konstan, J., et al.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th International Conference on World Wide Web, pp. 285–295 (2001)

    Google Scholar 

  23. Weerakody, P., Wong, K., Wang, G.: A review of irregular time series data handling with gated recurrent neural networks. Neurocomputing 441, 161–178 (2021)

    Article  Google Scholar 

  24. Shi, J., Ji, H., Shi, C., Wang, X., Zhang, Z., Zhou, J.: Heterogeneous graph neural network for recommendation. arXiv preprint arXiv:2009.00799(2020)

  25. Sun, X., Liu, H., Jing, L., et al.: Deep generative recommendation based on list-wise ranking. J. Comput. Res. Dev. 57(8), 1697–1706 (2020)

    Google Scholar 

  26. Tong, Y., Luo, Y., Zhang, Z., et al.: Collaborative generative adversarial network for recommendation systems. In: Proceedings of the IEEE 35th International Conference on Data Engineering Workshops, pp. 161–168 (2019)

    Google Scholar 

  27. Wang, X., He, X., Cao, Y.: KGAT: knowledge graph attention network for recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 950–958 (2019)

    Google Scholar 

  28. Wang, H., Wang, J., Wang, J., et al.: GraphGAN: graph representation learning with generative adversarial nets. In: Proceedings of the AAAI Conference on Artificial Intelligence (2018)

    Google Scholar 

  29. Wang, J., Yu, L., Zhang, W., et al.: IRGAN: a minimax game for unifying generative and discriminative information retrieval models. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 515–524 (2017)

    Google Scholar 

  30. Wang, X., He, X., Wang, M., et al.: Neural graph collaborative filtering. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 165–174 (2019)

    Google Scholar 

  31. Wu, Y., DuBois, C., Zheng, A., et al.: Collaborative denoising auto-encoders for top-n recommender systems. In: Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, pp. 153–162 (2016)

    Google Scholar 

  32. Wu, Z., Pan, S., Chen, F., et al.: A comprehensive survey on graph neural networks. IEEE Trans. Neural Netw. learn. syst. 32(1), 4–24 (2020)

    Article  MathSciNet  Google Scholar 

  33. Wang, S., Hu, L., Wang, Y., et al.: Sequential recommender systems: Challenges, progress and prospects. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, pp. 6332–6338 (2019)

    Google Scholar 

  34. Yuan, F., Yao, L., Benatallah, B.: Adversarial collaborative auto-encoder for top-n recommendation. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2019)

    Google Scholar 

  35. Yao, W., DuBois, C., Alice, Zheng., et al.: Collaborative denoising auto-encoders for top-n recommender systems. In: Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, pp. 153–162 (2016)

    Google Scholar 

  36. Zhao, W., Wang, B., Ye, J., et al.: PLASTIC: prioritize long and short-term information in top-n recommendation using adversarial training. In: Proceedings of the Proceedings of International Joint Conference on Artificial Intelligence, pp. 3676–3682 (2018)

    Google Scholar 

Download references

Acknowledgements

This work was partially supported by University-level key projects of Anhui University of Science and Technology(Grants #xjzd2020-15), Scientific Research Foundation for introduced talents of Anhui University of Science and Technology(Grants #13200426), Directive Science and technology plan projects in 2021 of Huainan City(Grants #2021003, #2021136), and the Supported projects (natural science) of Anhui University of Science and Technology(Grants #xjyb2020-13).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Li Jianhong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jianhong, L., Yue, W., Taotao, Y., Chengyuan, S., Dequan, L. (2024). Generative Adversarial Networks Based on Contrastive Learning for Sequential Recommendation. In: Song, X., Feng, R., Chen, Y., Li, J., Min, G. (eds) Web and Big Data. APWeb-WAIM 2023. Lecture Notes in Computer Science, vol 14332. Springer, Singapore. https://doi.org/10.1007/978-981-97-2390-4_30

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-2390-4_30

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-2389-8

  • Online ISBN: 978-981-97-2390-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics