Skip to main content

Random Virtual Embeddings Bootstrap High-Degree Item Diffusion for Recommendation

  • Conference paper
  • First Online:
Knowledge Science, Engineering and Management (KSEM 2024)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14887))

  • 550 Accesses

Abstract

The data sparsity and cold start issues reduce the recommendation accuracy of recommendation models based on Graph Neural Networks (GNN). Existing research mostly attributes this to insufficient exploration of user-item interaction information, resulting in methods that primarily focus on how to effectively extract user-interacted items and their domain information. However, this raises a problem: sparse interaction data leads to incomplete capture of user preferences, meaning learned user features have locality. Overly focusing on interacted user embedding learning can result in a narrow range of node embeddings involved in node embedding learning, making it difficult to recommend uninteracted hidden preference items. To address this, this paper combines graph neural networks and designs a novel self-supervised contrastive learning recommendation model, REBD. REBD preserves the personalized recommendation advantage of traditional models focusing on obtaining user interests from existing interactions by designing item graph convolution and contrastive learning data enhancement methods. Meanwhile, the model introduces virtual embeddings to diffuse high-degree item information, prompting the model to learn more uniformly unified node embeddings to mitigate the narrowness of node embeddings, forming a new recommendation pattern: high-degree item recommendations beyond interactively associated items. Finally, testing on three commonly used real datasets across different domains shows that REBD’s recommendation performance surpasses various existing recommendation models. Comparing with one of the recent state-of-the-art models MMSSL on the dataset with the most severe data sparsity, the recommendation accuracy has significantly improved by over 30%, confirming the advantage of our model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Chen, M., Wei, Z., Huang, Z., Ding, B., Li, Y.: Simple and deep graph convolutional networks. In: International Conference on Machine Learning, pp. 1725–1735. PMLR (2020)

    Google Scholar 

  2. Chen, X., He, K.: Exploring simple SIAMESE representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 15750–15758 (2021)

    Google Scholar 

  3. Chen, Y., Yang, Y., Wang, Y., Bai, J., Song, X., King, I.: Attentive knowledge-aware graph convolutional networks with collaborative guidance for personalized recommendation. In: 2022 IEEE 38th International Conference on Data Engineering (ICDE), pp. 299–311. IEEE (2022)

    Google Scholar 

  4. Fan, Z., et al.: Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM Web Conference 2022, pp. 2036–2047 (2022)

    Google Scholar 

  5. Fan, Z., Xu, K., Dong, Z., Peng, H., Zhang, J., Yu, P.S.: Graph collaborative signals denoising and augmentation for recommendation. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 2037–2041 (2023)

    Google Scholar 

  6. Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, pp. 249–256. JMLR Workshop and Conference Proceedings (2010)

    Google Scholar 

  7. Grill, J.B., et al.: Bootstrap your own latent-a new approach to self-supervised learning. In: Advances in Neural Information Processing Systems, vol. 33, pp. 21271–21284 (2020)

    Google Scholar 

  8. He, R., McAuley, J.: VBPR: visual Bayesian personalized ranking from implicit feedback. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30 (2016)

    Google Scholar 

  9. He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 639–648 (2020)

    Google Scholar 

  10. Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)

  11. Lee, D., Kang, S., Ju, H., Park, C., Yu, H.: Bootstrapping user and item representations for one-class collaborative filtering. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 317–326 (2021)

    Google Scholar 

  12. Lee, Y.C., Kim, T., Choi, J., He, X., Kim, S.W.: M-BPR: a novel approach to improving BPR for recommendation with multi-type pair-wise preferences. Inf. Sci. 547, 255–270 (2021)

    Article  MathSciNet  Google Scholar 

  13. Li, G., Müller, M., Ghanem, B., Koltun, V.: Training graph neural networks with 1000 layers. In: International Conference on Machine Learning, pp. 6437–6449. PMLR (2021)

    Google Scholar 

  14. Li, Q., Wang, X., Wang, Z., Xu, G.: Be causal: de-biasing social network confounding in recommendation. ACM Trans. Knowl. Discov. Data 17(1), 1–23 (2023)

    Google Scholar 

  15. Lin, Z., Tian, C., Hou, Y., Zhao, W.X.: Improving graph collaborative filtering with neighborhood-enriched contrastive learning. In: Proceedings of the ACM Web Conference 2022, pp. 2320–2329 (2022)

    Google Scholar 

  16. Loni, B., Pagano, R., Larson, M., Hanjalic, A.: Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM Conference on Recommender Systems, pp. 361–364 (2016)

    Google Scholar 

  17. Ma, T., Huang, L., Lu, Q., Hu, S.: KR-GCN: knowledge-aware reasoning with graph convolution network for explainable recommendation. ACM Trans. Inf. Syst. 41(1), 1–27 (2023)

    Article  Google Scholar 

  18. Tao, Z., et al.: Self-supervised learning for multimedia recommendation. IEEE Trans. Multimedia 25, 5107–5116 (2022)

    Article  Google Scholar 

  19. Wei, W., Huang, C., Xia, L., Zhang, C.: Multi-modal self-supervised learning for recommendation. In: Proceedings of the ACM Web Conference 2023, pp. 790–800 (2023)

    Google Scholar 

  20. Wei, Y., Wang, X., Li, Q., Nie, L., Li, Y., Li, X., Chua, T.S.: Contrastive learning for cold-start recommendation. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 5382–5390 (2021)

    Google Scholar 

  21. Wei, Y., Wang, X., Nie, L., He, X., Hong, R., Chua, T.S.: MMGCN: multi-modal graph convolution network for personalized recommendation of micro-video. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 1437–1445 (2019)

    Google Scholar 

  22. Wu, J., et al.: Self-supervised graph learning for recommendation. In: Proceedings of the 44th international ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 726–735 (2021)

    Google Scholar 

  23. Xia, L., Huang, C., Xu, Y., Zhao, J., Yin, D., Huang, J.: Hypergraph contrastive collaborative filtering. In: Proceedings of the 45th International ACM SIGIR conference on research and development in information retrieval. pp. 70–79 (2022)

    Google Scholar 

  24. Yi, Z., Wang, X., Ounis, I., Macdonald, C.: Multi-modal graph contrastive learning for micro-video recommendation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1807–1811 (2022)

    Google Scholar 

  25. Zhang, J., Zhu, Y., Liu, Q., Wu, S., Wang, S., Wang, L.: Mining latent structures for multimedia recommendation. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 3872–3880 (2021)

    Google Scholar 

  26. Zhou, X., et al.: Bootstrap latent representations for multi-modal recommendation. In: Proceedings of the ACM Web Conference 2023, pp. 845–854 (2023)

    Google Scholar 

  27. Zou, D., et al.: Multi-level cross-view contrastive learning for knowledge-aware recommender system. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1358–1368 (2022)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yan Tang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Luo, M., Su, Z., Tang, Y., Ding, X. (2024). Random Virtual Embeddings Bootstrap High-Degree Item Diffusion for Recommendation. In: Cao, C., Chen, H., Zhao, L., Arshad, J., Asyhari, T., Wang, Y. (eds) Knowledge Science, Engineering and Management. KSEM 2024. Lecture Notes in Computer Science(), vol 14887. Springer, Singapore. https://doi.org/10.1007/978-981-97-5501-1_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-5501-1_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-5500-4

  • Online ISBN: 978-981-97-5501-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics