Abstract
The data sparsity and cold start issues reduce the recommendation accuracy of recommendation models based on Graph Neural Networks (GNN). Existing research mostly attributes this to insufficient exploration of user-item interaction information, resulting in methods that primarily focus on how to effectively extract user-interacted items and their domain information. However, this raises a problem: sparse interaction data leads to incomplete capture of user preferences, meaning learned user features have locality. Overly focusing on interacted user embedding learning can result in a narrow range of node embeddings involved in node embedding learning, making it difficult to recommend uninteracted hidden preference items. To address this, this paper combines graph neural networks and designs a novel self-supervised contrastive learning recommendation model, REBD. REBD preserves the personalized recommendation advantage of traditional models focusing on obtaining user interests from existing interactions by designing item graph convolution and contrastive learning data enhancement methods. Meanwhile, the model introduces virtual embeddings to diffuse high-degree item information, prompting the model to learn more uniformly unified node embeddings to mitigate the narrowness of node embeddings, forming a new recommendation pattern: high-degree item recommendations beyond interactively associated items. Finally, testing on three commonly used real datasets across different domains shows that REBD’s recommendation performance surpasses various existing recommendation models. Comparing with one of the recent state-of-the-art models MMSSL on the dataset with the most severe data sparsity, the recommendation accuracy has significantly improved by over 30%, confirming the advantage of our model.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chen, M., Wei, Z., Huang, Z., Ding, B., Li, Y.: Simple and deep graph convolutional networks. In: International Conference on Machine Learning, pp. 1725–1735. PMLR (2020)
Chen, X., He, K.: Exploring simple SIAMESE representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 15750–15758 (2021)
Chen, Y., Yang, Y., Wang, Y., Bai, J., Song, X., King, I.: Attentive knowledge-aware graph convolutional networks with collaborative guidance for personalized recommendation. In: 2022 IEEE 38th International Conference on Data Engineering (ICDE), pp. 299–311. IEEE (2022)
Fan, Z., et al.: Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM Web Conference 2022, pp. 2036–2047 (2022)
Fan, Z., Xu, K., Dong, Z., Peng, H., Zhang, J., Yu, P.S.: Graph collaborative signals denoising and augmentation for recommendation. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 2037–2041 (2023)
Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, pp. 249–256. JMLR Workshop and Conference Proceedings (2010)
Grill, J.B., et al.: Bootstrap your own latent-a new approach to self-supervised learning. In: Advances in Neural Information Processing Systems, vol. 33, pp. 21271–21284 (2020)
He, R., McAuley, J.: VBPR: visual Bayesian personalized ranking from implicit feedback. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30 (2016)
He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 639–648 (2020)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Lee, D., Kang, S., Ju, H., Park, C., Yu, H.: Bootstrapping user and item representations for one-class collaborative filtering. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 317–326 (2021)
Lee, Y.C., Kim, T., Choi, J., He, X., Kim, S.W.: M-BPR: a novel approach to improving BPR for recommendation with multi-type pair-wise preferences. Inf. Sci. 547, 255–270 (2021)
Li, G., Müller, M., Ghanem, B., Koltun, V.: Training graph neural networks with 1000 layers. In: International Conference on Machine Learning, pp. 6437–6449. PMLR (2021)
Li, Q., Wang, X., Wang, Z., Xu, G.: Be causal: de-biasing social network confounding in recommendation. ACM Trans. Knowl. Discov. Data 17(1), 1–23 (2023)
Lin, Z., Tian, C., Hou, Y., Zhao, W.X.: Improving graph collaborative filtering with neighborhood-enriched contrastive learning. In: Proceedings of the ACM Web Conference 2022, pp. 2320–2329 (2022)
Loni, B., Pagano, R., Larson, M., Hanjalic, A.: Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM Conference on Recommender Systems, pp. 361–364 (2016)
Ma, T., Huang, L., Lu, Q., Hu, S.: KR-GCN: knowledge-aware reasoning with graph convolution network for explainable recommendation. ACM Trans. Inf. Syst. 41(1), 1–27 (2023)
Tao, Z., et al.: Self-supervised learning for multimedia recommendation. IEEE Trans. Multimedia 25, 5107–5116 (2022)
Wei, W., Huang, C., Xia, L., Zhang, C.: Multi-modal self-supervised learning for recommendation. In: Proceedings of the ACM Web Conference 2023, pp. 790–800 (2023)
Wei, Y., Wang, X., Li, Q., Nie, L., Li, Y., Li, X., Chua, T.S.: Contrastive learning for cold-start recommendation. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 5382–5390 (2021)
Wei, Y., Wang, X., Nie, L., He, X., Hong, R., Chua, T.S.: MMGCN: multi-modal graph convolution network for personalized recommendation of micro-video. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 1437–1445 (2019)
Wu, J., et al.: Self-supervised graph learning for recommendation. In: Proceedings of the 44th international ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 726–735 (2021)
Xia, L., Huang, C., Xu, Y., Zhao, J., Yin, D., Huang, J.: Hypergraph contrastive collaborative filtering. In: Proceedings of the 45th International ACM SIGIR conference on research and development in information retrieval. pp. 70–79 (2022)
Yi, Z., Wang, X., Ounis, I., Macdonald, C.: Multi-modal graph contrastive learning for micro-video recommendation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1807–1811 (2022)
Zhang, J., Zhu, Y., Liu, Q., Wu, S., Wang, S., Wang, L.: Mining latent structures for multimedia recommendation. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 3872–3880 (2021)
Zhou, X., et al.: Bootstrap latent representations for multi-modal recommendation. In: Proceedings of the ACM Web Conference 2023, pp. 845–854 (2023)
Zou, D., et al.: Multi-level cross-view contrastive learning for knowledge-aware recommender system. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1358–1368 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Luo, M., Su, Z., Tang, Y., Ding, X. (2024). Random Virtual Embeddings Bootstrap High-Degree Item Diffusion for Recommendation. In: Cao, C., Chen, H., Zhao, L., Arshad, J., Asyhari, T., Wang, Y. (eds) Knowledge Science, Engineering and Management. KSEM 2024. Lecture Notes in Computer Science(), vol 14887. Springer, Singapore. https://doi.org/10.1007/978-981-97-5501-1_2
Download citation
DOI: https://doi.org/10.1007/978-981-97-5501-1_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5500-4
Online ISBN: 978-981-97-5501-1
eBook Packages: Computer ScienceComputer Science (R0)