Skip to main content
SpringerLink
Log in

Preference-corrected multimodal graph convolutional recommendation network

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Users purchase goods to form a user-item interaction graph, where goods are usually displayed in multiple modes. The main role of the recommendation system is to obtain users’ preferences after analyzing users’ purchasing behavior. However, there are some deviations in the interaction between users and items. For example, users buy goods they are not interested in, which directly affects the user’s preference analysis. Most existing models do not focus on analyzing and correcting user preference errors in the user-item relationship graph, which leads to errors. There is little work on the multimodal information of commodities, resulting in the loss of information. In this paper, a preference-corrected multimodal graph convolution recommendation network (PMGCRN) is proposed to provide multimodal recommendation services for users. First, a multichannel network is designed to obtain user preference information under different modes. Then, a positive attention mechanism is proposed to deal with the implicit noise edges that do not match users’ interactions in the user-item graph to correct errors in user preferences. Additionally, the simplified graph convolution network acts on the structural information of the user-item bipartite graph as an additional channel to enhance the robustness of the model. Finally, a self-attention mechanism and layer-by-layer superposition are applied to obtain multilevel modal and structural information, respectively, so that valuable information can be obtained by the fusion matrix. Experiments show that our proposed PMGCRN outperforms other baselines on all three datasets, MovieLens, Amazon - Sports and Outdoors, and Douban.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. https://grouplens.org/datasets/movielens/1m/

  2. https://jmcauley.ucsd.edu/data/amazon/

  3. https://movie.douban.com/

References

  1. Baltrušaitis T, Ahuja C, Morency LP (2018) Multimodal machine learning: a survey and taxonomy. IEEE Trans Pattern Anal Mach Intell 41(2):423–443

    Article  Google Scholar 

  2. Chen J, Zhang H, He X, Nie L, Liu W, Chua TS (2017) Attentive collaborative filtering: multimedia recommendation with item-and component-level attention. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 335–344

  3. Chen X, Zhang Y, Xu H, Cao Y, Qin Z, Zha H (2018) Visually explainable recommendation. arXiv:1801.10288

  4. Covington P, Adams J, Sargin E (2016) Deep neural networks for youtube recommendations. In: Proceedings of the 10th ACM conference on recommender systems, pp 191–198

  5. Grover A, Leskovec J (2016) Node2vec: Scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 855–864

  6. Guo Q, Zhuang F, Qin C, Zhu H, Xie X, Xiong H, He Q (2020) A survey on knowledge graph-based recommender systems. IEEE Trans Knowl Data Eng, pp 1–1, https://doi.org/10.1109/TKDE.2020.3028705

  7. Hamilton WL, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. In: Proceedings of the 31st international conference on neural information processing systems, pp 1025–1035

  8. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  9. He R, McAuley J (2016) Vbpr: visual bayesian personalized ranking from implicit feedback. In: Proceedings of the AAAI conference on artificial intelligence, vol 30

  10. He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648

  11. He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. WWW ’17, pp 173–182, International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE. https://doi.org/10.1145/3038912.3052569

  12. Hu W, Chen C, Chang Y, Zheng Z, Du Y (2021) Robust graph convolutional networks with directional graph adversarial training. Appl Intell, pp 1–15

  13. Kipf TN, Welling M (2017) Semi-Supervised Classification with graph convolutional networks. In: Proceedings of the 5th international conference on learning representations, ICLR ’17

  14. Liu F, Cheng Z, Sun C, Wang Y, Nie L, Kankanhalli M (2019) User diverse preference modeling by multimodal attentive metric learning. In: Proceedings of the 27th ACM international conference on multimedia, MM ’19. https://doi.org/10.1145/3343031.3350953. Association for Computing Machinery, New York, pp 1526–1534

  15. Liu F, Cheng Z, Zhu L, Gao Z, Nie L (2021) Interest-aware message-passing gcn for recommendation. Proceedings of the Web Conference

  16. Ribeiro LF, Saverese PH, Figueiredo DR (2017) Struc2vec: learning node representations from structural identity. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp 385–394

  17. Sun FY, Hoffman J, Verma V, Tang J (2020) Infograph: unsupervised and semi-supervised graph-level representation learning via mutual information maximization. In: International conference on learning representations

  18. Sun R, Cao X, Zhao Y, Wan J, Zhou K, Zhang F, Wang Z, Zheng K (2020) Multi-modal knowledge graphs for recommender systems. In: Proceedings of the 29th ACM international conference on information & knowledge management, pp 1405–1414

  19. Togashi R, Otani M, Satoh S (2021) Alleviating cold-start problems in recommendation through pseudo-labelling over knowledge graph. In: Proceedings of the 14th ACM international conference on web search and data mining, pp 931–939

  20. Velickovic P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2017) Graph attention networks. Stat 1050:20

    Google Scholar 

  21. Wang X, He X, Cao Y, Liu M, Chua TS (2019) Kgat: knowledge graph attention network for recommendation. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp. 950–958

  22. Wang X, He X, Feng F, Nie L, Chua TS (2018) Tem: tree-enhanced embedding model for explainable recommendation. In: Proceedings of the 2018 world wide web conference, pp 1543–1552

  23. Wang X, He X, Nie L, Chua TS (2017) Item silk road: recommending items from information domains to social users. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 185–194

  24. Wang X, He X, Wang M, Feng F, Chua TS (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174

  25. Wang X, Huang T, Wang D, Yuan Y, Liu Z, He X, Chua TS (2021) Learning intents behind interactions with knowledge graph for recommendation. In: Proceedings of the web conference 2021, pp 878–887

  26. Wei Y, Wang X, Nie L, He X, Chua TS (2020) Graph-refined convolutional network for multimedia recommendation with implicit feedback. In: Proceedings of the 28th ACM international conference on multimedia, pp 3541–3549

  27. Wei Y, Wang X, Nie L, He X, Hong R, Chua TS (2019) Mmgcn: multi-modal graph convolution network for personalized recommendation of micro-video. In: Proceedings of the 27th ACM international conference on multimedia, pp 1437–1445

  28. Wu F, Souza A, Zhang T, Fifty C, Yu T, Weinberger K (2019) Simplifying graph convolutional networks. In: International conference on machine learning, pp 6861–6871, PMLR

  29. Xia X, Yin H, Yu J, Wang Q, Cui L, Zhang X (2021) Self-supervised hypergraph convolutional networks for session-based recommendation. In: Proceedings of the AAAI conference on artificial intelligence. vol 35, pp 4503–4511

  30. Yang F, Zhang H, Tao S (2021) Simplified multilayer graph convolutional networks with dropout. Appl Intell, pp 1–16

  31. Ying R, He R, Chen K, Eksombatchai P, Hamilton WL, Leskovec J (2018) Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 974–983

  32. Zhang Y, Ai Q, Chen X, Croft WB (2017) Joint representation learning for top-n recommendation with heterogeneous information sources. CIKM ’17. Association for Computing Machinery, New York, NY, USA, pp 1449–1458, https://doi.org/10.1145/3132847.3132892

  33. Zhang Z, Cui P, Zhu W (2020) Deep learning on graphs: a survey IEEE transactions on knowledge and data engineering

  34. Zhou K, Zhao WX, Bian S, Zhou Y, Wen JR, Yu J (2020) Improving conversational recommender systems via knowledge graph based semantic fusion. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1006–1014

  35. Zhu D, Zhang Z, Cui P, Zhu W (2019) Robust graph convolutional networks against adversarial attacks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1399–1407

Download references

Acknowledgements

This work was supported in part by Zhejiang NSF Grant No. LY20F020009 and No.LZ20F020001, China NSF Grants No. 61602133, Ningbo NSF Grant No.202003N4086, as well as programs sponsored by K.C. Wong Magna Fund in Ningbo University. (Corresponding author: Yihong Dong.)

Author information

Authors and Affiliations

  1. Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, China

    Xiangen Jia, Yihong Dong, Feng Zhu, Yu Xin & Jiangbo Qian

Authors
  1. Xiangen Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yihong Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Feng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yu Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jiangbo Qian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yihong Dong.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jia, X., Dong, Y., Zhu, F. et al. Preference-corrected multimodal graph convolutional recommendation network. Appl Intell 53, 3947–3962 (2023). https://doi.org/10.1007/s10489-022-03681-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03681-3

Keywords

Search

Navigation