Skip to main content
SpringerLink
Log in

Improving hypergraph convolution network collaborative filtering with feature crossing and contrastive learning

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Organizing user-item interaction data into a graph has brought many benefits to recommendation methods. Compared with the user-item bipartite graph structure, a hypergraph structure provides a natural way to directly model high-order correlations among users or items. Hypergraph Convolution Network (HGCN) has the capability of aggregating and propagating latent features of nodes in the hypergraph nonlinearly. Recently, recommendation models based on simplified HGCN have shown good performance. However, such models lose the powerful expression ability of feature crossing and suffer from limited labeled data. To tackle these two problems, a framework called HGCN-CC is proposed to improve HGCN with feature Crossing and Contrastive learning. Specifically, HGCN is combined with a feature cross network in a parallel manner to balance between feature crossing and over smoothing. By such a design, HGCN-CC not only utilizes simplified propagation operation in HGCN to capture high-order correlations among users or items, but also enjoys the powerful expressing ability of high-order feature interactions. Furthermore, HGCN-CC resorts to contrastive learning to help learn good representations. Under the HGCN-CC framework, two models called item-based HGCN-CC (I-HGCN-CC) and user-based HGCN-CC (U-HGCN-CC) are constructed to emphasize different aspects of data. Results of extensive experiments on four benchmark datasets demonstrate that proposed models have superiority in modelling hypergraph structure data for recommendations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. https://github.com/gusye1234/LightGCN-PyTorch/tree/master/data

  2. https://grouplens.org/datasets/movielens/

  3. https://github.com/fmonti/mgcnn

  4. https://nijianmo.github.io/amazon/index.html

References

  1. Van den Berg R, Kipf TN, Welling M (2017) Graph convolutional matrix completion. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining workshop on deep learning day

  2. Cantador I, Brusilovsky P, Kuflik T (2011) Proceedings of the 5th acm conference on recommender systems. In: Proceedings of the 2011 ACM conference on recommender systems, pp 387–388

  3. Chen T, Kornblith S, Norouzi M, Hinton GE (2020) A simple framework for contrastive learning of visual representations. In: Proceedings of the 37th international conference on machine learning, vol 119, pp 1597–1607

  4. Chen X, He K (2021) Exploring simple siamese representation learning. In: Proceeding of the 2021 IEEE conference on computer vision and pattern recognition, pp 15750–15758

  5. Chen Z, Wang Y, Zhang S, Zhong H, Chen L (2021) Differentially private user-based collaborative filtering recommendation based on k-means clustering. Expert Syst Appl 168:114366

    Article  Google Scholar 

  6. Cheng H, Koc L, Harmsen J, Shaked T, Chandra T, Aradhye H, Anderson G, Corrado G, Chai W, Ispir M, Anil R, Haque Z, Hong L, Jain V, Liu X, Shah H (2016) Wide & deep learning for recommender systems. In: Proceedings of the 1st workshop on deep learning for recommender systems, pp 7–10

  7. Feng W, Zhang J, Dong Y, Han Y, Luan H, Xu Q, Yang Q, Kharlamov E, Tang J (2020) Graph random neural networks for semi-supervised learning on graphs. In: Advances in neural information processing systems, pp 22092–22103

  8. Feng Y, You H, Zhang Z, Ji R, Gao Y (2019) Hypergraph neural networks. In: Proceedings of the the 33rd AAAI conference on artificial intelligence, pp 3558–3565

  9. Guo H, Tang R, Ye Y, Li Z, He X (2017) DeepFM: A factorization-machine based neural network for CTR prediction. In: Proceedings of the 26th international joint conference on artificial intelligence, pp 1725–1731

  10. Hao J, Dun Y, Zhao G, Wu Y, Qian X (2021) Annular-graph attention model for personalized sequential recommendation. IEEE Trans Multimedia (Early access). https://doi.org/10.1109/TMM.2021.3097186

    Article  Google Scholar 

  11. Harper FM, Konstan JA (2016) The movielens datasets: History and context. ACM Trans Interact Intell Syst 5(4):19:1–19:19

  12. He K, Fan H, Wu Y, Xie S, Girshick RB (2020a) Momentum contrast for unsupervised visual representation learning. In: Proceeding of the 2020 IEEE/CVF conference on computer vision and pattern recognition, pp 9726–9735

  13. He X, Liao L, Zhang H, Nie L, Hu X, Chua T (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182

  14. He X, He Z, Song J, Liu Z, Jiang Y, Chua T (2018) NAIS: Neural attentive item similarity model for recommendation. IEEE Trans Knowl Data Eng 30(12):2354–2366

    Article  Google Scholar 

  15. He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020b) LightGCN: Simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648

  16. Jain A, Nagar S, Singh PK, Dhar J (2020) EMUCF: Enhanced multistage user-based collaborative filtering through non-linear similarity for recommendation systems. Expert Syst Appl 161:113724

    Article  Google Scholar 

  17. Jamali M, Ester M (2010) A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the 2010 ACM conference on recommender systems, pp 135–142

  18. Ji S, Feng Y, Ji R, Zhao X, Tang W, Gao Y (2020) Dual channel hypergraph collaborative filtering. In: Proceedings of the 26th ACM SIGKDD conference on knowledge discovery and data mining, pp 2020–2029

  19. Jiang J, Wei Y, Feng Y, Cao J, Gao Y (2019) Dynamic hypergraph neural networks. In: Proceedings of the 28th international joint conference on artificial intelligence, pp 2635–2641

  20. Kabbur S, Ning X, Karypis G (2013) FISM: Factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, pp 659–667

  21. Khosla P, Teterwak P, Wang C, Sarna A, Tian Y, Isola P, Maschinot A, Liu C, Krishnan D (2020) Supervised contrastive learning. In: Advances in neural information processing systems, pp 18661–18673

  22. Kingma DP, Ba J (2015) Adam: A method for stochastic optimization. In: The 3rd international conference on learning representations, arXiv:1412.6980

  23. Krichene W, Rendle S (2020) On sampled metrics for item recommendation. In: Proceedings of the 26th ACM SIGKDD conference on knowledge discovery and data mining, pp 1748–1757

  24. Li Q, Han Z, Wu X (2018) Deeper insights into graph convolutional networks for semi-supervised learning. In: Proceedings of the 32nd AAAI conference on artificial intelligence, pp 3538–3545

  25. Monti F, Bronstein MM, Bresson X (2017) Geometric matrix completion with recurrent multi-graph neural networks. In: Advances in neural information processing systems, pp 3697–3707

  26. Na L, Li M, Hai-yang Q, Su H (2021) A hybrid user-based collaborative filtering algorithm with topic model. Appl Intell 51(11):7946–7959

    Article  Google Scholar 

  27. Ni J, Li J, McAuley JJ (2019) Justifying recommendations using distantly-labeled reviews and fine-grained aspects. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing, pp 188–197

  28. Nikolakopoulos AN, Karypis G (2020) Boosting item-based collaborative filtering via nearly uncoupled random walks. ACM Trans Knowl Discov Data 14(6):64:1–64:26

  29. Ning X, Karypis G (2011) SLIM: Sparse linear methods for top-n recommender systems. In: Proceedings of the 11th IEEE international conference on data mining, pp 497–506

  30. Ning X, Desrosiers C, Karypis G (2015) A comprehensive survey of neighborhood-based recommendation methods. Recommender systems handbook pp 37–76

  31. Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in PyTorch

  32. Rendle S (2010) Factorization machines. In: Proceedings of the 10th IEEE international conference on data mining, pp 995–1000

  33. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the 25th conference on uncertainty in artificial intelligence, pp 452–461

  34. Rendle S, Krichene W, Zhang L, Anderson JR (2020) Neural collaborative filtering vs. matrix factorization revisited. In: 14th ACM conference on recommender systems, pp 240–248

  35. Sarwar BM, Karypis G, Konstan JA, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on world wide web, pp 285–295

  36. Sedhain S, Menon AK, Sanner S, Xie L (2015) Autorec: Autoencoders meet collaborative filtering. In: Proceedings of the 24th international conference on world wide web, pp 111–112

  37. Sun Z, Yu D, Fang H, Yang J, Qu X, Zhang J, Geng C (2020) Are we evaluating rigorously? benchmarking recommendation for reproducible evaluation and fair comparison. In: 14th ACM conference on recommender systems, pp 23–32

  38. Tang H, Zhao G, Bu X, Qian X (2021) Dynamic evolution of multi-graph based collaborative filtering for recommendation systems. Knowl Based Syst 228:107251

    Article  Google Scholar 

  39. Tay Y, Tuan LA, Hui SC (2018) Latent relational metric mearning via memory-based attention for collaborative ranking. In: Proceedings of the 2018 world wide web conference, pp 729–739

  40. Wang J, Ding K, Hong L, Liu H, Caverlee J (2020a) Next-item recommendation with sequential hypergraphs. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1101–1110

  41. Wang J, Ding K, Zhu Z, Caverlee J (2021a) Session-based recommendation with hypergraph attention networks. In: Proceedings of the 2021 SIAM international conference on data mining, pp 82–90

  42. Wang R, Fu B, Fu G, Wang M (2017) Deep & cross network for ad click predictions. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp 12:1–12:7

  43. Wang R, Shivanna R, Cheng DZ, Jain S, Lin D, Hong L, Chi E (2021) DCN V2: Improved deep & cross network and practical lessons for web-scale learning to rank systems. Proceedings of the web conference 2021:1785–1797

    Google Scholar 

  44. Wang X, He X, Wang M, Feng F, Chua T (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174

  45. Wang X, Jin H, Zhang A, He X, Xu T, Chua T (2020b) Disentangled graph collaborative filtering. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1001–1010

  46. Wu J, Wang X, Feng F, He X, Chen L, Lian J, Xie X (2021) Self-supervised graph learning for recommendation. In: Proceeding of the 44th international ACM SIGIR conference on research and development in information retrieval, pp 726–735

  47. Xia X, Yin H, Yu J, Wang Q, Cui L, Zhang X (2021) Self-supervised hypergraph convolutional networks for session-based recommendation. In: Proceeding of the 35th AAAI conference on artificial intelligence, pp 4503–4511

  48. Yu J, Yin H, Li J, Wang Q, Hung NQV, Zhang X (2021) Self-supervised multi-channel hypergraph convolutional network for social recommendation. Proceedings of the web conference 2021:413–424

    Google Scholar 

  49. Zhang M, Chen Y (2020) Inductive matrix completion based on graph neural networks. In: The 8th international conference on learning representations, arXiv: 1904.12058

  50. Zhang S, Yao L, Sun A, Wang S, Long G, Dong M (2018) NeuRec: On nonlinear transformation for personalized ranking. In: Proceedings of the 27th international joint conference on artificial intelligence, pp 3669–3675

  51. Zhao Z, Shang M (2010) User-based collaborative-filtering recommendation algorithms on hadoop. In: Proceeding of the 3rd international conference on knowledge discovery and data mining, pp 478–481

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

    Huanhuan Yuan, Jian Yang & Jiajin Huang

  2. Beijing International Collaboration Base on Brain Informatics and Wisdom Services, Beijing, 100124, China

    Huanhuan Yuan, Jian Yang & Jiajin Huang

Authors
  1. Huanhuan Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jian Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiajin Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiajin Huang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, H., Yang, J. & Huang, J. Improving hypergraph convolution network collaborative filtering with feature crossing and contrastive learning. Appl Intell 52, 10220–10233 (2022). https://doi.org/10.1007/s10489-021-03144-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-03144-1

Keywords

Search

Navigation