Mengyuan Jing
Yanmin Zhu
Skip Abstract Section
Abstract
Graph Convolutional Networks (GCNs) have been widely used for collaborative filtering, due to their effectiveness in exploiting high-order collaborative signals. However, two issues have not been well addressed by existing studies. First, usually only one kind of information is utilized, i.e., user preference in user-item graphs or item dependency in item-item graphs. Second, they usually adopt static graphs, which cannot retain the temporal evolution of the information. These can limit the recommendation quality. To address these limitations, we propose to mine three kinds of information (user preference, item dependency, and user behavior similarity) and their temporal evolution by constructing multiple discrete dynamic heterogeneous graphs (i.e., a user-item dynamic graph, an item-item dynamic graph, and a user-subseq dynamic graph) from interaction data. A novel network (PDGCN) is proposed to learn the representations of users and items in these dynamic graphs. Moreover, we designed a structural neighbor aggregation module with novel pooling and convolution operations to aggregate the features of structural neighbors. We also design a temporal neighbor aggregation module based on self-attention mechanism to aggregate the features of temporal neighbors. We conduct extensive experiments on four real-world datasets. The results indicate that our approach outperforms several competing methods in terms of Hit Ratio (HR) and Normalized Discounted Cumulative Gain (NDCG). Dynamic graphs are also shown to be effective in improving recommendation performance.
- [1] . 2017. Enhancing social collaborative filtering through the application of non-negative matrix factorization and exponential random graph models. Data Mining and Knowledge Discovery 31, 4 (2017), 1031–1059.Google Scholar
Digital Library
- [2] . 2016. Diffusion-convolutional neural networks. In Proceedings of theAdvances in Neural Information Processing Systems. 1993–2001.Google Scholar
- [3] . 2014. Spectral networks and locally connected networks on graphs. In ICLR(Poster).Google Scholar
- [4] . 2020. Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI Press, 27–34.Google ScholarCross Ref
- [5] . 2004. Item-based top-n recommendation algorithms. ACM Transactions on Information Systems 22, 1 (2004), 143–177.Google ScholarDigital Library
- [6] . 2015. Neural network matrix factorization. arXiv:1511.06443. Retrieved from https://arxiv.org/abs/1511.06443.Google Scholar
- [7] . 2017. Convolutional sequence to sequence learning. In Proceedings of the International Conference on Machine Learning. JMLR.org, 1243–1252.Google Scholar
- [8] . 2013. A non-iid framework for collaborative filtering with restricted boltzmann machines. In Proceedings of the International Conference on Machine Learning. PMLR, 1148–1156.Google Scholar
- [9] . 2007. ItemRank: A random-walk based scoring algorithm for recommender engines. In Proceedings of the International Joint Conference on Artificial Intelligence. 2766–2771.Google Scholar
- [10] . 2020. dyngraph2vec: Capturing network dynamics using dynamic graph representation learning. Knowledge-Based Systems 187 (2020), 104816.Google ScholarCross Ref
- [11] . 2018. DynGEM: Deep embedding method for dynamic graphs. arXiv:1805.11273. Retrieved from https://arxiv.org/abs/1805.11273.Google Scholar
- [12] . 2019. Variational graph recurrent neural networks. In Proceedings of the Advances in Neural Information Processing Systems. 10700–10710.Google Scholar
- [13] . 2021. Explainable subgraph reasoning for forecasting on temporal knowledge graphs. In Proceedings of the International Conference on Learning Representations. OpenReview.net.Google Scholar
- [14] . 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 639–648.Google ScholarDigital Library
- [15] . 2018. NAIS: Neural attentive item similarity model for recommendation. IEEE Transactions on Knowledge and Data Engineering 30, 12 (2018), 2354–2366.Google ScholarDigital Library
- [16] . 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173–182.Google ScholarDigital Library
- [17] Yotam Hechtlinger, Purvasha Chakravarti, and Jining Qin. 2017. A generalization of convolutional neural networks to graph-structured data. arXiv:1704.08165. Retrieved from https://arxiv.org/abs/1704.08165.Google Scholar
- [18] . 2015. Deep convolutional networks on graph-structured data. arXiv:1506.05163. Retrieved from https://arxiv.org/abs/1506.05163.Google Scholar
- [19] . 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 2008 8th IEEE International Conference on Data Mining. 263–272.Google ScholarDigital Library
- [20] . 2013. Fism: Factored item similarity models for top-n recommender systems. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 659–667.Google ScholarDigital Library
- [21] Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In ICLR(Poster).Google Scholar
- [22] . 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 426–434.Google ScholarDigital Library
- [23] . 2015. Advances in collaborative filtering. Recommender Systems Handbook (2015), 77–118.Google ScholarCross Ref
- [24] . 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37.Google ScholarDigital Library
- [25] . 2017. Mining intrinsic information by matrix factorization-based approaches for collaborative filtering in recommender systems. Neurocomputing 249 (2017), 48–63.Google ScholarDigital Library
- [26] . 2021. Interest-aware message-passing GCN for recommendation. In Proceedings of the Web Conference. 1296–1305.Google ScholarDigital Library
- [27] . 2017. Geometric matrix completion with recurrent multi-graph neural networks. In Proceedings of the Advances in Neural Information Processing Systems. 3697–3707.Google Scholar
- [28] . 2018. Graph convolutional networks with argument-aware pooling for event detection. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI Press, 5900–5907.Google ScholarCross Ref
- [29] . 2019. Rethinking the item order in session-based recommendation with graph neural networks. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 579–588.Google ScholarDigital Library
- [30] . 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. 452–461.Google ScholarDigital Library
- [31] . 2020. DySAT: Deep neural representation learning on dynamic graphs via self-attention networks. In Proceedings of the 13th International Conference on Web Search and Data Mining. 519–527.Google ScholarDigital Library
- [32] . 2005. Dynamic social network analysis using latent space models. ACM SIGKDD Explorations Newsletter 7, 2 (
Dec. 2005), 31–40.Google ScholarDigital Library - [33] . 2017. Dynamic edge-conditioned filters in convolutional neural networks on graphs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Google ScholarCross Ref
- [34] Joakim Skarding, Bogdan Gabrys, and Katarzyna Musial. 2021. Foundations and modeling of dynamic networks using dynamic graph neural networks: A survey. IEEE Access 9 (2021), 79143–79168.Google Scholar
- [35] . 2009. A survey of collaborative filtering techniques. Advances in Artificial Intelligence 2009 (2009), 421425:1–421425:19.Google ScholarDigital Library
- [36] . 2018. Latent relational metric learning via memory-based attention for collaborative ranking. In Proceedings of the 2018 World Wide Web Conference. 729–739.Google ScholarDigital Library
- [37] . 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems. 6000–6010.Google Scholar
- [38] . 2018. Graph attention networks. In Proceedings of the International Conference on Learning Representations.Google Scholar
- [39] . 2015. Collaborative Deep Learning for Recommender Systems. 1235–1244.Google Scholar
- [40] . 2019. Neural graph collaborative filtering. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 165–174.Google ScholarDigital Library
- [41] . 2020. Disentangled graph collaborative filtering. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1001–1010.Google ScholarDigital Library
- [42] . 2014. Improving content-based and hybrid music recommendation using deep learning. In Proceedings of the 22nd ACM International Conference on Multimedia. ACM, 627–636.Google ScholarDigital Library
- [43] Shiwen Wu, Fei Sun, Wentao Zhang, Xu Xie, and Bin Cui. 2022. Graph neural networks in recommender systems: A survey. ACM Comput. Surv. Just Accepted (May 2022).Google Scholar
- [44] . 2019. Learning shared vertex representation in heterogeneous graphs with convolutional networks for recommendation. In Proceedings of the International Joint Conference on Artificial Intelligence. 4620–4626.Google ScholarCross Ref
- [45] . 2018. Graph convolutional neural networks for web-scale recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 974–983.Google ScholarDigital Library
- [46] . 2019. STAR-GCN: Stacked and reconstructed graph convolutional networks for recommender systems. In Proceedings of the International Joint Conference on Artificial Intelligence. ijcai.org, 4264–4270.Google ScholarCross Ref
- [47] . 2019. Deep learning based recommender system: A survey and new perspectives. CSUR 52, 1 (2019), 1–38.Google ScholarDigital Library
- [48] . 2015. Daily-aware personalized recommendation based on feature-level time series analysis. In Proceedings of the 24th International Conference on World Wide Web. 1373–1383.Google ScholarDigital Library
- [49] . 2021. Temporal augmented graph neural networks for session-based recommendations. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1798–1802.Google ScholarDigital Library
- [50] Jie Zhou, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, and Maosong Sun. 2020. Graph neural networks: A review of methods and applications. AI Open 1 (2020), 57–81.Google Scholar
- [51] . 2018. Dynamic network embedding by modeling triadic closure process. In Proceedings of the AAAI Conference on Artificial Intelligence. 571–578.Google ScholarCross Ref
- [52] . 2016. Scalable temporal latent space inference for link prediction in dynamic social networks. IEEE Transactions on Knowledge and Data Engineering 28, 10 (2016), 2765–2777.Google ScholarDigital Library
- [53] . 2014. Geographic routing based on predictive locations in vehicular ad hoc networks. EURASIP Journal on Wireless Communications and Networking 2014, 1 (2014), 137.
DOI: Google ScholarCross Ref
Index Terms
- Learning Shared Representations for Recommendation with Dynamic Heterogeneous Graph Convolutional Networks
Recommendations
Bundle Recommendation with Graph Convolutional Networks
SIGIR '20: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information RetrievalBundle recommendation aims to recommend a bundle of items for a user to consume as a whole. Existing solutions integrate user-item interaction modeling into bundle recommendation by sharing model parameters or learning in a multi-task manner, which ...
Graph Collaborative Signals Denoising and Augmentation for Recommendation
SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information RetrievalGraph collaborative filtering (GCF) is a popular technique for capturing high-order collaborative signals in recommendation systems. However, GCF's bipartite adjacency matrix, which defines the neighbors being aggregated based on user-item interactions, ...
Course Recommendation Based on Graph Convolutional Neural Network
Advances and Trends in Artificial Intelligence. Theory and ApplicationsAbstractSelecting the right learning content according to learners’ learning abilities and interests is the first and most important factor in achieving good learning performance. Based on the similarity between the course rating data in the Collaborative ...
Comments