Abstract
As one of the critical application directions in the Recommendation Systems domain, the top-k recommendation model is to rank all candidate items through non-explicit feedback (e.g., some implicit interact behavior, like clicking, collecting, or viewing) from users. In this ranking, the rank shows the users’ satisfaction with recommended items or the relevance of the target item. Although previous methods all improve the performance of the final recommended ranking, they suffer from several limitations. To overcome these limitations, we propose a Multi-Relational Hierarchical Attention within Graph Neural Network (GNN)-attention-Deep Neural Network (DNN) architecture for the top-k recommendation, named MRHA for brevity. In our proposed method, we combine the GNN’s ability to learn the local item representation of graph-structure data and attention-DNN architecture’s ability to learn the user’s preference. For processing the multi-relational data that occurs in the real application scenarios, we propose a novel hierarchical attention mechanism based on the GNN-attention-DNN architecture. The comparative experiments conducted on two real-world representative datasets show the effectiveness of the proposed method.
This work was supported by National Key R&D Program of China under Grant No. 2020YFB1710200
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. arXiv preprint arXiv:1310.4546 (2013)
Perozzi, B., Al-Rfou, R., Skiena, S.: Deepwalk: online learning of social representations. In: the 20th ACM SIGKDD on KDDM, pp. 701–710. KDD 2014, Association for Computing Machinery, New York (2014). https://doi.org/10.1145/2623330.2623732
Zhou, G., et al.: Deep interest network for click-through rate prediction. In: the 24th ACM SIGKDD on KDDM, KDD 2018, pp. 1059–1068. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3219819.3219823
Kipf, T.N., Welling, M.: Semi-Supervised Classification with Graph Convolutional Networks. arXiv e-prints arXiv:1609.02907 (September 2016)
Scarselli, F., Gori, M., Tsoi, A.C., Hagenbuchner, M., Monfardini, G.: The graph neural network model. IEEE Trans. Neural Netw. 20(1), 61–80 (2009). https://doi.org/10.1109/TNN.2008.2005605
Liu, Q., Zeng, Y., Mokhosi, R., Zhang, H.: STAMP: short-term attention/Memory priority model for session-based recommendation, pp. 1831–1839. Association for Computing Machinery, New York (2018), https://doi.org/10.1145/3219819.3219950
Krohn-Grimberghe, A., Drumond, L., Freudenthaler, C., Schmidt-Thieme, L.: Multi-relational matrix factorization using bayesian personalized ranking for social network data. In: the Fifth ACM on WSDM, WSDM 2012, pp. 173–182. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2124295.2124317
Wang, W., et al.: Beyond clicks: modeling multi-relational item graph for session-based target behavior prediction, pp. 3056–3062. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3366423.3380077
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Yu, P.S.: A comprehensive survey on graph neural networks. CoRR abs/1901.00596 (2019). http://arxiv.org/abs/1901.00596
Chang, B., Jang, G., Kim, S., Kang, J.: Learning graph-based geographical latent representation for point-of-interest recommendation. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, CIKM 2020, pp. 135–144. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3340531.3411905
He, Z., Chow, C.Y., Zhang, J.D.: Game: learning graphical and attentive multi-view embeddings for occasional group recommendation. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3397271.3401064
Bruna, J., Zaremba, W., Szlam, A., LeCun, Y.: Spectral networks and locally connected networks on graphs. arXiv e-prints arXiv:1312.6203 (December 2013)
Mnih, V., Heess, N., Graves, A., Kavukcuoglu, K.: Recurrent models of visual attention. In: the 27th NIPS, NIPS 2014, pp. 2204–2212. MIT Press, Cambridge, MA, USA (2014)
Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. arXiv e-prints arXiv:1409.0473 (September 2014)
Vaswani, A., et al.: Attention is all you need. CoRR abs/1706.03762 (2017). http://arxiv.org/abs/1706.03762
Xiao, J., Ye, H., He, X., Zhang, H., Wu, F., Chua, T.S.: Attentional factorization machines: learning the weight of feature interactions via attention networks. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, pp. 3119–3125 (2017). https://doi.org/10.24963/ijcai.2017/435
Wang, S., Hu, L., Cao, L., Huang, X., Lian, D., Liu, W.: Attention-based transactional context embedding for next-item recommendation. In: Thirty-Second AAAI 2018, pp. 2532–2539. Association for the Advancement of Artificial Intelligence, United States (2018)
Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X., Tan, T.: Session-based recommendation with graph neural networks. In: the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 346–353 (July 2019). https://doi.org/10.1609/aaai.v33i01.3301346, https://ojs.aaai.org/index.php/AAAI/article/view/3804
Zhou, C., et al.: Atrank: an attention-based user behavior modeling framework for recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, no. 1, April 2018. https://ojs.aaai.org/index.php/AAAI/article/view/11618
Lu, J., Yang, J., Batra, D., Parikh, D.: Hierarchical question-image co-attention for visual question answering. CoRR abs/1606.00061 (2016), http://arxiv.org/abs/1606.00061
Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: the 10th WWW, WWW 2001, pp. 285–295. Association for Computing Machinery, New York (2001). https://doi.org/10.1145/371920.372071
Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based Recommendations with Recurrent Neural Networks. arXiv e-prints arXiv:1511.06939 (November 2015)
Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., Ma, J.: Neural attentive session-based recommendation, pp. 1419–1428. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3132847.3132926
Khandelwal, U., He, H., Qi, P., Jurafsky, D.: Sharp nearby, fuzzy far away: how neural language models use context. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 284–294. Association for Computational Linguistics, Melbourne, Australia, July 2018. https://doi.org/10.18653/v1/P18-1027, https://www.aclweb.org/anthology/P18-1027
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, S., Zhu, J., XI, H. (2022). Multi-Relational Hierarchical Attention for Top-k Recommendation. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2021. Lecture Notes in Computer Science(), vol 13156. Springer, Cham. https://doi.org/10.1007/978-3-030-95388-1_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-95388-1_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95387-4
Online ISBN: 978-3-030-95388-1
eBook Packages: Computer ScienceComputer Science (R0)