skip to main content
research-article

Modeling Cross-session Information with Multi-interest Graph Neural Networks for the Next-item Recommendation

Authors Info & Claims
Published:20 February 2023Publication History
Skip Abstract Section

Abstract

Next-item recommendation involves predicting the next item of interest of a given user from their past behavior. Users tend to browse and purchase various items on e-commerce websites according to their varied interests and needs, as reflected in their purchasing history. Most existing next-item recommendation methods aim at extracting the main point of interest in each browsing session and encapsulate it in a single representation. However, past behavior sequences reflect the multiple interests of a single user, which cannot be captured by methods that focus on single-interest contexts. Indeed, multiple interests cannot be captured in a single representation, and doing so results in missing information. Therefore, we propose a model with a multi-interest structure for capturing the various interests of users from their behavior sequence. Moreover, we adopted a method based on a graph neural network to construct interest graphs based on the historical and current behavior sequences of users. These graphs can capture complex item transition patterns related to different interests. In experiments, the proposed method outperforms state-of-the-art session-based recommendation systems on three real-world datasets, achieving 4% improvement of Recall over the SOTAs on Jdata dataset.

REFERENCES

  1. [1] Boratto Ludovico, Carta Salvatore, and Saia Roberto. 2016. Improving the accuracy of latent-space-based recommender systems by introducing a cut-off criterion. In Proceedings of the EnCHIReS@ EICS. 4453.Google ScholarGoogle Scholar
  2. [2] Cen Yukuo, Zhang Jianwei, Zou Xu, Zhou Chang, Yang Hongxia, and Tang Jie. 2020. Controllable multi-interest framework for recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 29422951.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. [3] Chen Xu, Xu Hongteng, Zhang Yongfeng, Tang Jiaxi, Cao Yixin, Qin Zheng, and Zha Hongyuan. 2018. Sequential recommendation with user memory networks. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 108116.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. [4] Fernández-Tobías Ignacio, Cantador Iván, Kaminskas Marius, and Ricci Francesco. 2012. Cross-domain recommender systems: A survey of the state of the art. In Proceedings of the Spanish Conference on Information Retrieval. sn, 112.Google ScholarGoogle Scholar
  5. [5] Guo Cheng, Zhang Mengfei, Fang Jinyun, Jin Jiaqi, and Pan Mao. 2020. Session-based recommendation with hierarchical leaping networks. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 17051708.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] He Xiangnan, Zhang Hanwang, Kan Min-Yen, and Chua Tat-Seng. 2016. Fast matrix factorization for online recommendation with implicit feedback. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. 549558.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. [7] Hidasi Balázs, Karatzoglou Alexandros, Baltrunas Linas, and Tikk Domonkos. 2016. Session-based recommendations with recurrent neural networks. In Proceedings of the International Conference on Learning Representations. http://arxiv.org/abs/1511.06939.Google ScholarGoogle Scholar
  8. [8] Kang Wang-Cheng and McAuley Julian. 2018. Self-attentive sequential recommendation. In Proceedings of the 2018 IEEE International Conference on Data Mining. IEEE, 197206.Google ScholarGoogle ScholarCross RefCross Ref
  9. [9] Koren Yehuda, Bell Robert, and Volinsky Chris. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 3037.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. [10] Li Chao, Liu Zhiyuan, Wu Mengmeng, Xu Yuchi, Zhao Huan, Huang Pipei, Kang Guoliang, Chen Qiwei, Li Wei, and Lee Dik Lun. 2019. Multi-interest network with dynamic routing for recommendation at tmall. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 26152623.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] Li Jing, Ren Pengjie, Chen Zhumin, Ren Zhaochun, Lian Tao, and Ma Jun. 2017. Neural attentive session-based recommendation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 14191428.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. [12] Li Pan and Tuzhilin Alexander. 2020. DDTCDR: Deep dual transfer cross domain recommendation. In Proceedings of the 13th International Conference on Web Search and Data Mining. 331339.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Yujia Li, Richard Zemel, Marc Brockschmidt, and Daniel Tarlow. 2016. Gated Graph Sequence Neural Networks. In Proceedings of ICLR16. arXiv:1511.05493. Retrieved from https://arxiv.org/abs/1511.05493.Google ScholarGoogle Scholar
  14. [14] Liu Qiao, Zeng Yifu, Mokhosi Refuoe, and Zhang Haibin. 2018. STAMP: Short-term attention/memory priority model for session-based recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 18311839.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Nilashi Mehrbakhsh, Ibrahim Othman, and Bagherifard Karamollah. 2018. A recommender system based on collaborative filtering using ontology and dimensionality reduction techniques. Expert Systems with Applications 92 (2018), 507520.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Qiu Ruihong, Li Jingjing, Huang Zi, and Yin Hongzhi. 2019. Rethinking the item order in session-based recommendation with graph neural networks. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 579588.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. [17] Quadrana Massimo, Karatzoglou Alexandros, Hidasi Balázs, and Cremonesi Paolo. 2017. Personalizing session-based recommendations with hierarchical recurrent neural networks. In Proceedings of the 11th ACM Conference on Recommender Systems. ACM, 130137.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. [18] Ren Pengjie, Chen Zhumin, Li Jing, Ren Zhaochun, Ma Jun, and Rijke Maarten De. 2019. Repeatnet: A repeat aware neural recommendation machine for session-based recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence. 48064813.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Rendle Steffen, Freudenthaler Christoph, Gantner Zeno, and Schmidt-Thieme Lars. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence. 452–461. arXiv:1205.2618. Retrieved from https://arxiv.org/abs/1205.2618.Google ScholarGoogle Scholar
  20. [20] Rendle Steffen, Freudenthaler Christoph, and Schmidt-Thieme Lars. 2010. Factorizing personalized markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web. ACM, 811820.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. [21] Sabour Sara, Frosst Nicholas, and Hinton Geoffrey E.. 2017. Dynamic routing between capsules. In Advances in Neural Information Processing Systems 30 (2017). arXiv:1710.09829. Retrieved from https://arxiv.org/abs/1710.09829.Google ScholarGoogle Scholar
  22. [22] Saia Roberto, Boratto Ludovico, and Carta Salvatore. 2016. A semantic approach to remove incoherent items from a user profile and improve the accuracy of a recommender system. Journal of Intelligent Information Systems 47, 1 (2016), 111134.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. [23] Sarwar Badrul, Karypis George, Konstan Joseph, and Riedl John. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. 285295.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. [24] Scarselli Franco, Gori Marco, Tsoi Ah Chung, Hagenbuchner Markus, and Monfardini Gabriele. 2008. The graph neural network model. IEEE Transactions on Neural Networks 20, 1 (2008), 6180.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. [25] Schafer J. Ben, Frankowski Dan, Herlocker Jon, and Sen Shilad. 2007. Collaborative filtering recommender systems. In Proceedings of the Adaptive Web. Springer, 291324.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Shani Guy, Heckerman David, and Brafman Ronen I.. 2005. An MDP-based recommender system. Journal of Machine Learning Research 6, 9 (2005), 12651295.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. [27] Silveira Thiago, Zhang Min, Lin Xiao, Liu Yiqun, and Ma Shaoping. 2019. How good your recommender system is? A survey on evaluations in recommendation. International Journal of Machine Learning and Cybernetics 10, 5 (2019), 813831.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. [28] Song Wenzhuo, Wang Shoujin, Wang Yan, and Wang Shengsheng. 2021. Next-item recommendations in short sessions. In Fifteenth ACM Conference on Recommender Systems. 282291.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. [29] Tan Yong Kiam, Xu Xinxing, and Liu Yong. 2016. Improved recurrent neural networks for session-based recommendations. In Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 1722.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. [30] Tang Jiaxi and Wang Ke. 2018. Personalized top-n sequential recommendation via convolutional sequence embedding. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. ACM, 565573.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. [31] Vaswani Ashish, Shazeer Noam, Parmar Niki, Uszkoreit Jakob, Jones Llion, Gomez Aidan N., Kaiser Łukasz, and Polosukhin Illia. 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems. 59986008.Google ScholarGoogle Scholar
  32. [32] Wang Jinshan, Xu Qianfang, Lei Jiahuan, Lin Chaoqun, and Xiao Bo. 2020. PA-GGAN: Session-based recommendation with position-aware gated graph attention network. In Proceedings of the 2020 IEEE International Conference on Multimedia and Expo. IEEE, 16.Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Wang Meirui, Ren Pengjie, Mei Lei, Chen Zhumin, Ma Jun, and Rijke Maarten de. 2019. A collaborative session-based recommendation approach with parallel memory modules. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 345354.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. [34] Wang Shoujin, Cao Longbing, Wang Yan, Sheng Quan Z., Orgun Mehmet A., and Lian Defu. 2021. A survey on session-based recommender systems. ACM Computing Surveys 54, 7 (2021), 138.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. [35] Wang Shoujin, Hu Liang, Cao Longbing, Huang Xiaoshui, Lian Defu, and Liu Wei. 2018. Attention-based transactional context embedding for next-item recommendation. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence.Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Wang Shoujin, Hu Liang, Wang Yan, Sheng Quan Z., Orgun Mehmet, and Cao Longbing. 2020. Intention nets: Psychology-inspired user choice behavior modeling for next-basket prediction. In Proceedings of the AAAI Conference on Artificial Intelligence. 62596266.Google ScholarGoogle ScholarCross RefCross Ref
  37. [37] Wang Shoujin, Hu Liang, Wang Yan, Sheng Quan Z., Orgun Mehmet, and Cao Longbing. 2020. Intention2Basket: A neural intention-driven approach for dynamic next-basket planning. In Proceedings of the 29th International Joint Conference on Artificial Intelligence. 23332339.Google ScholarGoogle ScholarCross RefCross Ref
  38. [38] Wang Shoujin, Hu Liang, Wang Yan, Sheng Quan Z., Orgun Mehmet A., and Cao Longbing. 2019. Modeling multi-purpose sessions for next-item recommendations via mixture-channel purpose routing networks. In Proceedings of the IJCAI. 37713777.Google ScholarGoogle ScholarCross RefCross Ref
  39. [39] Wang Ziyang, Wei Wei, Cong Gao, Li Xiao-Li, Mao Xian-Ling, and Qiu Minghui. 2020. Global context enhanced graph neural networks for session-based recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 169178.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Wu Shu, Tang Yuyuan, Zhu Yanqiao, Wang Liang, Xie Xing, and Tan Tieniu. 2019. Session-based recommendation with graph neural networks. In Proceedings of the AAAI Conference on Artificial Intelligence. 33. 346353.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. [41] Xu Chengfeng, Zhao Pengpeng, Liu Yanchi, Sheng Victor S., Xu Jiajie, Zhuang Fuzhen, Fang Junhua, and Zhou Xiaofang. 2019. Graph contextualized self-attention network for session-based recommendation. In Proceedings of the IJCAI. 39403946.Google ScholarGoogle ScholarCross RefCross Ref
  42. [42] Yu Feng, Zhu Yanqiao, Liu Qiang, Wu Shu, Wang Liang, and Tan Tieniu. 2020. TAGNN: Target attentive graph neural networks for session-based recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1921–1924. arXiv:2005.02844. Retrieved from https://arxiv.org/abs/2005.02844.Google ScholarGoogle Scholar
  43. [43] Yuan Fajie, Karatzoglou Alexandros, Arapakis Ioannis, Jose Joemon M., and He Xiangnan. 2019. A simple convolutional generative network for next item recommendation. In Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 582590.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. [44] Zhang Yinan, Liu Yong, Han Peng, Miao Chunyan, Cui Lizhen, Li Baoli, and Tang Haihong. 2020. Learning personalized itemset mapping for cross-domain recommendation. In Proceedings of the 29th International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, 25612567.Google ScholarGoogle ScholarCross RefCross Ref
  45. [45] Zhu Nengjun, Cao Jian, Lu Xinjiang, and Xiong Hui. 2021. Learning a hierarchical intent model for next-item recommendation. ACM Transactions on Information Systems 40, 2 (2021), 128.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Modeling Cross-session Information with Multi-interest Graph Neural Networks for the Next-item Recommendation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Knowledge Discovery from Data
        ACM Transactions on Knowledge Discovery from Data  Volume 17, Issue 1
        January 2023
        375 pages
        ISSN:1556-4681
        EISSN:1556-472X
        DOI:10.1145/3572846
        Issue’s Table of Contents

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 February 2023
        • Online AM: 27 April 2022
        • Accepted: 14 April 2022
        • Revised: 14 March 2022
        • Received: 2 November 2021
        Published in tkdd Volume 17, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
      • Article Metrics

        • Downloads (Last 12 months)547
        • Downloads (Last 6 weeks)51

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text

      HTML Format

      View this article in HTML Format .

      View HTML Format