skip to main content
10.1145/3640912.3640983acmotherconferencesArticle/Chapter ViewAbstractPublication PagescnmlConference Proceedingsconference-collections
research-article

Recurrent Attentive Neural Networks for Sequential Recommendation

Published:22 February 2024Publication History

ABSTRACT

Sequential recommendation is essential in modern online service platforms. By modeling the evolving preferences of a user from the historical behavior sequence, sequential recommendation aims to predict the next interaction of the user in the near future. For sequential recommendation, it is challenging to comprehensively characterize user preferences based on historical behavior sequences. In this paper, we propose a Recurrent Attentive Neural Networks model (RANN) for sequential recommendation, which characterizes the user preference from the long-term preference, short-term interest, and current sequential pattern. Specifically, the long short-term memory network is employed to generate the cell state and hidden state at each time step for each user, which represent the long-term preference and the current sequential pattern of the user, respectively. And the scaled dot-product attention is utilized to capture the short-term interest feature among the most recent hidden states. Finally, user preference features and item embeddings are integrated into a next-item prediction network for sequential recommendation. Experimental results on the real-world dataset verify the superiority of RANN against state-of-the-art baselines.

References

  1. S. Rendle, C. Freudenthaler, L. Schmidt-Thieme, Factorizing Personalized Markov Chains for Next-Basket Recommendation, in: Proceedings of the 19th International Conference on World Wide Web (WWW), 2010, pp. 811–820.Google ScholarGoogle Scholar
  2. R. He, J. McAuley, Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation, in: Proceedings of the 16th IEEE International Conference on Data Mining (ICDM), 2016, pp. 191–200.Google ScholarGoogle Scholar
  3. S. Chen, J. L. Moore, D. R. Turnbull, T. Joachims, Playlist Prediction via Metric Embedding, in: Proceedings of the 18th ACM International Conference on Knowledge Discovery and Data Mining (SIGKDD), 2012, pp. 714–722.Google ScholarGoogle Scholar
  4. B. Hidasi, A. Karatzoglou, L. Baltrunas, D. Tikk, Session-Based Recommendations with Recurrent Neural Networks, in: Proceedings of the 4th International Conference on Learning Representations (ICLR), 2016.Google ScholarGoogle Scholar
  5. C. Xu, P. Zhao, Y. Liu, J. Xu, V. S. Sheng, Z. Cui, X. Zhou, H. Xiong, Recurrent Convolutional Neural Network for Sequential Recommendation, in: Proceedings of the 28th International Conference on World Wide Web (WWW), 2019, pp. 3398–3404.Google ScholarGoogle Scholar
  6. A. Yan, S. Cheng, W. Kang, M. Wan, J. McAuley, CosRec: 2D Convolutional Neural Networks for Sequential Recommendation, in: Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM), 2019, pp. 2173–2176.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. W. Kang, J. McAuley, Self-Attentive Sequential Recommendation, in: Proceedings of the 18th IEEE International Conference on Data Mining (ICDM), 2018, pp. 197–206.Google ScholarGoogle Scholar
  8. T. Zhang, P. Zhao, Y. Liu, V. S. Sheng, J. Xu, D. Wang, G. Liu, X. Zhou, Feature-level Deeper Self-Attention Network for Sequential Recommendation, in: Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI), 2019, pp. 4320–4326.Google ScholarGoogle Scholar
  9. S. Hochreiter, J. Schmidhuber, Long Short-Term Memory, Neural Computation 9, 1997, 1735–1780.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, I. Polosukhin, Attention Is All You Need, in: Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS), 2017, pp. 6000–6010.Google ScholarGoogle Scholar
  11. D. P. Kingma, J. L. Ba, Adam: A Method for Stochastic Optimization, in: Proceedings of the 3rd International Conference on Learning Representations (ICLR), 2015.Google ScholarGoogle Scholar
  12. X. He, L. Liao, H. Zhang, L. Nie, X. Hu, T.-S. Chua, Neural Collaborative Filtering, in: Proceedings of the 26th International Conference on World Wide Web (WWW), 2017, pp. 173–182.Google ScholarGoogle Scholar

Index Terms

  1. Recurrent Attentive Neural Networks for Sequential Recommendation
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          CNML '23: Proceedings of the 2023 International Conference on Communication Network and Machine Learning
          October 2023
          446 pages
          ISBN:9798400716683
          DOI:10.1145/3640912

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 22 February 2024

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited
        • Article Metrics

          • Downloads (Last 12 months)12
          • Downloads (Last 6 weeks)7

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format