Skip to main content
SpringerLink
Log in

Fusing collaborative transformation with temporally aware target interaction networks for sequential recommendation

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Sequential recommendation aims to simulate the changes in users’ interests according to their historical behavior data to predict which items they may interact with next. However, most existing sequential recommendation methods (such as attention and recurrent network-based models) utilize only the user’s own behavior sequence for user modeling, ignoring the dynamic transitions between items in the temporal pattern and between users’ complex transition structures arising from multilevel interdependencies. Additionally, traditional methods fuse a sequence representation into a fixed vector, but user interests are diverse, and a single vector does not reflect the diversity of user interests, and a fixed vector representation will limit the representation capability of the model.To address the above problems, this paper proposes a novel sequential recommendation method that fuses collaborative transformations and temporally aware target interaction networks. It can automatically learn the item transformation relationships within and between sequences. We first design a global feature extraction layer. This layer explicitly captures item transitions in different sequences in the form of higher-order connectivity by performing embedding propagation using global graph contexts. The global static representation extracted after collaborative transformation is used as the initial embedding of the sequential pattern, and the user-item interaction information is integrated into the embedded representation to enhance the sequential pattern. Then, different forms of temporal embeddings are fused to capture the dynamic interest changes of users over time. Finally, the candidate target items are used to activate users’ specific interests, and some items in the interaction sequence are enhanced by measuring the correlation between historical items and candidate items, so as to realize diverse user interest modeling and greatly improve the expression ability of the model. Extensive experiments on three real datasets show that our model can effectively improve the recommendation performance compared with existing methods. Code and data are open-sourced at https://github.com/carolmky/FCTT4Rec.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM). IEEE, pp 197–206

  2. He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648

  3. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37

    Article  Google Scholar 

  4. Goldberg D, Nichols D, Oki BM, Terry D (1992) Using collaborative filtering to weave an information tapestry. Commun ACM 35(12):61–70

    Article  Google Scholar 

  5. Wang X, He X, Wang M, Feng F, Chua, T-S (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174

  6. He R, McAuley J (2016) Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM). IEEE, pp 191–200

  7. Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv:1511.06939

  8. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser, Ł., Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30

  9. Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820

  10. Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852

  11. Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the eleventh ACM conference on recommender systems, pp 130–137

  12. Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 565–573

  13. You J, Wang Y, Pal A, Eksombatchai P, Rosenburg C, Leskovec J (2019) Hierarchical temporal convolutional networks for dynamic recommender systems. In: The world wide web conference, pp 2236–2246

  14. Yuan F, Karatzoglou A, Arapakis I, Jose JM, He X (2019) A simple convolutional generative network for next item recommendation. In: Proceedings of the twelfth ACM international conference on web search and data mining, pp 582–590

  15. Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 346–353

  16. Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839

  17. Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450

  18. Fan Z, Liu Z,y Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu PS (2022) Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM web conference 2022, pp 2036–2047

  19. Koren Y (2009) Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, pp 447–456

  20. Xiang L, Yuan Q, Zhao S, Chen L, Zhang X, Yang Q, Sun J (2010) Temporal recommendation on graphs via long-and short-term preference fusion. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, pp 723–732

  21. Kumar S, Zhang X, Leskovec J (2019) Predicting dynamic embedding trajectory in temporal interaction networks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1269–1278

  22. Ye W, Wang S, Chen X, Wang X, Qin Z, Yin D (2020) Time matters: sequential recommendation with complex temporal information. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1459–1468

  23. Zhu Y, Li H, Liao Y, Wang B, Guan Z, Liu H, Cai D (2017) What to do next: modeling user behaviors by time-lstm. In: IJCAI, vol 17, pp 3602–3608

  24. Wu J, Cai R, Wang H, Déjà vu (2020) A contextualized temporal attention mechanism for sequential recommendation. In: Proceedings of the web conference 2020, pp 2199–2209

  25. Li J, Wang Y, McAuley J (2020) Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, pp 322–330

  26. Chen Z, Zhang W, Yan J, Wang G, Wang J (2021) Learning dual dynamic representations on time-sliced user-item interaction graphs for sequential recommendation. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 231–240

  27. Fan Z, Liu Z, Zhang J, Xiong Y, Zheng L, Yu PS (2021) Continuous-time sequential recommendation with temporal graph collaborative transformer. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 433–442

  28. Yang J-H, Chen C-M, Wang C-J, Tsai M-F (2018) Hop-rec: high-order proximity for implicit recommendation. In: Proceedings of the 12th ACM conference on recommender systems, pp 140–144

  29. Liu Z, Yang L, Fan Z, Peng H, Yu PS (2021) Federated social recommendation with graph neural network. ACM Trans Intell Syst Technol

  30. Huang C, Chen J, Xia L, Xu Y, Dai P, Chen Y, Bo L, Zhao J, Huang JX (2021) Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 4123–4130

  31. Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi, Ki, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: International conference on machine learning. PMLR, pp 5453–5462

  32. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv:1609.02907

  33. Dai Z, Yang Z, Yang Y, Carbonell J, Le QV, Salakhutdinov R (2019) Transformer-xl: attentive language models beyond a fixed-length context. arXiv:1901.02860

  34. Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov RR, Le QV (2019) Xlnet: generalized autoregressive pretraining for language understanding. Adv Neural Inf Process Syst 32

  35. Harper FM, Konstan JA (2015) The movielens datasets: history and context. ACM Trans Interact Intell Syst 5(4):1–19

    Article  Google Scholar 

  36. McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image-based recommendations on styles and substitutes. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pp 43–52

  37. Cho SM, Park E, Yoo S (2020) Meantime: mixture of attention mechanisms with multi-temporal embeddings for sequential recommendation. In: Fourteenth ACM conference on recommender systems, pp 515–520

  38. Yu L, Zhang C, Liang S, Zhang X (2019) Multi-order attentive ranking model for sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 5709–5716

Download references

Acknowledgements

This work was supported by National Key R&D Program of China (No.2021YFF0901302-03).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250300, Shandong, China

    Kaiyang Ma, Zhenyu Yang, Yu Wang, Laiping Cui & Wenfeng Jiang

Authors
  1. Kaiyang Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhenyu Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Laiping Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wenfeng Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Zhenyu Yang or Wenfeng Jiang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, K., Yang, Z., Wang, Y. et al. Fusing collaborative transformation with temporally aware target interaction networks for sequential recommendation. Int. J. Mach. Learn. & Cyber. 14, 1635–1649 (2023). https://doi.org/10.1007/s13042-022-01717-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-022-01717-1

Keywords

Search

Navigation