Skip to main content

Advertisement

DTR4Rec: direct transition relationship for sequential recommendation

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Sequential recommendation aims at mining user interests through modeling sequential behaviors. Most existing sequential recommendation methods overlook the direct transition relationship among items, and only encode a user sequence as a whole, capturing the intention behind the sequence and predicting the next item with which the user might interact. However, in real-world scenarios, a small subset of items within a sequence may directly impact future interactions due to the direct transition relationship among items. To solve the above problem, in this paper, we propose a novel framework called Direct Transition Relationship for Recommendation (DTR4Rec). Specifically, we first construct a long-term direct transition matrix and a short-term co-occurrence matrix among items based on their occurrence patterns in the interaction data. The long-term direct transition matrix is constructed by counting the frequency of transitions from one item to another within a relatively long window. The short-term co-occurrence matrix is built by counting the frequency of co-occurrences of two items within a short window. We further utilize a learnable fusion approach to blend traditional sequence transition patterns with the direct transition relationship among items for predicting the next item. This integration is accomplished through a learnable fusion matrix. Additionally, in order to mitigate the data sparsity problem and enhance the generalization of the model, we propose a new paradigm for computing item similarity, which considers both collaborative filtering similarity and sequential similarity among items, then such similarity is utilized to substitute part of items in the sequence, thereby creating augmented data. We conduct extensive experiments on three real-world datasets, demonstrating that DTR4Rec outperforms state-of-the-art baselines for sequential recommendation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

All data used in the paper are released and available, including Beauty, Sports, and KuaiRand.

Notes

  1. https://jmcauley.ucsd.edu/data/amazon/

  2. https://kuairand.com/

  3. https://github.com/RUCAIBox/RecBole/tree/0.2.x

  4. https://github.com/HKUDS/SSLRec/tree/main

  5. https://github.com/RUCAIBox/CIKM2020-S3Rec

  6. https://github.com/salesforce/SRMA

  7. https://github.com/QinHsiu/MCLRec

  8. https://jmcauley.ucsd.edu/data/amazon/

  9. https://jmcauley.ucsd.edu/data/amazon/

  10. https://kuairand.com/

References

  1. Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450

  2. Jannach D, Ludewig M (2017) When recurrent neural networks meet the neighborhood for session-based recommendation. In: Proceedings of the eleventh ACM conference on recommender systems, pp 306–310

  3. He R, McAuley J (2016) Fusing similarity models with markov chains for sparse sequential recommendation. In: 2016 IEEE 16th International conference on data mining (ICDM), IEEE, pp 191–200

  4. Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852

  5. Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv:1511.06939

  6. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30

  7. Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE International conference on data mining (ICDM), IEEE, pp 197–206

  8. Zhang Y, Wang X, Chen H, Zhu W (2023) Adaptive disentangled transformer for sequential recommendation. In: Proceedings of the 29th ACM SIGKDD conference on knowledge discovery and data mining, pp 3434–3445

  9. He M, An B, Wang J, Wen H (2023) Cetd: Counterfactual explanations by considering temporal dependencies in sequential recommendation. Appl Sci 13(20):11176

    Article  Google Scholar 

  10. Liu Q, Yan F, Zhao X, Du Z, Guo H, Tang R, Tian F (2023) Diffusion augmentation for sequential recommendation. In: Proceedings of the 32nd ACM International conference on information and knowledge management, pp 1576–1586

  11. Wang Z, Zhang J, Xu H, Chen X, Zhang Y, Zhao WX, Wen J-R (2021) Counterfactual data-augmented sequential recommendation. In: Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, pp 347–356

  12. Yang Y, Huang C, Xia L, Huang C, Luo D, Lin K (2023) Debiased contrastive learning for sequential recommendation. In: Proceedings of the ACM web conference 2023, pp 1063–1073

  13. Qin X, Yuan H, Zhao P, Fang J, Zhuang F, Liu G, Liu Y, Sheng V (2023) Meta-optimized contrastive learning for sequential recommendation. arXiv:2304.07763

  14. Li X, Sun A, Zhao M, Yu J, Zhu K, Jin D, Yu M, Yu R (2023) Multi-intention oriented contrastive learning for sequential recommendation. In: Proceedings of the Sixteenth ACM international conference on web search and data mining, pp 411–419

  15. Zhou X, Zhou H, Liu Y, Zeng Z, Miao C, Wang P, You Y, Jiang F (2023) Bootstrap latent representations for multi-modal recommendation. In: Proceedings of the ACM web conference 2023, pp 845–854

  16. Zhao G, Lei X, Qian X, Mei T (2018) Exploring users’ internal influence from reviews for social recommendation. IEEE Trans Multimed 21(3):771–781

    Article  MATH  Google Scholar 

  17. Wang Z, Chen H, Li Z, Lin K, Jiang N, Xia F (2021) Vrconvmf: Visual recurrent convolutional matrix factorization for movie recommendation. IEEE Trans Emerg Topics Comput Intell 6(3):519–529

    Article  Google Scholar 

  18. Chen J, Zhu T, Gong M, Wang Z (2022) A game-based evolutionary clustering with historical information aggregation for personal recommendation. IEEE Trans Emerg Topics Comput Intell 7(2):552–564

    Article  MATH  Google Scholar 

  19. Gao H, Qin X, Barroso RJD, Hussain W, Xu Y, Yin Y (2020) Collaborative learning-based industrial iot api recommendation for software-defined devices: the implicit knowledge discovery perspective. IEEE Trans Emerg Topics Comput Intell 6(1):66–76

    Article  Google Scholar 

  20. Yin Y, Li Y, Gao H, Liang T, Pan Q (2022) Fgc: Gcn-based federated learning approach for trust industrial service recommendation. IEEE Trans Indust Inf 19(3):3240–3250

    Article  MATH  Google Scholar 

  21. Xu Y, Wang Z, Gao H, Jiang Z, Yin Y, Li R (2023) Towards machine-learning-driven effective mashup recommendations from big data in mobile networks and the internet-of-things. Digital Commun Netw 9(1):138–145

    Article  MATH  Google Scholar 

  22. Gao H, Qiu B, Wang Y, Yu S, Xu Y, Wang X (2023) Tbdb: Token bucket-based dynamic batching for resource scheduling supporting neural network inference in intelligent consumer electronics. IEEE Trans Consumer Electron

  23. Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th International conference on world wide web, pp 811–820

  24. Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM international conference on web search and data mining, pp 565–573

  25. Peng B, Ren Z, Parthasarathy S, Ning X (2021) Ham: Hybrid associations models for sequential recommendation. IEEE Trans Knowl Data Eng 34(10):4838–4853

    Article  MATH  Google Scholar 

  26. Zhou P, Ye Q, Xie Y, Gao J, Wang S, Kim JB, You C, Kim S (2023) Attention calibration for transformer-based sequential recommendation. In: Proceedings of the 32nd ACM international conference on information and knowledge management, pp 3595–3605

  27. Lin G, Gao C, Li Y, Zheng Y, Li Z, Jin D, Li Y (2022) Dual contrastive network for sequential recommendation. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval, pp 2686–2691

  28. Liu C, Gao C, Yuan Y, Bai C, Luo L, Du X, Shi X, Luo H, Jin D, Li Y (2022) Modeling persuasion factor of user decision for recommendation. In: Proceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining, pp 3366–3376

  29. Yu J, Xia X, Chen T, Cui L, Hung NQV, Yin H (2023) Xsimgcl: Towards extremely simple graph contrastive learning for recommendation. IEEE Trans Knowl Data Eng

  30. Yuan F, He X, Jiang H, Guo G, Xiong J, Xu Z, Xiong Y (2020) Future data helps training: Modeling future contexts for session-based recommendation. In: Proceedings of the web conference 2020, pp 303–313

  31. Chen Y, Liu Z, Li J, McAuley J, Xiong C (2022) Intent contrastive learning for sequential recommendation. In: Proceedings of the ACM web conference 2022, pp 2172–2182

  32. Wu Z, Wang X, Chen H, Li K, Han Y, Sun L, Zhu W (2023) Diff4rec: Sequential recommendation with curriculum-scheduled diffusion augmentation. In: Proceedings of the 31st ACM international conference on multimedia, pp 9329–9335

  33. Wang Y, Zhang H, Liu Z, Yang L, Yu PS (202) Contrastvae: Contrastive variational autoencoder for sequential recommendation. In: Proceedings of the 31st ACM international conference on information & knowledge management, pp 2056–2066

  34. Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805

  35. Poulain R, Gupta M, Foraker R, Beheshti R (2021) Transformer-based multi-target regression on electronic health records for primordial prevention of cardiovascular disease. In: 2021 IEEE International conference on bioinformatics and biomedicine (BIBM), IEEE, pp 726–731

  36. Wu L, Li S, Hsieh C-J, Sharpnack J (2020) Sse-pt: Sequential recommendation via personalized transformer. In: Proceedings of the 14th ACM conference on recommender systems, pp 328–337

  37. Yuan E, Guo W, He Z, Guo H, Liu C, Tang R (2022) Multi-behavior sequential transformer recommender. In: Proceedings of the 45th International ACM SIGIR conference on research and development in information retrieval, pp 1642–1652

  38. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958

    MathSciNet  MATH  Google Scholar 

  39. Li F, Yu S, Zeng F, Yang F (2023) Improving sequential recommendation models with an enhanced loss function. arXiv:2301.00979

  40. Qiu R, Huang Z, Yin H, Wang Z (2022) Contrastive learning for representation degeneration problem in sequential recommendation. In: Proceedings of the Fifteenth ACM international conference on web search and data mining, pp 813–823

  41. Zhou K, Wang H, Zhao WX, Zhu Y, Wang S, Zhang F, Wang Z, Wen J-R (2020) S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In: Proceedings of the 29th ACM international conference on information & knowledge management, pp 1893–1902

  42. Xie X, Sun F, Liu Z, Gao J, Ding B, Cui B (2020) Contrastive pre-training for sequential recommendation. arXiv:2010.14395

  43. Liu Z, Chen Y, Li J, Luo M, Yu PS, Xiong C (2022) Improving contrastive learning with model augmentation. arXiv:2203.15508

  44. Zhao WX, Mu S, Hou Y, Lin Z, Chen Y, Pan X, Li K, Lu Y, Wang H, Tian C, Min Y, Feng Z, Fan X, Chen X, Wang P, Ji W, Li Y, Wang X, Wen J-R (2021) Recbole: Towards a unified, comprehensive and efficient framework for recommendation algorithms. In: Proceedings of the 30th ACM international conference on information & knowledge management. CIKM ’21, pp 4653–4664. Association for Computing Machinery, New York, NY, USA

Download references

Funding

This work is supported by Beijing Natural Science Foundation NOs. 4192008

Author information

Authors and Affiliations

Authors

Contributions

Han Zhang: Conceptualization, Writing - original draft. Ming He: Methodology, Formal analysis, Funding acquisition, Supervision, Writing - review & editing. Zihao Zhang: Data Curation, Software. Chang Liu: Visualization, Validation.

Corresponding author

Correspondence to Ming He.

Ethics declarations

Competing Interests

All authors declare that they have no conflicts of interest.

Ethical and informed consent for data used

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, M., Zhang, H., Zhang, Z. et al. DTR4Rec: direct transition relationship for sequential recommendation. Appl Intell 55, 10 (2025). https://doi.org/10.1007/s10489-024-05875-3

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-05875-3

Keywords