Abstract
Sequential recommendation aims at mining user interests through modeling sequential behaviors. Most existing sequential recommendation methods overlook the direct transition relationship among items, and only encode a user sequence as a whole, capturing the intention behind the sequence and predicting the next item with which the user might interact. However, in real-world scenarios, a small subset of items within a sequence may directly impact future interactions due to the direct transition relationship among items. To solve the above problem, in this paper, we propose a novel framework called Direct Transition Relationship for Recommendation (DTR4Rec). Specifically, we first construct a long-term direct transition matrix and a short-term co-occurrence matrix among items based on their occurrence patterns in the interaction data. The long-term direct transition matrix is constructed by counting the frequency of transitions from one item to another within a relatively long window. The short-term co-occurrence matrix is built by counting the frequency of co-occurrences of two items within a short window. We further utilize a learnable fusion approach to blend traditional sequence transition patterns with the direct transition relationship among items for predicting the next item. This integration is accomplished through a learnable fusion matrix. Additionally, in order to mitigate the data sparsity problem and enhance the generalization of the model, we propose a new paradigm for computing item similarity, which considers both collaborative filtering similarity and sequential similarity among items, then such similarity is utilized to substitute part of items in the sequence, thereby creating augmented data. We conduct extensive experiments on three real-world datasets, demonstrating that DTR4Rec outperforms state-of-the-art baselines for sequential recommendation.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
All data used in the paper are released and available, including Beauty, Sports, and KuaiRand.
Notes
References
Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450
Jannach D, Ludewig M (2017) When recurrent neural networks meet the neighborhood for session-based recommendation. In: Proceedings of the eleventh ACM conference on recommender systems, pp 306–310
He R, McAuley J (2016) Fusing similarity models with markov chains for sparse sequential recommendation. In: 2016 IEEE 16th International conference on data mining (ICDM), IEEE, pp 191–200
Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv:1511.06939
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30
Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE International conference on data mining (ICDM), IEEE, pp 197–206
Zhang Y, Wang X, Chen H, Zhu W (2023) Adaptive disentangled transformer for sequential recommendation. In: Proceedings of the 29th ACM SIGKDD conference on knowledge discovery and data mining, pp 3434–3445
He M, An B, Wang J, Wen H (2023) Cetd: Counterfactual explanations by considering temporal dependencies in sequential recommendation. Appl Sci 13(20):11176
Liu Q, Yan F, Zhao X, Du Z, Guo H, Tang R, Tian F (2023) Diffusion augmentation for sequential recommendation. In: Proceedings of the 32nd ACM International conference on information and knowledge management, pp 1576–1586
Wang Z, Zhang J, Xu H, Chen X, Zhang Y, Zhao WX, Wen J-R (2021) Counterfactual data-augmented sequential recommendation. In: Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, pp 347–356
Yang Y, Huang C, Xia L, Huang C, Luo D, Lin K (2023) Debiased contrastive learning for sequential recommendation. In: Proceedings of the ACM web conference 2023, pp 1063–1073
Qin X, Yuan H, Zhao P, Fang J, Zhuang F, Liu G, Liu Y, Sheng V (2023) Meta-optimized contrastive learning for sequential recommendation. arXiv:2304.07763
Li X, Sun A, Zhao M, Yu J, Zhu K, Jin D, Yu M, Yu R (2023) Multi-intention oriented contrastive learning for sequential recommendation. In: Proceedings of the Sixteenth ACM international conference on web search and data mining, pp 411–419
Zhou X, Zhou H, Liu Y, Zeng Z, Miao C, Wang P, You Y, Jiang F (2023) Bootstrap latent representations for multi-modal recommendation. In: Proceedings of the ACM web conference 2023, pp 845–854
Zhao G, Lei X, Qian X, Mei T (2018) Exploring users’ internal influence from reviews for social recommendation. IEEE Trans Multimed 21(3):771–781
Wang Z, Chen H, Li Z, Lin K, Jiang N, Xia F (2021) Vrconvmf: Visual recurrent convolutional matrix factorization for movie recommendation. IEEE Trans Emerg Topics Comput Intell 6(3):519–529
Chen J, Zhu T, Gong M, Wang Z (2022) A game-based evolutionary clustering with historical information aggregation for personal recommendation. IEEE Trans Emerg Topics Comput Intell 7(2):552–564
Gao H, Qin X, Barroso RJD, Hussain W, Xu Y, Yin Y (2020) Collaborative learning-based industrial iot api recommendation for software-defined devices: the implicit knowledge discovery perspective. IEEE Trans Emerg Topics Comput Intell 6(1):66–76
Yin Y, Li Y, Gao H, Liang T, Pan Q (2022) Fgc: Gcn-based federated learning approach for trust industrial service recommendation. IEEE Trans Indust Inf 19(3):3240–3250
Xu Y, Wang Z, Gao H, Jiang Z, Yin Y, Li R (2023) Towards machine-learning-driven effective mashup recommendations from big data in mobile networks and the internet-of-things. Digital Commun Netw 9(1):138–145
Gao H, Qiu B, Wang Y, Yu S, Xu Y, Wang X (2023) Tbdb: Token bucket-based dynamic batching for resource scheduling supporting neural network inference in intelligent consumer electronics. IEEE Trans Consumer Electron
Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th International conference on world wide web, pp 811–820
Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM international conference on web search and data mining, pp 565–573
Peng B, Ren Z, Parthasarathy S, Ning X (2021) Ham: Hybrid associations models for sequential recommendation. IEEE Trans Knowl Data Eng 34(10):4838–4853
Zhou P, Ye Q, Xie Y, Gao J, Wang S, Kim JB, You C, Kim S (2023) Attention calibration for transformer-based sequential recommendation. In: Proceedings of the 32nd ACM international conference on information and knowledge management, pp 3595–3605
Lin G, Gao C, Li Y, Zheng Y, Li Z, Jin D, Li Y (2022) Dual contrastive network for sequential recommendation. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval, pp 2686–2691
Liu C, Gao C, Yuan Y, Bai C, Luo L, Du X, Shi X, Luo H, Jin D, Li Y (2022) Modeling persuasion factor of user decision for recommendation. In: Proceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining, pp 3366–3376
Yu J, Xia X, Chen T, Cui L, Hung NQV, Yin H (2023) Xsimgcl: Towards extremely simple graph contrastive learning for recommendation. IEEE Trans Knowl Data Eng
Yuan F, He X, Jiang H, Guo G, Xiong J, Xu Z, Xiong Y (2020) Future data helps training: Modeling future contexts for session-based recommendation. In: Proceedings of the web conference 2020, pp 303–313
Chen Y, Liu Z, Li J, McAuley J, Xiong C (2022) Intent contrastive learning for sequential recommendation. In: Proceedings of the ACM web conference 2022, pp 2172–2182
Wu Z, Wang X, Chen H, Li K, Han Y, Sun L, Zhu W (2023) Diff4rec: Sequential recommendation with curriculum-scheduled diffusion augmentation. In: Proceedings of the 31st ACM international conference on multimedia, pp 9329–9335
Wang Y, Zhang H, Liu Z, Yang L, Yu PS (202) Contrastvae: Contrastive variational autoencoder for sequential recommendation. In: Proceedings of the 31st ACM international conference on information & knowledge management, pp 2056–2066
Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805
Poulain R, Gupta M, Foraker R, Beheshti R (2021) Transformer-based multi-target regression on electronic health records for primordial prevention of cardiovascular disease. In: 2021 IEEE International conference on bioinformatics and biomedicine (BIBM), IEEE, pp 726–731
Wu L, Li S, Hsieh C-J, Sharpnack J (2020) Sse-pt: Sequential recommendation via personalized transformer. In: Proceedings of the 14th ACM conference on recommender systems, pp 328–337
Yuan E, Guo W, He Z, Guo H, Liu C, Tang R (2022) Multi-behavior sequential transformer recommender. In: Proceedings of the 45th International ACM SIGIR conference on research and development in information retrieval, pp 1642–1652
Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958
Li F, Yu S, Zeng F, Yang F (2023) Improving sequential recommendation models with an enhanced loss function. arXiv:2301.00979
Qiu R, Huang Z, Yin H, Wang Z (2022) Contrastive learning for representation degeneration problem in sequential recommendation. In: Proceedings of the Fifteenth ACM international conference on web search and data mining, pp 813–823
Zhou K, Wang H, Zhao WX, Zhu Y, Wang S, Zhang F, Wang Z, Wen J-R (2020) S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In: Proceedings of the 29th ACM international conference on information & knowledge management, pp 1893–1902
Xie X, Sun F, Liu Z, Gao J, Ding B, Cui B (2020) Contrastive pre-training for sequential recommendation. arXiv:2010.14395
Liu Z, Chen Y, Li J, Luo M, Yu PS, Xiong C (2022) Improving contrastive learning with model augmentation. arXiv:2203.15508
Zhao WX, Mu S, Hou Y, Lin Z, Chen Y, Pan X, Li K, Lu Y, Wang H, Tian C, Min Y, Feng Z, Fan X, Chen X, Wang P, Ji W, Li Y, Wang X, Wen J-R (2021) Recbole: Towards a unified, comprehensive and efficient framework for recommendation algorithms. In: Proceedings of the 30th ACM international conference on information & knowledge management. CIKM ’21, pp 4653–4664. Association for Computing Machinery, New York, NY, USA
Funding
This work is supported by Beijing Natural Science Foundation NOs. 4192008
Author information
Authors and Affiliations
Contributions
Han Zhang: Conceptualization, Writing - original draft. Ming He: Methodology, Formal analysis, Funding acquisition, Supervision, Writing - review & editing. Zihao Zhang: Data Curation, Software. Chang Liu: Visualization, Validation.
Corresponding author
Ethics declarations
Competing Interests
All authors declare that they have no conflicts of interest.
Ethical and informed consent for data used
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
He, M., Zhang, H., Zhang, Z. et al. DTR4Rec: direct transition relationship for sequential recommendation. Appl Intell 55, 10 (2025). https://doi.org/10.1007/s10489-024-05875-3
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-05875-3