Skip to main content

Advertisement

Springer Nature Link
Log in

A sequence recommendation method based on external reinforcement and position separation

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Sequential Recommendation systems play a crucial role in predicting users’ preferences based on their behavioral history. However, the existing methods ignore the extrapolation nature of sequences and do not make deep use of item provider information. This oversight limits the model’s ability to fully utilize relevant external properties. To alleviate these limitations, we design a recommendation model that incorporates Position encoding and external reinforcement (Item -Provider), named DPSRec. Specifically, we design an Embed Encoding layer, in order to distinguish the Position Embedding of previous sequence models, we combine the time variability with the position encoding with extrapolation property, and encode the item and item provider sequences accordingly. Meanwhile, to avoid the noise that the initial item embeddings might cause with Position Encoding, we calculate the position Encoding separately from the item embedding. In addition, we design a Cross Propagation layer to capture implicit higher-order dependencies between item sequences. Extensive experiments on three real-world datasets demonstrate that the proposed model generally outperforms the baselines by about 1–12.5%. Our source code will be published after the paper is published.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Availability of data and materials

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Li J, Zhu J, Bi Q, Cai G, Shang L, Dong Z, Jiang X, Liu Q (2022) MINER: multi-interest matching network for news recommendation. In: Findings of the Association for Computational Linguistics: ACL 2022, Dublin, Ireland, May 22–27, 2022, pp 343–352

  2. Bi Q, Li J, Shang L, Jiang X, Liu Q, Yang H (2022) MTREC: multi-task learning over BERT for news recommendation. In: Findings of the Association for Computational Linguistics: ACL 2022, pp 2663–2669

  3. Ma Y, He Y, Zhang A, Wang X, Chua T-S (2022) CrossCBR: cross-view contrastive learning for bundle recommendation. In: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp 1233–1241

  4. Covington P, Adams J, Sargin E (2016) Deep neural networks for YouTube recommendations. In: ACM Conference on Recommender Systems, pp 191–198

  5. Fan W, Ma Y, Li Q, He Y, Yin D (2019) Graph neural networks for social recommendation

  6. Mcauley J, He R (2016) Fusing similarity models with Markov chains for sparse sequential recommendation

  7. He D, Ke G, Liu TY (2020) Rethinking positional encoding in language pre-training

  8. Huang L, Ma Y, Liu Y, Du Danny B, Wang S, Li D (2023) Position-enhanced and time-aware graph convolutional network for sequential recommendations. ACM New York, NY

  9. Fan X, Liu Z, Lian J, Zhao WX, Wen JR (2021) Lighter and better: Low-rank decomposed self-attention networks for next-item recommendation. In: SIGIR ’21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

  10. Yuan X, Duan D, Tong L, Shi L, Zhang C (2021) ICAI-SR: item categorical attribute integrated sequential recommendation. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 1687–1691

  11. Liu C, Li X, Cai G, Dong Z, Zhu H, Shang L (2021) Noninvasive self-attention for side information fusion in sequential recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 35, pp 4249–4256

  12. Seng D, Li M, Zhang X, Wang J (2022) Research on neural graph collaborative filtering recommendation model fused with item temporal sequence relationships. IEEE Access 10:116972–116981

    Article  Google Scholar 

  13. Cho J, Hyun D, Lim D, Cheon H, Park H, Yu H (2023) Dynamic multi-behavior sequence modeling for next item recommendation. CoRR arXiv:2301.12105

  14. Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th International Conference on World Wide Web, WWW 2010, Raleigh, North Carolina, USA, April 26–30, 2010

  15. Wu CY, Ahmed A, Beutel A, Smola AJ, Jing H (2017) Recurrent recommender networks. In: Web Search and Data Mining

  16. Yu F, Liu Q, Wu S, Wang L, Tan T (2016) A dynamic recurrent model for next basket recommendation. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17–21, 2016, pp 729–732

  17. Hidasi B, Karatzoglou A (2017) Recurrent neural networks with top-k gains for session-based recommendations, pp 843–852

  18. Kang W, McAuley JJ (2018) Self-attentive sequential recommendation. In: IEEE International Conference on Data Mining, ICDM 2018, Singapore, November 17–20, 2018, pp 197–206

  19. Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks

  20. Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, WSDM 2018, Marina Del Rey, CA, USA, February 5–9, 2018, pp 565–573

  21. Meng X (2020) Sequential recommendation with user memory networks. Comput Rev 8:61

    Google Scholar 

  22. Huang J, Zhao WX, Dou H, Wen J, Chang EY (2018) Improving sequential recommendation with knowledge-enhanced memory networks. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08–12, 2018, pp 505–514

  23. Wu L, Li S, Hsieh C, Sharpnack J (2020) SE-PT: sequential recommendation via personalized transformer. In: RecSys 2020: Fourteenth ACM Conference on Recommender Systems, Virtual Event, Brazil, September 22–26, 2020, pp 328–337

  24. Yuan F, He X, Jiang H, Guo G, Xiong Y (2020) Future data helps training: Modeling future contexts for session-based recommendation. In: WWW ’20: The Web Conference 2020

  25. Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer

  26. Guo L, Tang L, Chen T, Zhu L, Nguyen QVH, Yin H (2021) DA-GCN: a domain-aware attentive graph convolution network for shared-account cross-domain sequential recommendation

  27. Fan Z, Liu Z, Zhang J, Xiong Y, Zheng L, Yu PS (2021) Continuous-time sequential recommendation with temporal graph collaborative transformer

  28. Wang Z, Wei W, Cong G, Li XL, Mao XL, Qiu M (2021) Global context enhanced graph neural networks for session-based recommendation

  29. Xu L, Zeng J, Peng W, Wu H, Yue K, Ding H, Zhang L, Wang X (2023) Modeling and predicting user preferences with multiple item attributes for sequential recommendations. Knowl Based Syst 260:110174

    Article  Google Scholar 

  30. Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. Computer Science

  31. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4–9, 2017, Long Beach, CA, USA, pp 5998–6008

  32. Ji-Li W, Dun-Lu P, Zhang C, Cong L (2019) AM-CNN: a convolution neural network architecture for text classification based on attention mechanism. J Chin Comput Syst

  33. Li J, Ren P, Chen Z, Ren Z, Ma J (2017) Neural attentive session-based recommendation. ACM

  34. Zhang B, Du Y, Geng Z, Guo X, Zhu H, Guo C. Long-and short-term sequential recommendation model based on transformer and mixture of experts. SSRN 4489333

  35. Xie Y, Zhou P, Kim S (2022) Decoupled side information fusion for sequential recommendation

  36. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks

  37. Ruihong Q, Jingjing L, Zi H, Hongzhi Y (2019) Rethinking the item order in session-based recommendation with graph neural networks. ACM

  38. Xu C, Zhao P, Liu Y, Sheng VS, Xu J, Zhuang F, Fang J, Zhou X (2019) Graph contextualized self-attention network for session-based recommendation. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China, August 10–16, 2019, pp 3940–3946

  39. Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 33, pp 346–353

  40. Chen Y, Liu Z, Li J, Mcauley J, Xiong C (2022) Intent contrastive learning for sequential recommendation

  41. Wang J, Yuan F, Cheng M, Jose JM, Yu C, Kong B, He X, Wang Z, Hu B, Li Z (2022) TransRec: learning transferable recommendation from mixture-of-modality feedback. arXiv preprint arXiv:2206.06190

  42. Chen L, Ding J, Yang M, Li C, Song C, Yi L (2022) Item-provider co-learning for sequential recommendation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 1817–1822

  43. Gehring J, Auli M, Grangier D, Yarats D, Dauphin YN (2017) Convolutional sequence to sequence learning. In: Precup D, Teh YW (eds) Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6–11 August 2017. Proceedings of Machine Learning Research, vol 70, pp 1243–1252

Download references

Acknowledgements

This work was supported in part Key R & D project of Shandong Province 2019JZZY010129, and in part by the Shandong Provincial Social Science Planning Project under Award 19BJCJ51, Award 18CXWJ01, and Award 18BJYJ04.

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Shandong Normal University, Jinan, 250358, Shandong, China

    Wenya Wu, Guangjin Wang, Xiufang Liang, Yingzheng Zhu, Huajuan Duan, Peiyu Liu & Ran Lu

Authors
  1. Wenya Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Guangjin Wang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Xiufang Liang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Yingzheng Zhu
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Huajuan Duan
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Peiyu Liu
    View author publications

    You can also search for this author inPubMed Google Scholar

  7. Ran Lu
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding authors

Correspondence to Peiyu Liu or Ran Lu.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, W., Wang, G., Liang, X. et al. A sequence recommendation method based on external reinforcement and position separation. J Supercomput 80, 20378–20399 (2024). https://doi.org/10.1007/s11227-024-06260-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-024-06260-0

Keywords