skip to main content
research-article

FLAG: A Feedback-aware Local and Global Model for Heterogeneous Sequential Recommendation

Published: 09 November 2022 Publication History

Abstract

Heterogeneous sequential recommendation that models sequences of items associated with more than one type of feedback such as examinations and purchases is an emerging topic in the research community, which is also an important problem in many real-world applications. Though there are some methods proposed to exploit different types of feedback in item sequences such as RLBL, RIB, and BINN, they are based on RNN and may not be very competitive in capturing users’ complex and dynamic preferences. And most existing advanced sequential recommendation methods such as the CNN- and attention-based methods are often designed for making use of item sequences with one single type of feedback, which thus can not be applied to the studied problem directly. As a response, we propose a novel feedback-aware local and global (FLAG) preference learning model for heterogeneous sequential recommendation. Our FLAG contains four modules, including (i) a local preference learning module for capturing a user’s short-term interest, which adopts a novel feedback-aware self-attention block to distinguish different types of feedback; (ii) a global preference learning module for modeling a user’s global preference; (iii) a local intention learning module, which takes a user’s real feedback in the next step, i.e., the user’s intention at the current step, as the query vector in a self-attention block to figure out the items that match the user’s intention well; and (iv) a prediction module for preference integration and final prediction. We then conduct extensive experiments on three public datasets and find that our FLAG significantly outperforms 13 very competitive baselines in terms of two commonly used ranking-oriented metrics in most cases. We also include ablation studies and sensitivity analysis of our FLAG to have more in-depth insights.

References

[1]
Jianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui, Yanan Niu, Yang Song, Depeng Jin, and Yong Li. 2021. Sequential recommendation with graph neural networks. In Proceedings of the 44th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’21). 378–387.
[2]
Chong Chen, Min Zhang, Yongfeng Zhang, Weizhi Ma, Yiqun Liu, and Shaoping Ma. 2020. Efficient heterogeneous collaborative filtering without negative sampling for recommendation. In Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI’20). 19–26.
[3]
Qiwei Chen, Huan Zhao, Wei Li, Pipei Huang, and Wenwu Ou. 2019. Behavior sequence transformer for e-commerce recommendation in Alibaba. In Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data. 1–4.
[4]
Tong Chen, Hongzhi Yin, Hongxu Chen, Rui Yan, Quoc Viet Hung Nguyen, and Xue Li. 2019. AIR: Attentional intention-aware recommender systems. In Proceedings of the 25th IEEE International Conference on Data Engineering (ICDE’19). 304–315.
[5]
Xiancong Chen, Lin Li, Weike Pan, and Zhong Ming. 2020. A survey on heterogeneous one-class collaborative filtering. ACM Trans. Inf. Syst. 38, 4 (2020), 35:1–35:54.
[6]
Jingtao Ding, Guanghui Yu, Xiangnan He, Yuhan Quan, Yong Li, Tat-Seng Chua, Depeng Jin, and Jiajie Yu. 2018. Improving implicit recommender systems with view data. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI’18). 3343–3349.
[7]
Chen Gao, Xiangnan He, Danhua Gan, Xiangning Chen, Fuli Feng, Yong Li, Tat-Seng Chua, Lina Yao, Yang Song, and Depeng Jin. 2021. Learning to recommend with multiple cascading behaviors. IEEE Trans. Knowl. Data Eng. 33, 6 (2021), 2588–2601.
[8]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (JMLR Proceedings), Vol. 9. 249–256.
[9]
Ruining He and Julian McAuley. 2016. Fusing similarity models with Markov chains for sparse sequential recommendation. In Proceedings of the 16th IEEE International Conference on Data Mining (ICDM’16). 191–200.
[10]
Xiangnan He, Zhankui He, Jingkuan Song, Zhenguang Liu, Yu-Gang Jiang, and Tat-Seng Chua. 2018. NAIS: Neural attentive item similarity model for recommendation. IEEE Trans. Knowl. Data Eng. 30, 12 (2018), 2354–2366.
[11]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173–182.
[12]
Yun He, Yin Zhang, Weiwen Liu, and James Caverlee. 2020. Consistency-aware recommendation for user-generated item list continuation. In Proceedings of the 13th International Conference on Web Search and Data Mining (WSDM’20). 250–258.
[13]
Balázs Hidasi and Alexandros Karatzoglou. 2018. Recurrent neural networks with top-k gains for session-based recommendations. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM’18). 843–852.
[14]
Santosh Kabbur, Xia Ning, and George Karypis. 2013. FISM: Factored item similarity models for top-n recommender systems. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’13). 659–667.
[15]
Wang-Cheng Kang and Julian J. McAuley. 2018. Self-attentive sequential recommendation. In Proceedings of the 18th IEEE International Conference on Data Mining (ICDM’18). 197–206.
[16]
Jing Li, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Tao Lian, and Jun Ma. 2017. Neural attentive session-based recommendation. In Proceedings of the ACM Conference on Information and Knowledge Management (CIKM’17). 1419–1428.
[17]
Zhi Li, Hongke Zhao, Qi Liu, Zhenya Huang, Tao Mei, and Enhong Chen. 2018. Learning from history and present: Next-item recommendation via discriminatively exploiting user behaviors. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (CIKM’18). 1734–1743.
[18]
Jing Lin, Weike Pan, and Zhong Ming. 2020. FISSA: Fusing item similarity models with self-attention networks for sequential recommendation. In Proceedings of the 14th ACM Conference on Recommender Systems (RecSys’20). 130–139.
[19]
Chang Liu, Xiaoguang Li, Guohao Cai, Zhenhua Dong, Hong Zhu, and Lifeng Shang. 2021b. Noninvasive self-attention for side information fusion in sequential recommendation. In Proceedings of the 35th AAAI Conference on Artificial Intelligence. 4249–4256.
[20]
Qiang Liu, Shu Wu, and Liang Wang. 2017. Multi-behavioral sequential prediction with recurrent log-bilinear model. IEEE Trans. Knowl. Data Eng. 29, 6 (2017), 1254–1267.
[21]
Zhiwei Liu, Ziwei Fan, Yu Wang, and Philip S. Yu. 2021a. Augmenting sequential recommendation with pseudo-prior items via reversely pre-training transformer. In Proceedings of the 44th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’21). 1608–1612.
[22]
Babak Loni, Roberto Pagano, Martha A. Larson, and Alan Hanjalic. 2016. Bayesian personalized ranking with multi-channel user feedback. In Proceedings of the 10th ACM Conference on Recommender Systems (RecSys’16). 361–364.
[23]
Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’15). 1412–1421.
[24]
Wenjing Meng, Deqing Yang, and Yanghua Xiao. 2020. Incorporating user micro-behaviors and item knowledge into multi-task learning for session-based recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’20). 1091–1100.
[25]
Weike Pan, Hao Zhong, Congfu Xu, and Zhong Ming. 2015. Adaptive Bayesian personalized ranking for heterogeneous implicit feedbacks. Knowl.-based Syst. 73 (2015), 173–180.
[26]
Massimo Quadrana, Alexandros Karatzoglou, Balázs Hidasi, and Paolo Cremonesi. 2017. Personalizing session-based recommendations with hierarchical recurrent neural networks. In Proceedings of the 11th ACM Conference on Recommender Systems (RecSys’17). 130–137.
[27]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI’09). 452–461.
[28]
Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2010. Factorizing personalized Markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web (WWW’10). 811–820.
[29]
Yatong Sun, Bin Wang, Zhu Sun, and Xiaochun Yang. 2021. Does every data instance matter? Enhancing sequential recommendation by eliminating unreliable data. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI’21). 1579–1585.
[30]
Qiaoyu Tan, Jianwei Zhang, Ninghao Liu, Xiao Huang, Hongxia Yang, Jingren Zhou, and Xia Hu. 2021. Dynamic memory based attention network for sequential recommendation. In Proceedings of the 35th AAAI Conference on Artificial Intelligence. 4384–4392.
[31]
Jiaxi Tang and Ke Wang. 2018. Personalized top-n sequential recommendation via convolutional sequence embedding. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM’18). 565–573.
[32]
Md. Mehrab Tanjim, Congzhe Su, Ethan Benjamin, Diane Hu, Liangjie Hong, and Julian J. McAuley. 2020. Attentive sequential models of latent intent for next item recommendation. In Proceedings of the 29th International Conference on World Wide Web Companion. 2528–2534.
[33]
Xiaohai Tong, Pengfei Wang, Chenliang Li, Long Xia, and ShaoZhang Niu. 2021. Pattern-enhanced contrastive policy learning network for sequential recommendation. In Proceedings of the 30th International Joint Conference on Artificial Intelligence. 1593–1599.
[34]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS’17). 6000–6010.
[35]
Zhenlei Wang, Jingsen Zhang, Hongteng Xu, Xu Chen, Yongfeng Zhang, Wayne Xin Zhao, and Ji-Rong Wen. 2021. Counterfactual data-augmented sequential recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’21). 347–356.
[36]
Yanan Xu, Yanmin Zhu, and Jiadi Yu. 2021. Modeling multiple coexisting category-level intentions for next item recommendation. ACM Trans. Inf. Syst. 39, 3 (2021), 23:1–23:24.
[37]
Xu Yuan, Hongshen Chen, Yonghao Song, Xiaofang Zhao, and Zhuoye Ding. 2021. Improving sequential recommendation consistency with self-supervised imitation. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI’21). 3321–3327.
[38]
Shengyu Zhang, Dong Yao, Zhou Zhao, Tat-Seng Chua, and Fei Wu. 2021. CauseRec: Counterfactual user sequence synthesis for sequential recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’21). 367–377.
[39]
Tingting Zhang, Pengpeng Zhao, Yanchi Liu, Victor S. Sheng, Jiajie Xu, Deqing Wang, Guanfeng Liu, and Xiaofang Zhou. 2019. Feature-level deeper self-attention network for sequential recommendation. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 4320–4326.
[40]
Meizi Zhou, Zhuoye Ding, Jiliang Tang, and Dawei Yin. 2018. Micro behaviors: A new perspective in e-commerce recommender systems. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM’18). 727–735.

Cited By

View all
  • (2024)Dynamic Stage-aware User Interest Learning for Heterogeneous Sequential RecommendationProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688103(465-474)Online publication date: 8-Oct-2024
  • (2024)Explicit and Implicit Modeling via Dual-Path Transformer for Behavior Set-informed Sequential RecommendationProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671755(329-340)Online publication date: 25-Aug-2024
  • (2023)MHANER: A Multi-source Heterogeneous Graph Attention Network for Explainable Recommendation in Online GamesACM Transactions on Intelligent Systems and Technology10.1145/362624315:4(1-23)Online publication date: 9-Oct-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 14, Issue 1
February 2023
487 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3570136
  • Editor:
  • Huan Liu
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2022
Online AM: 16 August 2022
Accepted: 01 August 2022
Revised: 28 June 2022
Received: 29 September 2021
Published in TIST Volume 14, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Heterogeneous sequential recommendation
  2. self-attention
  3. local intention
  4. local preference
  5. global preference

Qualifiers

  • Research-article
  • Refereed

Funding Sources

  • National Natural Science Foundation of China

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)95
  • Downloads (Last 6 weeks)8
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Dynamic Stage-aware User Interest Learning for Heterogeneous Sequential RecommendationProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688103(465-474)Online publication date: 8-Oct-2024
  • (2024)Explicit and Implicit Modeling via Dual-Path Transformer for Behavior Set-informed Sequential RecommendationProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671755(329-340)Online publication date: 25-Aug-2024
  • (2023)MHANER: A Multi-source Heterogeneous Graph Attention Network for Explainable Recommendation in Online GamesACM Transactions on Intelligent Systems and Technology10.1145/362624315:4(1-23)Online publication date: 9-Oct-2023

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media