Abstract
Repeat consumption is a common phenomenon in sequential recommendation tasks, where a user revisits or repurchases items that (s)he has interacted before. Previous researches have paid attention to repeat recommendation and made great achievements in this field. However, existing studies rarely considered the phenomenon that the consumers tend to show different behavior periodicities on different items, which is important for recommendation performance. In this paper, we propose a holistic model, which integrates Graph Convolutional Network with Periodic-Attenuated Self-Attention Network (GPASAN) to model user’s different behavior patterns for a better recommendation. Specifically, we first process all the users’ action sequences to construct a graph structure, which captures the complex item connection and obtains item representations. Then, we employ a periodic channel and an attenuated channel that incorporate temporal information into the self-attention mechanism to model the user’s periodic and novel behaviors, respectively. Extensive experiments conducted on three public datasets show that our proposed model outperforms the state-of-the-art methods consistently.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anderson, A., Kumar, R., Tomkins, A., Vassilvitskii, S.: The dynamics of repeat consumption. In: WWW, pp. 419–430. ACM (2014)
Benson, A.R., Kumar, R., Tomkins, A.: Modeling user consumption sequences. In: Proceedings of the 25th International Conference on World Wide Web, pp. 519–529. International World Wide Web Conferences Steering Committee (2016)
van den Berg, R., Kipf, T.N., Welling, M.: Graph convolutional matrix completion. arXiv preprint arXiv:1706.02263 (2017)
Cai, R., Bai, X., Wang, Z., Shi, Y., Sondhi, P., Wang, H.: Modeling sequential online interactive behaviors with temporal point process. In: Proceedings of the 27th ACM CIKM, pp. 873–882. ACM (2018)
Ehrenberg, A.S.: The pattern of consumer purchases. J. Roy. Stat. Soc.: Ser. C (Appl. Stat.) 8(1), 26–41 (1959)
He, R., McAuley, J.: Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th ICDM, pp. 191–200. IEEE (2016)
Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015)
Kabbur, S., Ning, X., Karypis, G.: FISM: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 659–667. ACM (2013)
Kang, W.C., McAuley, J.: Self-attentive sequential recommendation. In: 2018 IEEE ICDM, pp. 197–206. IEEE (2018)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)
Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., Ma, J.: Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 1419–1428. ACM (2017)
Luo, A., et al.: Adaptive attention-aware gated recurrent unit for sequential recommendation. In: Li, G., Yang, J., Gama, J., Natwichai, J., Tong, Y. (eds.) DASFAA 2019. LNCS, vol. 11447, pp. 317–332. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-18579-4_19
Ren, P., Chen, Z., Li, J., Ren, Z., Ma, J., de Rijke, M.: Repeatnet: A repeat aware neural recommendation machine for session-based recommendation. arXiv preprint arXiv:1812.02646 (2018)
Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth UAI, pp. 452–461. AUAI Press (2009)
Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized Markov chains for next-basket recommendation. In: WWW, pp. 811–820. ACM (2010)
Shani, G., Heckerman, D., Brafman, R.I.: An MDP-based recommender system. J. Mach. Learn. Res. 6(Sep), 1265–1295 (2005)
Tan, Y.K., Xu, X., Liu, Y.: Improved recurrent neural networks for session-based recommendations. In: DLRS, pp. 17–22. ACM (2016)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)
Wang, C., Zhang, M., Ma, W., Liu, Y., Ma, S.: Modeling item-specific temporal dynamics of repeat consumption for recommender systems. In: WWW, pp. 1977–1987. ACM (2019)
Wang, J., Zhang, Y.: Utilizing marginal net utility for recommendation in e-commerce. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1003–1012. ACM (2011)
Xu, C., et al.: Graph contextualized self-attention network for session-based recommendation. In: Proceedings of 28th International Joint Conference Artificial Intelligence (IJCAI), pp. 3940–3946 (2019)
Xu, C., et al.: Recurrent convolutional neural network for sequential recommendation. In: WWW, pp. 3398–3404 (2019)
Yap, G.-E., Li, X.-L., Yu, P.S.: Effective next-items recommendation via personalized sequential pattern mining. In: Lee, S., Peng, Z., Zhou, X., Moon, Y.-S., Unland, R., Yoo, J. (eds.) DASFAA 2012. LNCS, vol. 7239, pp. 48–64. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-29035-0_4
Acknowledgments
This research was partially supported by NSFC (No. 61876117, 61876217, 61872258, 61728205), Suzhou Science and Technology Development Program (SYG201803), Open Program of Key Lab of IIP of CAS (No. IIP2019-1) and A Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions(PAPD).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Ma, J., Zhao, P., Liu, Y., Sheng, V.S., Xu, J., Zhao, L. (2020). Modeling Periodic Pattern with Self-Attention Network for Sequential Recommendation. In: Nah, Y., Cui, B., Lee, SW., Yu, J.X., Moon, YS., Whang, S.E. (eds) Database Systems for Advanced Applications. DASFAA 2020. Lecture Notes in Computer Science(), vol 12114. Springer, Cham. https://doi.org/10.1007/978-3-030-59419-0_34
Download citation
DOI: https://doi.org/10.1007/978-3-030-59419-0_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59418-3
Online ISBN: 978-3-030-59419-0
eBook Packages: Computer ScienceComputer Science (R0)