Abstract
Next point-of-interest (POI) recommendation is important for users to help them find interesting venues to visit in the near future. Most previous work on this subject has incorporated geographical and temporal information into sequential patterns to predict next POIs. However, few studies have considered the influence of important factors such as users’ reviews or POIs’ popularity on sequential patterns, nor distinguished between factors of different importance for prediction. In addition, the relationships between entities in location-based social networks have been ignored in most previous work. To overcome these limitations, we proposed a model called MGCAN to flexibly incorporate various influential factors into different sequential patterns for next POI recommendation. We first used multiple graph convolutional networks and independent attention networks to model multiple sequential patterns with different influential factors. Furthermore, we designed corresponding modules to simultaneously capture general preferences of users and determine the impact of different influential factors on each user. Finally, we used multiple sequential patterns and the general preferences of users in the prediction module to predict the next POI. Experimental results on two datasets showed that the MGCAN model achieved better recommendation performance than benchmark models.









Similar content being viewed by others
References
Seo, Y. -D., Cho, Y. -S.: Point of interest recommendations based on the anchoring effect in location-based social network services. Expert Syst. Appl. 114018, 164 (2021)
Qiao, S., Han, N., Zhou, J., Li, R. -H., Jin, C., Gutierrez, L. A.: Socialmix: a familiarity-based and preference-aware location suggestion approach. Eng. Appl. Artif. Intel. 68, 192–204 (2018). https://doi.org/10.1016/j.engappai.2017.11.006
Yang, K., Zhu, J.: Next poi recommendation via graph embedding representation from h-deepwalk on hybrid network. IEEE Access 7, 171105–171113 (2019)
Aliannejadi, M., Rafailidis, D., Crestani, F.: A joint two-phase time-sensitive regularized collaborative ranking model for point of interest recommendation. IEEE Trans. Knowl. Data Eng. 32, 1050–1063 (2020)
Mingxin, G., Ling, G.: Discovering memory-based preferences for poi recommendation in location-based social networks. ISPRS International Journal of Geo-Information, 8 (2019)
Wang, W., Chen, J., Wang, J., Chen, J., Gong, Z.: Geography-aware inductive matrix completion for personalized point-of-interest recommendation in smart cities. IEEE Internet Things J. 7, 4361–4370 (2020)
Jiao, X., Xiao, Y., Zheng, W., Wang, H., Hsu, C. -H.: A novel next new point-of-interest recommendation system based on simulated user travel decision-making process. Futur. Gener. Comput. Syst. 100, 982–993 (2019)
Yu, F., Cui, L., Guo, W., Lu, X., Li, Q., Lu, H.: A category-aware deep model for successive poi recommendation on sparse check-in data. In: Proceedings of The Web Conference 2020. WWW ’20, pp. 1264–1274. Association for Computing Machinery (2020)
Cheng, C., Yang, H., Lyu, M. R., King, I.: Where you like to go next: Successive point-of-interest recommendation. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. IJCAI ’13, pp. 2605–2611 (2013)
Cui, Q., Tang, Y., Wu, S., Wang, L.: Distance2pre: Personalized spatial preference for next point-of-interest prediction. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 289–301. Springer (2019)
Wu, Y., Li, K., Zhao, G., Qian, X.: Long-and short-term preference learning for next poi recommendation. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 2301–2304 (2019)
Zhu, Y., Li, H., Liao, Y., Wang, B., Guan, Z., Liu, H., Cai, D.: What to do next: Modeling user behaviors by time-lstm. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, pp. 3602–3608 (2017)
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., Polosukhin, I.: Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. NIPS’17, pp. 6000–6010. Curran Associates Inc. (2017)
Kang, W. -C., McAuley, J.: Self-attentive sequential recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 197–206 (2018)
Wu, J., Cai, R., Wang, H.: Déjà vu: a contextualized temporal attention mechanism for sequential recommendation. In: Proceedings of The Web Conference 2020, pp. 2199–2209 (2020)
Ji, M., Joo, W., Song, K., Kim, Y. -Y., Moon, I. -C.: Sequential recommendation with relation-aware kernelized self-attention. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 4304–4311 (2020)
Gao, R., Li, J., Li, X., Song, C., Chang, J., Liu, D., Wang, C.: Stscr: Exploring spatial-temporal sequential influence and social information for location recommendation. Neurocomputing 319, 118–133 (2018)
Hosseini, S., Yin, H., Zhou, X., Sadiq, S., Kangavari, M. R., Cheung, N. -M.: Leveraging multi-aspect time-related influence in location recommendation. World Wide Web 22(3), 1001–1028 (2019)
Han, H., Zhang, M., Hou, M., Zhang, F., Wang, Z., Chen, E., Wang, H., Ma, J., Liu, Q.: Stgcn: A spatial-temporal aware graph learning method for poi recommendation. In: 2020 IEEE International Conference on Data Mining (ICDM), pp. 1052–1057. IEEE (2020)
Zhong, T., Zhang, S., Zhou, F., Zhang, K., Trajcevski, G., Wu, J.: Hybrid graph convolutional networks with multi-head attention for location recommendation. World Wide Web 23(6), 3125–3151 (2020)
Zhao, P., Luo, A., Liu, Y., Zhuang, F., Xu, J., Li, Z., Sheng, V. S., Zhou, X.: Where to go next: A spatio-temporal gated network for next poi recommendation. IEEE Transactions on Knowledge and Data Engineering (2020)
Cui, Q., Zhang, C., Zhang, Y., Wang, J., Cai, M.: St-pil: Spatial-temporal periodic interest learning for next point-of-interest recommendation. arXiv:2104.02262 (2021)
Liu, T., Liao, J., Wu, Z., Wang, Y., Wang, J.: Exploiting geographical-temporal awareness attention for next point-of-interest recommendation. Neurocomputing 400, 227–237 (2020)
Ye, M., Yin, P., Lee, W. -C., Lee, D. -L.: Exploiting geographical influence for collaborative point-of-interest recommendation. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 325–334 (2011)
Cai, L., Wen, W., Wu, B., Yang, X.: A coarse-to-fine user preferences prediction method for point-of-interest recommendation. Neurocomputing 422, 1–11 (2021)
Liu, W., Wang, Z. -J., Yao, B., Yin, J.: Geo-Alm: Poi recommendation by fusing geographical information and adversarial learning mechanism. In: IJCAI, vol. 7, pp. 1807–1813 (2019)
Zhang, J. -D., Chow, C. -Y., Li, Y.: Lore: Exploiting sequential influence for location recommendations. In: Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. SIGSPATIAL ’14, pp. 103–112. Association for Computing Machinery. https://doi.org/10.1145/2666310.2666400(2014)
Feng, S., Li, X., Zeng, Y., Cong, G., Chee, Y. M., Yuan, Q.: Personalized ranking metric embedding for next new poi recommendation. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)
Zhao, S., Zhao, T., Yang, H., Lyu, M. R., King, I.: Stellar: Spatial-temporal latent ranking for successive point-of-interest recommendation. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. AAAI’16, pp. 315–321 (2016)
Chang, B., Park, Y., Park, D., Kim, S., Kang, J.: Content-aware hierarchical point-of-interest embedding model for successive poi recommendation. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence. IJCAI’18, pp. 3301–3307. AAAI Press (2018)
Zhang, S., Xiong, H., Computer, S. O.: Geo-social-temporal sequential embedding rank for point-of-interest recommendation. Appl. Res. Comput. 36, 2618–2624 (2019)
Gan, M., Cui, H.: Exploring user movie interest space: a deep learning based dynamic recommendation model. Expert Syst. Appl. 173, 114695 (2021). https://doi.org/10.1016/j.eswa.2021.114695
Zhang, J., Mu, X., Zhao, P., Kang, K., Ma, C.: Improving current interest with item and review sequential patterns for sequential recommendation. Eng. Appl. Artif. Intel. 104, 104348 (2021). https://doi.org/10.1016/j.engappai.2021.104348
Sun, K., Qian, T., Chen, T., Liang, Y., Yin, H.: Where to go next: Modeling long- and short-term user preferences for point-of-interest recommendation. Proc. AAAI Conf. Artif. Intell. 34(1), 214–221 (2020)
Manotumruksa, J., Macdonald, C., Ounis, I.: A contextual recurrent collaborative filtering framework for modelling sequences of venue checkins. Inf. Process. Manag. 57(6), 102092 (2020)
Ma, Y., Gan, M.: Deepassociate: a deep learning model exploring sequential influence and history-candidate association for sequence recommendation. Expert Syst. Appl. 115587, 185 (2021). https://doi.org/10.1016/j.eswa.2021.115587
Liu, T., Liao, J., Wu, Z., Wang, Y., Wang, J.: A geographical-temporal awareness hierarchical attention network for next point-of-interest recommendation. In: Proceedings of the 2019 on International Conference on Multimedia Retrieval. ICMR ’19, pp. 7–15. Association for Computing Machinery (2019)
Zhao, K., Zhang, Y., Yin, H., Wang, J., Zheng, K., Zhou, X., Xing, C.: Discovering subsequence patterns for next poi recommendation. In: Bessiere, C (ed.) Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20, pp. 3216–3222. International Joint Conferences on Artificial Intelligence Organization, Ma (2020)
Ren, R., Liu, Z., Li, Y., Zhao, W. X., Wang, H., Ding, B., Wen, J. -R.: Sequential recommendation with self-attentive multi-adversarial network. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 89–98 (2020)
Li, Z., Cheng, W., Xiao, H., Yu, W., Chen, H., Wang, W.: You are what and where you are: Graph enhanced attention network for explainable poi recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 3945–3954 (2021)
Wang, W. X. X. Z. Y. D. D. S. X. G. D.: Attentive sequential model based on graph neural network for next poi recommendation. World Wide Web 24, 2161–2184 (2021). https://doi.org/10.1007/s11280-021-00961-9
Xu, Y., Li, X., Li, J., Wang, C., Gao, R., Yu, Y.: Ssser: Spatiotemporal sequential and social embedding rank for successive point-of-interest recommendation. IEEE Access 7, 156804–156823 (2019). https://doi.org/10.1109/ACCESS.2019.2950061
Liu, Y., Pei, A., Wang, F., Yang, Y., Zhang, X., Wang, H., Dai, H., Qi, L., Ma, R.: An attention-based category-aware gru model for the next poi recommendation. International Journal of Intelligent Systems (2021)
Zang, H., Han, D., Li, X., Wan, Z., Wang, M.: Cha: Categorical hierarchy-based attention for next poi recommendation. ACM Trans. Inf. Syst. (TOIS) 40(1), 1–22 (2021)
Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., Vandergheynst, P.: Geometric deep learning: going beyond euclidean data. IEEE Signal Process. Mag. 34(4), 18–42 (2017)
Kipf, T. N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv:1609.02907 (2016)
Marcheggiani, D., Bastings, J., Titov, I.: Exploiting semantics in neural machine translation with graph convolutional networks. arXiv:1804.08313(2018)
Yu, B., Yin, H., Zhu, Z.: Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. arXiv:1709.04875(2017)
Alex Fout, J.B.S.: Protein interface prediction using graph convolutional networks (2018)
Li, S., Pan, X.: A computational drug repositioning model based on hybrid similarity side information powered graph neural network. Futur. Gener. Comput. Syst. 125, 24–31 (2021)
Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W. L., Leskovec, J.: Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 974–983 (2018)
Wu, Q., Zhang, H., Gao, X., He, P., Weng, P., Gao, H., Chen, G.: Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systems. In: The World Wide Web Conference. WWW ’19, pp. 2091–2102. Association for Computing Machinery (2019)
Qian, T., Liang, Y., Li, Q.: Solving cold start problem in recommendation with attribute graph neural networks. arXiv:1912.12398 (2019)
Ji, Z., Wu, M., Yang, H., Íñigo, J.E.A.: Temporal sensitive heterogeneous graph neural network for news recommendation. Futur. Gener. Comput. Syst. 125, 324–333 (2021)
Dong, Y., Chawla, N. V., Swami, A.: Metapath2vec: Scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’17, pp. 135–144. Association for Computing Machinery (2017)
Zhou, C., Bai, J., Song, J., Liu, X., Zhao, Z., Chen, X., Gao, J.: Atrank: an attention-based user behavior modeling framework for recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
Maas, A.L., Hannun, A.Y., Ng, A.Y., et al: Rectifier nonlinearities improve neural network acoustic models. In: Proc. Icml, vol. 30, p. 3. Citeseer (2013)
Le, Q., Mikolov, T.: Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp. 1188–1196. PMLR (2014)
Si, Y., Zhang, F., Liu, W.: An adaptive point-of-interest recommendation method for location-based social networks based on user activity and spatial features. Knowl.-Based Syst. 163, 267–282 (2019)
Tang, J., Belletti, F., Jain, S., Chen, M., Beutel, A., Xu, C., Chi, H. E.: Towards neural mixture recommender for long range dependent user sequences. In: The World Wide Web Conference, Pp. 1782–1793 (2019)
Zhao, P., Zhu, H., Liu, Y., Li, Z., Xu, J., Sheng, V. S.: Where to go next: A spatio-temporal lstm model for next poi recommendation. arXiv:1806.06671 (2018)
Yuan, F., Karatzoglou, A., Arapakis, I., Jose, J. M., He, X.: A simple convolutional generative network for next item recommendation. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 582–590 (2019)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: Bpr: Bayesian personalized ranking from implicit feedback. arXiv:1205.2618 (2012)
Cheng, C., Yang, H., King, I., Lyu, M.: Fused matrix factorization with geographical and social influence in location-based social networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 26 (2012)
Liu, Q., Wu, S., Wang, L., Tan, T.: Predicting the next location: a recurrent model with spatial and temporal contexts. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 194–200 (2016)
Li, R., Shen, Y., Zhu, Y.: Next point-of-interest recommendation with temporal and multi-level context attention. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 1110–1115. https://doi.org/10.1109/ICDM.2018.00144 (2018)
Huang, L., Ma, Y., Wang, S., Liu, Y.: An attention-based spatiotemporal lstm network for next poi recommendation. IEEE Trans. Serv. Comput., 1–1. https://doi.org/10.1109/TSC.2019.2918310 (2019)
Acknowledgements
This research was supported in part by the National Natural Science Foundation of China, under Grants Nos. 71871019, 71471016.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Caiping Tan contributed equally to this work.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gan, M., Tan, C. Mining multiple sequential patterns through multi-graph representation for next point-of-interest recommendation. World Wide Web 26, 1345–1370 (2023). https://doi.org/10.1007/s11280-022-01094-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11280-022-01094-3