skip to main content
research-article

A Multi-Task Graph Neural Network with Variational Graph Auto-Encoders for Session-Based Travel Packages Recommendation

Published: 24 May 2023 Publication History

Abstract

Session-based travel packages recommendation aims to predict users’ next click based on their current and historical sessions recorded by Online Travel Agencies (OTAs). Recently, an increasing number of studies attempted to apply Graph Neural Networks (GNNs) to the session-based recommendation and obtained promising results. However, most of them do not take full advantage of the explicit latent structure from attributes of items, making learned representations of items less effective and difficult to interpret. Moreover, they only combine historical sessions (long-term preferences) with a current session (short-term preference) to learn a unified representation of users, ignoring the effects of historical sessions for the current session. To this end, this article proposes a novel session-based model named STR-VGAE, which fills subtasks of the travel packages recommendation and variational graph auto-encoders simultaneously. STR-VGAE mainly consists of three components: travel packages encoder, users behaviors encoder, and interaction modeling. Specifically, the travel packages encoder module is used to learn a unified travel package representation from co-occurrence attribute graphs by using multi-view variational graph auto-encoders and a multi-view attention network. The users behaviors encoder module is used to encode user’ historical and current sessions with a personalized GNN, which considers the effects of historical sessions on the current session, and coalesce these two kinds of session representations to learn the high-quality users’ representations by exploiting a gated fusion approach. The interaction modeling module is used to calculate recommendation scores over all candidate travel packages. Extensive experiments on a real-life tourism e-commerce dataset from China show that STR-VGAE yields significant performance advantages over several competitive methods, meanwhile provides an interpretation for the generated recommendation list.

References

[1]
Basmah Altaf, Uchenna Akujuobi, Lu Yu, and Xiangliang Zhang. 2019. Dataset recommendation via variational graph autoencoder. In Proceedings of the 2019 IEEE International Conference on Data Mining. IEEE, 11–20.
[2]
Rianne van den Berg, Thomas N. Kipf, and Max Welling. 2018. Graph convolutional matrix completion. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 145–155. Retrieved from https://arxiv.org/abs/1706.02263.
[3]
David M. Blei, Alp Kucukelbir, and Jon D. McAuliffe. 2017. Variational inference: A review for statisticians. Journal of the American Statistical Association 112, 518 (2017), 859–877.
[4]
John S. Breese, David Heckerman, and Carl Kadie. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence. ACM, 43–52.
[5]
Jie Cao, Da Ding, Jinliang Liu, Engang Tian, Songlin Hu, and Xiangpeng Xie. 2021. Hybrid-triggered-based security controller design for networked control system under multiple cyber attacks. Information Sciences 548 (2021), 69–84.
[6]
Jie Cao, Yuyao Wang, Zhan Bu, Youquan Wang, Haicheng Tao, and Guixiang Zhu. 2021. Compactness preserving community computation via a network generative process. IEEE Transactions on Emerging Topics in Computational Intelligence 6, 5 (2021), 1044–1056. DOI:
[7]
Jie Cao, Youquan Wang, Jing He, Weichao Liang, Haicheng Tao, and Guixiang Zhu. 2020. Predicting grain losses and waste rate along the entire chain: A multitask multigated recurrent unit autoencoder based method. IEEE Transactions on Industrial Informatics 17, 6 (2020), 4390–4400.
[8]
Lei Chen, Jie Cao, Youquan Wang, Weichao Liang, and Guixiang Zhu. 2022. Multi-view graph attention network for travel recommendation. Expert Systems with Applications 191 (2022), 116234.
[9]
Lei Chen, Jie Cao, Guixiang Zhu, Youquan Wang, and Weichao Liang. 2021. A multi-task learning approach for improving travel recommendation with keywords generation. Knowledge-Based Systems 233, C (2021), 107521.
[10]
Lei Chen, Zhiang Wu, Jie Cao, Guixiang Zhu, and Yong Ge. 2020. Travel recommendation via fusing multi-auxiliary information into matrix factorization. ACM Transactions on Intelligent Systems and Technology 11, 2 (2020), 22.
[11]
Yujuan Ding, Yunshan Ma, Wai Keung Wong, and Tat-Seng Chua. 2021. Leveraging two types of global graph for sequential fashion recommendation. Proceedings of the ACM International Conference on Multimedia Retrieval, 73–81. Retrieved from https://arxiv.org/abs/2105.07585.
[12]
Chen Gao, Yu Zheng, Nian Li, Yinfeng Li, Yingrong Qin, Jinghua Piao, Yuhan Quan, Jianxin Chang, Depeng Jin, Xiangnan He, and Yong Li. 2021. Graph neural networks for recommender systems: Challenges, methods, and directions. arXiv preprint arXiv:2109.12843. Retrieved from https://arxiv.org/abs/2109.12843.
[13]
Huiji Gao, Jiliang Tang, Xia Hu, and Huan Liu. 2015. Content-aware point of interest recommendation on location-based social networks. In Proceedings of the 29th AAAI Conference on Artificial Intelligence. 1721–1727.
[14]
Yong Ge, Hui Xiong, Alexander Tuzhilin, and Qi Liu. 2014. Cost-aware collaborative filtering for travel tour recommendations. ACM Transactions on Information Systems 32, 1 (2014), 4.
[15]
Aditya Grover, Aaron Zweig, and Stefano Ermon. 2019. Graphite: Iterative generative modeling of graphs. In Proceedings of the 36th International Conference on Machine Learning. 2434–2444.
[16]
Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. DeepFM: A factorization-machine based neural network for CTR prediction. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 1725–1731.
[17]
Arman Hasanzadeh, Ehsan Hajiramezanali, Nick Duffield, Krishna R. Narayanan, Mingyuan Zhou, and Xiaoning Qian. 2019. Semi-implicit graph variational auto-encoders. Proceedings of the 33rd Annual Conference on Neural Information Processing Systems, 10711–10722. Retrieved from https://arxiv.org/abs/1908.07078.
[18]
Arman Hasanzadeh, Ehsan Hajiramezanali, Krishna Narayanan, Nick Duffield, Mingyuan Zhou, and Xiaoning Qian. 2019. Variational graph recurrent neural networks. InProceedings of the 33rd International Conference on Neural Information Processing Systems.
[19]
Jiangning He, Hongyan Liu, and Hui Xiong. 2016. SocoTraveler: Travel-package recommendations leveraging social influence of different relationship types. Information & Management 53, 8 (2016), 934–950.
[20]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173–182.
[21]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2016. Session-based recommendations with recurrent neural networks. In Proceedings of the 4th International Conference on Learning Representations.
[22]
Mingming Hu, Richard T. R. Qiu, Doris Chenguang Wu, and Haiyan Song. 2021. Hierarchical pattern recognition for tourism demand forecasting. Tourism Management 84 (2021), 104263.
[23]
Zhibin Hu, Jiachun Wang, Yan Yan, Peilin Zhao, Jian Chen, and Jin Huang. 2021. Neural graph personalized ranking for top-n recommendation. Knowledge-Based Systems 213, C (2021), 106426.
[24]
C. Derrick Huang, Jahyun Goo, Kichan Nam, and Chul Woo Yoo. 2017. Smart tourism technologies in travel planning: The role of exploration and exploitation. Information & Management 54, 6 (2017), 757–770.
[25]
Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. Proceedings of the 5th International Conference on Learning Representations. Retrieved from https://arxiv.org/abs/1609.02907.
[26]
Thomas N. Kipf and Max Welling. 2016. Variational graph auto-encoders. Proceedings of the 30rd Annual Conference on Neural Information Processing Systems Workshop on Bayesian Deep Learning. Retrieved from https://arxiv.org/abs/1611.07308.
[27]
Yehuda Koren. 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 426–434.
[28]
Dichao Li and Zhiguo Gong. 2020. A deep neural network for crossing-city POI recommendations. IEEE Transactions on Knowledge and Data Engineering 34, 8 (2020), 3536–3548. DOI:
[29]
Yujia Li, Daniel Tarlow, Marc Brockschmidt, and Richard Zemel. 2015. Gated graph sequence neural networks. In Proceedings of the 2015 International Conference on Learning Representations.
[30]
Greg Linden, Brent Smith, and Jeremy York. 2003. Amazon.com recommendations: Item-to-item collaborative filtering. IEEE Internet Computing 7, 1 (2003), 76–80.
[31]
Bang Liu, Hanlin Zhang, Linglong Kong, and Di Niu. 2021. Factorizing historical user actions for next-day purchase prediction. ACM Transactions on the Web 16, 1 (2021), 1–26.
[32]
Ninghao Liu, Yong Ge, Li mei Li, Xia Hu, Rui Chen, and Soo-Hyun Choi. 2020. Explainable recommender systems via resolving learning representations. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 895–904.
[33]
Qi Liu, Enhong Chen, Hui Xiong, Yong Ge, Zhongmou Li, and Xiang Wu. 2014. A cocktail approach for travel package recommendation. IEEE Transactions on Knowledge and Data Engineering 26, 2 (2014), 278–293.
[34]
Qiao Liu, Yifu Zeng, Refuoe Mokhosi, and Haibin Zhang. 2018. STAMP: Short-term attention/memory priority model for session-based recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1831–1839.
[35]
Sanmin Liu, Shan Xue, Jia Wu, Chuan Zhou, Jian Yang, Zhao Li, and Jie Cao. 2021. Online active learning for drifting data streams. IEEE Transactions on Neural Networks and Learning Systems 34, 1 (2021), 186–200. DOI:
[36]
Xuexiong Luo, Jia Wu, Amin Beheshti, Jian Yang, Xiankun Zhang, Yuan Wang, and Shan Xue. 2022. ComGA: Community-aware attributed graph anomaly detection. In Proceedings of the 5th ACM International Conference on Web Search and Data Mining. 657–665.
[37]
Chen Ma, Yingxue Zhang, Qinglong Wang, and Xue Liu. 2018. Point-of-interest recommendation: Exploiting self-attentive autoencoders with neighbor-aware influence. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 697–706.
[38]
Xiaoxiao Ma, Shan Xue, Jia Wu, Jian Yang, Cecile Paris, Surya Nepal, and Quan Z. Sheng. 2022. Deep multi-attributed-view graph representation learning. IEEE Transactions on Network Science and Engineering 9, 5 (2022), 3762–3774.
[39]
Shirui Pan, Ruiqi Hu, Guodong Long, Jing Jiang, and Chengqi Zhang. 2018. Adversarially regularized graph autoencoder for graph embedding. In Proceedings of the 27th International Joint Conference on Artificial Intelligence.
[40]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 701–710.
[41]
Ruihong Qiu, Jingjing Li, Zi Huang, and Hongzhi Yin. 2019. Rethinking the item order in session-based recommendation with graph neural networks. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 579–588.
[42]
Paul Resnick, Neophytos Iacovou, Mitesh Suchak, Peter Bergstrom, and John Riedl. 1994. GroupLens: An open architecture for collaborative filtering of netnews. In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work. ACM, 175–186.
[43]
Yu Rong, Wenbing Huang, Tingyang Xu, and Junzhou Huang. 2020. Dropedge: Towards deep graph convolutional networks on node classification. In Proceedings of the 8th International Conference on Learning Representations.
[44]
Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic matrix factorization. In Proceedings of the 20th International Conference on Neural Information Processing Systems. 1257–1264.
[45]
Guillaume Salha, Romain Hennequin, and Michalis Vazirgiannis. 2020. Simple and effective graph autoencoders with one-hop linear models. The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases. Retrieved from https://arxiv.org/abs/2001.07614.
[46]
Yang Song, Lu Zhang, and C. Lee Giles. 2011. Automatic tag recommendation algorithms for social recommender systems. ACM Transactions on the Web 5, 1 (2011), 1–31.
[47]
Chang Tan, Qi Liu, Enhong Chen, Hui Xiong, and Xiang Wu. 2014. Object-oriented travel package recommendation. ACM Transactions on Intelligent Systems and Technology 5, 3 (2014), 43.
[48]
Fatemeh Vahedian, Robin Burke, and Bamshad Mobasher. 2017. Multirelational recommendation in heterogeneous networks. ACM Transactions on the Web 11, 3 (2017), 1–34.
[49]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 6000–6010.
[50]
Dongjing Wang, Xingliang Wang, Zhengzhe Xiang, Dongjin Yu, Shuiguang Deng, and Guandong Xu. 2021. Attentive sequential model based on graph neural network for next poi recommendation. World Wide Web 24, 6 (2021), 1–24.
[51]
Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1235–1244.
[52]
Li Wang, Binbin Jin, Zhenya Huang, Hongke Zhao, Defu Lian, Qi Liu, and Enhong Chen. 2021. Preference-adaptive meta-learning for cold-start recommendation. In Proceedings of the 30th International Joint Conference on Artificial Intelligence. 1607–1614.
[53]
Wen Wang, Wei Zhang, Shukai Liu, Qi Liu, Bo Zhang, Leyu Lin, and Hongyuan Zha. 2021. Incorporating link prediction into multi-relational item graph modeling for session-based recommendation. IEEE Transactions on Knowledge and Data Engineering 35, 3 (2021), 2683–2696.
[54]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 165–174.
[55]
Chuhan Wu, Fangzhao Wu, Mingxiao An, Jianqiang Huang, Yongfeng Huang, and Xing Xie. 2019. NPA: Neural news recommendation with personalized attention. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2576–2584.
[56]
Shu Wu, Yuyuan Tang, Yanqiao Zhu, Liang Wang, Xing Xie, and Tieniu Tan. 2019. Session-based recommendation with graph neural networks. In Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 33, 346–353.
[57]
Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S. Yu Philip. 2020. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems 32, 1 (2020), 4–24.
[58]
Qianqian Xie, Jimin Huang, Pan Du, Min Peng, and Jian-Yun Nie. 2021. Inductive topic variational graph auto-encoder for text classification. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4218–4227.
[59]
Chengfeng Xu, Pengpeng Zhao, Yanchi Liu, Victor S. Sheng, Jiajie Xu, Fuzhen Zhuang, Junhua Fang, and Xiaofang Zhou. 2019. Graph contextualized self-attention network for session-based recommendation. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. Vol. 19, 3940–3946.
[60]
Carl Yang, Lanxiao Bai, Chao Zhang, Quan Yuan, and Jiawei Han. 2017. Bridging collaborative filtering and semi-supervised learning: A neural approach for poi recommendation. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1245–1254.
[61]
Jing Yi and Zhenzhong Chen. 2021. Multi-modal variational graph auto-encoder for recommendation systems. IEEE Transactions on Multimedia 24 (2021), 1067–1079.
[62]
Hongzhi Yin, Yizhou Sun, Bin Cui, Zhiting Hu, and Ling Chen. 2013. Lcars: A location-content-aware recommender system. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 221–229.
[63]
Hongzhi Yin, Weiqing Wang, Hao Wang, Ling Chen, and Xiaofang Zhou. 2017. Spatial-aware hierarchical collaborative deep learning for POI recommendation. IEEE Transactions on Knowledge and Data Engineering 29, 11 (2017), 2537–2551.
[64]
Mingzhang Yin and Mingyuan Zhou. 2018. Semi-implicit variational inference. In Proceedings of the 35th International Conference on Machine Learning. Vol. 80, 5660–5669.
[65]
Quan Yuan, Gao Cong, Zongyang Ma, Aixin Sun, and Nadia Magnenat Thalmann. 2013. Time-aware point-of-interest recommendation. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 363–372.
[66]
Quan Yuan, Gao Cong, and Aixin Sun. 2014. Graph-based point-of-interest recommendation with geographical and temporal influences. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. 659–668.
[67]
Mengqi Zhang, Shu Wu, Meng Gao, Xin Jiang, Ke Xu, and Liang Wang. 2020. Personalized graph neural networks with attention mechanism for session-aware recommendation. IEEE Transactions on Knowledge and Data Engineering 34, 8 (2020), 3946–3957.
[68]
Hongke Zhao, Qi Liu, Guifeng Wang, Yong Ge, and Enhong Chen. 2016. Portfolio selections in P2P lending: A multi-objective perspective. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2075–2084.
[69]
Hongke Zhao, Xinpeng Wu, Chuang Zhao, Lei Zhang, Haiping Ma, and Fan Cheng. 2021. CoEA: A cooperative–competitive evolutionary algorithm for bidirectional recommendations. IEEE Transactions on Evolutionary Computation 26, 1 (2021), 28–42.
[70]
Guixiang Zhu, Jie Cao, Changsheng Li, and Zhiang Wu. 2017. A recommendation engine for travel products based on topic sequential patterns. Multimedia Tools and Applications 76, 16 (2017), 17595–17612.
[71]
Guixiang Zhu, Youquan Wang, Jie Cao, Zhan Bu, Shuxin Yang, Weichao Liang, and Jingting Liu. 2021. Neural attentive travel package recommendation via exploiting long-term and short-term behaviors. Knowledge-Based Systems 211 (2021), 106511.
[72]
Guixiang Zhu, Zhiang Wu, Youquan Wang, Shanshan Cao, and Jie Cao. 2019. Online purchase decisions for tourism e-commerce. Electronic Commerce Research and Applications 38, C (2019), 100887.

Cited By

View all

Index Terms

  1. A Multi-Task Graph Neural Network with Variational Graph Auto-Encoders for Session-Based Travel Packages Recommendation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on the Web
    ACM Transactions on the Web  Volume 17, Issue 3
    August 2023
    302 pages
    ISSN:1559-1131
    EISSN:1559-114X
    DOI:10.1145/3597636
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 May 2023
    Online AM: 01 February 2023
    Accepted: 20 October 2022
    Revised: 27 July 2022
    Received: 17 January 2022
    Published in TWEB Volume 17, Issue 3

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Travel recommendation
    2. graph mining
    3. session-based recommendation
    4. auto-encoder
    5. multi-task learning

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China (NSFC)
    • International Innovation Cooperation Project of Jiangsu Province of China
    • Future Network Scientific Research Fund Project of Jiangsu Province of China
    • Major Projects of Natural Science Research in Universities of Jiangsu Province of China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)355
    • Downloads (Last 6 weeks)65
    Reflects downloads up to 03 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)A multi-view GNN-based network representation learning framework for recommendation systemsNeurocomputing10.1016/j.neucom.2024.129001619(129001)Online publication date: Feb-2025
    • (2025)ConvSeq-MFNeurocomputing10.1016/j.neucom.2024.128932618:COnline publication date: 14-Feb-2025
    • (2025)A generative and discriminative model for diversity-promoting recommendationInformation Systems10.1016/j.is.2024.102488128(102488)Online publication date: Feb-2025
    • (2025)Knowledge graph-driven personalized attractions recommendations with tourists’ long- and short-term interest modelingExpert Systems with Applications10.1016/j.eswa.2025.127094275(127094)Online publication date: May-2025
    • (2024)General Optimization Methods for YOLO Series Object Detection in Remote Sensing ImagesIEEE Signal Processing Letters10.1109/LSP.2024.346978731(2860-2864)Online publication date: 2024
    • (2024)A Method to Enhance Web Service Clustering by Integrating Label-Enhanced Functional Semantics and Service CollaborationIEEE Access10.1109/ACCESS.2024.339260712(61301-61311)Online publication date: 2024
    • (2024)The research landscape on generative artificial intelligence: a bibliometric analysis of transformer-based modelsKybernetes10.1108/K-03-2024-0554Online publication date: 19-Jul-2024
    • (2024)Keywords-enhanced Contrastive Learning Model for travel recommendationInformation Processing & Management10.1016/j.ipm.2024.10387461:6(103874)Online publication date: Nov-2024
    • (2024)Legal Judgment Prediction via graph boosting with constraintsInformation Processing & Management10.1016/j.ipm.2024.10366361:3(103663)Online publication date: May-2024
    • (2024)A hybrid filtering for micro-video hashtag recommendation using graph-based deep neural networkEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.109417138(109417)Online publication date: Dec-2024
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media