Negative Sampling in Next-POI Recommendations: Observation, Approach, and Evaluation
Pages 3888 - 3899
Abstract
To recommend the points of interest (POIs) that a user would check-in next, most deep-learning (DL)-based existing studies have employed random negative (RN) sampling during model training. In this paper, we claim and validate that, as the training proceeds, such an RN sampling in reality performs as sampling easy negative (EN) POIs (i.e., EN sampling) that a user was highly unlikely to check-in at her check-in time point. Furthermore, we verify that EN sampling is more disadvantageous in improving the accuracy than sampling hard negative (HN) POIs (i.e., HN sampling) that a user was highly likely to check-in. To address this limitation, we present the novel concept of the Degree of Positiveness (DoP), which can be formulated by two factors: (i) the degree to which a POI has the characteristics preferred by a user; (ii) the geographical distance between a user and a POI. Then, we propose a new model-training scheme based on HN sampling by using DoP. Using real-world datasets (i.e., NYC, TKY, and Brightkite), we demonstrate that all the state-of-the-art models trained by our scheme showed dramatic improvements in accuracy by up to about 82.8%.
Supplemental Material
MP4 File
Supplemental video
- Download
- 38.86 MB
References
[1]
Hong-Kyun Bae, Jeewon Ahn, Dongwon Lee, and Sang-Wook Kim. 2023. LANCER: A Lifetime-Aware News Recommender System. In AAAI Conference on Artificial Intelligence (AAAI). 4141--4148.
[2]
Hong-Kyun Bae, Yeon-Chang Lee, and Kyungsik Han Sang-Wook Kim. 2023. A Competition-Aware Approach to Accurate TV Show Recommendation. In IEEE International Conference on Data Engineering (ICDE). 2822--2834.
[3]
Gang Cao, Shengmin Cui, and Inwhee Joe. 2023. Improving the Spatial--temporal Aware Attention Network with Dynamic Trajectory Graph Learning for Next Point-Of-Interest Recommendation. Information Processing & Management 60, 3 (2023), 1--19.
[4]
Dong-Kyu Chae, Jihoo Kim, Sang-Wook Kim, and Duen Horng Chau. 2020. ARCF: Augmenting Virtual Users and Items in Collaborative Filtering for Addressing Cold-Start Problems. In ACM SIGIR Conference on Research and Development in Information Retrieval. 1251--1260.
[5]
Wei Chen, Huaiyu Wan, Shengnan Guo, Haoyu Huang, Shaojie Zheng, Jiamu Li, Shuohao Lin, and Youfang Lin. 2022. Building and Exploiting Spatial--temporal Knowledge Graph for Next POI Recommendation. Knowledge-Based Systems 258 (2022), 1--12.
[6]
Eunjoon Cho, Seth A Myers, and Jure Leskovec. 2011. Friendship and Mobility: User Movement in Location-based Social networks. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1082--1090.
[7]
Kyung-Jae Cho, Yeon-Chang Lee, Kyungsik Han, Jaeho Choi, and Sang-Wook Kim. 2019. No, That's Not My Feedback: TV Show Recommendation Using Watchable Interval. In IEEE International Conference on Data Engineering (ICDE). 316--327.
[8]
Wenqi Fan, Yao Ma, Qing Li, Yuan He, Eric Zhao, Jiliang Tang, and Dawei Yin. 2019. Graph Neural Networks for Social Recommendation. In International Conference on World Wide Web (WWW). 417--426.
[9]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, YongDong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 639--648.
[10]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-term Memory. Neural Computation 9, 8 (1997), 1735--1780.
[11]
Zheng Huang, Jing Ma, Yushun Dong, Natasha Zhang Foutz, and Jundong Li. 2022. Empowering Next POI Recommendation with Multi-relational Modeling. In ACM SIGIR Conference on Research and Development in Information Retrieval. 2034--2038.
[12]
Won-Seok Hwang, Juan Parc, Sang-Wook Kim, Jongwuk Lee, and Dongwon Lee. 2016. 'Told you I didn't like it": Exploiting Uninteresting Items for Effective Collaborative Filtering. In IEEE International Conference on Data Engineering (ICDE). 349--360.
[13]
Md Ashraful Islam, Mir Mahathir Mohammad, Sarkar Snigdha Sarathi Das, and Mohammed Eunus Ali. 2022. A Survey on Deep Learning based Point-of-Interest (POI) Recommendations. Neurocomputing 472 (2022), 306--325.
[14]
Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive Sequential Recommendation. In IEEE International Conference on Data Mining (ICDM). 197--206.
[15]
Taeri Kim, Yeon-Chang Lee, Kijung Shin, and Sang-Wook Kim. 2022. MARIO: Modality-Aware Attention and Modality-Preserving Decoders for Multimedia Recommendation. In ACM International Conference on Information and Knowledge Management (CIKM). 993--1002.
[16]
Taeho Kim, Juwon Yu, Won-Yong Shin, Hyunyoung Lee, Ji hui Im, and Sang- Wook Kim. 2023. LATTE: A Framework for Learning Item-features to Make a Domain-Expert for Effective Conversational Recommendation. In ACM SIGKDD International Conference on Knowledge Discovery & Data mining. 1144--1153.
[17]
Yunyong Ko, Jae-Seo Yu, Hong-Kyun Bae, Yongjun Park, Dongwon Lee, and Sang-Wook Kim. 2021. MASCOT: A Quantization Framework for Efficient Matrix Factorization in Recommender Systems. In IEEE International Conference on Data Mining (ICDM). 290--299.
[18]
Jongwuk Lee, Won-Seok Hwang, Juan Parc, Youngnam Lee, Sang-Wook Kim, and Dongwon Lee. 2019. l-Injection: Toward Effective Collaborative Filtering Using Uninteresting Items. IEEE Transactions on Knowledge and Data Engineering 31, 1 (2019), 3--16.
[19]
Yeon-Chang Lee, Sang-Wook Kim, and Dongwon Lee. 2018. gOCCF: Graphtheoretic One-class Collaborative Filtering based on Uninteresting Items. In AAAI Conference on Artificial Intelligence (AAAI). 3448--3456.
[20]
Youngnam Lee, Sang-Wook Kim, Sunju Park, and Xing Xie. 2018. How to Impute Missing Ratings?: Claims, Solution, and its Application to Collaborative Filtering. In International Conference on World Wide Web (WWW). 783--792.
[21]
Hao Li, Kenli Li, Jiyao An, and Keqin Li. 2018. MSGD: A Novel Matrix Factorization Approach for Large-Scale Collaborative Filtering Recommender Systems on GPUs. IEEE Transactions On Parallel and Distributed Systems 29, 7 (2018), 1530--1544.
[22]
Ranzhen Li, Yanyan Shen, and Yanmin Zhu. 2018. Next point-of-interest recommendation with temporal and multi-level context attention. In 2018 IEEE International Conference on Data Mining (ICDM). IEEE, 1110--1115.
[23]
Defu Lian, Yongji Wu, Yong Ge, Xing Xie, and Enhong Chen. 2020. Geography- Aware Sequential Location Recommendation. In ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2009--2019.
[24]
Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2016. Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts. In Proceedings of the AAAI Conference on Artificial Intelligence.
[25]
Yingtao Luo, Qiang Liu, and Zhaocheng Liu. 2021. STAN: Spatio-temporal Attention Network for Next Location Recommendation. In International Conference on World Wide Web (WWW). 2177--2185.
[26]
Steffen Rendle and Christoph Freudenthaler. 2014. Improving Pairwise Learning for Item Recommendation from Implicit Feedback. In ACM International Conference on Web Search and Data Mining (WSDM). 273--282.
[27]
David E Rumelhart, Geoffrey E Hinton, and Ronald J Williams. 1986. Learning Representations by Back-propagating Errors. Nature 323, 6088 (1986), 533--536.
[28]
Wentao Shi, Jiawei Chen, Fuli Feng, Jizhi Zhang, Junkang Wu, Chongming Gao, and Xiangnan He. 2023. On the Theories Behind Hard Negative Sampling for Recommendation. In International Conference on World Wide Web (WWW). 812-- 822.
[29]
Wei Tan, Liangliang Cao, and Liana Fong. 2016. Faster and Cheaper: Parallelizing Large-Scale Matrix Factorization on GPUs. In ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC). 219--230.
[30]
Glen Van Brummelen and Elizabeth A Hamm. 2014. Heavenly Mathematics: The Forgotten Art of Spherical Trigonometry. Aestimatio: Sources and Studies in the History of Science 11 (2014), 127--130.
[31]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All You Need. Advances in Neural Information Processing Systems (NeurIPS) 30 (2017).
[32]
Zhaobo Wang, Yanmin Zhu, Haobing Liu, and Chunyang Wang. 2022. Learning Graph-based Disentangled Representations for Next POI Recommendation. In ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 1154--1163.
[33]
Heitor Werneck, Nícollas Silva, Matheus Carvalho Viana, Fernando Mourão, Adriano CM Pereira, and Leonardo Rocha. 2020. A Survey on Point-of-Interest Recommendation in Location-based Social Networks. In Brazilian Symposium on Multimedia and the Web (WebMedia). 185--192.
[34]
YuxiaWu, Ke Li, Guoshuai Zhao, and Xueming Qian. 2020. Personalized Long-and Short-term Preference Learning for Next POI Recommendation. IEEE Transactions on Knowledge and Data Engineering 34, 4 (2020), 1944--1957.
[35]
Lanling Xu, Jianxun Lian, Wayne Xin Zhao, Ming Gong, Linjun Shou, Daxin Jiang, Xing Xie, and Ji-Rong Wen. 2022. Negative Sampling for Contrastive Representation Learning: A Review. arXiv preprint arXiv:2206.00212 (2022).
[36]
Dingqi Yang, Daqing Zhang, Vincent.W. Zheng, and Zhiyong Yu. 2015. Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs. IEEE Transactions on Systems, Man, and Cybernetics: Systems 45, 1 (2015), 129--142.
[37]
Zhen Yang, Ming Ding, Xu Zou, Jie Tang, Bin Xu, Chang Zhou, and Hongxia Yang. 2023. Region or Global? A Principle for Negative Sampling in Graph-Based Recommendation. IEEE Transactions on Knowledge and Data Engineering (IEEE TKDE) 35, 6 (2023), 6264--6277.
[38]
Fuqiang Yu, Lizhen Cui, Wei Guo, Xudong Lu, Qingzhong Li, and Hua Lu. 2020. A Category-aware Deep Model for Successive POI Recommendation on Sparse Check-in Data. In International Conference on World Wide Web (WWW). 1264-- 1274.
[39]
Weinan Zhang, Tianqi Chen, Jun Wang, and Yong Yu. 2013. Optimizing Top- N Collaborative Filtering via Dynamic Negative Item Sampling. In ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 785--788.
[40]
Qiannan Zhu, Haobo Zhang, Qing He, and Zhicheng Dou. 2022. A Gain-Tuning Dynamic Negative Sampler for Recommendation. In International Conference on World Wide Web (WWW). 277--285.
Index Terms
- Negative Sampling in Next-POI Recommendations: Observation, Approach, and Evaluation
Recommendations
User Multi-behavior Enhanced POI Recommendation with Efficient and Informative Negative Sampling
Web and Big DataAbstractPoint-of-Interest (POI) recommendation plays a crucial role in the location-based social networks (LBSNs), while the extreme sparsity of user check-in data severely impedes the further improvement of POI recommendation. Existing works jointly ...
Topic-based User Profile Model for POI Recommendations
ISMSI '18: Proceedings of the 2nd International Conference on Intelligent Systems, Metaheuristics & Swarm IntelligenceLocation-based services (LBSs) provide users with points of interest (POIs) based on a limited distance from the user current location. Recently, the increased number of POIs in LBSs often results in overwhelming place suggestions generated to users ...
Event representation via contrastive learning with prototype based hard negative sampling
AbstractEvent representing methods usually use external knowledge to construct potentially more useful positive or negative samples, while neglecting the importance of sampling them during the training process. In this paper, we propose a prototype based ...
Comments
Information & Contributors
Information
Published In
May 2024
4826 pages
ISBN:9798400701719
DOI:10.1145/3589334
- General Chairs:
- Tat-Seng Chua,
- Chong-Wah Ngo,
- Proceedings Chair:
- Roy Ka-Wei Lee,
- Program Chairs:
- Ravi Kumar,
- Hady W. Lauw
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 May 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Institute of Information & Communications Technology Planning & Evaluation
- Institute of Information & Communications Technology Planning & Evaluation
- Institute of Information & Communications Technology Planning & Evaluation
Conference
WWW '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,899 of 8,196 submissions, 23%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 524Total Downloads
- Downloads (Last 12 months)524
- Downloads (Last 6 weeks)56
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in