skip to main content
research-article

Embedding Hierarchical Structures for Venue Category Representation

Authors Info & Claims
Published:22 November 2021Publication History
Skip Abstract Section

Abstract

Venue categories used in location-based social networks often exhibit a hierarchical structure, together with the category sequences derived from users’ check-ins. The two data modalities provide a wealth of information for us to capture the semantic relationships between those categories. To understand the venue semantics, existing methods usually embed venue categories into low-dimensional spaces by modeling the linear context (i.e., the positional neighbors of the given category) in check-in sequences. However, the hierarchical structure of venue categories, which inherently encodes the relationships between categories, is largely untapped. In this article, we propose a venue Category Embedding Model named Hier-CEM, which generates a latent representation for each venue category by embedding the Hierarchical structure of categories and utilizing multiple types of context. Specifically, we investigate two kinds of hierarchical context based on any given venue category hierarchy and show how to model them together with the linear context collaboratively. We apply Hier-CEM to three tasks on two real check-in datasets collected from Foursquare. Experimental results show that Hier-CEM is better at capturing both semantic and sequential information inherent in venues than state-of-the-art embedding methods.

REFERENCES

  1. [1] Aliannejadi Mohammad and Crestani Fabio. 2018. Personalized context-aware point of interest recommendation. ACM Trans. Inf. Syst. 36, 4 (2018), 128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. [2] Aliannejadi Mohammad, Rafailidis Dimitrios, and Crestani Fabio. 2018. A collaborative ranking model with multiple location-based similarities for venue suggestion. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval. 1926. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. [3] Alsuhaibani Mohammed, Maehara Takanori, and Bollegala Danushka. 2018. Joint learning of hierarchical word embeddings from a corpus and a taxonomy. In Automated Knowledge Base Construction. http://www.akbc.ws/2019/.Google ScholarGoogle Scholar
  4. [4] Chang Buru, Park Yonggyu, Park Donghyeon, Kim Seongsoon, and Kang Jaewoo. 2018. Content-aware hierarchical point-of-interest embedding model for successive POI recommendation. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 33013307. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. [5] Chen Meng, Yu Xiaohui, and Liu Yang. 2019. MPE: A mobility pattern embedding model for predicting next locations. World Wide Web 22, 6 (2019), 29012920.Google ScholarGoogle ScholarCross RefCross Ref
  6. [6] Chen Meng, Zhao Yan, Liu Yang, Yu Xiaohui, and Zheng Kai. 2020. Modeling spatial trajectories with attribute representation learning. IEEE Trans. Knowl. Data Eng. (2020).Google ScholarGoogle ScholarCross RefCross Ref
  7. [7] Clark Stephen. 2015. Vector space models of lexical meaning. The Handbook of Contemporary Semantic Theory. Wiley-Blackwell.Google ScholarGoogle ScholarCross RefCross Ref
  8. [8] Feng Shanshan, Cong Gao, An Bo, and Chee Yeow Meng. 2017. POI2Vec: Geographical latent representation for predicting future visitors. In Proceedings of the 31st AAAI Conference on Artificial Intelligence. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] He Jing, Li Xin, and Liao Lejian. 2017. Category-aware next point-of-interest recommendation via listwise Bayesian personalized ranking. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 18371843. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. [10] He Jiayuan, Qi Jianzhong, and Ramamohanarao Kotagiri. 2019. A joint context-aware embedding for trip recommendations. In Proceedings of the 35th International Conference on Data Engineering. IEEE, 292303.Google ScholarGoogle ScholarCross RefCross Ref
  11. [11] Hu Zhiting, Huang Poyao, Deng Yuntian, Gao Yingkai, and Xing Eric. 2015. Entity hierarchy embedding. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics. 12921300.Google ScholarGoogle ScholarCross RefCross Ref
  12. [12] Hull David. 1993. Using statistical testing in the evaluation of retrieval experiments. In Proceedings of the SIGIR Conference on Research and Development in Information Retrieval. 329338. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Janowicz Krzysztof, Raubal Martin, and Kuhn Werner. 2011. The semantics of similarity in geographic information retrieval. J. Spatial Inf. Sci. 2011, 2 (2011), 2957.Google ScholarGoogle Scholar
  14. [14] Kong Dejiang and Wu Fei. 2018. HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 23412347. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Le Quoc and Mikolov Tomas. 2014. Distributed representations of sentences and documents. In Proceedings of the 31st International Conference on Machine Learning. 11881196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Levy Omer and Goldberg Yoav. 2014. Dependency-based word embeddings. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. 302308.Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Levy Omer and Goldberg Yoav. 2014. Neural word embedding as implicit matrix factorization. In Proceedings of the 28th Annual Conference on Neural Information Processing Systems. 21772185. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. [18] Li Bofang, Liu Tao, Zhao Zhe, Tang Buzhou, Drozd Aleksandr, Rogers Anna, and Du Xiaoyong. 2017. Investigating different syntactic context types and context representations for learning word embeddings. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 24212431.Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] Li Yurui, Chen Hongmei, Wang Lizhen, and Xiao Qing. 2019. POI representation learning by a hybrid model. In Proceedings of the 20th IEEE International Conference on Mobile Data Management. IEEE, 485490.Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] Liu Liping, Ruiz Francisco, Athey Susan, and Blei David. 2017. Context selection for embedding models. In Proceedings of the 31st Annual Conference on Neural Information Processing Systems. 48164825. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. [21] Liu Qian, Huang Heyan, Zhang Guangquan, Gao Yang, Xuan Junyu, and Lu Jie. 2018. Semantic structure-based word embedding by incorporating concept convergence and word divergence. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. [22] Liu Xin, Liu Yong, Aberer Karl, and Miao Chunyan. 2013. Personalized point-of-interest recommendation by mining users’ preference transition. In Proceedings of the 22nd ACM International Conference on Information & Knowledge Management. 733738. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. [23] Liu Xin, Liu Yong, and Li Xiaoli. 2016. Exploring the context of locations for personalized location recommendations. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 11881194. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. [24] Maaten Laurens van der and Hinton Geoffrey. 2008. Visualizing data using t-SNE. J. Mach. Learn. Res. 9, Nov. (2008), 25792605.Google ScholarGoogle Scholar
  25. [25] Manotumruksa Jarana, Macdonald Craig, and Ounis Iadh. 2018. A contextual attention recurrent architecture for context-aware venue recommendation. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 555564. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Mikolov Tomas, Sutskever Ilya, Chen Kai, Corrado Greg S., and Dean Jeff. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the 27th Annual Conference on Neural Information Processing Systems. 31113119. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. [27] Mithun Niluthpol Chowdhury, Panda Rameswar, Papalexakis Evangelos E., and Roy-Chowdhury Amit K.. 2018. Webly supervised joint embedding for cross-modal image-text retrieval. In Proceedings of the 26th ACM International Conference on Multimedia. 18561864. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. [28] Potapenko Anna, Popov Artem, and Vorontsov Konstantin. 2017. Interpretable probabilistic embeddings: Bridging the gap between topic models and neural networks. In Proceedings of the Conference on Artificial Intelligence and Natural Language. Springer, 167180.Google ScholarGoogle Scholar
  29. [29] Qian Tieyun, Liu Bei, Nguyen Quoc Viet Hung, and Yin Hongzhi. 2019. Spatiotemporal representation learning for translation-based POI recommendation. ACM Trans. Inf. Syst. 37, 2 (2019), 124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. [30] Qiao Yaqiong, Luo Xiangyang, Li Chenliang, Tian Hechan, and Ma Jiangtao. 2020. Heterogeneous graph-based joint representation learning for users and POIs in location-based social network. Inf. Process. Manag. 57, 2 (2020), 102151.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. [31] Rahmani Hossein A., Aliannejadi Mohammad, Mirzaei Zadeh Rasoul, Baratchi Mitra, Afsharchi Mohsen, and Crestani Fabio. 2019. Category-aware location embedding for point-of-interest recommendation. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval. 173176. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. [32] Software NCSS Statistical. [n.d.]. Paired T-Test for Superiority by a Margin. Retrieved from: NCSS.com.Google ScholarGoogle Scholar
  33. [33] Wang Yue, Chen Meng, Yu Xiaohui, and Liu Yang. 2017. LCE: A location category embedding model for predicting the category labels of POIs. In Proceedings of the International Conference on Neural Information Processing. Springer, 710720.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. [34] Wu Yiling, Wang Shuhui, and Huang Qingming. 2018. Learning semantic structure-preserved embeddings for cross-modal retrieval. In Proceedings of the 26th ACM International Conference on Multimedia. 825833. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. [35] Xie Min, Yin Hongzhi, Wang Hao, Xu Fanjiang, Chen Weitong, and Wang Sen. 2016. Learning graph-based POI embedding for location-based recommendation. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. 1524. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. [36] Yan Bo, Janowicz Krzysztof, Mai Gengchen, and Gao Song. 2017. From ITDL to Place2Vec: Reasoning about place type similarity and relatedness by learning embeddings from augmented spatial contexts. In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 35. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. [37] Yang Dingqi, Qu Bingqing, Yang Jie, and Cudre-Mauroux Philippe. 2019. Revisiting user mobility and social relationships in LBSNs: A hypergraph embedding approach. In Proceedings of the World Wide Web Conference. 21472157. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. [38] Yang Dingqi, Zhang Daqing, Chen Longbiao, and Qu Bingqing. 2015. NationTelescope: Monitoring and visualizing large-scale collective behavior in LBSNs. J. Netw. Comput. Applic. 55 (2015), 170180.Google ScholarGoogle ScholarCross RefCross Ref
  39. [39] Yang Dingqi, Zhang Daqing, and Qu Bingqing. 2016. Participatory cultural mapping based on collective behavior data in location-based social networks. ACM Trans. Intell. Syst. Technol. 7, 3 (2016), 30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Yang Jing and Eickhoff Carsten. 2018. Unsupervised learning of parsimonious general-purpose embeddings for user and location modeling. ACM Trans. Inf. Syst. 36, 3 (2018), 32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. [41] Yin Hongzhi, Cui Bin, Huang Zi, Wang Weiqing, Wu Xian, and Zhou Xiaofang. 2015. Joint modeling of users’ interests and mobility patterns for point-of-interest recommendation. In Proceedings of the 23rd ACM International Conference on Multimedia. 819822. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. [42] Ying Haochao, Wu Jian, Xu Guandong, Liu Yanchi, Liang Tingting, Zhang Xiao, and Xiong Hui. 2019. Time-aware metric embedding with asymmetric projection for successive POI recommendation. World Wide Web 22, 5 (2019), 22092224. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. [43] Yu Fuqiang, Cui Lizhen, Guo Wei, Lu Xudong, Li Qingzhong, and Lu Hua. 2020. A category-aware deep model for successive POI recommendation on sparse check-in data. In Proceedings of the Web Conference. 12641274. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. [44] Zhang Jianglong, Nie Liqiang, Wang Xiang, He Xiangnan, Huang Xianglin, and Chua Tat Seng. 2016. Shorter-is-better: Venue category estimation from micro-video. In Proceedings of the 24th ACM International Conference on Multimedia. 14151424. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. [45] Zhang Jia-Dong and Chow Chi-Yin. 2015. GeoSoCa: Exploiting geographical, social and categorical correlations for point-of-interest recommendations. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. 443452. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. [46] Zhao Shenglin, Zhao Tong, King Irwin, and Lyu Michael R.. 2017. Geo-Teaser: Geo-temporal sequential embedding rank for point-of-interest recommendation. In Proceedings of the 26th International Conference on World Wide Web. 153162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. [47] Zhao Wayne Xin, Fan Feifan, Wen Ji-Rong, and Chang Edward Y.. 2018. Joint representation learning for location-based social networks with multi-grained sequential contexts. ACM Trans. Knowl. Discov. Data 12, 2 (2018), 121. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. [48] Zhao Wayne Xin, Zhou Ningnan, Sun Aixin, Wen Ji-Rong, Han Jialong, and Chang Edward Y.. 2018. A time-aware trajectory embedding model for next-location recommendation. Knowl. Inf. Syst. 56, 3 (2018), 559579. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. [49] Zhou Jie, Ma Chunping, Long Dingkun, Xu Guangwei, Ding Ning, Zhang Haoyu, Xie Pengjun, and Liu Gongshen. 2020. Hierarchy-aware global model for hierarchical text classification. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 11061117.Google ScholarGoogle ScholarCross RefCross Ref
  50. [50] Zhou Ningnan, Zhao Wayne Xin, Zhang Xiao, Wen Ji-Rong, and Wang Shan. 2016. A general multi-context embedding model for mining human trajectory data. IEEE Trans. Knowl. Data Eng. 28, 8 (2016), 19451958.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. [51] Zhou Yang and Huang Yan. 2018. DeepMove: Learning place representations through large scale movement data. In Proceedings of the IEEE International Conference on Big Data (Big Data). IEEE, 24032412.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Embedding Hierarchical Structures for Venue Category Representation

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Information Systems
          ACM Transactions on Information Systems  Volume 40, Issue 3
          July 2022
          650 pages
          ISSN:1046-8188
          EISSN:1558-2868
          DOI:10.1145/3498357
          Issue’s Table of Contents

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 22 November 2021
          • Accepted: 1 July 2021
          • Revised: 1 June 2021
          • Received: 1 September 2020
          Published in tois Volume 40, Issue 3

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Full Text

        View this article in Full Text.

        View Full Text

        HTML Format

        View this article in HTML Format .

        View HTML Format