skip to main content
10.1145/3404835.3462980acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

Knowledge Based Hyperbolic Propagation

Published: 11 July 2021 Publication History

Abstract

There has been significant progress in utilizing heterogeneous knowledge graphs (KGs) as auxiliary information in recommendation systems. However, existing KG-aware recommendation models rely solely on Euclidean space, neglecting hyperbolic space, which has already been shown to possess a superior ability to separate embed-dings by providing more "room". We propose a knowledge-based hyperbolic propagation framework (KBHP) which includes hyperbolic components for calculating the importance of KG attributes relative to achieve better knowledge propagation. In addition to the original relations in the knowledge graph, we propose a user purchase relation to better represent logical patterns in hyperbolic space, which bridges users and items for modeling user preference. Experiments on four real-world benchmarks show that KBHP is significantly more accurate than state-of-the-art models. We further visualize the generated embeddings to demonstrate that the proposed model successfully clusters attributes that are relevant to items and highlights those that contain useful information for the recommendation.

Supplementary Material

MP4 File (sigir_short_presentation.mp4)
Knowledge Based Hyperbolic Propagation

References

[1]
Ivana Balazevic, Carl Allen, and Timothy M. Hospedales. 2019. Multi-relational Poincaré Graph Embeddings. CoRRabs/1905.09791 (2019). arXiv:1905.09791 http://arxiv.org/abs/1905.09791
[2]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-Relational Data. In Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2(Lake Tahoe, Nevada)(NIPS'13). Curran Associates Inc., Red Hook, NY, USA, 2787--2795.
[3]
Yixin Cao, Xiang Wang, Xiangnan He, Zikun Hu, and Tat-Seng Chua. 2019. Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences. CoRRabs/1902.06236 (2019). arXiv:1902.06236http://arxiv.org/abs/1902.06236
[4]
Benjamin Paul Chamberlain, James Clough, and Marc Peter Deisenroth. 2017. Neural embeddings of graphs in hyperbolic space. arXiv preprint arXiv:1705.10359(2017).
[5]
Benjamin Paul Chamberlain, Stephen R. Hardwick, David R. Wardrope, Fabon Dzogang, Fabio Daolio, and Saúl Vargas. 2019. Scalable Hyperbolic Recommender Systems. CoRRabs/1902.08648 (2019). arXiv:1902.08648 http://arxiv.org/abs/1902.08648
[6]
Ines Chami, Adva Wolf, Da-Cheng Juan, Frederic Sala, Sujith Ravi, and Christopher Ré. 2020. Low-Dimensional Hyperbolic Knowledge Graph Embeddings. arXiv:2005.00545 [cs.LG]
[7]
Hongxu Chen, Yicong Li, Xiangguo Sun, Guandong Xu, and Hongzhi Yin. 2021.Temporal Meta-path Guided Explainable Recommendation.arXiv:2101.01433 [cs.SI]
[8]
Shanshan Feng, Lucas Vinh Tran, Gao Cong, Lisi Chen, Jing Li, and Fan Li. 2020. HME: A Hyperbolic Metric Embedding Approach for Next-POI Recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval(Virtual Event, China) (SIGIR'20). Association for Computing Machinery, New York, NY, USA, 1429--1438. https://doi.org/10.1145/3397271.3401049
[9]
Octavian Ganea, Gary Bécigneul, and Thomas Hofmann. 2018. Hyperbolic entailment cones for learning hierarchical embeddings. In International Conference on Machine Learning. PMLR, 1646--1655.
[10]
Octavian-Eugen Ganea, Gary Bécigneul, and Thomas Hofmann. 2018. Hyperbolic Neural Networks. CoRRabs/1805.09112 (2018). arXiv:1805.09112 http://arxiv.org/abs/1805.09112
[11]
Caglar Gulçehre, Misha Denil, Mateusz Malinowski, Ali Razavi, Razvan Pascanu, Karl Moritz Hermann, Peter W. Battaglia, Victor Bapst, David Raposo, Adam Santoro, and Nando de Freitas. 2018. Hyperbolic Attention Networks. CoRRabs/1805.09786 (2018). arXiv:1805.09786 http://arxiv.org/abs/1805.09786
[12]
Xiangnan He and Tat-Seng Chua. 2017. Neural Factorization Machines for Sparse Predictive Analytics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval(Shinjuku, Tokyo, Japan) (SIGIR '17). Association for Computing Machinery, New York, NY, USA, 355--364. https://doi.org/10.1145/3077136.3080777
[13]
Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Philip S. Yu. 2018. Leveraging Meta-path Based Context for Top- N Recommendation with A Neural Co-Attention Model. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining(London, United Kingdom) (KDD '18). ACM, New York, NY, USA, 1531--1540. https://doi.org/10.1145/3219819.3219965
[14]
Matthias Leimeister and Benjamin J Wilson. 2018. Skip-gram word embeddings in hyperbolic space. arXiv preprint arXiv:1809.01498(2018).
[15]
Anchen Li and Bo Yang. 2021. HSR: Hyperbolic Social Recommender. arXiv preprint arXiv:2102.09389(2021).
[16]
Qi Liu, Maximilian Nickel, and Douwe Kiela. 2019. Hyperbolic Graph Neural Networks. CoRRabs/1910.12892 (2019). arXiv:1910.12892 http://arxiv.org/abs/1910.12892
[17]
Leyla Mirvakhabova, Evgeny Frolov, Valentin Khrulkov, Ivan Oseledets, and Alexander Tuzhilin. 2020. Performance of Hyperbolic Geometry Models on Top-N Recommendation Tasks. Fourteenth ACM Conference on Recommender Systems(Sep 2020). https://doi.org/10.1145/3383313.3412219
[18]
Maximilian Nickel and Douwe Kiela. 2018. Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometry. arXiv:1806.03417 [cs.AI]
[19]
Jorg Ontrup and Helge Ritter. 2001. Text categorization and semantic browsing with self-organizing maps on non-euclidean spaces. In European Conference on Principles of Data Mining and Knowledge Discovery. Springer, 338--349.
[20]
Jörg Ontrup and Helge J Ritter. 2001. Hyperbolic Self-Organizing Maps for Semantic Navigation. In NIPS, Vol. 2001. 1417--1424.
[21]
Steffen Rendle, Zeno Gantner, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2011. Fast Context-aware Recommendations with Factorization Machines. In Proceedings of the 34th International ACM SIGIR Conference (SIGIR '11). ACM, New York, NY, USA, 635--644. https://doi.org/10.1145/2009916.2010002
[22]
Joel W Robbin and Dietmar A Salamon. 2017. Introduction to differential geometry.
[23]
Christopher De Sa, Albert Gu, Christopher Ré, and Frederic Sala. 2018. Representation Tradeoffs for Hyperbolic Embeddings. CoRRabs/1804.03329 (2018). arXiv:1804.03329 http://arxiv.org/abs/1804.03329
[24]
Timothy Schmeier, Joeseph Chisari, Sam Garrett, and Brett Vintch. 2019. Music recommendations in hyperbolic space: an application of empirical bayes and hierarchical poincaré embeddings. In Proceedings of the 13th ACM Conference on Recommender Systems. 437--441.
[25]
Jianing Sun, Zhaoyue Cheng, Saba Zuberi, Felipe Pérez, and Maksims Volkovs. 2021. HGCF: Hyperbolic Graph Convolution Networks for Collaborative Filtering. (2021).
[26]
Zhu Sun, Jie Yang, Jie Zhang, Alessandro Bozzon, Long-Kai Huang, and Chi Xu. 2018. Recurrent Knowledge Graph Embedding for Effective Recommendation. In Proceedings of the 12th ACM Conference on Recommender Systems(Vancouver, British Columbia, Canada)(RecSys '18). Association for Computing Machinery, New York, NY, USA, 297--305. https://doi.org/10.1145/3240323.3240361
[27]
Chang-You Tai, Meng-Ru Wu, Yun-Wei Chu, Shao-Yu Chu, and Lun-Wei Ku. 2020. MVIN: Learning Multiview Items for Recommendation.Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval(Jul 2020). https://doi.org/10.1145/3397271.3401126
[28]
Alexandru Tifrea, Gary Bécigneul, and Octavian-Eugen Ganea. 2018. Poincaré GloVe: Hyperbolic Word Embeddings. CoRRabs/1810.06546 (2018). arXiv:1810.06546 http://arxiv.org/abs/1810.06546
[29]
Tran Dang Quang Vinh, Yi Tay, Shuai Zhang, Gao Cong, and Xiao-Li Li. 2018. Hyperbolic recommender systems. arXiv preprint arXiv:1809.01703(2018).
[30]
Lucas Vinh Tran, Yi Tay, Shuai Zhang, Gao Cong, and Xiaoli Li. 2020. HyperML: a boosting metric learning approach in hyperbolic space for recommender systems. In Proceedings of the 13th International Conference on Web Search and Data Mining. 609--617.
[31]
Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018. Ripple Network: Propagating User Preferences on the Knowledge Graph for Recommender Systems. CoRRabs/1803.03467 (2018). arXiv:1803.03467 http://arxiv.org/abs/1803.03467
[32]
Hongwei Wang, Fuzheng Zhang, Xing Xie, and Minyi Guo. 2018. DKN: Deep Knowledge-Aware Network for News Recommendation. In Proceedings of the 2018 World Wide Web Conference(Lyon, France)(WWW '18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva,Switzerland, 1835--1844. https://doi.org/10.1145/3178876.3186175
[33]
Hongwei Wang, Fuzheng Zhang, Mengdi Zhang, Jure Leskovec, Miao Zhao, Wenjie Li, and Zhongyuan Wang. 2019. Knowledge Graph Convolutional Networks for Recommender Systems with Label Smoothness Regularization. CoRRabs/1905.04413 (2019). arXiv: 1905.04413 http://arxiv.org/abs/1905.04413
[34]
Hongwei Wang, Miao Zhao, Xing Xie, Wenjie Li, and Minyi Guo. 2019. Knowledge Graph Convolutional Networks for Recommender Systems. CoRRabs/1904.12575(2019). arXiv:1904.12575 http://arxiv.org/abs/1904.12575
[35]
Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019. KGAT: Knowledge Graph Attention Network for Recommendation. CoRRabs/1905.07854(2019). arXiv:1905.07854 http://arxiv.org/abs/1905.07854
[36]
Xiang Wang, Dingxian Wang, Canran Xu, Xiangnan He, Yixin Cao, and Tat-Seng Chua. 2018. Explainable Reasoning over Knowledge Graphs for Recommendation. CoRRabs/1811.04540 (2018). arXiv:1811.04540 http://arxiv.org/abs/1811.04540
[37]
Zhen Wang, J. Zhang, Jianlin Feng, and Z. Chen. 2014. Knowledge Graph Embedding by Translating on Hyperplanes. In AAAI.
[38]
Xiao Yu, Xiang Ren, Yizhou Sun, Quanquan Gu, Bradley Sturt, Urvashi Khandelwal, Brandon Norick, and Jiawei Han. 2014. Personalized Entity Recommendation: A Heterogeneous Information Network Approach. In Proceedings of the 7th ACM International Conference on Web Search and Data Mining(New York, New York, USA)(WSDM '14). ACM, New York, NY, USA, 283--292. https://doi.org/10.1145/2556195.2556259
[39]
Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016. Collaborative Knowledge Base Embedding for Recommender Systems. In Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '16). 353--362. https://doi.org/10.1145/2939672.2939673
[40]
Huan Zhao, Quanming Yao, Jianda Li, Yangqiu Song, and Dik Lun Lee. 2017. Meta-Graph Based Recommendation Fusion over Heterogeneous Information Networks. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining(Halifax, NS, Canada) (KDD '17). ACM, New York, NY, USA, 635--644. https://doi.org/10.1145/3097983.3098063
[41]
Yudong Zhu, Di Zhou, Jinghui Xiao, Xin Jiang, Xiao Chen, and Qun Liu. 2020. Hyper Text: Endowing Fast Text with Hyperbolic Geometry. In Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, Online, 1166--1171. https://doi.org/10.18653/v1/2020.findings-emnlp.104

Cited By

View all
  • (2023)Knowledge-based Multiple Adaptive Spaces Fusion for RecommendationProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608787(565-575)Online publication date: 14-Sep-2023
  • (2023)Expert Recommendation Method for Fault Maintenance Based On Industrial Manufacturing Knowledge2023 IEEE International Conference on Data Mining Workshops (ICDMW)10.1109/ICDMW60847.2023.00025(137-146)Online publication date: 4-Dec-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2021
2998 pages
ISBN:9781450380379
DOI:10.1145/3404835
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. graph neural network
  2. hyperbolic embedding learning
  3. knowledge graph
  4. recommendation

Qualifiers

  • Short-paper

Funding Sources

  • MOST

Conference

SIGIR '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)3
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Knowledge-based Multiple Adaptive Spaces Fusion for RecommendationProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608787(565-575)Online publication date: 14-Sep-2023
  • (2023)Expert Recommendation Method for Fault Maintenance Based On Industrial Manufacturing Knowledge2023 IEEE International Conference on Data Mining Workshops (ICDMW)10.1109/ICDMW60847.2023.00025(137-146)Online publication date: 4-Dec-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media