skip to main content
10.1145/3394171.3413992acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Quaternion-Based Knowledge Graph Network for Recommendation

Published: 12 October 2020 Publication History

Abstract

Recently, to alleviate the data sparsity and cold start problem, many research efforts have been devoted to the usage of knowledge graph (KG) in recommender systems. It is common for most existing KG based models to represent users and items using real-valued embeddings. However, compared with complex or hypercomplex numbers, these real-valued vectors are of less representation capacity and no intrinsic asymmetrical properties, thus may limit the modeling of interactions between entities and relations in KG. In this paper, we propose Quaternion-based Knowledge Graph Network (QKGN) for recommendation, which represents users and items with quaternion embeddings in hypercomplex space, so that the latent inter-dependencies between entities and relations could be captured effectively. In the core of our model, a semantic matching principle based on Hamilton product is applied to learn expressive quaternion representations from the unified user-item KG. On top of this, those embeddings are attentively updated by a customized preference propagation mechanism with structure information concerned. Finally, we apply the proposed QKGN to three real-world datasets of music, movie and book, and experimental results show the validity of our method.

Supplementary Material

RAR File (mmfp0588aux.rar)
This is the supplementary material for the paper 'Quaternion-Based Knowledge Graph Network for Recommendation' published in ACM Multimedia 2020. It includes some additional experiments.
MP4 File (3394171.3413992.mp4)
In this paper, we propose Quaternion-based Knowledge Graph Network (QKGN) for recommendation, which represents users and items with quaternion embeddings in hypercomplex space, so that the latent inter-dependencies between entities and relations could be captured effectively. In the core of our model, a semantic matching principle based on Hamilton product is applied to learn expressive quaternion representations from the unified user-item KG. On top of this, those embeddings are attentively updated by a customized preference propagation mechanism with structure information concerned. Finally, we apply the proposed QKGN to three real-world datasets of music, movie and book, and experimental results show the validity of our method.

References

[1]
Mart'in Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. Tensorflow: A system for large-scale machine learning. In Symposium on Operating Systems Design and Implementation. 265--283.
[2]
Qingyao Ai, Vahid Azizi, Xu Chen, and Yongfeng Zhang. 2018. Learning Heterogeneous Knowledge Base Embeddings for Explainable Recommendation. Algorithms, Vol. 11, 9 (2018), 137.
[3]
Shilong Bao, Qianqian Xu, Ke Ma, Zhiyong Yang, Xiaochun Cao, and Qingming Huang. 2019. Collaborative Preference Embedding against Sparse Labels. In ACM MM. 2079--2087.
[4]
Antoine Bordes, Nicolas Usunier, Alberto Garc'i a-Durá n, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In NIPS. 2787--2795.
[5]
Yixin Cao, Xiang Wang, Xiangnan He, Zikun Hu, and Tat-Seng Chua. 2019. Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences. In WWW. 151--161.
[6]
Rose Catherine and William W. Cohen. 2017. TransNets: Learning to Transform for Recommendation. In RecSys. 288--296.
[7]
Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In SIGIR. 335--344.
[8]
Xin Dong, Evgeniy Gabrilovich, Geremy Heitz, Wilko Horn, Ni Lao, Kevin Murphy, Thomas Strohmann, Shaohua Sun, and Wei Zhang. 2014. Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In KDD. 601--610.
[9]
Chase J Gaudet and Anthony S Maida. 2018. Deep quaternion networks. In IJCNN. 1--8.
[10]
Qingyu Guo, Fuzhen Zhuang, Chuan Qin, Hengshu Zhu, Xing Xie, Hui Xiong, and Qing He. 2020. A Survey on Knowledge Graph-Based Recommender Systems. CoRR, Vol. abs/2003.00911 (2020). arxiv: 2003.00911 https://arxiv.org/abs/2003.00911
[11]
William Rowan Hamilton. 1848. XI. On quaternions; or on a new system of imaginaries in algebra. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, Vol. 33, 219 ( 1848), 58--60.
[12]
Xiangnan He and Tat-Seng Chua. 2017. Neural Factorization Machines for Sparse Predictive Analytics. In SIGIR. 355--364.
[13]
Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Philip S. Yu. 2018. Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model. In KDD. 1531--1540.
[14]
Xiaowen Huang, Quan Fang, Shengsheng Qian, Jitao Sang, Yan Li, and Changsheng Xu. 2019. Explainable Interaction-driven User Modeling over Knowledge Graph for Sequential Recommendation. In ACM MM. 548--556.
[15]
Guoliang Ji, Shizhu He, Liheng Xu, Kang Liu, and Jun Zhao. 2015. Knowledge Graph Embedding via Dynamic Mapping Matrix. In ACL. 687--696.
[16]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR.
[17]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR.
[18]
Yehuda Koren, Robert M. Bell, and Chris Volinsky. 2009. Matrix Factorization Techniques for Recommender Systems. IEEE Computer, Vol. 42, 8 (2009), 30--37.
[19]
Timothé e Lacroix, Nicolas Usunier, and Guillaume Obozinski. 2018. Canonical Tensor Decomposition for Knowledge Base Completion. In ICML. 2869--2878.
[20]
Luis Lechuga-Gutié rrez, Jesus Medrano-Hermosillo, and Eduardo Bayro-Corrochano. 2018. Quaternion Spiking Neural Networks Control for Robotics. In LA-CCI. 1--6.
[21]
Tzu-Heng Lin, Chen Gao, and Yong Li. 2019. CROSS: Cross-platform Recommendation for Social E-Commerce. In SIGIR. 515--524.
[22]
Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning Entity and Relation Embeddings for Knowledge Graph Completion. In AAAI. 2181--2187.
[23]
Chun-Yi Liu, Chuan Zhou, Jia Wu, Yue Hu, and Li Guo. 2018. Social Recommendation with an Essential Preference Space. In AAAI. 346--353.
[24]
Weizhi Ma, Min Zhang, Yue Cao, Woojeong Jin, Chenyang Wang, Yiqun Liu, Shaoping Ma, and Xiang Ren. 2019. Jointly Learning Explainable Rules for Recommendation with Knowledge Graph. In WWW. 1210--1221.
[25]
Andrew L Maas, Awni Y Hannun, and Andrew Y Ng. 2013. Rectifier nonlinearities improve neural network acoustic models. In ICML. 3.
[26]
David N. Milne and Ian H. Witten. 2008. Learning to link with wikipedia. In CIKM. 509--518.
[27]
Maximilian Nickel, Lorenzo Rosasco, and Tomaso A. Poggio. 2016. Holographic Embeddings of Knowledge Graphs. In AAAI. 1955--1961.
[28]
Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. 2011. A Three-Way Model for Collective Learning on Multi-Relational Data. In ICML. 809--816.
[29]
Titouan Parcollet, Mohamed Morchid, Pierre-Michel Bousquet, Richard Dufour, Georges Linarè s, and Renato De Mori. 2016. Quaternion Neural Networks for Spoken Language Understanding. In SLT. 362--368.
[30]
Titouan Parcollet, Mirco Ravanelli, Mohamed Morchid, Georges Linarè s, Chiheb Trabelsi, Renato De Mori, and Yoshua Bengio. 2019. Quaternion Recurrent Neural Networks. In ICLR.
[31]
Titouan Parcollet, Ying Zhang, Mohamed Morchid, Chiheb Trabelsi, Georges Linarè s, Renato de Mori, and Yoshua Bengio. 2018. Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognition. In ISCA. 22--26.
[32]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback. In UAI. 452--461.
[33]
Steffen Rendle, Zeno Gantner, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2011. Fast context-aware recommendations with factorization machines. In SIGIR. 635--644.
[34]
Markus Schedl. 2016. The LFM-1b Dataset for Music Retrieval and Recommendation. In ICMR. 103--110.
[35]
Michael Sejr Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. 2018. Modeling Relational Data with Graph Convolutional Networks. In ESWC. 593--607.
[36]
Richard Socher, Danqi Chen, Christopher D. Manning, and Andrew Y. Ng. 2013. Reasoning With Neural Tensor Networks for Knowledge Base Completion. In NIPS. 926--934.
[37]
Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. In ICLR.
[38]
Xiaoli Tang, Tengyun Wang, Haizhi Yang, and Hengjie Song. 2019. AKUPM: Attention-Enhanced Knowledge-Aware User Preference Model for Recommendation. In KDD. 1891--1899.
[39]
Thé o Trouillon, Johannes Welbl, Sebastian Riedel, É ric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In ICML. 2071--2080.
[40]
Hongwei Wang, Fuzheng Zhang, Min Hou, Xing Xie, Minyi Guo, and Qi Liu. 2018a. SHINE: Signed Heterogeneous Information Network Embedding for Sentiment Link Prediction. In WSDM. 592--600.
[41]
Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018b. RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems. In CIKM. 417--426.
[42]
Hongwei Wang, Fuzheng Zhang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2019 d. Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation. In WWW. 2000--2010.
[43]
Hongwei Wang, Miao Zhao, Xing Xie, Wenjie Li, and Minyi Guo. 2019 e. Knowledge Graph Convolutional Networks for Recommender Systems. In WWW. 3307--3313.
[44]
Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019 a. KGAT: Knowledge Graph Attention Network for Recommendation. In KDD. 950--958.
[45]
Xiang Wang, Dingxian Wang, Canran Xu, Xiangnan He, Yixin Cao, and Tat-Seng Chua. 2019 b. Explainable Reasoning over Knowledge Graphs for Recommendation. In AAAI. 5329--5336.
[46]
Zitai Wang, Qianqian Xu, Ke Ma, Yangbangyan Jiang, Xiaochun Cao, and Qingming Huang. 2019 c. Adversarial Preference Learning with Pairwise Comparisons. In ACM MM. 656--664.
[47]
Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge Graph Embedding by Translating on Hyperplanes. In AAAI. 1112--1119.
[48]
Yikun Xian, Zuohui Fu, S. Muthukrishnan, Gerard de Melo, and Yongfeng Zhang. 2019. Reinforcement Knowledge Graph Reasoning for Explainable Recommendation. In SIGIR. 285--294.
[49]
Xin Xin, Xiangnan He, Yongfeng Zhang, Yongdong Zhang, and Joemon M. Jose. 2019. Relational Collaborative Filtering: Modeling Multiple Item Relations for Recommendation. In SIGIR. 125--134.
[50]
Zhenxing Xu, Ling Chen, Yimeng Dai, and Gencai Chen. 2017. A Dynamic Topic Model and Matrix Factorization-Based Travel Recommendation Method Exploiting Ubiquitous Data. IEEE TMM, Vol. 19, 8 (2017), 1933--1945.
[51]
Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In ICLR.
[52]
Zheng-Jun Zha, Jiawei Liu, Di Chen, and Feng Wu. 2020. Adversarial Attribute-Text Embedding for Person Search With Natural Language Query. IEEE TMM, Vol. 22, 7 (2020), 1836--1846.
[53]
Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016. Collaborative Knowledge Base Embedding for Recommender Systems. In KDD. 353--362.
[54]
Shuai Zhang, Yi Tay, Lina Yao, and Qi Liu. 2019 a. Quaternion Knowledge Graph Embeddings. In NIPS. 2731--2741.
[55]
Shuai Zhang, Lina Yao, Lucas Vinh Tran, Aston Zhang, and Yi Tay. 2019 b. Quaternion Collaborative Filtering for Recommendation. In IJCAI. 4313--4319.
[56]
Jun Zhao, Zhou Zhou, Ziyu Guan, Wei Zhao, Wei Ning, Guang Qiu, and Xiaofei He. 2019. IntentGC: A Scalable Graph Convolution Framework Fusing Heterogeneous Information for Recommendation. In KDD. 2347--2357.
[57]
Yipeng Zhou, Jiqiang Wu, Terence H. Chan, Siu-Wai Ho, Dah-Ming Chiu, and Di Wu. 2018. Interpreting Video Recommendation Mechanisms by Mining View Count Traces. IEEE TMM, Vol. 20, 8 (2018), 2153--2165.
[58]
Qiannan Zhu, Xiaofei Zhou, Zeliang Song, Jianlong Tan, and Li Guo. 2019. DAN: Deep Attention Neural Network for News Recommendation. In AAAI. 5973--5980.
[59]
Cai-Nicolas Ziegler, Sean M. McNee, Joseph A. Konstan, and Georg Lausen. 2005. Improving recommendation lists through topic diversification. In WWW. 22--32.

Cited By

View all
  • (2024)HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution DetectionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681118(1544-1553)Online publication date: 28-Oct-2024
  • (2024)Simple Contrastive Graph ClusteringIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.327187135:10(13789-13800)Online publication date: Oct-2024
  • (2024)Domain-Oriented Knowledge Transfer for Cross-Domain RecommendationIEEE Transactions on Multimedia10.1109/TMM.2024.339468626(9539-9550)Online publication date: 29-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '20: Proceedings of the 28th ACM International Conference on Multimedia
October 2020
4889 pages
ISBN:9781450379885
DOI:10.1145/3394171
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. knowledge graph
  2. quaternion embedding
  3. recommendation

Qualifiers

  • Research-article

Funding Sources

  • Beijing Education Committee Cooperation Beijing Natural Science Foundation
  • Youth Innovation Promotion Association CAS
  • National Key R&D Program of China
  • Strategic Priority Research Program of Chinese Academy of Sciences
  • Beijing Natural Science Foundation
  • Key Research Program of Frontier Sciences, CAS
  • National Natural Science Foundation of China

Conference

MM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)41
  • Downloads (Last 6 weeks)2
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution DetectionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681118(1544-1553)Online publication date: 28-Oct-2024
  • (2024)Simple Contrastive Graph ClusteringIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.327187135:10(13789-13800)Online publication date: Oct-2024
  • (2024)Domain-Oriented Knowledge Transfer for Cross-Domain RecommendationIEEE Transactions on Multimedia10.1109/TMM.2024.339468626(9539-9550)Online publication date: 29-Apr-2024
  • (2024)Weighted Graph-Structured Semantics Constraint Network for Cross-Modal RetrievalIEEE Transactions on Multimedia10.1109/TMM.2023.328289426(1551-1564)Online publication date: 1-Jan-2024
  • (2024)Simple Structure Enhanced Contrastive Graph clustering2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC54092.2024.10831365(4419-4424)Online publication date: 6-Oct-2024
  • (2024)Topological-Semantic Structure and Attribute Representations Decoupling Learning for Improved Graph Neural Networks2024 China Automation Congress (CAC)10.1109/CAC63892.2024.10865498(2523-2528)Online publication date: 1-Nov-2024
  • (2023)Graph Neural Networks without PropagationProceedings of the ACM Web Conference 202310.1145/3543507.3583419(469-477)Online publication date: 30-Apr-2023
  • (2023)Instant Representation Learning for Recommendation over Large Dynamic Graphs2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00014(82-95)Online publication date: Apr-2023
  • (2023)KSGANInformation Systems10.1016/j.is.2023.102282119:COnline publication date: 1-Oct-2023
  • (2023)SRDPR: Social Relation-driven Dynamic network for Personalized micro-video RecommendationExpert Systems with Applications10.1016/j.eswa.2023.120157226(120157)Online publication date: Sep-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media