Abstract
In knowledge graph (KG) based recommender systems, path-based methods make recommendations by building user-item graphs and exploiting connectivity patterns between the entities in the graph. To overcome the limitations of traditional meta-path based methods that rely heavily on handcrafted meta-paths, recent deep neural network based methods, such as the Recurrent Knowledge Graph Embedding (RKGE) approach, can automatically mine the connectivity patterns between entities in the KG, thereby improving recommendation performance. However, these methods usually use only one type of neural network to encode path embeddings, which cannot fully extract path features, limiting performance improvement of the recommender system. In this paper, we propose a Deep Hybrid Knowledge Graph Embedding (DHKGE) method for top-N recommendation. DHKGE encodes embeddings of paths between users and items by combining convolutional neural network (CNN) and the long short-term memory (LSTM) network. Furthermore, it uses an attention mechanism to aggregate the encoded path representations and generate a final hidden state vector, which is used to calculate the proximity between the target user and candidate items, thus generating top-N recommendation. Experiments on the MovieLens 100K and Yelp datasets show that DHKGE overall outperforms RKGE and several typical recommendation methods in terms of Precision@N, MRR@N, and NDCG@N.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The experiment of [14] used MovieLens 1M, but the pre-training vectors of users and items in MovieLens 1M were not published on GitHub, so we can only use MovieLens 100K.
- 2.
- 3.
- 4.
- 5.
- 6.
References
Aggarwal, C.C.: Evaluating recommender systems. Recommender Systems, pp. 225–254. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29659-3_7
Cao, Y., Wang, X., He, X., Hu, Z., Chua, T.: Unifying knowledge graph learning and recommendation: towards a better understanding of user preferences. In: Proceedings of the 28th International Conference on World Wide Web, WWW 2019, pp. 151–161. ACM (2019). https://doi.org/10.1145/3308558.3313705
Catherine, R., Cohen, W.W.: Personalized recommendations using knowledge graphs: a probabilistic logic programming approach. In: Proceedings of the 10th ACM Conference on Recommender Systems, RecSys 2016, pp. 325–332. ACM (2016). https://doi.org/10.1145/2959100.2959131
Da’u, A., Salim, N.: Recommendation system based on deep learning methods: a systematic review and new directions. Artif. Intell. Rev. 53(4), 2709–2748 (2020). https://doi.org/10.1007/s10462-019-09744-1
Goodfellow, I.J., Bengio, Y., Courville, A.C.: Convolutional networks. In: Goodfellow, I.J., Bengio, Y., Courville, A.C. (eds.) Deep Learning, pp. 330–372. MIT Press (2016). http://www.deeplearningbook.org/contents/convnets.html
Goodfellow, I.J., Bengio, Y., Courville, A.C.: Sequence modeling: recurrent and recursive nets. In: Goodfellow, I.J., Bengio, Y., Courville, A.C. (eds.) Deep Learning, pp. 373–420. MIT Press (2016). http://www.deeplearningbook.org/contents/rnn.html
Guo, Q., Zhuang, F., Qin, C., et al.: A survey on knowledge graph-based recommender systems. CoRR abs/2003.00911 (2020). https://arxiv.org/abs/2003.00911
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.: Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web, WWW 2017, pp. 173–182. ACM (2017). https://doi.org/10.1145/3038912.3052569
Hu, B., Shi, C., Zhao, W.Z., Yu, P.S.: Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, pp. 1531–1540. ACM (2018). https://doi.org/10.1145/3219819.3219965
Kim, D., Park, C., Oh, J., Lee, S., Yu, H.: Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM Conference on Recommender Systems, RecSys 2016, pp. 233–240. ACM (2016). https://doi.org/10.1145/2959100.2959165
Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, pp. 1746–1751. ACL (2014). https://doi.org/10.3115/v1/D14-1181
Lee, H., Ahn, Y., Lee, H., Ha, S., Lee, S.: Quote recommendation in dialogue using deep neural network. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, pp. 957–960. ACM (2016). https://doi.org/10.1145/2911451.2914734
Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, UAI 2009, pp. 452–461. AUAI Press (2009). https://dslpitt.org/uai/papers/09/p452-rendle.pdf
Sun, Z., Yang, J., Zhang, J., Bozzon, A., Huang, L., Xu, C.: Recurrent knowledge graph embedding for effective recommendation. In: Proceedings of the 12th ACM Conference on Recommender Systems, RecSys 2018, pp. 297–305. ACM (2018). https://doi.org/10.1145/3240323.3240361
Wang, X., Wang, D., Xu, C., He, X., Cao, Y., Chua, T.: Explainable reasoning over knowledge graphs for recommendation. In: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, pp. 5329–5336. AAAI Press (2019). https://doi.org/10.1609/aaai.v33i01.33015329
Xu, W., Xu, Z., Ye, L.: Computing user similarity by combining item ratings and background knowledge from linked open data. In: Meng, X., Li, R., Wang, K., Niu, B., Wang, X., Zhao, G. (eds.) WISA 2018. LNCS, vol. 11242, pp. 467–478. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-02934-0_43
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A.J., Hovy, E.H.: Hierarchical attention networks for document classification. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics, HLT-NAACL 2016, pp. 1480–1489. ACL (2016). https://doi.org/10.18653/v1/N16-1174
Yu, X., Ren, X., Sun, Y., Sturt, B., Khandelwal, U., Gu, Q., Norick, B., Han, J.: Recommendation in heterogeneous information networks with implicit user feedback. In: Proceedings of the 7th ACM Conference on Recommender Systems, RecSys 2013, pp. 347–350. ACM (2013). https://doi.org/10.1145/2507157.2507230
Zhang, F., Yuan, N.J., Lian, D., Xie, X., Ma, W.: Collaborative knowledge base embedding for recommender systems. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2016, pp. 353–362. ACM (2016). https://doi.org/10.1145/2939672.2939673
Zhang, S., Yao, L., Sun, A., Tay, Y.: Deep learning based recommender system: a survey and new perspectives. ACM Comput. Surv. 52(1), 5:1–5:38 (2019). https://doi.org/10.1145/3285029
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, J., Xu, Z., Tang, Y., Zhao, B., Tian, H. (2020). Deep Hybrid Knowledge Graph Embedding for Top-N Recommendation. In: Wang, G., Lin, X., Hendler, J., Song, W., Xu, Z., Liu, G. (eds) Web Information Systems and Applications. WISA 2020. Lecture Notes in Computer Science(), vol 12432. Springer, Cham. https://doi.org/10.1007/978-3-030-60029-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-60029-7_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60028-0
Online ISBN: 978-3-030-60029-7
eBook Packages: Computer ScienceComputer Science (R0)
