Skip to main content
SpringerLink
Log in

Knowledge-aware recommendation model with dynamic co-attention and attribute regularize

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

As important information provided by recommender systems, knowledge graphs are widely applied in computer science and many other fields. The recommender system performance can be significantly improved by leveraging the knowledge graph between the user and item. Various recommendation approaches have been proposed based on the knowledge graph in recent years; however, most of the existing models only apply item-level user representations or attention mechanisms to users and items in the same way and ignore the fact that user and item attributes are significantly different. Hence, these models are not an effectively exploited attribute information and circumscribe the further improvement of recommender performance. In this paper, a novel approach of dynamic co-attention with an attribute regularizer (DCAR) for a knowledge-aware recommender system is proposed to explore the latent connections between the user level and item level. The model dynamically adjusts the dynamic co-attention mechanism through the attribute similarity between the target user and the candidate item. Specifically, an attribute regularizer between user and item is designed to improve the quality of attribute embedding. Experimental results on two realistic datasets show that our proposed model can significantly improve recommender system effectiveness and represents an advancement beyond the compared deep models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Sarwar BM, Karypis G, Konstan JA, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the tenth international world wide web conference, pp 285–295

  2. Wen P, Yuan W, Qin Q, Sang S, Zhang Z (2020) Neural attention model for recommendation based on factorization machines. Applied Intelligence 51:1829–1844

    Article  Google Scholar 

  3. Wang H, Zhang F, Wang J, Zhao M, Li W, Xie X, Guo M (2018) Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 417–426

  4. Yang D, Song Z, Xue L, Xiao Y (2020) A knowledge-enhanced recommendation model with attribute-level co-attention. In: Proceedings of the 43rd International ACM SIGIR conference on research and development in information retrieval, pp 1909–1912

  5. Zhang T, Zhao P, Liu Y, S Sheng V, Xu J, Wang D, Liu G, Zhou X (2019) Feature-level deeper self-attention network for sequential recommendation. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, pp 4320–4326

  6. Bordes A, Usunier N, García-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: 27th Annual conference on neural information processing systems, pp 2787–2795

  7. Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, pp 1112–1119

  8. Xiao H, Huang M, Hao Y, Zhu X (2015) Transa: An adaptive approach for knowledge graph embedding. arXiv:1509.05490

  9. Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing of the asian federation of natural language processing, pp 687–696

  10. Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, pp 2181–2187

  11. Nickel M, Tresp V, Kriegel H (2011) A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th international conference on machine learning, pp 809–816

  12. Yang B, Yih W, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: 3rd international conference on learning representations

  13. Liu Q, Jiang H, Ling Z, Wei S, Hu Y (2016) Probabilistic reasoning via deep learning: Neural association models. arXiv:1603.07704

  14. Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: 3rd International conference on learning representations

  15. Yan C, Chen Y, Wan Y, Wang P (2020) Modeling low- and high-order feature interactions with fm and self-attention network

  16. Cheng Z, Ding Y, He X, Zhu L, Song X, Kankanhalli MS (2018) A3̂ncf: An adaptive aspect attention model for rating prediction. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 3748–3754

  17. Chin JY, Zhao K, Joty SR, Cong G (2018) ANR: aspect-based neural recommender. In: Proceedings of the 27th ACM International conference on information and knowledge management, pp 147–156

  18. Gao X, Feng F, He X, Huang H, Guan X, Feng C, Ming Z, Chua T (2020) Hierarchical attention network for visually-aware food recommendation. IEEE Trans Multimed 22:1647–1659

    Article  Google Scholar 

  19. Tay Y, Luu AT, Hui SC (2018) Multi-pointer co-attention networks for recommendation. In: Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, pp 2309–2318

  20. Zhang S, Tay Y, Yao L, Sun A (2018) Next item recommendation with self-attention. arXiv:1808.06414

  21. Ying H, Zhuang F, Zhang F, Liu Y, Xu G, Xie X, Xiong H, Wu J (2018) Sequential recommender system based on hierarchical attention networks. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 3926–3932

  22. Zhang C, Li T, Ren Z, Hu Z, Ji Y (2019) Taxonomy-aware collaborative denoising autoencoder for personalized recommendation. Appl Intell 49:2101–2118

    Article  Google Scholar 

  23. Lee J, Abu-El-Haija S, Varadarajan B, Natsev A (2018) Collaborative deep metric learning for video understanding. In: Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, pp 481–490

  24. Wang H, Zhang F, Zhao M, Li W, Xie X, Guo M (2019) Multi-task feature learning for knowledge graph enhanced recommendation. In: The world wide web conference, pp 2000–2010

  25. Wang H, Leskovec J, Zhang F, Zhao M, Li W, Zhang M, Wang Z (2019) Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining, pp 968–977

  26. Wang Z, Lin G, Tan H, Chen Q, Liu X (2020) CKAN: collaborative knowledge-aware attentive network for recommender systems. In: Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, pp 219–228

  27. Wang X, Huang T, Wang D, Yuan Y, Liu Z, He X, Chua T (2021) Learning intents behind interactions with knowledge graph for recommendation. arXiv:2102.07057

  28. Zhou G, Zhu X, Song C, Fan Y, Zhu H, Ma X, Yan Y, Jin J, Li H, Gai K (2018) Deep interest network for click-through rate prediction. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1059–1068

  29. Yang C, Sun M, Yi X, Li W (2018) Stylistic chinese poetry generation via unsupervised style disentanglement. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 3960–3969

  30. Hu L, Xu S, Li C, Yang C, Shi C, Duan N, Xie X, Zhou M (2020) Graph neural news recommendation with unsupervised preference disentanglement. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 4255–4264

  31. He X, He Z, Song J, Liu Z, Jiang YG, Chua T (2018) NAIS: Neural attentive item similarity model for recommendation. IEEE Trans Knowl Data Eng 30:2354–2366

    Article  Google Scholar 

  32. He X, Liao L, Zhang H, Nie L, Hu X, Chua T (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182

  33. Kingma DP, Ba J (2015) Adam: A method for stochastic optimization. In: 3rd international conference on learning representations

  34. Xu B, Xu Y, Liang J, Xie C, Liang B, Cui W, Xiao Y (2017) Cn-dbpedia: A never-ending chinese knowledge extraction system. In: Advances in artificial intelligence: from theory to practice - 30th international conference on industrial engineering and other applications of applied intelligent systems, vol 10351, pp 428–438

  35. Xiao J, Ye H, He X, Zhang H, Wu F, Chua T (2017) Attentional factorization machines: Learning the weight of feature interactions via attention networks. In: Proceedings of the twenty-sixth international joint conference on artificial intelligence, pp 3119–3125

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under Grants No. 61472096, No. 61272186, No. 61472095, No. 61502410, the Fundamental Research Funds for the Central Universities(No. 3072021CF0609).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Harbin Engineering University, Harbin, 150001, Heilongjiang, China

    Guisheng Yin, Fukun Chen, Yuxin Dong & Gesu Li

Authors
  1. Guisheng Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fukun Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuxin Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gesu Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fukun Chen.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Fully documented templates are available in the elsarticle package on http://www.ctan.org/tex-archive/macros/latex/contrib/elsarticle.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yin, G., Chen, F., Dong, Y. et al. Knowledge-aware recommendation model with dynamic co-attention and attribute regularize. Appl Intell 52, 3807–3824 (2022). https://doi.org/10.1007/s10489-021-02598-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02598-7

Keywords

Search

Navigation