skip to main content
research-article

Graph Neural News Recommendation with User Existing and Potential Interest Modeling

Published:09 March 2022Publication History
Skip Abstract Section

Abstract

Personalized news recommendations can alleviate the information overload problem. To enable personalized recommendation, one critical step is to learn a comprehensive user representation to model her/his interests. Many existing works learn user representations from the historical clicked news articles, which reflect their existing interests. However, these approaches ignore users’ potential interests and pay less attention to news that may interest the users in the future. To address this problem, we propose a novel Graph neural news Recommendation model with user Existing and Potential interest modeling, named GREP. Different from existing works, GREP introduces three modules to jointly model users’ existing and potential interests: (1) Existing Interest Encoding module mines user historical clicked news and applies the multi-head self-attention mechanism to capture the relatedness among the news; (2) Potential Interest Encoding module leverages the graph neural network to explore the user potential interests on the knowledge graph; and (3) Bi-directional Interaction module dynamically builds a news-entity bipartite graph to further enrich two interest representations. Finally, GREP combines the existing and potential interest representations to represent the user and leverages a prediction layer to estimate the clicking probability of the candidate news. Experiments on two real-world large-scale datasets demonstrate the state-of-the-art performance of GREP.

REFERENCES

  1. [1] An Mingxiao, Wu Fangzhao, Wu Chuhan, Zhang Kun, Liu Zheng, and Xie Xing. 2019. Neural news recommendation with long- and short-term user representations. In Proceedings of the ACL (1). Association for Computational Linguistics, 336345.Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Ba Lei Jimmy, Kiros Jamie Ryan, and Hinton Geoffrey E.. 2016. Layer normalization. CoRR abs/1607.06450.Google ScholarGoogle Scholar
  3. [3] Bansal Trapit, Das Mrinal Kanti, and Bhattacharyya Chiranjib. 2015. Content driven user profiling for comment-worthy recommendations of news and blog articles. In Proceedings of the RecSys. ACM, 195202.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. [4] Cheng Heng-Tze, Koc Levent, Harmsen Jeremiah, Shaked Tal, Chandra Tushar, Aradhye Hrishi, Anderson Glen, Corrado Greg, Chai Wei, Ispir Mustafa, Anil Rohan, Haque Zakaria, Hong Lichan, Jain Vihan, Liu Xiaobing, and Shah Hemal. 2016. Wide & deep learning for recommender systems. In Proceedings of the DLRS@RecSys. ACM, 710.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. [5] Morales Gianmarco De Francisci, Gionis Aristides, and Lucchese Claudio. 2012. From chatter to headlines: Harnessing the real-time web for personalized news recommendation. In Proceedings of the 5th ACM International Conference on Web Search and Data Mining. 153162.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Ge Suyu, Wu Chuhan, Wu Fangzhao, Qi Tao, and Huang Yongfeng. 2020. Graph enhanced representation learning for news recommendation. In Proceedings of the WWW. ACM / IW3C2, 28632869.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. [7] Gulla Jon Atle, Zhang Lemei, Liu Peng, Özgöbek Özlem, and Su Xiaomeng. 2017. The adressa dataset for news recommendation. In Proceedings of the International Conference on Web Intelligence. 10421048.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. [8] Guo Huifeng, Tang Ruiming, Ye Yunming, Li Zhenguo, and He Xiuqiang. 2017. DeepFM: A factorization-machine based neural network for CTR prediction. In Proceedings of the IJCAI. ijcai.org, 17251731.Google ScholarGoogle ScholarCross RefCross Ref
  9. [9] Ho Yu-Chieh, Chiang Yi-Ting, and Hsu Jane Yung-jen. 2014. Who likes it more?: Mining worth-recommending items from long tails by modeling relative preference. In Proceedings of the 7th ACM International Conference on Web Search and Data Mining. Carterette Ben, Diaz Fernando, Castillo Carlos, and Metzler Donald (Eds.), ACM, 253262. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. [10] Hu Linmei, Li Chen, Shi Chuan, Yang Cheng, and Shao Chao. 2020. Graph neural news recommendation with long-term and short-term interest modeling. Information Processing and Management 57, 2 (2020), 102142.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] Hu Linmei, Xu Siyong, Li Chen, Yang Cheng, Shi Chuan, Duan Nan, Xie Xing, and Zhou Ming. 2020. Graph neural news recommendation with unsupervised preference disentanglement. In Proceedings of the ACL. Association for Computational Linguistics, 42554264.Google ScholarGoogle ScholarCross RefCross Ref
  12. [12] IJntema Wouter, Goossen Frank, Frasincar Flavius, and Hogenboom Frederik. 2010. Ontology-based news recommendation. In Proceedings of the 2010 EDBT/ICDT Workshops. 16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Kipf Thomas N. and Welling Max. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the ICLR (Poster). OpenReview.net.Google ScholarGoogle Scholar
  14. [14] Li Lihong, Chu Wei, Langford John, and Schapire Robert E. 2010. A contextual-bandit approach to personalized news article recommendation. In Proceedings of the 19th International Conference on World Wide Web. 661670.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Li Qimai, Han Zhichao, and Wu Xiao-Ming. 2018. Deeper insights into graph convolutional networks for semi-supervised learning. In Proceedings of the AAAI. AAAI Press, 35383545.Google ScholarGoogle ScholarCross RefCross Ref
  16. [16] Lian Jianxun, Zhang Fuzheng, Xie Xing, and Sun Guangzhong. 2018. Towards better representation learning for personalized news recommendation: A multi-channel deep fusion approach. In Proceedings of the IJCAI. ijcai.org, 38053811.Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Lin Yuanguo, Liu Yong, Lin Fan, Wu Pengcheng, Zeng Wenhua, and Miao Chunyan. 2021. A survey on reinforcement learning for recommender systems. CoRR abs/2109.10665.Google ScholarGoogle Scholar
  18. [18] Liu Danyang, Lian Jianxun, Wang Shiyin, Qiao Ying, Chen Jiun-Hung, Sun Guangzhong, and Xie Xing. 2020. KRED: Knowledge-aware document representation for news recommendations. In Proceedings of the RecSys. ACM, 200209.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Liu Danyang, Lian Jianxun, Wang Shiyin, Qiao Ying, Chen Jiun-Hung, Sun Guangzhong, and Xie Xing. 2020. KRED: Knowledge-aware document representation for news recommendations. In Proceedings of the RecSys 2020: 14th ACM Conference on Recommender Systems, Virtual Event, Brazil, September 22-26, 2020, Santos Rodrygo L. T., Marinho Leandro Balby, Daly Elizabeth M., Chen Li, Falk Kim, Koenigstein Noam, and Moura Edleno Silva de (Eds.), ACM, 200209. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. [20] Okura Shumpei, Tagami Yukihiro, Ono Shingo, and Tajima Akira. 2017. Embedding-based news recommendation for millions of users. In Proceedings of the KDD. ACM, 19331942.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. [21] Pennington Jeffrey, Socher Richard, and Manning Christopher D.. 2014. Glove: Global vectors for word representation. In Proceedings of the EMNLP. ACL, 15321543.Google ScholarGoogle ScholarCross RefCross Ref
  22. [22] Qi Tao, Wu Fangzhao, Wu Chuhan, Yang Peiru, Yu Yang, Xie Xing, and Huang Yongfeng. 2021. HieRec: Hierarchical user interest modeling for personalized news recommendation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021, Zong Chengqing, Xia Fei, Li Wenjie, and Navigli Roberto (Eds.), Association for Computational Linguistics, 54465456. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] Qiu Zhaopeng, Wu Xian, and Fan Wei. 2019. Question difficulty prediction for multiple choice problems in medical exams. In Proceedings of the CIKM. ACM, 139148.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. [24] Qiu Zhaopeng, Wu Xian, and Fan Wei. 2020. Automatic distractor generation for multiple choice questions in standard tests. In Proceedings of the COLING. International Committee on Computational Linguistics, 20962106.Google ScholarGoogle ScholarCross RefCross Ref
  25. [25] Qiu Zhaopeng, Wu Xian, Gao Jingyue, and Fan Wei. 2021. U-BERT: Pre-training user representations for improved recommendation. In Proceedings of the AAAI. AAAI Press, 43204327.Google ScholarGoogle Scholar
  26. [26] Rendle Steffen. 2012. Factorization machines with libFM. ACM Transactions on Intelligent Systems and Technology 3, 3 (2012), 57:1–57:22.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. [27] Shi Yunsheng, Huang Zhengjie, Feng Shikun, and Sun Yu. 2020. Masked label prediction: Unified massage passing model for semi-supervised classification. CoRR abs/2009.03509.Google ScholarGoogle Scholar
  28. [28] Wang Chong and Blei David M.. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the KDD. ACM, 448456.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. [29] Wang Heyuan, Wu Fangzhao, Liu Zheng, and Xie Xing. 2020. Fine-grained interest matching for neural news recommendation. In Proceedings of the ACL. Association for Computational Linguistics, 836845.Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Wang Hongwei, Zhang Fuzheng, Xie Xing, and Guo Minyi. 2018. DKN: Deep knowledge-aware network for news recommendation. In Proceedings of the WWW. ACM, 18351844.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. [31] Wu Chuhan, Wu Fangzhao, An Mingxiao, Huang Jianqiang, Huang Yongfeng, and Xie Xing. 2019. Neural news recommendation with attentive multi-view learning. In Proceedings of the IJCAI. ijcai.org, 38633869.Google ScholarGoogle ScholarCross RefCross Ref
  32. [32] Wu Chuhan, Wu Fangzhao, An Mingxiao, Huang Jianqiang, Huang Yongfeng, and Xie Xing. 2019. NPA: Neural news recommendation with personalized attention. In Proceedings of the KDD. ACM, 25762584.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. [33] Wu Chuhan, Wu Fangzhao, Ge Suyu, Qi Tao, Huang Yongfeng, and Xie Xing. 2019. Neural news recommendation with multi-head self-attention. In Proceedings of the EMNLP/IJCNLP (1). Association for Computational Linguistics, 63886393.Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Wu Fangzhao, Qiao Ying, Chen Jiun-Hung, Wu Chuhan, Qi Tao, Lian Jianxun, Liu Danyang, Xie Xing, Gao Jianfeng, Wu Winnie, and Zhou Ming. 2020. MIND: A large-scale dataset for news recommendation. In Proceedings of the 58th Annual Meeting of the Association for Computational, Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel R. Tetreault (Eds.). Association for Computational Linguistics, 35973606. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  35. [35] Wu Zonghan, Pan Shirui, Chen Fengwen, Long Guodong, Zhang Chengqi, and Philip S Yu. 2021. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems 32, 1 (2021), 4–24.Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Zhang Hui, Chen Xu, and Ma Shuai. 2019. Dynamic news recommendation with hierarchical attention network. In Proceedings of the ICDM. IEEE, 14561461.Google ScholarGoogle ScholarCross RefCross Ref
  37. [37] Zhang Xuanyu, Yang Qing, and Xu Dongliang. 2021. Combining explicit entity graph with implicit text information for news recommendation. In Proceedings of the Companion Proceedings of the Web Conference 2021. 412416.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. [38] Zheng Guanjie, Zhang Fuzheng, Zheng Zihan, Xiang Yang, Yuan Nicholas Jing, Xie Xing, and Li Zhenhui. 2018. DRN: A deep reinforcement learning framework for news recommendation. In Proceedings of the 2018 World Wide Web Conference. 167176.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. [39] Zolaktaf Zainab, Babanezhad Reza, and Pottinger Rachel. 2018. A generic top-n recommendation framework for trading-off accuracy, novelty, and coverage. In 34th IEEE International Conference on Data Engineering, ICDE 2018, Paris, France, April 16-19, 2018. IEEE Computer Society, 149160. DOI:Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Graph Neural News Recommendation with User Existing and Potential Interest Modeling

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Knowledge Discovery from Data
        ACM Transactions on Knowledge Discovery from Data  Volume 16, Issue 5
        October 2022
        532 pages
        ISSN:1556-4681
        EISSN:1556-472X
        DOI:10.1145/3514187
        Issue’s Table of Contents

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 9 March 2022
        • Online AM: 4 February 2022
        • Accepted: 1 January 2022
        • Revised: 1 November 2021
        • Received: 1 June 2021
        Published in tkdd Volume 16, Issue 5

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text

      HTML Format

      View this article in HTML Format .

      View HTML Format