Skip to main content

Time-Aware Attentive Neural Network for News Recommendation with Long- and Short-Term User Representation

  • Conference paper
  • First Online:
Book cover Knowledge Science, Engineering and Management (KSEM 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12275))

Abstract

News recommendation is very critical to help users quickly find news satisfying their preferences. Modeling user interests with accurate user representations is a challenging task in news recommendation. Existing methods usually utilize recurrent neural networks to capture the short-term user interests, and have achieved promising performance. However, existing methods ignore the user interest drifts caused by time interval in the short session. Thus they always assume the short-term user interests are stable, which might lead to suboptimal performance. To address this issue, we propose the novel model named Time-aware Attentive Neural Network with Long-term and Short-term User Representation (TANN). Specifically, to reduce the influence of interest drifts, we propose the Time-aware Self-Attention (T-SA) which considers the time interval information about user browsing history. We learn the short-term user representations from their recently browsing news through the T-SA. In addition, we learn more informative news representations from the historical readers and the contents of news articles. Moreover, we adopt the latent factor model to build the long-term user representations from the entire browsing history. We combine the short-term and long-term user representations to capture more accurate user interests. Extensive experiments on two public datasets show that our model outperforms several state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.kaggle.com/gspmoreira/news-portal-user-interactions-by-globocom.

  2. 2.

    http://reclab.idi.ntnu.no/dataset/.

References

  1. An, M., Wu, F., Wu, C., Zhang, K., Liu, Z., Xie, X.: Neural news recommendation with long-and short-term user representations. In: Proceedings of the 57th ACL, pp. 336–345 (2019)

    Google Scholar 

  2. Chen, X., Zhang, Y., Qin, Z.: Dynamic explainable recommendation based on neural attentive models. In: Proceedings of the AAAI, vol. 33, pp. 53–60 (2019)

    Google Scholar 

  3. Das, A.S., Datar, M., Garg, A., Rajaram, S.: Google news personalization: scalable online collaborative filtering. In: Proceedings of the 16th WWW, pp. 271–280. ACM (2007)

    Google Scholar 

  4. Gulla, J.A., Zhang, L., Liu, P., Özgöbek, Ö., Su, X.: The Adressa dataset for news recommendation. In: Proceedings of the International Conference on Web Intelligence, pp. 1042–1048. ACM (2017)

    Google Scholar 

  5. Guo, H., Tang, R., Ye, Y., Li, Z., He, X.: DeepFM: a factorization-machine based neural network for CTR prediction. arXiv preprint arXiv:1703.04247 (2017)

  6. He, X., Du, X., Wang, X., Tian, F., Tang, J., Chua, T.S.: Outer product-based neural collaborative filtering. In: Proceedings of the 27th IJCAI, pp. 2227–2233. AAAI Press (2018)

    Google Scholar 

  7. Hu, L., Li, C., Shi, C., Yang, C., Shao, C.: Graph neural news recommendation with long-term and short-term interest modeling. Inf. Process. Manag. 57(2), 102142 (2020)

    Article  Google Scholar 

  8. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  9. Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)

    Article  Google Scholar 

  10. Li, L., Wang, D., Li, T., Knox, D., Padmanabhan, B.: Scene: a scalable two-stage personalized news recommendation system. In: Proceedings of the 34th ACM SIGIR, pp. 125–134 (2011)

    Google Scholar 

  11. Li, L., Zheng, L., Yang, F., Li, T.: Modeling and broadening temporal user interest in personalized news recommendation. Expert Syst. Appl. 41(7), 3168–3177 (2014)

    Article  Google Scholar 

  12. Li, L., Chu, W., Langford, J., Schapire, R.E.: A contextual-bandit approach to personalized news article recommendation. In: Proceedings of the 19th WWW, pp. 661–670 (2010)

    Google Scholar 

  13. Liu, J., Dolan, P., Pedersen, E.R.: Personalized news recommendation based on click behavior. In: Proceedings of the 15th International Conference on Intelligent User Interfaces, pp. 31–40. ACM (2010)

    Google Scholar 

  14. Okura, S., Tagami, Y., Ono, S., Tajima, A.: Embedding-based news recommendation for millions of users. In: Proceedings of the 23rd ACM SIGKDD, pp. 1933–1942 (2017)

    Google Scholar 

  15. Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Proceedings of the EMNLP, pp. 1532–1543 (2014)

    Google Scholar 

  16. Ren, H., Feng, W.: CONCERT: a concept-centric web news recommendation system. In: Wang, J., Xiong, H., Ishikawa, Y., Xu, J., Zhou, J. (eds.) WAIM 2013. LNCS, vol. 7923, pp. 796–798. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-38562-9_82

    Chapter  Google Scholar 

  17. Son, J.W., Kim, A.Y., Park, S.B.: A location-based news article recommendation with explicit localized semantic analysis. In: Proceedings of the 36th ACM SIGKDD, pp. 293–302 (2013)

    Google Scholar 

  18. Wang, H., Zhang, F., Xie, X., Guo, M.: DKN: deep knowledge-aware network for news recommendation. In: Proceedings of WWW, pp. 1835–1844 (2018)

    Google Scholar 

  19. Wu, C., Wu, F., An, M., Huang, J., Huang, Y., Xie, X.: Neural news recommendation with attentive multi-view learning. arXiv preprint arXiv:1907.05576 (2019)

    Google Scholar 

  20. Wu, C., Wu, F., An, M., Huang, J., Huang, Y., Xie, X.: NPA: neural news recommendation with personalized attention. In: Proceedings of the 25th SIGKDD, pp. 2576–2584. ACM (2019)

    Google Scholar 

  21. Wu, C., Wu, F., Ge, S., Qi, T., Huang, Y., Xie, X.: Neural news recommendation with multi-head self-attention. In: Proceedings of the EMNLP-IJCNLP, pp. 6390–6395 (2019)

    Google Scholar 

  22. Zhang, L., Liu, P., Gulla, J.A.: A deep joint network for session-based news recommendations with contextual augmentation. In: Proceedings of the 29th on Hypertext and Social Media, pp. 201–209 (2018)

    Google Scholar 

  23. Zhu, Q., Zhou, X., Song, Z., Tan, J., Guo, L.: Dan: deep attention neural network for news recommendation. In: Proceedings of the AAAI, vol. 33, pp. 5973–5980 (2019)

    Google Scholar 

  24. Zhu, Y., et al.: What to do next: modeling user behaviors by time-LSTM. In: Proceedings of the IJCAI, pp. 3602–3608 (2017)

    Google Scholar 

Download references

Acknowledgements

This work is supported by the project of National Key research and development plan (Grant No. 213) and the National Natural Science Foundation of China (Grant No. 61976160, No. 61673301), and Major project of Ministry of Public Security (Grant No. 20170004).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhihua Wei .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pang, Y., Zhang, Y., Tong, J., Wei, Z. (2020). Time-Aware Attentive Neural Network for News Recommendation with Long- and Short-Term User Representation. In: Li, G., Shen, H., Yuan, Y., Wang, X., Liu, H., Zhao, X. (eds) Knowledge Science, Engineering and Management. KSEM 2020. Lecture Notes in Computer Science(), vol 12275. Springer, Cham. https://doi.org/10.1007/978-3-030-55393-7_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-55393-7_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-55392-0

  • Online ISBN: 978-3-030-55393-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics