Skip to main content

Deep Learning for Recommender Systems

  • Chapter
  • First Online:
Recommender Systems Handbook

Abstract

Deep neural networks have been serving as the main driving force for the emergence of cutting-edge applications in many areas including computer vision, speech recognition, natural language processing, etc. In the meantime, deep neural networks based recommender systems have demonstrated impressive abilities in performance improvements, and have led to breakthroughs in some largely underexplored tasks. Examples are recommender systems with integrated multimodal/unstructured data and temporal dynamics. This chapter provides an overview of deep neural networks based recommender systems, with two aims. One is to explain how deep neural networks can be applied to recommendation tasks and the other is to review the recent progress in this field. Specifically, we begin with basic concepts and terminologies about deep neural networks and how they are applied to recommender systems. We then present an overview of the state-of-the-art deep learning based recommendation algorithms, and discuss their strengths and limitations. Finally, we provide an outlook on the future trends and directions which might lead to the next generation of recommender systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In this section, we mainly refer to categorical features.

  2. 2.

    Since there are a large body of related work on news recommendation, we refer readers to Sect. 4 for more details.

  3. 3.

    https://www.flickr.com/.

  4. 4.

    https://www.amazon.com/.

  5. 5.

    https://www.ebay.com/.

  6. 6.

    https://www.alibaba.com/.

  7. 7.

    Note that there is no guarantee that the listed methods are currently in use.

  8. 8.

    https://www.kaola.com/.

  9. 9.

    https://www.pinterest.com/.

  10. 10.

    https://www.yelp.com/.

  11. 11.

    https://foursquare.com/.

  12. 12.

    https://www.google.com/maps.

  13. 13.

    http://www.meituan.com/.

References

  1. M. An, F. Wu, C. Wu, K. Zhang, Z. Liu, X. Xie, Neural news recommendation with long- and short-term user representations, in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence (2019), pp. 336–345

    Google Scholar 

  2. S. Bai, J.Z. Kolter, V. Koltun, An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. Preprint, arXiv:1803.01271 (2018)

    Google Scholar 

  3. T. Bansal, D. Belanger, A. McCallum, Ask the GRU: multi-task learning for deep text recommendations, in Recsys, New York, NY (2016), pp. 107–114

    Google Scholar 

  4. O. Barkan, N. Koenigstein, Item2vec: neural item embedding for collaborative filtering, in 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP) (IEEE, Piscataway, 2016), pp. 1–6

    Google Scholar 

  5. R. van den Berg, T.N. Kipf, M. Welling, Graph convolutional matrix completion. CoRR abs/1706.02263 (2017). http://arxiv.org/abs/1706.02263

  6. H. Bharadhwaj, H. Park, B.Y. Lim, RecGAN: recurrent generative adversarial networks for recommendation systems, in Recsys (2018), pp. 372–376

    Google Scholar 

  7. S. Biswal, C. Xiao, L.M. Glass, E. Milkovits, J. Sun, Doctor2vec: dynamic doctor representation learning for clinical trial recruitment, in Proceedings of AAAI (2020), pp. 557–564

    Google Scholar 

  8. Y. Cen, J. Zhang, X. Zou, C. Zhou, H. Yang, J. Tang, Controllable multi-interest framework for recommendation, in Proceedings of SIGKDD (2020)

    Google Scholar 

  9. B. Chang, Y. Koh, D. Park, J. Kang, Content-aware successive point-of-interest recommendation, in Proceedings of the 2020 SIAM International Conference on Data Mining (SIAM, Philadelphia, 2020), pp. 100–108

    Google Scholar 

  10. C. Chen, M. Zhang, Y. Liu, S. Ma, Neural attentional rating regression with review-level explanations, in Proceedings of WWW, WWW ’18, Republic and Canton of Geneva, CHE (2018), pp. 1583–1592

    Google Scholar 

  11. H. Chen, X. Dai, H. Cai, W. Zhang, X. Wang, R. Tang, Y. Zhang, Y. Yu, Large-scale interactive recommendation with tree-structured policy gradient, in Proceedings of AAAI, vol. 33 (2019), pp. 3312–3320

    Google Scholar 

  12. M. Chen, A. Beutel, P. Covington, S. Jain, F. Belletti, E.H. Chi, Top-k off-policy correction for a reinforce recommender system, in Proceedings of WSDM, WSDM ’19 (Association for Computing Machinery, New York, 2019), p. 456–464

    Google Scholar 

  13. Q. Chen, H. Zhao, W. Li, P. Huang, W. Ou, Behavior sequence transformer for e-commerce recommendation in Alibaba, in Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data, DLP-KDD ’19, New York (2019)

    Google Scholar 

  14. W. Chen, P. Huang, J. Xu, X. Guo, C. Guo, F. Sun, C. Li, A. Pfadler, H. Zhao, B. Zhao, POG: personalized outfit generation for fashion recommendation at Alibaba iFashion, in Proceedings of SIGKDD, KDD ’19, New York (2019), pp. 2662–2670

    Google Scholar 

  15. X. Chen, H. Chen, H. Xu, Y. Zhang, Y. Cao, Z. Qin, H. Zha, Personalized fashion recommendation with visual explanations based on multimodal attention network: towards visually explainable recommendation, in Proceedings of SIGIR, SIGIR’19, New York (2019), pp. 765–774

    Google Scholar 

  16. X. Chen, H. Xu, Y. Zhang, J. Tang, Y. Cao, Z. Qin, H. Zha, Sequential recommendation with user memory networks, in Proceedings of WSDM (2018), pp. 108–116

    Google Scholar 

  17. X. Chen, Y. Zhang, Q. Ai, H. Xu, J. Yan, Z. Qin, Personalized key frame recommendation, in Proceedings of SIGIR, New York (2017), pp. 315–324

    Google Scholar 

  18. X. Chen, Y. Zhang, Z. Qin, Dynamic explainable recommendation based on neural attentive models, in Proceedings of AAAI, vol. 33 (2019), pp. 53–60

    Google Scholar 

  19. H.T. Cheng, L. Koc, J. Harmsen, T. Shaked, T. Chandra, H. Aradhye, G. Anderson, G. Corrado, W. Chai, M. Ispir et al., Wide & deep learning for recommender systems, in Proceedings of the 1st Workshop on Deep Learning for Recommender Systems (2016), pp. 7–10

    Google Scholar 

  20. Z. Cheng, Y. Ding, X. He, L. Zhu, X. Song, M. Kankanhalli, A3NCF: an adaptive aspect attention model for rating prediction, in Proceedings of IJCAI (2018), pp. 3748–3754

    Google Scholar 

  21. W.T. Chu, Y.L. Tsai, A hybrid recommendation system considering visual information for predicting favorite restaurants. WWW 20(6), 1313–1331 (2017)

    Google Scholar 

  22. J. Chung, C. Gulcehre, K. Cho, Y. Bengio, Empirical evaluation of gated recurrent neural networks on sequence modeling. Preprint, arXiv:1412.3555 (2014)

    Google Scholar 

  23. P. Covington, J. Adams, E. Sargin, Deep neural networks for youtube recommendations, in Proceedings of Recsys (2016), pp. 191–198

    Google Scholar 

  24. A. Creswell, T. White, V. Dumoulin, K. Arulkumaran, B. Sengupta, A.A. Bharath, Generative adversarial networks: an overview. IEEE Signal Process. Mag. 35(1), 53–65 (2018)

    Article  Google Scholar 

  25. M.F. Dacrema, P. Cremonesi, D. Jannach, Are we really making much progress? A worrying analysis of recent neural recommendation approaches, in Proceedings of the 13th ACM Conference on Recommender Systems (2019), pp. 101–109

    Google Scholar 

  26. J. Devlin, M.W. Chang, K. Lee, K. Toutanova, Bert: pre-training of deep bidirectional transformers for language understanding, in Proceedings of NAACL-HLT (2019)

    Google Scholar 

  27. T. Donkers, B. Loepp, J. Ziegler, Sequential user-based recurrent neural network recommendations, in Proceedings of Recsys (2017), pp. 152–160

    Google Scholar 

  28. W. Fan, Y. Ma, Q. Li, Y. He, E. Zhao, J. Tang, D. Yin, Graph neural networks for social recommendation, in Proceedings of WWW, New York (2019), pp. 417–426

    Google Scholar 

  29. Y. Feng, B. Hu, F. Lv, Q. Liu, Z. Zhang, W. Ou, ATBRG: adaptive target-behavior relational graph network for effective recommendation, in Proceedings of SIGIR (2020)

    Google Scholar 

  30. Y. Feng, F. Lv, W. Shen, M. Wang, F. Sun, Y. Zhu, K. Yang, Deep session interest network for click-through rate prediction, in International Joint Conferences on Artificial Intelligence Organization, IJCAI (2019), pp. 2301–2307

    Google Scholar 

  31. A. Fischer, C. Igel, An introduction to restricted Boltzmann machines, in Iberoamerican Congress on Pattern Recognition (Springer, New York, 2012), pp. 14–36

    Google Scholar 

  32. V. François-Lavet, P. Henderson, R. Islam, M.G. Bellemare, J. Pineau et al., An introduction to deep reinforcement learning. Found. Trends Mach. Learn. 11(3–4), 219–354 (2018)

    Article  Google Scholar 

  33. D.A. Galron, Y.M. Brovman, J. Chung, M. Wieja, P. Wang, Deep item-based collaborative filtering for sparse implicit feedback (2018)

    Google Scholar 

  34. X. Geng, H. Zhang, J. Bian, T.S. Chua, Learning image and user features for recommendation in social networks, in Proceedings of ICCV (2015), pp. 4274–4282

    Google Scholar 

  35. K. Georgiev, P. Nakov, A non-IID framework for collaborative filtering with restricted Boltzmann machines, in Proceedings of ICML (2013), pp. 1148–1156

    Google Scholar 

  36. I. Goodfellow, Y. Bengio, A. Courville, Deep Learning (MIT Press, 2016). https://www.deeplearningbook.org

  37. M. Grbovic, V. Radosavljevic, N. Djuric, N. Bhamidipati, J. Savla, V. Bhagwan, D. Sharp, E-commerce in your inbox: product recommendations at scale, in Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2015), pp. 1809–1818

    Google Scholar 

  38. A. Greenstein-Messica, L. Rokach, M. Friedman, Session-based recommendations using item embedding, in Proceedings of the 22nd International Conference on Intelligent User Interfaces (2017), pp. 629–633

    Google Scholar 

  39. X. Guan, Z. Cheng, X. He, Y. Zhang, Z. Zhu, Q. Peng, T.S. Chua, Attentive aspect modeling for review-aware recommendation. ACM Trans. Inf. Syst. 37(3) (2019)

    Google Scholar 

  40. H. Guo, R. Tang, Y. Ye, Z. Li, X. He, DeepFM: a factorization-machine based neural network for CTR prediction, in Proceedings of IJCAI (2017), pp. 1725–1731

    Google Scholar 

  41. X. Guo, C. Shi, C. Liu, Intention modeling from ordered and unordered facets for sequential recommendation, in Proceedings of WWW (2020), pp. 1127–1137

    Google Scholar 

  42. R. He, J. McAuley, Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering, in Proceedings of WWW, Republic and Canton of Geneva, CHE (2016), pp. 507–517

    Google Scholar 

  43. R. He, J. McAuley, VBPR: visual Bayesian personalized ranking from implicit Feedback, in Proceedings of AAAI (2016), pp. 144–150

    Google Scholar 

  44. X. He, T.S. Chua, Neural factorization machines for sparse predictive Analytics, in Proceedings of SIGIR (2017), pp. 355–364

    Google Scholar 

  45. X. He, X. Du, X. Wang, F. Tian, J. Tang, T.S. Chua, Outer product-based neural collaborative filtering, in Proceedings of IJCAI (2018), pp. 2227–2233

    Google Scholar 

  46. X. He, Z. He, X. Du, T.S. Chua, Adversarial personalized ranking for recommendation, in Proceedings of SIGIR, SIGIR ’18, New York (2018), pp. 355–364

    Google Scholar 

  47. X. He, L. Liao, H. Zhang, L. Nie, X. Hu, T.S. Chua, Neural collaborative filtering, in Proceedings of WWW (2017), pp. 173–182

    Google Scholar 

  48. B. Hidasi, A. Karatzoglou, Recurrent neural networks with top-k gains for session-based recommendations, in Proceedings of CIKM (2018), pp. 843–852

    Google Scholar 

  49. B. Hidasi, A. Karatzoglou, L. Baltrunas, D. Tikk, Session-based recommendations with recurrent neural networks. Preprint, arXiv:1511.06939 (2015)

    Google Scholar 

  50. B. Hidasi, M. Quadrana, A. Karatzoglou, D. Tikk, Parallel recurrent neural network architectures for feature-rich session-based recommendations, in Proceedings of Recsys (2016), pp. 241–248

    Google Scholar 

  51. G.E. Hinton, Deep belief networks. Scholarpedia 4(5), 5947 (2009)

    Google Scholar 

  52. S. Hochreiter, J. Schmidhuber, Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  53. C.K. Hsieh, L. Yang, Y. Cui, T.Y. Lin, S. Belongie, D. Estrin, Collaborative metric learning, in Proceedings of WWW (2017), pp. 193–201

    Google Scholar 

  54. L. Hu, S. Xu, C. Li, C. Yang, C. Shi, N. Duan, X. Xie, M. Zhou, Graph neural news recommendation with unsupervised preference disentanglement, in Proceedings of Association for Computational Linguistics (2020)

    Google Scholar 

  55. J. Huang, W.X. Zhao, H. Dou, J.R. Wen, E.Y. Chang, Improving sequential recommendation with knowledge-enhanced memory networks, in Proceedings of SIGIR, SIGIR ’18, New York (2018), pp. 505–514

    Google Scholar 

  56. Q. Huang, A. Jansen, L. Zhang, D.P.W. Ellis, R.A. Saurous, J. Anderson, Large-scale weakly-supervised content embeddings for music recommendation and tagging, in ICASSP 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2020), pp. 8364–8368

    Google Scholar 

  57. X. Huang, Q. Fang, S. Qian, J. Sang, Y. Li, C. Xu, Explainable interaction-driven user modeling over knowledge graph for sequential recommendation, in Proceedings of the 27th ACM International Conference on Multimedia, MM ’19, New York (2019), pp. 548–556

    Google Scholar 

  58. X. Huang, S. Qian, Q. Fang, J. Sang, C. Xu, CSAN: contextual self-attention network for user sequential recommendation, in Proceedings of the 26th ACM International Conference on Multimedia (2018), pp. 447–455

    Google Scholar 

  59. Y. Ji, A. Sun, J. Zhang, C. Li, A re-visit of the popularity baseline in recommender systems, in Proceedings of SIGIR (2020), pp. 1749–1752

    Google Scholar 

  60. W.C. Kang, E. Kim, J. Leskovec, C. Rosenberg, J. McAuley, Complete the look: scene-based complementary product recommendation, in Proceedings of CVPR (2019)

    Google Scholar 

  61. W.C. Kang, J. McAuley, Self-attentive sequential recommendation. in Proceedings of ICDM (IEEE, Piscataway, 2018), pp. 197–206

    Google Scholar 

  62. D. Kim, C. Park, J. Oh, S. Lee, H. Yu, Convolutional matrix factorization for document context-aware recommendation, in Proceedings of Recsys, New York (2016), pp. 233–240

    Google Scholar 

  63. T.N. Kipf, M. Welling, Semi-supervised classification with graph convolutional networks. Preprint, arXiv:1609.02907 (2016)

    Google Scholar 

  64. Y. Koren, R. Bell, C. Volinsky, Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)

    Article  Google Scholar 

  65. W. Krichene, S. Rendle, On sampled metrics for item recommendation, in Proceedings of SIGKDD, KDD ’20, New York (2020), pp. 1748–1757

    Google Scholar 

  66. T. Lake, S.A. Williamson, A.T. Hawk, C.C. Johnson, B.P. Wing, Large-scale collaborative filtering with product embeddings. Preprint, arXiv:1901.04321 (2019)

    Google Scholar 

  67. H. Lee, Y. Ahn, H. Lee, S. Ha, S.g. Lee, Quote recommendation in dialogue using deep neural network, in Proceedings of SIGIR, New York (2016), pp. 957–960

    Google Scholar 

  68. J. Lee, S. Abu-El-Haija, B. Varadarajan, A.P. Natsev, Collaborative deep metric learning for video understanding, in Proceedings of SIGKDD, New York (2018), pp. 481–490

    Google Scholar 

  69. C. Lei, D. Liu, W. Li, Z.J. Zha, H. Li, Comparative deep learning of hybrid representations for image recommendations, in Proceedings of CVPR (2016)

    Google Scholar 

  70. C. Li, Z. Liu, M. Wu, Y. Xu, H. Zhao, P. Huang, G. Kang, Q. Chen, W. Li, D.L. Lee, Multi-interest network with dynamic routing for recommendation at Tmall, in Proceedings of CIKM, CIKM ’19, New York (2019), pp. 2615–2623

    Google Scholar 

  71. J. Li, P. Ren, Z. Chen, Z. Ren, T. Lian, J. Ma, Neural attentive session-based recommendation, in Proceedings of CIKM (2017), pp. 1419–1428

    Google Scholar 

  72. L. Li, L. Chen, Y. Zhang, Towards controllable explanation generation for recommender systems via neural template, in Proceedings of WWW, WWW ’20, New York (2020), pp. 198–202

    Google Scholar 

  73. P. Li, Z. Wang, Z. Ren, L. Bing, W. Lam, Neural rating regression with abstractive tips generation for recommendation, in Proceedings of SIGIR, SIGIR ’17, New York (2017), pp. 345–354

    Google Scholar 

  74. J. Lian, X. Zhou, F. Zhang, Z. Chen, X. Xie, G. Sun, xDeepFM: combining explicit and implicit feature interactions for recommender systems, in Proceedings of SIGKDD (2018), pp. 1754–1763

    Google Scholar 

  75. F. Liu, H. Guo, X. Li, R. Tang, Y. Ye, X. He, End-to-end deep reinforcement learning based recommendation with supervised embedding, in Proceedings of WSDM, WSDM ’20, New York (2020), pp. 384–392

    Google Scholar 

  76. Q. Liu, S. Wu, L. Wang, Deepstyle: learning user preferences for visual recommendation, in Proceedings of SIGIR, New York (2017), pp. 841–844

    Google Scholar 

  77. Q. Liu, S. Wu, L. Wang, T. Tan, Predicting the next location: a recurrent model with spatial and temporal contexts, in Thirtieth AAAI Conference on Artificial Intelligence (2016)

    Google Scholar 

  78. M. Ludewig, D. Jannach, Evaluation of session-based recommendation algorithms. User Model. User-Adapted Interact. 28(4–5), 331–390 (2018)

    Article  Google Scholar 

  79. C. Ma, P. Kang, X. Liu, Hierarchical gating networks for sequential recommendation, in Proceedings of SIGKDD (2019), pp. 825–833

    Google Scholar 

  80. J. Ma, C. Zhou, P. Cui, H. Yang, W. Zhu, Learning disentangled representations for recommendation, in Proceeding of NeurIPS, ed. by H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, R. Garnett (Curran Associates, Red Hook, 2019), pp. 5711–5722

    Google Scholar 

  81. J. McAuley, C. Targett, Q. Shi, A. van den Hengel, Image-based recommendations on styles and substitutes, in Proceeding of SIGIR, New York (2015), pp. 43–52

    Google Scholar 

  82. T. Mikolov, K. Chen, G. Corrado, J. Dean, Efficient estimation of word representations in vector space. Preprint, arXiv:1301.3781 (2013)

    Google Scholar 

  83. F. Monti, M. Bronstein, X. Bresson, Geometric matrix completion with recurrent multi-graph neural networks, in Advances in Neural Information Processing Systems, ed. by I. Guyon, U.V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, R. Garnett (Curran Associates, Red Hook, 2017), pp. 3697–3707

    Google Scholar 

  84. W. Niu, J. Caverlee, H. Lu, Neural personalized ranking for image recommendation, in Proceedings of WSDM, New York (2018), pp. 423–431

    Google Scholar 

  85. A. van den Oord, S. Dieleman, B. Schrauwen, Deep content-based music recommendation, in Advances in Neural Information Processing Systems, ed. by C.J.C. Burges, L. Bottou, M. Welling, Z. Ghahramani, K.Q. Weinberger (2013), pp. 2643–2651

    Google Scholar 

  86. F. Pan, S. Li, X. Ao, P. Tang, Q. He, Warm up cold-start advertisements: improving CTR predictions via learning to learn ID embeddings, in Proceedings of SIGIR, SIGIR’19, New York (2019), pp. 695–704

    Google Scholar 

  87. R. Qiu, Z. Huang, J. Li, H. Yin, Exploiting cross-session information for session-based recommendation with graph neural networks. ACM Trans. Inf. Syst. 38(3), 1–23 (2020)

    Article  Google Scholar 

  88. S. Rendle, W. Krichene, L. Zhang, J. Anderson, Neural collaborative filtering vs. matrix factorization revisited. Preprint, arXiv:2005.09683 (2020)

    Google Scholar 

  89. S. Rendle, W. Krichene, L. Zhang, J. Anderson, Neural collaborative filtering vs. matrix factorization revisited, in Fourteenth ACM Conference on Recommender Systems, RecSys ’20, New York (2020), pp. 240–248

    Google Scholar 

  90. S. Sabour, N. Frosst, G.E. Hinton, Dynamic routing between capsules, in Proceedings of NeurIPS (2017), pp. 3856–3866

    Google Scholar 

  91. R. Salakhutdinov, A. Mnih, G. Hinton, Restricted Boltzmann machines for collaborative filtering, in Proceedings of ICML (2007), pp. 791–798

    Google Scholar 

  92. B. Sarwar, G. Karypis, J. Konstan, J. Riedl, Item-based collaborative filtering recommendation algorithms, in Proceedings of WWW (2001), pp. 285–295

    Google Scholar 

  93. S. Sedhain, A.K. Menon, S. Sanner, L. Xie, Autorec: autoencoders meet collaborative filtering, in Proceedings of WWW, WWW ’15 Companion, New York (2015), pp. 111–112

    Google Scholar 

  94. S. Seo, J. Huang, H. Yang, Y. Liu, Interpretable convolutional neural networks with dual local and global attention for review rating prediction, in Proceedings of Recsys, New York (2017), pp. 297–305

    Google Scholar 

  95. J. Shang, T. Ma, C. Xiao, J. Sun, Pre-training of graph augmented transformers for medication recommendation, in Proceedings of IJCAI (2019), pp. 5953–5959

    Google Scholar 

  96. J. Shang, C. Xiao, T. Ma, H. Li, J. Sun, Gamenet: graph augmented memory networks for recommending medication combination, in Proceedings of AAAI, vol. 33 (2019), pp. 1126–1133

    Google Scholar 

  97. W. Song, Z. Xiao, Y. Wang, L. Charlin, M. Zhang, J. Tang, Session-based social recommendation via dynamic graph attention networks, in Proceedings of WSDM, New York (2019), pp. 555–563

    Google Scholar 

  98. G. de Souza Pereira Moreira, F. Ferreira, A.M. da Cunha, News session-based recommendations using deep neural networks, in Proceedings of the 3rd Workshop on Deep Learning for Recommender Systems (2018), pp. 15–23

    Google Scholar 

  99. F. Sun, J. Liu, J. Wu, C. Pei, X. Lin, W. Ou, P. Jiang, Bert4rec: sequential recommendation with bidirectional encoder representations from transformer, in Proceedings of CIKM (2019), pp. 1441–1450

    Google Scholar 

  100. J. Tan, X. Wan, J. Xiao, A neural network approach to quote recommendation in writings, in Proceedings of CIKM, New York (2016), pp. 65–74

    Google Scholar 

  101. J. Tang, F. Belletti, S. Jain, M. Chen, A. Beutel, C. Xu, H. Chi, E.: Towards neural mixture recommender for long range dependent user sequences, in Proceedings of WWW (2019), pp. 1782–1793

    Google Scholar 

  102. J. Tang, X. Du, X. He, F. Yuan, Q. Tian, T. Chua, Adversarial training towards robust multimedia recommender system. IEEE Trans. Knowl. Data Eng. 32(5), 855–867 (2020)

    Article  Google Scholar 

  103. J. Tang, K. Wang, Personalized top-n sequential recommendation via convolutional sequence embedding, in Proceedings of WSDM (2018), pp. 565–573

    Google Scholar 

  104. Y. Tay, L. Anh Tuan, S.C. Hui, Latent relational metric learning via memory-based attention for collaborative ranking, in Proceedings of WWW (2018), pp. 729–739

    Google Scholar 

  105. Y. Tay, A.T. Luu, S.C. Hui, Multi-pointer co-attention networks for recommendation, in Proceedings of SIGKDD, New York (2018), pp. 2309–2318

    Google Scholar 

  106. Y. Tay, L.A. Tuan, S.C. Hui, Couplenet: paying attention to couples with coupled attention for relationship recommendation, in Twelfth International AAAI Conference on Web and Social Media (2018)

    Google Scholar 

  107. Y. Tay, S. Zhang, A.T. Luu, S.C. Hui, L. Yao, T.D.Q. Vinh, Holographic factorization machines for recommendation, in Proceedings of AAAI, vol. 33 (2019), pp. 5143–5150

    Google Scholar 

  108. T.X. Tuan, T.M. Phuong, 3D convolutional networks for session-based recommendation with content features, in Proceedings of RecSys, New York (2017), pp. 138–146

    Google Scholar 

  109. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, Ł. Kaiser, I. Polosukhin, Attention is all you need, in Proceedings of NeurIPS (2017), pp. 5998–6008

    Google Scholar 

  110. P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, Y. Bengio, Graph attention networks. Preprint, arXiv:1710.10903 (2017)

    Google Scholar 

  111. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, P.A. Manzagol, L. Bottou, Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11(12), 3371–3408 (2010)

    MathSciNet  MATH  Google Scholar 

  112. L. Vinh Tran, Y. Tay, S. Zhang, G. Cong, X. Li, Hyperml: a boosting metric learning approach in hyperbolic space for recommender systems, in Proceedings of WSDM (2020), pp. 609–617

    Google Scholar 

  113. M. Volkovs, G. Yu, T. Poutanen, Dropoutnet: addressing cold start in recommender systems, in Proceedings of NIPS, ed. by I. Guyon, U.V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, R. Garnett (Curran Associates, Red Hook, 2017), pp. 4957–4966

    Google Scholar 

  114. H. Wang, N. Wang, D.Y. Yeung, Collaborative deep learning for recommender systems, in Proceedings of SIGKDD, New York (2015), p. 1235–1244

    Google Scholar 

  115. H. Wang, F. Wu, Z. Liu, X. Xie, Fine-grained interest matching for neural news recommendation, in Proceedings of ACL (2020), pp. 836–845

    Google Scholar 

  116. H. Wang, F. Zhang, M. Zhang, J. Leskovec, M. Zhao, W. Li, Z. Wang, Knowledge-aware graph neural networks with label smoothness regularization for recommender systems, in Proceedings of SIGKDD, New York (2019), pp. 968–977

    Google Scholar 

  117. H. Wang, M. Zhao, X. Xie, W. Li, M. Guo, Knowledge graph convolutional networks for recommender systems, in Proceedings of WWW, New York (2019), pp. 3307–3313

    Google Scholar 

  118. R. Wang, B. Fu, G. Fu, M. Wang, Deep & cross network for ad click predictions, in Proceedings of the ADKDD’17, New York (2017)

    Google Scholar 

  119. S. Wang, Y. Wang, J. Tang, K. Shu, S. Ranganath, H. Liu, What your images reveal: exploiting visual contents for point-of-interest recommendation, in Proceedings of WWW (2017), pp. 391–400

    Google Scholar 

  120. X. Wang, X. He, M. Wang, F. Feng, T.S. Chua, Neural graph collaborative filtering, in Proceedings of SIGIR, New York (2019), pp. 165–174.

    Google Scholar 

  121. X. Wang, Y. Wang, Improving content-based and hybrid music recommendation using deep learning, in Proceedings of the 22nd ACM International Conference on Multimedia, New York (2014), pp. 627–636

    Google Scholar 

  122. C. Wu, F. Wu, M. An, T. Qi, J. Huang, Y. Huang, X. Xie, Neural news recommendation with heterogeneous user behavior, in Proceedings of EMNLP-IJCNLP (Association for Computational Linguistics, Hong Kong, 2019), pp. 4874–4883

    Google Scholar 

  123. C. Wu, F. Wu, S. Ge, T. Qi, Y. Huang, X. Xie, Neural news recommendation with multi-head self-attention, in Proceedings of EMNLP-IJCNLP (2019), pp. 6390–6395

    Google Scholar 

  124. C.Y. Wu, A. Ahmed, A. Beutel, A.J. Smola, H. Jing, Recurrent recommender networks, in Proceedings of WSDM (2017), pp. 495–503

    Google Scholar 

  125. S. Wu, W. Ren, C. Yu, G. Chen, D. Zhang, J. Zhu, Personal recommendation using deep recurrent neural networks in NetEase, in Proceedings of ICDE (IEEE, Piscataway, 2016), pp. 1218–1229

    Google Scholar 

  126. S. Wu, Y. Tang, Y. Zhu, L. Wang, X. Xie, T. Tan, Session-based recommendation with graph neural networks, in Proceedings of AAAI, vol. 33 (2019), pp. 346–353

    Google Scholar 

  127. Y. Wu, C. DuBois, A.X. Zheng, M. Ester, Collaborative denoising auto-encoders for top-n recommender systems, in Proceedings of WSDM, New York (2016), pp. 153–162

    Google Scholar 

  128. Y. Xian, Z. Fu, S. Muthukrishnan, G. de Melo, Y. Zhang, Reinforcement knowledge graph reasoning for explainable recommendation, in Proceedings of SIGIR, SIGIR’19, New York (2019), pp. 285–294

    Google Scholar 

  129. J. Xiao, H. Ye, X. He, H. Zhang, F. Wu, T.S. Chua, Attentional factorization machines: learning the weight of feature interactions via attention networks, in Proceedings of IJCAI (2017), pp. 3119–3125

    Google Scholar 

  130. C. Xu, M. Wu, Learning feature interactions with Lorentzian factorization machine, in Proceedings of AAAI (2019)

    Google Scholar 

  131. D. Xu, C. Ruan, E. Korpeoglu, S. Kumar, K. Achan, Self-attention with functional time representation learning, in Proceedings of NeurIPS (2019), pp. 15915–15925

    Google Scholar 

  132. H.J. Xue, X. Dai, J. Zhang, S. Huang, J. Chen, Deep matrix factorization models for recommender systems, in Proceedings of IJCAI (2017), pp. 3203–3209

    Google Scholar 

  133. A. Yan, S. Cheng, W.C. Kang, M. Wan, J. McAuley, Cosrec: 2d convolutional neural networks for sequential recommendation, in Proceedings of CIKM (2019), pp. 2173–2176

    Google Scholar 

  134. C. Yang, L. Bai, C. Zhang, Q. Yuan, J. Han, Bridging collaborative filtering and semi-supervised learning: a neural approach for poi recommendation. in Proceedings of SIGKDD, KDD ’17, New York (2017), pp. 1245–1254

    Google Scholar 

  135. J. Yang, X. Yi, D. Zhiyuan Cheng, L. Hong, Y. Li, S. Xiaoming Wang, T. Xu, E.H. Chi, Mixed negative sampling for learning two-tower neural networks in recommendations, in Companion Proceedings of the Web Conference 2020 (2020), pp. 441–447

    Google Scholar 

  136. L. Yao, Y. Zhang, Y. Feng, D. Zhao, R. Yan, Towards implicit content-introducing for generative short-text conversation systems. in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (Association for Computational Linguistics, Copenhagen, 2017), pp. 2190–2199

    Google Scholar 

  137. Q. Yao, X. Chen, J.T. Kwok, Y. Li, C.J. Hsieh, Efficient neural interaction function search for collaborative filtering. in Proceedings of WWW (2020), pp. 1660–1670

    Google Scholar 

  138. R. Ying, R. He, K. Chen, P. Eksombatchai, W.L. Hamilton, J. Leskovec, Graph convolutional neural networks for web-scale recommender systems, in Proceedings of SIGKDD, New York (2018), pp. 974–983

    Google Scholar 

  139. J. You, Y. Wang, A. Pal, P. Eksombatchai, C. Rosenburg, J. Leskovec, Hierarchical temporal convolutional networks for dynamic recommender systems, in Proceedings of WWW (2019), pp. 2236–2246

    Google Scholar 

  140. W. Yu, H. Zhang, X. He, X. Chen, L. Xiong, Z. Qin, Aesthetic-based clothing recommendation, in Proceedings of WWW, Republic and Canton of Geneva, CHE (2018), pp. 649–658

    Google Scholar 

  141. F. Yuan, L. Yao, B. Benatallah, Adversarial collaborative neural network for robust recommendation, in Proceedings of SIGIR, SIGIR’19, New York (2019), pp. 1065–1068

    Google Scholar 

  142. J. Zhang, X. Shi, S. Zhao, I. King, Star-GCN: stacked and reconstructed graph convolutional networks for recommender systems, in Proceedings of IJCAI (AAAI Press, Palo Alto, 2019), pp. 4264–4270

    Google Scholar 

  143. M. Zhang, Y. Chen, Inductive matrix completion based on graph neural networks. Preprint, arXiv:1904.12058 (2019)

    Google Scholar 

  144. S. Zhang, H. Liu, A. Zhang, Y. Hu, C. Zhang, Y. Li, T. Zhu, S. He, W. Ou, Learning user representations with hypercuboids for recommender systems, in Proceedings of the 14th ACM International Conference on Web Search and Data Mining (2020)

    Google Scholar 

  145. S. Zhang, Y. Tay, W. Jiang, D.c. Juan, C. Zhang, Switch spaces: learning product spaces with sparse gating. Preprint, arXiv:2102.08688 (2021)

    Google Scholar 

  146. S. Zhang, Y. Tay, L. Yao, A. Sun, J. An, Next item recommendation with self-attentive metric learning. in AAAI Workshop, vol. 9 (2019)

    Google Scholar 

  147. S. Zhang, L. Yao, A. Sun, Y. Tay, Deep learning based recommender system: a survey and new perspectives. ACM Comput. Surv. 52(1), 1–38 (2019)

    Article  Google Scholar 

  148. S. Zhang, L. Yao, A. Sun, S. Wang, G. Long, M. Dong, Neurec: on nonlinear transformation for personalized ranking, in Proceedings of IJCAI (2018), pp. 3669–3675

    Google Scholar 

  149. S. Zhang, L. Yao, L. Vinh Tran, A. Zhang, Y. Tay, Quaternion collaborative filtering for recommendation, in Proceedings of IJCAI (2019), pp. 4313–4319

    Google Scholar 

  150. T. Zhang, P. Zhao, Y. Liu, V.S. Sheng, J. Xu, D. Wang, G. Liu, X. Zhou, Feature-level deeper self-attention network for sequential recommendation, in Proceedings of IJCAI (2019), pp. 4320–4326

    Google Scholar 

  151. P. Zhao, H. Zhu, Y. Liu, J. Xu, Z. Li, F. Zhuang, V.S. Sheng, X. Zhou, Where to go next: a spatio-temporal gated network for next poi recommendation. in Proceedings of AAAI, vol. 33 (2019), pp. 5877–5884

    Google Scholar 

  152. X. Zhao, L. Xia, L. Zhang, Z. Ding, D. Yin, J. Tang, Deep reinforcement learning for page-wise recommendations, in Proceedings of Recsys, RecSys ’18 (Association for Computing Machinery, New York, 2018), pp. 95–103

    Google Scholar 

  153. X. Zhao, L. Zhang, Z. Ding, L. Xia, J. Tang, D. Yin, Recommendations with negative feedback via pairwise deep reinforcement learning, in Proceedings of SIGKDD, KDD ’18, New York (2018), pp. 1040–1048

    Google Scholar 

  154. G. Zheng, F. Zhang, Z. Zheng, Y. Xiang, N.J. Yuan, X. Xie, Z. Li, DRN: a deep reinforcement learning framework for news recommendation. in Proceedings of WWW (2018), pp. 167–176

    Google Scholar 

  155. L. Zheng, V. Noroozi, P.S. Yu, Joint deep modeling of users and items using reviews for recommendation, in Proceedings of WSDM, New York (2017), pp. 425–434

    Google Scholar 

  156. C. Zhou, J. Bai, J. Song, X. Liu, Z. Zhao, X. Chen, J. Gao, Atrank: an attention-based user behavior modeling framework for recommendation, in Proceedings of AAAI (2018)

    Google Scholar 

  157. G. Zhou, X. Zhu, C. Song, Y. Fan, H. Zhu, X. Ma, Y. Yan, J. Jin, H. Li, K. Gai, Deep interest network for click-through rate prediction, in Proceedings of SIGKDD (2018), pp. 1059–1068

    Google Scholar 

  158. X. Zhou, C. Mascolo, Z. Zhao, Topic-enhanced memory networks for personalised point-of-interest recommendation, in Proceedings of SIGKDD (2019), pp. 3018–3028

    Google Scholar 

  159. L. Zou, L. Xia, P. Du, Z. Zhang, T. Bai, W. Liu, J.Y. Nie, D. Yin, Pseudo Dyna-Q: a reinforcement learning framework for interactive recommendation, in Proceedings of WSDM, WSDM ’20, New York (2020), pp. 816–824

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Shuai Zhang or Ce Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Science+Business Media, LLC, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Zhang, S., Tay, Y., Yao, L., Sun, A., Zhang, C. (2022). Deep Learning for Recommender Systems. In: Ricci, F., Rokach, L., Shapira, B. (eds) Recommender Systems Handbook. Springer, New York, NY. https://doi.org/10.1007/978-1-0716-2197-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-0716-2197-4_5

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-0716-2196-7

  • Online ISBN: 978-1-0716-2197-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics