Tim Donkers
Benedikt Loepp
ABSTRACT
Recurrent Neural Networks are powerful tools for modeling sequences. They are flexibly extensible and can incorporate various kinds of information including temporal order. These properties make them well suited for generating sequential recommendations. In this paper, we extend Recurrent Neural Networks by considering unique characteristics of the Recommender Systems domain. One of these characteristics is the explicit notion of the user recommendations are specifically generated for. We show how individual users can be represented in addition to sequences of consumed items in a new type of Gated Recurrent Unit to effectively produce personalized next item recommendations. Offline experiments on two real-world datasets indicate that our extensions clearly improve objective performance when compared to state-of-the-art recommender algorithms and to a conventional Recurrent Neural Network.
- L. Baltrunas and X. Amatriain. 2009. Towards time-dependant recommendation based on implicit feedback. In CARS '09.Google Scholar
- Y. Bengio, P. Frasconi, and P. Simard. 1993. The problem of learning long-term dependencies in recurrent networks. In ICNN '93. IEEE, 1183--1188.Google Scholar
- G. Bonnin and D. Jannach. 2015. Automated generation of music playlists: Survey and experiments. ACM Comput Surv 47, 2 (2015), 26:1--26:35. Google ScholarDigital Library
- P. G. Campos, F. Díez, and I. Cantador. 2014. Time-aware recommender systems: A comprehensive survey and analysis of existing evaluation protocols. User Model User-Adap 24, 1-2 (2014), 67--119. Google ScholarDigital Library
- K. Cho, B. Van Merriënboer, D. Bahdanau, and Y. Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. In SSST '14.Google Scholar
- J. Chung, C. Gulcehre, K. Cho, and Y. Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. In Deep Learning Workshop at NIPS '14.Google Scholar
- Y. Ding and X. Li. 2005. Time weight collaborative filtering. In CIKM '05. ACM, 485--492. Google ScholarDigital Library
- S. El Hihi and Y. Bengio. 1995. Hierarchical recurrent neural networks for long-term dependencies. In NIPS '95. 493--499. Google ScholarDigital Library
- F. Gers. 2001. Long short-term memory in recurrent neural networks. Ph.D. Dissertation. University of Hannover.Google Scholar
- I. Goodfellow, Y. Bengio, and A. Courville. 2016. Deep learning. MIT Press. Google ScholarDigital Library
- A. Graves. 2013. Generating sequences with recurrent neural networks. (2013).Google Scholar
- A. Graves, A. Mohamed, and G. Hinton. 2013. Speech recognition with deep recurrent neural networks. In ICASSP '13. IEEE, 6645-- 6649.Google Scholar
- A. Greenstein-Messica, L. Rokach, and M. Friedman. 2017. Session-based recommendations using item embedding. In IUI '17. ACM, 629--633. Google ScholarDigital Library
- A. Gunawardana and G. Shani. 2009. A survey of accuracy evaluation metrics of recommendation tasks. J Mach Learn Res 10 (2009), 2935--2962. Google ScholarDigital Library
- K. He, X. Zhang, S. Ren, and J. Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In ICCV '15. 1026--1034. Google ScholarDigital Library
- K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In CVPR '16. IEEE, 770--778.Google Scholar
- C. Hermann. 2010. Time-based recommendations for lecture materials. In EdMedia '10. 1028--1033.Google Scholar
- B. Hidasi, A. Karatzoglou, L. Baltrunas, and D. Tikk. 2015. Session-based recommendations with recurrent neural networks. In ICLR '16.Google Scholar
- B. Hidasi, M. Quadrana, A. Karatzoglou, and D. Tikk. 2016. Parallel recurrent neural network architectures for feature-rich session-based recommendations. In RecSys '16. ACM, 241--248. Google ScholarDigital Library
- S. Hochreiter and J. Schmidhuber. 1997. Long short-term memory. Neural Comput 9, 8 (1997), 1735--1780. Google ScholarDigital Library
- T. Hofmann. 2001. Unsupervised learning by probabilistic latent semantic analysis. Mach Learn 42, 1-2 (2001), 177--196.Google ScholarCross Ref
- T. Hussein, T. Linder, W. Gaulke, and J. Ziegler. 2014. Hybreed: A software framework for developing context-aware hybrid recommender systems. User Model User-Adap 24, 1-2 (2014), 121--174. Google ScholarDigital Library
- A. Karatzoglou. 2011. Collaborative temporal order modeling. In RecSys '11. ACM, 313--316. Google ScholarDigital Library
- A. Karatzoglou, X. Amatriain, L. Baltrunas, and N. Oliver. 2010. Multiverse recommendation: N-dimensional tensor factorization for context-aware collaborative filtering. In RecSys '10. ACM, 79--86. Google ScholarDigital Library
- D. Kingma and J. Ba. 2015. Adam: A method for stochastic optimization. In ICLR '15.Google Scholar
- R. Klinkenberg and T. Joachims. 2000. Detecting concept drift with support vector machines. In ICML '00. Morgan Kaufmann, 487--494. Google ScholarDigital Library
- Y. Koren. 2010. Collaborative filtering with temporal dynamics. Commun ACM 53, 4 (2010), 89--97. Google ScholarDigital Library
- Y. Koren and R. Bell. 2015. Recommender systems handbook. Springer, Chapter Advances in collaborative filtering, 77--118.Google Scholar
- Y. Koren, R. Bell, and C. Volinsky. 2009. Matrix factorization techniques for recommender systems. IEEE Computer 42, 8 (2009), 30--37. Google ScholarDigital Library
- A. Krizhevsky, I. Sutskever, and G. E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS '12. 1097--1105. Google ScholarDigital Library
- Z. C. Lipton, J. Berkowitz, and C. Elkan. 2015. A critical review of recurrent neural networks for sequence learning. (2015).Google Scholar
- T. Mikolov, K. Chen, G. Corrado, and J. Dean. 2013. Efficient estimation of word representations in vector space. Workshop at ICLR '13.Google Scholar
- T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. 2013. Distributed representations of words and phrases and their compositionality. In NIPS '13. 3111--3119. Google ScholarDigital Library
- T. Mikolov and G. Zweig. 2012. Context dependent recurrent neural network language model. In SLT '12. 234--239.Google Scholar
- O. Nasraoui, J. Cerwinske, C. Rojas, and F. Gonzalez. 2007. Performance of recommendation systems in dynamic streaming environments. In SDM '07. SIAM, 569--574.Google Scholar
- R. Pascanu, C. Gulcehre, K. Cho, and Y. Bengio. 2014. How to construct deep recurrent neural networks. In ICLR '14.Google Scholar
- D. M. Powers. 2011. Evaluation: From precision, recall and Fmeasure to ROC, informedness, markedness and correlation. J Mach Learn Tech 2, 1 (2011), 37--63.Google ScholarCross Ref
- S. Rallapalli, L. Qiu, Y. Zhang, and Y.-C. Chen. 2010. Exploiting temporal stability and low-rank structure for localization in mobile networks. In MobiCom '10. ACM, 161--172. Google ScholarDigital Library
- S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In UAI '09. AUAI Press, 452--461. Google ScholarDigital Library
- S. Rendle, C. Freudenthaler, and L. Schmidt-Thieme. 2010. Factorizing personalized Markov chains for next-basket recommendation. In WWW '10. ACM, 811--820. Google ScholarDigital Library
- F. Ricci, L. Rokach, and B. Shapira. 2015. Recommender systems handbook (2nd ed.). Springer. Google ScholarDigital Library
- N. Sahoo, P. V. Singh, and T. Mukhopadhyay. 2012. A hidden Markov model for collaborative filtering. MIS Quarterly 36, 4 (2012), 1329--1356. Google ScholarCross Ref
- R. Salakhutdinov, A. Mnih, and G. E. Hinton. 2007. Restricted Boltzmann machines for collaborative filtering. In ICML '07. ACM, 791--798. Google ScholarDigital Library
- J. Schmidhuber. 1992. Learning complex, extended sequences using the principle of history compression. Neural Comput 4, 2 (1992), 234--242. Google ScholarDigital Library
- J. Schmidhuber. 2015. Deep learning in neural networks: An overview. Neural Networks 61 (2015), 85--117. Google ScholarDigital Library
- H. Soh, S. Sanner, M. White, and G. Jamieson. 2017. Deep sequential recommendation for personalized adaptive user interfaces. In IUI '17. ACM, 589--593. Google ScholarDigital Library
- C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. Going deeper with convolutions. In CVPR '15. IEEE, 1--9.Google Scholar
- Y. K. Tan, X. Xu, and Y. Liu. 2016. Improved recurrent neural networks for session-based recommendations. In DLRS '16. ACM, 17--22. Google ScholarDigital Library
- A. van den Oord, S. Dieleman, and B. Schrauwen. 2013. Deep content-based music recommendation. In NIPS '13. 2643--2651. Google ScholarDigital Library
- J. Vinagre, A. M. Jorge, and J. Gama. 2015. An overview on the exploitation of time in collaborative filtering. Data Min Knowl Disc 5, 5 (2015), 195--215. Google ScholarDigital Library
- E. M. Voorhees. 1999. The TREC-8 question answering track report. In TREC '99. 77--82.Google Scholar
- H. Wang, N. Wang, and D.-Y. Yeung. 2015. Collaborative deep learning for recommender systems. In KDD '15. ACM, 1235--1244. Google ScholarDigital Library
- C. Wu, J. Wang, J. Liu, and W. Liu. 2016. Recurrent neural network based recommendation for time heterogenous feedback. Knowl-Based Syst 109 (2016), 90--103. Google ScholarDigital Library
- C.-Y. Wu, A. Ahmed, A. Beutel, A. J. Smola, and H. Jing. 2017. Recurrent recommender networks. In WSDM '17. ACM, 495--503. Google ScholarDigital Library
- L. Xiong, X. Chen, T.-K. Huang, J. Schneider, and J. Carbonell. 2010. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In SDM '10. SIAM, 211--222.Google Scholar
- Z. Xu, C. Chen, T. Lukasiewicz, Y. Miao, and X. Meng. 2016. Tag-aware personalized recommendation using a deep-semantic similarity model with negative sampling. In CIKM '16. ACM, 1921--1924. Google ScholarDigital Library
- H.-F. Yu, N. Rao, and I. S. Dhillon. 2015. High-dimensional time series prediction with missing values. (2015).Google Scholar
- W. Zaremba, I. Sutskever, and O. Vinyals. 2014. Recurrent neural network regularization. (2014).Google Scholar
Index Terms
- Sequential User-based Recurrent Neural Network Recommendations
Recommendations
Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks
RecSys '17: Proceedings of the Eleventh ACM Conference on Recommender SystemsSession-based recommendations are highly relevant in many modern on-line services (e.g. e-commerce, video streaming) and recommendation settings. Recently, Recurrent Neural Networks have been shown to perform very well in session-based settings. While ...
News Session-Based Recommendations using Deep Neural Networks
DLRS 2018: Proceedings of the 3rd Workshop on Deep Learning for Recommender SystemsNews recommender systems are aimed to personalize users experiences and help them to discover relevant articles from a large and dynamic search space. Therefore, news domain is a challenging scenario for recommendations, due to its sparse user profiling,...
Combining User-Based and Session-Based Recommendations with Recurrent Neural Networks
Neural Information ProcessingAbstractRecommender systems generate recommendations based on user profiles, which consist of past interactions of users with items. When user profiles are not available, session-based recommendation can be used instead to make predictions based on ...
Comments