Abstract
With the growth of online information, varying personalization drifts and volatile behaviors of internet users, recommender systems are effective tools for information filtering to overcome the information overload problem. Recommender systems utilize rating prediction approaches i.e. predicting the rating that a user will give to a particular item, to generate ranked lists of items according to the preferences of each user in order to make personalized recommendations. Although previous recommendation systems are effective in creating attired recommendations, however, they still suffer from different types of challenges such as accuracy, scalability, cold-start, and data sparsity. In the last few years, deep learning has attained substantial interest in various research areas such as computer vision, speech recognition, and natural language processing. Deep learning based approaches are vigorous in not only performance improvement but also to feature representations learning from the scratch. The impact of deep learning is also prevalent, recently validating its efficacy on information retrieval and recommender systems research. In this study, a comprehensive review of deep learning-based rating prediction approaches is provided to help out new researchers interested in the subject. More concretely, the classification of deep learning-based recommendation/rating prediction models is provided and articulated along with an extensive summary of the state-of-the-art. Lastly, new trends are exposited with new perspectives pertaining to this novel and exciting development of the field.








Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abdollahi B, Nasraoui O (2016) Explainable restricted Boltzmann machines for collaborative filtering. In: Proc. ICML workshop human interpretability in mach. learning, June 2016, pp. 31–35
Adomavicius G, Kwon Y (2007) New recommendation techniques for multicriteria rating systems. IEEE Intell Syst 22(3):48–55
Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749
Agarwal D, Chen B, Long B (2011) Localized factor models for multi-context recommendation. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, San Diego, CA, USA, August 21–24, 2011, pp 609–617. https://doi.org/10.1145/2020408.2020504
Amplayo RK, Song M (2017) An adaptable fine-grained sentiment analysis for summarization of multiple short online reviews. Data Knowl Eng 110:54–67. https://doi.org/10.1016/j.datak.2017.03.009
Ashok M, Rajanna S, Joshi PV, S SK (2016) A personalized recommender system using machine learning based sentiment analysis over social data. In: 2016 IEEE students’ conference on electrical, electronics and computer science (SCEECS), Bhopal, 2016, pp 1–6. https://doi.org/10.1109/SCEECS.2016.7509354
Bao Y, Fang H, Zhang J (2014) Topicmf: simultaneously exploiting ratings and reviews for recommendation. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, July 27–31, 2014, Québec City, Québec, Canada, pp 2–8. http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8273
Batmaz Z, Yurekli A, Bilge A, Kaleli C (2019) A review on deep learning for recommender systems: challenges and remedies. Artif Intell Rev 52(1):1–37
Betru BT, Onana CA, Batchakui B (2017) Deep learning methods on recommender system: a survey of state-of-the-art. Int J Comput Appl 162(10):17–22
Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J Mach Learn Res 3:993–1022
Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl Based Syst 46:109–132
Burke R (2002) Hybrid recommender systems: survey and experiments. User Model User Adap Interact 12(4):331–370
Caputo A, Basile P, de Gemmis M, Lops P, Semeraro G, Rossiello G (2017) Sabre: a sentiment aspect-based retrieval engine. In: Information filtering and retrieval. Springer, pp 63–78
Catherine R, Cohen WW (2017) Transnets: learning to transform for recommendation. In: Proceedings of the eleventh ACM conference on recommender systems, RecSys 2017, Como, Italy, August 27–31, 2017, pp 288–296. https://doi.org/10.1145/3109859.3109878
Chambua J, Niu Z (2020) Review text based rating prediction approaches: preference knowledge learning, representation and utilization. Artif Intell Rev. https://doi.org/10.1007/s10462-020-09873-y
Chambua J, Niu Z, Yousif A, Mbelwa J (2018) Tensor factorization method based on review text semantic similarity for rating prediction. Expert Syst Appl 114:629–638
Chambua J, Niu Z, Zhu Y (2019) User preferences prediction approach based on embedded deep summaries. Expert Syst Appl 132:87–98
Chen C, Zheng X, Wang Y, Hong F, Chen D (2016) Capturing semantic correlation for item recommendation in tagging systems. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, February 12–17, 2016, Phoenix, Arizona, USA, pp 108–114. http://www.aaai.org/ocs/index.php/AAAI/AAAI16/paper/view/11994
Chen RC et al (2019) User rating classification via deep belief network learning and sentiment analysis. IEEE Trans Comput Soc Syst 6(3):535–546
Chen S, Peng Y (2018) Matrix factorization for recommendation with explicit and implicit feedback. Knowl Based Syst 158:109–117. https://doi.org/10.1016/j.knosys.2018.05.040
Chen Z, Ma W, Dai W, Pan W, Ming Z (2020) Conditional restricted boltzmann machine for item recommendation. Neurocomputing 385:269–277
Cheng Z, Caverlee J, Lee K, Sui DZ (2011) Exploring millions of footprints in location sharing services. In:Proceedings of the fifth international conference on weblogs and social media, Barcelona, 17–21 July 2011, pp 81–88
Cheng Z, Ding Y, He X, Zhu L, Song X, Kankanhalli MS (2018a) A\({}^{\wedge }\)3NCF: an adaptive aspect attention model for rating prediction. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, IJCAI 2018, Stockholm, Sweden, July 13–19, 2018, pp 3748–3754. https://doi.org/10.24963/ijcai.2018/521
Cheng Z, Ding Y, Zhu L, Kankanhalli MS (2018b) Aspect-aware latent factor model: rating prediction with ratings and reviews. In: Proceedings of the 2018 world wide web conference on world wide web, WWW 2018, Lyon, France, April 23–27, 2018, pp 639–648. https://doi.org/10.1145/3178876.3186145
Chin JY, Zhao K, Joty SR, Cong G (2018) ANR: aspect-based neural recommender. In: Proceedings of the 27th ACM international conference on information and knowledge management, CIKM 2018, Torino, Italy, October 22–26, 2018, pp 147–156. https://doi.org/10.1145/3269206.3271810
Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder–decoder for statistical machine translation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar, pp 1724–1734
Chu WT, Tsai YL (2017) A hybrid recommendation system considering visual information for predicting favorite restaurants. World Wide Web 20(6):1313–1331
Dai H, Wang Y, Trivedi R, Song L (2016) Recurrent coevolutionary latent feature processes for continuous-time recommendation. In: Proceedings of the 1st workshop on deep learning for recommender systems, pp 29–34
Deldjoo Y, Elahi M, Cremonesi P (2016) Using visual features and latent factors for movie recommendation. In: Proceedings of the 3rd workshop on new trends in content-based recommender systems co-located with ACM conference on recommender systems (RecSys 2016), Boston, MA, USA, September 16, 2016, pp 15–18. http://ceur-ws.org/Vol-1673/paper3.pdf
Deng D, Jing L, Yu J, Sun S, Zhou H (2018) Neural Gaussian mixture model for review-based rating prediction. In: Proceedings of the 12th ACM conference on recommender systems, pp 113–121
Deng L, Yu D (2014) Deep learning: methods and applications. Found Trends Signal Process 7(3–4):197–387. https://doi.org/10.1561/2000000039
Deng S, Huang L, Xu G, Wu X, Wu Z (2016) On deep learning for trust-aware recommendations in social networks. IEEE Trans Neural Netw Learn Syst 28(5):1164–1177
Diao Q, Qiu M, Wu C, Smola AJ, Jiang J, Wang C (2014) Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In: The 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD’14, New York, NY, USA, August 24–27, 2014, pp 193–202. https://doi.org/10.1145/2623330.2623758
Donahue J, Anne Hendricks L, Guadarrama S, Rohrbach M, Venugopalan S, Saenko K, Darrell T (2015) Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2625–2634
Dong R, O’Mahony MP, Schaal M, McCarthy K, Smyth B (2016) Combining similarity and sentiment in opinion mining for product recommendation. J Intell Inf Syst 46(2):285–312
Dong X, Yu L, Wu Z, Sun Y, Yuan L, Zhang F (2017) A hybrid collaborative filtering model with deep structure for recommender systems. In: Proceedings of the thirty-first AAAI conference on artificial intelligence, February 4–9, 2017, San Francisco, California, USA, pp 1309–1315. http://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14676
Du C, Li C, Zheng Y, Zhu J, Zhang B (2018) Collaborative filtering with user-item co-autoregressive models. In: Thirty-second AAAI conference on artificial intelligence
Yp Du, Cq Yao, Huo Sh, Jx Liu (2017) A new item-based deep network structure using a restricted Boltzmann machine for collaborative filtering. Front Inf Technol Electron Eng 18(5):658–666
Elkahky AM, Song Y, He X (2015) A multi-view deep learning approach for cross domain user modeling in recommendation systems. In: Proceedings of the 24th international conference on world wide web, WWW 2015, Florence, Italy, May 18–22, 2015, pp 278–288. https://doi.org/10.1145/2736277.2741667
Fu M, Qu H, Yi Z, Lu L, Liu Y (2019) A novel deep learning-based collaborative filtering model for recommendation system. IEEE Trans Cybern 49(3):1084–1096. https://doi.org/10.1109/TCYB.2018.2795041
Gao H, Tang J, Hu X, Liu H (2015) Content-aware point of interest recommendation on location-based social networks. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, Austin, Texas, USA, January 25-30, 2015, pp 1721–1727
Ge Y, Xiong H, Tuzhilin A, Xiao K, Gruteser M, Pazzani M (2010) An energy-efficient mobile recommender system. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, pp 899–908
Georgiev K, Nakov P (2013) A non-IID framework for collaborative filtering with restricted Boltzmann machines. In: International conference on machine learning, pp 1148–1156
Goceri E (2018) Formulas behind deep learning success. In: International conference on applied analysis and mathematical modeling (ICAAMM2018), Istanbul, Turkey
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT press, Cambridge
Gunawardana A, Meek C (2008) Tied Boltzmann machines for cold start recommendations. In: Proceedings of the 2008 ACM conference on recommender systems, pp 19–26
He X, Chua T (2017) Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, Shinjuku, Tokyo, Japan, August 7–11, 2017, pp 355–364. https://doi.org/10.1145/3077136.3080777
He X, Chen T, Kan M, Chen X (2015) Trirank: review-aware explainable recommendation by modeling aspects. In: Proceedings of the 24th ACM international conference on information and knowledge management, CIKM 2015, Melbourne, VIC, Australia, October 19–23, 2015, pp 1661–1670. https://doi.org/10.1145/2806416.2806504
He X, Liao L, Zhang H, Nie L, Hu X, Chua T (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, WWW 2017, Perth, Australia, April 3–7, 2017, pp 173–182. https://doi.org/10.1145/3038912.3052569
He X, He Z, Song J, Liu Z, Jiang Y, Chua T (2018) NAIS: neural attentive item similarity model for recommendation. IEEE Trans Knowl Data Eng 30(12):2354–2366. https://doi.org/10.1109/TKDE.2018.2831682
Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2016) Session-based recommendations with recurrent neural networks. In: 4th international conference on learning representations, ICLR 2016, San Juan, Puerto Rico, conference track proceedings, May 2–4, 2016. arxiv:1511.06939
Hinton GE (2009) Deep belief networks. Scholarpedia 4(5):5947
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Hu L, Cao J, Xu G, Cao L, Gu Z, Cao W (2014) Deep modeling of group preferences for group-based recommendation. In: Proceedings of twenty-eighth AAAI conference on artificial intelligence, Quebec City, Quebec, Canada, July 27–31, 2014, pp 1861–1867. http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8458
Hyun D, Park C, Yang MC, Song I, Lee JT, Yu H (2018) Review sentiment-guided scalable deep recommender system. In: The 41st international ACM SIGIR conference on research & development in information retrieval, pp 965–968
Jannach D, Zanker M, Felfernig A, Friedrich G (2010) Recommender systems: an introduction. Cambridge University Press, Cambridge
Khan ZY, Niu Z, Yousif A (2020) Joint deep recommendation model exploiting reviews and metadata information. Neurocomputing 402:256–265. https://doi.org/10.1016/j.neucom.2020.03.075
Kim DH, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems, Boston, MA, USA, September 15–19, 2016, pp 233–240. https://doi.org/10.1145/2959100.2959165
Koren Y (2010) Collaborative filtering with temporal dynamics. Commun ACM 53(4):89–97. https://doi.org/10.1145/1721654.1721677
Koren Y, Bell RM, Volinsky C (2009) Matrix factorization techniques for recommender systems. IEEE Comput 42(8):30–37. https://doi.org/10.1109/MC.2009.263
Kula M (2015) Metadata embeddings for user and item cold-start recommendations. In: Proceedings of the 2nd workshop on new trends on content-based recommender systems co-located with 9th ACM conference on recommender systems (RecSys 2015), Vienna, Austria, September 16–20, 2015, pp 14–21. http://ceur-ws.org/Vol-1448/paper4.pdf
Larochelle H, Murray I (2011) The neural autoregressive distribution estimator. In: Proceedings of the fourteenth international conference on artificial intelligence and statistics, pp 29–37
Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. In: Advances in neural information processing systems 13, papers from neural information processing systems (NIPS) 2000, Denver, CO, USA, pp 556–562. http://papers.nips.cc/paper/1861-algorithms-for-non-negative-matrix-factorization
Leskovec J (2015) New directions in recommender systems. In: Proceedings of the eighth ACM international conference on web search and data mining, WSDM 2015, Shanghai, China, February 2–6, 2015, pp 3–4. https://doi.org/10.1145/2684822.2697044
Li P, Wang Z, Ren Z, Bing L, Lam W (2017) Neural rating regression with abstractive tips generation for recommendation. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 345–354
Li S, Kawale J, Fu Y (2015) Deep collaborative filtering via marginalized denoising auto-encoder. In: Proceedings of the 24th ACM international on conference on information and knowledge management, pp 811–820
Lian D, Zhao C, Xie X, Sun G, Chen E, Rui Y (2014) Geomf: joint geographical modeling and matrix factorization for point-of-interest recommendation. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 831–840
Lian J, Zhang F, Xie X, Sun G (2017) Cccfnet: A content-boosted collaborative filtering neural network for cross domain recommender systems. In: Proceedings of the 26th international conference on world wide web companion, Perth, Australia, April 3–7, 2017, pp 817–818. https://doi.org/10.1145/3041021.3054207
Lian J, Zhou X, Zhang F, Chen Z, Xie X, Sun G (2018) xdeepfm: Combining explicit and implicit feature interactions for recommender systems. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1754–1763
Lin Q, Zhu Y, Zhang S, Shi P, Guo Q, Niu Z (2019) Lexical based automated teaching evaluation via students’ short reviews. Comput Appl Eng Educ 27(1):194–205
Linden G, Smith B, York J (2003) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7(1):76–80. https://doi.org/10.1109/MIC.2003.1167344
Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Eighth ACM conference on recommender systems, RecSys’14, Foster City, Silicon Valley, CA, USA, October 06–10, 2014, pp 105–112. https://doi.org/10.1145/2645710.2645728
Liu B, Xiong H (2013) Point-of-interest recommendation in location based social networks with topic and location awareness. In: Proceedings of the 2013 SIAM international conference on data mining. SIAM, pp 396–404
Liu B, Hu M, Cheng J (2005) Opinion observer: analyzing and comparing opinions on the web. In: Proceedings of the 14th international conference on World Wide Web, WWW 2005, Chiba, Japan, May 10–14, 2005, pp 342–351. https://doi.org/10.1145/1060745.1060797
Liu B, Fu Y, Yao Z, Xiong H (2013) Learning geographical preferences for point-of-interest recommendation. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 1043–1051
Liu D, Li J, Du B, Chang J, Gao R (2019) Daml: dual attention mutual learning between ratings and reviews for item recommendation. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. ACM, pp 344–352
Liu DC, Rogers S, Shiau R, Kislyuk D, Ma KC, Zhong Z, Liu J, Jing Y (2017) Related pins at pinterest: the evolution of a real-world recommender system. In: Proceedings of the 26th international conference on world wide web companion, Perth, Australia, April 3–7, 2017, pp 583–592. https://doi.org/10.1145/3041021.3054202
Liu H, Wang Y, Peng Q, Wu F, Gan L, Pan L, Jiao P (2020) Hybrid neural recommendation with joint deep representation learning of ratings and reviews. Neurocomputing 374:77–85
Liu J, Wu C (2017) Deep learning based recommendation: a survey. In: International conference on information science and applications. Springer, pp 451–458
Liu X, Ouyang Y, Rong W, Xiong Z (2015) Item category aware conditional restricted Boltzmann machine based recommendation. In: International conference on neural information processing. Springer, pp 609–616
Liu Y, Tong Q, Du Z, Hu L (2014) Content-boosted restricted Boltzmann machine for recommendation. In: Artificial neural networks and machine learning—ICANN 2014—24th international conference on artificial neural networks, Hamburg, Germany, September 15–19, 2014. Proceedings, pp 773–780. https://doi.org/10.1007/978-3-319-11179-7_97
Lops P, De Gemmis M, Semeraro G (2011) Content-based recommender systems: state of the art and trends. In: Recommender systems handbook. Springer, pp 73–105
Lu Y, Dong R, Smyth B (2018) Coevolutionary recommendation model: mutual learning between ratings and reviews. In: Proceedings of the 2018 world wide web conference on world wide web, WWW 2018, Lyon, France, April 23–27, 2018, pp 773–782. https://doi.org/10.1145/3178876.3186158
Ma Y, Chen G, Wei Q (2017) Finding users preferences from large-scale online reviews for personalized recommendation. Electron Commer Res 17(1):3–29. https://doi.org/10.1007/s10660-016-9240-9
Ma Y, Xu J, Stenger B, Liu C, Hirate Y (2018) Deep heterogeneous autoencoders for collaborative filtering. In: IEEE international conference on data mining, ICDM 2018, Singapore, November 17–20, 2018, pp 1164–1169. https://doi.org/10.1109/ICDM.2018.00153
McAuley JJ, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Seventh ACM conference on recommender systems, RecSys’13, Hong Kong, China, October 12–16, 2013, pp 165–172. https://doi.org/10.1145/2507157.2507163
Miao Z, Yan J, Chen K, Yang X, Zha H, Zhang W (2016) Joint prediction of rating and popularity for cold-start item by sentinel user selection. IEEE Access 4:8500–8513. https://doi.org/10.1109/ACCESS.2016.2633282
Musto C, de Gemmis M, Semeraro G, Lops P (2017a) A multi-criteria recommender system exploiting aspect-based sentiment analysis of users’ reviews. In: Proceedings of the eleventh ACM conference on recommender systems, RecSys 2017, Como, Italy, August 27–31, 2017, pp 321–325. https://doi.org/10.1145/3109859.3109905
Musto C, de Gemmis M, Semeraro G, Lops P (2017b) A multi-criteria recommender system exploiting aspect-based sentiment analysis of users’ reviews. In: Proceedings of the eleventh ACM conference on recommender systems, pp 321–325
Nicholas ISC, Nicholas CK (1999) Combining content and collaboration in text filtering. In: Proceedings of the IJCAI’99 workshop on machine learning for information filtering, pp 86–91
Nickel M, Tresp V, Kriegel H (2011) A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th international conference on machine learning, ICML 2011, Bellevue, Washington, USA, June 28–July 2, 2011, pp 809–816. https://icml.cc/2011/papers/438_icmlpaper.pdf
Nie Y, Zhu Y, Lin Q, Zhang S, Shi P, Niu Z (2019) Academic rising star prediction via scholar’s evaluation model and machine learning techniques. Scientometrics 120(2):461–476
Oh KJ, Lee WJ, Lim CG, Choi HJ (2014) Personalized news recommendation using classified keywords to capture user preference. In: 16th international conference on advanced communication technology. IEEE, pp 1283–1287
Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp 2643–2651
Ouyang Y, Liu W, Rong W, Xiong Z (2014) Autoencoder-based collaborative filtering. In: International conference on neural information processing. Springer, pp 284–291
Pan W, Xiang EW, Liu NN, Yang Q (2010) Transfer learning in collaborative filtering for Sparsity reduction. In: Proceedings of twenty-fourth AAAI conference on artificial intelligence, Atlanta, Georgia, USA, July 11–15, 2010, pp 230–235. http://www.aaai.org/ocs/index.php/AAAI/AAAI10/paper/view/1649
Pappas N, Popescu-Belis A (2013) Sentiment analysis of user comments for one-class collaborative filtering over ted talks. In: The 36th international ACM SIGIR conference on research and development in Information Retrieval, SIGIR’13, Dublin, Ireland, July 28–August 01, 2013, pp 773–776. https://doi.org/10.1145/2484028.2484116
Paradarami TK, Bastian ND, Wightman JL (2017) A hybrid recommender system using artificial neural networks. Expert Syst Appl 83:300–313. https://doi.org/10.1016/j.eswa.2017.04.046
Pham D, Le A (2018) Learning multiple layers of knowledge representation for aspect based sentiment analysis. Data Knowl Eng 114:26–39. https://doi.org/10.1016/j.datak.2017.06.001
Pham TN, Li X, Cong G, Zhang Z (2016) A general recommendation model for heterogeneous networks. IEEE Trans Knowl Data Eng 28(12):3140–3153. https://doi.org/10.1109/TKDE.2016.2601091
Purkaystha B, Datta T, Islam MS et al (2019) Rating prediction for recommendation: constructing user profiles and item characteristics using backpropagation. Appl Soft Comput 75:310–322
Qiu G, Liu B, Bu J, Chen C (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37(1):9–27. https://doi.org/10.1162/coli_a_00034
Quadrana M, Cremonesi P, Jannach D (2018) Sequence-aware recommender systems. ACM Comput Surv (CSUR) 51(4):1–36
Rendle S (2010) Factorization machines. In: ICDM 2010, the 10th IEEE international conference on data mining, Sydney, Australia, 14–17 December 2010, pp 995–1000. https://doi.org/10.1109/ICDM.2010.127
Salakhutdinov R, Hinton G (2009) Deep Boltzmann machines. In: Artificial intelligence and statistics, pp 448–455
Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: Advances in neural information processing systems 20, proceedings of the twenty-first annual conference on neural information processing systems, Vancouver, British Columbia, Canada, December 3–6, 2007, pp 1257–1264. http://papers.nips.cc/paper/3208-probabilistic-matrix-factorization
Salakhutdinov R, Mnih A, Hinton GE (2007) Restricted Boltzmann machines for collaborative filtering. In: Machine learning, proceedings of the twenty-fourth international conference (ICML 2007), Corvallis, Oregon, USA, June 20–24, 2007, pp 791–798. https://doi.org/10.1145/1273496.1273596
Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp 285–295
Saveski M, Mantrach A (2014) Item cold-start recommendations: learning local collective embeddings. In: Eighth ACM conference on recommender systems, RecSys ’14, Foster City, Silicon Valley, CA, USA, October 06–10, 2014, pp 89–96. https://doi.org/10.1145/2645710.2645751
Schafer JB, Konstan JA, Riedl J (2001) E-commerce recommendation applications. Data Min Knowl Disc 5(1–2):115–153
Sedhain S, Menon AK, Sanner S, Xie L (2015) Autorec: Autoencoders meet collaborative filtering. In: Proceedings of the 24th international conference on World Wide Web, pp 111–112
Seo S, Huang J, Yang H, Liu Y (2017) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the eleventh ACM conference on recommender systems, RecSys 2017, Como, Italy, August 27–31, 2017, pp 297–305. https://doi.org/10.1145/3109859.3109890
Shi K, Gong C, Lu H, Zhu Y, Niu Z (2020a) Wide-grained capsule network with sentence-level feature to detect meteorological event in social network. Future Gener Comput Syst 102:323–332
Shi K, Lu H, Zhu Y, Niu Z (2020b) Automatic generation of meteorological briefing by event knowledge guided summarization model. Knowl Based Syst 192:105379
Shmueli E, Kagian A, Koren Y, Lempel R (2012) Care to comment?: recommendations for commenting on news stories. In: Proceedings of the 21st world wide web conference 2012, WWW 2012, Lyon, France, April 16–20, 2012, pp 429–438. https://doi.org/10.1145/2187836.2187895
Singh AP, Gordon GJ (2008) Relational learning via collective matrix factorization. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, Las Vegas, Nevada, USA, August 24–27, 2008, pp 650–658. https://doi.org/10.1145/1401890.1401969
Sohail SS, Siddiqui J, Ali R (2013) Book recommendation system using opinion mining technique. In: International conference on advances in computing, communications and informatics, ICACCI 2013, Mysore, India, August 22–25, 2013, pp 1609–1614. https://doi.org/10.1109/ICACCI.2013.6637421
Strub F, Mary J (2015) Collaborative filtering with stacked denoising autoencoders and sparse inputs. In: NIPS workshop on machine learning for eCommerce, December 2015, Montreal, Canada
Strub F, Gaudel R, Mary J (2016) Hybrid recommender system based on autoencoders. In: Proceedings of the 1st workshop on deep learning for recommender systems, pp 11–16
Tan Y, Zhang M, Liu Y, Ma S (2016a) Rating-boosted latent topics: understanding users and items with ratings and reviews. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, IJCAI 2016, New York, NY, USA, 9–15 July 2016, pp 2640–2646. http://www.ijcai.org/Abstract/16/375
Tan YK, Xu X, Liu Y (2016b) Improved recurrent neural networks for session-based recommendations. In: Proceedings of the 1st workshop on deep learning for recommender systems, pp 17–22
Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 565–573
Tarus JK, Niu Z, Yousif A (2017) A hybrid knowledge-based recommender system for e-learning based on ontology and sequential pattern mining. Future Gener Comput Sys 72:37–48
Tarus JK, Niu Z, Mustafa G (2018) Knowledge-based recommendation: a review of ontology-based recommender systems for e-learning. Artif Intell Rev 50(1):21–48
Tran T, Cohen R (2000) Hybrid recommender systems for electronic commerce. In: Proceedings of knowledge-based electronic markets, papers from the AAAI workshop, technical report WS-00-04, vol 40. AAAI Press
Truyen TT, Phung DQ, Venkatesh S (2009) Ordinal Boltzmann machines for collaborative filtering. In: UAI 2009, proceedings of the twenty-fifth conference on uncertainty in artificial intelligence, Montreal, QC, Canada, June 18–21, 2009, pp 548–556. https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=1595&proceeding_id=25
Tuan TX, Phuong TM (2017) 3D convolutional networks for session-based recommendation with content features. In: Proceedings of the eleventh ACM conference on recommender systems, pp 138–146
Van Meteren R, Van Someren M (2000) Using content-based filtering for recommendation. In: Proceedings of the machine learning in the new information age: MLnet/ECML2000 workshop, vol 30, pp 47–56
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008
Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(Dec):3371–3408
Wan S, Niu Z (2020) A hybrid e-learning recommendation approach based on learners’ influence propagation. IEEE Trans Knowl Data Eng 32(5):827–840. https://doi.org/10.1109/TKDE.2019.2895033
Wang C, Blei DM (2011a) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, San Diego, CA, USA, August 21–24, 2011, pp 448–456. https://doi.org/10.1145/2020408.2020480
Wang C, Blei DM (2011b) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, San Diego, CA, USA, August 21–24, 2011, pp 448–456. https://doi.org/10.1145/2020408.2020480
Wang H, Wang N, Yeung D (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, Sydney, NSW, Australia, August 10–13, 2015, pp 1235–1244. https://doi.org/10.1145/2783258.2783273
Wang H, Fu Y, Wang Q, Yin H, Du C, Xiong H (2017a) A location-sentiment-aware recommender system for both home-town and out-of-town users. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, Halifax, NS, Canada, August 13–17, 2017, pp 1135–1143. https://doi.org/10.1145/3097983.3098122
Wang S, Wang Y, Tang J, Shu K, Ranganath S, Liu H (2017b) What your images reveal: exploiting visual contents for point-of-interest recommendation. In: Proceedings of the 26th international conference on world wide web, pp 391–400
Wang X, Wang Y (2014) Improving content-based and hybrid music recommendation using deep learning. In: Proceedings of the 22nd ACM international conference on multimedia, pp 627–636
Wang X, Liu H, Wang P, Wu F, Xu H, Wang W, Xie X (2019) Neural review rating prediction with hierarchical attentions and latent factors. In: International conference on database systems for advanced applications. Springer, pp 363–367
Wei J, He J, Chen K, Zhou Y, Tang Z (2016) Collaborative filtering and deep learning based hybrid recommendation for cold start problem. In: 2016 IEEE 14th international conference on dependable, autonomic and secure computing, 14th international conference on pervasive intelligence and computing, 2nd international conference on big data intelligence and computing and cyber science and technology congress (DASC/PiCom/DataCom/CyberSciTech), IEEE, pp 874–877
Wei J, He J, Chen K, Zhou Y, Tang Z (2017) Collaborative filtering and deep learning based recommendation system for cold start items. Expert Syst Appl 69:29–39
Wu C, Ahmed A, Beutel A, Smola AJ (2017a) Joint training of ratings and reviews with recurrent recommender networks. In: 5th international conference on learning representations, ICLR 2017, Toulon, France, April 24–26, 2017, workshop track proceedings. https://openreview.net/forum?id=Bkv9FyHYx
Wu CY, Ahmed A, Beutel A, Smola AJ, Jing H (2017b) Recurrent recommender networks. In: Proceedings of the tenth ACM international conference on web search and data mining, pp 495–503
Wu H, Zhang Z, Yue K, Zhang B, Zhu R (2017c) Content embedding regularized matrix factorization for recommender systems. In: 2017 IEEE international congress on big data (BigData Congress), IEEE, pp 209–215
Wu L, Quan C, Li C, Wang Q, Zheng B, Luo X (2019) A context-aware user-item representation learning for item recommendation. ACM Trans Inf Syst 37(2):22:1–22:29. https://doi.org/10.1145/3298988
Wu M, Chang C, Liu R (2014) Integrating content-based filtering with collaborative filtering using co-clustering with augmented matrices. Expert Syst Appl 41(6):2754–2761. https://doi.org/10.1016/j.eswa.2013.10.008
Wu S, Ren W, Yu C, Chen G, Zhang D, Zhu J (2016a) Personal recommendation using deep recurrent neural networks in netease. In: 2016 IEEE 32nd international conference on data engineering (ICDE), IEEE, pp 1218–1229
Wu Y, DuBois C, Zheng AX, Ester M (2016b) Collaborative denoising auto-encoders for top-n recommender systems. In: Proceedings of the ninth ACM international conference on web search and data mining, pp 153–162
Xing S, Liu F, Wang Q, Zhao X, Li T (2019) A hierarchical attention model for rating prediction by leveraging user and product reviews. Neurocomputing 332:417–427. https://doi.org/10.1016/j.neucom.2018.12.027
Yan X, Guo J, Lan Y, Cheng X (2013) A biterm topic model for short texts. In: 22nd international world wide web conference, WWW’13, Rio de Janeiro, Brazil, May 13–17, 2013, pp 1445–1456. https://doi.org/10.1145/2488388.2488514
Yang C, Yu X, Liu Y, Nie Y, Wang Y (2016) Collaborative filtering with weighted opinion aspects. Neurocomputing 210:185–196. https://doi.org/10.1016/j.neucom.2015.12.136
Yang D, Zhang D, Yu Z, Wang Z (2013) A sentiment-enhanced personalized location recommendation system. In: Proceedings of the 24th ACM conference on hypertext and social media, pp 119–128
Yang D, Huang C, Wang M (2017) A social recommender system by combining social network and sentiment similarity: a case study of healthcare. J Inf Sci 43(5):635–648. https://doi.org/10.1177/0165551516657712
Ye M, Yin P, Lee WC (2010) Location recommendation for location-based social networks. In: Proceedings of the 18th SIGSPATIAL international conference on advances in geographic information systems, pp 458–461
Ye W, Zhang Y, Zhao WX, Chen X, Qin Z (2017) A collaborative neural model for rating prediction by leveraging user reviews and product images. In: Asia information retrieval symposium. Springer, pp 99–111
Yedder HB, Zakia U, Ahmed A, Trajković L (2017) Modeling prediction in recommender systems using restricted Boltzmann machine. In: 2017 IEEE international conference on systems, man, and cybernetics (SMC), IEEE, pp 2063–2068
Yin H, Cui B, Chen L, Hu Z, Zhang C (2015a) Modeling location-based user rating profiles for personalized recommendation. TKDD 9(3):19:1–19:41. https://doi.org/10.1145/2663356
Yin H, Zhou X, Shao Y, Wang H, Sadiq SW (2015b) Joint modeling of user check-in behaviors for point-of-interest recommendation. In: Proceedings of the 24th ACM international conference on information and knowledge management, CIKM 2015, Melbourne, VIC, Australia, October 19–23, 2015, pp 1631–1640. https://doi.org/10.1145/2806416.2806500
Yin H, Zhou X, Cui B, Wang H, Zheng K, Nguyen QVH (2016) Adapting to user interest drift for poi recommendation. IEEE Trans Knowl Data Eng 28(10):2566–2581
Ying H, Chen L, Xiong Y, Wu J (2016) Collaborative deep ranking: A hybrid pair-wise recommendation algorithm with implicit feedback. In: Pacific-Asia conference on knowledge discovery and data mining. Springer, pp 555–567
Yousif A, Niu Z, Chambua J, Khan ZY (2019a) Multi-task learning model based on recurrent convolutional neural networks for citation sentiment and purpose classification. Neurocomputing 335:195–205
Yousif A, Niu Z, Tarus JK, Ahmad A (2019b) A survey on sentiment analysis of scientific citations. Artif Intell Rev 52(3):1805–1838
Yu D, Mu Y, Jin Y (2017) Rating prediction using review texts with underlying sentiments. Inf Process Lett 117:10–18. https://doi.org/10.1016/j.ipl.2016.08.002
Yuan W, Yang Y, Bao X (2017) Parallel DNNS for users and items modeling and recommendation using comments. In: 2017 IEEE smartworld, ubiquitous intelligence & computing, advanced & trusted computed, scalable computing & communications, cloud & big data computing, internet of people and smart city innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), IEEE, pp 1–6
Yun Y, Hooshyar D, Jo J, Lim H (2018) Developing a hybrid collaborative filtering recommendation system with opinion mining on purchase review. J Inf Sci 44(3):331–344. https://doi.org/10.1177/0165551517692955
Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv (CSUR) 52(1):1–38
Zhang Y, Lai G, Zhang M, Zhang Y, Liu Y, Ma S (2014) Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In: The 37th international ACM SIGIR conference on research and development in information retrieval, SIGIR’14, Gold Coast , QLD, Australia, July 06–11, 2014, pp 83–92. https://doi.org/10.1145/2600428.2609579
Zhang Y, Ai Q, Chen X, Croft WB (2017) Joint representation learning for top-n recommendation with heterogeneous information sources. In: Proceedings of the 2017 ACM on conference on information and knowledge management, CIKM 2017, Singapore, November 06–10, 2017, pp 1449–1458. https://doi.org/10.1145/3132847.3132892
Zhao Y, Wang J, Wang F (2015) Word embedding based retrieval model for similar cases recommendation. In: 2015 Chinese automation congress (CAC), IEEE, pp 2268–2272
Zheng L (2016) A survey and critique of deep learning on recommender systems. University of Illinois at Chicago. http://bdsc.lab.uic.edu/docs/survey-critique-deep.pdf
Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on web search and data mining, WSDM 2017, Cambridge, United Kingdom, February 6–10, 2017, pp 425–434. http://dl.acm.org/citation.cfm?id=3018665
Zheng Y, Tang B, Ding W, Zhou H (2016) A neural autoregressive approach to collaborative filtering. In: Proceedings of the 33nd international conference on machine learning, ICML 2016, New York City, NY, USA, June 19–24, 2016, pp 764–773
Zuo Y, Zeng J, Gong M, Jiao L (2016) Tag-aware recommender systems based on deep neural networks. Neurocomputing 204:51–60
Acknowledgements
This work was supported by the National Key R&D Program of China (No. 2019YFB1406302), National Natural Science Foundation of China (No. 61370137), the National Basic Research Program of China (No.2012CB7207002), the Ministry of Education—China Mobile Research Foundation Project (2016/2-7).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Khan, Z.Y., Niu, Z., Sandiwarno, S. et al. Deep learning techniques for rating prediction: a survey of the state-of-the-art. Artif Intell Rev 54, 95–135 (2021). https://doi.org/10.1007/s10462-020-09892-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-020-09892-9