Skip to main content
SpringerLink
Log in

A hybrid neural network approach to combine textual information and rating information for item recommendation

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Collaborative filtering (CF) is a common method used by many recommender systems. Traditional CF algorithms exploit users’ ratings as the sole information source to learn user preferences. However, ratings usually sparse cause a serious impact on the recommendation results. Most existing CF algorithms use ratings and textual information to alleviate the sparsity of data and then utilize matrix factorization to achieve the latent feature interactions for rating prediction. Nevertheless, the following shortcomings remain in these studies: (1) The word orders and surrounding words of the textual information are ignored. (2) The nonlinearity of feature interactions is seldom exploited. Therefore, we propose a novel hybrid neural network to combine textual information and rating (NCTR) information for item recommendation. The proposed NCTR model is built upon a hybrid neural network framework with fine-grained modeling of latent representation and nonlinearity feature interactions for rating prediction. Specifically, convolution neural network is applied to extract effectively contextual features from textual information. Meanwhile, a fusion layer is exploited to combine features, and the multilayer perceptions are used to model the nonlinear interactions between the merged item latent features and user latent features. Experimental results over five real-world datasets show that NCTR significantly outperforms several state-of-the-art recommendation methods. Source codes are available in https://github.com/luojia527/NCTR_master.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. http://grouplens.org/datasets/movielens/.

  2. http://jmcauley.ucsd.edu/data/amazon/.

  3. Plot summaries are available at http://www.imdb.com/.

  4. https://www.tensorflow.org/.

References

  1. Bao Y, Fang H, Zhang J (2014) Topicmf: Simultaneously exploiting ratings and reviews for recommendation. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence. pp 2–8

  2. Blei D, Ng A, Jordan M (2003) Latent Dirichlet allocation. Mach Learn Res 3(4–5):993–1022

    MATH  Google Scholar 

  3. Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl Based Syst 46:109–132

    Article  Google Scholar 

  4. Cheng HT, Koc L, Harmsen J, Shaked T, Chandra T, Aradhye H et al (2016) Wide and deep learning for recommender systems. In: Proceedings of the 1st workshop on deep learning for recommender systems, DLRS 2016. pp 7–10

  5. Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. Mach Learn Res 12(8):2493–2537

    MATH  Google Scholar 

  6. Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints, vol. 1

  7. Diao Q, Qiu M, Wu CY, Smola AJ, Jiang J, Wang C (2014) Jointly modeling aspects, ratings and sentiments for movie recommendation (jmars). In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD’ 14. pp 193–202

  8. Diaz F, Mitra B, Craswell N (2016) Query expansion with locally-trained word embeddings. CoRR arXiv:1605.07891

  9. Dong X, Yu L, Wu Z, Sun Y, Yuan L, Zhang F (2017) A hybrid collaborative filtering model with deep structure for recommender systems. In: Proceedings of the thirty-first AAAI conference on artificial intelligence. pp 1309–1315

  10. Gao R, Li J, Li X, Song C, Zhou Y (2018) A personalized point-of-interest recommendation model via fusion of geo-social information. Neurocomputing 273:159–170

    Article  Google Scholar 

  11. He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on World Wide Web, WWW’ 17. pp 173–182

  12. He X, Zhang H, Kan MY, Chua TS(2016) Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th international ACM SIGIR conference on research and development in information retrieval, SIGIR’ 16. pp 549–558

  13. Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. CoRR arXiv:1404.2188

  14. Kim D, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems, RecSys’ 16. pp 233–240

  15. Kim MW, Kim EJ, Ryu JW (2005) Collaborative filtering for recommendation using neural networks. In: Proceedings of the 2005 international conference on computational science and its applications, ICCSA’05. pp 127–136

  16. Kim Y (2014) Convolutional neural networks for sentence classification. CoRR arXiv:1408.5882

  17. Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. CoRR arXiv:1412.6980

  18. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37

    Article  Google Scholar 

  19. Li X, She J (2017) Collaborative variational autoencoder for recommender systems. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, KDD’17. pp 305–314

  20. Liang H, Xu Y, Li Y, Nayak R, Tao X (2010) Connecting users and items with weighted tags for personalized item recommendations. In: Proceedings of the 21st ACM conference on hypertext and hypermedia, HT’ 10. pp 51–60

  21. Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM conference on recommender systems, RecSys’ 14. pp 105–112

  22. Lu Z, Dou Z, Lian J, Xie X, Yang Q (2015) Content-based collaborative filtering for news topic recommendation. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, AAAI’15. pp 217–223

  23. Luo X, Zhou M, Xia Y, Zhu Q (2014) An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans Ind Inform 10(2):1273–1284

    Article  Google Scholar 

  24. Mazumdar P, Patra BK, Babu KS, Lock R (2018) Hidden location prediction using check-in patterns in location-based social networks. Knowl Inf Syst 57:571–601

    Article  Google Scholar 

  25. McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on recommender systems, RecSys ’13. pp 165–172

  26. Ortega F, Hernando A, Bobadilla J, Kang JH (2016) Recommending items to group of users using matrix factorization based collaborative filtering. Inf Sci 345:313–324

    Article  Google Scholar 

  27. Pichl M, Zangerle E, Specht G (2017) Improving context-aware music recommender systems: beyond the pre-filtering approach. In: Proceedings of the 2017 ACM on international conference on multimedia retrieval, ICMR’ 17. pp 201–208

  28. Rumelhart DE, Hinton GE, Williams RJ (1988) Neurocomputing: foundations of research. chap. Learning internal representations by error propagation. pp 673–695

  29. Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: Proceedings of the 20th international conference on neural information processing systems, NIPS’07. pp 1257–1264

  30. Shani G, Gunawardana A (2011) Evaluating recommendation systems. Springer, New York, pp 257–297

    Google Scholar 

  31. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958

    MathSciNet  MATH  Google Scholar 

  32. Tamhane A, Arora S, Warrier D (2017) Modeling contextual changes in user behaviour in fashion e-commerce. In: Kim J, Shim K, Cao L, Lee JG, Lin X, Moon YS (eds) Advances in knowledge discovery and data mining. Springer, Berlin, pp 539–550

    Chapter  Google Scholar 

  33. Tan Y, Zhang M, Liu Y, Ma S (2016) Rating-boosted latent topics: understanding users and items with ratings and reviews. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, IJCAI’16. pp 2640–2646

  34. Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408

    MathSciNet  MATH  Google Scholar 

  35. Wallach HM (2006) Topic modeling: beyond bag-of-words. In: Proceedings of the 23rd international conference on machine learning, ICML’06. pp 977–984

  36. Wang C, Blei DM(2011) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, KDD’11. pp 448–456

  37. Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, KDD’15. pp 1235–1244

  38. Wang N, Yeung DY (2013) Learning a deep compact image representation for visual tracking. In: Burges CJC, Bottou L, Welling M, Ghahramani Z, Weinberger KQ (eds) Advances in neural information processing systems, vol 26. Springer, Berlin, pp 809–817

    Google Scholar 

  39. Wang X, He X, Nie L, Chua TS (2017) Item silk road: recommending items from information domains to social users. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, SIGIR’17. pp 185–194

  40. Wang X, Wang Y (2014) Improving content-based and hybrid music recommendation using deep learning. In: Proceedings of the 22Nd ACM international conference on multimedia, MM’14. pp 627–636

  41. Wang Z, Du B, Guo Y (2020) Domain adaptation with neural embedding matching. IEEE Trans Neural Netw Learn Syst 31(7):2387–2397

    Article  MathSciNet  Google Scholar 

  42. Werbos P (1988) Generalization of backpropagation with application to a recurrent gas market model. Neural Netw 1:39–356

    Article  Google Scholar 

  43. Wu L, Quan C, Li C, Wang Q, Zheng B, Luo X (2019) A context-aware user-item representation learning for item recommendation. ACM Trans Inf Syst 37(2):1–29

    Article  Google Scholar 

  44. Wu Y, DuBois C, Zheng AX, Ester M (2016) Collaborative denoising auto-encoders for top-n recommender systems. In: Proceedings of the ninth ACM international conference on web search and data mining, WSDM’16. pp 153–162

  45. Yang C, Bai L, Zhang C, Yuan Q, Han J (2017) Bridging collaborative filtering and semi-supervised learning: a neural approach for poi recommendation. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, KDD’17. pp 1245–1254

  46. Yang C, Sun M, Zhao WX, Liu Z, Chang EY (2017) A neural network approach to jointly modeling social networks and mobile trajectories. ACM Trans Inf Syst 35(4):1–28

    Article  Google Scholar 

  47. Ying H, Chen L, Xiong Y, Wu J (2016) Collaborative deep ranking: a hybrid pair-wise recommendation algorithm with implicit feedback. In: Bailey J, Khan L, Washio T, Dobbie G, Huang JZ, Wang R (eds) Advances in knowledge discovery and data mining. Springer, Berlin, pp 555–567

    Chapter  Google Scholar 

  48. Zhang F, Yuan NJ, Lian D, Xie X, Ma WY (2016) Collaborative knowledge base embedding for recommender systems. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, KDD’16. pp 353–362

  49. Zhang L, Luo T, Zhanga F, Wu Y (2018) A recommendation model based on deep neural network. IEEE Access pp 1–1

  50. Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv 52(1):1–38

    Google Scholar 

  51. Zhao WX, Li S, He Y, Chang EY, Wen JR, Li X (2016) Connecting social media to e-commerce: cold-start product recommendation using microblogging information. IEEE Trans Knowl Data Eng 28(5):1147–1159

    Article  Google Scholar 

  52. Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on web search and data mining, WSDM ’17. pp 425–434

  53. Zuo Y, Zeng J, Gong M, Jiao L (2016) Tag-aware recommender systems based on deep neural networks. Neurocomputing 204:51–60

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the anonymous reviewers and the editor for their thankful comments and suggestions. This work is supported in part by National Natural Science Foundation of China under Grants 61822113, 41871243, the Science and Technology Major Project of Hubei Province (Next-Generation AI Technologies) under Grant 2019AEA170.

Author information

Authors and Affiliations

  1. School of Computer Science, Wuhan University, Wuhan, 430072, China

    Donghua Liu, Jing Li, Bo Du, Jun Chang & Yujia Wu

  2. School of Computer Science, Hubei University of Technology, Wuhan, 430068, China

    Rong Gao

Authors
  1. Donghua Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bo Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rong Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yujia Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jing Li.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, D., Li, J., Du, B. et al. A hybrid neural network approach to combine textual information and rating information for item recommendation. Knowl Inf Syst 63, 621–646 (2021). https://doi.org/10.1007/s10115-020-01528-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-020-01528-2

Keywords

Search

Navigation