Skip to main content
SpringerLink
Log in

Capsmf: a novel product recommender system using deep learning based text analysis model

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Researchers and data scientists have developed different Recommender System Algorithms such as Content-Based and Collaborative-Based in order to filter a large amount of information available on the internet and hence, recommend only the relevant and essential content based on the personalized interests of users. Information acquired explicitly by collecting users’ ratings for an item lead to the problem of data sparsity. Many researchers have been currently working towards the improvement of rating prediction accuracy by integrating the auxiliary information along with the ratings provided by the users. This paper proposes a novel product recommender system called as “CapsMF”, it applies the advanced neural network architecture Capsule Networks (Caps) for document representation, and MF represents Matrix factorization. In the proposed approach, we have enhanced a deep neural network text analysis model by adding a newly discovered neural network architecture; Capsule Networks stacked on bi-directional Recurrent Neural Network (Bi-RNN) for the robust representation of textual descriptions of items and users. The Deep Neural Network text analysis model is integrated with the Probabilistic Matrix Factorization to generate improved recommendations. The experiment has been performed on two real amazon datasets resulting in the enhancement of rating prediction accuracy, the recall, and the precision of top-n recommendations, in comparison to the basic and hybrid Recommendation System Algorithms. Also, text analysis model involving Capsule Networks stacked with Recurrent Neural Networks (RNNs) have outperformed the baseline models that have single Convolutional Neural Networks (CNN) or CNN combined with Bi-RNN in text analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Belém FM, Heringer AG, Almeida JM, Gonçalves MA (2019) Exploiting syntactic and neighborhood attributes to address cold start in tag recommendation. Inf Process Manag 56(3):771–790

    Article  Google Scholar 

  2. Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Knowledge-based systems recommender systems survey. Knowledge-Based Syst 46:109–132

    Article  Google Scholar 

  3. Chen K, Chen T, Zheng G, Jin O, Yao E, Yu Y (2012) Collaborative personalized tweet recommendation. Proc. 35th Int. ACM SIGIR Conf Res Dev Inf Retr - SIGIR ‘12, no 800, p 661

  4. Chollet F et al. Keras: deep learning library for theano and tensorflow. https://keras.io/

  5. Chung J (2014) Gated recurrent neural networks on sequence modeling. arXiv : 1412. 3555v1 [ cs . NE ], pp 1–9

  6. Hinton GE, Krizhevsky A, Wang SD (2011) Transforming auto-encoders. In: Honkela T, Duch W, Girolami M, Kaski S (eds) Artificial neural networks and machine learning – ICANN 2011. Lecture notes in computer science, vol 6791. Springer, Berlin, Heidelberg

  7. Hinton G, Sabour S, Frosst N (2018) Matrix capsules with EM routing. International Conference on Learning Representations (ICLR), pp 1–15

  8. Jaiswal A, AbdAlmageed W, Natarajan P (2018) CapsuleGAN: generative adversarial capsule network. Cite arxiv:1802.06167 pp 1–10

  9. Johnson R, Zhang T Effective use of word order for text categorization with convolutional neural networks. In Proceedings of the 2015 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 103–112. https://doi.org/10.3115/v1/N15-1011

  10. Katarya R, Arora Y (2018) A survey of recommendation systems in twitter. 2018 4th international conference on Computational Intelligence & Communication Technology (CICT), Ghaziabad, pp 1–5. https://doi.org/10.1109/CIACT.2018.8480264

  11. Katarya R, Arora Y (2019) Study on text classification using capsule networks. Accepted in International Conference on Advanced Computing & Communication Systems (ICACCS), IEEE

  12. Khasmakhi NN, Balafar MA, Derakhshi MRF (2019) Engineering Applications of Artificial Intelligence The state-of-the-art in expert recommendation systems ✩. Eng. Appl. Artif. Intell. 82(August 2018):126–147

    Article  Google Scholar 

  13. Khater S, Elmongui HG, Gra D (2014) Tweets you like: personalized tweets recommendation based on dynamic users interests. IEEE, pp 1–10

  14. Kim D, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. Proceedings of the 10th ACM Conference on Recommender Systems, page 233–240. New York, NY, USA, ACM

  15. Kong X, Member S (2018) A survey of collaborative filtering-based recommender systems : From traditional models to hybrid models based on social networks. IEEE Access 6:64301–64320

    Article  Google Scholar 

  16. Koren Y, Bell R, Volinsky C (2009) Matrix Factorization Techniques for Recommender Systems. Computer 42(8):30–37. https://doi.org/10.1109/MC.2009.263

    Article  Google Scholar 

  17. Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In Proceedings of the 8th ACM Conference on Recommender systems (RecSys '14). ACM, New York, NY, USA, 105–112. https://doi.org/10.1145/2645710.2645728

  18. Liphoto M, Du C, Ngwira S (2016) A survey on recommender systems. 2016 International Conference on Advances in Computing and Communication Engineering (ICACCE), Durban, pp 276–280. https://doi.org/10.1109/ICACCE.2016.807376

  19. Mcauley J (2013) Hidden factors and hidden topics : understanding rating dimensions with review text. Proceedings of the 7th ACM Conference on Recommender Systems, RecSys '13, pages 165–172, ACM

  20. Pennington JJ, Socher R, Manning CD (2014) GloVe : global vectors for word representation. Empirical Models in Natural Language Processing (EMNLP), pp 1532–1543

  21. Ramlatchan A, Yang M, Liu Q, Li M, Wang J, Li Y (2018) A survey of matrix completion models for recommendation systems. In Big Data Mining and Analytics, vol 1, no 4, pp 308–323(IEEE), December. https://doi.org/10.26599/BDMA.2018.9020008

  22. Razghandi M, Golpaygani SAH (2017) A context-aware and user behavior-based recommender system with regarding social network analysis. 2017 IEEE 14th Int Conf E-bus Eng pp 208–213

  23. Rojo D, Valdiviezo-díaz P (2018) Hybrid collaborative filtering based on users rating behavior. IEEE Access vol 6

  24. Sabour S, Nov CV, Hinton GE (2017) Dynamic routing between capsules. arXiv:1710.09829, Nips

  25. Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In Proceedings of the 20th International Conference on Neural Information Processing Systems (NIPS'07), Curran Associates Inc., USA, 1257–1264

  26. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: A simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958

    MathSciNet  MATH  Google Scholar 

  27. Srivastava S, Khurana P, Tewari V (2018) Identifying aggression and toxicity in comments using capsule network. Proceedings of the First Workshop on Trolling, Aggression, and Cyberbullying (TRAC-2018), pp 98–105

  28. Steyvers M, Smyth P, Rosen-Zvi M, Griffiths T (2004) Probabilistic author-topic models for information discovery. Proc. 2004 ACM SIGKDD Int Conf Knowl Discov Data Min. - KDD ‘04, no. 1990, p 306

  29. Van Merri B, Fellow CS (2014) Learning phrase representations using RNN encoder – decoder for statistical machine translation. In Proceedings of the 2014 Conference on empirical models in natural language processing (EMNLP), Association for Computational Linguistics, pp 1724–1734, October

  30. Wang C, Blei DM (2011) Collaborative topic modeling for recommending scientific articles. Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, page 448–456, New York, NY, USA, ACM

  31. Wang Y, Sun A, Han J (2018) Sentiment analysis by capsules. WWW '18 Proceedings of the 2018 World Wide Web Conference, Pages 1165–1174 vol 2

  32. Wang H, Wang N (2015) Collaborative deep learning for recommender systems. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 1235–1244. https://doi.org/10.1145/2783258.2783273

  33. Wang W, Zhang G, Lu J (2016) Member contribution-based group recommender system. Decis Support Syst 87:80–93

    Article  Google Scholar 

  34. Wu H, Zhang Z, Yue K, Zhang B, He J, Sun L (2018) Knowledge-based systems dual-regularized matrix factorization with deep neural networks for recommender systems R. Knowledge-Based Syst. 145:46–58

    Article  Google Scholar 

  35. Zhang L, Luo T, Zhang F, Wu Y (2018) A recommendation model based on deep neural network. IEEE Access 6:9454–9463. https://doi.org/10.1109/ACCESS.2018.2789866

    Article  Google Scholar 

  36. Zhang S, Yao L, Sun A, Tay Y (2019) Deep Learning Based Recommender System: A Survey and New Perspectives. ACM Comput. Surv. 52:5:1–5:38. https://doi.org/10.1145/3285029

    Article  Google Scholar 

  37. Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In proceedings of the tenth ACM international conference on web search and data mining (WSDM '17). ACM, New York, NY, USA, 425–434. https://doi.org/10.1145/3018661.3018665.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Delhi Technological University, Delhi, India

    Rahul Katarya

  2. Department of Information Technology, Delhi Technological, Delhi, India

    Yamini Arora

Authors
  1. Rahul Katarya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yamini Arora
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rahul Katarya.

Ethics declarations

Conflict of interest

There is “NO any” direct or indirectly related conflict of interest for this manuscript and with authors.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Katarya, R., Arora, Y. Capsmf: a novel product recommender system using deep learning based text analysis model. Multimed Tools Appl 79, 35927–35948 (2020). https://doi.org/10.1007/s11042-020-09199-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09199-5

Keywords

Search

Navigation