Skip to main content
Log in

Neural embedding collaborative filtering for recommender systems

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The main purpose of collaborative filtering algorithm is to provide a personalized recommender system based on past interactions of each user (e.g., clicks and purchases). Among various collaborative filtering techniques, matrix factorization is widely adopted in diverse applications. This technique has superior characteristics, including applying latent feature vectors to represent users or items and projecting users and items into a shared latent feature space. In the present study, a matrix factorization model with the neural embedding called the neural embedding collaborative filtering (NECF) is proposed. In order to evaluate the performance of the proposed method, a probabilistic auto-encoder is initially applied to achieve unsupervised learning to generate the neural embedding vector from the user–item data. Secondly, these vectors are combined with a regression model based on single point negative sampling to represent the latent feature vectors of the user with regression coefficients. Moreover, an inner product is applied on latent features of users and items to determine the correlations between them. It should be indicated that the NECF is generic so that it can express and generalize the matrix factorization under its framework. In the present study, a ridge regression learning is applied on latent features of each user. The experimental results on two benchmark data sets show that the proposed model outperforms other state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Barkan O, Koenigstein N (2016) Item2vec: neural item embedding for collaborative filtering. In: 2016 IEEE 26th International workshop on machine learning for signal processing (MLSP). IEEE, pp 1–6

  2. Deng Z, Huang L, Wang C, Lai J, Yu PS (2019) DeepCF: a unified framework of representation learning and matching function learning in recommender system. In: National conference on artificial intelligence

  3. Ebesu T, Shen B, Fang Y (2018) Collaborative memory network for recommendation systems. In: International ACM SIGIR conference on research and development in information retrieval

  4. Goldberg Y, Levy O (2014) word2vec explained: deriving Mikolov et al.’s negative-sampling word-embedding method. Eprint Arxiv

  5. He X, Chua TS (2017) Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval

  6. He X, Liao L, Zhang H et al (2017) Neural collaborative filtering. In: The web conference, 2017, pp 173–182

  7. He X, Chen T, Kan M, Chen X (2015) TriRank: review-aware explainable recommendation by modeling aspects. In: Conference on information and knowledge management

  8. He X, Zhang H, Kan M, Chua T (2016) Fast matrix factorization for online recommendation with implicit feedback. In: International ACM SIGIR conference on research and development in information retrieval

  9. Hoerl A, Kennard R (1970) Ridge regression: applications to nonorthogonal problems. Technometrics 12(1):69–82

    Article  Google Scholar 

  10. Hu Y, Koren Y, Volinsky C (2009) Collaborative filtering for implicit feedback datasets. In: Eighth IEEE international conference on data mining

  11. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv: Learning

  12. Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ACM SIGKDD International conference on knowledge discovery and data mining, pp 426–434

  13. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37

    Article  Google Scholar 

  14. Landgraf AJ, Bellay J (2017) word2vec Skip-gram with negative sampling is a weighted logistic PCA. arXiv: Computation and Language

  15. Liang H, Baldwin T (2015) A probabilistic rating auto-encoder for personalized recommender systems. In: ACM International on conference on information and knowledge management

  16. Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781

  17. Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed representations of words and phrases and their compositionality. Adv Neural Inf Process Syst 26:3111–3119

    Google Scholar 

  18. Mu C, Yang G, Yan Z (2018) Revisiting skip-gram negative sampling model with rectification

  19. Ning X, Karypis G (2012) Slim: sparse linear methods for top-\(n\) recommender systems. In: IEEE International conference on data mining

  20. Ozsoy MG (2016) From word embeddings to item recommendation. arXiv: Learning

  21. Pan R, Zhou Y, Cao B, Liu NN, Lukose R, Scholz MB, Yang Q (2008) One-class collaborative filtering. In: International conference on data mining

  22. Rendle S (2010) Factorization machines. In: International conference on data mining

  23. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Conference on uncertainty in artificial intelligence

  24. Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: International conference on neural information processing systems

  25. Sarwar BM, Karypis G, Konstan JA (2001) Item-based collaborative filtering recommendation algorithms. In: WWW, pp 285–295

  26. Socher R, Chen D, Manning CD, Ng AY (2013) Reasoning with neural tensor networks for knowledge base completion. In: International conference on neural information processing systems

  27. Xue G, Zhang H, Bian J, Chua TS (2015) Learning image and user features for recommendation in social networks. In: IEEE International conference on computer vision

  28. Xue HJ, Dai X, Zhang J, Huang S, Chen J (2017) Deep matrix factorization models for recommender systems. In: International joint conference on artificial intelligence, pp 3203–3209

  29. Yao W, Dubois C, Zheng AX, Ester M (2016) Collaborative denoising auto-encoders for top-\(n\) recommender systems. In: ACM International conference on web search and data mining

  30. Zhang H, Ji Y, Li J, Ye Y (2016) A triple wing harmonium model for movie recommendation. IEEE Trans Ind Inf 12(1):231–239

    Article  Google Scholar 

  31. Zhang H, Sun Y, Zhao M, Chow TW, Wu QM (2019) Bridging user interest to item content for recommender systems: an optimization model. IEEE Trans Cybern. https://doi.org/10.1109/TCYB.2019.2900159

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tianlin Huang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, T., Zhang, D. & Bi, L. Neural embedding collaborative filtering for recommender systems. Neural Comput & Applic 32, 17043–17057 (2020). https://doi.org/10.1007/s00521-020-04920-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-04920-9

Keywords

Navigation