Skip to main content
Log in

Multi-view fusion for recommendation with attentive deep neural network

  • Special Issue
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

Recommendation systems have been widely developed and introduced in numerous applications. However, due to the lack of sufficient user feedback data, the recommendation performance of such systems is often affected by data sparsity. To address this problem, a multi-view fusion recommendation algorithm with an attentive deep neural network is proposed. A two-stage joint learning solution is designed in the proposed model, which combines user attributes, item attributes, and user-item interaction information into a unified framework. The convolutional neural network and attention mechanism are applied to improve effect of extracting features from user and item attributes. The extended deep neural network model based on matrix factorization and multiple-layer perception is used to enhance the feature extraction of user and item interaction information. Experimental results on the MovieLens-1 M and Book-Crossing real datasets show that the proposed algorithm can achieve the best recommendation accuracy compared with other classical recommendation algorithms, even with extremely sparse data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Availability of data and material

Data transparency. https://grouplens.org/datasets/movielens/(ml-1m.zip).

Code availability

Software application or custom code. https://github.com/smilerAI/DNN_AE-AM.

Notes

  1. https://keras.io.

  2. https://grouplens.org/datasets/movielens/.

  3. http://www2.informatik.uni-freiburg.de/~cziegler/BX/.

References

  1. Guo L, Liang J, Zhu Y et al (2019) Collaborative filtering recommendation based on trust and emotion. J Intell Inf Syst 53(1):113–135

    Article  Google Scholar 

  2. Chen R, Hua Q, Chang YS et al (2018) A survey of collaborative filtering-based recommender systems: from traditional methods to hybrid methods based on social networks. IEEE Access 6:64301–64320

    Article  Google Scholar 

  3. Jiang X, Zhang H, Zhang Z, Quan X (2018) Flexible non-negative matrix factorization to unravel disease-related genes. IEEE/ACM Trans Comput Biol Bioinform 99:1–1

    Article  Google Scholar 

  4. Nguyen J, Zhu M (2013) Content-boosted matrix factorization techniques for recommender systems. Statal Anal Data Min 6(4):286–301

    Article  MathSciNet  MATH  Google Scholar 

  5. Yu Y, Wang C, Wang H, Gao Y (2017) Attributes coupling based matrix factorization for item recommendation. Appl Intell 46(3):521–533

    Article  Google Scholar 

  6. Wu Z, Liu H, Xu Y, Jing L (2019) Collaboration matrix factorization on rate and review for recommendation. J Database Manag 30(2):27–43

    Article  Google Scholar 

  7. Singhal A, Sinha P, Pant R (2017) Use of deep learning in modern recommendation system: a summary of recent works. Int J Comput Appl 180(7):17–22

    Google Scholar 

  8. Zhang S, Yao L, Sun A, Tay Y (2018) Deep learning-based recommender system: a survey and new perspectives. ACM Comput Surv 1(1):1–35

    Google Scholar 

  9. Cheng HT, Koc L, Harmsen J, et al (2016) Wide and deep learning for recommender systems. arXiv: Computer Science, Machine Learning

  10. He X, Liao L, Zhang H, Nie, et al (2017) Neural collaborative filtering. arXiv: Computer Science, Information Retrieval, 173–182

  11. Rodríguez P, Bautista MA, Gonzalez J, Escalera S (2018) Beyond One-hot encoding: lower dimensional target embedding. Image Vis Comput 75:21–31

    Article  Google Scholar 

  12. Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1235–1244

  13. Huang L, Jiang B, Lv S, Liu Y (2018) Survey on deep learning based recommender systems. Chin J Comput 41(7):191–219

    MathSciNet  Google Scholar 

  14. Guan Y, Wei Q, Chen G (2019) Deep learning based personalized recommendation with multi-view information integration. Decis Support Syst 118(3):58–69

    Article  Google Scholar 

  15. Wang H, Tian S, Yu L, Wang X (2019) Image inpainting algorithm based on neural network and attention mechanism. In: Proceedings of the 2019 2nd international conference on algorithms, computing and artificial intelligence, pp. 345–349

  16. Chen J, Wang Z, Zhu T, Rosas FE (2020) Recommendation algorithm in double-layer network based on vector dynamic evolution clustering and attention mechanism. Complexity 3:1–19

    Google Scholar 

  17. Huang Z, Xu X, Zhu H, Zhou MC (2020) An efficient group recommendation model with multiattention-based neural networks. IEEE Trans Neural Netw Learn Syst 99:1–14

    MathSciNet  Google Scholar 

  18. Moeyersoms J, Martens D (2015) Including high-cardinality attributes in predictive models: a case study in churn prediction in the energy sector. Decis Support Syst 72:72–81

    Article  Google Scholar 

  19. Yang R, Singh SK, Tavakkoli M et al (2020) CNN-LSTM deep learning architecture for computer vision-based modal frequency detection. Mech Syst Signal Process 144:106885

    Article  Google Scholar 

  20. He X, Du X, Wang X, et al (2018) Outer product-based neural collaborative filtering. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI-18), pp. 2227–2233

  21. Wang J, Sangaiah AK, Liu W (2020) A hybrid collaborative filtering recommendation algorithm: integrating content information and matrix factorization. Int J Grid Util Comput 11(3):367–377

    Article  Google Scholar 

  22. Peng W, Xin B (2019) A social trust and preference segmentation-based matrix factorization recommendation algorithm. EURASIP J Wirel Commun Netw 1:1–12

    Google Scholar 

  23. Zhang Z (2018) Improved Adam optimizer for deep neural networks. In 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS), pp. 1–2

  24. Bock S, Weis M (2019) A Proof of local convergence for the adam optimizer. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8

  25. Harper FM, Konstan JA (2015) The movielens datasets: history and context. ACM Trans Interact Intell Syst 5(4):1–19

    Article  Google Scholar 

  26. Das J, Majumder S, Gupta P et al (2019) Collaborative recommendations using hierarchical clustering based on K-d trees and quadtrees. Int J Uncertain Fuzziness Knowl Based Syst 27(4):637–668

    Article  Google Scholar 

  27. Song W, Li X (2019) A Non-Negative Matrix Factorization for Recommender Systems Based on Dynamic Bias. In: Torra V, Narukawa Y, Pasi G, Viviani M (eds) Modeling Decisions for Artificial Intelligence. MDAI 2019. Lecture Notes in Computer Science, vol 11676. Springer, Cham. https://doi.org/10.1007/978-3-030-26773-5_14

  28. Xin D, Lei Y, Zhong HW, et al (2017) A hybrid collaborative filtering model with deep structure for recommender systems. In: Proceedings of the 31st AAAI conference on artificial intelligence, pp. 1309–1315

  29. Sangaiah AK, Medhane DV, Han T et al (2019) Enforcing position-based confidentiality with machine learning paradigm through mobile edge computing in real-time industrial informatics. IEEE Trans Ind Inform 15(7):4189–4196. https://doi.org/10.1109/TII.2019.2898174

    Article  Google Scholar 

  30. Kang J, Choi HS, Lee H (2019) Deep recurrent convolutional networks for inferring user interests from social media. J Intell Inf Syst 52:191–209

    Article  Google Scholar 

Download references

Acknowledgements

This paper is supported by National Natural Science Foundation of China (61902439), the basic and applied basic research fund of Guangdong Province (2019A1515012048), 2019 Scientific Research Projects for Special Talents of the Open University of Guangdong (2019-48), The Major Science and Technology Research Programs of Zhongshan City (2019B2006, 2019A40027), Characteristic Innovative projects for young talents of Education Department of Guangdong Province (2019KQNCX223), Characteristic innovation project of Education Department of Guangdong Province (2020KTSCX400).

Author information

Authors and Affiliations

Authors

Contributions

WJ: Methodology, Experiments, Writing; AKS: Methodology, Reviewing; LW: Theory, Model optimization; LS: Reviewing; LL: Experiments; Liang Ruishi: Revising.

Corresponding author

Correspondence to Arun Kumar Sangaiah.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jing, W., Sangaiah, A.K., Wei, L. et al. Multi-view fusion for recommendation with attentive deep neural network. Evol. Intel. 15, 2619–2629 (2022). https://doi.org/10.1007/s12065-021-00626-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-021-00626-6

Keywords

Navigation