Skip to main content
Log in

An Ensemble Model for Combining Deep Matrix Factorization and Image-Based Recommendation Systems

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Recommender systems are widely used in many domains, especially in E-commerce. It can be used for attracting users by recommending appropriate products to them. There are many techniques in recommendation systems which can predict rating scores to recommend next products. In this work, we propose an ensemble model for combining Image-based recommendation and Deep Matrix factorization. Specifically, in the proposed model, we have utilized the pre-trained deep learning models (e.g., the VGG16) to extract the image features. Next, based on the image features, we compute similarities between the products to generate recommendations. We integrated the Deep Matrix Factorization model to predict the ratings between users and items into the Image-based recommendation to enhance the effectiveness of the recommendation model. Experimental results on public data sets show that the approach can give good recommendations at more than 90% of accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Data Availability Statement

Data sets are available, such as Style Color Imageshttps://www.kaggle.com/datasets/paramaggarwal/fashion-product-images-dataset, Fashion product images datasethttps://www.kaggle.com/datasets/paramaggarwal/fashion-product-images-dataset, and Amazon fashion review with imageshttps://cseweb.ucsd.edu/~jmcauley/datasets/amazon_v2/.

Notes

  1. https://www.kaggle.com/datasets/olgabelitskaya/style-color-images.

  2. https://www.kaggle.com/datasets/paramaggarwal/fashion-product-images-dataset

References

  1. Dien TT, Nguyen T-H, Nguyen T-N. Novel approaches for searching and recommending learning resources. Cybern Inform Technol. 23(2, 3923): pp.151–169. https://doi.org/10.2478/cait-2023-0019.

  2. Alamdari PM, Navimipour NJ, Hosseinzadeh M, Safaei AA, Darwesh A. Image-based product recommendation method for E-commerce applications using convolutional neural networks. Acta Inform Pragensia Prague Univ Econ Bus. 2022;2022(1):15–35.

    Article  Google Scholar 

  3. Ullah F, Zhang B, Khan RU. Image-based service recommendation system: a JPEG-coefficient RFs approach. In IEEE Access. 2020;2020(8):3308–18. https://doi.org/10.1109/ACCESS.2019.2962315.

    Article  Google Scholar 

  4. Tuinhof H, Pirker C, Haltmeier M. Image-based fashion product recommendation with deep learning. In: Nicosia G, Pardalos P, Giuffrida G, Umeton R, Sciacca V, editors. Machine learning, optimization, and data science. LOD 2018. Lecture Notes in Computer Science, vol. 1331. Cham: Springer; 2019. https://doi.org/10.1007/978-3-030-13709-0_40.

    Chapter  Google Scholar 

  5. Yin P, Zhang L. Image recommendation algorithm based on deep learning. IEEE Access. 2020;8:132799–807. https://doi.org/10.1109/ACCESS.2020.3007353.

    Article  Google Scholar 

  6. Sivaramakrishnan N, Subramaniyaswamy V, Viloria A, et al. A deep learning-based hybrid model for recommendation generation and ranking. Neural Comput Appl. 2021;33:10719–36. https://doi.org/10.1007/s00521-020-04844-4.

    Article  Google Scholar 

  7. Yin P, Wang J, Zhao J, Wang H, Gan H. Deep collaborative filtering: a recommendation method for crowdfunding project based on the integration of deep neural network and collaborative filtering. Math Probl Eng. 2022;2022:1–15. https://doi.org/10.1155/2022/4655030.

    Article  Google Scholar 

  8. Jena KK, Bhoi SK, Mallick C, et al. Neural model based collaborative filtering for movie recommendation system. Int J Inf Tecnol. 2022;14:2067–77. https://doi.org/10.1007/s41870-022-00858-4.

    Article  Google Scholar 

  9. Simonyan K, Zisserman A. Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv:1409.1556, 2015.

  10. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. 2016;770-778. https://doi.org/10.1109/CVPR.2016.90.

  11. Kobyshev K, Voinov N, Nikiforov I. Hybrid image recommendation algorithm combining content and collaborative filtering approaches. Proc Comput Sci. 2021;193:200–9. https://doi.org/10.1016/j.procs.2021.10.020. (ISSN 1877-0509).

    Article  Google Scholar 

  12. Yassine A, Mohamed L, Al Achhab M. Hybrid recommendation system combined content-based filtering and collaborative prediction using artificial neural network. Simul Model Pract Theory. 2021;113: 102375. https://doi.org/10.1016/j.simpat.2021.102375. (ISSN 1569-190X).

    Article  Google Scholar 

  13. Sulthana AR, Gupta M, Subramanian S, et al. Improvising the performance of image-based recommendation system using convolution neural networks and deep learning. Soft Comput. 2020;24:14531–44. https://doi.org/10.1007/s00500-020-04803-0.

    Article  Google Scholar 

  14. Liu K, Xue F, Guo D, Sun P, Qian S, Hong R. Multimodal graph contrastive learning for multimedia-based recommendation. IEEE Trans Multimed. https://doi.org/10.1109/TMM.2023.3251108.

  15. Ahmadkhani S, Moghaddam ME. An image recommendation technique based on fuzzy inference system. Soft Comput. 2021;25:6427–43. https://doi.org/10.1007/s00500-021-05637-0.

    Article  Google Scholar 

  16. Wu L, Chen L, Hong R, Fu Y, Xie X, Wang M. A hierarchical attention model for social contextual image recommendation. IEEE Trans Knowl Data Eng. 2020;32(10):1854–67. https://doi.org/10.1109/TKDE.2019.2913394.

    Article  Google Scholar 

  17. Hwang S, Ahn H, Park E. iMovieRec: a hybrid movie recommendation method based on a user-image-item model. Int J Mach Learn Cyberm. 2023;14:3205–16. https://doi.org/10.1007/s13042-023-01828-3.

    Article  Google Scholar 

  18. Mu Y, Wu Y. Multimodal movie recommendation system using deep learning. Mathematics. 2023;11:895. https://doi.org/10.3390/math11040895.

    Article  Google Scholar 

  19. Jouyandeh F, Zadeh PM. IPARS: an image-based personalized advertisement recommendation system on social networks. 2022;201:375–82. https://doi.org/10.1016/j.procs.2022.03.050.

  20. Liu K, Xue F, Guo D, Sun P, Qian S, Hong R. Multimodal Graph contrastive learning for multimedia-based recommendation. IEEE Trans Multimed. 2023;25:9343–55. https://doi.org/10.1109/TMM.2023.3251108.

    Article  Google Scholar 

  21. Zhang Y, Xu K, Liang S, Zhao C. Matrix completion based on low-rank and local features applied to images recovery and recommendation systems. IEEE Access. 2022;10:97010–21. https://doi.org/10.1109/ACCESS.2022.3204660.

    Article  Google Scholar 

  22. Sun W, Jiang J, Huang Y, Li J, Zhang M. An integrated PCA-DAEGCN model for movie recommendation in the social internet of things. IEEE Internet Things J. 2022;9(12):9410–8. https://doi.org/10.1109/JIOT.2021.3111614.

    Article  Google Scholar 

  23. Wan S, Yang S, Liu Y, Ding J, Qiu D, Wei C. An image recommendation algorithm based on target alternating attention and user affiliation network. Appl Sci. 2023;13:4389. https://doi.org/10.3390/app13074389.

    Article  Google Scholar 

  24. Thai-Nghe N, Xuyen NTK, Tran AC, Dien TT. Dealing with new user problem using content-based deep matrix factorization. In: Fujita H, Wang Y, Xiao Y, Moonis A, editors. Advances and trends in artificial intelligence. Theory and applications. IEA/AIE 2023. Lecture Notes in Computer Science(), vol. 13926. Cham: Springer; 2023. https://doi.org/10.1007/978-3-031-36822-6_16.

    Chapter  Google Scholar 

  25. Bao LHQ, Khoa HHB, Thai-Nghe N. Image recommendation based on pre-trained deep learning and similarity matching. In: Thai-Nghe N, Do TN, Haddawy P, editors. Intelligent systems and data science. ISDS 2023. Communications in Computer and Information Science, vol. 301. Singapore: Springer; 2024. https://doi.org/10.1007/978-981-99-7649-2_20.

    Chapter  Google Scholar 

  26. Huynh T, Nguyen HD, Zelinka I, Pham XH, Pham VT, Selamat A, Krejcar O. A method to detect influencers in social networks based on the combination of amplification factors and content creation. PLoS One. 2022;17(10): e0274596. https://doi.org/10.1371/journal.pone.0274596. (PMID: 36201526; PMCID: PMC9536580).

    Article  Google Scholar 

Download references

Funding

There is no funding.

Author information

Authors and Affiliations

Authors

Contributions

The authors equally contribute to this work.

Corresponding author

Correspondence to Nguyen Thai-Nghe.

Ethics declarations

Conflict of Interest

There are no competing Interests.

Research Involving Human and /or Animals

Not applicable.

Informed consent

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bao, L.H.Q., Khoa, H.H.B. & Thai-Nghe, N. An Ensemble Model for Combining Deep Matrix Factorization and Image-Based Recommendation Systems. SN COMPUT. SCI. 5, 674 (2024). https://doi.org/10.1007/s42979-024-02978-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-024-02978-z

Keywords

Navigation