Abstract
Recommender systems are widely used in many domains, especially in E-commerce. It can be used for attracting users by recommending appropriate products to them. There are many techniques in recommendation systems which can predict rating scores to recommend next products. In this work, we propose an ensemble model for combining Image-based recommendation and Deep Matrix factorization. Specifically, in the proposed model, we have utilized the pre-trained deep learning models (e.g., the VGG16) to extract the image features. Next, based on the image features, we compute similarities between the products to generate recommendations. We integrated the Deep Matrix Factorization model to predict the ratings between users and items into the Image-based recommendation to enhance the effectiveness of the recommendation model. Experimental results on public data sets show that the approach can give good recommendations at more than 90% of accuracy.


















Similar content being viewed by others
Data Availability Statement
Data sets are available, such as Style Color Imageshttps://www.kaggle.com/datasets/paramaggarwal/fashion-product-images-dataset, Fashion product images datasethttps://www.kaggle.com/datasets/paramaggarwal/fashion-product-images-dataset, and Amazon fashion review with imageshttps://cseweb.ucsd.edu/~jmcauley/datasets/amazon_v2/.
References
Dien TT, Nguyen T-H, Nguyen T-N. Novel approaches for searching and recommending learning resources. Cybern Inform Technol. 23(2, 3923): pp.151–169. https://doi.org/10.2478/cait-2023-0019.
Alamdari PM, Navimipour NJ, Hosseinzadeh M, Safaei AA, Darwesh A. Image-based product recommendation method for E-commerce applications using convolutional neural networks. Acta Inform Pragensia Prague Univ Econ Bus. 2022;2022(1):15–35.
Ullah F, Zhang B, Khan RU. Image-based service recommendation system: a JPEG-coefficient RFs approach. In IEEE Access. 2020;2020(8):3308–18. https://doi.org/10.1109/ACCESS.2019.2962315.
Tuinhof H, Pirker C, Haltmeier M. Image-based fashion product recommendation with deep learning. In: Nicosia G, Pardalos P, Giuffrida G, Umeton R, Sciacca V, editors. Machine learning, optimization, and data science. LOD 2018. Lecture Notes in Computer Science, vol. 1331. Cham: Springer; 2019. https://doi.org/10.1007/978-3-030-13709-0_40.
Yin P, Zhang L. Image recommendation algorithm based on deep learning. IEEE Access. 2020;8:132799–807. https://doi.org/10.1109/ACCESS.2020.3007353.
Sivaramakrishnan N, Subramaniyaswamy V, Viloria A, et al. A deep learning-based hybrid model for recommendation generation and ranking. Neural Comput Appl. 2021;33:10719–36. https://doi.org/10.1007/s00521-020-04844-4.
Yin P, Wang J, Zhao J, Wang H, Gan H. Deep collaborative filtering: a recommendation method for crowdfunding project based on the integration of deep neural network and collaborative filtering. Math Probl Eng. 2022;2022:1–15. https://doi.org/10.1155/2022/4655030.
Jena KK, Bhoi SK, Mallick C, et al. Neural model based collaborative filtering for movie recommendation system. Int J Inf Tecnol. 2022;14:2067–77. https://doi.org/10.1007/s41870-022-00858-4.
Simonyan K, Zisserman A. Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv:1409.1556, 2015.
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. 2016;770-778. https://doi.org/10.1109/CVPR.2016.90.
Kobyshev K, Voinov N, Nikiforov I. Hybrid image recommendation algorithm combining content and collaborative filtering approaches. Proc Comput Sci. 2021;193:200–9. https://doi.org/10.1016/j.procs.2021.10.020. (ISSN 1877-0509).
Yassine A, Mohamed L, Al Achhab M. Hybrid recommendation system combined content-based filtering and collaborative prediction using artificial neural network. Simul Model Pract Theory. 2021;113: 102375. https://doi.org/10.1016/j.simpat.2021.102375. (ISSN 1569-190X).
Sulthana AR, Gupta M, Subramanian S, et al. Improvising the performance of image-based recommendation system using convolution neural networks and deep learning. Soft Comput. 2020;24:14531–44. https://doi.org/10.1007/s00500-020-04803-0.
Liu K, Xue F, Guo D, Sun P, Qian S, Hong R. Multimodal graph contrastive learning for multimedia-based recommendation. IEEE Trans Multimed. https://doi.org/10.1109/TMM.2023.3251108.
Ahmadkhani S, Moghaddam ME. An image recommendation technique based on fuzzy inference system. Soft Comput. 2021;25:6427–43. https://doi.org/10.1007/s00500-021-05637-0.
Wu L, Chen L, Hong R, Fu Y, Xie X, Wang M. A hierarchical attention model for social contextual image recommendation. IEEE Trans Knowl Data Eng. 2020;32(10):1854–67. https://doi.org/10.1109/TKDE.2019.2913394.
Hwang S, Ahn H, Park E. iMovieRec: a hybrid movie recommendation method based on a user-image-item model. Int J Mach Learn Cyberm. 2023;14:3205–16. https://doi.org/10.1007/s13042-023-01828-3.
Mu Y, Wu Y. Multimodal movie recommendation system using deep learning. Mathematics. 2023;11:895. https://doi.org/10.3390/math11040895.
Jouyandeh F, Zadeh PM. IPARS: an image-based personalized advertisement recommendation system on social networks. 2022;201:375–82. https://doi.org/10.1016/j.procs.2022.03.050.
Liu K, Xue F, Guo D, Sun P, Qian S, Hong R. Multimodal Graph contrastive learning for multimedia-based recommendation. IEEE Trans Multimed. 2023;25:9343–55. https://doi.org/10.1109/TMM.2023.3251108.
Zhang Y, Xu K, Liang S, Zhao C. Matrix completion based on low-rank and local features applied to images recovery and recommendation systems. IEEE Access. 2022;10:97010–21. https://doi.org/10.1109/ACCESS.2022.3204660.
Sun W, Jiang J, Huang Y, Li J, Zhang M. An integrated PCA-DAEGCN model for movie recommendation in the social internet of things. IEEE Internet Things J. 2022;9(12):9410–8. https://doi.org/10.1109/JIOT.2021.3111614.
Wan S, Yang S, Liu Y, Ding J, Qiu D, Wei C. An image recommendation algorithm based on target alternating attention and user affiliation network. Appl Sci. 2023;13:4389. https://doi.org/10.3390/app13074389.
Thai-Nghe N, Xuyen NTK, Tran AC, Dien TT. Dealing with new user problem using content-based deep matrix factorization. In: Fujita H, Wang Y, Xiao Y, Moonis A, editors. Advances and trends in artificial intelligence. Theory and applications. IEA/AIE 2023. Lecture Notes in Computer Science(), vol. 13926. Cham: Springer; 2023. https://doi.org/10.1007/978-3-031-36822-6_16.
Bao LHQ, Khoa HHB, Thai-Nghe N. Image recommendation based on pre-trained deep learning and similarity matching. In: Thai-Nghe N, Do TN, Haddawy P, editors. Intelligent systems and data science. ISDS 2023. Communications in Computer and Information Science, vol. 301. Singapore: Springer; 2024. https://doi.org/10.1007/978-981-99-7649-2_20.
Huynh T, Nguyen HD, Zelinka I, Pham XH, Pham VT, Selamat A, Krejcar O. A method to detect influencers in social networks based on the combination of amplification factors and content creation. PLoS One. 2022;17(10): e0274596. https://doi.org/10.1371/journal.pone.0274596. (PMID: 36201526; PMCID: PMC9536580).
Funding
There is no funding.
Author information
Authors and Affiliations
Contributions
The authors equally contribute to this work.
Corresponding author
Ethics declarations
Conflict of Interest
There are no competing Interests.
Research Involving Human and /or Animals
Not applicable.
Informed consent
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Bao, L.H.Q., Khoa, H.H.B. & Thai-Nghe, N. An Ensemble Model for Combining Deep Matrix Factorization and Image-Based Recommendation Systems. SN COMPUT. SCI. 5, 674 (2024). https://doi.org/10.1007/s42979-024-02978-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-024-02978-z