Abstract
Information retrieval is useful in all aspects of life, ranging from clothing shopping to education and academic pursuits. Many systems optimize models with pairwise ranking techniques such as Bayesian Personalized Ranking (BPR) for personalized information retrieval. A Bayesian personalized ranking system can assist specific shoppers, students, and researchers based on their interaction, which has illustrated an enormous capability for improvement by generating intelligent recommendations, such as clothing, books, and other related information. However, for such users, finding the desired clothing and books online is complex and is influenced by various factors (e.g., visual appearance and time). As such, traditional personalized recommendation methods that model only user-product interaction data would deliver unsatisfactory recommendation results. In this paper, we propose combining visual, temporal, and sequential information for personalized recommendations. Technically speaking, our main contributions include: (1) We incorporate the image features of clothing and books into personalized ranking to model users’ preferences. (2) We design a new time model for personalized recommender systems. The visual features are then injected into the time model to capture the temporal dynamics of visual preferences. (3) To this end, we present a Time Hierarchical Embedding (T-Sherlock) approach, which can incorporate sequential and temporal information simultaneously to model users’ preferences for different categories of products. To reduce the impact of adversarial noise, we train a T-Sherlock objective function using minimax adversarial training (AT-Sherlock). Experiments on real-world datasets demonstrated the efficacy of our methods in comparison to baselines.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11042-022-12259-7/MediaObjects/11042_2022_12259_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11042-022-12259-7/MediaObjects/11042_2022_12259_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11042-022-12259-7/MediaObjects/11042_2022_12259_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11042-022-12259-7/MediaObjects/11042_2022_12259_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11042-022-12259-7/MediaObjects/11042_2022_12259_Fig5_HTML.png)
Similar content being viewed by others
References
Deldjoo Y, Elahi M, Cremonesi P, Garzotto F, varPiazzolla P, Quadrana M (2016) Content-based video recommendation system based on stylistic visual features. J Data Semantics, pp 99–113
Deldjoo Y, Noia TD, Merra FA (2020) Adversarial machine learning in recommender systems (AML-recsys). In: Thirteenth ACM international conference on web search and data mining, pp 869–872
Donaldson J (2007) A hybrid social-acoustic recommendation system for popular music. In: Proceedings of the 2007 ACM conference on recommender systems, pp 187–190
Dong-Jin YU, Chen C, Jian-Hua WU, Chen YW (2018) Personalized game recommendation based on implicit feedback. Chin J Electron 27(4):2626–2632
Geng X, Zhang H, Bian J, Chua TS (2015) Learning image and user features for recommendation in social networks. In: IEEE international conference on computer vision, pp 4274–4282
Goodfellow IJ, Shlens J, Szegedy C (2015) Explaining and Harnessing Adversarial Examples. http://arxiv.org/abs/1412.6572
He X, He Z, Du X, Chua TS (2018) Adversarial personalized ranking for recommendation. In: The 41st international ACM SIGIR conference on research and development in information retrieval, pp 355–364
He X, He Z, Song J, Liu Z, Jiang YG et al (2018) Nais: Neural attentive item similarity model for recommendation. IEEE Trans on Knowl and Data Eng 30(12):2354–2366
He R, Lin C, Wang J, Mcauley J (2016) Sherlock: Sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 3740–3746
He R, Mcauley J (2016) VBPR: Visual Bayesian Personalized Ranking From implicit feedback. In: Proceedings of the Thirtieth conference on artificial intelligence, pp 144–150
Hu Y, Koren Y, Volinsky C (2008) Collaborative filtering for implicit feedback datasets. In: Proc of the 8th IEEE Int Conf on Data Mining, pp 263–272
Jian M, Jia T, Yang X, Wu L, Huo L (2019) Cross-modal collaborative manifold propagation for image recommendation. In: Proceedings of the 2019 on international conference on multimedia retrieval, pp 344–348
Kang WC, Fang C, Wang Z, McAuley JJ (2017) Visually-Aware Fashion recommendation and design with generative image models. In: IEEE International Conference on Data Mining, pp 207–216
Koren Y, Bell R (2011) Advances in collaborative filtering. Recommender Systems Handbook, pp 145–186
Kurakin A, Goodfellow I, Bengio S (2017) Adversarial machine learning at scale. http://arxiv.org/abs/1611.01236
Kurakin A, Goodfellow IJ, Bengio S (2017) Adversarial examples in the physical world. http://arxiv.org/abs/1607.02533
Liu TY (2009) Learning to rank for information retrieval. Found Trends Inf Ret 3(3):225–331
Liu Q, Wu S, Wang L (2017) Deepstyle: Learning user preferences for visual recommendation. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 841–844
McAuley J, Pandey R, Leskovec J (2015) Inferring networks of substitutable and complementary products. In: Proceedings of the 21th ACM international conference on knowledge discovery and data mining, pp 785–794
Miyato T, Dai AM, Goodfellow I (2016) Adversarial training methods for semi-supervised text classification. http://arxiv.org/abs/1605.07725
Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: Bayesian Personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth conference on uncertainty in artificial intelligence, pp 452–461
Tang J, Du X, He X, Yuan F, Tian Q, et al (2020) Adversarial training towards robust multimedia recommender system. IEEE Trans Knowl Data Eng 32(5):855–867
Wang S, Wang Y, Tang J, Shu K, Ranganath S, Liu H (2017) What your images reveal: exploiting visual contents for point-of-interest recommendation. In: Proceedings of the 26th international conference on world wide web, pp 391–400
Wu L, Chen L, Hong R, Fu Y, Xie X, Wang M (2020) A hierarchical attention model for social contextual image recommendation. IEEE Trans Knowl Data Eng 32(10):1854–1867
Wu Z, Paul A, Chan M, Zhou H, Xiang Y (2017) Improved one-class collaborative filtering for online recommendation. Int Workshop on Complex Systems and Networks
Yin R, Li K, Lu J, Zhang G (2019) Enhancing fashion recommendation with visual compatibility relationship. In: The world wide web conference, pp 3434–3440
Yu W, Zhang H, He X, Chen X, Xiong L, Qin Z (2018) Aesthetic-based clothing recommendation. In: Proceedings of the world wide web conference, pp 649–658
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Paul, A., Wu, Z., Liu, K. et al. Personalized recommendation: From clothing to academic. Multimed Tools Appl 81, 14573–14588 (2022). https://doi.org/10.1007/s11042-022-12259-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12259-7