Skip to main content
SpringerLink
Log in

Personalized clothing recommendation fusing the 4-season color system and users’ biological characteristics

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In clothing e-commerce, the challenge of optimally recommending clothing that suits a user’s unique characteristics remains a pressing issue. Many platforms simply recommend best-selling or popular clothing, without taking into account important attributes like user’s face color, pupil color, face shape, age, etc. To solve this problem, this paper proposes a personalized clothing recommendation algorithm that incorporates the established 4-Season Color System and user-specific biological characteristics. Firstly, the attributes and colors of clothing are classified by Fnet network, that can learn disjoint label combinations and mitigate the issue of excessive labels. Secondly, on the basis of the 4-Season Color System, the user’s face color model is trained by combined MobileNetV3_DTL, which ensures the model’s generalization and improves the training speed. Thirdly, user’s face shape and age are divided into different categories by an Inception network. Finally, according to the users’ face color, age, face shape and other information, personalized clothing is recommended in a coarse-to-fine manner. Experiments on five datasets demonstrate that the algorithm proposed in this paper achieves state-of-the-art results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

  2. Alzahrani T, Al-Nuaimy W, Al-Bander B (2019) “Hybrid Feature Learning and Engineering Based Approach for Face Shape Classification,” in International Conference on Intelligent Systems and Advanced Computing Sciences (ISACS), pp. 1–4 https://doi.org/10.1109/ISACS48493.2019.9068910

  3. Bansode NK, Sinha PK (2016) Face shape classification based on region similarity, correlation and fractal dimensions. Int J Comput Sci Issue (IJCSI) 13(1):24

    Article  Google Scholar 

  4. Chen W, Huang P, Xu J, et al. (2019) “Personalized outfit generation for fashion recommendation at alibaba ifashion,” in Proc. of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2662–2670 https://doi.org/10.1145/3292500.3330652

  5. Chen Y, Zhang Y, Huang Z, et al. (2021) CelebHair: a new large-scale dataset for hairstyle recommendation based on CelebA. arXiv preprint arXiv:2104.06885 https://doi.org/10.1007/978-3-030-82153-1_27

  6. Deng Q, Wang R, Gong Z, et al. (2018) “Research and Implementation of Personalized Clothing Recommendation Algorithm,” in 7th International Conference on Digital Home (ICDH), pp. 219–223 https://doi.org/10.1109/ICDH.2018.00046

  7. Eidinger E, Enbar R, Hassner T (2014) Age and gender estimation of unfiltered faces. IEEE Trans Inf Forensic Secur 9(12):2170–2179

    Article  Google Scholar 

  8. Zou X, Kong X, Wong W et al (2019) Fashionai: A hierarchical dataset for fashion understanding. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 0–0

  9. Gao F, Ai H (2009) “Face Age Classification on Consumer Images with Gabor Feature and Fuzzy Lda Method,” in International Conference on Biometrics, pp. 132–141 https://doi.org/10.1007/978-3-642-01793-3_14

  10. Gu S, Liu X, Cai L, Shen J (2017) “Fashion coordinates recommendation based on user behavior and visual clothing style,” in Proc. of the 3rd International Conference on Communication and Information Processing, pp. 185–189 https://doi.org/10.1145/3162957.3162982

  11. Guo G, Mu G (2011) “Simultaneous Dimensionality Reduction and Human Age Estimation Via Kernel Partial Least Squares Regression,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.657–664 https://doi.org/10.1109/CVPR.2011.5995404

  12. Guo G, Mu G, Fu Y, Huang TS (2009) “Human age estimation using bio-inspired features,” in IEEE Conf. on computer vision and pattern recognition, pp. 112–119 https://doi.org/10.1109/CVPR.2009.5206681

  13. Hassan KR, Ali IH (2020) Age and gender classification using multiple convolutional neural network[C//IOP conference series: Mater Sci Eng: 32-39 https://doi.org/10.1088/1757-899X/928/3/032039.

  14. Howard AG, Zhu M, Chen B, Kalenichenko D, et al (2017) “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” in Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9

  15. Jackson C (1985) Color me beautiful:Discover your natural beauty through the colors that make you look great & feel fabulous! New York: Ballantine Books, 15-21

  16. Li L, So J, Shin HC, Han Y (2013) An AAM-based face shape classification method used for facial expression recognition. Int J Res Eng Technol (IJRET) 2(4):164–168

    Google Scholar 

  17. Lin Z, Chen H (2019) Recommendation over time: a probabilistic model of time-aware recommender systems. Sci Chin Inf Sci 62(11):1–14

    Article  MathSciNet  Google Scholar 

  18. Lin YR, Su WH, Lin CH, et al. (2019) “Clothing Recommendation System based on Visual Information Analytics,” in International Automatic Control Conference (CACS), pp. 1–6 https://doi.org/10.1109/CACS47674.2019.9024361

  19. Lin Y, Moosaei M, Yang H (2020) “OutfitNet: Fashion outfit recommendation with attention-based multiple instance learning,” in Proc. of The Web Conference, pp. 77–87 https://doi.org/10.1145/3366423.3380096

  20. Liu C, Wechsler H (2002) Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans Image Process 11(4):467–476

    Article  Google Scholar 

  21. Nhan Duong C, Luu K, et al. (2016) “Longitudinal face modeling via temporal deep restricted boltzmann machines,” in Proc. of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5772–5780 https://doi.org/10.1109/CVPR.2016.622

  22. Sunhem W, Pasupa K (2016) An approach to face shape classification for hairstyle recommendation. In: Eighth International Conference on Advanced Computational Intelligence (ICACI), IEEE,  pp. 390-394

  23. Pasupa K, Sunhem W, Loo CK (2019) A hybrid approach to building face shape classifier for hairstyle recommender system. Expert Syst Appl 120:14–32

    Article  Google Scholar 

  24. Standley T, Zamir A, Chen D, et al (2020) “Which tasks should be learned together in multi-task learning?” in International Conference on Machine Learning, pp. 9120–9132

  25. Su X, Gao M, Ren J et al (2020) Personalized clothing recommendation based on user emotional analysis. Discret Dyn Nat Soc

  26. Tio AE (2019) Face shape classification using inception v3. arXiv preprint arXiv:1911.07916

  27. Twigg J (2009) Dress and the narration of life: Women’s reflection on clothing and age. Russell Press, UK

    Google Scholar 

  28. Wen Y, Liu X, Xu B (2018) Personalized clothing recommendation based on knowledge graph. In: International Conference on Audio, Language and Image Processing (ICALIP), IEEE, pp. 1-5

  29. Xu YL, Qiu JX, Ma L (2010) “Measurement and classification of shanghai female face shape based on 3D image feature,” in 3rd International Congress on Image and Signal Processing (CISP), pp. 2588–2592 https://doi.org/10.1109/CISP.2010.5648207

  30. Xu D, Shi Y, Tsang IW et al (2019) A survey on multi-output learning. IEEE Trans Neural Netw Learn Syst 31(7):2409–2429. https://doi.org/10.1109/TNNLS.2019.2945133

    Article  MathSciNet  Google Scholar 

  31. Yaman D, Eyiokur FI, Sezgin N, et al. (2018) “Age and gender classification from ear images,” in International Workshop on Biometrics and Forensics (IWBF), pp. 1–7 https://doi.org/10.1109/IWBF.2018.8401568

  32. Yaman D, Eyiokur FI, Ekenel H. K (2019) “Multimodal age and gender classification using ear and profile face images,” in Proc. of IEEE/CVF Conf. on computer vision and pattern recognition Workshops, pp. 13–22 https://doi.org/10.1109/CVPRW.2019.00296

  33. Yan S, Zhou X, Liu M, et al. (2008) “Regression from Patch-kernel,” in IEEE Computer Society Conf. on computer vision and pattern recognition, pp. 1–8 https://doi.org/10.1109/CVPR.2008.4587405

  34. Zhang K, Zhang Z, Li Z et al (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process Lett 23(10):1499–1503. https://doi.org/10.1109/LSP.2016.2603342

    Article  Google Scholar 

  35. Zhuang X, Zhou X, Hasegawa-Johnson M, et al. (2008) “Face Age Estimation Using Patch-based Hidden Markov Model Supervectors,” in International Conference on Pattern Recognition, pp. 1–4

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (grant no. 61902301), the Natural Science Basic Research Key Program funded by Shaanxi Provincial Science and Technology Department(2022JZ-35), Shaanxi Natural Science Basic Research Project (grant no. 2022JM-394, 2022JQ-711), the Key Scientific Research Program funded by the Shaanxi Provincial Education Department (grant no. 22JS019), and Xi’an Science and Technology Bureau Science and Technology Innovation Leading Project (grant no. 21XJZZ0020 and 21XJZZ0022), and Science and Technology Guidance Program of China National Textile And Apparel Council (2020100).

Author information

Authors and Affiliations

  1. College of Information and Technology, Northwest University of China, Xi’an, China

    Xueping Su & Jinye Peng

  2. School of Electronics and Information, Xi’an Polytechnic University, Xi’an, China

    Xueping Su, Jiawei Duan, Jie Ren & Yunhong Li

  3. Interactive and Mobile Robotics and Artificial Intelligence, Department of Engineering, Reutlingen University, Reutlingen, Germany

    Michael Danner & Matthias Rätsch

Authors
  1. Xueping Su
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiawei Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jie Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yunhong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michael Danner
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Matthias Rätsch
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jinye Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xueping Su.

Ethics declarations

Several images in our dataset were provided by our teachers and students and may contain sensitive personal information, which makes them unsuitable for sharing.

Disclosures

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Su, X., Duan, J., Ren, J. et al. Personalized clothing recommendation fusing the 4-season color system and users’ biological characteristics. Multimed Tools Appl 83, 12597–12625 (2024). https://doi.org/10.1007/s11042-023-16014-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16014-4

Keywords

Search

Navigation