Skip to main content
SpringerLink
Log in

Personalized clothing recommendation combining user social circle and fashion style consistency

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With the rapid expansion of social networks and fashion websites, clothing recommendation has attracted more attention of researchers, since various web data bring opportunities for recommender systems to solve the problems of cold start and sparsity. For clothing recommender system, user social circle and fashion style consistency of clothing items are two important factors, which have critical impacts on user decision making. In this paper, two practical problems are considered: how to visually analyze fashion style consistency between clothing items and how to implement personalized clothing recommendation by combining user social circle and fashion style consistency. To address the first problem, a Siamese Convolutional Neural Network (SCNN) with a novel sampling strategy is employed to measure the fashion style consistency of clothing items. It can learn a feature transformation from clothing images to a latent feature space, where the representations of clothing items with similar styles locate closer than those with different styles. For the second problem, three social factors (i.e., personal interest, interpersonal interest similarity and interpersonal influence) and fashion style consistency are fused into a unified personalized recommendation model based on probabilistic matrix factorization (PMF). To comprehensively evaluate our model, extensive experiments have been conducted on two real world datasets collected from a popular social fashion website, which demonstrate the effectiveness of the proposed method for personalized clothing recommendation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. 1 http://www.mogujie.com/.

  2. 2 https://www.pinterest.com/.

  3. 3 https://www.polyvore.com/.

References

  1. Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749

    Article  Google Scholar 

  2. Bossard L, Dantone M, Leistner C, Wengert C, Quack T, Gool L V (2013) Apparel classification with style. In: Asian conference on computer vision, pp 321–335

  3. Chen H, Gallagher A, Girod B (2012) Describing clothing by semantic attributes. In: European conference on computer vision, pp 609–623

  4. Cui P, Wang F, Liu S, Ou M, Yang S, Sun L (2011) Who should share what?: item-level social influence prediction for users and posts ranking. In: International ACM SIGIR conference on research and development in information retrieval, pp 185–194

  5. Cui P, Wang F, Yang S, Sun L (2011) Item-level social influence prediction with probabilistic hybrid factor matrix factorization. In: AAAI conference on artificial intelligence

  6. Fu J, Wang J, Li Z, Xu M, Lu H (2012) Efficient clothing retrieval with semantic-preserving visual phrases. In: Asian conference on computer vision, pp 420–431

  7. Gao H, Tang J, Hu X, Liu H (2015) Content-aware point of interest recommendation on location-based social networks. In: AAAI conference on artificial intelligence, pp 1721–1727

  8. He R, McAuley J (2016) Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: International conference on world wide web, pp 507–517

  9. Hu Y, Yi X, Davis L S (2015) Collaborative fashion recommendation: a functional tensor factorization approach. In: ACM international conference on multimedia, pp 129–138

  10. Huang J, Feris R S, Chen Q, Yan S (2015) Cross-domain image retrieval with a dual attribute-aware ranking network. In: International conference on computer vision, pp 1062–1070

  11. Jagadeesh V, Piramuthu R, Bhardwaj A, Di W, Sundaresan N (2014) Large scale visual recommendations from street fashion images. In: ACM conference on knowledge discovery and data mining, pp 1925–1934

  12. Jamali M, Ester M (2009) TrustWalker: a random walk model for combining trust-based and item-based recommendation. In: ACM conference on knowledge discovery and data mining, pp 397–406

  13. Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. arXiv:http://arXiv.org/abs/1408.5093

  14. Jiang M, Cui P, Liu R, Yang Q, Wang F, Zhu W, Yang S (2012) Social contextual recommendation. In: International conference on information and knowledge management, pp 45–54

  15. Jiang S, Qian X, Shen J, Fu Y, Mei T (2015) Author topic model-based collaborative filtering for personalized POI recommendations. IEEE Trans Multimed 17(6):907–918

    Google Scholar 

  16. Kalantidis Y, Kennedy L, Li L (2013) Getting the look: clothing recognition and segmentation for automatic product suggestions in everyday photos. In: International conference on multimedia retrieval, pp 105–112

  17. Kiapour M H, Yamaguchi K, Berg A C, Berg T L (2014) Hipster wars: discovering elements of fashion styles. In: European conference on computer vision, pp 472–488

  18. Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ACM conference on knowledge discovery and data mining, pp 426–434

  19. Liang X, Lin L, Yang W, Luo P, Huang J, Yan S (2016) Clothes co-parsing via joint image segmentation and labeling with application to clothing retrieval. IEEE Trans Multimed 18(6):1175–1186

    Article  Google Scholar 

  20. Liu S, Feng J, Song Z, Zhang T, Lu H, Xu C, Yan S (2012) Hi, magic closet, tell me what to wear! In: ACM international conference on multimedia MM, pp 619–628

  21. Liu S, Song Z, Liu G, Xu C, Lu H, Yan S (2012) Street-to-shop: cross-scenario clothing retrieval via parts alignment and auxiliary set. In: Computer vision and pattern recognition, pp 3330–3337

  22. Liu S, Feng J, Domokos C, Xu H, Huang J, Hu Z, Yan S (2014) Fashion parsing with weak color-category labels. IEEE Trans Multimed 16(1):253–265

    Article  Google Scholar 

  23. Liu Z, Luo P, Qiu S, Wang X, Tang X (2016) Deepfashion: powering robust clothes recognition and retrieval with rich annotations. In: Computer vision and pattern recognition, pp 1096–1104

  24. Ma H, King I, Lyu M R (2009) Learning to recommend with social trust ensemble. In: International ACM SIGIR conference on research and development in information retrieval, pp 203–210

  25. McAuley J J, Targett C, Shi Q, van den Hengel A (2015) Image-based recommendations on styles and substitutes. In: International ACM SIGIR conference on research and development in information retrieval, pp 43–52

  26. Nogueira K, Veloso A A, dos Santos J A (2016) Pointwise and pairwise clothing annotation: combining features from social media. Multimed Tools Appl 75 (7):4083–4113

    Article  Google Scholar 

  27. Qian X, Liu X, Zheng C, Du Y, Hou X (2013) Tagging photos using users’ vocabularies. Neurocomputing 111:144–153

    Article  Google Scholar 

  28. Qian X, Feng H, Zhao G, Mei T (2014) Personalized recommendation combining user interest and social circle. IEEE Trans Knowl Data Eng 26(7):1763–1777

    Article  Google Scholar 

  29. Resnick P, Iacovou N, Suchak M, Bergstrom P, Riedl J (1994) Grouplens: an open architecture for collaborative filtering of netnews. In: ACM conference on computer supported cooperative work and social computing, pp 175–186

  30. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M S, Berg A C, Li F (2014) Imagenet large scale visual recognition challenge. CoRR arXiv:1409.0575

  31. Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: Neural information processing systems, pp 1257–1264

  32. Sarwar B M, Karypis G, Konstan J A, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: International conference on World Wide Web, pp 285–295

  33. Simo-Serra E, Fidler S, Moreno-Noguer F, Urtasun R (2015) Neuroaesthetics in fashion: modeling the perception of fashionability. In: Computer vision and pattern recognition

  34. Sun G, Wu X, Peng Q (2016) Part-based clothing image annotation by visual neighbor retrieval. Neurocomputing 213:115–124

    Article  Google Scholar 

  35. Veit A, Kovacs B, Bell S, McAuley J, Bala K, Belongie S J (2015) Learning visual clothing style with heterogeneous dyadic co-occurrences. In: International conference on computer vision, pp 4642–4650

  36. Wang X, Zhang T (2011) Clothes search in consumer photos via color matching and attribute learning. In: ACM international conference on multimedia, pp 1353–1356

  37. Wang Z, Sun L, Zhu W, Yang S, Li H, Wu D (2013) Joint social and content recommendation for user-generated videos in online social network. IEEE Trans Multimed 15(3):698–709

    Article  Google Scholar 

  38. Yamaguchi K, Kiapour M H, Ortiz L E, Berg T L (2012) Parsing clothing in fashion photographs. In: Computer vision and pattern recognition, pp 3570–3577

  39. Yamaguchi K, Kiapour M H, Berg T L (2013) Paper doll parsing: retrieving similar styles to parse clothing items. In: International conference on computer vision, pp 3519–3526

  40. Yamaguchi K, Berg T L, Ortiz L E (2014) Chic or social: visual popularity analysis in online fashion networks. In: ACM international conference on multimedia, pp 773–776

  41. Yang X, Steck H, Liu Y (2012) Circle-based recommendation in online social networks. In: ACM conference on knowledge discovery and data mining, pp 1267–1275

  42. Zhao B, Wu X, Peng Q, Yan S (2016) Clothing cosegmentation for shopping images with cluttered background. IEEE Trans Multimed 18(6):1111–1123

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by the National Natural Science Foundation of China (Grant Nos. 61373121 and 61772436).

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Southwest Jiaotong University, Chengdu, China

    Guang-Lu Sun, Zhi-Qi Cheng, Xiao Wu & Qiang Peng

Authors
  1. Guang-Lu Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhi-Qi Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiao Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qiang Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiao Wu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, GL., Cheng, ZQ., Wu, X. et al. Personalized clothing recommendation combining user social circle and fashion style consistency. Multimed Tools Appl 77, 17731–17754 (2018). https://doi.org/10.1007/s11042-017-5245-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5245-1

Keywords

Search

Navigation