skip to main content
10.1145/3123266.3123268acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Fashion World Map: Understanding Cities Through Streetwear Fashion

Published: 19 October 2017 Publication History

Editorial Notes

The authors have requested minor, non-substantive changes to the VoR and, in accordance with ACM policies, a Corrected VoR was published on July 1, 2021. For reference purposes the VoR may still be accessed via the Supplemental Material section on this page.

Abstract

Fashion is an integral part of life. Streets as a social center for people's interaction become the most important public stage to showcase the fashion culture of a metropolitan area. In this paper, therefore, we propose a novel framework based on deep neural networks (DNN) for depicting the street fashion of a city by automatically discovering fashion items (e.g., jackets) in a particular look that are most iconic for the city, directly from a large collection of geo-tagged street fashion photos. To obtain a reasonable collection of iconic items, our task is formulated as the prize-collecting Steiner tree (PCST) problem, whereby a visually intuitive summary of the world's iconic street fashion can be created. To the best of our knowledge, this is the first work devoted to investigate the world's fashion landscape in modern times through the visual analytics of big social data. It shows how the visual impression of local fashion cultures across the world can be depicted, modeled, analyzed, compared, and exploited. In the experiments, our approach achieves the best performance (43.19%) on our large collected GSFashion dataset (170K photos), with an average of two times higher than all the other algorithms (FII: 20.13%, AP: 18.76%, DC: 17.90%), in terms of the users' agreement ratio on the discovered iconic fashion items of a city. The potential of our proposed framework for advanced sociological understanding is also demonstrated via practical applications.

Supplementary Material

3123268-vor (3123268-vor.pdf)
Version of Record for "Fashion World Map: Understanding Cities Through Streetwear Fashion" by Chang et al., Proceedings of the 25th ACM international conference on Multimedia (MM '21).

References

[1]
1913. One Look Is Worth A Thousand Words. Piqua Leader-Dispatch. (1913).
[2]
Tamara L. Berg and Alexander C. Berg. 2009. Finding Iconic Images. In CVPR.
[3]
Mario De Bortoli and Jesus Maroto. 2001. Colours across cultures: Translating colours in interactive marketing communications. In ELICIT.
[4]
K. Chen, K. Chen, P. Cong, W. H. Hsu, and J. Luo. 2015. Who are the devils wearing prada in new york city?. In ACM Multimedia.
[5]
Kuan-Ting Chen and Jiebo Luo. 2016. When Fashion Meets Big Data: Discriminative Mining of Best Selling Clothing Features. In WWW.
[6]
Qiang Chen, Junshi Huang, Rogerio Feris, Lisa M Brown, Jian Dong, and Shuicheng Yan. 2015. Deep Domain Adaptation for Describing People Based on Fine-Grained Clothing Attributes. In CVPR.
[7]
Heng-Yu Chi, Chun-Chieh Chen, Wen-Huang Cheng, and Ming-Syan Chen. 2015. UbiShop: Commercial item recommendation using visual part-based object representation. Multimedia Tools and Applications (2015).
[8]
Joan Clos. 2013. Streets as Public Spaces and Drivers of Urban Prosperity. UN- HABITAT.
[9]
Carl Doersch, Saurabh Singh, Abhinav Gupta, Josef Sivic, and Alexei A. Efros. 2012. What makes Paris look like Paris?. In ACM SIGGRAPH.
[10]
Brendan J. Frey and Delbert Dueck. 2007. Clustering by Passing Messages Between Data Points. Science 315, 1 (February 2007), 972--976.
[11]
Hancheng Ge and James Caverlee. 2016. College Towns, Vacation Spots, and Tech Hubs: Using Geo-Social Media to Model and Compare Locations. In AAAI.
[12]
Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-class Collaborative Filtering. In WWW.
[13]
Charles A. Heatwole. 2006. Culture: A Geographical Perspective. http://www. p12.nysed.gov/ciai/socst/grade3/geograph.html. (2006).
[14]
Shintami Chusnul Hidayati, Kai-Lung Hua, Wen-Huang Cheng, and Shih-Wei Sun. 2014. What are the Fashion Trends in New York?. In ACM Multimedia.
[15]
Tianran Hu, Eric Bigelow, and Jiebo Luo. 2016. Tales of Two Cities: Using Social Media to Understand Idiosyncratic Lifestyles in Distinctive Metropolitan Areas. IEEE Transactions on Big Data (2016).
[16]
Jia Jia, Jie Huang, Guangyao Shen, Tao He, Zhiyuan Liu, Huanbo Luan, and Chao Yan. 2015. Learning to Appreciate the Aesthetic Effects of Clothing. In AAAI.
[17]
M. Hadi Kiapour, Xufeng Han, Svetlana Lazebnik, Alexander C. Berg, and Tamara L. Berg. 2015. Where to Buy It: Matching Street Clothing Photos in Online Shops. In ICCV.
[18]
Tekoing Lim, Kai-Lung Hua, Hong-Cyuan Wang, Kai-Wen Zhao, Min-Chun Hu, and Wen-Huang Cheng. 2015. VRank: Voting System on Ranking Model for Human Age Estimation. In MMSP.
[19]
Si Liu, Luoqi Liu, and Shuicheng Yan. 2014. Fashion Analysis: Current Techniques and Future Directions. IEEE Multimedia 21, 2 (April-June 2014), 72--79.
[20]
Ziwei Liu, Sijie Yan, Ping Luo, Xiaogang Wang, and Xiaoou Tang. 2016. Fashion Landmark Detection in the Wild. In ECCV.
[21]
I. Ljubic, R. Weiskircher, U. Pferschy, G. W. Klau, P. Mutzel, and M. Fischetti. 2006. An algorithmic framework for the exact solution of the prize-collecting Steiner tree problem. Mathematical Programming 105, 2-3 (February 2006), 427--449.
[22]
Babak Loni, Lei Yen Cheung, Michael Riegler, Alessandro Bozzon, Luke Gottlieb, and Martha Larson. 2014. Fashion 10000: an enriched social image dataset for fashion and clothing. In MMSys .
[23]
Yihui Ma, Jia Jia, Suping Zhou, Jingtian Fu, Yejun Liu, and Zijian Tong. 2017. Towards Better Understanding the Clothing Fashion Styles: A Multimodal Deep Learning Approach. In AAAI.
[24]
Meredith Ringel Morris, Kori Inkpen, and Gina Venolia. 2014. Remote Shopping Advice: Enhancing In-Store Shopping with Social Technologies. In CSCW.
[25]
A.C. Murillo, I.S. Kwak, L. Bourdev, D. Kriegman, and S. Belongie. 2012. Urban Tribes: Analyzing Group Photos from a Social Perspective. In CVPR Workshop.
[26]
Tam V. Nguyen, Si Liu, Bingbing Ni, Jun Tan, Yong Rui, and Shuicheng Yan. 2012. Sense Beauty via Face, Dressing, and/or Voice. In ACM Multimedia.
[27]
Rahul Raguram and Svetlana Lazebnik. 2008. Computing Iconic Summaries of General Visual Concepts. In CVPR Workshop.
[28]
Boon-Siew Seah, Sourav S Bhowmick, and Aixin Sun. 2014. PRISM: Concept- preserving Social Image Search Results Summarization. In ACM SIGIR.
[29]
Edgar Simo-Serra, Sanja Fidler, Francesc Moreno-Noguer, and Raquel Urtasun. 2015. Neuroaesthetics in Fashion: Modeling the Perception of Fashionability. In CVPR.
[30]
Edgar Simo-Serra and Hiroshi Ishikawa. 2016. Fashion Style in 128 Floats: Joint Ranking and Classification using Weak Data for Feature Extraction. In CVPR.
[31]
Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In ICLR.
[32]
Zheng Song, Meng Wang, Xian-Sheng Hua, and Shuicheng Yan. 2011. Predicting occupation via human clothing and contexts. In ICCV.
[33]
Tsung-Hung Tsai, Wen-Huang Cheng, Chuang-Wen You, Min-Chun Hu, Arvin Wen Tsui, and Heng-Yu Chi. 2014. Learning and Recognition of On-Premise Signs (OPSs) from Weakly Labeled Street View Images. IEEE Transactions on Image Processing 23, 3 (March 2014), 1047--1059.
[34]
Andreas Veit, Balazs Kovacs, Sean Bell, Julian McAuley, Kavita Bala, and Serge Belongie. 2015. Learning Visual Clothing Style with Heterogeneous Dyadic Co-occurrences. In ICCV.
[35]
Vivek K. Verma. 2016. $2.1 trillion Global Apparel Market by 2025: Decoding opportunities for African Apparel Industry. http://educationwithvivek.blogspot. com. (2016).
[36]
Sudheendra Vijayanarasimhan and Kristen Grauman. 2011. Efficient Region Search for Object Detection. In CVPR.
[37]
Sirion Vittayakorn, Kota Yamaguchi, and Alexander C. Berg. 2015. Runway to Realway: Visual Analysis of Fashion. In WACV.
[38]
L. C. Wang, X. Y. Zeng, L. Koehl, and Y. Chen. 2015. Intelligent Fashion Recom- mender System: Fuzzy Logic in Personalized Garment Design. IEEE Transactions on Human-Machine Systems 45, 1 (February 2015), 95--109.
[39]
Bo Wu, Wen-Huang Cheng, Yongdong Zhang, and Tao Mei. 2016. Time Matters: Multi-scale Temporalization of Social Media Popularity. In ACM MM.
[40]
Bo Wu, Tao Mei, Wen-Huang Cheng, and Yongdong Zhang. 2016. Unfolding Temporal Dynamics: Predicting Social Media Popularity Using Multi-scale Temporal Decomposition. In AAAI.
[41]
Kota Yamaguchi, M. Hadi Kiapour, and Tamara L. Berg. 2013. Paper Doll Parsing: Retrieving Similar Styles to Parse Clothing Items. In ICCV.
[42]
Jason Yosinski, Jeff Clune, Anh Nguyen, Thomas Fuchs, and Hod Lipson. 2015. Understanding Neural Networks Through Deep Visualization. In ICML Workshop.
[43]
Dongfei Yu, Xinmei Tian, and Tao Mei. 2015. On the Selection of Trending Image from the Web. In ICME.
[44]
Bolei Zhou, Liu Liu, Aude Oliva, and Antonio Torralba. 2014. Recognizing City Identity via Attribute Analysis of Geo-tagged Images. In ECCV.

Cited By

View all
  • (2024)Toward Fashion Intelligence in the Big Data Era: State-of-the-Art and Future ProspectsIEEE Transactions on Consumer Electronics10.1109/TCE.2023.328588070:1(36-57)Online publication date: Feb-2024
  • (2023)A Systematic Review and Research Agenda of Body Image and Fashion TrendsInternational Journal of Case Studies in Business, IT, and Education10.47992/IJCSBE.2581.6942.0281(422-447)Online publication date: 30-Jun-2023
  • (2023)A Review of Modern Fashion Recommender SystemsACM Computing Surveys10.1145/362473356:4(1-37)Online publication date: 21-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '17: Proceedings of the 25th ACM international conference on Multimedia
October 2017
2028 pages
ISBN:9781450349062
DOI:10.1145/3123266
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. city profiling
  2. social media
  3. street fashion
  4. visual big data analysis

Qualifiers

  • Research-article

Conference

MM '17
Sponsor:
MM '17: ACM Multimedia Conference
October 23 - 27, 2017
California, Mountain View, USA

Acceptance Rates

MM '17 Paper Acceptance Rate 189 of 684 submissions, 28%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)121
  • Downloads (Last 6 weeks)11
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Toward Fashion Intelligence in the Big Data Era: State-of-the-Art and Future ProspectsIEEE Transactions on Consumer Electronics10.1109/TCE.2023.328588070:1(36-57)Online publication date: Feb-2024
  • (2023)A Systematic Review and Research Agenda of Body Image and Fashion TrendsInternational Journal of Case Studies in Business, IT, and Education10.47992/IJCSBE.2581.6942.0281(422-447)Online publication date: 30-Jun-2023
  • (2023)A Review of Modern Fashion Recommender SystemsACM Computing Surveys10.1145/362473356:4(1-37)Online publication date: 21-Oct-2023
  • (2023)A Survey of Artificial Intelligence in FashionIEEE Signal Processing Magazine10.1109/MSP.2022.323344940:3(64-73)Online publication date: May-2023
  • (2022)Community Trend Prediction on Heterogeneous Graph in E-commerceProceedings of the Fifteenth ACM International Conference on Web Search and Data Mining10.1145/3488560.3498522(1319-1327)Online publication date: 11-Feb-2022
  • (2021)Fashion Meets Computer VisionACM Computing Surveys10.1145/344723954:4(1-41)Online publication date: 2-Jul-2021
  • (2020)Deep spatial-temporal networks for flame detectionMultimedia Tools and Applications10.1007/s11042-020-10079-1Online publication date: 23-Nov-2020
  • (2019)Outfit Compatibility Prediction and Diagnosis with Multi-Layered Comparison NetworkProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3350909(329-337)Online publication date: 15-Oct-2019
  • (2019)Dressing for Attention: Outfit Based Fashion Popularity Prediction2019 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2019.8803461(3222-3226)Online publication date: Sep-2019
  • (2019)Seal imprint verification via feature analysis and classificationsFuture Generation Computer Systems10.1016/j.future.2019.04.027Online publication date: May-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media