skip to main content
10.1145/3469951.3469961acmotherconferencesArticle/Chapter ViewAbstractPublication PagesipmvConference Proceedingsconference-collections
Article

Clothing Image Retrieval Based on Parts Detection and Segmentation

Published: 21 August 2021 Publication History

Abstract

With the rapid development of E-commerce, more and more users are buying clothes through the Internet, and "image search" for clothing images has become a popular research direction. The current "image search" technology mainly relies on the results of feature extraction of the whole image, but cannot focus on the parts of the clothing, and the background of the clothing image is generally complex, resulting in low accuracy of clothing image retrieval, so we propose a retrieval method based on clothing image detection and segmentation. Firstly, Mask R-CNN is used to detect and segment the image to get the information of garment body, collar parts, sleeve category and pocket positions, then VGG16 is used to extract 512-dimensional features from the garment body and collar parts, based on this information, the similarity between the garment to be retrieved and the garment in the database is calculated one by one. We calculate the similarity by weighting the cosine similarity of 512-dimensional features of the garment body and collar, as well as the similarity of the sleeves and pockets. The search results are presented to the user according to the descending order of similarity. The experimental results show that the method can focus on the whole garment as well as their parts, thus enabling retrieval based on garment style. It also allows users to adjust the weights of each part and can return the search results that best meet their individual needs

References

[1]
Jeong-Yo Ha, Mi-Young Choi, and Hyung-Il Choi. 2002. Content-based Image Retrieval Using Color and Shape. Proc of the Acm Symposium on Applied Computing, 13, 1, 687-692
[2]
Xiongmei Zeng. 2019. Research on clothing image retrieval by region of interest and feature fusion. Huazhong University of Science and Technology, China
[3]
Peizhong Liu, Jing-Ming Guo, Chi-Yi Wu, and Danlin Cai. 2017. Fusion of Deep Learning and Compressed Domain Features for Content-Based Image Retrieval. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society, 12,1-1
[4]
Kaiming He, Georgia Gkioxari, Piotr Dollar, and Ross Girshick. 2017. Mask R-CNN. In 2017 IEEE International Conference on Computer Vision (ICCV)
[5]
Zhiyuan Lu, Ling Shen, Ling Shen, and Yong Zhao. 2012. Semantic classification based clothing image retrieval. In 2012 International Conference Audio, Language and Image Processing (ICALIP)
[6]
Hailong Wang, Junli Du,and Qingyu Guo. 2009. The Application of Content Based Image Retrieval Technology in Clothing Retrieval System. Computing Technology and Automation, 28, 02, 89-91
[7]
Qiaoli Jia, Juan Wang, and Bing Kong. 2011. Clothing Image Retrieval Based on Color and Texture. Modern Computer, 07, 30-32.
[8]
Kiapour M H, Han X, and Lazebnik S, 2015. Where to Buy It: Matching Street Clothing Photos in Online Shops. In 2015 IEEE International Conference on Computer Vision (ICCV). IEEE, 3343-3351
[9]
Ming Yang, and Kai Yu. 2011. Real-time clothing recognition in surveillance videos. In 8th IEEE International Conference on Image Processing. IEEE, 11-14
[10]
David Freire-Obregón, Modesto Castrillón Santana, Javier Lorenzo-Navarro, and Enrique Ramón-Balmaseda. 2014. Automatic Clothes Segmentation for Soft Biometrics. In 2014 IEEE International Conference on Image Processing (ICIP). IEEE, 4972-4976
[11]
Dongmei Huang, Li Liu, Xiaodong Fu, and Qingsong Huang. 2017. Segmentation algorithm of clothing image based on HOG and E-SVM, 53, 18, 199-203
[12]
Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis & Machine Intelligence, 39, 6, 1137-1149
[13]
Yuanyuan Hou, Ruhan He, Min Li, and Jia Chen. 2019. Clothing Image Retrieval Method Combining Convolutional Neural Network Multi-layer Feature Fusion and K-Means Clustering. COMPUTER SCIENCE, 46, S1, 215-221.

Cited By

View all
  • (2024)Generative AI-based style recommendation using fashion item detection and classificationSignal, Image and Video Processing10.1007/s11760-024-03538-x18:12(9179-9189)Online publication date: 13-Sep-2024
  • (2023)Artificial Intelligence in Business-to-Customer Fashion Retail: A Literature ReviewMathematics10.3390/math1113294311:13(2943)Online publication date: 30-Jun-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
IPMV '21: Proceedings of the 2021 3rd International Conference on Image Processing and Machine Vision
May 2021
87 pages
ISBN:9781450390040
DOI:10.1145/3469951
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 August 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Clothing image retrieval
  2. Mask R-CNN
  3. Similarity
  4. VGG16
  5. Weights

Qualifiers

  • Article
  • Research
  • Refereed limited

Funding Sources

  • Shanghai Municipal Natural Science Foundation
  • Special Fund for Innovation and Development of Shanghai Industrial Internet

Conference

IPMV 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)34
  • Downloads (Last 6 weeks)2
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Generative AI-based style recommendation using fashion item detection and classificationSignal, Image and Video Processing10.1007/s11760-024-03538-x18:12(9179-9189)Online publication date: 13-Sep-2024
  • (2023)Artificial Intelligence in Business-to-Customer Fashion Retail: A Literature ReviewMathematics10.3390/math1113294311:13(2943)Online publication date: 30-Jun-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media