Skip to main content
SpringerLink
Log in

Predicting clothing attributes with CNN and SURF based classification model

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Fashion industry utilizes learning-based strategy for e-commerce applications such as apparel recognition, apparel search, and apparel attribute detection. However, apparel recognition is challenging due to variability in tags for similarly looking apparels. This work utilizes a combination of Convolutional Neural Network and Speed up Robust Feature to propose a framework for efficient apparel recognition. Research highlights that a good quality cloth image provides more information and hence better feature extraction. This work thus proposes Atmospheric Dark Light Adjustment (ADLA) technique to enhance image in the pre-processing phase of the framework. Effectiveness of the proposed integration (ADLA, SURF, and CNN) is validated by experimental results using six apparel attributes on three datasets, namely LSF, DeepFashion2, and Consumer to shop. Results obtained for various performance parameters ensure the desired accuracy. Experimental results are computed for further performance analysis using precision, recall, f-measure, and accuracy parameters. Results show improvements by nearly 4%, 10%, 6%, and 4%, respectively, for the same as compared to CNN alone. Comparison with prior mechanisms considering LSF dataset also highlights the superiority of the proposed framework. Overall, the proposed framework using ADLA with SURF-CNN enhances the performance by 4% to 10% using three fashion datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Bedeli M, Geradts Z, van Eijk E (2018) Clothing identification via deep learning: forensic applications. Forensic Sci Res 3(3):219–229

    Article  Google Scholar 

  2. Chenbunyanon C, Jiang J-H (2018) Clothing classification with multi-attribute using convolutional neural network. In: International computer symposium. Springer, Singapore, pp 190–196

    Google Scholar 

  3. Damodaran S et al (2018) Scene classification using transfer learning. In: Studies in computational intelligence, pp 363–399

  4. Foody GM, Mathur A (2004) A relative evaluation of multiclass image classification by support vector machines. IEEE Trans Geosci Remote Sens 42(6):1335–1343

    Article  Google Scholar 

  5. Halstead MA et al (2019) Multimodal clothing recognition for semantic search in unconstrained surveillance imagery. J Vis Commun Image Represent 58:439–452

    Article  Google Scholar 

  6. Hassaballah M, Awad AI (2016) Detection and description of image features: an introduction. In: Image feature detectors and descriptors. Springer, Cham, pp 1–8

    Google Scholar 

  7. Huang Z et al (2018) Framelet regularization for uneven intensity correction of color images with illumination and reflectance estimation. Neurocomputing 314:154–168

    Article  Google Scholar 

  8. Huang J et al (2019) Real-time clothing detection with convolutional neural network. In: Recent developments in intelligent computing, communication and devices. Springer, Singapore, pp 233–239

    Chapter  Google Scholar 

  9. Jain P, Kankani A, Amali DGB (2019) A new technique for accurate segmentation, and detection of outfit using convolution neural networks. In: Information systems design and intelligent applications. Springer, Singapore, pp 169–177

    Chapter  Google Scholar 

  10. Lee W et al (2018) Clothing attribute extraction using convolutional neural networks. In: Pacific rim knowledge acquisition workshop. Springer, Cham, pp 241–250

    Google Scholar 

  11. Li A et al (2014) Clothing attributes assisted person reidentification. IEEE Trans Circuits Syst Video Technol 25(5):869–878

    Article  Google Scholar 

  12. Li Y et al (2017) Mining fashion outfit composition using an end-to-end deep learning approach on set data. IEEE Trans Multimedia 6(1):1946–1955

    Article  Google Scholar 

  13. Li M et al (2018) Structure-revealing low-light image enhancement via robust retinex model. IEEE Trans Image Process 27(6):2828–2841

    Article  MathSciNet  MATH  Google Scholar 

  14. Li Y, Chen T, Huang Z (2021) Attribute-aware explainable complementary clothing recommendation. World Wide Web 24(5):1885–1901

    Article  Google Scholar 

  15. Li Y, He Z, Wang S, Wang Z, Huang W (2021) Multideep feature fusion algorithm for clothing style recognition. Wirel Commun Mob Comput

  16. Lin J, Song X, Gan T, Yao Y, Liu W, Nie L (2021) PaintNet: a shape-constrained generative framework for generating clothing from fashion model. Multimed Tools Appl 80(11):17183–17203

    Article  Google Scholar 

  17. Liu S et al (2013) Fashion parsing with weak color-category labels. IEEE Trans Multimedia 16(1):253–265

    Article  Google Scholar 

  18. Medina A, Méndez JI, Ponce P, Peffer T, Meier A, Molina A (2022) Using deep learning in real-time for clothing classification with connected thermostats. Energies 15(5):1811

    Article  Google Scholar 

  19. Papegnies, Etienne, et al.: Impact of content features for automatic online abuse detection, International conference on computational linguistics and intelligent text processing. Springer, Cham, 2017, 19 (8), pp. 1946–1955.

    Google Scholar 

  20. Reza AM (2004) Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. J VLSI Signal Process Syst Signal Image Video Technol 38(1):35–44

    Article  Google Scholar 

  21. Sales LF, Pereira A, Vieira T, de Barros Costa E (2021) Multimodal deep neural networks for attribute prediction and applications to e-commerce catalogs enhancement. Multimed Tools Appl 80(17):25851–25873

    Article  Google Scholar 

  22. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  23. Seo Y, Shin K-s (2019) Hierarchical convolutional neural networks for fashion image classification. Expert Syst Appl 116:328–339

    Article  Google Scholar 

  24. Shajini M, Ramanan A (2021) A knowledge-sharing semi-supervised approach for fashion clothes classification and attribute prediction. Vis Comput:1–11

  25. Shi Z et al (2018) Nighttime low illumination image enhancement with single image using bright/dark channel prior. EURASIP J Image Video Process 2018(1):1–15

    Article  MathSciNet  Google Scholar 

  26. Sun T et al (2017) Convolution neural networks with two pathways for image style recognition. IEEE Trans Image Process 26(9):4102–4113

    Article  MathSciNet  MATH  Google Scholar 

  27. Wang W et al (2018) Attentive fashion grammar network for fashion landmark detection and clothing category classification. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4271–4280

  28. Xiao B et al (2018) Brightness and contrast controllable image enhancement based on histogram specification. Neurocomputing 275:2798–2809

    Article  Google Scholar 

  29. Yue X, Cheng Z, Fujita H, Lv Y (2021) Clothing fashion style recognition with design issue graph. Appl Intell 51(6):3548–3560

    Article  Google Scholar 

  30. Zhang S et al (2019) Task-aware attention model for clothing attribute prediction. IEEE Trans Circuits Syst Video Technol 30(4):1051–1064

    Article  Google Scholar 

  31. Zhou M et al (2017) Color retinal image enhancement based on luminosity and contrast adjustment. IEEE Trans Biomed Eng 65(3):521–527

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CSED, Thapar Institute of Engineering & Technology, Patiala, Punjab, 147004, India

    Navneet Kaur & Shreelekha Pandey

Authors
  1. Navneet Kaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shreelekha Pandey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shreelekha Pandey.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kaur, N., Pandey, S. Predicting clothing attributes with CNN and SURF based classification model. Multimed Tools Appl 82, 10681–10701 (2023). https://doi.org/10.1007/s11042-022-13714-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13714-1

Keywords

Search

Navigation