Abstract
Automating the fabric inspection process has been attempted by several researchers in the past. However, the numerous variants of fabric, such as their construction, texture, print, and colour along with the huge gamut of fabric defects which exist, complicate the process of automating defect detection, thus making it an open challenge for researchers to come up with a one-stop, full proof robust automation solution. In the present study, an attempt has been made to detect, classify, and locate four different types of fabric defects on solid wovens, hole, knot, slub and stain, which contributes 86% of total fabric defects; using the convolutional neural network (CNN) through transfer learning on the MATLAB® platform and computer vision technology. The image dataset in this study consists of 5000 images, which is one of the largest reported till date and collected from real working environments of different apparel manufacturing units. The methodology involves four different approaches—detection approach, hierarchical approach, classification approach, and object location approach. For algorithm development, transfer learning has been adopted in which the pre-trained deep learning architectures are fine-tuned as per specific case requirement. In this study, 4 state-of-the-art deep learning models were selected as follows: VGG16, VGG19, ResNet101 and DarkNet53. This study not only focuses on defect detection and classification but also on defect location which is detailed in its fourth approach. For object location, YOLOv3 architecture was used. The defect detection, classification and location identification systems attained an accuracy of 95%, 88% and 97%, respectively. The developed model was tested on different platforms viz. Internet-based webcam and MATLAB® cloud. Detailed investigation towards challenges faced by models specific to class of defect was carried out and reported thus adding insights for probable modification required in the model. The study proposes an industry ready system for real-time implementation.















Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The data related to this research work may be made available on request.
References
Barua S, Patil H, Desai PD, Arun M (2020) Deep learning-based smart colored fabric defect detection system. In: Iyer B, Rajurkar A, Gudivada V (eds) Applied computer vision and image processing advances in intelligent systems and computing. Springer, Singapore
USTER, “Fabric Inspection,” [Online]. https://www.uster.com/en/instruments/fabric-inspection-1/. Accessed 16 April 2021
Ngan HYT, Pang GK, Yung NH (2011) Automated fabric defect detection—a review. Image Vision Comput 29:442–458
Rasheed A, Zafar B, Rasheed A, Ali N, Sajid M, Dar SH, Habib U, Shehryar T, Mahmood MT (2020) Fabric defect detection using computer vision techniques: a comprehensive review. Math Probl Eng. https://doi.org/10.1155/2020/8189403
Czimmermann T, Ciuti G, Milazzo M, Chiurazzi M, Roccella S, Oddo CM, Dario P (2020) Visual-based defect detection and classification approaches for industrial applications—a SURVEY. Sensors 20(5):1–25
Hanbaya K, Talub MF, Özgüvenc ÖF (2016) Fabric defect detection systems and methods—a systematic literature review. Optik 127(24):11960–11973
Kumar A (2008) Computer-vision-based fabric defect detection: a survey. IEEE Trans Industr Electron 55(1):348–363
BM Vision–Cyclops and Argus, “Automatic on-loom fabric inspection.” https://www.bmsvision.com/products/fabric-inspection. Accessed 16th April 2021
Shelton Vision, “Automated Surface Inspection.” https://www.sheltonvision.co.uk/visual-inspection-systems/webspector/. Accessed 16 April 2021
ComVIS, “Inspection Systems.” https://comvis.com/inspection-systems/. Accessed 16 April 2021.
“IQ Tex 4.” http://www.evs.co.il/UserFiles/File/EVS/EVS%20products%20brochures/IQ-TEX%204%20-%20Vision%20Empowered%20Process%20Monitoring.pdf. Accessed 13 July 2021
“Fabric Inspection Fault Detection Made Easy.” https://www.texmaag.ch/en/products/fabric-inspection/. Accessed 13 July 2021
Tong L, Wong WK, Wong CK (2017) Fabric defect detection for apparel industry: a nonlocal sparse representation approach. IEEE Access 5:5947–5964
Rebhi A, Benmhammed I, Abid S, Fnaiech F (2015) Fabric defect detection using local homogeneity analysis and neural network. J Photonics. https://doi.org/10.1155/2015/376163
Jing JF, Ma H, Zhang HH (2019) Automatic fabric defect detection using a deep convolutional neural network. Color Technol 135(3):1–11
Desai A, Amutha AL (2020) fabric defect detection for industrial use. Int J Adv Sci Tech 29(6):2271–2280
Modrângă C, Brad R, Brad R (2017) Fabric defect detection using Fourier transform and Gabor filters. J Text E Fash Tech 3(4):684–688
Cuifanga Z, Yu C, Jiacheng Z (2020) Fabric defect detection algorithm based on PHOG and SVM. Indian J Fibre Text 45:123–126
Tian H, Li F (2019) Autoencoder-based fabric defect detection with cross-patch similarity. In 16th International conference on machine vision applications (MVA) national olympics memorial youth center, 1–6
Liu Z, Zhang C, Li C, Ding S, Dong Y, Huang Y (2019) Fabric defect recognition using optimized neural networks. J Eng Fiber Fabr 14:1–10
Jing J, Ren H (2021) Defect detection of printed fabric based on RGBAAM and image pyramid. Autex Res J 21(2):136–141
Abu-Amara, F (2010) An automated framework for defect detection in concrete bridge decks using fractals and independent component analysis. PhD Dissertations, Western Michigan University
Chatterjee S, Saeedfar P, Tofangchi S, Kolbe LM (2018) Intelligent road maintenance: a machine learning approach for surface defect detection. 26th European conference on information systems (ECIS2018), Portsmouth, UK
Lim TY, Ratnam MM, Khalid MA (2017) Automatic classification of weld defects using simulated data and an MLP neural network. Insight 49(3):154–159
Nturambirwe JFI, Opara UI (2020) Machine learning applications to non-destructive defect detection in horticultural products. Biosyst Eng 189:60–83
Unay D, Gosselin B (2002) Apple defect detection and quality classification with MLP-neural networks. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.10.4838&rep=rep1&type=pdf. Accessed on 4th June 2022, 501–506
Khan MF, Alam A, Siddiqui MA, Alam MS, Rafat Y, Salik N, Al-Saidan I (2021) Real-time defect detection in 3D printing using machine learning. Mater Today-Proc 42:521–528
Li R, Jin M, Paquit VC (2021) Geometrical defect detection for additive manufacturing with machine learning models. Adv Mater Res Switz 206:109726
Narayanan BN, Beigh K, Loughnane G, Powar N (2019) Support vector machine and convolutional neural network-based approaches for defect detection in fused filament fabrication. Proc. SPIE 1113913, Applications of machine learning, SPIE optical engineering + applications, San Diego, California
Papageorgiou EI, Theodosiou T, Margetis G, Dimitriou N, Charala P (2021) Short survey of artificial intelligent technologies for defect detection in manufacturing. IEEE xplore, 12th international conference on information, intelligence, systems & applications (IISA)
Blanes JS, Albero TA, Miralles I, Llorens RP, Moreno JM (2019) A public fabric image database for defect detection. Autex Res J 19(4):363–374
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Thakur, R., Panghal, D., Jana, P. et al. Automated fabric inspection through convolutional neural network: an approach. Neural Comput & Applic 35, 3805–3823 (2023). https://doi.org/10.1007/s00521-022-07891-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-07891-1