Abstract
In contrast to the common small target detection problems, it is more difficult to locate and identify the small surface defects of fabric due to its own texture and complex background interference. Therefore, this paper proposes an effective detector for small-scale block defects on fabric surface by taking advantage of the backbone which integrates the Coordinate Attention module to enhance the acquisition of small-scale block defect location information. The FPN + PAN multi-scale detection structure is adopted to effectively integrate the feature information between different levels and deal with the multi-scale problem of defects. In the Neck section, a small target detection layer is set to expand the receptive field to prevent the loss of small-scale defect feature information. Moreover, we propose to use the GhostBottleneck module instead of the ordinary downsampling process to eliminate redundant convolutional calculations to improve the detection speed. The experimental results show that the optimal detection results of 0.56 and 0.842 are achieved in the detection recall and accuracy of the public fabric dataset; compared with other detectors, the result of small-scale defect detection rate is reduced by at least 2.7%, and the detection process meets the real-time requirement of automatic defect detection, which verifies the effectiveness of our method. Code and data are available at: https://github.com/VIMLab-hfut/SCG-NET.













Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Tianchi cup public fabric dataset. https://tianchi.aliyun.com/dataset/dataDetail?dataId=110512
Tianchi cup public tile dataset. https://tianchi.aliyun.com/dataset/dataDetail?dataId=110088
Abouelela, A., Abbas, H.M., Eldeeb, H., Wahdan, A.A., Nassar, S.M.: Automated vision system for localizing structural defects in textile fabrics. Pattern Recogn. Lett. 26(10), 1435–1443 (2005)
Banumathi, P., Nasira, G.: Artificial neural network techniques in identifying plain woven fabric defects. Res. J. Appl. Sci. Eng. Technol. 9(4), 272–276 (2015)
Cai, Z., Vasconcelos, N.: Cascade r-cnn: delving into high quality object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6154–6162 (2018)
Campbell, J.G., Murtagh, F.D.: Automatic visual inspection of woven textiles using a two-stage defect detector. Opt. Eng. 37(9), 2536–2542 (1998)
Chan, C.H., Pang, G.: Fabric defect detection by Fourier analysis. In: Conference Record of the 1999 IEEE Industry Applications Conference. Thirty-Forth IAS Annual Meeting (Cat. No.99CH36370), vol. 3, pp. 1743–1750 (1999)
Chen, M., Yu, L., Zhi, C., Sun, R., Zhu, S., Gao, Z., Ke, Z., Zhu, M., Zhang, Y.: Improved faster r-cnn for fabric defect detection based on gabor filter with genetic algorithm optimization. Comput. Ind. 134, 103551 (2022)
Chen, Z., Chen, K., Lin, W., See, J., Yu, H., Ke, Y., Yang, C.: Piou loss: towards accurate oriented object detection in complex environments. In: European Conference on Computer Vision, pp. 195–211. Springer (2020)
Di, H., Ke, X., Peng, Z., Dongdong, Z.: Surface defect classification of steels with a new semi-supervised learning method. Opt. Lasers Eng. 117, 40–48 (2019)
Ghiasi, G., Cui, Y., Srinivas, A., Qian, R., Lin, T.Y., Cubuk, E.D., Le, Q.V., Zoph, B.: Simple copy-paste is a strong data augmentation method for instance segmentation. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2917–2927 (2021)
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., Xu, C.: Ghostnet: more features from cheap operations. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1577–1586 (2020)
Han, Y., Shi, P.: An adaptive level-selecting wavelet transform for texture defect detection. Image Vis. Comput. 25(8), 1239–1248 (2007)
Hanbay, K., Talu, M.F., Özgüven, Ö.F., Öztürk, D.: Fabric defect detection methods for circular knitting machines. In: 2015 23nd Signal Processing and Communications Applications Conference (SIU), pp. 735–738. IEEE (2015)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)
Hou, Q., Zhou, D., Feng, J.: Coordinate attention for efficient mobile network design. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13708–13717 (2021)
Jia, L., Chen, C., Liang, J., Hou, Z.: Fabric defect inspection based on lattice segmentation and gabor filtering. Neurocomputing 238, 84–102 (2017)
Jia, L., Liang, J.: Fabric defect inspection based on isotropic lattice segmentation. J. Franklin Inst. 354(13), 5694–5738 (2017)
Jing, J., Dong, A., Li, P., Zhang, K.: Yarn-dyed fabric defect classification based on convolutional neural network. Opt. Eng. 56(9), 093104 (2017)
Jocher, G.: Yolov5 by ultralytics (version 7.0) [computer software] (2020). https://doi.org/10.5281/zenodo.3908559
Jocher, G., Chaurasia, A., Qiu, J.: Yolo by ultralytics (version 8.0.0) [computer software] (2023). https://github.com/ultralytics/ultralytics
Jun, X., Wang, J., Zhou, J., Meng, S., Pan, R., Gao, W.: Fabric defect detection based on a deep convolutional neural network using a two-stage strategy. Text. Res. J. 91(1–2), 130–142 (2021)
Karlekar, V.V., Biradar, M., Bhangale, K.: Fabric defect detection using wavelet filter. In: 2015 International Conference on Computing Communication Control and Automation, pp. 712–715. IEEE (2015)
Kumar, A.: Neural network based detection of local textile defects. Pattern Recogn. 36(7), 1645–1659 (2003)
Li, P., Dong, Z., Shi, J., Pang, Z., Li, J.: Detection of small size defects in belt layer of radial tire based on improved faster r-cnn. In: 2021 11th International Conference on Information Science and Technology (ICIST), pp. 531–538 (2021)
Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2117–2125 (2017)
Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)
Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. IEEE Trans. Pattern Anal. Mach. Intell. 42(2), 318–327 (2020). https://doi.org/10.1109/TPAMI.2018.2858826
Liu, G., Zheng, X.: Fabric defect detection based on information entropy and frequency domain saliency. Vis. Comput. 37(3), 515–528 (2021)
Liu, S., Qi, L., Qin, H., Shi, J., Jia, J.: Path aggregation network for instance segmentation. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8759–8768 (2018)
Liu, Z.: Fabric defect detection based on faster r-cnn. In: Ninth International Conference on Graphic and Image Processing (ICGIP 2017), vol. 10615, p. 106150A. International Society for Optics and Photonics (2018)
Liu, Z., Huo, Z., Li, C., Dong, Y., Li, B.: Dlse-net: a robust weakly supervised network for fabric defect detection. Displays 68, 102008 (2021)
Ngan, H.Y., Pang, G.K., Yung, N.H.: Automated fabric defect detection—a review. Image Vis. Comput. 29(7), 442–458 (2011)
Qiao, S., Chen, L.C., Yuille, A.: Detectors: detecting objects with recursive feature pyramid and switchable atrous convolution. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10213–10224 (2021)
Sari, L., Ertüzün, A.: Texture defect detection using independent vector analysis in wavelet domain. In: 2014 22nd International Conference on Pattern Recognition, pp. 1639–1644 (2014)
Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Li, L., Yuan, Z., Wang, C., et al.: Sparse r-cnn: end-to-end object detection with learnable proposals. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14454–14463 (2021)
Tian, Z., Shen, C., Chen, H., He, T.: Fcos: fully convolutional one-stage object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9627–9636 (2019)
Wang, C.Y., Bochkovskiy, A., Liao, H.Y.M.: Scaled-yolov4: scaling cross stage partial network. In: Proceedings of the IEEE/cvf Conference on Computer Vision and Pattern Recognition, pp. 13029–13038 (2021)
Wang, J., Xu, C., Yang, W., Yu, L.: A normalized gaussian wasserstein distance for tiny object detection. arXiv:2110.13389 (2021)
Wang, J., Yang, W., Guo, H., Zhang, R., Xia, G.S.: Tiny object detection in aerial images. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 3791–3798. IEEE (2021)
Wang, J., Yang, W., Li, H.C., Zhang, H., Xia, G.S.: Learning center probability map for detecting objects in aerial images. IEEE Trans. Geosci. Remote Sens. 59(5), 4307–4323 (2020)
Yang, C., Huang, Z., Wang, N.: Querydet: cascaded sparse query for accelerating high-resolution small object detection. arXiv:2103.09136 (2021)
Yang, Z., Liu, S., Hu, H., Wang, L., Lin, S.: Reppoints: Point set representation for object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9657–9666 (2019)
Yapi, D., Allili, M.S., Baaziz, N.: Automatic fabric defect detection using learning-based local textural distributions in the contourlet domain. IEEE Trans. Autom. Sci. Eng. 15(3), 1014–1026 (2018)
Zhang, G., Lu, S., Zhang, W.: Cad-net: a context-aware detection network for objects in remote sensing imagery. IEEE Trans. Geosci. Remote Sens. 57(12), 10015–10024 (2019)
Zhang, S., Chi, C., Yao, Y., Lei, Z., Li, S.Z.: Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9759–9768 (2020)
Zhou, X., Chen, Y., Lu, X.: Study on detection method of small-size solder ball defects. In: 2017 2nd IEEE International Conference on Integrated Circuits and Microsystems (ICICM), pp. 213–217 (2017)
Zhou, X., Wang, D., Krähenbühl, P.: Objects as points. arXiv:1904.07850 (2019)
Zhu, X., Su, W., Lu, L., Li, B., Wang, X., Dai, J.: Deformable detr: deformable transformers for end-to-end object detection. arXiv:2010.04159 (2020)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China (201904d07020010) and the Scientific and Technological Achievement Cultivation Project of Intelligent Manufacturing Research Institute of Hefei University of Technology (IMIPY2021022).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Mei Che, Fan Jin, Qiang lu, Quanhao Yu, Wei Chen, and Xin Li declare that they have no conflict of interest or financial conflicts to disclose. The authors declare that they have no conflict of interest.
Ethics approval
This study does not contain any studies with human or animal subjects performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, M., Jin, F., Lu, Q. et al. Small-scale block defect detection of fabric surface based on SCG-NET. Vis Comput 40, 8973–8986 (2024). https://doi.org/10.1007/s00371-024-03289-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-024-03289-3