Skip to main content
SpringerLink
Log in

A multi-task and multi-scale convolutional neural network for automatic recognition of woven fabric pattern

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

The recognition of woven fabric pattern is a crucial task for mass manufacturing and quality control in the textile industry. Traditional methods based on image processing have some limitations on accuracy and stability. In this paper, an automatic method is proposed to jointly realize yarn location and weave pattern recognition. First, a new big fabric dataset is established by a portable wireless device. The dataset contains wide kinds of fabrics and detailed fabric structure parameters. Then, a novel multi-task and multi-scale convolutional neural network (MTMSnet) is proposed to predict the location maps of yarns and floats. By adopting the multi-task structure, the MTMSnet can better learn the related features between yarns and floats. Finally, the weave pattern and basic weave repeat are recognized by combining the yarn and float location maps. Extensive experimental results on various kinds of fabrics indicate that the proposed method achieves high accuracy and quality in weave pattern recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Aldemir, E., Özdemir, H., & Sarı, Z. (2018). An improved gray line profile method to inspect the warp–weft density of fabrics. The Journal of The Textile Institute, 104, 1–12.

    Google Scholar 

  • Boonsirisumpun, N., & Puarungroj, W. (2018). Loei fabric weaving pattern recognition using deep neural network. In 2018 15th International joint conference on computer science and software engineering (JCSSE), 2018 (pp. 1–6). IEEE.

  • Dai, J., He, K., & Sun, J. (2016). Instance-aware semantic segmentation via multi-task network cascades. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016 (pp. 3150–3158).

  • Duda, R. O., & Hart, P. E. (1972). Use of the hough transform to detect lines and curves in pictures. Communications of the ACM, 15(1), 11–15.

    Article  Google Scholar 

  • Glorot, X., & Bengio, Y. (2010). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, 9, 249–256.

    Google Scholar 

  • Golik, P., Doetsch, P., & Ney, H. (2013). Cross-entropy vs. squared error training: A theoretical and experimental comparison. In: Interspeech, 2013 (pp. 1756–1760).

  • Guo, Y., Ge, X., Yu, M., Yan, G., & Liu, Y. (2019). Automatic recognition method for the repeat size of a weave pattern on a woven fabric image. Textile Research Journal, 89(14), 2754–2775.

    Article  Google Scholar 

  • Huang, C.-C., Liu, S.-C., & Yu, W.-H. (2000). Woven fabric analysis by image processing: Part I: Identification of weave patterns. Textile Research Journal, 70(6), 481–485.

    Article  Google Scholar 

  • Jing, J., Xu, M., Li, P., Qi, L., & Liu, S. (2014). Automatic classification of woven fabric structure based on texture feature and PNN. Fibers and Polymers, 15(5), 1092–1098.

    Article  Google Scholar 

  • Kang, T. J., Kim, C. H., & Oh, K. W. (1999). Automatic recognition of fabric weave patterns by digital image analysis. Textile Research Journal, 69(2), 77–83.

    Article  Google Scholar 

  • Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:14091556.

  • Kinoshita, M., Hashimoto, Y., Akiyama, R., & Uchiyama, S. (1989). Determination of weave type in woven fabric by digital image processing. Journal of the Textile Machinery Society of Japan, 35(2), 1–4.

    Article  Google Scholar 

  • Kuo, C.-F. J., Shih, C.-Y., Huang, C.-C., Su, T.-L., & Liao, I.-C. (2016). A novel image processing technology for recognizing the weave of fabrics. Textile Research Journal, 86(3), 288–301.

    Article  Google Scholar 

  • Lachkar, A., Benslimane, R., D’orazio, L., & Martuscelli, E. (2005). Textile woven fabric recognition using Fourier image analysis techniques: Part II–texture analysis for crossed-states detection. Journal of the Textile Institute, 96(3), 179–183.

    Article  Google Scholar 

  • Li, Z., Meng, S., Wang, L., Zhang, N., & Gao, W. (2019). Intelligent recognition of the patterns of yarn-dyed fabric based on LSRT images. Journal of Engineered Fibers and Fabrics, 14, 1558925019840659.

    Google Scholar 

  • Li, P. F., Wang, J., Zhang, H. H., & Jing, J. F. (2013). Automatic woven fabric classification based on support vector machine. In International conference on automatic control and artificial intelligence, 2013 (pp. 581–584).

  • Lin, H., Li, B., Wang, X., Shu, Y., & Niu, S. (2019). Automated defect inspection of LED chip using deep convolutional neural network. Journal of Intelligent Manufacturing, 30(6), 2525–2534.

    Article  Google Scholar 

  • Malaca, P., Rocha, L. F., Gomes, D., Silva, J., & Veiga, G. (2019). Online inspection system based on machine learning techniques: real case study of fabric textures classification for the automotive industry. Journal of Intelligent Manufacturing, 30(1), 351–361.

    Article  Google Scholar 

  • Meng, S., Pan, R., Gao, W., Zhou, J., Wang, J., & He, W. (2019). Woven fabric density measurement by using multi-scale convolutional neural networks. IEEE Access, 7, 75810–75821.

    Article  Google Scholar 

  • Ohtsu, N. (1979). A threshold selection method from gray-level histograms. IEEE Transactions on Systems Man and Cybernetics, 9(1), 62–66.

    Article  Google Scholar 

  • Pan, R., Gao, W., Liu, J., & Wang, H. (2010a). Automatic recognition of woven fabric patterns based on pattern database. Fibers and Polymers, 11(2), 303–308.

    Article  Google Scholar 

  • Pan, R., Gao, W., Liu, J., & Wang, H. (2010b). Automatic detection of the layout of color yarns for yarn-dyed fabric via a FCM algorithm. Textile Research Journal, 80(12), 1222–1231.

    Article  Google Scholar 

  • Pan, R., Gao, W., Liu, J., & Wang, H. (2011). Automatic recognition of woven fabric pattern based on image processing and BP neural network. Journal of the Textile Institute Proceedings and Abstracts, 102(1), 19–30.

    Article  Google Scholar 

  • Pan, R., Gao, W., Liu, J., Wang, H., & Zhang, X. (2010c). Automatic detection of structure parameters of yarn-dyed fabric. Textile Research Journal, 80(17), 1819–1832.

    Article  Google Scholar 

  • Sabuncu, M., & Ã-zdemir, H. (2015). Recognition of fabric weave patterns using optical coherence tomography. Journal of the Textile Institute Proceedings and Abstracts, 107(11), 1406–1411.

    Article  Google Scholar 

  • Schneider, D., Gloy, Y. S., & Merhof, D. (2015). Vision-based on-loom measurement of yarn densities in woven fabrics. IEEE Transactions on Instrumentation and Measurement, 64(4), 1063–1074.

    Article  Google Scholar 

  • Schneider, D., & Merhof, D. (2015). Blind weave detection for woven fabrics. Pattern Analysis and Applications, 18(3), 725–737.

    Article  Google Scholar 

  • Shen, J., Zou, X., Xu, F., & Xian, Z. (2010). Intelligent recognition of fabric weave patterns using texture orientation features. In International conference on information computing and applications, 2010 (pp. 8–15). Berlin: Springer.

  • Sindagi, V. A., & Patel, V. M. (2017). CNN-based cascaded multi-task learning of high-level prior and density estimation for crowd counting. In 2017 14th IEEE international conference on advanced video and signal based surveillance (AVSS), 2017.

  • Tabernik, D., Šela, S., Skvarč, J., & Skočaj, D. (2020). Segmentation-based deep-learning approach for surface-defect detection. Journal of Intelligent Manufacturing, 31(3), 759–776. https://doi.org/10.1007/s10845-019-01476-x.

    Article  Google Scholar 

  • Wang, X., Georganas, N. D., & Petriu, E. M. (2010a). Fabric texture analysis using computer vision techniques. IEEE Transactions on Instrumentation and Measurement, 60(1), 44–56.

    Article  Google Scholar 

  • Wang, X., Georganas, N. D., & Petriu, E. M. (2010). Automatic woven fabric structure identification by using principal component analysis and fuzzy clustering. In 2010 IEEE instrumentation and measurement technology conference proceedings, 2010 (pp. 590–595). IEEE.

  • Xiao, Z., Guo, Y., Geng, L., Wu, J., Zhang, F., Wang, W., et al. (2018a). Automatic recognition of woven fabric pattern based on TILT. Mathematical Problems in Engineering, 2018, 1–12.

    Google Scholar 

  • Xiao, Z., Liu, X., Wu, J., Geng, L., Sun, Y., Zhang, F., et al. (2018b). Knitted fabric structure recognition based on deep learning. The Journal of The Textile Institute, 109(9), 1217–1223.

    Article  Google Scholar 

  • Xin, B., Hu, J., Baciu, G., & Yu, X. (2009). Investigation on the classification of weave pattern based on an active grid model. Textile Research Journal, 79(12), 1123–1134.

    Article  Google Scholar 

  • Xu, B. (1996). Identifying fabric structures with fast Fourier transform techniques. Textile Research Journal, 66(8), 496–506.

    Article  Google Scholar 

  • Zhang, T. Y., & Suen, C. Y. (1984). A fast parallel algorithm for thinning digital patterns. Communications of the ACM, 27(3), 236–239.

    Article  Google Scholar 

  • Zhang, K., Zhang, Z., Li, Z., & Yu, Q. (2016). Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Processing Letters, 23(10), 1499–1503.

    Article  Google Scholar 

Download references

Acknowledgements

The authors are thankful to the National Natural Science Foundation of China under Grant 61976105, for providing financial support for this research work.

Author information

Authors and Affiliations

  1. Key Laboratory of Eco-Textiles, Ministry of Education, Jiangnan University, Wuxi, 214122, Jiangsu, China

    Shuo Meng, Ruru Pan, Weidong Gao, Jian Zhou, Jingan Wang & Wentao He

Authors
  1. Shuo Meng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruru Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weidong Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jian Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jingan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wentao He
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ruru Pan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Meng, S., Pan, R., Gao, W. et al. A multi-task and multi-scale convolutional neural network for automatic recognition of woven fabric pattern. J Intell Manuf 32, 1147–1161 (2021). https://doi.org/10.1007/s10845-020-01607-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10845-020-01607-9

Keywords

Search

Navigation