Skip to main content
SpringerLink
Log in

Toward cognitive support for automated defect detection

  • Cognitive Computing for Intelligent Application and Service
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

With the development of cognitive computing, machine learning techniques, and big data analytics, cognitive support is crucial for automated industrial production. The real-time automated visual inspection in industrial production is a challenging task. Speed and accuracy are crucial factors for the process of automating the defect detection. Many statistical and spectrum analysis approaches have been introduced; however, they suffer from high computational cost with average performance. This paper proposes a neighborhood-maintaining approach, which is based on the minimum ratio for fast and reliable inspection of industrial products. The minimum ratio between local neighborhood sliding windows is used as a similarity measure for localizing defection. Extreme learning machine is then adapted to classify surfaces to defect or normal. A defect detection accuracy on textile fabrics has achieved 98.07% with 91.29% sensitivity and 99.67% specificity. The minimum ratio shows highly discriminant power to distinguish between normal and abnormal surfaces. A defective region produces a smaller value of minimum ratio than that of a defect-free region. Experimental results show superior speed and accuracy performance over many existing defect detection methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Grand View Research (2018) Cognitive computing market size to reach USD 49.36 billion by 2025. https://www.grandviewresearch.com/press-release/global-cognitive-computing-market. Accessed 11 Feb 2018

  2. Zhang Y, Peng L, Sun Y, Lu H (2018) Editorial: Intelligent industrial IoT integration with cognitive computing. Mob Netw Appl 23:185–187

    Google Scholar 

  3. CBR (2017) IBM brings cognitive assistant to factory for cutting down inspection time. https://www.cbronline.com/internet-of-things/cognitive-computing/ibm-brings-cognitive-assistant-to-factory-for-cutting-down-inspection-time/. Accessed 11 Feb 2018

  4. Melkote AK (2016) The future of cognitive robotic process automation. http://www.sourcingfocus.com/site/opinionscomments/the_future_of_cognitive_robotic_process_automation/. Accessed 11 Feb 2018

  5. Chen M, Herrera F, Hwang K (2018) Cognitive computing: architecture, technologies and intelligent applications. IEEE Access 6:19774–19783

    Google Scholar 

  6. Wu Q, Member S, Ding G, Member S, Xu Y, Member S (2014) Cognitive internet of things: a new paradigm beyond connection. IEEE Internet Things J 1(2):129–143

    Google Scholar 

  7. Bannat A et al (2011) Artificial cognition in production systems. IEEE Trans Autom Sci Eng 8(1):148–174

    Google Scholar 

  8. Chen M, Tian Y, Fortino G, Zhang J, Humar I (2018) Cognitive internet of vehicles. Comput Commun 120(January):58–70

    Google Scholar 

  9. Lapido YL et al (2015) Cognitive high speed defect detection and classification in MWIR images of laser welding. In: Proceedings of SPIE, p 9657

  10. Chen M, Li W, Hao Y, Qian Y, Humar I (2018) Edge cognitive computing based smart healthcare system. Futur Gener Comput Syst 86:403–411

    Google Scholar 

  11. Qian Y et al (2018) Secure enforcement in cognitive internet of vehicles. IEEE Internet Things J 5(2):1242–1250

    MathSciNet  Google Scholar 

  12. Hossain MS, Muhammad G, Al Qurishi M (2018) Verifying the images authenticity in Cognitive Internet of Things (CIoT)-oriented cyber physical system. Mob Netw Appl 23:239–250

    Google Scholar 

  13. Hossain MS, Muhammad G (2019) Emotion recognition using deep learning approach from audio–visual emotional big data. Inf Fusion 49:69–78

    Google Scholar 

  14. Hanbay K, Talu MF, Özgüven ÖF (2016) Fabric defect detection systems and methods: a systematic literature review. Opt Int J Light Electron Opt 127(24):11960–11973

    Google Scholar 

  15. Karimi MH, Asemani D (2014) Surface defect detection in tiling industries using digital image processing methods: analysis and evaluation. ISA Trans 53(3):834–844

    Google Scholar 

  16. Neogi N, Mohanta DK, Dutta PK (2014) Review of vision-based steel surface inspection systems. EURASIP J Image Video Process 2014(1):1–19

    Google Scholar 

  17. Satorres Martínez S, Ortega Vázquez C, Gámez García J, Gómez Ortega J (2017) Quality inspection of machined metal parts using an image fusion technique. Meas J Int Meas Confed 111:374–383

    Google Scholar 

  18. Shojaedini SV, Kasbgar Haghighi R, Kermani A (2017) A new method for defect detection in lumber images: optimising the energy model by an irregular parametric genetic approach. Int Wood Prod J 8(1):26–31

    Google Scholar 

  19. Xie X (2008) A review of recent advances in surface defect detection using texture analysis techniques. Electron Lett Comput Vis Image Anal 7(3):1–22

    Google Scholar 

  20. Kumar A (2008) Computer-vision-based fabric defect detection : a survey. IEEE Trans Ind Electron 55(1):348–363

    Google Scholar 

  21. Schneider D, Merhof D (2015) Blind weave detection for woven fabrics. Pattern Anal Appl 18(3):725–737

    MathSciNet  Google Scholar 

  22. Hu G, Wang Q, Zhang G (2015) Unsupervised defect detection in textiles based on Fourier analysis and wavelet shrinkage. Appl Opt 54(10):2963–2980

    Google Scholar 

  23. Zhu B, Liu J, Pan R, Gao W, Liu J (2015) Seam detection of in homogeneously textured fabrics based on wavelet transform. Text Res J 85(13):1381–1393

    Google Scholar 

  24. Li P, Zhang H, Jing J, Li R, Zhao J (2015) Fabric defect detection based on multi-scale wavelet transform and Gaussian mixture model method. J Text Inst 106(6):587–592

    Google Scholar 

  25. Tolba AS (2011) Fast defect detection in homogeneous flat surface products. Expert Syst Appl 38(10):12339–12347

    Google Scholar 

  26. Hu GH (2015) Automated defect detection in textured surfaces using optimal elliptical Gabor filters. Opt Int J Light Electron Opt 126(14):1331–1340

    Google Scholar 

  27. Guo X, Tang C, Zhang H, Chang Z (2012) Automatic thresholding for defect detection. ICIC Express Lett 6(1):159–164

    Google Scholar 

  28. Tolba AS (2011) Neighborhood-preserving cross correlation for automated visual inspection of fine-structured textile fabrics. Text Res J 81(19):2033–2042

    Google Scholar 

  29. Popescu D, Dobrescu R, Nicolae M (2007) Texture classification and defect detection by statistical features. NAUN Int J 1(1):79–84

    Google Scholar 

  30. Susan S, Sharma M (2017) Automatic texture defect detection using Gaussian mixture entropy modeling. Neurocomputing 239:232–237

    Google Scholar 

  31. Cohen FS, Fan Z, Attali S (1991) Automated inspection of textile fabrics using textural models. IEEE Trans Pattern Anal Mach Intell 13(8):803–808

    Google Scholar 

  32. Zhang R, Hu Y, Guo W, Zhang C (2009) Multi-scale Markov random field based fabric image segmentation associate with edge information. Int Symp Comput Intell Des 1(7):566–569

    Google Scholar 

  33. Serafim AFL (1992) Segmentation of natural images based on multiresolution pyramids linking of the parameters of an autoregressive rotation invariant model. Application to leather defects detection. Proc Int Conf Pattern Recognit 3(M1):41–44

    Google Scholar 

  34. Çelik HI, Dülger LC, Topalbekiroǧlu M (2014) Development of a machine vision system: real-time fabric defect detection and classification with neural networks. J Text Inst 105(6):575–585

    Google Scholar 

  35. Çelik Hİ, Dülger LC, Topalbekiro M (2014) Fabric defect detection using linear filtering and morphological operations. Indian J Fibre Text Res 39(September):254–259

    Google Scholar 

  36. Xue-wu Z, Yan-qiong D, Yan-yun L, Ai-ye S, Rui-yu L (2011) Expert systems with applications a vision inspection system for the surface defects of strongly reflected metal based on multi-class SVM. Expert Syst Appl 38(5):5930–5939

    Google Scholar 

  37. Sugumaran VÃ, Ramachandran KI (2007) Automatic rule learning using decision tree for fuzzy classifier in fault diagnosis of roller bearing. Mech Syst Signal Process 21:2237–2247

    Google Scholar 

  38. Naso D, Turchiano B, Member S, Pantaleo P (2005) A fuzzy-logic based optical sensor for online weld defect-detection. IEEE Trans Ind Inf 1(4):259–273

    Google Scholar 

  39. Jasper W, Joines J, Brenzovich J (2016) Fabric defect detection using a genetic algorithm tuned wavelet filter. J Text Inst 96:43–54

    Google Scholar 

  40. Yuen CWM, Wong WK, Qian SQ, Chan LK, Fung EHK (2009) A hybrid model using genetic algorithm and neural network for classifying garment defects. Expert Syst Appl 36(2):2037–2047

    Google Scholar 

  41. Yapi D, Mejri M, Allili MS, Baaziz N (2015) A learning-based approach for automatic defect detection in textile images. IFAC Pap Online 28(3):2423–2428

    Google Scholar 

  42. Ren R, Hung T, Tan KC (2018) A generic deep-learning-based approach for automated surface inspection. IEEE Trans Cybern 48(3):929–940

    Google Scholar 

  43. Li Y, Zhao W, Pan J (2017) Deformable patterned fabric defect detection with fisher criterion-based deep learning. IEEE Trans Autom Sci Eng 14(2):1256–1264

    Google Scholar 

  44. Jen Clark (2017) IBM Watson IoT: cognitive visual inspection, July 4, 2017. https://www-01.ibm.com/common/ssi/cgi-bin/ssialias?htmlfid=WWS12361USEN. Accessed April 2018

  45. Miao Y et al (2018) Green cognitive body sensor network: architecture, energy harvesting and smart clothing based applications. IEEE Sens J. https://doi.org/10.1109/jsen.2018.2870251

    Article  Google Scholar 

  46. Jen Clark. Cognitive inspection: IBM visual insights, July 4, 2017. https://www.ibm.com/blogs/internet-of-things/category/manufacturing/. Accessed April 2018

  47. Bin Huang G, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501

    Google Scholar 

  48. Abbas M, Albadr A, Tiun S (2017) Extreme learning machine: a review. Int J Appl Eng Res ISSN 12(14):973–4562

    Google Scholar 

  49. Huang G-B, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern 42(2):513–529

    Google Scholar 

  50. Eisner R, Poulin B, Szafron D, Lu P, Greiner R (2005) Improving protein function prediction using the hierarchical structure of the gene ontology. IEEE Comput Intell Bioinform Comput Biol 00:1–10

    Google Scholar 

  51. Sokolova M, Japkowicz N, Szpakowicz N (2006) Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation. In: AI 2006: advances in artificial intelligence, pp 1015–1021

  52. TILDA (1996) Textile defect image database. University of Freiburg, Germany. https://lmb.informatik.uni-freiburg.de/resources/datasets/tilda.en.html. Accessed 10 Jan 2018

  53. Tolba AS, Atwan A, Amanneddine N, Mutawa AM, Khan HA (2010) Defect detection in flat surface products using log-Gabor filters. Int J Hybrid Intell Syst 7:187–201

    Google Scholar 

  54. Tolba AS (2012) A novel multiscale-multidirectional autocorrelation approach for defect detection in homogeneous flat surfaces. Mach Vis Appl 23:739–750

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Deanship of Scientific Research, King Saud University, Riyadh, Saudi Arabia, through the Vice Deanship of Scientific Research Chairs.

Author information

Authors and Affiliations

  1. Department of Computer Science, Faculty of Computers and Information, Mansoura University, Mansoura, 35516, Egypt

    Ehab Essa, A. S. Tolba & Samir Elmogy

  2. Computer Science Department, Kuwait University, Kuwait, Kuwait

    Hazem M. Raafat

  3. Research Chair of Pervasive and Mobile Computing, College of Computer and Information Sciences, King Saud University, Riyadh, 11451, Saudi Arabia

    M. Shamim Hossain

  4. Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, 11543, Saudi Arabia

    M. Shamim Hossain

  5. Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, 11543, Saudi Arabia

    Ghulam Muahmmad

  6. Misr University of Science and Technology, 6th of October City, Egypt

    A. S. Tolba

Authors
  1. Ehab Essa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Shamim Hossain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. S. Tolba
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hazem M. Raafat
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Samir Elmogy
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ghulam Muahmmad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Shamim Hossain.

Ethics declarations

Conflict of interest

The authors do not have any type of conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Essa, E., Hossain, M.S., Tolba, A.S. et al. Toward cognitive support for automated defect detection. Neural Comput & Applic 32, 4325–4333 (2020). https://doi.org/10.1007/s00521-018-03969-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-018-03969-x

Keywords

Search

Navigation