Skip to main content

Advertisement

Springer Nature Link
Log in

Enhancing defective region visualization in industrial products using Grad-CAM and random masking data augmentation

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

Defect detection in various industrial products ensures product quality and safety. This paper introduces an innovative design, training, and evaluation application employing CNN, CAE, YOLO, FCN, and SVM models, to facilitate defect detection without requiring extensive IT expertise. However, conventional usage of Grad-CAM for visualizing defect regions sometimes includes irrelevant areas unrelated to the target defects. A novel data augmentation technique called random masking is proposed to enhance the visualization of defective regions, leading to more accurate and focused defect detection in various industrial products. This technique is used during training, replacing non-target areas in each image with randomly generated mask patterns. The efficacy of the proposed technique is demonstrated through visualization tests of defective regions using Grad-CAM. Furthermore, an ablation study is conducted to assess the effectiveness of the data augmentation techniques, comparing the performance of Grad-CAM with and without random masking augmentation. We further provide insights into the dataset used and present noteworthy findings from the evaluation, showcasing the contributions of our work in advancing defect detection methodologies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Baumgartl H, Tomas J, Buettner R, Merkel M (2020) A deep learning-based model for defect detection in laser-powder bed fusion using in-situ thermographic monitoring. Prog Addit Manuf 5:277–285

    Article  Google Scholar 

  2. Bukhsh ZA, Jansen N, Saeed A (2021) Damage detection using in-domain and cross-domain transfer learning. Neural Comput Appl 33:16921–16936

    Article  Google Scholar 

  3. Nagata F, Watanabe K (2020) Design tool of convolutional neural network (CNN) and its application to defect detection (in Japanese). J Syst Control Inf 64(8):304–309

    Google Scholar 

  4. Nakashima K, Nagata F, Watanabe K (2020), Detection of defective products in wrapped roll products using convolutional neural network (CNN) (in Japanese). In: Proceedings of the fuzzy system symposium (FSS2020), pp 111–115

  5. Fang H, Sun J, Wang R, Gou M, Li Y, Lu C (2019) Instaboost: boosting instance segmentation via probability map guided copy–pasting. In: Proceedings of the IEEE conference on international conference on computer vision (ICCV), pp 682–691

  6. Dvornik N, Mairal J, and Schmid C (2018) Modeling visual context is key to augmenting object detection datasets. In: Proceedings of the IEEE conference on IEEE European conference on computer vision (ECCV), pp 375–391

  7. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision (ICCV), pp 618–626

  8. Zhang Q, Rao L, Yang Y. Group-CAM: group score-weighted visual explanations for deep convolutional networks. arXiv:2103.13859 [cs.CV]

  9. Wang H, Wang Z, Du M, Yang F, Zhang Z, Ding S, Mardziel P, Hu X, Score-CAM: score-weighted visual explanations for convolutional neural networks. arXiv:1910.01279 [cs.CV]

  10. Shimizu T, Nagata F, Arima K, Miki K, Hirohisa Kato, Akimasa Otsuka, Keigo Watanabe (2022) Image processing to improve visualization function of defect areas included in mechanical parts using Grad-CAM. In: Proceedings of the 27th international symposium on artificial life and robotics (AROB 2022), pp. 1077–1080

  11. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1–9

  12. Dwibedi D, Misra I, Hebert M (2017) Cut, paste and learn: surprisingly easy synthesis for instance detection. In: Proceedings of the IEEE conference on international conference on computer vision (ICCV), pp 1301–1310

  13. Yun S, Han D, Chun S, Oh SJ, Yoo Y, Choe J (2019) CutMix: regularization strategy to train strong classifiers with localizable features. In: Proceedings of 2019 IEEE/CVF international conference on computer vision (ICCV), pp 6022–6031

Download references

Author information

Authors and Affiliations

  1. Sanyo-Onoda City University, 1-1-1 Daigaku-Dori, Sanyo-Onoda, 756-0884, Japan

    Tatsuki Shimizu, Fusaomi Nagata, Koki Arima, Kohei Miki, Hirohisa Kato & Akimasa Otsuka

  2. Okayama University, Okayama, Japan

    Keigo Watanabe

  3. The American University in Cairo, Cairo, Egypt

    Maki K. Habib

Authors
  1. Tatsuki Shimizu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Fusaomi Nagata
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Koki Arima
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Kohei Miki
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Hirohisa Kato
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Akimasa Otsuka
    View author publications

    You can also search for this author inPubMed Google Scholar

  7. Keigo Watanabe
    View author publications

    You can also search for this author inPubMed Google Scholar

  8. Maki K. Habib
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Fusaomi Nagata.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was presented in part at the joint symposium of the 27th International Symposium on Artificial Life and Robotics, the 7th International Symposium on BioComplexity, and the 5th International Symposium on Swarm Behavior and Bio-Inspired Robotics (Online, January 25–27, 2022).

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shimizu, T., Nagata, F., Arima, K. et al. Enhancing defective region visualization in industrial products using Grad-CAM and random masking data augmentation. Artif Life Robotics 29, 62–69 (2024). https://doi.org/10.1007/s10015-023-00913-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-023-00913-8

Keywords