Abstract
Precision steel balls enable the bearings of machine parts to maintain their relative position, and they reduce operating time during relative movement, reduce friction force, improve efficiency and extend service life. Inspections are mainly conducted manually by eye, with classification of detected defects. Such visual inspections may cause accuracy imbalances and cost problems. For this reason, deep learning technology has been introduced into production lines. The innovation of the research presented here was to use an object-detection model to detect defects on the surface of steel balls to reduce manpower consumption and improve accuracy in detection of steel ball defects. The “You Only Look Once” algorithm (YOLOv5) was used, along with a fast-region convolutional neural network (R-CNN), finally obtaining an average recall rate of 99% and a detection accuracy rate of 93%. The results showed the YOLO algorithm to be more capable of judging good products. The contribution of this research, the efficiency of production lines can be enhanced through better detection of flaws on steel balls. The comparison showed that YOLO and Faster R-CNN are better than traditional IP detection, and the above results constitute an 80% improvement in the current detection system of the partner company.
















Similar content being viewed by others
Change history
12 April 2023
This article has been retracted. Please see the Retraction Notice for more detail: https://doi.org/10.1007/s11227-023-05274-4
References
Wang Y, Wang K, Zhou L, Chen Y, Li P (2021) A new method of surface defect detection of steel ball based on pre-trained YOLOv4 model. In: Proceedings Volume 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning. https://doi.org/10.1117/12.2604531
Li L, Zhang H, Pang J, Huang J (2019) Dam surface crack detection based on deep learning. 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence, pp738–743
Zhao L, Liu B, Liu C (2021) SHIP target image recognition based on FAST detector and faster-RCNN. In: Proceedings of SPIE 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning, 1191116 (5 October 2021). https://doi.org/10.1117/12.2604529
Bochkovskiy A, Wang C-Y, Liao H-Y (2020) YOLOv4: optimal speed and accuracy of object detection.
Yanan S, Hui Z, Li L, Hang Z (2018) Rail surface defect detection method based on YOLOv3 deep learning networks. In: 2018 Chinese Automation Congress, pp 1563–1568
Le P-P, Guo S-M, Chen J-C, Lien J-J (2019) Ball-grid-array chip defects detection and classification using patch-based modified YOLOv3. TAA I:2019
Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Zhou J, Yang Y (2008) Detection of surface defects on steel balls using image processing technology. SPIE 7130:1–6
Deli L, Xianli L, Huanrui L, Yizhi L, Xinmiao J, Peng W (2008) Study for steel ball surface quality detecting based on vision technique. Int Soc Opt Eng 6836, art. no. 683611
Kai ZF, Luhua W, Zhong S, Changjie Y (2017) Research on surface defect detection of ceramic ball based on fringe reflection. SPIE - Opt Eng 56(10):104104
Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Hagi H, Iwahori Y, Fukui S, Adachi Y, Bhuyan MK (2014) Defect classification of electronic circuit board using SVM based on random sampling. Procedia Comput Sci 35:1210–1218
Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Wang Y, Liu M, Zheng P, Yang H, Zou JJAEI (2020) A smart surface inspection system using faster R-CNN in cloud-edge computing environment. Adv Eng Inform. https://doi.org/10.1016/j.aei.2020.10103743,101037
Zhang X, Hao Y, Shangguan H, Zhang P, Wang AJIP (2020) Detection of surface defects on solar cells by fusing multi-channel convolution neural networks. 103334
Chen CM, Chen L, Gan W, Qiu L, Ding W (2021) Discovering high utility-occupancy patterns from uncertain data. Inf Sci 546:1208–1229
Chen CM, Huang Y, Wang KH, Kumari S, Wu M (2020) A secure authenticated and key exchange scheme for fog computing. Enterprise Inform Syst 1–16
Guo Y, Zhao M (2021) Nighttime vehicle detection on highway based on improved faster R-CNN model. In: Proceedings of SPIE 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning. https://doi.org/10.1117/12.2604624
Chen X, Li A, Zeng X, Guo W (2015) Huang G (2015) Runtime model based approach to IoT application development. Front Comp Sci 9(4):540–553
Chen X, Lin J, Ma Y, Lin B, Wang H, Huang G (2019) Self-adaptive Resource allocation for cloud-based software services based on progressive QoS PREDICTION Model. Sci China Inform Sci 62(11)
Chen X, Wang H, Ma Y, Zheng X, Guo L (2020) Self-adaptive resource allocation for cloud-based software services based on iterative QoS prediction model. Futur Gener Comput Syst 105:287–296
Qiao W (2021) Remote sensing image matching method based on neural network paper. In: Proceedings of SPIE 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning, 119110C (5 October 2021). https://doi.org/10.1117/12.2604763
Huang G, Liu X, Ma Y, Lu X, Zhang Y, Xiong Y (2019) Programming situational mobile Web applications with cloud-mobile convergence: an internetware-oriented approach. IEEE Trans Serv Comput 12(1):6–19
Huang G, Ma Y, Liu X, Luo Y, Lu X, Blake M (2015) Model-based automated navigation and composition of complex service mashups. IEEE Trans Serv Comput 8(3):494–506
Huang G, Xu M, Lin X, Liu Y, Ma Y, Pushp S, Liu X (2017) ShuffleDog: characterizing and adapting user-perceived latency of android apps. IEEE Trans Mob Comput 16(10):2913–2926
Lin B, Huang Y, Zhang J, Hu J, Chen X, Li J (2020) Cost-driven offloading for DNN-based applications over cloud, edge and end devices. IEEE Trans Industr Inf 16(8):5456–5466
Liu X, Huang G, Zhao Q, Mei H, Blake M (2014) iMashup: a mashup-based framework for service composition. Sci China Inf Sci 54(1):1–20
Shifa A, Asghar MN, Ahmed A, Fleury M (2020) Fuzzy-logic threat classification for multi-level selective encryption over real-time video streams. J Ambient Intell Humaniz Comput 11(11):5369–5397
Salam A, Hoang AD, Meghna A, Martin DR, Guzman G, Yoon YH, Fan X (2019). The future of emerging IoT paradigms: architectures and technologies. https://doi.org/10.20944/preprints201912.0276.v1
Nong C, Zhang J, Liu Z, Zeng Q, Zhang T (2021) Application of lightweight YOLOv4 in aircraft skin fault detection paper. In: Proceedings of SPIE 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning. https://doi.org/10.1117/12.2604633
Kong Y, Zhang S, Li X, Zhang K, Qi Y, Zhao Z (2021) Recognition system for masked face based on deep learning. In: Proceedings of SPIE 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning. https://doi.org/10.1117/12.2604714
Ye O, P. Huang, Z. Zhang, Y. Zheng et al (2021) Multiview Learning with Robust Double-Sided Twin SVM, IEEE transactions on Cybernetics (early Access)
Fu L, Li Z, Ye Q, et al.(2020) Learning Robust Discriminant Subspace Based on Joint L2,p- and L2,s-Norm Distance Metrics, IEEE Transactions on Neural Networks and Learning Systems. (Early Access)
Ye Q, Li Z, Fu L et al (2019) Nonpeaked discriminant analysis. IEEE Trans Neural Netw Learn Syst 30(12):3818–3832
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article has been retracted. Please see the retraction notice for more detail:https://doi.org/10.1007/s11227-023-05274-4
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, L. RETRACTED ARTICLE: Application of deep learning to detect defects on the surface of steel balls in an IoT environment. J Supercomput 78, 16425–16452 (2022). https://doi.org/10.1007/s11227-022-04516-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-022-04516-1