Skip to main content
SpringerLink
Log in

A centernet-based direct detection method for mining conveyer belt damage

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

As the main components of belt conveyor, the conveyor belt plays an important role in carrying materials and transferring power. Due to the harsh usage conditions, conveyor belts often suffer from surface wear, surface damage, breakdown, tears or other damage accidents, especially in mining belt conveyors. In view of the immature damage detection methods of conveyor belt and the needs of the intelligent development of coal mine equipment, a centernet-based direct damage detection method was proposed on the basis of constructing the belt damage dataset. Unlike the current commonly used anchor-based target detection mechanism, centernet target detection algorithm was adopted in this paper based on center point detection, belongs to anchor-free mechanism, which omits the process of anchor generation and regression adjustment. The prediction process is more straightforward, and the test accuracy on the conveyor belt damage dataset reaches 97%, with a test speed of 32.4 FPS. Compared with Yolov3 algorithm, the accuracy is increased by 10%, and the detection speed by 12.9%, while 7.8% in accuracy with Yolov4. Meanwhile, the performance of various target detection algorithms, including hardware usage, were also compared on the conveyor belt damage dataset by means of transfer learning, which provides an empirical reference for the intelligent development of belt conveyors and the marginalization of monitoring.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Aichun Z, Gang H, Yongxing W (2011) The research on the detection method of belt deviation by video in coal mine. IEEE, pp 430–433

    Google Scholar 

  • Al-Andoli M, Cheah WP, Tan SC (2021a) Deep learning-based community detection in complex networks with network partitioning and reduction of trainable parameters. J Amb Intel Hum Comp 12:2527–2545

    Article  Google Scholar 

  • Al-Andoli M, Cheah WP, Tan SC (2021b) Deep autoencoder-based community detection in complex networks with particle swarm optimization and continuation algorithms. J Intell Fuzzy Syst 40:1–17

    Google Scholar 

  • Chollet FCCO (2017) Xception: deep learning with depthwise separable convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, pp 1251–1258

    Google Scholar 

  • Fedorko G, Molnar V, Marasova D, Grincova A, Dovica M, Zivcak J, Toth T, Husakova N (2013) Failure analysis of belt conveyor damage caused by the falling material. Part II: application of computer metrotomography. Eng Fail Anal 34:431–442

    Article  Google Scholar 

  • Fedorko G, Molnar V, Marasova D, Grincova A, Dovica M, Zivcak J, Toth T, Husakova N (2014) Failure analysis of belt conveyor damage caused by the falling material. Part I: experimental measurements and regression models. Eng Fail Anal 36:30–38

    Article  Google Scholar 

  • Fedorko G, Molnar V, Dovica M, Toth T, Fabianova J (2015) Failure analysis of irreversible changes in the construction of the damaged rubber hoses. Eng Fail Anal 58:31–43

    Article  Google Scholar 

  • Gao Y, Qiao T, Zhang H, Yang Y, Pang Y, Wei H (2019) A contactless measuring speed system of belt conveyor based on machine vision and machine learning. Measurement 139:127–133

    Article  Google Scholar 

  • Girshick R (2015) Fast r-cnn. IEEE, pp 1440–1448

    Google Scholar 

  • Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, pp 580–587

    Google Scholar 

  • Grincova A, Andrejiova M, Marasova D (2016) Failure analysis of conveyor belt in terms of impact loading by means of the damping coefficient. Eng Fail Anal 68:210–221

    Article  Google Scholar 

  • Guan Y, Zhang J, Shang Y, Wu M, Liu X (2008) Embedded sensor of forecast conveyer belt breaks. IEEE, pp 617–621

    Google Scholar 

  • Hao X, Liang H (2019) A multi-class support vector machine real-time detection system for surface damage of conveyor belts based on visual saliency. Measurement 146:125–132

    Article  Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, pp 770–778

    Google Scholar 

  • Hou C, Qiao T, Zhang H, Pang Y, Xiong X (2019) Multispectral visual detection method for conveyor belt longitudinal tear. Measurement 143:246–257

    Article  Google Scholar 

  • Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105

    Google Scholar 

  • Law H, Deng J (2018a) Cornernet: detecting objects as paired keypoints. Proceedings of the European conference on computer vision. Springer, pp 734–750

    Google Scholar 

  • Lin T, Dollar P, Girshick R, He K, Hariharan B, Belongie S (2017a) Feature pyramid networks for object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, pp 2117–2125

    Google Scholar 

  • Lin T, Goyal P, Girshick R, He K, Dollar P (2017b) Focal loss for dense object detection. Proceedings of the IEEE international conference on computer vision. IEEE, pp 2980–2988

    Google Scholar 

  • Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C, Berg AC (2016) Ssd: Single shot multibox detector. Springer, pp 21–37

    Google Scholar 

  • Molnar W, Nugent S, Lindroos M, Apostol M, Varga M (2015a) Ballistic and numerical simulation of impacting goods on conveyor belt rubber. Polym Test 42:1–7

    Article  Google Scholar 

  • Molnar W, Nugent S, Lindroos M, Apostol M, Varga M (2015b) Ballistic and numerical simulation of impacting goods on conveyor belt rubber. Int J Math Eng Manag Sci Polym Test 42:1169–1179

    Google Scholar 

  • Pang Y, Lodewijks G (2006) A novel embedded conductive detection system for intelligent conveyor belt monitoring. IEEE, Rome, pp 803–808

    Google Scholar 

  • Peng H, Wu J, Chen S, Huang J, Tolias G, Sicre R, Gou JE (2019) Collaborative channel pruning for deep networks. International conference on machine learning. IEEE

    Google Scholar 

  • Qiao T, Lu X, Yan L (2012) Research on the signal feature extraction method in steel-cord conveyor belt with metal magnetic memory testing. Adv Sci Lett 11:489–492

    Article  Google Scholar 

  • Redmon J, Farhadi A (2018) Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767.

  • Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, pp 779–788

    Google Scholar 

  • Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497.

  • Sakharwade SG, Nagpal S, Molnar W, Nugent S, Lindroos M, Apostol M, Varga M (2019) Analysis of transient belt stretch for horizontal and inclined belt conveyor system

  • Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. PMLR. IEEE, pp 6105–6114

    Google Scholar 

  • Tian Z, Shen C, Chen H, He T (2019) Fcos: fully convolutional one-stage object detection. Proceedings of the IEEE/CVF international conference on computer vision 2019. IEEE, pp 9627–9636

    Google Scholar 

  • Tolias G, Sicre R, Jégou H (2015a) Particular object retrieval with integral max-pooling of CNN activations. In: PMLR, pp 5113–5122.

  • Tolias G, Sicre R, Jégou H (2015b) Particular object retrieval with integral max-pooling of CNN activations. arXiv preprint arXiv:1511.05879.

  • Ullrich K, Meeds E, Welling M (2017) Soft weight-sharing for neural network compression. arXiv preprint arXiv:1702.04008.

  • Wang Y, Wang Y, Dang L (2020) Video detection of foreign objects on the surface of belt conveyor underground coal mine based on improved SSD. J Amb Intel Hum Comp. https://doi.org/10.1007/s12652-020-02495-w

    Article  Google Scholar 

  • Xianguo L, Lifang S, Zixu M, Can Z, Hangqi J (2018) Laser-based on-line machine vision detection for longitudinal rip of conveyor belt. Optik 168:360–369

    Article  Google Scholar 

  • Yang Y, Miao C, Li X, Mei X (2014) On-line conveyor belts inspection based on machine vision. Optik 125:5803–5807

    Article  Google Scholar 

  • Yang Y, Hou C, Qiao T, Zhang H, Ma L (2019) Longitudinal tear early-warning method for conveyor belt based on infrared vision. Measurement 147:106817

    Article  Google Scholar 

  • Yang R, Qiao T, Pang Y, Yang Y, Zhang H, Yan G (2020) Infrared spectrum analysis method for detection and early warning of longitudinal tear of mine conveyor belt. Measurement 165:107856

    Article  Google Scholar 

  • Yu B, Qiao T, Zhang H, Yan G (2018) Dual band infrared detection method based on mid-infrared and long infrared vision for conveyor belts longitudinal tear. Measurement 120:140–149

    Article  Google Scholar 

  • Zeng F, Xie Z (2018) Coordinated control system of multi-level belt conveyors for promotion the energy efficiency based on IoT-technology. IEEE, pp 675–679

    Google Scholar 

  • Zhang M, Shi H, Yu Y, Zhou M (2020a) A computer vision based conveyor deviation detection system. Appl Sci 10:2402

    Article  Google Scholar 

  • Zhang M, Zhou M, Shi H (2020b) A computer vision-based real-time load perception method for belt conveyors. Math Probl Eng 2020:1–9

    Google Scholar 

  • Zhang M, Shi H, Zhang Y, Yu Y, Zhou M (2021) Deep learning-based damage detection of mining conveyor belt. Measurement 175:109130

    Article  Google Scholar 

  • Zhou X, Wang D, Krähenbühl, P (2019a) Objects as points. arXiv preprint arXiv:1904.07850.

  • Zhou X, Zhuo J, Krahenbuhl P (2019b) Bottom-up object detection by grouping extreme and center points. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2019. IEEE, pp 850–859

    Google Scholar 

Download references

Funding

This research received no external funding.

Author information

Authors and Affiliations

  1. College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao, 266590, Shandong, China

    Mengchao Zhang, Yuan Zhang, Manshan Zhou & Hao Shi

  2. College of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, 100049, China

    Ningxia Sun

  3. College of Mechanical Electronic and Information Engineering, China University of Mining and Technology (Beijing), Beijing, 100083, China

    Yang Shen

Authors
  1. Mengchao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ningxia Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Manshan Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yang Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hao Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Writing—original draft preparation, MZ and NS; data collection—YS; methodology, MZ; software, MZ; review and editing, YZ and HS.

Corresponding author

Correspondence to Hao Shi.

Ethics declarations

Conflict of interest

The authors declare no conflict of interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, M., Sun, N., Zhang, Y. et al. A centernet-based direct detection method for mining conveyer belt damage. J Ambient Intell Human Comput 14, 4477–4487 (2023). https://doi.org/10.1007/s12652-023-04566-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-023-04566-0

Keywords

Search

Navigation