Skip to main content
Log in

A fast recognition method for coal gangue image processing

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

This paper proposes a modified YOLOv4 model, named GYOLO, for coal gangue recognition with the aim of reducing model parameters, improving calculation speed, and reducing equipment requirements. To achieve this, the paper optimizes the feature extraction network structure by using linear operation instead of traditional convolution to obtain redundant feature maps, thus reducing the number of parameters by 29.7%. A feature fusion network structure is also reconstructed to strengthen the model’s use of feature information, further explore the dependence of each channel feature, and make better use of feature information. The ablation experiment is designed to verify the effect of each improvement. The image is blurred to improve the difficulty of target detection and test the robustness of the GYOLO model. The generative adversarial network is trained with a small amount of coal gangue data, and then a large amount of virtual data is obtained by using the generative adversarial neural network. The GYOLO model is trained by transfer learning, which reduces the dependence of the model on real data. The GYOLO algorithm is compared with a variety of excellent target detection algorithms to analyze the performance of the algorithm. It is verified that the accuracy of the proposed method is 97.08%, which is 2.3% higher than that of the original model, the amount of parameters is reduced by 19.6%, and the amount of data required is reduced by 57.3%. The balance between data volume, parameter quantity and model performance is further realized.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Alfarzaeai, M.S., Niu, Q., Zhao, J., Eshaq, R.: Coal/gangue recognition using convolutional neural networks and thermal images. IEEE Access 8, 76780–76789 (2020)

    Article  Google Scholar 

  2. Bai, F.Y., Fan, M.Q., Yang, H.L., Dong, L.P.: Fast recognition using convolutional neural network for the coal particle density range based on images captured under multiple light sources. Int. J. Min. Sci. Technol. 31(6), 1053–1061 (2021)

    Article  Google Scholar 

  3. Dou, D., Wu, W., YANG, J., Zhang, Y.: Classification of coal and gangue under multiple surface conditions via machine vision and relief-SVM. Powder Technol. 356, 1024–1028 (2019)

    Article  Google Scholar 

  4. Dwivedi, N., et al.: Employing data generation for visual weapon identification using Convolutional neural networks. Multimedia Syst. 28(1), 347 (2022)

    Article  Google Scholar 

  5. Gilanie, G., et al.: RiceNet: convolutional neural networks-based model to classify Pakistani grown rice seed types. Multimedia Syst. 27(5), 867 (2021)

    Article  Google Scholar 

  6. Hu, Y.C., et al.: Video-based driver action recognition via hybrid spatial-temporal deep learning framework. Multimedia Syst. 27(3), 483 (2021)

    Article  Google Scholar 

  7. Hu, F., Zhou, M.R., Yan, P.C., Bian, K.: Multispectral imaging: a new solution for identification of coal and gangue. IEEE Access 7, 169697–169704 (2019)

    Article  Google Scholar 

  8. Han, K., Wang, Y., Tian, Q., Guo, J.Y., Xu, C.J.: GhostNet: more features from cheap operations, pp. 1577–1586. IEEE Computer Society, DC USA (2019)

    Google Scholar 

  9. Hu, F., Bian, K.: Accurate identification strategy of coal and gangue using infrared imaging technology combined with convolutional neural network. IEEE Access 10, 8758–8766 (2022)

    Article  Google Scholar 

  10. Eshaq, R., Hu, E.Y., Qaid, H., Zhang, Y., Liu, T.G.: Using deep convolutional neural networks and infrared thermography to identify coal quality and gangue. IEEE Access 9, 147315–147327 (2021)

    Article  Google Scholar 

  11. Li, D., Wu, D., Xu, F., Lai, J., Shao, L.: Literature overview of Chinese research in the field of better coal utilization. J. Clean. Prod. 185, 959–980 (2018)

    Article  Google Scholar 

  12. Lei, H., Wang, S., Guo, Y.C., Cheng, G.: Multi-scale coal and gangue dual-energy X-ray image concave point detection and segmentation algorithm. Measurement 196, 111041 (2022)

    Article  Google Scholar 

  13. Li, D., Zhang, Z.X., Xu, Z., Xu, L., Meng, G.Y.: An image-based hierarchical deep learning framework for coal and gangue detection. IEEE Access 7, 184686–184699 (2019)

    Article  Google Scholar 

  14. Li, D., Wang, G., Zhang, Y., Wang, S.: Coal gangue detection and recognition algorithm based on deformable convolution YOLOv3. IET Image Proc. 16(1), 134–144 (2022)

    Article  Google Scholar 

  15. Liu, Q., Li, J.G., Li, Y.S., Gao, M.: Recognition methods for coal and coal gangue based on deep learning. IEEE Access 9, 77599–77610 (2021)

    Article  Google Scholar 

  16. Muhammad, I., Akhtar, J., Sheikh, N., Munir, S.: Reverse flotation of cut-of-grade of Lakhra coal. Energy Sourc Part A Recov Utilizat Environ Ef-fects 39(20), 1999–2005 (2017)

    Google Scholar 

  17. Ma, G., Wang, X.S., Liu, J., Chen, W., Niu, Q.: Intelligent detection of foreign matter in coal mine transportation belt based on convolution neural network. Sci Program (2022). https://doi.org/10.1038/s41598-017-18625-y

    Article  Google Scholar 

  18. Pan, H., Shi, Y.H., Lei, X., Wang, Z., Xin, F.: Fast identification model for coal and gangue based on the improved tiny YOLOv3. J. Real-Time Image Proc. 19(3), 687–701 (2022)

    Article  Google Scholar 

  19. Pu, Y., Apel, D., Szmigiel, A., Chen, J.: Image recognition of coal and coal gangue using a convolutional neural network and transfer learning. Energies 12(9), 1735–1745 (2019)

    Article  Google Scholar 

  20. Ran, Z., Pan, Y., Liu, W.: Co-disposal of coal gangue and red mud for prevention of acid mine drainage generation from self-heating gangue dumps. Minerals 11(6) (2020)

  21. Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. International Conference on Learning Representations.

  22. Wu, D., Wang, Y., Wang, M., Wei, C., Hu, G., He, X., Fu, W.: Basic characteristics of coal gangue in a small-scale mining site and risk assessment of radioactive elements for the surrounding soils. Minerals. 11(6), 647 (2021)

    Article  Google Scholar 

  23. Wang, X., Wang, S., Guo, Y., Hu, K., Wang, W.: Dielectric and geometric feature extraction and recognition method of coal and gangue based on VMD-SVM. Powder Technol 7, 241–250 (2021)

    Article  Google Scholar 

  24. Wang, B., Huang, H., Dou, D., Qiu, Z.: Detection of coal content in gangue via image analysis and particle swarm optimization-support vector machine. Int. J. Coal Prep. Util. 42(7), 1915–1924 (2021)

    Article  Google Scholar 

  25. Wang, Y., Wang, Y.J., Dang, L.: Video detection of foreign objects on the surface of belt conveyor underground coal mine based on improved SSD. Journal of Ambient Intelligence and Humanized Computing (2020). https://doi.org/10.1007/s12652-020-02495-w

  26. Wang, L., Wang, X.W., Li, B., Wei, D.L.: A data expansion strategy for improving coal-gangue detection. Int J Coal Preparat Utilizat (2021). https://doi.org/10.1080/19392699.2022.2096016

    Article  Google Scholar 

  27. Xing, J., Zhao, Z., Wang, Y., Nie, L., Du, X.: Coal and gangue identification method based on the intensity image of lidar and DenseNet. Appl. Opt. 60(22), 6566–6572 (2021)

    Article  Google Scholar 

  28. Xu, G., Bu, X., Mao, Y., Ni, C., Peng, Y., Xie, G.: Combined column and cell flotation process for improving clean coal quality: Laboratory-scale and industry-scale studies. Energy Sourc. Part A Recov. Utilizat. Environ-mental Eff. 42(21), 2678–2687 (2020)

    Google Scholar 

  29. Yang, D., Li, J., Du, C., Zheng, K., Liu, S.: Particle size distribution of coal and gangue after impact-crush separation. J. Cent. South Univ. 24(6), 1252–1262 (2017)

    Article  Google Scholar 

  30. Yang, D., Li, J., Zheng, K., Du, C., Liu, S.: Impact-crush separation characteristics of coal and gangue. Int. J. Coal Prep. Util. 38(3), 127–134 (2018)

    Article  Google Scholar 

  31. Zhao, Y., Wang, S., Cheng, G., He, L.: Study on coal and gangue recognition method based on the combination of X-ray transmission and diffraction principle. Energy Sourc. Part A Recov. Utilizat. Environ. Eff. 44(4), 9716–9728 (2022)

    Google Scholar 

  32. Zhang Y, Zhu H, Zhu J, Ou Z, Shen T, Sun J, Feng A 2021 Experimental study on separation of lumpish coal and gangue using X-ray. Energy Sources, Part A: Recovery, Utilization, and Environ-mental Effects.

  33. Zhang, N., Liu, C.: Radiation characteristics of natural gamma-ray from coal and gangue for recognition in top coal caving. Sci. Rep. 8(1), 190 (2018)

    Article  MathSciNet  Google Scholar 

  34. Zhang, Z., Yang, J.: Online analysis of coal ash content on a moving conveyor belt by machine vision. J. Coal Prepara. Utilizat. 37(2), 100–111 (2022)

    Article  MathSciNet  Google Scholar 

  35. Zhang, Y., Wang, J., Yu, Z., Zhao, S., Bei, G.: Research on intelligent detection of coal gangue based on deep learning. Measurement 198, 111415 (2022)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by National Natural Science Foundation of China (51804207, 51875386). We thank the anonymous reviewer for pointing out the issues on the manuscript.

Funding

Xuewen Wang reports financial support was provided by National Natural Science Foundation of China (51875386). Bo Li reports financial support was provided by National Natural Science Foundation of China (51804207).

Author information

Authors and Affiliations

Authors

Contributions

Dailiang Wei is responsible for the improvement of the algorithm structure, Juanli Li and Dailiang Wei are responsible for the preparation of the paper, Bo Li, Xin Wang,Siyuan Chen,Xuewen Wang and Luyao Wang are responsible for the experiment, and Wang Luyao is responsible for drawing the pictures in the paper

Corresponding author

Correspondence to Juanli Li.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Handling editor: Dr. An-An Liu.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wei, D., Li, J., Li, B. et al. A fast recognition method for coal gangue image processing. Multimedia Systems 29, 2323–2335 (2023). https://doi.org/10.1007/s00530-023-01109-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-023-01109-7

Keywords

Navigation