Abstract
Deep learning has been diffusely used in bearing fault diagnosis. In view of the increasing complexity of the model and the exponential growth of the hyperparameters, the adjustment becomes increasingly difficult. In this paper, a Bayesian optimization-Deep convolution gate recurring unit (Bayes-DCGRU) based on Bayesian optimization is proposed. It adopts Bayesian optimization algorithm to automatically adjust the hyperparameters of the model, and convolutional neural network (CNN) adaptively extracts the spatial characteristics of bearing signals. Combined with the Gate recurring unit (GRU) to learn the time series characteristics of signals, and then achieve high precision bearing fault identification. This method overcomes the shortcomings of the traditional hyperparameter adjustment method based on experience and feeling. It provides a solution for the hyperparameter adjustment of bearing fault diagnosis model under multi-hyperparameter coupling. The experimental results show that the model obtained by this method converges quickly and the fault identification accuracy is higher.
Similar content being viewed by others
References
Xie P, Lin H, Liu Y (2017) Principles and Applications of Signal Processing, vol 1. Tsinghua University Press
El-Thalji I, Jantunen E (2015) A summary of fault modelling and predictive health monitoring of rolling element bearings. Mech Syst Signal Process 60:252–272
Ding X, He Q (2017) Energy-fluctuated multiscale feature learning with deep convnet for intelligent spindle bearing fault diagnosis. IEEE Trans Instrum Measur PP(8):1–10
Fan X, Liang M, Yeap TH, Kind B (2007) A joint wavelet lifting and independent component analysis approach to fault detection of rolling element bearings. Smart Mater Struct 16(5):1973
Chen C, Li Z, Yang J, Liang B (2017) A cross domain feature extraction method based on transfer component analysis for rolling bearing fault diagnosis. In: 2017 29Th chinese control and decision conference (CCDC)
Feng Y, Zhang Z, Zhao X, Ji R, Gao Y (2018) Gvcnn: Group-view convolutional neural networks for 3d shape recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 264–272
Wang X, Gao L, Song J, Shen H (2016) Beyond frame-level cnn: saliency-aware 3-d cnn with lstm for video action recognition. IEEE Signal Process Lett 24(4):510–514
Chen Z, Mauricio A, Li W, Gryllias K (2020) A deep learning method for bearing fault diagnosis based on cyclic spectral coherence and convolutional neural networks. Mech Syst Signal Process:140
Zhang W, Li C, Peng G, Chen Y, Zhang Z (2018) A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load. Mech Syst Signal Process 100:439–453
Islam M, Kim JM (2019) Automated bearing fault diagnosis scheme using 2D representation of wavelet packet transform and deep convolutional neural network. Comput Ind 106:142–153
Li H, Huang J, Ji S (2019) Bearing fault diagnosis with a feature fusion method based on an ensemble convolutional neural network and deep neural network. Sensors 19(9):2034
Chen X, Zhang B, Gao D, Kusiak A (2021) Bearing fault diagnosis base on multi-scale CNN and LSTM model. J Intell Manuf 32(4):971–987
Khorram A, Khalooei M, Rezghi M (2021) End-to-end cnn+ lstm deep learning approach for bearing fault diagnosis. Appl Intell 51(2):736–751
Wang Z, Liu Q, Chen H, Chu X (2020) A deformable cnn-dlstm based transfer learning method for fault diagnosis of rolling bearing under multiple working conditions. Int J Prod Res:1–15
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Chung J, Gulcehre C, Cho KH, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. Eprint Arxiv
Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(2)
Doke P, Shrivastava D, Pan C, Zhou Q, Zhang YD (2020) Using cnn with bayesian optimization to identify cerebral micro-bleeds. Mach Vis Appl 31:1–14
Zhang Q, Hu W, Liu Z, Tan J (2020) Tbm performance prediction with bayesian optimization and automated machine learning. Tunn Undergr Space Technol 103:103493
Zhang Z, Robinson D, Tepper J (2018) Detecting hate speech on twitter using a convolution-gru based deep neural network. In: European semantic web conference. Springer, pp 745–760
Sainath TN, Vinyals O, Senior A, Sak H (2015) Convolutional, long short-term memory, fully connected deep neural networks. In: 2015 IEEE International conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 4580–4584
Goodfellow I, Bengio Y, Courville A, Bengio Y (2016) Deep learning, vol. 1. MIT Press, Cambridge
Chaturvedi I, Ong YS, Arumugam RV (2015) Deep transfer learning for classification of time-delayed gaussian networks. Signal Process 110:250–262
Brochu E, Cora VM, Freitas ND (2010) A tutorial on bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. Computer Science
Chollet F, et al. (2018) Deep learning with Python, vol 361. Manning New York
Case western reserve university bearing data center website. http://www.eecs.case.edu/laboratory/bearing
Qiao M, Yan S, Tang X, Xu C (2020) Deep convolutional and lstm recurrent neural networks for rolling bearing fault diagnosis under strong noises and variable loads. IEEE Access PP(99):1–1
Acknowledgements
The authors would like to gratefully acknowledge the financial support of the Fundamental Research Funds for the Central Universities (N180304020).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jiaocheng, M., Jinan, S., Xin, Z. et al. Bayes-DCGRU with bayesian optimization for rolling bearing fault diagnosis. Appl Intell 52, 11172–11183 (2022). https://doi.org/10.1007/s10489-021-02924-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-021-02924-z