Skip to main content

Advertisement

Advanced stacking models for machine fault diagnosis with ensemble trees and SVM

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Fault diagnosis plays an integral role in machine health monitoring. However, in practical applications, there are obvious differences in class distribution within the data, leading to poor performance of the algorithm in identifying a few classes. Meanwhile, overfitting and computational resource requirements have become a challenge. Recently, the stacking model has been promoted in the field of fault diagnosis, but its performance evaluation of stacking models in many literature is not comprehensive enough. In this paper, an Advanced Ensemble Trees model (AET) is proposed. The SMOTE (Synthetic Minority Oversampling Technique) resampling technique is used to optimise the dataset balance. Then, the advantages of Support Vector Machines (SVM) and multi-tree models are combined to form a robust base model using hyper-parameter tuning. Simple Logistic Regression (LR) is used as a meta-model to construct the new stacking model. Through extensive experimental validation, it is found that the AET model is close to 99% in several key performance metrics and outperforms existing machine learning methods and relatively short model training time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Algorithm 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The UCI AI4I 2020 Predictive Maintenance Dataset is available at: https://archive.ics.uci.edu/dataset/601/ai4i+2020+predictive+maintenance+dataset. The CWRU Dataset is available at: https://engineering.case.edu/bearingdatacenter/download-data-file.

References

  1. Hakim M, Omran AAB, Ahmed AN, Al-Waily M, Abdellatif A (2023) A systematic review of rolling bearing fault diagnoses based on deep learning and transfer learning: Taxonomy, overview, application, open challenges, weaknesses and recommendations. Ain Shams Eng J 14(4):101945

    Article  Google Scholar 

  2. Li D, Zhang Z, Wen G (2023) Classifier subset selection based on classifier representation and clustering ensemble. Appl Intell 53(18):20730–20752

    Article  MATH  Google Scholar 

  3. Dey R, Mathur R (2023) Ensemble learning method using stacking with base learner, a comparison. In: International conference on data analytics and insights, Springer pp 159–169

  4. Wang Y, Wang D, Geng N, Wang Y, Yin Y, Jin Y (2019) Stacking-based ensemble learning of decision trees for interpretable prostate cancer detection. Appl Soft Comput 77:188–204

    Article  MATH  Google Scholar 

  5. Zhou L, Li W, Wu T, Fan Z, Ismaili L, Komolafe TE, Zhang S (2024) Adaptive weighted stacking model with optimal weights selection for mortality risk prediction in sepsis patients. Appl Intell 1–22

  6. Rashid M, Kamruzzaman J, Imam T, Wibowo S, Gordon S (2022) A tree-based stacking ensemble technique with feature selection for network intrusion detection. Appl Intell 52(9):9768–9781

    Article  MATH  Google Scholar 

  7. Rashid M, Kamruzzaman JA, Imam T et al (2022) A tree-based stacking ensemble technique with feature selection for network intrusion detection. Appl Intell 52:9768–9781. https://doi.org/10.1007/s10489-021-02968-1

    Article  MATH  Google Scholar 

  8. Chen C-H, Tsung C-K, Yu S-S (2022) Designing a hybrid equipment-failure diagnosis mechanism under mixed-type data with limited failure samples. Appl Sci 12(18):9286

    Article  MATH  Google Scholar 

  9. Brandt J, Lanzén E (2021) A comparative review of smote and adasyn in imbalanced data classification

  10. He D, Li R, Zhang Z, Sun S, Guo P (2021) Gas-liquid two-phase flow pattern identification of a centrifugal pump based on smote and artificial neural network. Micromachines 13(1):2

    Article  MATH  Google Scholar 

  11. Mota B, Faria P, Ramos C (2022) Predictive maintenance for maintenance-effective manufacturing using machine learning approaches. In: International workshop on soft computing models in industrial and environmental applications, Springer pp 13–22

  12. Grzyb J, Woźniak M (2023) Svm ensemble training for imbalanced data classification using multi-objective optimization techniques. Appl Intell 53(12):15424–15441

    Article  MATH  Google Scholar 

  13. Tîrnovan R-A, Cristea M (2019) Advanced techniques for fault detection and classification in electrical power transmission systems: An overview. In: 2019 8th International conference on modern power systems (MPS), IEEE pp 1–10

  14. Li Z, Zhang Y, Abu-Siada A, Chen X, Li Z, Xu Y, Zhang L, Tong Y (2021) Fault diagnosis of transformer windings based on decision tree and fully connected neural network. Energies 14(6):1531

    Article  MATH  Google Scholar 

  15. Rajagopal S, Kundapur PP, Hareesha KS (2020) A stacking ensemble for network intrusion detection using heterogeneous datasets. Secur Commun Netw 2020:1–9

    Article  Google Scholar 

  16. Li G, Zheng Y, Liu J, Zhou Z, Xu C, Fang X, Yao Q (2021) An improved stacking ensemble learning-based sensor fault detection method for building energy systems using fault-discrimination information. J Build Eng 43:102812

    Article  Google Scholar 

  17. Frank M, Drikakis D, Charissis V (2020) Machine-learning methods for computational science and engineering. Computation 8(1):15

    Article  MATH  Google Scholar 

  18. Van N, Van Thanh P, Tran D, Tran D-T (2023) A new model of air quality prediction using lightweight machine learning. Int J Environ Sci Technol 20(3):2983–2994

  19. Zhang H, Ren Y, Zhang Y, Zheng S (2023) Intelligent prediction method for fracture pressure based on stacking ensemble algorithm. Geomech Geophys Geo-Energy Geo-Resourc 9(1):149

    Article  MATH  Google Scholar 

  20. Alazba A, Aljamaan H (2022) Software defect prediction using stacking generalization of optimized tree-based ensembles. Appl Sci 12(9):4577

    Article  MATH  Google Scholar 

  21. Yang L, Shami A (2020) On hyperparameter optimization of machine learning algorithms: Theory and practice. Neurocomputing 415:295–316

    Article  MATH  Google Scholar 

  22. Bansal A, Kaur S (2018) Extreme gradient boosting based tuning for classification in intrusion detection systems. In: Advances in computing and data sciences: second international conference, ICACDS 2018, Dehradun, India, April 20-21, 2018, Revised Selected Papers, Part I 2, Springer pp 372–380

  23. Ismail E, Gad W, Hashem M (2023) A hybrid stacking-smote model for optimizing the prediction of autistic genes. BMC Bioinform 24(1):379

    Article  MATH  Google Scholar 

  24. Zhang W, Yang D, Wang H (2019) Data-driven methods for predictive maintenance of industrial equipment: A survey. IEEE Syst J 13(3):2213–2227

    Article  MATH  Google Scholar 

  25. AI4I 2020 Predictive Maintenance Dataset (2020) UCI machine learning repository. https://doi.org/10.24432/C5HS5C

  26. Fernández A, Garcia S, Herrera F, Chawla NV (2018) Smote for learning from imbalanced data: progress and challenges, marking the 15-year anniversary. J Artif Intell Res 61:863–905

    Article  MathSciNet  MATH  Google Scholar 

  27. Matzka S (2020) Explainable artificial intelligence for predictive maintenance applications. In: 2020 Third international conference on artificial intelligence for industries (ai4i), IEEE pp 69–74

  28. Iantovics LB, Enăchescu C (2022) Method for data quality assessment of synthetic industrial data. Sensors 22(4):1608

    Article  MATH  Google Scholar 

  29. Torcianti A, Matzka S (2021) Explainable artificial intelligence for predictive maintenance applications using a local surrogate model. In: 2021 4th International conference on artificial intelligence for industries (ai4i), IEEE pp 86–88

  30. Vuttipittayamongkol P, Arreeras T (2022) IEEE Data-driven industrial machine failure detection in imbalanced environments. In: 2022 IEEE international conference on industrial engineering and engineering management (IEEM), pp 1224–1227

  31. Ghasemkhani B, Aktas O, Birant D (2023) Balanced k-star: An explainable machine learning method for internet-of-things-enabled predictive maintenance in manufacturing. Machines 11(3):322

    Article  MATH  Google Scholar 

Download references

Acknowledgements

This research was funded by Hunan Provincial Regional Joint Fund Project (Grant No. 2024JJ7179).

Author information

Authors and Affiliations

Authors

Contributions

Yuhua Liao, conceptualization methodology, experiment, validation and writing draft manuscript. Ming Li, conceptualization, methodology, formal analysis. Qingshuai Sun, methodology, validation. Pude Li, supervision, validation.

Corresponding author

Correspondence to Ming Li.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest to the content of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liao, Y., Li, M., Sun, Q. et al. Advanced stacking models for machine fault diagnosis with ensemble trees and SVM. Appl Intell 55, 251 (2025). https://doi.org/10.1007/s10489-024-06206-2

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-06206-2

Keywords