Abstract
Maintenance cost of aircraft engine is an important component of aircraft operation cost. The prediction of aircraft engine maintenance cost can provide decision support for airline to make reasonable maintenance plan and maintenance fund management. Considering that the prediction accuracy of engine maintenance cost is not high in the case of small samples, this paper proposes a bootstrapped support vector regression (SVR) prediction method based on improved recursive feature elimination, which realizes the point and interval prediction of engine maintenance cost in aircraft operation phase. First, the recursive feature elimination (RFE) is improved and then combined with SVR to select feature subsets. Second, particle swarm optimization (PSO) algorithm is applied to optimize the improved RFE-SVR model (IRFE-SVR) parameters. Finally, the point and interval estimates are obtained by bootstrapped IRFE-SVR. To demonstrate the performance of the bootstrapped IRFE-SVR, experiments on UCI and a real case study of engine maintenance cost prediction are conducted. The results on UCI and real datasets show that the bootstrapped IRFE-SVR method has high accuracy and reliability.









Similar content being viewed by others
Availability of data and materials
The data used to support the findings of this study are available from the corresponding author upon request.
References
Lee S, Ma Y, Thimm G, Verstraeten J (2008) Product lifecycle management in aviation maintenance, repair and overhaul. Comput Ind 59(2–3):296–303
Heisey RB (2004) 717-200: low maintenance costs and high dispatch reliability. AERO Mag 2004(19):18–29
Cortes C, Vapnik V (1995) Support-Vector Networks. Mach Learn 20(3):273–297
Friedman J, Hastie T, Tibshirani R (2001) The elements of statistical learning: data mining, inference, and prediction. Springer, New York
Efron B (1979) Bootstrap method: another look at the Jackknife. Ann Stat 7(1):1–26
Rodrigues L, Gomes J, Bizarria C et al (2010) Using prognostic system and decision analysis techniques in aircraft maintenance cost-benefit models. In: Aerospace Conference. IEEE
Bazargan M (2015) An optimization approach to aircraft dispatching strategy with maintenance cost—a case study. J Air Transp Manag 42:10–14
Fioriti M, Vercella V, Viola N (2018) Viola N Cost-estimating model for aircraft maintenance. J Aircr 55(4):1–12
Mofokeng T, Mativenga PT, Annlizé M (2020) Analysis of aircraft maintenance processes and cost. Procedia CIRP 90:467–472
Xie Q-h, Lu Y, Liang J et al (2007) Combination forecasting model of aero-engine maintenance costs based on statistic rough sets theory. J PLA Univ Sci Technol 8(4):391–395
James W, James S, Murat H (2008) Modelling the life cycle cost of aero-engine maintenance. In: ISPE International Conference on Concurrent Engineering
Myoungcheol K, Stephen O, Pericles P, Changduk K (2008) An approach to maintenance cost estimation for aircraft engines. ASME Turbo Expo 2008: power for land, sea, and air Berlin, Germany 2008, pp 71–79
Shanmuganathan VK, Haran AP, Ragavendran S et al (2013) Aero-engine maintenance cost optimization by RCM. Life Sci J 10(1):2891–2896
Wang H, Gao J, Wu H (2014) Direct maintenance cost prediction of civil aircraft. Aircr Eng Aerosp Technol 86(5):406–414
Effiom SO, Abam FI, Kadurumba CH et al (2018) Off-wing fleet maintenance study of a CFM56-3B turbofan engine: the propulsive engine of Boeing 737–300 civil aircraft. Niger J Technol Res 13(1):72
Zhen LI, Zhong S, Lin L (2019) An aero-engine life-cycle maintenance policy optimization algorithm: the reinforcement learning approach. Chin J Aeronaut 32(9):2133–2150
Hong WC, Dong Y, Zheng F et al (2011) Forecasting urban traffic flow by SVR with continuous ACO. Appl Math Model 35(3):1282–1291
Hong WC, Dong Y, Zhang WY et al (2013) Cyclic electric load forecasting by seasonal SVR with chaotic genetic algorithm. Int J Electr Power Energy Syst 44(1):604–614
Liang H, Zou J, Li Z, Khan M, Lu Y (2019) Dynamic evaluation of drilling leakage risk based on fuzzy theory and PSO-SVR algorithm. Futur Gener Comput Syst 95:454–466
Li X, Zhao X, Pu W (2020) Battle damage-oriented spare parts forecasting method based on wartime influencing factors analysis and ε-support vector regression. Int J Prod Res 58(4):1178–1198
Zhang J, Tang H, Tannant D, Lin C, Xia D, Liu X, Zhang Y, Ma J (2021) Combined forecasting model with CEEMD-LCSS reconstruction and the ABC-SVR method for landslide displacement prediction. J Clean Prod 293:126205
Schölkopf B (2003) Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT Press, MIT Press
Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J f Mach Learn Res 3(6):1157–1182
Huang CL, Tsai CY (2014) A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting. Expert Syst Appl 36(2):1529–1539
Chelgania SC, Shahbazib B, Hadavandic E (2018) Support vector regression modeling of coal flotation based on variable importance measurements by mutual information method. Measurement 114:102–108
Hoang ND, Liao KW, Tran XL (2018) Estimation of scour depth at bridges with complex pier foundations using support vector regression integrated with feature selection. J Civ Struct Heal Monit 8:431–442
Mohammadi B, Mehdizadeh S (2020) Modeling daily reference evapotranspiration via a novel approach based on support vector regression coupled with whale optimization algorithm. Agric Water Manag 237:106145
Montgomery DC, Peck EA, Vining GG (1982) Introduction to linear regression analysis. Wiley, New York
Ak R, Li Y, Vitelli V et al (2013) NSGA-II-trained neural network approach to the estimation of prediction intervals of scale deposition rate in oil & gas equipment. Expert Syst Appl 40:1205–1212
Anguita D, Boni A, Ridella S (2000) Evaluating the generalization ability of support vector machines through the bootstrap. Neural Process Lett 11(1):51–58
Masaaki T, Yusuke T (2011) Cross-validation, bootstrap, and support vector machines. Adv Artif Neural Syst. https://doi.org/10.1155/2011/302572
Lins ID, Droguett EL, das Chagas Moura M et al (2015) Computing confidence and prediction intervals of industrial equipment degradation by bootstrapped support vector regression. Reliab Eng Syst Saf 137:120–128
Belayneh A, Adamowski J, Khalil B et al (2016) Coupling machine learning methods with wavelet transforms and the bootstrap and boosting ensemble approaches for drought prediction. Atmos Res 172–173:37–47
Chen W, Gu K, Lin W et al (2021) Reference-free quality assessment of sonar images via contour degradation measurement. IEEE Trans Image Process 28:5336–5351
Meira E, Oliveira F, Menezes L (2021) Point and interval forecasting of electricity supply via pruned ensembles. Energy 232:121009. https://doi.org/10.1016/j.energy.2021.121009
Cherkassky V, Ma Y (2004) Practical selection of SVM parameters and noise estimation for SVM regression. Neural Netw 17(1):113–126
Xin N, Gu X, Wu H et al (2012) Application of genetic algorithm-support vector regression (GA-SVR) for quantitative analysis of herbal medicines. J Chemom 26(7):353–360
Yazdani M, Babagolzadeh M, Kazemitash N, Saberi M (2019) Reliability estimation using an integrated support vector regression–variable neighborhood search model. J Ind Inf Integr 15:103–110
Long S, Zhao M (2020) Theoretical study of GDM-SA-SVR algorithm on RAFM steel. Artif Intell Rev 53:4601–4623
Hu W, Yan L, Liu K et al (2016) A short-term traffic flow forecasting method based on the hybrid PSO-SVR. Neural Process Lett 43(1):155–172
Smola A, Lkopf B (2004) A tutorial on support vector regression. Stat Comput 14(3):199–222
Ding Y, Wilkins D (2006) Improving the performance of SVM-RFE to select genes in microarray data. BMC Bioinform 7(Suppl 2):S12
Kennedy J, Eberhart R 1995 Particle swarm optimization. In: Icnn95-international Conference on Neural Networks. IEEE, pp 1942–1948
Zoubir A, Boashash B (1998) The bootstrap and its application in signal processing. IEEE Signal Process Mag 15:56–76
Tibshirani R, Efron B (1993) An introduction to the bootstrap. Monographs Stat Appl Probab 57:1–436
Khosravi A, Nahavandi S, Srinivasan D et al (2015) Constructing optimal prediction intervals by using neural networks and Bootstrap method. IEEE Trans Neural Netw Learn Syst 26(8):1810–1815
Caesarendra W, Triwiyanto T, Pandiyan V et al (2021) A CNN prediction method for belt grinding tool wear in a polishing process utilizing 3-axes force and vibration data. Electronics 10(12):1429
Xu H, Chen C, Zheng H et al (2020) A GA-SVR-based selection of feature subsets and optimization of parameter in regional soil salinization monitoring. Int J Remote Sens 41(12):4470–4495
Tahmasebifar R, Sheikh M, Kheirollahi R (2017) Point and interval forecasting of real-time and day-ahead electricity prices by a novel hybrid approach. IET Gener Transm Distrib 11(9):2173–2183
Li K, Wang R, Lei H et al (2018) Interval prediction of solar power using an improved Bootstrap method. Sol Energy 159:97–112
Tian C, Hao Y (2020) Point and interval forecasting for carbon price based on an improved analysis-forecast system. Appl Math Model 79:126–144
Acknowledgements
We appreciated Chaoming Hu for providing ideas for the experimental analysis of the manuscript.
Funding
This work is supported by The National Natural Science Foundation of China (Nos. 72271077, 71801071, 71922009, 72071056, 71871080, 71601065, 71690235, 71501058, 71601060), and Innovative Research Groups of the National Natural Science Foundation of China (71521001), Anhui Province Natural Science Foundation (No. 1908085MG223), the Fundamental Research Funds for the Central Universities (Nos. JZ2019HGTA0051, JZ2019HGBZ0131), Base of Introducing Talents of Discipline to Universities for Optimization and Decision-making in the Manufacturing Process of Complex Product (111 project), the Project of Key Research Institute of Humanities and Social Science in University of Anhui Province, Open Research Fund Program of Key Laboratory of Process Optimization and Intelligent Decision-making (Hefei University of Technology), Ministry of Education.
Author information
Authors and Affiliations
Contributions
JH and XQ wrote the main manuscript text, and all authors reviewed the manuscript.
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Hu, J., Qian, X., Tan, C. et al. Point and interval prediction of aircraft engine maintenance cost by bootstrapped SVR and improved RFE. J Supercomput 79, 7997–8025 (2023). https://doi.org/10.1007/s11227-022-04986-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-022-04986-3