Abstract
In many complex industrial scenarios where condition monitoring data are involved, data-driven models can highly support maintenance tasks and improve assets’ performance. To infer physical meaningful models that accurately characterize assets’ behaviors across a wide range of operating conditions is a difficult issue. Usually, data-driven models are in black-box format, accurate but too complex to intelligibly explain the inherent physics of the process and lacking in conciseness. This study presents a deep evolutionary-based approach to optimally model and predict physical behaviors in industrial assets from operational data. The evolutionary modeling process is combined with long short-term memory networks, which are trained on estimations made by the evolutionary physical model and then used to predict sequences of data over a number of time steps. The likelihood of behaviors of interest is assessed by means of the resulting sequences of residuals, and a resulting score is computed over time. The proposed approach is applied to model and predict a set of temperatures related to a marine propulsion system, anticipating anomalies and changes in operating conditions. It is demonstrated that deep evolutionary modeling results are quite satisfactory for prognostics and obtained physical models are practical and easy to understand.
Similar content being viewed by others
References
Al-Janabi S (2017) Pragmatic miner to risk analysis for intrusion detection (pmraid). In: International conference on soft computing in data science. pp 263–277
Al_Janabi S, Al_Shourbaji I, Salman MA (2017) Assessing the suitability of soft computing approaches for forest fires prediction. Appl Comput Inform 14:214–224
Azar AT, Vaidyanathan S (2015) Computational intelligence applications in modeling and control. Springer, Berlin
Barmpalexis P, Kachrimanis K, Tsakonas A, Georgarakis E (2011) Symbolic regression via genetic programming in the optimization of a controlled release pharmaceutical formulation. Chemometr Intell Lab Syst 107(1):75–82
Bentley P (1999) Evolutionary design by computers. Morgan Kaufmann, Burlington
Box GE, Jenkins GM, Reinsel GC, Ljung GM (2015) Time series analysis: forecasting and control. Wiley, Hoboken
Brabazon A, O’Neill M, McGarraghy S (2015) Natural computing algorithms. Springer, Berlin
Carrascal A, Díez Oliván A, Font Fernández JM, Manrique Gamo D (2009) Evolutionary generation of fuzzy knowledge bases for diagnosing monitored railway systems. In: 22nd International congress on condition monitoring and diagnostic engineering management (COMADEM 2009), pp 191–198, San Sebastián, España
Carrascal A, Font J, Pelta D (2010) Evolutionary physical model design. In: Research and development in intelligent systems, vol xxvi. Springer, pp 487–492
Çelik V, Arcaklioğlu E (2005) Performance maps of a diesel engine. Appl Energy 81(3):247–259
Chapra SC, Canale RP (2012) Numerical methods for engineers, vol 2. McGraw-Hill, New York
Dallemand JE (1958) Stepwise regression program on the ibm 704. In: GMR-I99, Research Laboratories, GeneralMotor Corporation (November 1958)
Diez-Olivan A, Pagan JA, Khoa NLD, Sanz R, Sierra B (2018) Kernelbased support vector machines for automated health status assessment in monitoring sensor data. Int J Adv Manuf Technol 95(1–4):327–340
Diez-Olivan A, Pagan JA, Sanz R, Sierra B (2017) Data-driven prognostics using a combination of constrained k-means clustering, fuzzymodeling and lof-based score. Neurocomputing 241:97–107
Doerr B, Fischer P, Hilbert A, Witt C (2017) Detecting structural breaks in time series via genetic algorithms. Soft Comput 21(16):4707–4720
Espinosa HEP, Ayala-Solares JR (2016) The power of natural inspiration in control systems. In: Nature-inspired computing for control systems. Springer, pp 1–10
Garg A, Vijayaraghavan V, Tai K, Singru PM, Jain V, Krishnakumar N (2015) Model development based on evolutionary framework for condition monitoring of a lathe machine. Measurement 73:95–110
Garson GD (2012) Testing statistical assumptions. Statistical Associates Publishing, Asheboro
Gong YJ, Chen WN, Zhan ZH, Zhang J, Li Y, Zhang Q, Li JJ (2015) Distributed evolutionary algorithms and theirmodels: a survey of the state-of-the-art. Appl Soft Comput 34:286–300
Guo L, Li N, Jia F, Lei Y, Lin J (2017) A recurrent neural network based health indicator for remaining useful life prediction of bearings. Neurocomputing 240:98–109
Haeri MA, Ebadzadeh MM, Folino G (2017) Statistical genetic programming for symbolic regression. Appl Soft Comput 60:447–469
Harrell FE (2001) Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. Springer, Berlin
Hayton P, Utete S, King D, King S, Anuzis P, Tarassenko L (2007) Static and dynamic novelty detection methods for jet engine health monitoring. Philos Trans R Soc Lond A Math Phys Eng Sci 365(1851):493–514
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection, vol 1. MIT Press, Cambridge
La Cava W, Danai K, Spector L, Fleming P, Wright A, Lackner M (2016) Automatic identification of wind turbine models using evolutionary multiobjective optimization. Renew Energy 87:892–902
Langley P, Zytkow JM (1989) Data-driven approaches to empirical discovery. Artif Intell 40(1):283–312
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444
Malhotra P , Vig L, Shroff G, Agarwal P (2015). Long short term memory networks for anomaly detection in time series. In: Proceedings. p 89
Meerschaert MM (2013) Mathematical modeling. Academic Press, Cambridge
Mikolov T, Karafiát M, Burget L, Cernockỳ J, Khudanpur S (2010) Recurrent neural network based languagemodel. In: Interspeech, vol 2, p 3
Munteanu MC, Caliman A, Zaharia C (2017, May 30) Convolutional neural network. In: Google patents. US Patent 9,665,799
Rasmussen CE, Williams CK (2006) Gaussian processes for machine learning, vol 38, pp 715–719. The MIT Press, Cambridge, MA, USA
Rodriguez JD, Perez A, Lozano JA (2010) Sensitivity analysis of k-fold cross validation in prediction error estimation. IEEE Trans Pattern Anal Mach Intell 32(3):569–575
Rojas R (2013) Neural networks: a systematic introduction. Springer, Berlin
Rokach L, Maimon O (2005) Top-down induction of decision trees classifiersa survey. IEEE Trans Syst Man Cybern Part C (Appl Rev) 35(4):476–487
Rousseaux F (2016) Big data and data-driven intelligent predictive algorithms to support creativity in industrial engineering. Comput Ind Eng 112:459–465
Safiyullah F, Sulaiman SA, Zakaria N, Jasmani MS, Ghazali SMA (2016) Modeling the isentropic head value of centrifugal gas compressor using genetic programming. In: Matec web of conferences, vol 38
Shipmon DT, Gurevitch JM, Piselli PM, Edwards ST (2017) Time series anomaly detection; detection of anomalous drops with limited features and sparse examples in noisy highly periodic data. arXiv preprint arXiv:1708.03665
Tian F, Voskuijl M (2015) Automated generation of multiphysics simulation models to support multidisciplinary design optimization. Adv Eng Inf 29(4):1110–1125
Westervelt FH (1960) Automatic system simulation programming (Unpublished doctoral dissertation). Ph.D. Dissertation, University ofMichigan
Whigham PA, et al (1995) Grammatically-based genetic programming. In: Proceedings of the workshop on genetic programming: from theory to real world applications, vol 16, pp 33–41
Yin S, Li X, Gao H, Kaynak O (2015) Data-based techniques focused on modern industry: an overview. IEEE Trans Ind Electron 62(1):657–667
Zhao Y, Chu S, Zhou Y, Tu K (2017) Sequence prediction using neural network classiers. In: International conference on grammatical inference, pp 164–169
Zhu Q, Azar AT (2015) Complex system modelling and control through intelligent soft computations. Springer, Berlin
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest.
Ethical standard
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by V. Loia.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Diez-Olivan, A., Pagan, J.A., Sanz, R. et al. Deep evolutionary modeling of condition monitoring data in marine propulsion systems. Soft Comput 23, 9937–9953 (2019). https://doi.org/10.1007/s00500-018-3549-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-018-3549-3