Skip to main content

Advertisement

Springer Nature Link
Log in

A data-driven approach based on deep neural networks for lithium-ion battery prognostics

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Remaining useful life estimation is gaining attention in many real-world applications to alleviate maintenance expenses and increase system reliability and efficiency. Deep learning approaches have recently provided a significant improvement in the estimation of remaining useful life (RUL) and degradation progression concerning machinery prognostics. This research presents a new data-driven approach for RUL estimation using a hybrid deep neural network that combines CNN, LSTM, and classical neural networks. The presented CNN–LSTM neural network aims to extract the spatio-temporal relations in multivariate time series data and capture nonlinear characteristics to achieve better RUL prediction accuracy. To improve the proposed model's performance, PSO is handled to simultaneously optimize the hyperparameters of the network consisting of the number of epochs, the number of convolutional and LSTM layers, the size of units (or filters) in each convolutional, and LSTM layers. Besides, the proposed model in this paper, called the CNN–LSTM–PSO, realizes the multi-step-ahead prediction. In the experimental studies, the popular lithium-ion battery dataset presented by NASA is selected to verify the CNN–LSTM–PSO approach. The experimental consequences revealed that the presented CNN–LSTM–PSO model gives better results than other state-of-the-art machine learning techniques and deep learning approaches considering various performance criteria.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Li X, Zhang W, Ma H et al (2020) Data alignments in machinery remaining useful life prediction using deep adversarial neural networks. Knowl Based Syst 197:105843. https://doi.org/10.1016/j.knosys.2020.105843

    Article  Google Scholar 

  2. Deng L, Shen W, Wang H, Wang S (2021) A rest-time-based prognostic model for remaining useful life prediction of lithium-ion battery. Neural Comput Appl 33:2035–2046. https://doi.org/10.1007/s00521-020-05105-0

    Article  Google Scholar 

  3. Carvalho TP, Soares FAAMN, Vita R et al (2019) A systematic literature review of machine learning methods applied to predictive maintenance. Comput Ind Eng 137:106024. https://doi.org/10.1016/j.cie.2019.106024

    Article  Google Scholar 

  4. Wang Y, Tian J, Sun Z et al (2020) A comprehensive review of battery modeling and state estimation approaches for advanced battery management systems. Renew Sustain Energy Rev 131:110015. https://doi.org/10.1016/j.rser.2020.110015

    Article  Google Scholar 

  5. Tian H, Qin P, Li K, Zhao Z (2020) A review of the state of health for lithium-ion batteries: Research status and suggestions. J Clean Prod 261:120813. https://doi.org/10.1016/j.jclepro.2020.120813

    Article  Google Scholar 

  6. Zhang Z, Si X, Hu C, Lei Y (2018) Degradation data analysis and remaining useful life estimation: a review on Wiener-process-based methods. Eur J Oper Res 271:775–796. https://doi.org/10.1016/j.ejor.2018.02.033

    Article  MathSciNet  MATH  Google Scholar 

  7. Zhu J, Chen N, Peng W (2019) Estimation of bearing remaining useful life based on multiscale convolutional neural network. IEEE Trans Ind Electron 66:3208–3216. https://doi.org/10.1109/TIE.2018.2844856

    Article  Google Scholar 

  8. Liu D, Luo Y, Liu J et al (2014) Lithium-ion battery remaining useful life estimation based on fusion nonlinear degradation AR model and RPF algorithm. Neural Comput Appl 25:557–572. https://doi.org/10.1007/s00521-013-1520-x

    Article  Google Scholar 

  9. Trinh H-C, Kwon Y-K (2020) A data-independent genetic algorithm framework for fault-type classification and remaining useful life prediction. Appl Sci 10:368. https://doi.org/10.3390/app10010368

    Article  Google Scholar 

  10. Wang D, Miao Q, Pecht M (2013) Prognostics of lithium-ion batteries based on relevance vectors and a conditional three-parameter capacity degradation model. J Power Sour 239:253–264. https://doi.org/10.1016/j.jpowsour.2013.03.129

    Article  Google Scholar 

  11. Ben Ali J, Chebel-Morello B, Saidi L et al (2015) Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network. Mech Syst Signal Process 56–57:150–172. https://doi.org/10.1016/j.ymssp.2014.10.014

    Article  Google Scholar 

  12. Qin W, Lv H, Liu C et al (2019) Remaining useful life prediction for lithium-ion batteries using particle filter and artificial neural network. Ind Manag Data Syst 120:312–328. https://doi.org/10.1108/IMDS-03-2019-0195

    Article  Google Scholar 

  13. Khelif R, Chebel-Morello B, Malinowski S et al (2017) Direct remaining useful life estimation based on support vector regression. IEEE Trans Ind Electron 64:2276–2285. https://doi.org/10.1109/TIE.2016.2623260

    Article  Google Scholar 

  14. Patil MA, Tagade P, Hariharan KS et al (2015) A novel multistage Support Vector Machine based approach for Li ion battery remaining useful life estimation. Appl Energy 159:285–297. https://doi.org/10.1016/j.apenergy.2015.08.119

    Article  Google Scholar 

  15. García Nieto PJ, García-Gonzalo E, Sánchez Lasheras F, de Cos Juez FJ (2015) Hybrid PSO–SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability. Reliab Eng Syst Saf 138:219–231. https://doi.org/10.1016/j.ress.2015.02.001

    Article  Google Scholar 

  16. Liu D, Zhou J, Pan D et al (2015) Lithium-ion battery remaining useful life estimation with an optimized relevance vector machine algorithm with incremental learning. Measurement 63:143–151. https://doi.org/10.1016/j.measurement.2014.11.031

    Article  Google Scholar 

  17. Xue Z, Zhang Y, Cheng C, Ma G (2020) Remaining useful life prediction of lithium-ion batteries with adaptive unscented kalman filter and optimized support vector regression. Neurocomputing 376:95–102. https://doi.org/10.1016/j.neucom.2019.09.074

    Article  Google Scholar 

  18. Wang F-K, Mamo T (2020) Gradient boosted regression model for the degradation analysis of prismatic cells. Comput Ind Eng 144:106494. https://doi.org/10.1016/j.cie.2020.106494

    Article  Google Scholar 

  19. Che C, Wang H, Ni X, Fu Q (2020) Domain adaptive deep belief network for rolling bearing fault diagnosis. Comput Ind Eng 143:106427. https://doi.org/10.1016/j.cie.2020.106427

    Article  Google Scholar 

  20. Kim TS, Sohn SY (2020) Multitask learning for health condition identification and remaining useful life prediction: deep convolutional neural network approach. J Intell Manuf. https://doi.org/10.1007/s10845-020-01630-w

    Article  Google Scholar 

  21. Su C, Li L, Wen Z (2020) Remaining useful life prediction via a variational autoencoder and a time-window-based sequence neural network. Qual Reliab Eng Int 36:1639–1656. https://doi.org/10.1002/qre.2651

    Article  Google Scholar 

  22. Wang B, Lei Y, Li N, Yan T (2019) Deep separable convolutional network for remaining useful life prediction of machinery. Mech Syst Signal Process 134:106330. https://doi.org/10.1016/j.ymssp.2019.106330

    Article  Google Scholar 

  23. Xia M, Zheng X, Imran M, Shoaib M (2020) Data-driven prognosis method using hybrid deep recurrent neural network. Appl Soft Comput 93:106351. https://doi.org/10.1016/j.asoc.2020.106351

    Article  Google Scholar 

  24. Shi Z, Chehade A (2021) A dual-LSTM framework combining change point detection and remaining useful life prediction. Reliab Eng Syst Saf 205:107257. https://doi.org/10.1016/j.ress.2020.107257

    Article  Google Scholar 

  25. Al-Dulaimi A, Zabihi S, Asif A, Mohammadi A (2019) A multimodal and hybrid deep neural network model for remaining useful life estimation. Comput Ind 108:186–196. https://doi.org/10.1016/j.compind.2019.02.004

    Article  Google Scholar 

  26. Zhang Y, Xiong R, He H, Pecht MG (2018) Long short-term memory recurrent neural network for remaining useful life prediction of lithium-ion batteries. IEEE Trans Veh Technol 67:5695–5705. https://doi.org/10.1109/TVT.2018.2805189

    Article  Google Scholar 

  27. Li J, Li X, He D (2019) A directed acyclic graph network combined with cnn and lstm for remaining useful life prediction. IEEE Access 7:75464–75475. https://doi.org/10.1109/ACCESS.2019.2919566

    Article  Google Scholar 

  28. Ozcan T, Basturk A (2019) Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition. Neural Comput Appl 31:8955–8970. https://doi.org/10.1007/s00521-019-04427-y

    Article  Google Scholar 

  29. Sagheer A, Kotb M (2019) Time series forecasting of petroleum production using deep LSTM recurrent networks. Neurocomputing 323:203–213. https://doi.org/10.1016/j.neucom.2018.09.082

    Article  Google Scholar 

  30. Tan TY, Zhang L, Lim CP (2019) Intelligent skin cancer diagnosis using improved particle swarm optimization and deep learning models. Appl Soft Comput 84:105725. https://doi.org/10.1016/j.asoc.2019.105725

    Article  Google Scholar 

  31. Zhang B, Zhang S, Li W (2019) Bearing performance degradation assessment using long short-term memory recurrent network. Comput Ind 106:14–29. https://doi.org/10.1016/j.compind.2018.12.016

    Article  Google Scholar 

  32. Listou Ellefsen A, Bjørlykhaug E, Æsøy V et al (2019) Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture. Reliab Eng Syst Saf 183:240–251. https://doi.org/10.1016/j.ress.2018.11.027

    Article  Google Scholar 

  33. Qu J, Liu F, Ma Y, Fan J (2019) A neural-network-based method for RUL prediction and SOH monitoring of lithium-ion battery. IEEE Access 7:87178–87191. https://doi.org/10.1109/ACCESS.2019.2925468

    Article  Google Scholar 

  34. Xia T, Song Y, Zheng Y et al (2020) An ensemble framework based on convolutional bi-directional LSTM with multiple time windows for remaining useful life estimation. Comput Ind 115:103182. https://doi.org/10.1016/j.compind.2019.103182

    Article  Google Scholar 

  35. Wang D, Tan D, Liu L (2018) Particle swarm optimization algorithm: an overview. Soft Comput 22:387–408. https://doi.org/10.1007/s00500-016-2474-6

    Article  Google Scholar 

  36. Guo Y, Li J-Y, Zhan Z-H (2021) Efficient hyperparameter optimization for convolution neural networks in deep learning: a distributed particle swarm optimization approach. Cybern Syst 52:36–57. https://doi.org/10.1080/01969722.2020.1827797

    Article  Google Scholar 

  37. Saha B, Goebel K (2007) Battery data set. In: NASA Ames Progn. Data Repos. http://ti.arc.nasa.gov/project/prognostic-data-repository

  38. Goebel K, Saha B, Saxena A et al (2008) Prognostics in battery health management. IEEE Instrum Meas Mag 11:33–40. https://doi.org/10.1109/MIM.2008.4579269

    Article  Google Scholar 

  39. Qiao J, Liu X, Chen Z (2020) Prediction of the remaining useful life of lithium-ion batteries based on empirical mode decomposition and deep neural networks. IEEE Access 8:42760–42767. https://doi.org/10.1109/ACCESS.2020.2977429

    Article  Google Scholar 

  40. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. In: Proceedings of the 3rd international conference on learning represent ICLR 2015-Conf Track Proc

  41. Zhang W, Li X, Li X (2020) Deep learning-based prognostic approach for lithium-ion batteries with adaptive time-series prediction and on-line validation. Measurement 164:108052. https://doi.org/10.1016/j.measurement.2020.108052

    Article  Google Scholar 

  42. Yu J (2018) State of health prediction of lithium-ion batteries: multiscale logic regression and Gaussian process regression ensemble. Reliab Eng Syst Saf 174:82–95. https://doi.org/10.1016/j.ress.2018.02.022

    Article  Google Scholar 

  43. Li P, Zhang Z, Xiong Q et al (2020) State-of-health estimation and remaining useful life prediction for the lithium-ion battery based on a variant long short term memory neural network. J Power Sources 459:228069. https://doi.org/10.1016/j.jpowsour.2020.228069

    Article  Google Scholar 

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

  1. Department of Industrial Engineering, Hitit University, Çorum, Turkey

    Ahmet Kara

Authors
  1. Ahmet Kara
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Ahmet Kara.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest regarding the publication of this article.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kara, A. A data-driven approach based on deep neural networks for lithium-ion battery prognostics. Neural Comput & Applic 33, 13525–13538 (2021). https://doi.org/10.1007/s00521-021-05976-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-05976-x

Keywords