Skip to main content
SpringerLink
Log in

Real-time structural damage assessment using LSTM networks: regression and classification approaches

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Structural health monitoring(SHM) techniques rarely consider the effect of ambient temperature, even though its impact on the structures being substantial. Moreover, typical modal or time-domain SHM approaches may delay the detection of damages endangering human lives due to their requirement of response time histories of sufficient length. Targeting prompt detection of structural anomalies, this article proposes a Long-Short-Term-Memory (LSTM)-based real-time approach that employs unsupervised LSTM prediction network for detection, followed by a supervised classifier network for localization. The prediction network is trained for one-step-ahead response prediction under ambient temperature conditions, and a novelty measure is devised using the usual prediction error threshold. Subsequently, damage is alarmed on encountering significant departure beyond this threshold. The damage is further localized with the classifier network. The approach is tested on a real bridge subjected to substantial thermal variation and the performance has been observed to be prompt and reliable under different operating conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. \({\mathscr {N}}(\mu ; \sigma )\) denotes a random realization obtained from a Gaussian distribution of mean \(\mu \) and covariance \(\sigma \))

  2. SNR is a measure of noise contamination level in which \(X\%\) SNR signifies \(X \;=\; 100 \sigma (Noise)/\sigma (Signal)\), with \(\sigma \) denoting variance operation

References

  1. Abdel-Ghaffar AM, Scanlan RH (1985) Ambient vibration studies of golden gate bridge. I. suspended structure. J Eng Mech 111(4):463–482

    Google Scholar 

  2. Abdel-Jaber H, Glisic B (2019) Monitoring of long-term prestress losses in prestressed concrete structures using fiber optic sensors. Struct Health Monit 18(1):254–269

    Article  Google Scholar 

  3. Abdeljaber O, Avci O, Kiranyaz MS, Boashash B, Sodano H, Inman DJ (2018) 1-d cnns for structural damage detection: verification on a structural health monitoring benchmark data. Neurocomputing 275:1308–1317

    Article  Google Scholar 

  4. Aktan A, Catbas F, Grimmelsman K, Tsikos C (2000) Issues in infrastructure health monitoring for management. J Eng Mech 126(7):711–724

    Google Scholar 

  5. Aktan AE, Farhey DN, Helmicki AJ, Brown DL, Hunt VJ, Lee KL, Levi A (1997) Structural identification for condition assessment: experimental arts. J Struct Eng 123(12):1674–1684

    Article  Google Scholar 

  6. Alampalli S (2000) Effects of testing, analysis, damage, and environment on modal parameters. Mech Syst Signal Process 14(1):63–74

    Article  Google Scholar 

  7. Aria A, Lopez Droguett E, Azarm S, Modarres M (2020) Estimating damage size and remaining useful life in degraded structures using deep learning-based multi-source data fusion. Struct Health Monit 19(5):1542–1559

    Article  Google Scholar 

  8. Avci O, Abdeljaber O, Kiranyaz S, Inman D (2017) Structural damage detection in real time: implementation of 1d convolutional neural networks for shm applications. In: Structural health monitoring and damage detection, Vol 7, Springer, pp 49–54

  9. Bagchi A, Humar J, Xu H, Noman AS (2010) Model-based damage identification in a continuous bridge using vibration data. J Perform Constr Facil 24(2):148–158

    Article  Google Scholar 

  10. Bao Y, Tang Z, Li H, Zhang Y (2019) Computer vision and deep learning-based data anomaly detection method for structural health monitoring. Struct Health Monit 18(2):401–421

    Article  Google Scholar 

  11. Basseville M, Abdelghani M, Benveniste A (2000) Subspace-based fault detection algorithms for vibration monitoring. Automatica 36(1):101–109

    Article  MathSciNet  MATH  Google Scholar 

  12. Brownjohn JM, De Stefano A, Xu YL, Wenzel H, Aktan AE (2011) Vibration-based monitoring of civil infrastructure: challenges and successes. J Civ Struct Heal Monit 1(3–4):79–95

    Article  Google Scholar 

  13. Brownjohn JMW, Moyo P, Omenzetter P, Lu Y (2003) Assessment of highway bridge upgrading by dynamic testing and finite-element model updating. J Bridg Eng 8(3):162–172

    Article  Google Scholar 

  14. Catbas FN, Susoy M, Frangopol DM (2008) Structural health monitoring and reliability estimation: Long span truss bridge application with environmental monitoring data. Eng Struct 30(9):2347–2359

    Article  Google Scholar 

  15. Cheynet E, Snæbjörnsson J, Jakobsen JB (2017) Temperature effects on the modal properties of a suspension bridge. In: Dynamics of civil structures, Vol 2, Springer, pp 87–93

  16. Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078

  17. Chollet F (2017) Deep learning with python, vol 1. Manning Publications CO, Greenwich, CT

    Google Scholar 

  18. Farrar CR, Jauregui DA (1998) Comparative study of damage identification algorithms applied to a bridge: I. experiment. Smart Mater Struct 7(5):704

    Article  Google Scholar 

  19. Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868

    Article  Google Scholar 

  20. Gu J, Gul M, Wu X (2017) Damage detection under varying temperature using artificial neural networks. Struct Control Health Monit 24(11):e1998

    Article  Google Scholar 

  21. Guo L, Li N, Jia F, Lei Y, Lin J (2017) A recurrent neural network based health indicator for remaining useful life prediction of bearings. Neurocomputing 240:98–109

    Article  Google Scholar 

  22. Guo T, Wu L, Wang C, Xu Z (2020) Damage detection in a novel deep-learning framework: a robust method for feature extraction. Struct Health Monit 19(2):424–442

    Article  Google Scholar 

  23. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780

    Article  Google Scholar 

  24. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79(8):2554–2558

    Article  MathSciNet  MATH  Google Scholar 

  25. Jin C, Jang S, Sun X, Li J, Christenson R (2016) Damage detection of a highway bridge under severe temperature changes using extended kalman filter trained neural network. J Civ Struct Heal Monit 6(3):545–560

    Article  Google Scholar 

  26. Karpathy A, Fei-Fei L (2015) Deep visual-semantic alignments for generating image descriptions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3128–3137

  27. Ke W, Wu L (2011) Mobile location with nlos identification and mitigation based on modified kalman filtering. Sensors 11(2):1641–1656

    Article  Google Scholar 

  28. Khan A, Ko DK, Lim SC, Kim HS (2019) Structural vibration-based classification and prediction of delamination in smart composite laminates using deep learning neural network. Compos B Eng 161:586–594

    Article  Google Scholar 

  29. Kim W, Laman JA (2013) Integral abutment bridge behavior under uncertain thermal and time-dependent load. Struct Eng Mech 46(1):53–73

    Article  Google Scholar 

  30. Kromanis R, Kripakaran P, Harvey B (2016) Long-term structural health monitoring of the cleddau bridge: evaluation of quasi-static temperature effects on bearing movements. Struct Infrastruct Eng 12(10):1342–1355

    Article  Google Scholar 

  31. Kullaa J (2009) Eliminating environmental or operational influences in structural health monitoring using the missing data analysis. J Intell Mater Syst Struct 20(11):1381–1390

    Article  Google Scholar 

  32. Loh CH, Chen MC, Chao SH (2012) Stochastic subspace identification for operational modal analysis of an arch bridge. In: Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2012, International society for optics and photonics, vol 8345, p 834504

  33. Miao H, Li B, Sun C, Liu J (2019) Joint learning of degradation assessment and rul prediction for aeroengines via dual-task deep lstm networks. IEEE Trans Industr Inf 15(9):5023–5032

    Article  Google Scholar 

  34. Ni Y, Hua X, Fan K, Ko J (2005) Correlating modal properties with temperature using long-term monitoring data and support vector machine technique. Eng Struct 27(12):1762–1773

    Article  Google Scholar 

  35. Oh CK, Sohn H (2009) Damage diagnosis under environmental and operational variations using unsupervised support vector machine. J Sound Vib 325(1–2):224–239

    Article  Google Scholar 

  36. Ozdagli AI, Koutsoukos X (2019) Machine learning based novelty detection using modal analysis. Comput-Aided Civil Infrastructure Eng 34(12):1119–1140

    Article  Google Scholar 

  37. Pathirage CSN, Li J, Li L, Hao H, Liu W, Ni P (2018) Structural damage identification based on autoencoder neural networks and deep learning. Eng Struct 172:13–28

    Article  Google Scholar 

  38. Rautela M, Gopalakrishnan S (2021) Ultrasonic guided wave based structural damage detection and localization using model assisted convolutional and recurrent neural networks. Expert Syst with Appl 167:114189

    Article  Google Scholar 

  39. Reddy J, Chin C (1998) Thermomechanical analysis of functionally graded cylinders and plates. J Therm Stresses 21(6):593–626

    Article  Google Scholar 

  40. Ren WX, Zhao T, Harik IE (2004) Experimental and analytical modal analysis of steel arch bridge. J Struct Eng 130(7):1022–1031

    Article  Google Scholar 

  41. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  42. Seo J, Hu JW, Lee J (2016) Summary review of structural health monitoring applications for highway bridges. J Perform Constr Facil 30(4):04015072

    Article  Google Scholar 

  43. Shao H, Jiang H, Zhang H, Liang T (2017) Electric locomotive bearing fault diagnosis using a novel convolutional deep belief network. IEEE Trans Industr Electron 65(3):2727–2736

    Article  Google Scholar 

  44. Sharma S, Sen S (2020) One-dimensional convolutional neural network-based damage detection in structural joints. J Civ Struct Heal Monit 10(5):1057–1072

    Article  Google Scholar 

  45. Sharma S, Sen S (2021) Bridge damage detection in presence of varying temperature using two-step neural network approach. J Bridg Eng 26(6):04021027

    Article  Google Scholar 

  46. Sohn H, Worden K, Farrar CR (2002) Statistical damage classification under changing environmental and operational conditions. J Intell Mater Syst Struct 13(9):561–574

    Article  Google Scholar 

  47. Sohn H, Farrar CR, Hemez FM, Shunk DD, Stinemates DW, Nadler BR, Czarnecki JJ (2004) A review of structural health monitoring literature: 1996–2001. Los Alamos National Laboratory Report, LA-13976-MS

  48. Sun C, Ma M, Zhao Z, Chen X (2018) Sparse deep stacking network for fault diagnosis of motor. IEEE Trans Industr Inf 14(7):3261–3270

    Article  Google Scholar 

  49. Sun L, Shang Z, Xia Y, Bhowmick S, Nagarajaiah S (2020) Review of bridge structural health monitoring aided by big data and artificial intelligence: from condition assessment to damage detection. J Struct Eng 146(5):04020073

    Article  Google Scholar 

  50. Taborri J, Scalona E, Palermo E, Rossi S, Cappa P (2015) Validation of inter-subject training for hidden markov models applied to gait phase detection in children with cerebral palsy. Sensors 15(9):24514–24529

    Article  Google Scholar 

  51. Vanlanduit S, Parloo E, Cauberghe B, Guillaume P, Verboven P (2005) A robust singular value decomposition for damage detection under changing operating conditions and structural uncertainties. J Sound Vib 284(3–5):1033–1050

    Article  Google Scholar 

  52. Wahab MA, De Roeck G (1997) Effect of temperature on dynamic system parameters of a highway bridge. Struct Eng Int 7(4):266–270

    Article  Google Scholar 

  53. Weinstein JC, Sanayei M, Brenner BR (2018) Bridge damage identification using artificial neural networks. J Bridg Eng 23(11):04018084

    Article  Google Scholar 

  54. Xia Q, Cheng Y, Zhang J, Zhu F (2017) In-service condition assessment of a long-span suspension bridge using temperature-induced strain data. J Bridg Eng 22(3):04016124

    Article  Google Scholar 

  55. Yan AM, Kerschen G, De Boe P, Golinval JC (2005) Structural damage diagnosis under varying environmental conditions-part ii: local pca for non-linear cases. Mech Syst Signal Process 19(4):865–880

    Article  Google Scholar 

  56. Yang HD (2015) Sign language recognition with the kinect sensor based on conditional random fields. Sensors 15(1):135–147

    Article  Google Scholar 

  57. Yang J, Zhou Y, Zhou J, Chen Y (2013) Prediction of bridge monitoring information chaotic using time series theory by multi-step bp and rbf neural networks. Intell Automation Soft Comput 19(3):305–314

    Article  MathSciNet  Google Scholar 

  58. Yarnold M, Moon F (2015) Temperature-based structural health monitoring baseline for long-span bridges. Eng Struct 86:157–167

    Article  Google Scholar 

  59. Yildirim Ö (2018) A novel wavelet sequence based on deep bidirectional lstm network model for ecg signal classification. Comput Biol Med 96:189–202

    Article  Google Scholar 

  60. Yu Y, Wang C, Gu X, Li J (2019) A novel deep learning-based method for damage identification of smart building structures. Struct Health Monit 18(1):143–163

    Article  Google Scholar 

  61. Zhou Y, Sun L (2019) Insights into temperature effects on structural deformation of a cable-stayed bridge based on structural health monitoring. Struct Health Monit 18(3):778–791

    Article  Google Scholar 

  62. Zhu Y, Ni YQ, Jin H, Inaudi D, Laory I (2019) A temperature-driven mpca method for structural anomaly detection. Eng Struct 190:447–458

    Article  Google Scholar 

Download references

Funding

This study was funded by Aeronautics Research & Development Board (DRDO), New Delhi, India through grant file no. ARDB/01/1051907/M/I.

Author information

Authors and Affiliations

  1. i4S Laboratory, Indian Institute of Technology Mandi, Mandi, HP, 175005, India

    Smriti Sharma & Subhamoy Sen

Authors
  1. Smriti Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Subhamoy Sen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Subhamoy Sen.

Ethics declarations

Conflict of interest:

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sharma, S., Sen, S. Real-time structural damage assessment using LSTM networks: regression and classification approaches. Neural Comput & Applic 35, 557–572 (2023). https://doi.org/10.1007/s00521-022-07773-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07773-6

Keywords

Search

Navigation