Abstract
Structural health monitoring(SHM) techniques rarely consider the effect of ambient temperature, even though its impact on the structures being substantial. Moreover, typical modal or time-domain SHM approaches may delay the detection of damages endangering human lives due to their requirement of response time histories of sufficient length. Targeting prompt detection of structural anomalies, this article proposes a Long-Short-Term-Memory (LSTM)-based real-time approach that employs unsupervised LSTM prediction network for detection, followed by a supervised classifier network for localization. The prediction network is trained for one-step-ahead response prediction under ambient temperature conditions, and a novelty measure is devised using the usual prediction error threshold. Subsequently, damage is alarmed on encountering significant departure beyond this threshold. The damage is further localized with the classifier network. The approach is tested on a real bridge subjected to substantial thermal variation and the performance has been observed to be prompt and reliable under different operating conditions.















Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Notes
\({\mathscr {N}}(\mu ; \sigma )\) denotes a random realization obtained from a Gaussian distribution of mean \(\mu \) and covariance \(\sigma \))
SNR is a measure of noise contamination level in which \(X\%\) SNR signifies \(X \;=\; 100 \sigma (Noise)/\sigma (Signal)\), with \(\sigma \) denoting variance operation
References
Abdel-Ghaffar AM, Scanlan RH (1985) Ambient vibration studies of golden gate bridge. I. suspended structure. J Eng Mech 111(4):463–482
Abdel-Jaber H, Glisic B (2019) Monitoring of long-term prestress losses in prestressed concrete structures using fiber optic sensors. Struct Health Monit 18(1):254–269
Abdeljaber O, Avci O, Kiranyaz MS, Boashash B, Sodano H, Inman DJ (2018) 1-d cnns for structural damage detection: verification on a structural health monitoring benchmark data. Neurocomputing 275:1308–1317
Aktan A, Catbas F, Grimmelsman K, Tsikos C (2000) Issues in infrastructure health monitoring for management. J Eng Mech 126(7):711–724
Aktan AE, Farhey DN, Helmicki AJ, Brown DL, Hunt VJ, Lee KL, Levi A (1997) Structural identification for condition assessment: experimental arts. J Struct Eng 123(12):1674–1684
Alampalli S (2000) Effects of testing, analysis, damage, and environment on modal parameters. Mech Syst Signal Process 14(1):63–74
Aria A, Lopez Droguett E, Azarm S, Modarres M (2020) Estimating damage size and remaining useful life in degraded structures using deep learning-based multi-source data fusion. Struct Health Monit 19(5):1542–1559
Avci O, Abdeljaber O, Kiranyaz S, Inman D (2017) Structural damage detection in real time: implementation of 1d convolutional neural networks for shm applications. In: Structural health monitoring and damage detection, Vol 7, Springer, pp 49–54
Bagchi A, Humar J, Xu H, Noman AS (2010) Model-based damage identification in a continuous bridge using vibration data. J Perform Constr Facil 24(2):148–158
Bao Y, Tang Z, Li H, Zhang Y (2019) Computer vision and deep learning-based data anomaly detection method for structural health monitoring. Struct Health Monit 18(2):401–421
Basseville M, Abdelghani M, Benveniste A (2000) Subspace-based fault detection algorithms for vibration monitoring. Automatica 36(1):101–109
Brownjohn JM, De Stefano A, Xu YL, Wenzel H, Aktan AE (2011) Vibration-based monitoring of civil infrastructure: challenges and successes. J Civ Struct Heal Monit 1(3–4):79–95
Brownjohn JMW, Moyo P, Omenzetter P, Lu Y (2003) Assessment of highway bridge upgrading by dynamic testing and finite-element model updating. J Bridg Eng 8(3):162–172
Catbas FN, Susoy M, Frangopol DM (2008) Structural health monitoring and reliability estimation: Long span truss bridge application with environmental monitoring data. Eng Struct 30(9):2347–2359
Cheynet E, Snæbjörnsson J, Jakobsen JB (2017) Temperature effects on the modal properties of a suspension bridge. In: Dynamics of civil structures, Vol 2, Springer, pp 87–93
Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078
Chollet F (2017) Deep learning with python, vol 1. Manning Publications CO, Greenwich, CT
Farrar CR, Jauregui DA (1998) Comparative study of damage identification algorithms applied to a bridge: I. experiment. Smart Mater Struct 7(5):704
Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868
Gu J, Gul M, Wu X (2017) Damage detection under varying temperature using artificial neural networks. Struct Control Health Monit 24(11):e1998
Guo L, Li N, Jia F, Lei Y, Lin J (2017) A recurrent neural network based health indicator for remaining useful life prediction of bearings. Neurocomputing 240:98–109
Guo T, Wu L, Wang C, Xu Z (2020) Damage detection in a novel deep-learning framework: a robust method for feature extraction. Struct Health Monit 19(2):424–442
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79(8):2554–2558
Jin C, Jang S, Sun X, Li J, Christenson R (2016) Damage detection of a highway bridge under severe temperature changes using extended kalman filter trained neural network. J Civ Struct Heal Monit 6(3):545–560
Karpathy A, Fei-Fei L (2015) Deep visual-semantic alignments for generating image descriptions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3128–3137
Ke W, Wu L (2011) Mobile location with nlos identification and mitigation based on modified kalman filtering. Sensors 11(2):1641–1656
Khan A, Ko DK, Lim SC, Kim HS (2019) Structural vibration-based classification and prediction of delamination in smart composite laminates using deep learning neural network. Compos B Eng 161:586–594
Kim W, Laman JA (2013) Integral abutment bridge behavior under uncertain thermal and time-dependent load. Struct Eng Mech 46(1):53–73
Kromanis R, Kripakaran P, Harvey B (2016) Long-term structural health monitoring of the cleddau bridge: evaluation of quasi-static temperature effects on bearing movements. Struct Infrastruct Eng 12(10):1342–1355
Kullaa J (2009) Eliminating environmental or operational influences in structural health monitoring using the missing data analysis. J Intell Mater Syst Struct 20(11):1381–1390
Loh CH, Chen MC, Chao SH (2012) Stochastic subspace identification for operational modal analysis of an arch bridge. In: Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2012, International society for optics and photonics, vol 8345, p 834504
Miao H, Li B, Sun C, Liu J (2019) Joint learning of degradation assessment and rul prediction for aeroengines via dual-task deep lstm networks. IEEE Trans Industr Inf 15(9):5023–5032
Ni Y, Hua X, Fan K, Ko J (2005) Correlating modal properties with temperature using long-term monitoring data and support vector machine technique. Eng Struct 27(12):1762–1773
Oh CK, Sohn H (2009) Damage diagnosis under environmental and operational variations using unsupervised support vector machine. J Sound Vib 325(1–2):224–239
Ozdagli AI, Koutsoukos X (2019) Machine learning based novelty detection using modal analysis. Comput-Aided Civil Infrastructure Eng 34(12):1119–1140
Pathirage CSN, Li J, Li L, Hao H, Liu W, Ni P (2018) Structural damage identification based on autoencoder neural networks and deep learning. Eng Struct 172:13–28
Rautela M, Gopalakrishnan S (2021) Ultrasonic guided wave based structural damage detection and localization using model assisted convolutional and recurrent neural networks. Expert Syst with Appl 167:114189
Reddy J, Chin C (1998) Thermomechanical analysis of functionally graded cylinders and plates. J Therm Stresses 21(6):593–626
Ren WX, Zhao T, Harik IE (2004) Experimental and analytical modal analysis of steel arch bridge. J Struct Eng 130(7):1022–1031
Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117
Seo J, Hu JW, Lee J (2016) Summary review of structural health monitoring applications for highway bridges. J Perform Constr Facil 30(4):04015072
Shao H, Jiang H, Zhang H, Liang T (2017) Electric locomotive bearing fault diagnosis using a novel convolutional deep belief network. IEEE Trans Industr Electron 65(3):2727–2736
Sharma S, Sen S (2020) One-dimensional convolutional neural network-based damage detection in structural joints. J Civ Struct Heal Monit 10(5):1057–1072
Sharma S, Sen S (2021) Bridge damage detection in presence of varying temperature using two-step neural network approach. J Bridg Eng 26(6):04021027
Sohn H, Worden K, Farrar CR (2002) Statistical damage classification under changing environmental and operational conditions. J Intell Mater Syst Struct 13(9):561–574
Sohn H, Farrar CR, Hemez FM, Shunk DD, Stinemates DW, Nadler BR, Czarnecki JJ (2004) A review of structural health monitoring literature: 1996–2001. Los Alamos National Laboratory Report, LA-13976-MS
Sun C, Ma M, Zhao Z, Chen X (2018) Sparse deep stacking network for fault diagnosis of motor. IEEE Trans Industr Inf 14(7):3261–3270
Sun L, Shang Z, Xia Y, Bhowmick S, Nagarajaiah S (2020) Review of bridge structural health monitoring aided by big data and artificial intelligence: from condition assessment to damage detection. J Struct Eng 146(5):04020073
Taborri J, Scalona E, Palermo E, Rossi S, Cappa P (2015) Validation of inter-subject training for hidden markov models applied to gait phase detection in children with cerebral palsy. Sensors 15(9):24514–24529
Vanlanduit S, Parloo E, Cauberghe B, Guillaume P, Verboven P (2005) A robust singular value decomposition for damage detection under changing operating conditions and structural uncertainties. J Sound Vib 284(3–5):1033–1050
Wahab MA, De Roeck G (1997) Effect of temperature on dynamic system parameters of a highway bridge. Struct Eng Int 7(4):266–270
Weinstein JC, Sanayei M, Brenner BR (2018) Bridge damage identification using artificial neural networks. J Bridg Eng 23(11):04018084
Xia Q, Cheng Y, Zhang J, Zhu F (2017) In-service condition assessment of a long-span suspension bridge using temperature-induced strain data. J Bridg Eng 22(3):04016124
Yan AM, Kerschen G, De Boe P, Golinval JC (2005) Structural damage diagnosis under varying environmental conditions-part ii: local pca for non-linear cases. Mech Syst Signal Process 19(4):865–880
Yang HD (2015) Sign language recognition with the kinect sensor based on conditional random fields. Sensors 15(1):135–147
Yang J, Zhou Y, Zhou J, Chen Y (2013) Prediction of bridge monitoring information chaotic using time series theory by multi-step bp and rbf neural networks. Intell Automation Soft Comput 19(3):305–314
Yarnold M, Moon F (2015) Temperature-based structural health monitoring baseline for long-span bridges. Eng Struct 86:157–167
Yildirim Ö (2018) A novel wavelet sequence based on deep bidirectional lstm network model for ecg signal classification. Comput Biol Med 96:189–202
Yu Y, Wang C, Gu X, Li J (2019) A novel deep learning-based method for damage identification of smart building structures. Struct Health Monit 18(1):143–163
Zhou Y, Sun L (2019) Insights into temperature effects on structural deformation of a cable-stayed bridge based on structural health monitoring. Struct Health Monit 18(3):778–791
Zhu Y, Ni YQ, Jin H, Inaudi D, Laory I (2019) A temperature-driven mpca method for structural anomaly detection. Eng Struct 190:447–458
Funding
This study was funded by Aeronautics Research & Development Board (DRDO), New Delhi, India through grant file no. ARDB/01/1051907/M/I.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest:
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sharma, S., Sen, S. Real-time structural damage assessment using LSTM networks: regression and classification approaches. Neural Comput & Applic 35, 557–572 (2023). https://doi.org/10.1007/s00521-022-07773-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-07773-6