Abstract
Fixed-wing UAVs (FW-UAVs) are empowered to handle diverse civilian and military missions, but sensor failure scenarios are constantly rising. Rapid advancement in deep learning methods currently proposes state-of-the-art solutions for fault detection of UAVs. However, most recent deep learning-based detection models suffer from model size, high computational complexity, and high-power consumption, which are challenging for small-sized FW-UAVs with limited battery backup and computational power. Therefore, to overcome these problems, this article introduces a lightweight CNN model built on prior work combined with the LSTM-AM framework to obtain accurate fault detection of FW-UAVs with low power consumption and fast computations. First, lightweight CNN architecture aims to minimize computational complexity while maintaining high accuracy in fault detection. The LSTM model merged with Attention Mechanism (AM), allows the architecture to obtain temporal dependencies and concentrate on essential features for enhanced fault detection accuracy. The combined version of lightweight CNN, LSTM, and AM commits to more reliable and efficient fault detection in FW-UAV applications, improving UAV drones’ overall performance and safety.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The datasets generated during and analyzed during the current study are available from the corresponding author upon reasonable request.
References
Zhao Y, Ma J, Li X, Zhang J (2018) Saliency detection and deep learning-based wildfire identification in UAV imagery. Sensors 18:712. https://doi.org/10.3390/s18030712
Sibanyoni SV, Ramotsoela DT, Silva BJ, Hancke GP (2019) A 2-D acoustic source localization system for drones in search and rescue missions. IEEE Sens J 19:332–341. https://doi.org/10.1109/JSEN.2018.2875864
Li M, Zhen L, Wang S et al (2018) Unmanned aerial vehicle scheduling problem for traffic monitoring. Comput Ind Eng 122:15–23. https://doi.org/10.1016/j.cie.2018.05.039
James AT, Kumar G, Khan AQ, Asjad M (2022) Maintenance 4.0: implementation challenges and its analysis. Int J Quality Reliabil Manage 40:1706–1728. https://doi.org/10.1108/IJQRM-04-2021-0097
Cortés-Leal A, Cárdenas C, Del-Valle-Soto C (2022) Maintenance 5.0: towards a worker-in-the-loop framework for resilient smart manufacturing. Appl Sci 12:11330. https://doi.org/10.3390/app122211330
Fourlas GK, Karras GC (2021) A survey on fault diagnosis methods for UAVs. In: 2021 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE, Athens, Greece, pp 394–403
Guo D, Zhong M, Zhou D (2018) Multisensor data-fusion-based approach to airspeed measurement fault detection for unmanned aerial vehicles. IEEE Trans Instrum Meas 67:317–327. https://doi.org/10.1109/TIM.2017.2735663
Zuo L, Yao L, Kang Y (2020) UIO based sensor fault diagnosis and compensation for quadrotor UAV. In: 2020 Chinese Control And Decision Conference (CCDC). IEEE, Hefei, China, pp 4052–4057
Gao J, Zhang Q, Chen J (2020) EKF-based actuator fault detection and diagnosis method for tilt-rotor unmanned aerial vehicles. Math Probl Eng 2020:1–12. https://doi.org/10.1155/2020/8019017
5G_SDR-Assisted_Cognitive_Communication_in_UAV_Swarms_Architecture_and_Applications.pdf. In: Google Docs. https://drive.google.com/file/d/1PF__isoP0Y_p7BTm8oBI2T3TEoG5nsW3/view?usp=embed_facebook. Accessed 8 Feb 2024
Akhunzada A, Zeadally S, Islam SU (2021) Power and performance efficient SDN-enabled fog architecture. IT Prof 23:24–30. https://doi.org/10.1109/MITP.2021.3085840
Ali Z, Henna S, Akhunzada A et al (2019) Performance evaluation of LoRaWAN for green internet of things. IEEE Access 7:164102–164112. https://doi.org/10.1109/ACCESS.2019.2943720
Akhunzada A, Zeadally S, ul Islam S (2023) Toward performance and energy-efficient edge-of-things. IT Professional 25:17–23. https://doi.org/10.1109/MITP.2022.3230837
Miao J, Wang J, Wang D, Miao Q (2021) Experimental investigation on electro-hydraulic actuator fault diagnosis with multi-channel residuals. Measurement 180:109544. https://doi.org/10.1016/j.measurement.2021.109544
Wang N, Ren J, Luo Y, et al (2021) UAV actuator fault detection using maximal information coefficient and 1-D convolutional neural network. In: 2021 Global Reliability and Prognostics and Health Management (PHM-Nanjing). IEEE, Nanjing, China, pp 1–6
Li C, Li S, Zhang A et al (2021) Meta-learning for few-shot bearing fault diagnosis under complex working conditions. Neurocomputing 439:197–211. https://doi.org/10.1016/j.neucom.2021.01.099
Bhatia AK, Jiang J, Kumar A et al (2021) Adaptive preview control with deck motion compensation for autonomous carrier landing of an aircraft. Int J Adapt Control Signal Process 35:769–785. https://doi.org/10.1002/acs.3228
Perez E, Kiela D, Cho K (2021) True few-shot learning with language models
Bilal H, Yin B, Kumar A et al (2023) Jerk-bounded trajectory planning for rotary flexible joint manipulator: an experimental approach. Soft Comput 27:4029–4039. https://doi.org/10.1007/s00500-023-07923-5
Kumar A, Shaikh AM, Li Y et al (2021) Pruning filters with L1-norm and capped L1-norm for CNN compression. Appl Intell 51:1152–1160. https://doi.org/10.1007/s10489-020-01894-y
Ding SX (2013) Model-based fault diagnosis techniques: design schemes, algorithms and tools. Springer, London
Gangsar P, Tiwari R (2020) Signal based condition monitoring techniques for fault detection and diagnosis of induction motors: a state-of-the-art review. Mech Syst Signal Process 144:106908. https://doi.org/10.1016/j.ymssp.2020.106908
Hoang D-T, Kang H-J (2019) A survey on Deep Learning based bearing fault diagnosis. Neurocomputing 335:327–335. https://doi.org/10.1016/j.neucom.2018.06.078
Chakrapani G, Sugumaran V (2023) Transfer learning based fault diagnosis of automobile dry clutch system. Eng Appl Artif Intell 117:105522. https://doi.org/10.1016/j.engappai.2022.105522
Wu TY, Lei KW (2019) Prediction of surface roughness in milling process using vibration signal analysis and artificial neural network. Int J Adv Manuf Technol 102:305–314. https://doi.org/10.1007/s00170-018-3176-2
Boztaş S, Özbudak F, Tekin E (2022) New Correlations of m-sequences over the finite field \mathbbF_4 compatible with a new bijection to \mathbbZ_4. In: 2022 10th International Workshop on Signal Design and Its Applications in Communications (IWSDA). pp 1–5
Thomas JB, Chaudhari SG, K. V. S, Verma NK (2023) CNN-based transformer model for fault detection in power system networks. IEEE Trans Instrum Meas 72:1–10. https://doi.org/10.1109/TIM.2023.3238059
Wang T, Zhang L, Wang X (2023) Fault detection for motor drive control system of industrial robots using CNN-LSTM-based observers. Trans Electr Mach Syst 7:144–152. https://doi.org/10.30941/CESTEMS.2023.00014
Freddi A, Longhi S, Monteriù A (2012) A diagnostic thau observer for a class of unmanned vehicles. J Intell Robot Syst 67:61–73. https://doi.org/10.1007/s10846-012-9650-4
Ortiz-Torres G, Castillo P, Sorcia-Vazquez FDJ et al (2020) Fault estimation and fault tolerant control strategies applied to VTOL aerial vehicles with soft and aggressive actuator faults. IEEE Access 8:10649–10661. https://doi.org/10.1109/ACCESS.2019.2963693
Baldini A, Felicetti R, Freddi A, et al (2022) Hexarotor Fault Tolerant Control Using a Bank of Disturbance Observers. In: 2022 International Conference on Unmanned Aircraft Systems (ICUAS). pp 608–616
Ghalamchi B, Jia Z, Mueller MW (2020) Real-time vibration-based propeller fault diagnosis for multicopters. IEEE/ASME Trans Mechatron 25:395–405. https://doi.org/10.1109/TMECH.2019.2947250
Ai S, Song J, Cai G, Zhao K (2022) Active fault-tolerant control for quadrotor UAV against sensor fault diagnosed by the auto sequential random forest. Aerospace 9:518. https://doi.org/10.3390/aerospace9090518
Liang S, Zhang S, Huang Y et al (2022) Data-driven fault diagnosis of FW-UAVs with consideration of multiple operation conditions. ISA Trans 126:472–485. https://doi.org/10.1016/j.isatra.2021.07.043
Park J, Jung Y, Kim J-H (2022) Multiclass classification fault diagnosis of multirotor UAVs utilizing a deep neural network. Int J Control Autom Syst 20:1316–1326. https://doi.org/10.1007/s12555-021-0729-1
Kang W, Xiao J, Xue J (2022) Complex system health condition estimation using tree-structured simple recurrent unit networks. Complex Intell Syst 8:5203–5221. https://doi.org/10.1007/s40747-022-00732-7
Liu G, Wei P, Chen K et al (2022) Polymer gear contact fatigue reliability evaluation with small data set based on machine learning. J Comput Design Eng 9:583–597. https://doi.org/10.1093/jcde/qwac020
Chen X-M, Wu C-X, Wu Y et al (2019) Design and analysis for early warning of rotor UAV based on data-driven DBN. Electronics 8:1350. https://doi.org/10.3390/electronics8111350
Guo D, Zhong M, Ji H et al (2018) A hybrid feature model and deep learning based fault diagnosis for unmanned aerial vehicle sensors. Neurocomputing 319:155–163. https://doi.org/10.1016/j.neucom.2018.08.046
Cui A, Zhang Y, Zhang P et al (2020) Intelligent health management of fixed-wing UAVs: a deep-learning-based approach
Ahmad MW, Akram MU, Ahmad R et al (2022) Intelligent framework for automated failure prediction, detection, and classification of mission critical autonomous flights. ISA Trans 129:355–371. https://doi.org/10.1016/j.isatra.2022.01.014
Liu W, Chen Z, Zheng M (2020) An audio-based fault diagnosis method for quadrotors using convolutional neural network and transfer learning
Zhang Y, Zhao H, Ma J et al (2021) A deep neural network-based fault detection scheme for aircraft IMU sensors. Int J Aerosp Eng 2021:e3936826. https://doi.org/10.1155/2021/3936826
Wang X, Roy S, Farì S, Baldi S (2020) The problem of reliable design of vector-field path following in the presence of uncertain course dynamics. IFAC-PapersOnLine 53:9399–9404. https://doi.org/10.1016/j.ifacol.2020.12.2409
Li Z, Zhang Y, Ai J et al (2023) A lightweight and explainable data-driven scheme for fault detection of aerospace sensors. IEEE Trans Aerosp Electron Syst 59:8392–8410. https://doi.org/10.1109/TAES.2023.3303855
Jiang T, Zong M, Ma Y, et al (2023) MobileACNet: ACNet-based lightweight model for image classification. In: Yan WQ, Nguyen M, Stommel M (eds) Image and vision computing. Springer Nature Switzerland, Cham, pp 361–372
Ghose P, Biswas M, Gaur L (2023) BrainSegNeT: a lightweight brain tumor segmentation model based on U-net and progressive neuron expansion. In: Liu F, Zhang Y, Kuai H et al (eds) Brain informatics. Springer Nature Switzerland, Cham, pp 249–260
Cai G, Lum K-Y, Chen BM, Lee TH (2010) A brief overview on miniature fixed-wing unmanned aerial vehicles. IEEE ICCA 2010:285–290
Ducard G (2015) Actuator fault detection in UAVs. In: Valavanis KP, Vachtsevanos GJ (eds) Handbook of unmanned aerial vehicles. Springer, Netherlands, pp 1071–1122
Fu J, Sun C, Yu Z, Liu L (2019) A hybrid CNN-LSTM model based actuator fault diagnosis for six-rotor UAVs. In: 2019 Chinese Control And Decision Conference (CCDC). pp 410–414
Kumar A (2022) Structure level pruning of efficient convolutional neural networks with sparse group LASSO. IJMLC. https://doi.org/10.18178/ijmlc.2022.12.5.1111
Li Y, Wang L, Peng S et al (2019) Using feature entropy to guide filter pruning for efficient convolutional networks. In: Tetko IV, Kůrková V, Karpov P, Theis F (eds) Artificial neural networks and machine learning—ICANN 2019: deep learning. Springer International Publishing, Cham, pp 263–274
Kumar A, Yin B, Shaikh AM et al (2022) CorrNet: pearson correlation based pruning for efficient convolutional neural networks. Int J Mach Learn Cyber 13:3773–3783. https://doi.org/10.1007/s13042-022-01624-5
Zhao Z, Chen W, Wu X et al (2017) LSTM network: a deep learning approach for short-term traffic forecast. IET Intel Transport Syst 11:68–75. https://doi.org/10.1049/iet-its.2016.0208
Bronz M, Baskaya E, Delahaye D, Puechmore S (2020) Real-time fault detection on small fixed-wing UAVs using machine learning. In: 2020 AIAA/IEEE 39th Digital Avionics Systems Conference (DASC). pp 1–10
Li C, Li S, Zhang A et al (2022) A Siamese hybrid neural network framework for few-shot fault diagnosis of fixed-wing unmanned aerial vehicles. J Comput Design Eng 9:1511–1524. https://doi.org/10.1093/jcde/qwac070
Lindemann B, Fesenmayr F, Jazdi N, Weyrich M (2019) Anomaly detection in discrete manufacturing using self-learning approaches. Procedia CIRP 79:313–318. https://doi.org/10.1016/j.procir.2019.02.073
Titouna C, Nait-Abdesselam F, Moungla H (2020) An online anomaly detection approach for unmanned aerial vehicles. Int Wirel Commun Mob Comput (IWCMC) 2020:469–474. https://doi.org/10.1109/IWCMC48107.2020.9148073
Park KH, Park E, Kim HK (2021) Unsupervised fault detection on unmanned aerial vehicles: encoding and thresholding approach. Sensors 21:2208. https://doi.org/10.3390/s21062208
Tlili F, Ayed S, Chaari L, Ouni B (2022) Artificial intelligence based approach for fault and anomaly detection within UAVs. In: International conference on advanced information networking and applications. Springer International Publishing, Cham, pp 297–308
Acknowledgements
This work is funded by the International Cooperation Foundation of Jilin Province (20210402074GH). This work is also supported by the 111 Project of China (D21009, D17017).
Author information
Authors and Affiliations
Contributions
Aakash Kumar conceptualized the research, collected the data, and performed data analysis. Shifeng Wang assisted with formal analysis and investigation and also served as the corresponding author. Ali Muhammad Shaikh and Hazrat Bilal reviewed and edited the draft. Shifeng Wang and Shigeng Song supervised the entire research instructed during various phases of the study and provided meaningful guidelines. Aakash Kumar and Lu Bo wrote the first draft of the manuscript, and all authors commented on previous versions. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing interests to declare relevant to this article's content.
Ethical standards
I certify that this article has no actual or potential conflict of interest. This research does not involve human participants and animals and does not require informed consent.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kumar, A., Wang, S., Shaikh, A.M. et al. Building on prior lightweight CNN model combined with LSTM-AM framework to guide fault detection in fixed-wing UAVs. Int. J. Mach. Learn. & Cyber. 15, 4175–4191 (2024). https://doi.org/10.1007/s13042-024-02141-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-024-02141-3