Skip to main content
Log in

Building on prior lightweight CNN model combined with LSTM-AM framework to guide fault detection in fixed-wing UAVs

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Fixed-wing UAVs (FW-UAVs) are empowered to handle diverse civilian and military missions, but sensor failure scenarios are constantly rising. Rapid advancement in deep learning methods currently proposes state-of-the-art solutions for fault detection of UAVs. However, most recent deep learning-based detection models suffer from model size, high computational complexity, and high-power consumption, which are challenging for small-sized FW-UAVs with limited battery backup and computational power. Therefore, to overcome these problems, this article introduces a lightweight CNN model built on prior work combined with the LSTM-AM framework to obtain accurate fault detection of FW-UAVs with low power consumption and fast computations. First, lightweight CNN architecture aims to minimize computational complexity while maintaining high accuracy in fault detection. The LSTM model merged with Attention Mechanism (AM), allows the architecture to obtain temporal dependencies and concentrate on essential features for enhanced fault detection accuracy. The combined version of lightweight CNN, LSTM, and AM commits to more reliable and efficient fault detection in FW-UAV applications, improving UAV drones’ overall performance and safety.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The datasets generated during and analyzed during the current study are available from the corresponding author upon reasonable request.

References

  1. Zhao Y, Ma J, Li X, Zhang J (2018) Saliency detection and deep learning-based wildfire identification in UAV imagery. Sensors 18:712. https://doi.org/10.3390/s18030712

    Article  Google Scholar 

  2. Sibanyoni SV, Ramotsoela DT, Silva BJ, Hancke GP (2019) A 2-D acoustic source localization system for drones in search and rescue missions. IEEE Sens J 19:332–341. https://doi.org/10.1109/JSEN.2018.2875864

    Article  Google Scholar 

  3. Li M, Zhen L, Wang S et al (2018) Unmanned aerial vehicle scheduling problem for traffic monitoring. Comput Ind Eng 122:15–23. https://doi.org/10.1016/j.cie.2018.05.039

    Article  Google Scholar 

  4. James AT, Kumar G, Khan AQ, Asjad M (2022) Maintenance 4.0: implementation challenges and its analysis. Int J Quality Reliabil Manage 40:1706–1728. https://doi.org/10.1108/IJQRM-04-2021-0097

    Article  Google Scholar 

  5. Cortés-Leal A, Cárdenas C, Del-Valle-Soto C (2022) Maintenance 5.0: towards a worker-in-the-loop framework for resilient smart manufacturing. Appl Sci 12:11330. https://doi.org/10.3390/app122211330

    Article  Google Scholar 

  6. Fourlas GK, Karras GC (2021) A survey on fault diagnosis methods for UAVs. In: 2021 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE, Athens, Greece, pp 394–403

  7. Guo D, Zhong M, Zhou D (2018) Multisensor data-fusion-based approach to airspeed measurement fault detection for unmanned aerial vehicles. IEEE Trans Instrum Meas 67:317–327. https://doi.org/10.1109/TIM.2017.2735663

    Article  Google Scholar 

  8. Zuo L, Yao L, Kang Y (2020) UIO based sensor fault diagnosis and compensation for quadrotor UAV. In: 2020 Chinese Control And Decision Conference (CCDC). IEEE, Hefei, China, pp 4052–4057

  9. Gao J, Zhang Q, Chen J (2020) EKF-based actuator fault detection and diagnosis method for tilt-rotor unmanned aerial vehicles. Math Probl Eng 2020:1–12. https://doi.org/10.1155/2020/8019017

    Article  MathSciNet  Google Scholar 

  10. 5G_SDR-Assisted_Cognitive_Communication_in_UAV_Swarms_Architecture_and_Applications.pdf. In: Google Docs. https://drive.google.com/file/d/1PF__isoP0Y_p7BTm8oBI2T3TEoG5nsW3/view?usp=embed_facebook. Accessed 8 Feb 2024

  11. Akhunzada A, Zeadally S, Islam SU (2021) Power and performance efficient SDN-enabled fog architecture. IT Prof 23:24–30. https://doi.org/10.1109/MITP.2021.3085840

    Article  Google Scholar 

  12. Ali Z, Henna S, Akhunzada A et al (2019) Performance evaluation of LoRaWAN for green internet of things. IEEE Access 7:164102–164112. https://doi.org/10.1109/ACCESS.2019.2943720

    Article  Google Scholar 

  13. Akhunzada A, Zeadally S, ul Islam S (2023) Toward performance and energy-efficient edge-of-things. IT Professional 25:17–23. https://doi.org/10.1109/MITP.2022.3230837

    Article  Google Scholar 

  14. Miao J, Wang J, Wang D, Miao Q (2021) Experimental investigation on electro-hydraulic actuator fault diagnosis with multi-channel residuals. Measurement 180:109544. https://doi.org/10.1016/j.measurement.2021.109544

    Article  Google Scholar 

  15. Wang N, Ren J, Luo Y, et al (2021) UAV actuator fault detection using maximal information coefficient and 1-D convolutional neural network. In: 2021 Global Reliability and Prognostics and Health Management (PHM-Nanjing). IEEE, Nanjing, China, pp 1–6

  16. Li C, Li S, Zhang A et al (2021) Meta-learning for few-shot bearing fault diagnosis under complex working conditions. Neurocomputing 439:197–211. https://doi.org/10.1016/j.neucom.2021.01.099

    Article  Google Scholar 

  17. Bhatia AK, Jiang J, Kumar A et al (2021) Adaptive preview control with deck motion compensation for autonomous carrier landing of an aircraft. Int J Adapt Control Signal Process 35:769–785. https://doi.org/10.1002/acs.3228

    Article  MathSciNet  Google Scholar 

  18. Perez E, Kiela D, Cho K (2021) True few-shot learning with language models

  19. Bilal H, Yin B, Kumar A et al (2023) Jerk-bounded trajectory planning for rotary flexible joint manipulator: an experimental approach. Soft Comput 27:4029–4039. https://doi.org/10.1007/s00500-023-07923-5

    Article  Google Scholar 

  20. Kumar A, Shaikh AM, Li Y et al (2021) Pruning filters with L1-norm and capped L1-norm for CNN compression. Appl Intell 51:1152–1160. https://doi.org/10.1007/s10489-020-01894-y

    Article  Google Scholar 

  21. Ding SX (2013) Model-based fault diagnosis techniques: design schemes, algorithms and tools. Springer, London

    Book  Google Scholar 

  22. Gangsar P, Tiwari R (2020) Signal based condition monitoring techniques for fault detection and diagnosis of induction motors: a state-of-the-art review. Mech Syst Signal Process 144:106908. https://doi.org/10.1016/j.ymssp.2020.106908

    Article  Google Scholar 

  23. Hoang D-T, Kang H-J (2019) A survey on Deep Learning based bearing fault diagnosis. Neurocomputing 335:327–335. https://doi.org/10.1016/j.neucom.2018.06.078

    Article  Google Scholar 

  24. Chakrapani G, Sugumaran V (2023) Transfer learning based fault diagnosis of automobile dry clutch system. Eng Appl Artif Intell 117:105522. https://doi.org/10.1016/j.engappai.2022.105522

    Article  Google Scholar 

  25. Wu TY, Lei KW (2019) Prediction of surface roughness in milling process using vibration signal analysis and artificial neural network. Int J Adv Manuf Technol 102:305–314. https://doi.org/10.1007/s00170-018-3176-2

    Article  Google Scholar 

  26. Boztaş S, Özbudak F, Tekin E (2022) New Correlations of m-sequences over the finite field \mathbbF_4 compatible with a new bijection to \mathbbZ_4. In: 2022 10th International Workshop on Signal Design and Its Applications in Communications (IWSDA). pp 1–5

  27. Thomas JB, Chaudhari SG, K. V. S, Verma NK (2023) CNN-based transformer model for fault detection in power system networks. IEEE Trans Instrum Meas 72:1–10. https://doi.org/10.1109/TIM.2023.3238059

    Article  Google Scholar 

  28. Wang T, Zhang L, Wang X (2023) Fault detection for motor drive control system of industrial robots using CNN-LSTM-based observers. Trans Electr Mach Syst 7:144–152. https://doi.org/10.30941/CESTEMS.2023.00014

    Article  Google Scholar 

  29. Freddi A, Longhi S, Monteriù A (2012) A diagnostic thau observer for a class of unmanned vehicles. J Intell Robot Syst 67:61–73. https://doi.org/10.1007/s10846-012-9650-4

    Article  Google Scholar 

  30. Ortiz-Torres G, Castillo P, Sorcia-Vazquez FDJ et al (2020) Fault estimation and fault tolerant control strategies applied to VTOL aerial vehicles with soft and aggressive actuator faults. IEEE Access 8:10649–10661. https://doi.org/10.1109/ACCESS.2019.2963693

    Article  Google Scholar 

  31. Baldini A, Felicetti R, Freddi A, et al (2022) Hexarotor Fault Tolerant Control Using a Bank of Disturbance Observers. In: 2022 International Conference on Unmanned Aircraft Systems (ICUAS). pp 608–616

  32. Ghalamchi B, Jia Z, Mueller MW (2020) Real-time vibration-based propeller fault diagnosis for multicopters. IEEE/ASME Trans Mechatron 25:395–405. https://doi.org/10.1109/TMECH.2019.2947250

    Article  Google Scholar 

  33. Ai S, Song J, Cai G, Zhao K (2022) Active fault-tolerant control for quadrotor UAV against sensor fault diagnosed by the auto sequential random forest. Aerospace 9:518. https://doi.org/10.3390/aerospace9090518

    Article  Google Scholar 

  34. Liang S, Zhang S, Huang Y et al (2022) Data-driven fault diagnosis of FW-UAVs with consideration of multiple operation conditions. ISA Trans 126:472–485. https://doi.org/10.1016/j.isatra.2021.07.043

    Article  Google Scholar 

  35. Park J, Jung Y, Kim J-H (2022) Multiclass classification fault diagnosis of multirotor UAVs utilizing a deep neural network. Int J Control Autom Syst 20:1316–1326. https://doi.org/10.1007/s12555-021-0729-1

    Article  Google Scholar 

  36. Kang W, Xiao J, Xue J (2022) Complex system health condition estimation using tree-structured simple recurrent unit networks. Complex Intell Syst 8:5203–5221. https://doi.org/10.1007/s40747-022-00732-7

    Article  Google Scholar 

  37. Liu G, Wei P, Chen K et al (2022) Polymer gear contact fatigue reliability evaluation with small data set based on machine learning. J Comput Design Eng 9:583–597. https://doi.org/10.1093/jcde/qwac020

    Article  Google Scholar 

  38. Chen X-M, Wu C-X, Wu Y et al (2019) Design and analysis for early warning of rotor UAV based on data-driven DBN. Electronics 8:1350. https://doi.org/10.3390/electronics8111350

    Article  Google Scholar 

  39. Guo D, Zhong M, Ji H et al (2018) A hybrid feature model and deep learning based fault diagnosis for unmanned aerial vehicle sensors. Neurocomputing 319:155–163. https://doi.org/10.1016/j.neucom.2018.08.046

    Article  Google Scholar 

  40. Cui A, Zhang Y, Zhang P et al (2020) Intelligent health management of fixed-wing UAVs: a deep-learning-based approach

  41. Ahmad MW, Akram MU, Ahmad R et al (2022) Intelligent framework for automated failure prediction, detection, and classification of mission critical autonomous flights. ISA Trans 129:355–371. https://doi.org/10.1016/j.isatra.2022.01.014

    Article  Google Scholar 

  42. Liu W, Chen Z, Zheng M (2020) An audio-based fault diagnosis method for quadrotors using convolutional neural network and transfer learning

  43. Zhang Y, Zhao H, Ma J et al (2021) A deep neural network-based fault detection scheme for aircraft IMU sensors. Int J Aerosp Eng 2021:e3936826. https://doi.org/10.1155/2021/3936826

    Article  Google Scholar 

  44. Wang X, Roy S, Farì S, Baldi S (2020) The problem of reliable design of vector-field path following in the presence of uncertain course dynamics. IFAC-PapersOnLine 53:9399–9404. https://doi.org/10.1016/j.ifacol.2020.12.2409

    Article  Google Scholar 

  45. Li Z, Zhang Y, Ai J et al (2023) A lightweight and explainable data-driven scheme for fault detection of aerospace sensors. IEEE Trans Aerosp Electron Syst 59:8392–8410. https://doi.org/10.1109/TAES.2023.3303855

    Article  Google Scholar 

  46. Jiang T, Zong M, Ma Y, et al (2023) MobileACNet: ACNet-based lightweight model for image classification. In: Yan WQ, Nguyen M, Stommel M (eds) Image and vision computing. Springer Nature Switzerland, Cham, pp 361–372

  47. Ghose P, Biswas M, Gaur L (2023) BrainSegNeT: a lightweight brain tumor segmentation model based on U-net and progressive neuron expansion. In: Liu F, Zhang Y, Kuai H et al (eds) Brain informatics. Springer Nature Switzerland, Cham, pp 249–260

  48. Cai G, Lum K-Y, Chen BM, Lee TH (2010) A brief overview on miniature fixed-wing unmanned aerial vehicles. IEEE ICCA 2010:285–290

    Google Scholar 

  49. Ducard G (2015) Actuator fault detection in UAVs. In: Valavanis KP, Vachtsevanos GJ (eds) Handbook of unmanned aerial vehicles. Springer, Netherlands, pp 1071–1122

    Chapter  Google Scholar 

  50. Fu J, Sun C, Yu Z, Liu L (2019) A hybrid CNN-LSTM model based actuator fault diagnosis for six-rotor UAVs. In: 2019 Chinese Control And Decision Conference (CCDC). pp 410–414

  51. Kumar A (2022) Structure level pruning of efficient convolutional neural networks with sparse group LASSO. IJMLC. https://doi.org/10.18178/ijmlc.2022.12.5.1111

    Article  Google Scholar 

  52. Li Y, Wang L, Peng S et al (2019) Using feature entropy to guide filter pruning for efficient convolutional networks. In: Tetko IV, Kůrková V, Karpov P, Theis F (eds) Artificial neural networks and machine learning—ICANN 2019: deep learning. Springer International Publishing, Cham, pp 263–274

    Chapter  Google Scholar 

  53. Kumar A, Yin B, Shaikh AM et al (2022) CorrNet: pearson correlation based pruning for efficient convolutional neural networks. Int J Mach Learn Cyber 13:3773–3783. https://doi.org/10.1007/s13042-022-01624-5

    Article  Google Scholar 

  54. Zhao Z, Chen W, Wu X et al (2017) LSTM network: a deep learning approach for short-term traffic forecast. IET Intel Transport Syst 11:68–75. https://doi.org/10.1049/iet-its.2016.0208

    Article  Google Scholar 

  55. Bronz M, Baskaya E, Delahaye D, Puechmore S (2020) Real-time fault detection on small fixed-wing UAVs using machine learning. In: 2020 AIAA/IEEE 39th Digital Avionics Systems Conference (DASC). pp 1–10

  56. Li C, Li S, Zhang A et al (2022) A Siamese hybrid neural network framework for few-shot fault diagnosis of fixed-wing unmanned aerial vehicles. J Comput Design Eng 9:1511–1524. https://doi.org/10.1093/jcde/qwac070

    Article  Google Scholar 

  57. Lindemann B, Fesenmayr F, Jazdi N, Weyrich M (2019) Anomaly detection in discrete manufacturing using self-learning approaches. Procedia CIRP 79:313–318. https://doi.org/10.1016/j.procir.2019.02.073

    Article  Google Scholar 

  58. Titouna C, Nait-Abdesselam F, Moungla H (2020) An online anomaly detection approach for unmanned aerial vehicles. Int Wirel Commun Mob Comput (IWCMC) 2020:469–474. https://doi.org/10.1109/IWCMC48107.2020.9148073

    Article  Google Scholar 

  59. Park KH, Park E, Kim HK (2021) Unsupervised fault detection on unmanned aerial vehicles: encoding and thresholding approach. Sensors 21:2208. https://doi.org/10.3390/s21062208

    Article  Google Scholar 

  60. Tlili F, Ayed S, Chaari L, Ouni B (2022) Artificial intelligence based approach for fault and anomaly detection within UAVs. In: International conference on advanced information networking and applications. Springer International Publishing, Cham, pp 297–308

Download references

Acknowledgements

This work is funded by the International Cooperation Foundation of Jilin Province (20210402074GH). This work is also supported by the 111 Project of China (D21009, D17017).

Author information

Authors and Affiliations

Authors

Contributions

Aakash Kumar conceptualized the research, collected the data, and performed data analysis. Shifeng Wang assisted with formal analysis and investigation and also served as the corresponding author. Ali Muhammad Shaikh and Hazrat Bilal reviewed and edited the draft. Shifeng Wang and Shigeng Song supervised the entire research instructed during various phases of the study and provided meaningful guidelines. Aakash Kumar and Lu Bo wrote the first draft of the manuscript, and all authors commented on previous versions. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Shifeng Wang.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare relevant to this article's content.

Ethical standards

I certify that this article has no actual or potential conflict of interest. This research does not involve human participants and animals and does not require informed consent.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, A., Wang, S., Shaikh, A.M. et al. Building on prior lightweight CNN model combined with LSTM-AM framework to guide fault detection in fixed-wing UAVs. Int. J. Mach. Learn. & Cyber. 15, 4175–4191 (2024). https://doi.org/10.1007/s13042-024-02141-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-024-02141-3

Keywords

Navigation