Skip to main content

Advertisement

Springer Nature Link
Log in

Model-aided and vision-based navigation for an aerial robot in real-time application

  • Original Research Paper
  • Published:
Intelligent Service Robotics Aims and scope Submit manuscript

Abstract

In this paper, a novel navigation method with the assistance of a vehicle dynamic model (VDM), known as the VDM-aided navigation method, is introduced. This method is specifically designed for a subset of fixed-wing aerial robots within the broader category of unmanned aerial vehicles. Vision-based navigation (VBN) is employed to increase accuracy while maintaining reliability in Global Navigation Satellite System (GNSS) outages. In addition, an unscented Kalman filter (UKF) is used to estimate navigation parameters, including speed, position and attitude. This method uses the dynamic system as a process model and employs VBN, barometric altitude and vertical gyro as measurement inputs. In VBN, the method of scale-invariant feature transform is used as a method for image matching. To ensure the real-time capability of this method with the existing microprocessor, a hardware-in-the-loop (HIL) laboratory has been utilized. According to nonlinear observability methods, one can show the proposed integrated nonlinear navigation is observable under all conditions. Finally, the results of the HIL laboratory demonstrate that the proposed approach can estimate the robot navigation parameters with an acceptable level of precision even in the absence of an Inertial Navigation System (INS) and GNSS. It was validated even when there was an error of up to 20% in VDM parameters. Furthermore, an investigation was carried out regarding the use of Extended Kalman Filter instead of the UKF for the integrated navigation output. In GNSS outage conditions, considering both accuracy and cost, this method can serve as a valuable alternative for aerial robots. In addition, this approach can be recommended for INS fault detection with or without GNSS. Additionally, the integrated navigation provided can substitute the GNSS/INS system during fault conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Liu Y, Luo Q, Zhou Y (2022) Deep learning-enabled fusion to bridge GPS outages for INS/GPS integrated navigation. IEEE Sens J 22(9):8974–8985

    Article  Google Scholar 

  2. Barra J, Creuzet T, Lesecq S, Scorletti G, Blanco E, Zarudniev M (2023) Micro-drone ego-velocity and height estimation in GPS-denied environments using an FMCW MIMO Radar, IEEE Sens J 23(3):2684–2692

    Article  Google Scholar 

  3. Wei Y, Li H, Lu M (2022) A steady-state spoofing detection and exclusion method based on raw IMU measurement. IEEE Sens J 22(4):3529–3539

    Article  Google Scholar 

  4. Zhang H, Ye F, Lai Y (2023) IQ-VIO: adaptive visual inertial odometry via interference quantization under dynamic environments. Intell Serv Robot 16:565–581

    Article  Google Scholar 

  5. Sung C, Jeon S, Lim H (2022) What if there was no revisit? Large-scale graph-based SLAM with traffic sign detection in an HD map using LiDAR inertial odometry. Intell Serv Robot 15:161–170

    Article  Google Scholar 

  6. Li S, Ozo MMOI, De Wagter C, de Croon GCHE (2020) Autonomous drone race: A computationally efficient vision-based navigation and control strategy. Rob Auton Syst 133:103621

    Article  Google Scholar 

  7. Andreis E, Panicucci P, Topputo F (2023) An autonomous vision-based algorithm for interplanetary navigation, arXiv Prepr. arXiv:2309.09590

  8. Kalidas AP, Joshua CJ, Md AQ, Basheer S, Mohan S, Sakri S (2023) Deep reinforcement learning for vision-based navigation of UAVs in avoiding stationary and mobile obstacles. Drones 7:245

    Article  Google Scholar 

  9. Kanagasingham S, Ekpanyapong M, Chaihan R (2020) Integrating machine vision-based row guidance with GPS and compass-based routing to achieve autonomous navigation for a rice field weeding robot. Precis Agric 21(4):831–855

    Article  Google Scholar 

  10. Liu Y, Guo C, Wang Y (2023) Object-aware data association for the semantically constrained visual SLAM. Intell Serv Robot 16(2):155–176

    Article  Google Scholar 

  11. Wen S, Liu X, Wang Z, Zhang H, Zhang Z, Tian W (2022) An improved multi-object classification algorithm for visual SLAM under dynamic environment. Intell Serv Robot 15(1):39–55

    Article  Google Scholar 

  12. Sobczak L, Filus K, Domańska J, Domański A (2022) Finding the best hardware configuration for 2D SLAM in indoor environments via simulation based on Google Cartographer. Sci Rep 12(1):18815

    Article  Google Scholar 

  13. Luo XL, Lv JH, Sun G (2020) A visual-inertial navigation method for high-speed unmanned aerial vehicles, arXiv Prepr. arXiv:2002.04791

  14. Karami E, Prasad S, Shehata M (2015) Image matching using SIFT, SURF, BRIEF and ORB: performance comparison for distorted images. In Proceedings of the 2015 Newfoundland Electrical and Computer Engineering Conference, St. johns, Canada, November 2015.

  15. Bansal M, Kumar M, Kumar M (2021) 2D object recognition: a comparative analysis of SIFT, SURF and ORB feature descriptors. Multimed Tools Appl 80:18839–18857

    Article  Google Scholar 

  16. Bilik S, Horak K (2022) SIFT and SURF based feature extraction for the anomaly detection. In: Proceedings I of the 28th Conference STUDENT EEICT 2022 General Papers, pp. 459–464. Faculty of Electrical Engineering and Communication, Brno University of Technology, Brno

  17. Haijie Z, Jiafeng L, Sifan C, Linlin Q (2020) Research on image feature matching algorithm applied to UAV obstacle avoidance. Chinese Control Decision Conf (CCDC) 2020:3753–3757

    Google Scholar 

  18. Lowe DG (2004) Distinctive image features from scale invariant keypoints. Int J Comput Vision 60(2):91–110

    Article  Google Scholar 

  19. Meng L, Ye C, Lin W (2022) A tightly coupled monocular visual lidar odometry with loop closure. Intell Serv Robot 15(1):129–141

    Article  Google Scholar 

  20. Zou J, Shao L, Tang H (2023) Lmapping: tightly-coupled LiDAR-inertial odometry and mapping for degraded environments, Intell Serv Robot 16:583–597

    Article  Google Scholar 

  21. Nobahari H, Mohammadkarimi H (2017) Application of model aided inertial navigation for precise altimetry of unmanned aerial vehicles in ground proximity. Aerosp Sci Technol 69:650–658

    Article  Google Scholar 

  22. Dahmane S-A et al (2023) Analysis and compensation of positioning errors of robotic systems by an interactive method. J Brazilian Soc Mech Sci Eng 45(2):119

    Article  Google Scholar 

  23. Dahmane SA, Megueni A, Azzedine A, Slimane A, Lousdad A (2019) Determination of the optimal path of three axes robot using genetic algorithm. Int J Eng Res Africa 44:135–149

    Article  Google Scholar 

  24. Dahmane S-A, Azzedine A, Megueni A, Slimane A (2019) Quantitative and qualitative study of methods for solving the kinematic problem of a planar parallel manipulator based on precision error optimization. Int J Interact Des Manuf 13(2):567–595

    Article  Google Scholar 

  25. Xu Y, Zhang Q, Zhang J, Wang X, Yu Z (2021) A vehicle-model-aided navigation reconstruction method for a multicopter during a gps outage. Electronics 10(5):528

    Article  Google Scholar 

  26. Xu Y, de Croon GCHE (2023) Efficient Model-Aided Visual-Inertial Ego-Motion Estimation for Multirotor MAVs, In: 14th annual international micro air vehicle conference and competition

  27. Youn W et al (2021) Model-aided synthetic airspeed estimation of UAVs for analytical redundancy. IEEE Robot Autom Lett 6(3):5841–5848

    Article  Google Scholar 

  28. Koifman M, Bar-Itzhack IY (1999) Inertial navigation system aided by aircraft dynamics. IEEE Trans Control Syst Technol 7(4):487–493

    Article  Google Scholar 

  29. Du B, Wang H, Pan S, Liu D, Zhu Y, Shi Z (2022) Robust multilayer vehicle model-aided INS based on soft and hard constraints. IEEE Sens J 23(1):812–827

    Article  Google Scholar 

  30. Khaghani, M, Skaloud, J (2018) VDM-based UAV Attitude Determination in Absence of IMU Data, In: 2018 European Navigation Conference (ENC), 84–90

  31. Khaghani M, Skaloud J (2016) Autonomous vehicle dynamic model-based navigation for small UAVs. Navig J Inst Navig 63(3):345–358

    Article  Google Scholar 

  32. Khaghani M, Skaloud J (2018) Assessment of VDM-based autonomous navigation of a UAV under operational conditions. Rob Auton Syst 106:152–164

    Article  Google Scholar 

  33. Worth DB, Woolley BG, Hodson DD (2021) SwarmSim: a framework for modeling swarming unmanned aerial vehicles using hardware-in-the-loop. J Def Model Simul 18(2):105–124

    Article  Google Scholar 

  34. Dai X, Ke C, Quan Q, Cai K-Y (2021) RFlySim: automatic test platform for UAV autopilot systems with FPGA-based hardware-in-the-loop simulations. Aerosp Sci Technol 114:106727

    Article  Google Scholar 

  35. Gaber K, El-Mashade MB, Aziz GAA (2020) Hardware-in-the-loop real-time validation of micro-satellite attitude control. Comput Electr Eng 85:106679

    Article  Google Scholar 

  36. Moréac E, Abdali EM, Berry F, Heller D, Diguet J-P (2020) Hardware-in-the-loop simulation with dynamic partial FPGA reconfiguration applied to computer vision in ROS-based UAV. Int Workshop Rapid Syst Prototyp (RSP) 2020:1–7

    Google Scholar 

  37. Saif E, Eminoğlu İ (2022) Modelling of quad-rotor dynamics and hardware-in-the-loop simulation. J Eng 2022(10):937–950

    Google Scholar 

  38. Zipfel PH (2007) Modeling and simulation of aerospace vehicle dynamics, Amer. Inst. of Aeronautics. Second Edition. AIAA

  39. Gu Y, Gross J, Rhudy MA (2016) fault-tolerant multiple sensor fusion approach applied to UAV attitude estimation. Int J Aerosp Eng 3:1–12

    Article  Google Scholar 

  40. Gu Y et al (2006) Design and flight testing evaluation of formation control laws. IEEE Trans Control Syst Technol 14(6):1105–1112

    Article  Google Scholar 

  41. Aminzadeh A, Atashgah MA, Roudbari A (2018) Software in the loop framework for the performance assessment of a navigation and control system of an unmanned aerial vehicle. IEEE Aerosp Electron Syst Mag 33(1):50–57

    Article  Google Scholar 

  42. Simon D (2006) Optimal state estimation: kalman, h infinity, and nonlinear approaches. John Wiley & Sons, Hoboken

    Book  Google Scholar 

  43. Zhou B, Fang H, Xu J (2022) UWB-IMU-odometer fusion localization scheme: observability analysis and experiments. IEEE Sens J 23(3):2550–2564

    Article  Google Scholar 

  44. Chen W, Yang Z, Gu S, Wang Y, Tang Y (2022) Adaptive transfer alignment method based on the observability analysis for airborne pod strapdown inertial navigation system. Sci Rep 12(1):946

    Article  Google Scholar 

  45. Krener Arthur J, Ide Kayo (2009) Measures of unobservability, In: Proceedings of the 48th IEEE Conference on Decision and Control, 2009 Held Jointly with the 200928th Chinese Control Conference, CDC/CCC 2009, IEEE

  46. Ducard GJ (2009) Fault-tolerant flight control and guidance systems: practical methods for small unmanned aerial vehicles. Springer, London

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Aerospace Engineering Department, UAV Lab., K. N. Toosi University of Technology, Tehran, Iran

    M. Alizadeh & A. M. Khoshnood

Authors
  1. M. Alizadeh
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. A. M. Khoshnood
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to A. M. Khoshnood.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose. The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix: UAV data

Appendix: UAV data

Longitudinal and lateral–directional aerodynamic coefficients of the fixed-wing UAV used in this study are shown in Table 

Table 2 Longitudinal Aerodynamic coefficients of the fixed-wing UAV
Full size table

2 and Table 

Table 3 Lateral–directional aerodynamic coefficients of the fixed-wing UAV
Full size table

3. Other parameters of the UAV include mass, geometric and thrust data, which are in Table 

Table 4 Mass, geometric and thrust data of fixed-wing UAV
Full size table

4.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alizadeh, M., Khoshnood, A.M. Model-aided and vision-based navigation for an aerial robot in real-time application. Intel Serv Robotics 17, 731–744 (2024). https://doi.org/10.1007/s11370-024-00532-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11370-024-00532-7

Keywords