Skip to main content
SpringerLink
Log in

Automatic estimation of optimal UAV flight parameters for real-time wide areas monitoring

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In the last few years, small-scale Unmanned Aerial Vehicles (UAVs) have been used in many video-based monitoring applications, such as search and rescue (SAR) operations, border control, precision agriculture, and many others. Usually, during these missions, a human operator manually selects UAV flight parameters according to the specific monitoring application to be performed. Anyway, regardless a particular mission, some main tasks can be considered common preprocessing steps that require to be accomplished. These tasks include the mosaicking of areas of interest, the detection of changes over time on these areas, finally, the classification of what is present on the ground. The success of these tasks strictly depends on flight and video sensor parameters. In this paper, for the first time in the literature, a method to automatically estimate the optimal parameters, in particular altitude and frame rate, to accomplish the three main tasks reported above is presented and tested. The parameters are estimated according to several factors, including size of the target to be analysed, cruise speed of UAVs, and main internal parameters of the video sensor, i.e., focal length, field of view, and size of the pixel. The full effectiveness of the proposed method, on the three case studies (i.e., main tasks), was proven both by synthetic videos generated with the Aerial Informatics and Robotics Simulation (AirSim) and by real video sequences reported in the UAV Mosaicking and Change Detection (UMCD) and NPU Drone-Map datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

Notes

  1. https://github.com/openMVG/openMVG

References

  1. Araar O, Aouf N, Vitanov I (2017) Vision based autonomous landing of multirotor uav on moving platform. J Intell Robot Syst 85(2):369–384

    Article  Google Scholar 

  2. Avola D, Bernardi M, Cinque L, Foresti G, Massaroni C (2017) Adaptive bootstrapping management by keypoint clustering for background initialization. Pattern Recogn Lett 100:110–116

    Article  Google Scholar 

  3. Avola D, Cinque L, Del Bimbo A, Marini M (2020) Miftel: a multimodal interactive framework based on temporal logic rules. Multimed Tools Appl 79(19-20):13533–13558

    Article  Google Scholar 

  4. Avola D, Cinque L, Fagioli A, Foresti GL, Massaroni C, Pannone D (2019) Feature-based slam algorithm for small scale uav with nadir view. In: Image analysis and processing – ICIAP 2019, pp 457– 467

  5. Avola D, Cinque L, Foresti G, Marini M, Pannone D (2018) Vrheab: a fully immersive motor rehabilitation system based on recurrent neural network. Multimed Tools Appl 77(19):24955–24982

    Article  Google Scholar 

  6. Avola D, Cinque L, Foresti G, Pannone D (2020) Homography vs similarity transformation in aerial mosaicking: Which is the best at different altitudes? Multimed Tools Appl 79(25-26):18387–18404

    Article  Google Scholar 

  7. Avola D, Cinque L, Foresti GL, Martinel N, Pannone D, Piciarelli C (2020) A uav video dataset for mosaicking and change detection from low-altitude flights. IEEE Trans Syst Man Cybern Syst 50(6):2139–2149

    Article  Google Scholar 

  8. Avola D, Foresti GL, Martinel N, Micheloni C, Pannone D, Piciarelli C (2017) Aerial video surveillance system for small-scale uav environment monitoring. In: Proceedings of the IEEE international conference on advanced video and signal based surveillance (AVSS), pp 1–6

  9. Avola D, Foresti GL, Martinel N, Micheloni C, Pannone D, Piciarelli C (2017) Real-time incremental and geo-referenced mosaicking by small-scale uavs. In: Proceedings of the international conference on image analysis and processing (ICIAP), pp 694–705

  10. Avtar R, Suab SA, Syukur MS, Korom A, Umarhadi DA, Yunus AP (2020) Assessing the influence of uav altitude on extracted biophysical parameters of young oil palm. Remote Sensing 12(18)

  11. Bu S, Zhao Y, Wan G, Liu Z (2016) Map2dfusion: Real-time incremental uav image mosaicing based on monocular slam. In: 2016 IEEE/RSJ International conference on intelligent robots and systems (IROS), pp 4564–4571

  12. Cabrera-Quiros L, Tax DMJ, Hung H (2020) Gestures in-the-wild: Detecting conversational hand gestures in crowded scenes using a multimodal fusion of bags of video trajectories and body worn acceleration. IEEE Trans Multimed 22 (1):138–147

    Article  Google Scholar 

  13. Chan C, Tsai C (2020) Collision-free speed alteration strategy for human safety in human-robot coexistence environments. IEEE Access 8:80120–80133

    Article  Google Scholar 

  14. Chen M, Wang H, Chang C, Wei X (2020) Sidr: a swarm intelligence-based damage-resilient mechanism for uav swarm networks. IEEE Access 8:77089–77105

    Article  Google Scholar 

  15. Fischler MA, Bolles RC (1981) Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

  16. Gaszczak A, Breckon TP, Han J (2011) Real-time people and vehicle detection from UAV imagery. In: Proceedings of the international conference on intelligent robots and computer vision XXVIII: Algorithms and techniques (IRCV-AT), pp 71–83

  17. Ho YH, Chen YR, Chen LJ (2015) Krypto: Assisting search and rescue operations using wi-fi signal with uav. In: Proceedings of the 1th workshop on micro aerial vehicle networks, systems, and applications for civilian use (DroNet), pp 3–8

  18. Jiang R, Wang P, Xu Y, Zhou Z, Luo X, Lan Y, Zhao G, Sanchez-Azofeifa A, Laakso K (2020) Assessing the operation parameters of a low-altitude uav for the collection of ndvi values over a paddy rice field Remote Sensing 12(11)

  19. Johnson J (1958) Analysis of image forming systems. In: Proceedings of the international image intensifier symposium (IIS), pp 244–273

  20. Kostas Daniilidis RK (2006) Imaging beyond the pinhole camera. Springer, Netherlands

    Book  Google Scholar 

  21. Lin S, Garratt MA, Lambert AJ (2017) Monocular vision-based real-time target recognition and tracking for autonomously landing an uav in a cluttered shipboard environment. Auton Robot 41(4):881–901

    Article  Google Scholar 

  22. Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: Single shot multibox detector. In: Proceedings of the european conference on computer vision (ECCV), pp 21–37

  23. Lu Y, Liu J, Liu W, Ma S, Xiu X, Liu W, Chen H (2020) Detecting moving objects from dynamic background combining subspace learning with mixed norm approach. Multimed Tools Appl 79(25-26):18747–18766

    Article  Google Scholar 

  24. Matsukawa T, Okabe T, Suzuki E, Sato Y (2020) Hierarchical gaussian descriptors with application to person re-identification. IEEE Trans Pattern Anal Mach Intell 42(9):2179–2194

    Article  Google Scholar 

  25. Meng X, Wang W, Leong B (2015) Skystitch: A cooperative multi-uav-based real-time video surveillance system with stitching. In: Proceedings of the 23rd ACM International Conference on Multimedia (MM), pp 261–270

  26. Pounds PEI, Bersak DR, Dollar AM (2012) Stability of small-scale uav helicopters and quadrotors with added payload mass under pid control. Auton Robot 33(1):129–142

    Article  Google Scholar 

  27. Price A, Pyke J, Ashiri D, Cornall T (2006) Real time object detection for an unmanned aerial vehicle using an fpga based vision system. In: Proceedings of the IEEE international conference on robotics and automation (ICRA), pp 2854–2859

  28. Qi J, Song D, Shang H, Wang N, Hua C, Wu C, Qi X, Han J (2016) Search and rescue rotary-wing uav and its application to the lushan ms 7.0 earthquake. J Field Robot 33(3):290–321

    Article  Google Scholar 

  29. Reymann C, Renzaglia A, Lamraoui F, Bronz M, Lacroix S (2018) Adaptive sampling of cumulus clouds with uavs. Auton Robot 42(2):491–512

    Article  Google Scholar 

  30. Ruchanurucks M, Rakprayoon P, Kongkaew S (2018) Automatic landing assist system using imu+pnp for robust positioning of fixed-wing uavs. J Intell Robot Syst 90(1):189–199

    Article  Google Scholar 

  31. Scherer J, Yahyanejad S, Hayat S, Yanmaz E, Andre T, Khan A, Vukadinovic V, Bettstetter C, Hellwagner H, Rinner B (2015) An autonomous multi-uav system for search and rescue. In: Proceedings of the 1st workshop on micro aerial vehicle networks, systems, and applications for civilian use (DroNet), pp 33–38

  32. Shah S, Dey D, Lovett C, Kapoor A (2017) Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In: Proceedings of the international conference on field and service robotics (FSR), pp 621–635

  33. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  34. Sohn WJ, Sipahi R, Sanger TD, Sternad D (2019) Portable motion-analysis device for upper-limb research, assessment, and rehabilitation in non-laboratory settings. IEEE J Trans Eng Health Med 7:1–14

    Article  Google Scholar 

  35. Vamsikrishna KM, Dogra DP, Desarkar MS (2016) Computer-vision-assisted palm rehabilitation with supervised learning. IEEE Trans Biomed Eng 63 (5):991–1001

    Article  Google Scholar 

  36. Wischounig-Strucl D, Rinner B (2015) Resource aware and incremental mosaics of wide areas from small-scale uavs. Mach Vis Appl 26(7):885–904

    Article  Google Scholar 

  37. Yahyanejad S, Wischounig-Strucl D, Quaritsch M, Rinner B (2010) Incremental mosaicking of images from autonomous, small-scale uavs. In: Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2010, pp 329–336

  38. Yang Y, Zheng Z, Bian K, Song L, Han Z (2018) Real-time profiling of fine-grained air quality index distribution using uav sensing. IEEE Internet Things J 5(1):186–198

    Article  Google Scholar 

  39. Zachariah D, Jansson M (2011) Self-motion and wind velocity estimation for small-scale uavs. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp 1166–1171

  40. Zengin U, Dogan A (2011) Cooperative target pursuit by multiple uavs in an adversarial environment. Robot Auton Syst 59(12):1049–1059

    Article  Google Scholar 

  41. Zhang Y, Zheng W, Leng K, Li H (2020) Background subtraction using an adaptive local median texture feature in illumination changes urban traffic scenes. IEEE Access 8:130367–130378

    Article  Google Scholar 

  42. Zheng Z, Jin Z, Sun L, Zhu M (2017) Adaptive sliding mode relative motion control for autonomous carrier landing of fixed-wing unmanned aerial vehicles. IEEE Access 5:5556–5565

    Article  Google Scholar 

  43. Zhou S, Wang J, Meng D, Xin X, Li Y, Gong Y, Zheng N (2018) Deep self-paced learning for person re-identification. Pattern Recogn 76:739–751

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially supported both by the “PREscriptive Situational awareness for cooperative auto-organizing aerial sensor NETworks (PRESNET)” project and by the MIUR under grant “Departments of Excellence 2018-2022” of the Department of Computer Science of Sapienza University.

Author information

Authors and Affiliations

  1. Department of Computer Science, Sapienza University, Via Salaria 113, 00198, Rome, Italy

    Danilo Avola, Luigi Cinque, Alessio Fagioli & Daniele Pannone

  2. Department of Mathematics, Computer Science and Physics, University of Udine, Via delle Scienze 206, 33100, Udine, Italy

    Gian Luca Foresti & Claudio Piciarelli

Authors
  1. Danilo Avola
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luigi Cinque
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alessio Fagioli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gian Luca Foresti
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Daniele Pannone
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Claudio Piciarelli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Danilo Avola.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Avola, D., Cinque, L., Fagioli, A. et al. Automatic estimation of optimal UAV flight parameters for real-time wide areas monitoring. Multimed Tools Appl 80, 25009–25031 (2021). https://doi.org/10.1007/s11042-021-10859-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10859-3

Keywords

Search

Navigation