Skip to main content

Time Efficient Inspection of Ground Vehicles by a UAV Team Using a Markov Inequality Based Rule

  • Conference paper
  • First Online:
Distributed Autonomous Robotic Systems

Abstract

We present a control design for N unmanned aerial vehicles (UAVs) tasked with a time efficient inspection of M ground moving vehicles. The navigation and intent of each ground vehicle are unknown, therefore, the uncertainty of its navigation has to be anticipated in the navigation of each UAV. We use the minimum time stochastic optimal control to navigate each UAV towards the inspection of ground vehicles. Based on this control, we formulate assignments of ground vehicles to be inspected by UAVs as an optimization problem to inspect all ground vehicles in the minimum expected time. Accounting for ground vehicle uncertain trajectories, we update the optimal assignment by a Markov inequality rule. The rule prevents the possibility of indefinite updating of assignments without finishing the inspection of all vehicles. On the other hand, it updates an assignment if it leads to a statistically significant improvement of the expected time of inspection. The presented approach is illustrated by a numerical example.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Anderson, R., Milutinović, D.: A stochastic approach to dubins vehicle tracking problems. IEEE Trans. Autom. Control 10(59), 2801–2806 (2014)

    Article  MathSciNet  Google Scholar 

  2. Anderson, R.P., Bakolas, E., Milutinović, D., Tsiotras, P.: Optimal feedback guidance of a small aerial vehicle in a stochastic wind. J. Guid. Control Dyn. 36(4), 975–985 (2013)

    Article  Google Scholar 

  3. Angelov, P.: Sense and Avoid in UAS: Research and Applications. Wiley (2012)

    Google Scholar 

  4. Beard, R.W., McLain, T.W., Goodrich, M.A., Anderson, E.P.: Coordinated target assignment and intercept for unmanned air vehicles. IEEE Trans. Robot. Autom. 18(6), 911–922 (2002)

    Article  Google Scholar 

  5. Burkard, R., Dell’Amico, M., Martello, S.: Assignment Problems: Revised Reprint. SIAM: Society for Industrial and Applied Mathematics, Philadelphia, PA, USA (2009). Chapter 4: Linear Assignment Problem

    Google Scholar 

  6. Choi, J., Milutinović, D.: Tips on stochastic optimal feedback control and bayesian spatio-temporal models: application to robotics. ASME J. Dyn. Syst. Meas. Control 3(137) (2015)

    Google Scholar 

  7. Festa, A., Vinter, R.B.: Decomposition of differential games with multiple targets. J. Optim. Theory Appl. 849–875 (2016)

    Google Scholar 

  8. Ge, J., Tang, L., Reimann, J., Vachtsevanos, G.: Hierarchical decomposition approach for pursuit- evasion differential game with multiple players. IEEE Aerosp. Conf. (2006)

    Google Scholar 

  9. Getz, W.M., Pachter, M.: Capturability in a Two-Target ‘’Game of Two Cars”. J. Guid. Control 4(1), 15–22 (1981)

    Article  Google Scholar 

  10. Hashemi, A., Casbeer, D.W., Milutinović, D.: Scalable value approximation for multiple target tail-chase with collision avoidance. In: Proceedings of the 55th IEEE Conference of Decision and Control (CDC) (2016)

    Google Scholar 

  11. Isaacs, R.: Games of Pursuit. RAND Corporation, Santa Monica, CA (1951)

    Google Scholar 

  12. Kushner, H.J., Dupuis, P.: Numerical Methods for Stochastic Control Problems in Continuous Time, 2nd edn. Springer, New York, NY, USA (2001)

    Book  Google Scholar 

  13. LaValle, S.M.: Planning Algorithms. Cambridge University Press (2006)

    Google Scholar 

  14. Li Jr., D., Cruz, J.B., Chen, G., Kwan, C., Chang, M.H.: A Hierarchical approach to multi-player pursuit-evasion differential games. In: Proceedings of the 44th IEEE Conference of Decision and Control (CDC), vol. 44(5), pp. 5674–5679 (2005)

    Google Scholar 

  15. Milutinović, D., Casbeer, D.W., Pachter, M.: Markov inequality rule for switching among time optimal controllers in a multiple vehicle intercept problem. Automatica 87, 274–280 (2018)

    Article  MathSciNet  Google Scholar 

  16. Milutinović, D., Casbeer, D.W., Rasmussen, S., Kingston, D.: A stochastic approach to small UAV feedback control for target tracking and blind spot avoidance. In: Proceedings of the 1st IEEE Conference on Control Technology and Applications (CCTA) (2017)

    Google Scholar 

  17. Mitchell, I.M., Bayen, A.M., Tomlin, C.J.: A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games. IEEE Trans. Autom. Control 50(7), 947–957 (2005)

    Article  MathSciNet  Google Scholar 

  18. Munishkin, A.A., Hashemi, A., Casbeer, D.W., Milutinović, D.: Scalable markov chain approximation for a safe intercept navigation in the presence of multiple vehicles. Autonomous Robots (accepted for publication)

    Google Scholar 

  19. Munishkin, A.A., Milutinović, D., Casbeer, D.W.: Stochastic optimal control navigation with the avoidance of unsafe configurations. In: Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS) (2016)

    Google Scholar 

  20. Spivey, M.Z., Powell, W.B.: Dynamic assignment problem. Trans. Sci. 38(4), 399–419 (2004)

    Article  Google Scholar 

  21. Von Moll, A., Casbeer, D.W., Garcia, E., Milutinović, D.: Pursuit-Evasion of an Evader by Multiple Pursuers (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dejan Milutinović .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Munishkin, A.A., Milutinović, D., Casbeer, D.W. (2019). Time Efficient Inspection of Ground Vehicles by a UAV Team Using a Markov Inequality Based Rule. In: Correll, N., Schwager, M., Otte, M. (eds) Distributed Autonomous Robotic Systems. Springer Proceedings in Advanced Robotics, vol 9. Springer, Cham. https://doi.org/10.1007/978-3-030-05816-6_7

Download citation

Publish with us

Policies and ethics