Abstract
This work addresses the problem of enabling a single human operator to individually inspect targets for a fixed amount of time in a reconnaissance mission. The task of the operator is to classify the targets as friends or foes in real time, as they appear in video feeds from multiple UAVs. In order to account for cognitive limitations, the human is modeled as a single processing unit that can only execute one task at a time. A task is defined as a target inside the field of view of a given UAV, that needs to be inspected. Under the assumptions of this model, a linear program (LP) formulation is used to optimally find each task’s arrival time and latency in the system such that the human operator can inspect each target individually for some time Δt. Previous work by the authors investigated the idea of using UAV velocity modifications to meet the timing schedule specified by the LP solution. In this paper, the idea of UAV trajectory changes is introduced by modeling the UAVs as Dubins vehicles. Modifications to the bounds on the LP constraints are derived based on Dubins trajectories. The new bounds ensure that the LP solution returns a timing schedule achievable via maneuvers that combine velocity and trajectory changes to the UAVs’ flight plans. An on-line algorithm is developed that constructs and commands these velocity and trajectory changes in real time when conflicts arise. Correctness properties of this algorithm are analyzed and discussed for mission scenarios where the location of the targets is unknown and targets are discovered by the UAVs in real time.
Similar content being viewed by others
References
Gross, D., Rasmussen, S., Chandler, P., Feitshans, G.: Cooperative operations in urban terrain (counter). In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, ser. Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 6249 (2006)
Pachter, M., Chandler, P., Darbha, S.: Optimal control of an atr module equipped mav/human operator team. In: Proceedings of the 6th International Conference on Cooperative Control and Optimization (2006)
Girard, A., Pachter, M., Chandler, P.: Optimal decision rules and human operator models for UAV operations. In: AIAA Guidance Navigation and Control Conference and Exhibit, Keystone, Colorado (2006)
Donohue, M., Langbort, C.: Tasking human agents: a sigmoidal utility maximization approach for target identification in mixed teams of humans and UAVS. In: AIAA Conference on Guidance, Navigation and Control, Chicago, IL (2009)
Savla, K., Temple, T., Frazzoli, E.: Human-in-the-loop vehicle routing policies for dynamic environments. In: Decision and Control, 2008. CDC 2008. 47th IEEE Conference on, pp. 1145–1150 (2008)
Savla, K., Nehme, C., Temple, T., Frazzoli, E.: Efficient routing of multiple vehicles for human-supervised services in a dynamic environment. In: AIAA Conference on Guidance Navigation and Control, Honolulu, HI (2008)
Savla, K., Frazzoli, E.: A dynamical queue approach to intelligent task management for human operators. Proc. I.E.E.E. 100(3), 672–686 (2012). doi:10.1109/JPROC.2011.2173264
Srivastava, V., Carli, R., Bullo, F., Langbort, C.: Task release control for decision making queues. In: American Controls Conference, San Francisco, CA (2011)
Lehoczky, J., Sha, L., Ding, Y.: The rate monotonic scheduling algorithm: exact characterization and average case behavior. In: Real-Time Systems Symposium, pp. 166–171 (1989)
Sprunt, B., Sha, L., Lehoczky, J.: Aperiodic task scheduling for hard-real-time systems. Real-time Syst. 1, 27–60 (1989)
Ortiz, A., Langbort, C.: Scheduling multiple UAVS for online target classification by a single human operator. AIAA JACIC 8(12), 328–345 (2011)
Dubins, L.E.: On curves of minimal length with a constraint on average curvature, and with prescribed initial and terminal positions and tangents. Am. J. Math. 79(3), 497 (1957). http://www.jstor.org/stable/2372560
Chitsaz, H., LaValle, S.M.: Time-optimal paths for a dubins airplane. In: Conference on Decision and Control, New Orleans, LA (2007)
Bhatia, A., Graziano, M., Karaman, S., Naldi, R., Frazzoli, E.: Dubins trajectory tracking using commercial off-the-shelf autopilots. In: AIAA Guidance, Navigation and Control Conference and Exhibit, Honolulu, Hawaii, USA (2008)
Bhatia, A., Frazzoli, E.: Decentralized algorithm for minimum-time rendezvous of dubins vehicles. In: American Control Conference, pp. 1343–1349 (2008)
Jodeh, N., Mears, M., Gross, D.: An overview of the cooperative operations in urban terrain (counter) program. In: AIAA Guidance, Navigation and Control Conference and Exhibit, Honolulu, Hawaii (2008)
Pew, R.W.: The speed-accuracy operating characteristic. Acta Psychol 30, 16–26 (1969)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ortiz, A., Kingston, D. & Langbort, C. Multi-UAV Velocity and Trajectory Scheduling Strategies for Target Classification by a Single Human Operator. J Intell Robot Syst 70, 255–274 (2013). https://doi.org/10.1007/s10846-012-9701-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-012-9701-x