Abstract
We introduce and study the problem of planning a trajectory for an agent to carry out a scouting mission while avoiding being detected by an adversarial opponent. This introduces a multi-objective version of classical visibility-based target search and pursuit-evasion problem. In our formulation, the agent receives a positive reward for increasing its visibility (by exploring new regions) and a negative penalty every time it is detected by the opponent. The objective is to find a finite-horizon path for the agent that balances the trade off between maximizing visibility and minimizing detectability. We model this problem as a discrete, sequential, two-player, zero-sum game. We use two types of game tree search algorithms to solve this problem: minimax search tree and Monte-Carlo search tree. Both search trees can yield the optimal policy but may require possibly exponential computational time and space. We first propose three pruning techniques to reduce the computational time while preserving optimality guarantees. When the agent and the opponent are located far from each other initially, we present a variable resolution technique with longer planning horizon to further reduce computational time. Simulation results show the effectiveness of the proposed strategies in terms of computational time.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Here, more informative indicates that the value backpropagated from the current node’s successor will be greater than the value backpropagated from the path of another node that contains the same agent and opponent’s position.
References
Baier, H., & Winands, M. H. (2013). “Monte-carlo tree search and minimax hybrids,” in Computational Intelligence in Games (CIG). IEEE Conference on, 2013, 1–8.
Bhadauria, D., & Isler, V. (2011). Capturing an evader in a polygonal environment with obstacles. IJCAI, 22, 2054–2059.
Bopardikar, S. D., Bullo, F., & Hespanha, J. P. (2007) . “Sensing limitations in the lion and man problem,” in American Control Conference,. (2007). ACC’07. IEEE, 2007, 5958–5963.
Carlsson, S., & Nilsson, B. J. (1999). Computing vision points in polygons. Algorithmica, 24(1), 50–75.
Chaslot, G., Bakkes, S., Szita, I., & Spronck, P. (2008) . “Monte-carlo tree search: A new framework for game ai.” in AIIDE
Gelly, S., & Wang, Y. (2006) . “Exploration exploitation in go: Uct for monte-carlo go,” in NIPS: Neural Information Processing Systems Conference On-line trading of Exploration and Exploitation Workshop
Hollinger, G., Singh, S., Djugash, J., & Kehagias, A. (2009). Efficient multi-robot search for a moving target. The International Journal of Robotics Research, 28(2), 201–219.
Hrabar, S. (2008) . “3d path planning and stereo-based obstacle avoidance for rotorcraft uavs,” in 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, pp. 807–814.
Jin, S., & Qu, Z. (2011) . “A heuristic task scheduling for multi-pursuer multi-evader games,” in Information and Automation (ICIA), 2011 IEEE International Conference on. IEEE, pp. 528–533.
Karaman, S., & Frazzoli, E. (2010). Incremental sampling-based algorithms for a class of pursuit-evasion games (pp. 71–87). NY: Algorithmic foundations of robotics IX Springer.
Kavraki, L. E., Kolountzakis, M. N., & Latombe, J.-C. (1996) . “Analysis of probabilistic roadmaps for path planning,” in Robotics and Automation, 1996. Proceedings., 1996 IEEE International Conference on, vol. 4. IEEE, pp. 3020–3025.
Kim, A., & Eustice, R. M. (2015). Active visual slam for robotic area coverage: Theory and experiment. The International Journal of Robotics Research, 34(4–5), 457–475.
Knuth, D. E., & Moore, R. W. (1975). An analysis of alpha-beta pruning. Artificial intelligence, 6(4), 293–326.
Kocsis, L., & Szepesvári, C. (2006) . “Bandit based monte-carlo planning,” in European conference on machine learning. Springer, pp. 282–293.
Koenig, N., & Howard, A. (2004) . “Design and use paradigms for gazebo, an open-source multi-robot simulator,” in Intelligent Robots and Systems, 2004.(IROS 2004). Proceedings. 2004 IEEE/RSJ International Conference on, vol. 3.IEEE, pp. 2149–2154.
LaValle, S. M. (2006). Planning algorithms. Cambridge: Cambridge University Press.
Lisy, V., Kovarik, V., Lanctot, M., & Bosansky, B. (2013). Convergence of monte carlo tree search in simultaneous move games. Advances in Neural Information Processing Systems, 26, 2112–2120.
Macias, V., Becerra, I., Murrieta-Cid, R., Becerra, H., & Hutchinson, S. (2018). Image feedback based optimal control and the value of information in a differential game. Automatica, 90, 271–285.
Obermeyer, K. J. and Contributors, “The visilibity library,” https://karlobermeyer.github.io/VisiLibity1/.
O’rourke, J. (1987). Art gallery theorems and algorithms. Oxford: Oxford University Press.
Peng, C.,&Isler, V. (2017) . “View selection with geometric uncertainty modeling,” arXiv preprint arXiv:1704.00085
Quattrini Li, A., Fioratto, R., Amigoni, F., & Isler, V. (2018) . “A search-based approach to solve pursuit-evasion games with limited visibility in polygonal environments,” in Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems, pp. 1693–1701.
Raboin, E., Kuter, U., & Nau, D. (2012) . “Generating strategies for multi-agent pursuit-evasion games in partially observable euclidean space,” in Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems-Volume 3, pp. 1201–1202.
Raboin, E., Nau, D. S., Kuter, U., Gupta, S. K., & Svec, P. (2010). Strategy generation in multi-agent imperfect-information pursuit games. AAMAS, 32, 947–954.
Russell, S., & Norvig, P. (2009). Artificial intelligence: A modern approach. NJ: Prentice Hall Press.
Russell, S. J., & Norvig, P. (2016). Artificial intelligence: A modern approach. Malaysia: Pearson Education Limited.
Stiffler, N. M., & OKane, J. M. (2017). Complete and optimal visibility-based pursuit-evasion. The International Journal of Robotics Research, 36(8), 923–946.
Surynek, P. (2009) . “A novel approach to path planning for multiple robots in bi-connected graphs,” in 2009 IEEE International Conference on Robotics and Automation. IEEE, pp. 3613–3619.
Tokekar, P., & Kumar, V. (2015) . “Visibility-based persistent monitoring with robot teams,” in Intelligent Robots and Systems (IROS), 2015 IEEE/RSJ International Conference on. IEEE, pp. 3387–3394.
Zhang, Z., & Tokekar, P. (2016) . “Non-myopic target tracking strategies for non-linear systems,” in Decision and Control (CDC), 2016 IEEE 55th Conference on. IEEE, pp. 5591–5596.
Zhang, Z., Lee, J., Smereka, J. M., Sung, Y., Zhou, L., & Tokekar, P. (2019) . “Tree search techniques for minimizing detectability and maximizing visibility,” in 2019 International Conference on Robotics and Automation (ICRA). IEEE, pp. 8791–8797.
Zhou, L., Tzoumas, V., Pappas, G. J., & Tokekar, P. (2018). Resilient active target tracking with multiple robots. IEEE Robotics and Automation Letters, 4(1), 129–136.
Acknowledgements
This research was supported in part by the Automotive Research Center (ARC) at the University of Michigan, with funding and support by the Department of Defense under Contract No. W56HZV-14-2-0001.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Distribution A: Approved for public release; distribution unlimited. OPSEC # 3929.
Supplementary Information
Below is the link to the electronic supplementary material.
Supplementary material 1 (mp4 29173 KB)
Rights and permissions
About this article
Cite this article
Zhang, Z., Smereka, J.M., Lee, J. et al. Game tree search for minimizing detectability and maximizing visibility. Auton Robot 45, 283–297 (2021). https://doi.org/10.1007/s10514-020-09963-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10514-020-09963-4