Abstract
In highly dynamic environments with uncertainty the elaboration of long or rigid plans is useless because the constructed plans are frequently dismissed by the arrival or new unexpected situations; in these cases, a “second-best” plan could rescue the situation. We present a new real-time planning method where we take into consideration the number and quality of future options of the next action to choose, in contrast to most planning methods that just take into account the intrinsic value of the chosen plan or the maximum valued future option. We apply our method to the Robocup simulated soccer competition, which is indeed highly dynamic and involves uncertainty. We propose a specific architecture for implementing this method in the context of a player agent in the Robocup competition, and we present experimental evidence showing the potential of our method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allen, J., Hendler, J., Tate, A.: Readings in Planning. Representation and Reasoning Series. Morgan Kaufmann, San Mateo (1990)
Bowling, M., Browning, B., Veloso, M.: Plays as effective multiagent plans enabling opponent-adaptive play selection. In: Proceedings of International Conference on Automated Planning and Scheduling, ICAPS 2004 (2004)
Chen, M., Dorer, K., Foroughi, E., Heintz, F., Huang, Z., Kapetanakis, S., Kostiadis, K., Kummeneje, J., Murray, J., Noda, I., Obst, O., Riley, P., Steffens, T., Wang, Y., Yin, X.: Users manual: Robocup soccer server (for soccerserver version 7.07 and later)
de Boer, R., Kok, J.: The incremental development of a synthetic multi-agent system: The uva trilearn (2001)
Farahany, A., Rokooey, M., Salehe, M., Vosoughpour, M.: Mersad 2004 team description (2004)
Frank, I., Tanaka-Ishii, K., Arai, K., Matsubara, H.: The statistics proxy server. In: Stone, P., Balch, T., Kraetszchmar, G. (eds.) RoboCup-2000: Robot Soccer World Cup IV, pp. 303–308. Springer, Berlin (2001)
Garrido, L., Brena, R., Sycara, K.: Towards modeling other agents: A simulation-based study. In: Sichman, J.S., Conte, R., Gilbert, N. (eds.) MABS 1998. LNCS (LNAI), vol. 1534, pp. 210–225. Springer, Heidelberg (1998)
Getoor, L., Ottosson, G., Fromherz, M., Carlson, B.: Effective redundant constraints for online scheduling. In: Proceedings of the 14th National Conference on Artificial Intelligence (AAAI 1997), Providence, Rhode Island, July 1997, pp. 302–307. AAAI Press / MIT Press, Menlo Park (1997)
Groen, F., Spaan, M., Vlassis, N.: Robot soccer: Game or science. In: Proceedings CNR 2002, Editura Universitaria Craiova (October 2002)
Koenig, S.: Agent-centered search. AI Magazine 22(4), 109–131 (2001)
Kok, J., Spaan, M., Vlassis, N.: Non-communicative multi-robot coordination in dynamic environments. Robotics and Autonomous Systems 50(2-3), 99–114 (2005)
Martinez, E., Brena, R.: Simultaneous planning: A real-time planning method. Research on Computer Science 13, 3–11 (2005)
Martinez, E.: A real-time planning method for Robocup (in spanish). Master’s thesis, Tecnologico de Monterrey, Mexico (2005)
Riley, P., Veloso, M.: On behavior classification in adversarial environments. In: Parker, L.E., Bekey, G., Barhen, J. (eds.) Distributed Autonomous Robotic Systems 4, pp. 371–380. Springer, Heidelberg (2000)
Riley, P., Veloso, M.: Planning for distributed execution through use of probabilistic opponent models. In: IJCAI-2001 Workshop PRO-2: Planning under Uncertainty and Incomplete Information (2001)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn. Prentice-Hall, Englewood Cliffs (2003)
Stone, P.: Layered learning in multiagent systems. In: AAAI/IAAI, p. 819 (1997)
Stone, P., Veloso, M.: Using decision tree confidence factors for multiagent control. In: Sycara, K.P., Wooldridge, M. (eds.) Proceedings of the 2nd International Conference on Autonomous Agents (Agents 1998), 1998, pp. 9–13. ACM Press, New York (1998)
Stone, P., Veloso, M.M.: Multiagent systems: A survey from a machine learning perspective. Autonomous Robots 8(3), 345–383 (2000)
Zweben, M., Fox, M.S.: Intelligent Scheduling. Morgan Kaufmann, San Francisco (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brena, R.F., Martinez, E. (2005). Maximizing Future Options: An On-Line Real-Time Planning Method. In: Gelbukh, A., de Albornoz, Á., Terashima-Marín, H. (eds) MICAI 2005: Advances in Artificial Intelligence. MICAI 2005. Lecture Notes in Computer Science(), vol 3789. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11579427_99
Download citation
DOI: https://doi.org/10.1007/11579427_99
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29896-0
Online ISBN: 978-3-540-31653-4
eBook Packages: Computer ScienceComputer Science (R0)