Abstract
In this paper, we focus on the problem of learning reactive skills for use by physical agents. We propose a new representation for such procedures, teleoreactive logic programs, along with an interpreter that utilizes them to achieve goals. After this, we describe a learning method that acquires these structures in a cumulative manner through problem solving. We report experiments in three domains that involve multiple levels of skilled behavior. We also review related work and discuss directions for future research.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Benson, S.: Induction learning of reactive action models. In: Proceedings of the Twelfth International Conference on Machine Learning, pp. 47–54. Morgan Kaufmann, San Francisco (1995)
Choi, D., Kaufman, M., Langley, P., Nejati, N., Shapiro, D.: An architecture for persistent reactive behavior. In: Proceedings of the Third International Joint Conference on Autonomous Agents and Multi Agent Systems, pp. 988–995. ACM Press, New York (2004)
Erol, K., Hendler, J., Nau, D.S.: HTN planning: Complexity and expressivity. In: Proceedings of the Twelfth National Conference on Artificial Intelligence, pp. 1123–1128. MIT Press, Seattle (1994)
Estlin, T.A., Mooney, R.J.: Learning to improve both efficiency and quality of planning. In: Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, Nagoya, Japan, pp. 1227–1232 (1997)
Fern, A., Yoon, S.W., Givan, R.: Learning domain-specific control knowledge from random walks. In: Proceedings of the Fourteenth International Conference on Automated Planning and Scheduling, pp. 191–199. AAAI Press, Whistler (2004)
Iba, G.A.: A heuristic approach to the discovery of macro-operators. Machine Learning 3, 285–317 (1989)
Laird, J.E., Rosenbloom, P.S., Newell, A.: Chunking in Soar: The anatomy of a general learning mechanism. Machine Learning 1, 11–46 (1986)
Minton, S.N.: Quantitative results concerning the utility of explanation-based learning. Artificial Intelligence 42, 363–391 (1990)
Mooney, R.J.: The effect of rule use on the utility of explanation-based learning. In: Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, pp. 725–730. Morgan Kaufmann, Detroit (1989)
Newell, A., Shaw, J.C., Simon, H.A.: Report on a general problem-solving program for a computer. Information Processing. In: Proceedings of the International Conference on Information Processing, UNESCO House, Paris, pp. 256–264 (1960)
Nilsson, N.: Teleoreactive programs for agent control. Journal of Artificial Intelligence Research 1, 139–158 (1994)
Reddy, C., Tadepalli, P.: Learning goal-decomposition rules using exercises. In: Proceedings of the Fourteenth International Conference on Machine Learning, pp. 278–286. Morgan Kaufmann, San Francisco (1997)
Ruby, D., Kibler, D.: SteppingStone: An empirical and analytical evaluation. In: Proceedings of the Tenth National Conference on Artificial Intelligence, pp. 527–532. AAAI Press, Menlo Park (1991)
Sammut, C.: Automatic construction of reactive control systems using symbolic machine learning. Knowledge Engineering Review 11, 27–42 (1996)
Sammut, C., Banerji, R.B.: Learning concepts by asking questions. In: Michalski, R.S., Carbonell, J.G., Mitchell, T.M. (eds.) Machine learning: An artificial intelligence approach, vol. 2, Morgan Kaufmann, Los Altos (1986)
Shavlik, J.W.: Acquiring recursive concepts with explanation-based learning. In: Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, pp. 688–693. Morgan Kaufmann, Detroit (1989)
Stone, P., Veloso, M.M.: Layered learning. In: Proceedings of the Eleventh European Conference on Machine Learning, pp. 369–381. Springer, Barcelona (2000)
Sutton, R.S., Barto, A.G.: Reinforcement learning. MIT Press, Cambridge (1998)
Utgoff, P., Stracuzzi, D.: Many-layered learning. In: Proceedings of the Second International Conference on Development and Learning, pp. 141–146 (2002)
Zelle, J.M., Mooney, R.J.: Combining FOIL and EBG to speed up logic programs. In: Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, pp. 1106–1111. Morgan Kaufmann, Chambery (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Choi, D., Langley, P. (2005). Learning Teleoreactive Logic Programs from Problem Solving. In: Kramer, S., Pfahringer, B. (eds) Inductive Logic Programming. ILP 2005. Lecture Notes in Computer Science(), vol 3625. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11536314_4
Download citation
DOI: https://doi.org/10.1007/11536314_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28177-1
Online ISBN: 978-3-540-31851-4
eBook Packages: Computer ScienceComputer Science (R0)