Abstract
In this paper we present a method to obtain a near optimal neuro-controller for the autonomous helicopter flight by means of an ad hoc evolutionary reinforcement learning method. The method presented here was developed for the Second Annual Reinforcement Learning Competition (RL2008) held in Helsinki-Finland. The present work uses a Helicopter Hovering simulator created in the Stanford University that simulates a Radio Control XCell Tempest helicopter in the flight regime close to hover. The objective of the controller is to hover the helicopter by manipulating four continuous control actions based on a 12-dimensional state space.
This work has been partially funded by the Spanish Ministry of Science and Technology, project DPI2006-15346-C03-02.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
de Lope Asiaín, J., Martín, J.J.S., José Antonio Martin, H.: Helicopter flight dynamics using soft computing models. In: Moreno Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds.) EUROCAST 2007. LNCS, vol. 4739, pp. 621–628. Springer, Heidelberg (2007)
Moriarty, D.E., Schultz, A.C., Grefenstette, J.J.: Reinforcement learning through evolutionary computation (1999)
Koppejan, R., Whiteson, S.: Neuroevolutionary reinforcement learning for generalized helicopter control. In: GECCO 2009: Proceedings of the Genetic and Evolutionary Computation Conference (to appear, July 2009)
Ng, A.Y., Kim, H.J., Jordan, M.I., Sastry, S.: Autonomous helicopter flight via reinforcement learning. In: Thrun, S., Saul, L.K., Schölkopf, B. (eds.) NIPS. MIT Press, Cambridge (2003)
Jose Antonio Martin, H., de Lope, J., Santos, M.: Evolution of neuro-controllers for multi-link robots. In: Innovations in Hybrid Intelligent Systems. Advances in Soft Computing, vol. 44, pp. 175–182 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Martín H., J.A., de Lope, J. (2009). Learning Autonomous Helicopter Flight with Evolutionary Reinforcement Learning. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory - EUROCAST 2009. EUROCAST 2009. Lecture Notes in Computer Science, vol 5717. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04772-5_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-04772-5_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04771-8
Online ISBN: 978-3-642-04772-5
eBook Packages: Computer ScienceComputer Science (R0)