Abstract
Recently, a lot of attention is paid to the use of evolutionary computing techniques for the development of adaptive robots. This paper presents the use of Cultural Algorithms with Evolution Strategies (ES) to produce optimal solutions to the ball following problem. This involves learning how to find and advance toward a ball. This is a basic skill needed to play robot soccer. Since it is possible that both the ball and the robot can be moving simultaneously this can be a difficult problem to solve. Four different solutions are implemented here. The first is the two member ES with comma strategy, (1,1)-ES. The second is the ES with plus strategy, (1+1)-ES. The third is a cultured version of the (1,1)-ES. The fourth is a cultured version of the (1+1)-ES. In cultural versions, the ES model is the population model for a Cultural Algorithm. The belief space contains generalizations about the individual's ancestral line, e.g. grandparents, in order to guide the modifications. Each of the four systems was tested by loading it into the RAM of a Khpera robot. Each system was then used to learn how to control the direction and speed of the two Khepera robot's wheels in order to direct it to a given ball. The real-time learning results are then compared. The results suggest that simple Evolution Strategies implemented here exhibit a satisfactory level of real-time learning in forwarding and pushing the ball. The cultured version exhibits an improvement in time over this performance as well.
Preview
Unable to display preview. Download preview PDF.
Reference
Takashi Gomi and Ann Griffith, “Evolutionary Robotics — An Overview,” In Proceedings of IEEE International Conference on Evolutionary Computation. IEEE Press, 1996, pp. 40–49.
Henrik Hautop Lund, John Hallam, and Wei-Po Lee. “Evolving Robot Morphology,” In Proceedings of IEEE 4th International Conference on Evolutionary Computation. IEEE Press, 1997, pp. 197–202.
Henrik Hautop Lund and John Hallam, “Evolving Sufficient Robot Controllers,” In Proceedings of IEEE 4th International Conference on Evolutionary Computation. IEEE Press, 1997, pp. 495–500.
Francesco Mondada, Edoardo Franzi, and Paolo Ienne, “Mobile robot miniaturization: A tool for investigation in control algorithms,” in proceedings of the 3rd International Symposium on Experimental Robotics, Kyoto, Japan, Oct. 28–30, 1993, Springer Verlag, London, pp501–513.
Thomas Bäck, Evolutionary Algorithms in Theory and Practice, Oxford University Press, New York, 1996.
Thomas Bäck, U. Hammel, and Hans-Paul Schwefel, “Evolutionary Computation: History and Current State,” IEEE transactions on Evolutionary Computation, 1(1), pp. 3–17, 1997
ChanJin Chung and Robert G. Reynolds, “Function Optimization Using Evolutionary Programming with Self-Adaptive Cultural Algorithms,” in Simulated Evolution and Learning, Selected Papers, Lecture Notes in Artificial Intelligence — 1285, Xin Yao and Jong-Hwan Kim (Editors), Springer-Verlag 1996, pp. 17–26
Chan-Jin Chung, Knowledge-Based Approaches to Self-Adaptation in Cultural Algorithms, Ph.D. thesis, Wayne State University, May 1997
David B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, IEEE Press, Piscataway, NJ, 1995
David B. Fogel, “Using Fitness Distributions to Design More Efficient Evolutionary Computations,” in Proceedings of 1996 IEEE International Conference on Evolutionary Computation (ICEC'96), pp. 11–19.
J.-H Kim, J.Y. Jeon, H.K. Chae, and K.I. Koh, “A novel Evolutionary Algorithm with Fast Convergence,” in Proceedings of 1995 IEEE International Conference on Evolutionary Computation (ICEC'95), 1995, pp. 819–824
Robert G. Reynolds, “An Introduction to Cultural Algorithms,” in Proceedings of the 3rd Annual Conference on Evolutionary Programming, Sebald, A.V.; Fogel, L.J. (Editors), River Edge, NJ, World Scientific Publishing, 1994, pp. 131–139.
H.-P. Schwefel, Numerical Optimization of Computer Models John Wiley, Chichester, UK, 1981
Hans-Paul Schwefel, Evolution and Optimum Seeking, John Wiley & Sons, Inc., 1995
Khepera User Manual, Version 4.09, K-Team S. A., Lausanne Switzerland, Nov. 1995
Khepera K213 Vision Turret User Manual, Version 1.0, K-Team S.A., Lausanne Switzerland, Nov. 1995
Nils J. Nilsson, Principles of Artificial Intelligence, Tioga Publishing Co., Palo Alto, CA, 1980.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chung, CJ., Reynolds, R.G. (1998). Culturing evolution strategies to support the exploration of novel environments by an intelligent robotic agent. In: Porto, V.W., Saravanan, N., Waagen, D., Eiben, A.E. (eds) Evolutionary Programming VII. EP 1998. Lecture Notes in Computer Science, vol 1447. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0040775
Download citation
DOI: https://doi.org/10.1007/BFb0040775
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64891-8
Online ISBN: 978-3-540-68515-9
eBook Packages: Springer Book Archive