Abstract
We present a solution for robotic docking, i.e. the approach of a robot toward a table so that it can grasp an object. One constraint is that our PeopleBot robot has a short non-extendable gripper and wide “shoulders”. Therefore it must approach the table at a perpendicular angle so that the gripper can reach over it. Another constraint is the use of vision to locate the object. Only the angle is supplied as additional input.
We present a solution based solely on neural networks: object recognition and localisation is trained, motivated by insights from the lower visual system. Based on the hereby obtained perceived location, we train a value function unit and four motor units via reinforcement learning. After training the robot can approach the table at the correct position and in a perpendicular angle. This is to be used as part of a bigger system where the robot acts according to verbal instructions based on multi-modal neuronal representations as found in language and motor cortex (mirror neurons).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
N. Barnes and G. Sandini. Direction control for an active docking behaviour based on the rotational component of log-polar optic flow. In ECCV2000 — Proc. European Conference on Computer Vision, Vol. 2, pages 167–181, 2000.
M. Becker, E. Kefalea, E. Mal, C. von der Malsburg, M. Pagel, J. Triesch, J.C. Vorbrggen, R.P. Wrtz, and S. Zadel. Gripsee: A gesture-controlled robot for object perception and manipulation. Autonomous Robots, 6:203–221, 1999.
P. Dayan, G. E. Hinton, R. Neal, and R. S. Zemel. The Helmholtz machine. Neur. Comp., 7:1022–1037, 1995.
D.J. Foster, R.G.M. Morris, and P. Dayan. A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus, 10:1–16, 2000.
V. Gallese, L. Fadiga, L. Fogassi, and G. Rizzolatti. Action recognition in the premotor cortex. Brain, 119:593–609, 1996.
H.M. Gross, V. Stephan, and M. Krabbes. A neural field approach to topological reinforcement learning in continuous action spaces. In Proc. of WCCI-IJCNN, 1998.
G. E. Hinton, P. Dayan, B. J. Frey, and R. Neal. The wake-sleep algorithm for unsupervised neural networks. Science, 268:1158–1161, 1995.
A. Namiki, Y. Nakabo, I. Ishii, and M. Ishikawa. High speed grasping using visual and force feedback. In Proc. IEEE Int. Conf. on Robotics and Automation (Detroit), 1999.
H. Ritter, J. Steil, Noelker C., Roethling F., and P. McGuire. Neural architectures for robotic intelligence. Rev. Neurosci., 2003.
M.C. Silverman, D. Nies, B. Jung, and G.S. Sukhatme. Staying alive: A docking station for autonomous robot recharging. In Proc. IEEE Int. Conf. on Robotics and Automation, 2002.
J. Spofford, J. Blitch, W. Klarquist, and R. Murphy. Vision-guided heterogeneous mobile robot docking. In Sensor Fusion and Decentralized Control in Robotic Systems II, 1999.
C. Weber. Self-organization of orientation maps, lateral connections, and dynamic receptive fields in the primary visual cortex. In G. Dorffner, H. Bischof, and K. Hornik, editors, Proc. ICANN, pages 1147–1152. Springer-Verlag Berlin Heidelberg, 2001.
C. Weber and S. Wermter. Object localization using laterally connected “what” and “where” associator networks. In Proc. ICANN, page in press. Springer-Verlag Berlin Heidelberg, 2003.
M. Williamson, R. Murray-Smith, and V. Hansen. Robot docking using mixtures of gaussians. In Advances in Neural Information Processing Systems 11, pages 945–951, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag London Limited
About this paper
Cite this paper
Weber, C., Wermter, S., Zochios, A. (2004). Robot Docking with Neural Vision and Reinforcement. In: Bramer, M., Ellis, R., Macintosh, A. (eds) Applications and Innovations in Intelligent Systems XI. SGAI 2003. Springer, London. https://doi.org/10.1007/978-1-4471-0643-2_15
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0643-2_15
Publisher Name: Springer, London
Print ISBN: 978-1-85233-779-7
Online ISBN: 978-1-4471-0643-2
eBook Packages: Springer Book Archive