Abstract
Robot hand-eye coordination has recently enjoyed much attention. Previous research at MIT has examined combining vision and manipulation applied to the task of tracking and catching tossed balls in controlled environments. Building upon the foundations of this past research, this paper presents work which incorporates a new active vision system which requires a minimally controlled environment, and implements methods for object tracking, robot/camera calibration, and new catching algorithms. Experimental results for real time catching of free-flying spherical balls are presented. The system was tested on under-hand tosses from random locations approximately 1.5–2.5 meters distant from the base of the arm. The best performance results were found to be 70–80% success for similar tosses.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
J. K. Salisbury, Whole Arm Manipulation, Proc. 4th Int. Symposium on Robotics Research, Santa Cruz, CA, August, 1987.
J. K. Salisbury, W. T. Townsend, B. S. Eberman, D. M. DiPietro, Preliminary Design of a Whole-Arm Manipulation System (WAM), Proc. 1988 IEEE Int. Conf. on Robotics and Automation, Philadelphia, PA, April 1988.
W. T. Townsend, The Effect of Transmission Design on Force-Controlled Manipulator Performance, PhD Thesis, Department of Mechanical Engineering, MIT, April 1988. (See also MIT AI Lab Technical Report 1054).
N. Swarup, Design and Control of a Two-Axis Gimbal System for Use in Active Vision, S.B. Thesis, Department of Mechanical Engineering, MIT, Cambridge, MA, 1993.
J. Billingsley, Robot ping pong, Practical Computing, May 1983.
H. Fässler, H. A. Beyer, and J. Wen, A robot ping pong player: optimized mechanics, high performance 3D vision, and intelligent sensor control, Robotersysteme 6, Springer-Verlag, pp. 161–170, 1990.
R. L. Andersson, A robot ping-pong player: Experiment in real time control, MIT Press, Cambridge, MA, 1987.
E. Aboaf, S. Drucker, and C. Atkeson, Task-level robot learning: juggling a tennis ball more accurately, Proc. IEEE Int. Conf. on Robotics and Automation, pp. 1290–1295, Scottsdale, AZ, May 1989.
A. A. Rizzi and D. E. Koditschek, Further progress in robot juggling: Solvable mirror laws, Int. Conf. on Robotics and Automation, pp. 2935–2940, 1994.
Promising Directions in Active Vision, NSF Active Vision Workshop, University of Chicago, August 5–7, 1991, in Int. Journal of Computer Vision, Vol. 11:2, pp. 109–126, 1993.
J. C. Fiala, R. Lumia, K. J. Roberts, and A. J. Wavering, National Institute of Standards and Technology, TRICLOPs: A Tool for Studying Active Vision, Int. Journal of Computer Vision, Vol. 12:2/3, pp. 231–250, 1994.
A. J. Wavering and R. Lumia, Predictive Visual Tracking, SPIE Volume 2056, Intelligent Robots and Computer Vision XII, 1993.
H. K. Nishihara, H. J. Thomas, Real-Time Tracking of People Using Stereo and Motion, IS&T/SPIE Symposium on Electronic Imaging: Science & Technology, San Jose, California, February 6–10, 1994.
B. M. Hove and J.-J. E. Slotine, Experiments in Robotic Catching, Proc. of the 1991 American Control Conf. Vol. 1, Boston, MA, pp. 380–385, June 1991.
H. Kimura, N. Mukai, and J.-J. E. Slotine, Adaptive Visual Tracking and Gaussian Network Algorithms for Robotic Catching, DSC-Vol. 43, Advances in Robust and Nonlinear Control Systems, Winter Annual Meeting of the ASME, Anaheim, CA, pp. 67–74, November 1992.
H. Kimura, Adaptive Visual Tracking Algorithms for 3-D Robotic Catching, M.S. Thesis, Department of Mechanical Engineering, MIT, Cambridge, MA, August 1992.
W. Hong, Robotic Catching and Manipulation Using Active Vision, M.S. Thesis, Department of Mechanical Engineering, MIT, Cambridge, MA, August 1995.
J.-J. E. Slotine and W. Li, Applied Nonlinear Control, Prentice Hall, Englewood Cliffs, New Jersey, 1991.
A. Wright, A high speed low-latency portable vision sensing system, SPIE, September 1993.
B. K. P. Horn, Robot Vision, MIT Press, Cambridge, MA, 1986.
G. Niemeyer and J.-J. E. Slotine, Performance in Adaptive Manipulator Control, December 1988, Int. Journal of Robotics Research, 10(2).
M. Cannon and J.-J.E. Slotine, Space Frequency Localized Basis Function Networks for Nonlinear System Estimation and Control, Neurocomputing, 9(3), 1995.
I. Watanabe and J.-J.E. Slotine, Stable real-time prediction of the trajectories of light objects in air using wavelet networks, MIT-NSL 100195, 1995.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag London Limited
About this paper
Cite this paper
Hong, W., Slotine, JJ.E. (1997). Experiments in hand-eye coordination using active vision. In: Khatib, O., Salisbury, J.K. (eds) Experimental Robotics IV. Lecture Notes in Control and Information Sciences, vol 223. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0035204
Download citation
DOI: https://doi.org/10.1007/BFb0035204
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76133-4
Online ISBN: 978-3-540-40942-7
eBook Packages: Springer Book Archive