Abstract
We describe a new tracking and predicting scheme applied to a lab-made ping pong robot. The robot has a monocular vision system comprised of a camera and a light. We propose an optimized strategy to calibrate the light center using the least square method. An ellipse fitting method is used to precisely locate the center of ball and shadow on the captured image. After the triangulation of the ball position in the world coordinates, a tracking algorithm based on a Kalman filter outputs an accurate estimation of the flight states including the ball position and velocity. Furthermore, a neural network model is constructed and trained to predict the following flight path. Experimental results show that this scheme can achieve a good predicting precision and success rate of striking an incoming ball. The robot can achieve a success rate of about 80% to return a flight ball of 5 m/s to the opposite court.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Acosta, L., Rodrigo, J.J., Mendez, J.A., Marichal, G.N., Sigut, M., 2003. Ping-pong player prototype. IEEE Robot. Autom. Mag., 10(4):44–52. [doi:10.1109/MRA.2003.1256297]
Andersson, R.L., 1987. A Robot Ping-Pong Player: Experiment in Real-Time Intelligent Control. MIT Press, London, England.
Andersson, R.L., 1989. Dynamic sensing in a ping-pong playing robot. IEEE Trans. Robot. Autom., 5(6):728–739. [doi:10.1109/70.88095]
Basler, 2006. Camera Manual A600 Series Data Sheet. Available from http://www.graftek.com/pdf/Brochures/basler/A600fmanualNEW.pdf [Accessed on Dec. 1,2007].
Fassler, H., Beyer, H., Wen, J., 1990. A robot ping-pong player: optimized mechanics, high performance 3D vision, and intelligent sensor control. Robotersysteme, 6:161–170.
Forsyth, D.A., Ponce, J., 2002. Computer Vision: a Modern Approach. Prentice Hall, New Jersey, USA.
Gonzalez, R., Woods, R., Eddins, S., 2003. Digital Image Processing Using MATLAB. Prentice-Hall, New Jersey, USA.
Goodwill, S.R., Chin, S.B., Haake, S.J., 2004. Aerodynamics of spinning and non-spinning tennis balls. J. Wind Eng. Ind. Aerodyn., 92(11):935–958. [doi:10.1016/j.jweia.2004.05.004]
Haykin, S., 2001. Kalman Filtering and Neural Networks. Wiley, Chichester, UK.
Kalman, R.E., Bucy, R.S., 1961. New results in linear filtering and prediction theory. Trans. ASME Ser. D: J. Basic Eng., 83:95–107.
Kim, T., Seo, Y., Hong, K., 1998. Physics-Based 3D Position Analysis of a Soccer Ball from Monocular Image Sequences. 6th Int. Conf. on Computer Vision, p.721–726. [doi:10.1109/ICCV.1998.710797]
Matsushima, M., Hashimoto, T., Miyazaki, F., 2003. Learning to the Robot Table Tennis Task-Ball Control & Rally with a Human. IEEE Int. Conf. on Systems, Man and Cybernetics, p.2962–2969. [doi:10.1109/ICSMC.2003.1244342]
Matsushima, M., Hashimoto, T., Takeuchi, M., Miyazaki, F., 2005. A learning approach to robotic table tennis. IEEE Trans. Robot., 21(4):767–771. [doi:10.1109/TRO.2005.844689]
Miyamoto, H., Kawato, M., 1998. A tennis serve and upswing learning robot based on bi-directional theory. Neur. Networks, 11(7–8):1331–1344. [doi:10.1016/S0893-6080 (98)00062-8]
Miyazaki, F., Matsushima, M., Takeuchi, M., 2006. Learning to Dynamically Manipulate: a Table Tennis Robot Controls a Ball and Rallies with a Human Being. In: Advances in Robot Control. Springer Berlin Heidelberg, p.317–341. [doi:10.1007/978-3-540-37347-6_15]
Modi, K.P., Sahin, F., Saber, E., 2005. An Application of Human Robot Interaction: Development of a Ping-Pong Playing Robotic Arm. IEEE Int. Conf. on Systems, Man and Cybernetics, p.1831–1836. [doi:10.1109/ICSMC.2005.1571413]
Naghdy, F., Wyatt, J., Tran, S., 1994. A Transputer-Based Architecture for Control of a Robot Ping-Pong Player. In: Parallel Computing and Transputers. IOS Press, New York, p.311–317.
Ogata, K., 2001. Modern Control Engineering. Prentice Hall, New Jersey, USA, p.100–140.
Press, W., Teukolsky, S., Vetterling, W., Flannery, B., 1992. Numerical Recipes in C: the Art of Scientific Computing. Cambridge University Press, Cambridge.
Reid, I., North, A., 1998. 3D Trajectories from a Single Viewpoint Using Shadows. The British Machine Vision Conf., p.863–872.
Resnick, R., Halliday, D., Krane, K.S., 2002. Physics. John Wiley & Sons, Singapore.
Rusdorf, S., Brunnett, G., Lorenz, M., Winkler, T., 2007. Realtime interaction with a humanoid avatar in an immersive table tennis simulation. IEEE Trans. Visual. Comput. Graph., 13(1):15–25. [doi:10.1109/TVCG.2007.18]
TOSY, 2008. Citing Electronic Sources of Information. TOSY Robotics JSC. Available from http://www.tosy.com/ [Accessed on Dec. 12, 2009].
White, F.M., 2002. Fluid Mechanics. McGraw-Hill, New York, USA.
Zhang, Y.H., 2009. Citing Electronic Sources of Information. Personal Website of Ping-Pong Robot. Available from https://sites.google.com/site/pprobot/home [Accessed on Dec. 1, 2009].
Zhang, Z., 2000. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell., 22(11): 1330–1334. [doi:10.1109/34.888718]10.1631/jzus.C1010042
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National High-Tech Research and Development Program (863) of China (No. 2008AA042602) and the Fundamental Research Funds for the Central Universities of China (No. KYJD09035)
Rights and permissions
About this article
Cite this article
Zhang, Yh., Wei, W., Yu, D. et al. A tracking and predicting scheme for ping pong robot. J. Zhejiang Univ. - Sci. C 12, 110–115 (2011). https://doi.org/10.1631/jzus.C0910528
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.C0910528