Xinguo Yu
ABSTRACT
The ability to acquire the accurate camera matrix of each frame of a video clip is essential if virtual content is inserted into the images in a believable way. This paper presents our system for inserting projected virtual content into broadcast tennis video based on camera matrix acquired. To achieve the accurate camera matrix, we develop a new algorithm for the 3D camera calibration of broadcast tennis video, which improves the accuracy of camera matrices via the proposed techniques of clip-wise data analysis and Hough-like search. We divide all the camera parameters determining a camera matrix into two categories: clip-varying and frame-varying. For the clip-varying ones, we use a clip-wise data analysis procedure to achieve their accuracy. For the framevarying ones, we use a Hough-like search to tune them for each frame. Preliminary experiments results show that we can seamlessly insert projected virtual content into each frame.
- D. Farin, S. Krabbe, P. H. N. de With, and W. Effelsberg. Robust camera calibration for sport videos using court models. SPIE Storage & Retr. M. & App. for MM, vol 5307, pp80--91, 2004.Google Scholar
- S. Gibson, J. Cook, T. Howard, R. Hubbold, and D. Oram. Accurate camera calibration for off-line, video-based augmented reality, ISMAR 2002, pp. 37--46. Google ScholarDigital Library
- J. R. Gloundemans, et al. Blending a graphic, US paten: 6,229,550 (From Sportsvision Inc, US).Google Scholar
- R. Hartley and A. Zisserman, Multiple view geometry in computer vision, Cambridge U. Press 2003 (2rd edition), UK. Google ScholarDigital Library
- I. D. Reid and A. Zisserman. Goal-directed video metrology, Proc. of 4th ECCV, vol. II, pp 647--658, 1996. Google ScholarDigital Library
- R. Y. Tsai. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the shelf TV cameras and lenses, IEEE J. of Robotics and Automation, vol. RA-3, No. 4, Aug 1987, pp 323--344.Google ScholarCross Ref
- K. Wan, X. Yan, X. Yu, and C. Xu. Robust goal-mouth detection for virtual content insertion, ACM MM 2003, pp.468--469 Google ScholarDigital Library
- X. Yu, C. H. Sim, J. R. Wang, and F. C. Loong. A trajectory-based ball detection and tracking algorithm in broadcast tennis video. ICIP04, pp1049--1052, 2004.Google Scholar
- http://www.orad.co.ilGoogle Scholar
- http://www.sportvision.comGoogle Scholar
- http://www.hawkeyeinnovations.co.uk.Google Scholar
Index Terms
- Inserting 3D projected virtual content into broadcast tennis video
Recommendations
A system for 3D projected virtual content insertion into broadcast tennis video
MM '06: Proceedings of the 14th ACM international conference on MultimediaThis demonstration presents our system for inserting projected virtual content into broadcast tennis video based on camera matrix acquired. This system can automatically acquire the accurate camera matrix for each frame with the tennis court and insert ...
Automatic camera calibration of broadcast tennis video with applications to 3D virtual content insertion and ball detection and tracking
This paper presents an original algorithm to automatically acquire accurate camera calibration from broadcast tennis video (BTV) as well as demonstrates two of its many applications. Accurate camera calibration from BTV is challenging because the frame-...
Geometric and Color Calibration of Multiview Panoramic Cameras for Life-Size 3D Immersive Video
3DV '13: Proceedings of the 2013 International Conference on 3D VisionIn this paper we address calibration of camera arrays for life-size 3D video acquisition and display where mosaicking and multiviewpoint stereo are combined to provide an immersive experience which, by its size, resolution, and three-dimensionality, is ...
Comments