Abstract
Tracking the head and hand in real-time are important tasks for developing an intuitive interaction system. We present a system for robust probabilistic tracking that integrates face detection, face and hand color tracking and foot tracking in a uniform way by using particle filters. The advantages of different cues like motion, color and face detection are combined to yield robust 2D and 3D position estimates in spite of difficult varying lighting conditions and cluttered background. The system enables a user to navigate in the virtual scene by walking around and pointing towards objects by a simple hand gesture. The environment is a 3-sided CAVE with 1-sided stereo back projection.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Argyros, A.A., Lourakis, M.I.A.: Real-time tracking of multiple skin-colored objects with a possibly moving camera. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 368–379. Springer, Heidelberg (2004)
Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Transactions on Signal Processing 50(2), 174–188 (2002)
Grest, D., Frahm, J.-M., Koch, R.: A color similarity measure for robust shadow removal in real time. In: Proc. of VMV, Munich, Germany (November 2003)
Gross, M., et al.: blue-c: A spatially immersive display and 3d video portal for telepresence. In: Proc. of SIGGRAPH, San Diego, USA, pp. 819–827 (July 2003)
Intel. openCV: Open source Computer Vision library, http://www.sourceforge.net/opencv/
Isard, M., Blake, A.: ICONDENSATION: Unifying low-level and high-level tracking in a stochastic framework. LNCS. Springer, Heidelberg (1998)
Moravec, H.P.: Certainty grids for sensor fusion in mobile robots. In: Nato Asi Series F: Sensor Devices and Systems for Robotics, vol. 52. Springer, Heidelberg (1989)
Pérez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-based probabilistic tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 661–675. Springer, Heidelberg (2002)
Reiners, D., Voss, G., Roth, M., et al.: OpenSceneGraph library (OpenSG), http://www.opensg.org
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (2001)
Woelk, F., Schiller, I., Koch, R.: An airborne bayesian color tracking system, Las Vegas, USA (June 2005)
Yang, M.-H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(1) (January 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Grest, D., Koch, R. (2005). Multi-camera Person Tracking in a Cluttered Interaction Environment. In: Gagalowicz, A., Philips, W. (eds) Computer Analysis of Images and Patterns. CAIP 2005. Lecture Notes in Computer Science, vol 3691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11556121_59
Download citation
DOI: https://doi.org/10.1007/11556121_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28969-2
Online ISBN: 978-3-540-32011-1
eBook Packages: Computer ScienceComputer Science (R0)