Abstract
We present an approach for tracking human body parts and classification of human actions. We introduce Gaussian Processing Annealed Particle Filter Tracker (GPAPF), which is an extension of the annealed particle filter tracker and uses Gaussian Process Dynamical Model (GPDM) in order to reduce the dimensionality of the problem, increase the tracker’s stability and learn the motion models. Motion of human body is described by concatenation of low dimensional manifolds which characterize different motion types. The trajectories in the latent space provide low dimensional representations of sequences of body poses performed during motion. Our approach uses these trajectories in order to classify human actions. The approach was checked on HumanEva data set as well as on our own one. The results and the comparison to other methods are presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Christoudias, C.M., Darrell, T.: On modelling nonlinear shape-and-texture appearance manifolds. In: Proc. CVPR, vol. 2, pp. 1067–1074 (2005)
Elgammal, A., Lee, C.: Inferring 3d body pose from silhouettes using activity manifold learning. In: Proc. CVPR, vol. 2, pp. 681–688 (2004)
Lawrence, N.: Gaussian process latent variable models for visualization of high dimensional data. Information Processing Systems (NIPS) 16, 329–336 (2004)
Wang, J., Fleet, D., Hetzmann, A.: Gaussian process dynamical models. Information Processing Systems (NIPS), 1441–1448 (2005)
Deutscher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filtering. In: Proc. CVPR, pp. 2126–2133 (2000)
Alt, H., Knauer, C., Wenk, C.: Matching polygonal curves with respect to the frèchet distance. In: Ferreira, A., Reichel, H. (eds.) STACS 2001. LNCS, vol. 2010, pp. 63–74. Springer, Heidelberg (2001)
Isard, M., Blake, A.: Condensation - conditional density propagation for visual tracking. International Journal of Computer Vision 29(1), 5–28 (1998)
Sidenbladh, H., Black, M., Fleet, D.: Stochastic tracking of 3d human figures using 2d image motion. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 702–718. Springer, Heidelberg (2000)
Rohr, K.: Human movement analysis based on explicit motion models. Motion-Based Recognition 8, 171–198 (1997)
Wang, Q., Xu, G., Ai, H.: Learning object intrinsic structure for robust visual tracking. In: Proc. CVPR, vol. 2, pp. 227–233. Madison, WI (2003)
Tenenbaum, J., de Silva, V., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)
Urtasun, R., Fleet, D.J., Fua, P.: 3d people tracking with gaussian process dynamical models. In: Proc. CVPR, vol. 1, pp. 238–245 (2006)
Sato, K., Aggarwal, J.: Recognizing two-person interactions in outdoor image sequences. IEEE Workshop on Multi-Object Tracking (2001)
Park, S., Aggrawal, J.: Recognition of human interactions using multiple features in a grayscale images. In: Proc. ICPR, vol. 1, pp. 51–54 (2000)
Hongeng, S., Bremond, F., Nevatia, R.: Representation and optimal recognition of human activities. In: Proc. CVPR, vol. 1, pp. 818–825 (2000)
Park, J., Park, S., Aggrawal, J.: Video retrieval of human interactions using model-based motion tracking and multi-layer finite state automata. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds.) CIVR 2003. LNCS, vol. 2728, Springer, Heidelberg (2003)
Deutscher, J., Reid, I.: Articulated body motion capture by stochastic search. International Journal of Computer Vision 61(2), 185–205 (2004)
Balan, A., Sigal, L., Black, M.: A quantitative evaluation of video-based 3d person tracking. IEEE Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS), 349–356 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Raskin, L., Rivlin, E., Rudzsky, M. (2007). Using Gaussian Processes for Human Tracking and Action Classification. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2007. Lecture Notes in Computer Science, vol 4841. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76858-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-76858-6_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76857-9
Online ISBN: 978-3-540-76858-6
eBook Packages: Computer ScienceComputer Science (R0)