Abstract
This article describes a novel approach to the modeling of human actions in 3D. The method we propose is based on a “bag of poses” model that represents human actions as histograms of key-pose occurrences over the course of a video sequence. Actions are first represented as 3D poses using a sequence of 36 direction cosines corresponding to the angles 12 joints form with the world coordinate frame in an articulated human body model. These pose representations are then projected to three-dimensional, action-specific principal eigenspaces which we refer to as aSpaces. We introduce a method for key-pose selection based on a local-motion energy optimization criterion and we show that this method is more stable and more resistant to noisy data than other key-poses selection criteria for action recognition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arie, B.J., Wang, Z., Pandit, P., Rajaram, S.: Human Activity Recognition Using Multidimensional Indexing. IEEE Trans. Pattern Anal. Mach. Intell. 24(8), 1091–1104 (2002)
Bosch, A., Zisserman, A., Munoz, X.: Representing shape with a spatial pyramid kernel. In: CIVR ’07, pp. 401–408. ACM, Amsterdam (2007)
Gonzàlez, J., Varona, J., Roca, F.X., Villanueva, J.J.: Analysis of Human Walking Based on a Spaces. In: Perales, F.J., Draper, B.A. (eds.) AMDO 2004. LNCS, vol. 3179, pp. 177–188. Springer, Heidelberg (2004)
Kovar, L.: Automated Extraction and Parameterization of Motions in Large Data Sets. ACM Transactions on Graphics 23, 559–568 (2004)
Lazebnik, S., Schmid, C., Ponce, J.: Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In: CVPR ’06, Anchorage, Alaska, pp. 2169–2178 (2006)
Li, F., Perona, P.: A Bayesian Hierarchical Model for Learning Natural Scene Categories. In: CVPR ’05, Washington, DC, USA, pp. 524–531 (2005)
Lv, F., Nevatia, R., Lee, M.: 3D Human Action Recognition Using Spatio-temporal Motion Templates. In: CVHCI ’05, p. 120
Lv, F., Nevatia, R.: Recognition and Segmentation of 3D Human Action Using HMM and Multi-Class AdaBoost. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 359–372. Springer, Heidelberg (2006)
Lv, F., Nevatia, R.: Single View Human Action Recognition using Key Pose Matching and Viterbi Path Searching. In: CVPR’07, Minneapolis, Minnesota, USA , pp. 1–8 (2007)
Masoud, O., Papanikolopoulos, N.: A Method for Human Action Recognition. Image and Vision Computing 21(8), 729–743 (2003)
Müller, M., Röder, T., Clausen, M.: Efficient content-based retrieval of motion capture data. ACM Transactions on Graphics 24(3), 677–685 (2005)
Raptis, M., Wnu, K., Soatt, S.: Flexible Dictionaries for Action Classification. In: Proceedings of the Workshop on Machine Learning for Visual Motion Analysis (2008)
Rius, I., Gonzàlez, J., Mozerov, M., Roca, F.X.: Automatic learning of 3D pose variability in walking performances for gait analysis. International journal for computational vision and biomechanics 1, 33–43 (2007)
Rius, I., Gonzàlez, J., Varona, J., Roca, F.X.: Action-specific motion prior for efficient Bayesian 3D human body tracking. Pattern Recognition 42(11), 2907–2921 (2009)
Sigal, L., Black, J.M.: HumanEva: Synchronized video and Motion Capture Dataset for Evaluation of Articulated Human Motion. Brown University (2006)
Zatsiorsky, M.V.: Kinematics of Human Motion. Human Kinetics Publishers (1998)
Zatsiorsky, M.V.: Kinetics of Human Motion. Human Kinetics Publishers (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gong, W., Bagdanov, A.D., Roca, F.X., Gonzàlez, J. (2010). Automatic Key Pose Selection for 3D Human Action Recognition. In: Perales, F.J., Fisher, R.B. (eds) Articulated Motion and Deformable Objects. AMDO 2010. Lecture Notes in Computer Science, vol 6169. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14061-7_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-14061-7_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14060-0
Online ISBN: 978-3-642-14061-7
eBook Packages: Computer ScienceComputer Science (R0)