Feng Zheng
ABSTRACT
Human actions can be seen as a trajectory in the eigen-space of silhouette of the human body. In this paper, the silhouette is firstly denoted as a vector using R-transform. Then, we exploit semi-supervised diffusion maps (SSDM) for dimensionality reduction and learning the eigen-space of the silhouette. Semi-supervised diffusion maps characterizes the spatiotemporal property of the action, as well as to preserve much of the local geometric structure and label information. We use the K-nearest neighbor classifier for recognizing actions represented as histograms of occurrence of the silhouette in the eigen-space. Experimental results show that the proposed approach performs significantly better than other manifold learning based action recognition techniques.
- S. Ali, A. Basharat, and M. Shah. Chaotic invariants for human action recognition. pages 1--8, oct. 2007.Google Scholar
- M. Belkin and P. Niyogi. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15:1373--1396, 2002. Google ScholarDigital Library
- M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri. Actions as space-time shapes. volume 2, pages 1395--1402 Vol. 2, oct. 2005.Google Scholar
- R. R. Coifman and S. Lafon. Diffusion maps. Applied and Computational Harmonic Analysis, 21(1):5--30, 2006. Diffusion Maps and Wavelets.Google ScholarCross Ref
- R. D. Cook. Fisher lecture: Dimension reduction in regression. Statistical Science, 22(1):1--26, 2007.Google ScholarCross Ref
- A. A. Efros, A. C. Berg, G. Mori, and J. Malik. Recognizing action at a distance. In IEEE International Conference on Computer Vision, pages 726--733, Nice, France, 2003. Google ScholarDigital Library
- A. Elgammal and C.-S. Lee. Inferring 3d body pose from silhouettes using activity manifold learning. volume 2, pages II-681--II-688 Vol. 2, june--2 july 2004. Google ScholarDigital Library
- X. He and P. Niyogi. Locality preserving projections. Cambridge, MA, 2004. MIT Press. Google ScholarDigital Library
- K. Jia and D.-Y. Yeung. Human action recognition using local spatio-temporal discriminant embedding. pages 1--8, june 2008.Google Scholar
- I. T. Jolliffe. Principal component analysis. New York: Springer-Verlag, 2003.Google Scholar
- J. Niebles and L. Fei-Fei. A hierarchical model of shape and appearance for human action classification. pages 1--8, june 2007.Google Scholar
- S. T. Roweis and L. K. Saul. Nonlinear dimensionality reduction by locally linear embedding. SCIENCE, 290:2323--2326, 2000.Google ScholarCross Ref
- P. Scovanner, S. Ali, and M. Shah. A 3-dimensional sift descriptor and its application to action recognition. In Proceedings of the 15th international conference on Multimedia, pages 357--360, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
- C. Sminchisescu, A. Kanujia, Z. Li, and D. Metaxas. Conditional visual tracking in kernel space. 2005.Google Scholar
- R. Souvenir and J. Babbs. Learning the viewpoint manifold for action recognition. pages 1--7, june 2008.Google Scholar
- S. Tabbone, L. Wendling, and J. P. Salmon. A new shape descriptor defined on the radon transform. Computer Vision and Image Understanding, 102(1):42--51, April 2006. Google ScholarDigital Library
- J. B. Tenenbaum, V. d. Silva, and J. C. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319--2323, 2000.Google ScholarCross Ref
- L. Wang and D. Suter. Recognizing human activities from silhouettes: Motion subspace and factorial discriminative graphical model. pages 1--8, june 2007.Google Scholar
- L. Wang, T. Tan, H. Ning, and W. Hu. Silhouette analysis-based gait recognition for human identification. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 25(12):1505--1518, dec. 2003. Google ScholarDigital Library
- B. Yao and S. chun Zhu. Learning deformable action templates from cluttered videos. Kyoto, Japan, 2009. IEEE International Conference on Computer Vision.Google Scholar
Index Terms
- Eigen-space learning using semi-supervised diffusion maps for human action recognition
Recommendations
A semi-supervised approach for dimensionality reduction with distributional similarity
Semi-supervised learning has recently received considerable attention in machine learning. In this paper, we propose a novel diffusion maps based semi-supervised algorithm for dimensionality reduction, visualization and data representation. Unlike ...
Boosted multi-class semi-supervised learning for human action recognition
Human action recognition is a challenging task due to significant intra-class variations, occlusion, and background clutter. Most of the existing work use the action models based on statistic learning algorithms for classification. To achieve good ...
Semi-supervised learning with varifold Laplacians
This paper presents varifold learning, a learning framework based on the mathematical concept of varifolds. Different from manifold based methods, our varifold learning framework does not treat data as being sampled from a manifold; but rather, we ...
Comments