Skip to main content
SpringerLink
Log in

Statistical Analysis on Manifolds and Its Applications to Video Analysis

  • Chapter
Video Search and Mining

Part of the book series: Studies in Computational Intelligence ((SCI,volume 287))

Abstract

The analysis and interpretation of video data is an important component of modern vision applications such as biometrics, surveillance, motionsynthesis and web-based user interfaces. A common requirement among these very different applications is the ability to learn statistical models of appearance and motion from a collection of videos, and then use them for recognizing actions or persons in a new video. These applications in video analysis require statistical inference methods to be devised on non-Euclidean spaces or more formally on manifolds. This chapter outlines a broad survey of applications in video analysis that involve manifolds. We develop the required mathematical tools needed to perform statistical inference on manifolds and show their effectiveness in real video-understanding applications.

This work was partially supported by the Office of Naval Research under the Grant n00014-09-10664.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Absil, P.A., Mahony, R., Sepulchre, R.: Optimization Algorithms on Matrix Manifolds. Princeton University Press, Princeton (2008)

    MATH  Google Scholar 

  2. Aggarwal, G., Roy-Chowdhury, A., Chellappa, R.: A system identification approach for video-based face recognition. In: International Conference on Pattern Recognition (ICPR) (2004)

    Google Scholar 

  3. Begelfor, E., Werman, M.: Affine invariance revisited. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 2087–2094 (2006)

    Google Scholar 

  4. Bhattacharya, R., Patrangenaru, V.: Nonparametric estimation of location and dispersion on Riemannian manifolds. Journal for Statistical Planning and Inference 108, 23–36 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  5. Bhattacharya, R., Patrangenaru, V.: Large sample theory of intrinsic and extrinsic sample means on manifolds- I. The Annals of Statistics 31(1), 1–29 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  6. Bissacco, A., Chiuso, A., Ma, Y., Soatto, S.: Recognition of human gaits. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 52–57 (2001)

    Google Scholar 

  7. Bobick, A., Tanawongsuwan: Performance analysis of time-distance gait parameters under different speeds. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688. Springer, Heidelberg (2003)

    Google Scholar 

  8. Bookstein, F.: Size and shape spaces for landmark data in two dimensions. Statistical Science 1, 181–242 (1986)

    Article  MATH  Google Scholar 

  9. Boothby, W.M.: An introduction to differentiable manifolds and Riemannian geometry. Academic Press Inc., London (1975)

    Google Scholar 

  10. Brockett, R.: Notes on Stochastic Processes on Manifolds. In: Systems and Control in the Twenty-First Century: Progress in Systems and Control, vol. 22. Birkhäuser, Basel (1997)

    Google Scholar 

  11. Brockett, R.W.: System theory on group manifolds and coset spaces. SIAM Journal on Control 10(2), 265–284 (1972)

    Google Scholar 

  12. Chikuse, Y.: Statistics on special manifolds. Lecture Notes in Statistics. Springer, Heidelberg (2003)

    MATH  Google Scholar 

  13. Cock, K.D., Moor, B.D.: Subspace angles and distances between ARMA models. In: Proceedings of the Intl. Symposium of Mathematical Theory of Networks and Systems, MTNS (2000)

    Google Scholar 

  14. Dryden, I., Mardia, K.: Statistical shape analysis. John Wiley and Sons, Chichester (1998)

    MATH  Google Scholar 

  15. Dryden, I.L., Mardia, K.V.: Statistical Shape Analysis. John Wiley & Son, Chichester (1998)

    Google Scholar 

  16. Edelman, A., Arias, T., Smith, S.T.: The geometry of algorithms with orthogonality constraints. SIAM Journal of Matrix Analysis and Applications 20(2), 303–353 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  17. Georghiades, A.S., Kriegman, D.J., Belhumeur, P.N.: Illumination cones for recognition under variable lighting: Faces. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 52–59 (1998)

    Google Scholar 

  18. Grenander, U.: Probabilities on Algebraic Structures. Wiley, Chichester (1963)

    MATH  Google Scholar 

  19. Grenander, U.: General Pattern Theory. Oxford University Press, Oxford (1993)

    Google Scholar 

  20. Grenander, U., Miller, M.I.: Computational anatomy: An emerging discipline. Quarterly of Applied Mathematics LVI(4), 617–694 (1998)

    MathSciNet  Google Scholar 

  21. Grenander, U., Miller, M.I., Srivastava, A.: Hilbert-Schmidt lower bounds for estimators on matrix Lie groups for ATR. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(8), 790–802 (1998)

    Article  Google Scholar 

  22. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. (2004)

    Google Scholar 

  23. Kale, A., Sundaresan, A., Rajagopalan, A., Cuntoor, N., Roy Cowdhury, A., Krueger, V., Chellappa, R.: Identification of humans using gait. IEEE Transactions on Image Processing 13(9), 1163–1173 (2004)

    Article  Google Scholar 

  24. Karcher, H.: Riemannian center of mass and mollifier smoothing. Communications on Pure and Applied Mathematics 30, 509–541 (1977)

    Article  MATH  MathSciNet  Google Scholar 

  25. Kendall, D.: Shape manifolds, procrustean metrics and complex projective spaces. Bulletin of London Mathematical society 16, 81–121 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  26. Kendall, D.G.: Shape manifolds, procrustean metrics and complex projective spaces. Bulletin of London Mathematical Society 16, 81–121 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  27. Klassen, E., Srivastava, A., Mio, W., Joshi, S.: Analysis of planar shapes using geodesic paths on shape spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(3), 372–383 (2004)

    Article  Google Scholar 

  28. Le, H.L., Kendall, D.G.: The Riemannian structure of Euclidean shape spaces: a novel environment for statistics. Annals of Statistics 21(3), 1225–1271 (1993)

    Article  MATH  MathSciNet  Google Scholar 

  29. Liu, Z., Sarkar, S.: Improved gait recognition by gait dynamics normalization. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(6), 863–876 (2006)

    Article  Google Scholar 

  30. Lui, Y.M., Beveridge, J.R.: Grassmann registration manifolds for face recognition. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 44–57. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  31. Miller, M.I., Younes, L.: Group actions, homeomorphisms, and matching: A general framework. International Journal on Computer Vision 41(1/2), 61–84 (2001)

    Article  MATH  Google Scholar 

  32. Mio, W., Srivastava, A., Joshi, S.: On shape of plane elastic curves. International Journal on Computer Vision 73(3), 307–324 (2007)

    Article  Google Scholar 

  33. Pennec, X., Ayache, N.: Uniform distribution, distance and expectation problems for geometric features processing. Journal of Mathematical Imaging and Vision 9(1), 49–67 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  34. Rabiner, L., Juang, B.: Fundamentals of speech recognition. Prentice-Hall, Englewood Cliffs (1993)

    Google Scholar 

  35. Sarkar, S., Phillips, P., Liu, Z., Vega, I., Grother, P., Bowyer, K.: The humanid gait challenge problem: data sets, performance, and analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 162–177 (2005)

    Google Scholar 

  36. Small, C.G.: The Statistical Theory of Shape. Springer, Heidelberg (1996)

    MATH  Google Scholar 

  37. Soatto, S., Doretto, G., Wu, Y.N.: Dynamic textures. In: IEEE International Conference on Computer Vision, vol. 2, pp. 439–446 (2001)

    Google Scholar 

  38. Spivak, M.: A Comprehensive Introduction to Differential Geometry, vol. 1. Publish or Perish, Inc., Houston (1970)

    Google Scholar 

  39. Srivastava, A., Joshi, S., Mio, W., Liu, X.: Statistical shape analysis: Clustering, learning and testing. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(4), 590–602 (2005)

    Article  Google Scholar 

  40. Srivastava, A., Klassen, E.: Monte Carlo extrinsic estimators for manifold-valued parameters. IEEE Trans. on Signal Processing 50(2), 299–308 (2001)

    Article  Google Scholar 

  41. Srivastava, A., Klassen, E.: Bayesian, geometric subspace tracking. Journal for Advances in Applied Probability 36(1), 43–56 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  42. Subbarao, R., Meer, P.: Nonlinear mean shift over riemannian manifolds. International Journal on Computer Vision 84(1), 1–20 (2009)

    Article  Google Scholar 

  43. Turaga, P., Chellappa, R.: Locally time-invariant models of human activities using trajectories on the grassmannian. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 2435–2441 (2009)

    Google Scholar 

  44. Turaga, P., Veeraraghavan, A., Chellappa, R.: Unsupervised view and rate invariant clustering of video sequences. Computer Vision and Image Understanding 113(3), 353–371 (2009)

    Article  Google Scholar 

  45. Turaga, P.K., Veeraraghavan, A., Chellappa, R.: Statistical analysis on Stiefel and Grassmann manifolds with applications in computer vision. In: IEEE International Conference on Computer Vision and Pattern Recognition (2008)

    Google Scholar 

  46. Tuzel, O., Porikli, F., Meer, P.: Region covariance: A fast descriptor for detection and classification. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 589–600. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  47. Tuzel, O., Porikli, F., Meer, P.: Pedestrian detection via classification on Riemannian manifolds. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(10), 1713–1727 (2008)

    Article  Google Scholar 

  48. Veeraraghavan, A., Roy-Chowdhury, A., Chellappa, R.: Matching shape sequences in video with an application to human movement analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(12), 1896–1909 (2005)

    Article  Google Scholar 

  49. Veeraraghavan, A., Srivastava, A., Roy Chowdhury, A.K., Chellappa, R.: Rate-invariant recognition of humans and their activities. IEEE Transactions on Image Processing 18(6), 1326–1339 (2009)

    Article  Google Scholar 

  50. Weinland, D., Ronfard, R., Boyer, E.: Free viewpoint action recognition using motion history volumes. Computer Vision and Image Understanding 104(2), 249–257 (2006)

    Article  Google Scholar 

  51. Zhong, H., Shi, J., Visontai, M.: Detecting unusual activity in video. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 819–826 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Advanced Computer Studies, University of Maryland, College Park, MD, 20742

    Pavan Turaga & Rama Chellappa

  2. Mitsubishi Electric Research Labs, Cambridge, MA, 02139

    Ashok Veeraraghavan

  3. Department of Statistics, Florida State University, Tallahasse, FL

    Anuj Srivastava

Authors
  1. Pavan Turaga
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashok Veeraraghavan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anuj Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rama Chellappa
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Multimedia Communications Laboratory Department of Electrical & Computer Engineering, University of Illinois at Chicago, Room 1020 SEO (M/C 154), 851 South Morgan Street, 60607-7053, Chicago, IL, USA

    Dan Schonfeld

  2. Philips Research, High-Tech Campus 36, 5656, Eindhoven, AE, The Netherlands

    Caifeng Shan

  3. Department of Computing, Hong Kong Polytechnic University, 7/F, Building P, Hung Hom, PQ704, Kowloon,Hong Kong, China

    Dacheng Tao

  4. Department of Computer Science, University of Bath, BA2 7AY, United Kingdom

    Liang Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Turaga, P., Veeraraghavan, A., Srivastava, A., Chellappa, R. (2010). Statistical Analysis on Manifolds and Its Applications to Video Analysis. In: Schonfeld, D., Shan, C., Tao, D., Wang, L. (eds) Video Search and Mining. Studies in Computational Intelligence, vol 287. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12900-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12900-1_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12899-8

  • Online ISBN: 978-3-642-12900-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation