Skip to main content
SpringerLink
Log in
Book cover

International Conference on Computer Analysis of Images and Patterns

CAIP 2001: Computer Analysis of Images and Patterns pp 29–40Cite as

An Overview of MPEG-7 Motion Descriptors and Their Applications

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2124))

Abstract

We present an overview of the MPEG-7 motion descriptors viz. motion trajectory, camera motion, parametric motion and motion activity. These descriptors cover a wide range of functionality and hence enable several applications. We present the salient parts of the syntax, the semantics and the associated extraction of each of these descriptors. We discuss the possible applications for these descriptors and associated complexity trade-offs. We then describe a case study of a low complexity video browsing and indexing system that capitalizes on the simple extraction, compactness and effectiveness of the motion activity descriptor. This system relies on feature extraction in the compressed domain, which makes dynamic feature extraction possible. It combines the MPEG-7 motion activity descriptor and a simple color histogram to achieve both video summarization (top-down traversal) and indexing (bottom-up traversal) and thus enables a user-friendly video-browsing interface.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jeannin S., Divakaran, A.: MPEG-7 visual motion descriptors. Invited paper To appear in: Trans. Circuits and Systems for Video Technology special issue on MPEG-7, 11(6) (2001)

    Google Scholar 

  2. Divakaran A., Sun, H.: A Descriptor for spatial distribution of motion activity. In: Proc. SPIE Conf. on Storage and Retrieval from Image and Video Databases, San Jose, CA 24–28 Jan. (2000)

    Google Scholar 

  3. MPEG-7 Visual part of the XM 4.0. In: ISO/IEC MPEG99/W3068, Maui, USA, Dec. (1999)

    Google Scholar 

  4. Kadir A. Peker: Video indexing and summarization using motion activity. Ph.D. Dissertation, New Jersey Institute of Technology, Electrical Engineering Dept. (2001)

    Google Scholar 

  5. Akutsu & al.: Video indexing using motion vectors. In: Proc. Visual Communications and Image Processing, SPIE 1818 (1992) 1522–1530

    Google Scholar 

  6. Ardizzone E. & al.: Video indexing using MPEG motion compensation vectors. In: Proc. IEEE International Conference on Multimedia Computing and Systems (1999)

    Google Scholar 

  7. Davis, J.W.: Recognizing movement using motion histograms, Technical Report No. 487, MIT Media Laboratory Perceptual Computing Section (1998)

    Google Scholar 

  8. Dimitrova N., Golshani, F.: Motion recovery for video content analysis. ACM Trans. Information Systems, 13 (1995) 408–439

    Article  Google Scholar 

  9. Kobla V., Doermann D., Lin, K.-L, Faloutsous, C: Compressed domain video indexing techniques using DCT and motion vector information in MPEG video. In: Proc. SPIE Conference on Storage and Retrieval for Image and Video Databases V, SPIE Vol. 3022, (1997)200–211

    Google Scholar 

  10. Sahouria, E.: Video indexing based on object motion. M.S. thesis, Dept. of EECS, UC Berkeley

    Google Scholar 

  11. Tan, Y.P., Kulkarni, S.R., Ramadge, P.J.: Rapid estimation of camera motion from compressed video with application to video annotation. IEEE Trans, on Circuits and Systems for Video Technology, 10 (2000) 133–146.

    Article  Google Scholar 

  12. Tse, Y.T., Baker, R.L.: Camera zoom/pan estimation and compensation fore video compression. In: Proc. SPIE Conf. On Image Processing Algorithms and Techniques II, Boston, MA (1991) 468–479

    Google Scholar 

  13. Wolf, W.: Key frame selection by motion analysis. In: Proc. ICASSP 96, Vol. II (1996) 1228–1231

    Google Scholar 

  14. Jeannin, S., Jasinschi R. & al.: Motion Descriptors for Content-Based Video Representation. Signal Processing: Image Communication Journal, August 2000 (to appear)

    Google Scholar 

  15. Chang, S.F., Chen, W., Meng, HJ., Sundaram, H., Zhong, D.: A Fully Automated Content-Based Video Search Engine Supporting Multi-Objects Spatio-Temporal Queries. IEEE Transactions on Circuit and Systems for Video Technology, 8 (1998) 602–615

    Article  Google Scholar 

  16. Marr, D.: Vision. W. H. Freeman, San Francisco (1982)

    Google Scholar 

  17. Niblack, W., Ponceleon, D.B., Petkovic D. & al.: Updates to the QBIC System. In: Proc. IS&T SPIE, Storage and Retrieval for Image and Video Databases VI, San Jose, Vol. 3312 (1998) 150–161

    Google Scholar 

  18. Hori, O., Kaneko, T.: Results of Spatio-Temporal Region DS Core/Validation Experiment. In: ISO/IEC JTC1/SC29/WG11/MPEG99/M5414, Dec. 1999, Maui.

    Google Scholar 

  19. Llach, J., Salembier, P.: Analysis of video sequences: table of contents and index creation. In: Proc. Int’l Workshop on very low bit-rate video coding (VLBV’99), Kyoto, Japan (1999) 52–56

    Google Scholar 

  20. Jeannin, S., Video Motion Representation for Improved Content Access. IEEE Transactions on Consumers Electronics, August (2000)

    Google Scholar 

  21. Information technology-Coding of Audio-visual Objects. Standard MPEG4, Version 1. ISO/IEC 14496

    Google Scholar 

  22. Lee, K.W., You, W.S., Kim, J.: Quantitative analysis for the motion trajectory descriptor in MPEG-7. In: ISO/IEC JTC1/SC29/WG11/MPEG99/M5400, Dec. 1999, Maui.

    Google Scholar 

  23. Szeliski, R.: Image Mosaicing for Tele-reality Applications. In: IEEE Workshop on Applications of Computer Vision, IEEE Computer Society (1994) 44–53

    Google Scholar 

  24. Irani, M., Anandan P. & al.: Efficient Representation of Video Sequences and their Application. Signal Processing: Image Communications, 8 (1996) 327–351

    Article  Google Scholar 

  25. URL: http://www.cselt.it/mpeg/ official MPEG site

  26. URL: http://www.virage.com, Virage system

  27. URL: http://www.qbic.almaden.ibm.com, QBIC system

  28. URL: http://www.ctr.columbia.edu/videoq/, VideoQ system

  29. Peker K., Divakaran, A.: Automatic Measurement of Intensity of Motion Activity of Video Segments. In: Proc. SPIE Conference on Storage and Retrieval from Multimedia Databases, San Jose, CA (2001)

    Google Scholar 

  30. Divakaran A., Peker, K.: Video Summarization Using Motion Descriptors. In: Proc. SPIE Conference on Storage and Retrieval from Multimedia Databases, San Jose, CA (2001)

    Google Scholar 

  31. Bober, M., Asai K., Divakaran, A.: MPEG-4/7 based internet video and still image browsing system. In: Proc. SPIE Conference on Multimedia Systems and Applications, Boston, MA (2000)

    Google Scholar 

  32. Divakaran A., Vetro A., Asai K., Nishikawa, H.: Video browsing system based on compressed domain feature extraction. IEEE Trans. Consumer Electronics, Aug. 2000

    Google Scholar 

  33. Peker, K., Divakaran A., Sun, H.: Constant Pace Skimming and Temporal Sub-sampling of Video Using Motion Activity. To appear in: ICIP 2001

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Mitsubishi Electric Research Laboratories, 571, Central Avenue Suite 115, New Providence, NJ, 07974, USA

    Ajay Divakaran

Authors
  1. Ajay Divakaran
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Electronics and Information Technology Institute of Radioelectronics, Warsaw University of Technology, ul. Nowowiejska 15/19, 00-665, Warsaw, Poland

    Władysław Skarbek

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Divakaran, A. (2001). An Overview of MPEG-7 Motion Descriptors and Their Applications. In: Skarbek, W. (eds) Computer Analysis of Images and Patterns. CAIP 2001. Lecture Notes in Computer Science, vol 2124. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44692-3_5

Download citation

  • DOI: https://doi.org/10.1007/3-540-44692-3_5

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42513-7

  • Online ISBN: 978-3-540-44692-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation