Skip to main content
SpringerLink
Log in

Compressed domain video retrieval using object and global motion descriptors

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video content description has become an important task with the standardization effort of MPEG-7, which aims at easy and efficient access to visual information. In this paper we propose a system to extract object-based and global features from compressed MPEG video using the motion vector information for video retrieval. The reliability of the motion information is enhanced by a motion accumulation process. The global features like motion activity and camera motion parameters are extracted from the above enhanced motion information. The object features such as speed, area and trajectory are then obtained after the proposed object segmentation. The number of objects in a given video shot is determined by the proposed K-means clustering procedure. The object segmentation is done by applying EM algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ardizzone E, Casciai ML, Avanzato A, Bruna A (1999 June) Video indexing using MPEG motion compensation vectors. In: IEEE International Conference on Multimedia Computing and Systems, vol 2, pp. 725–729

  2. Babu VR, Anantharaman B, Ramakrishnan KR, Srinivasan SH (2002 August) Compressed domain action classification using HMM. Pattern Recogn Lett 23(10):1203–1213

    Article  Google Scholar 

  3. Chang S, Chen W, Horace H, Sundaram H, Zhong D (1998 September) A fully automated content based video search engine supporting spatio-temporal queries. IEEE Trans Circuits Syst Video Technol 8(5):602–615

    Article  Google Scholar 

  4. Courtney JD (1997 April) Automatic video indexing via object motion analysis. Pattern Recogn 30(4):607–625

    Article  Google Scholar 

  5. Davis JW (1998 April) Recognizing movement using motion histograms. Technical Report 487, MIT Media Lab

  6. Deng Y, Mukherjee D, Manjunath BS (1998) NeTra-V: Toward an object-based video representation. In: Storage and Retrieval for Image and Video Databases (SPIE), pp 202–215

  7. Dimitrova N, Golshani F (1995 October) Motion recovery for video content classification. ACM Trans Inf Sys 13(4):408–439

    Article  Google Scholar 

  8. Fablet R, Bouthemy P (2000) Statistical motion-based retrieval with partial query. In: Visual Information and Information Systems, pp. 96–107

  9. Flickner M, Sawhney H, Niblack W, Aashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995 September) Query by image and video content: The QBIC system. IEEE Comput Mag 28:23–32

    Google Scholar 

  10. Jeannin S, Divakaran A (2001 June) MPEG-7 visual motion descriptors. IEEE Trans Circuits Syst Video Technol 11(6):720–724

    Article  Google Scholar 

  11. Jeannin S, Jasinschi R, She A, Naveen T, Mory B, Tabatabai A (2000) Motion descriptors for content-based video representation. Signal Process Image Commun 16:59–85

    Article  Google Scholar 

  12. Kobla V, Doermann DS, Lin K-I (1996) Archiving, indexing and retrieval of video in compressed domain. In: SPIE Conference on Multimedia Storage and Archiving Systems, vol 2916, pp. 78–89

  13. Kobla V, Doermann DS, Lin K-I, Faloutsos C (1997) Compressed domain video indexing techniques using DCT and motion vector information in MPEG video. In: SPIE Conference on Multimedia Storage and Archiving Systems, vol 3022, pp. 200–211

  14. Mandal M, Idris F, Panchanathan S (1999) A critical evaluation of image and video indexing techniques in the compressed domain. J Image Vis Comput 17(7):513–529 (Special issue on Content-based Image Indexing)

    Article  Google Scholar 

  15. Nabil M, Ngu AHH, Shepherd J (2001) Modeling and retrieval of moving objects. Multimedia Tools and Applications 13(1):35–71

    Article  Google Scholar 

  16. Sahouria E, Zakhor A (1999) A trajectory based video indexing system for street surveillance. In: IEEE International Conference on Image Processing

  17. Standard MPEG1: ISO/IEC 11172. Coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s.

  18. Sudhir G, Lee J (1996 December) Video annotation by motion interpretation using optical flow streams. J Vis Commun Image Represent 7(4):354–368

    Article  Google Scholar 

  19. Taşkiran C, Chen J-Y, Bouman CA, Delp EJ (1998 October) A compressed video database structured for active browsing and search. In: IEEE International Conference on Image Processing, vol 3, pp 133–137

  20. Tan YP, Saur DD, Kulkarni SR, Ramadge PJ (2000 February) Rapid estimation of camera motion from compresses video with applications to video annotation. IEEE Trans Circuits Syst Video Technol 10(1):133–146

    Article  Google Scholar 

  21. Yoon K, DeMenthon DF, Doermann D (2000) Event detection from MPEG video in the compressed domain. In: International Conference on Pattern Recognition, pp 819–822, Barcelona, Spain

  22. Zhong D, Chang SF (1999) December) An integrated approach for content-based video object segmentation and retrieval. IEEE Trans Circuits Syst Video Technol 9(8):1259–1268

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Indian Institute of Science, Bangalore, Karnataka, 560 012, India

    R. Venkatesh Babu & K. R. Ramakrishnan

Authors
  1. R. Venkatesh Babu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. R. Ramakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to R. Venkatesh Babu.

Additional information

An earlier, brief version of this paper has appeared in the Proceedings of the IEEE International Symposium on Circuits and Systems 2002, (ISCAS 2002) Vol. 4, pp. 141–144.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Babu, R.V., Ramakrishnan, K.R. Compressed domain video retrieval using object and global motion descriptors. Multimed Tools Appl 32, 93–113 (2007). https://doi.org/10.1007/s11042-006-0048-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0048-9

Keywords

Search

Navigation