Abstract
Video indexing is employed to represent the features of video sequences. Motion vectors derived from compressed video are preferred for video indexing because they can be accessed by partial decoding; thus, they are used extensively in various video analysis and indexing applications. In this study, we introduce an efficient compressed domain video indexing method and implement it on the H.264/AVC coded videos. The video retrieval experimental evaluations indicate that the video retrieval based on the proposed indexing method outperforms motion vector based video retrieval in 74 % of queries with little increase in computation time. Furthermore, we compared our method with a pixel level video indexing method which employs both temporal and spatial features. Experimental evaluation results indicate that our method outperforms the pixel level method both in performance and speed. Hence considering the speed and precision characteristics of indexing methods, the proposed method is an efficient indexing method which can be used in various video indexing and retrieval applications.











Similar content being viewed by others
References
Amir A, Berg M, Chang SF, Hsu W, Iyengar G, Lin CY, Naphade M, Natsev A, Neti C, Nock H (2003) IBM research TRECVID-2003 video retrieval system. NIST TRECVID-2003
Ardizzone E, Cascia ML, Avanzato A, Bruna A (1999) Video indexing using MPEG motion compensation vectors. IEEE Int Conf Multimed Comput Syst 2:725–729
Babu RV, Ramakrishnan KR (2007) Compressed domain video retrieval using object and global motion descriptors. Multimed Tools Appl 93–113
Barla A, Odone F, Verri A (2003) Histogram intersection kernel for image classification. Int Conf Image Process 3:513–516
Benois-Pineau J (2010) Indexing of compressed video: methods, challenges, applications. Int Conf Image Process Theory Tools Appl (IPTA) 3–4
Campbell M, Hauboldy A, Ebadollahi S, Joshi D, Naphade MR, Natsev AP, Seidl J, Smith JR, Scheinberg K, Tesic J, Xie L (2006) IBM research TRECVID-2006 video retrieval system. In: Proceedings of the TREC Video Retrieval Evaluation (TRECVID)
Gao L, Li Z, Katsaggelos A (2009) An efficient video indexing and retrieval algorithm using the luminance field trajectory modeling. IEEE Trans Circ Syst Video Technol 19(10):1566–1570
ITU-T Rec. H.264/ISO/IEC 11496–10, “Advanced video coding for generic audiovisual services”, March 2005
Joint Video Team of ITU-T VCEG and ISO/IEC MPEG, Joint Model Reference Software, Version 122
Lie WN, Hsiao WC (2002) Content-based video retrieval based on object motion trajectory. IEEE Work Multimed Signal Process 237–240
Mandal MK, Idris F, Panchanathan S (1999) A critical evaluation of image and video indexing techniques in the compressed domain. Image Vision Comput 17(7):513–529
Manjunath BS, Salembier P, Sikora T (2002) Introduction to MPEG-7: multimedia content description interface, vol 1. John Wiley & Sons Inc
Mehrabi M, Zargari F, Ghanbari M (2010) Fast and low complexity method for content accessing and extracting DC-frames from H.264 coded videos. IEEE Trans Consum Electron 56(3):1801–1808
Mezaris V, Kompatsiaris I, Boulgouris NV, Strintzis MG (2004) Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval. IEEE Trans Circ Syst Video Technol 14(5):606–621
Natsev A, Smith JR, Hill M, Hua G, Huangy B, Merlery M, Xie L, Ouyangz H, Zhou M (2010) IBM research TRECVID-2010 video copy detection and multimedia event detection system. In: Proceedings of the TRECVID 2010 Workshop, Gaithersburg, MD, USA
Qin YH, Li HL, Liu GH, Wang ZN (2010) Human action recognition using PEM histogram. Int Conf Comput Probl Solv (ICCP) 323–325
Richardson IEG (2003) H.264 and MPEG-4 video compression. Wiley, West Sussex
Sun X, Divakaran A, Manjunath BS (2001) A motion activity descriptor and it’s extraction in compressed domain. Adv Multimed Inf Process 450–457
Takaya K (2006) Detection of scene changes for video indexing by means of the MPEG motion vectors. Int Symp Intell Signal Process Commun 447–450
Venkatesh Babu R, Anantharaman B, Ramakrishnan KR, Srinivasan SH (2002) Compressed domain action classification using HMM. Pattern Recognit Lett 23(10):1203–1213
Wang H, Divakaran A, Vetro A, Chang SF, Sun H (2003) Survey of compressed-domain features used in audio-visual indexing and analysis. J Vis Commun Image Represent 14:150–183
Xuefeng Pan P, Jintao L, Yongdong Zhang Z, Sheng Tang T, Lejun Y (2007) Format-independent motion content description based on spatiotemporal visual sensitivity. IEEE Trans Consum Electron 53(2):769–774
Yeo C, Ahammad P, Ramchandran K, Sastry S (2008) High speed action recognition and localization in compressed domain videos. IEEE Trans Circ Syst Video Technol 18(8):1006–1015
Yi H, Rajan D, Chia L-T (2005) A new motion histogram to index motion content in video segments. Pattern Recognit Lett 26(9):1221–1231
Zampoglou M, Papadimitriou T, Diamantaras KI (2007) Support vector machines content-based video retrieval based solely on motion information. IEEE Work Digit Object Identifier 176–180
Zargari F, Mehrabi M, Ghanbari M (2010) Compressed domain texture based visual information retrieval method for I-frame coded frames. IEEE Trans Consum Electron 56(2):728–736
Zhang D, Lu G (2003) Evaluation of similarity measurement for image retrieval. Int Conf Neural Netw Signal Process 2:928–931
Zhao J, Zhang Z, Han S, Qu C, Yuan Z, Zhang D (2011) SVM based forest fire detection using static and dynamic features. Comput Sci Inf Syst 8(3):821–841
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Akrami, F., Zargari, F. An efficient compressed domain video indexing method. Multimed Tools Appl 72, 705–721 (2014). https://doi.org/10.1007/s11042-013-1403-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1403-2