Abstract
A fast and simple method for content based retrieval using the DC-pictures of H.264 coded video without full decompression is presented. Compressed domain retrieval is very desirable for content analysis and retrieval of compressed image and video. Even though, DC-pictures are among the most widely used compressed domain indexing and retrieval methods in pre H.264 coded videos, they are not generally used in the H.264 coded video. This is due to two main facts, first, the I-frame in the H.264 standard are spatially predicatively coded and second, the H.264 standard employs Integer Discrete Cosine Transform. In this paper we have applied color histogram indexing method on the DC-pictures derived from H.264 coded I-frames. Since the method is based on independent I-frame coded pictures, it can be used either for video analysis of H.264 coded videos, or image retrieval of the I-frame based coded images such as advanced image coding. The retrieval performance of the proposed algorithm is compared with that the fully decoded images. Simulation results indicate that the performance of the proposed method is very close to the fully decompressed image systems. Moreover the proposed method has much lower computational load.
Similar content being viewed by others
References
Divakaran A, Vetro A, Asai K, Nishikawa H (2000) Video browsing system based on compressed domain feature extraction. IEEE Trans Consum Electron 46(3):637–644
Feng Y, Fang H, Jiang J (2005) Region growing with automatic seeding for semantic video object segmentation. Lect Notes Comput Sci 3687:542–549
Jiang J, Armstrong A, Feng GC (2002) Direct content access and extraction from JPEG compressed images. Pattern Recognit 35:2511–2519
Jiang J, Feng G (2002) The spatial relationship of DCT coefficients between a block and its sub-blocks. IEEE Trans Signal Process 50(5):1160–1169
Jiang J, Weng Y, Jie P, Li C (2006) Dominant colour extraction in DCT domain. Image Vis Comput 24:1269–1277
Joyce RA, Liu B (2000) Temporal segmentation of video using frame and histogram space. Image Processing, Proceedings. 2000 International Conference on, vol. 3, pp. 941–944
Kobla V, Doermann D, Lin K-I (1996) Archiving, indexing, and retrieval of video in the compressed domain. In: Proc. SPIE Conf. on Multimedia Storage and Archiving Systems, SPIE 2916:78–89
Lee SM, Xin JH, Westland S (2005) Evaluation of image similarity by histogram intersection. Color Res Appl 30(4):265–274
Li X, Zhang M, Zhu Y, Xin J (2009) A novel RS-based key frame representation for video mining in compressed-domain, second international workshop on knowledge discovery and data mining. IEEE Computer Society, pp. 199–201
Malvar HS, Hallapuro A, Karczewicz M, Kerofsky L (2003) Low-complexity transform and quantization in H.264/AVC. IEEE Trans Circuits Syst Video Technol 13(7):598–603
Manning CD, Raghavan P, Schütze H (2008) Introduction to information retrieval” Cambridge University Press
Qian X, Liu L, Su R (2006) Effective fades and flashlight detection based on accumulating histogram difference. IEEE Trans Circuits Syst Video Technol 16(10):1245–1258
Seo K-D, Park S, Jung S-H (2009) Wipe scene-change detector based on visual rhythm spectrum. IEEE Trans Consum Electron 55(2):831–838
Shu-long Z, Zhi-sheng Y, Shi-yong L, Xin Z (2007) “An improved video compression algorithm for lane surveillance”, Fourth International Conference on Image and Graphics(ICIG), pp. 224–229
Swain M, Ballard D (1997) Color indexing. Int J Comput Vis 7:11–32
Tavanapong W, Zhou J (2004) Shot clustering techniques for story browsing IEEE Trans Multimedia 6(4):517–527
Wang H, Divakaran A, Vetro A, Chang S-F, Sunb H (2003) Survey of compressed-domain features used in audio-visual indexing and analysis. J Vis Commun Image Represent 14:150–183
Zhang Z, Veerla R, Rao KR (2008) Modified advanced image coding. In: Proc. international conference on complexity and intelligence of the artificial and natural complex systems, medical applications of the complex systems, biomedical computing, pp. 110–116
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mehrabi, M., Zargari, F. & Ghanbari, M. Compressed domain content based retrieval using H.264 DC-pictures. Multimed Tools Appl 60, 443–453 (2012). https://doi.org/10.1007/s11042-010-0597-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0597-9