Skip to main content
Log in

Compressed domain content based retrieval using H.264 DC-pictures

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A fast and simple method for content based retrieval using the DC-pictures of H.264 coded video without full decompression is presented. Compressed domain retrieval is very desirable for content analysis and retrieval of compressed image and video. Even though, DC-pictures are among the most widely used compressed domain indexing and retrieval methods in pre H.264 coded videos, they are not generally used in the H.264 coded video. This is due to two main facts, first, the I-frame in the H.264 standard are spatially predicatively coded and second, the H.264 standard employs Integer Discrete Cosine Transform. In this paper we have applied color histogram indexing method on the DC-pictures derived from H.264 coded I-frames. Since the method is based on independent I-frame coded pictures, it can be used either for video analysis of H.264 coded videos, or image retrieval of the I-frame based coded images such as advanced image coding. The retrieval performance of the proposed algorithm is compared with that the fully decoded images. Simulation results indicate that the performance of the proposed method is very close to the fully decompressed image systems. Moreover the proposed method has much lower computational load.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Divakaran A, Vetro A, Asai K, Nishikawa H (2000) Video browsing system based on compressed domain feature extraction. IEEE Trans Consum Electron 46(3):637–644

    Article  Google Scholar 

  2. Feng Y, Fang H, Jiang J (2005) Region growing with automatic seeding for semantic video object segmentation. Lect Notes Comput Sci 3687:542–549

    Article  Google Scholar 

  3. Jiang J, Armstrong A, Feng GC (2002) Direct content access and extraction from JPEG compressed images. Pattern Recognit 35:2511–2519

    Article  MATH  Google Scholar 

  4. Jiang J, Feng G (2002) The spatial relationship of DCT coefficients between a block and its sub-blocks. IEEE Trans Signal Process 50(5):1160–1169

    Article  MathSciNet  Google Scholar 

  5. Jiang J, Weng Y, Jie P, Li C (2006) Dominant colour extraction in DCT domain. Image Vis Comput 24:1269–1277

    Article  Google Scholar 

  6. Joyce RA, Liu B (2000) Temporal segmentation of video using frame and histogram space. Image Processing, Proceedings. 2000 International Conference on, vol. 3, pp. 941–944

  7. Kobla V, Doermann D, Lin K-I (1996) Archiving, indexing, and retrieval of video in the compressed domain. In: Proc. SPIE Conf. on Multimedia Storage and Archiving Systems, SPIE 2916:78–89

  8. Lee SM, Xin JH, Westland S (2005) Evaluation of image similarity by histogram intersection. Color Res Appl 30(4):265–274

    Article  Google Scholar 

  9. Li X, Zhang M, Zhu Y, Xin J (2009) A novel RS-based key frame representation for video mining in compressed-domain, second international workshop on knowledge discovery and data mining. IEEE Computer Society, pp. 199–201

  10. Malvar HS, Hallapuro A, Karczewicz M, Kerofsky L (2003) Low-complexity transform and quantization in H.264/AVC. IEEE Trans Circuits Syst Video Technol 13(7):598–603

    Google Scholar 

  11. Manning CD, Raghavan P, Schütze H (2008) Introduction to information retrieval” Cambridge University Press

  12. Qian X, Liu L, Su R (2006) Effective fades and flashlight detection based on accumulating histogram difference. IEEE Trans Circuits Syst Video Technol 16(10):1245–1258

    Article  Google Scholar 

  13. Seo K-D, Park S, Jung S-H (2009) Wipe scene-change detector based on visual rhythm spectrum. IEEE Trans Consum Electron 55(2):831–838

    Article  Google Scholar 

  14. Shu-long Z, Zhi-sheng Y, Shi-yong L, Xin Z (2007) “An improved video compression algorithm for lane surveillance”, Fourth International Conference on Image and Graphics(ICIG), pp. 224–229

  15. Swain M, Ballard D (1997) Color indexing. Int J Comput Vis 7:11–32

    Article  Google Scholar 

  16. Tavanapong W, Zhou J (2004) Shot clustering techniques for story browsing IEEE Trans Multimedia 6(4):517–527

    Google Scholar 

  17. Wang H, Divakaran A, Vetro A, Chang S-F, Sunb H (2003) Survey of compressed-domain features used in audio-visual indexing and analysis. J Vis Commun Image Represent 14:150–183

    Article  Google Scholar 

  18. Zhang Z, Veerla R, Rao KR (2008) Modified advanced image coding. In: Proc. international conference on complexity and intelligence of the artificial and natural complex systems, medical applications of the complex systems, biomedical computing, pp. 110–116

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Farzad Zargari.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mehrabi, M., Zargari, F. & Ghanbari, M. Compressed domain content based retrieval using H.264 DC-pictures. Multimed Tools Appl 60, 443–453 (2012). https://doi.org/10.1007/s11042-010-0597-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0597-9

Keywords

Navigation