Abstract
Low-level video analysis is an important step for further semantic interpretation of the video. This provides information about the camera work, video editing process, shape, texture, color and topology of the objects and the scenes captured by the camera. Here we introduce a framework capable of extracting the information about the shot boundaries and the camera and object motion, based on the analysis of spatiotemporal pixel blocks in a series of video frames. Extracting the motion information and detecting shot boundaries using the same underlying principle is the main contribution of this paper. Besides, this original principle is likely to improve robustness of the abovementioned low-level video analysis as it avoids typical problems of standard frame-based approaches and the camera motion information provides critical help to improve the shot boundary detection performance. The system is evaluated using TRECVID data [1] with promising results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Naci, U., Hanjalic, A.: TU DELFT at TRECVID 2005: Shot Boundary Detection. In: Proceedings of TRECVID (November 2005)
Haritaoglu, I., Harwood, D., Davis, L.: W4: Real-Time Surveillance of People and Their Activities. IEEE PAMI 22(8), 809–830 (2000)
Jin, S.H., Bae, T.M., Ro, Y.M.: Automatic Video Genre Detection for Content-Based Authoring. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM 2004. LNCS, vol. 3331, pp. 335–343. Springer, Heidelberg (2004)
Gargi, U., Kasturi, R., Strayer, S.H.: Performance Characterization of Video-Shot-Change Detection Methods. IEEE Transactions on Circuits and Systems for Video Technology 10(1), 1–13 (2000)
Hanjalic, A.: Content-Based Analysis of Digital Video. Kluwer Academic Publishers, Dordrecht (2004)
Koprinska, I., Carrato, S.: Video Segmentation: A Survey. Signal Processing: Image Communication 16(5), 477–500 (2001)
Ankush, M., Cheong, L.F., Leung, T.S.: Robust identification of gradual shot-transition types. In: Proceedings of IEEE International Conference on Image Processing, pp. 413–416 (2002)
Lienhart, R.: Comparison of Automatic Shot Boundary Detection Algorithms. In: Proc. SPIE, Storage and Retrieval for Image and Video Databases VII, San Jose, CA, USA, vol. 3656, pp. 290–301 (1999)
Hanjalic, A.: Shot-Boundary Detection: Unraveled and Resolved? IEEE Transactions on Circuits and Systems for Video Technology 12(2) (February 2002)
Lienhart, R.: Reliable dissolve detection. In: Proc. SPIE, vol. 4315, pp. 219–230 (2001)
Kobla, V., DeMenthon, D., Doermann, D.: Special effect edit detection using video trails: A comparison with existing techniques. In: SPIE Storage and Retrieval for Image and Video Databases VII, pp. 302–313 (1999)
Porter, S.V., Mirmehdi, M., Thomas, B.T.: Temporal video segmentation and classification of edit effects. Image and Vision Computing 21(13-14), 1097–1106 (2003)
Chimienti, A., Ferraris, C., Pau, D.: A Complexity-Bounded Motion Estimation Algorithm. IEEE Transactions on Image Processing 11(4) (April 2002)
Brünig, M., Menser, B.: Fast full search block matching using subblocks and successive approximation of the error measure. In: Proc SPIE, vol. 3974, pp. 235–244 (January 2000)
Jin, S.H., Bae, T.M., Choo, J.H., Ro, Y.M.: Video genre classification using multimodal features. In: SPIE 2004, vol. 5307, pp. 307–318 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Naci, U., Hanjalic, A. (2006). Low Level Analysis of Video Using Spatiotemporal Pixel Blocks. In: Gunsel, B., Jain, A.K., Tekalp, A.M., Sankur, B. (eds) Multimedia Content Representation, Classification and Security. MRCS 2006. Lecture Notes in Computer Science, vol 4105. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11848035_102
Download citation
DOI: https://doi.org/10.1007/11848035_102
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39392-4
Online ISBN: 978-3-540-39393-1
eBook Packages: Computer ScienceComputer Science (R0)