Abstract
We present a clustering approach for video summarization and browsing based on the Growing Cell Structures (GCS) neural algorithms and MPEG-7 video descriptors. Each I frame is represented as a feature vector of MPEG-7 descriptors. These vectors are clustered using GCS to select one or more keyframes for each shot. The extracted keyframes are then grouped together by TreeGCS to form a hierarchical view of the video for efficient browsing. We evaluate the effectiveness of different combinations of MPEG-7 descriptors and also compare them with the performance of color histograms.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Fritzke, B.: Growing Cell Structures - a Self-Organizing Network for Unsupervised and Supervised Learning. Neural Networks 7(9), 1441–1460 (1994)
Lu, S., King, I., Lyu, M.R.: Video Summarization by Video Structure Analysis and Graph Optimization. In: Proc. IEEE International Conference on Multimedia and Expo (ICME 2004), Taiwan, June 2004, pp. 27–30 (2004)
Divakaran, A., Peker, K., Radhakrishnan, R., Xiong, Z., Cabasson, R.: Video Summarization using MPEG-7 Motion Activity and Audio Descriptors. In: Rosenfeld, A., Doermann, D., DeMenthon, D. (eds.) Video Mining, Kluwer Academic Publishers, Dordrecht (2003)
Pope, Kumar, R., Sawhney, H., Corporation, C.W.S.: Summarizing Video Content for Retrieval and Visualization. In: Proc. Thirty-Second Asilomar Conference on Signals, Systems & Computers, pp. 915–919 (1998)
Stefanidis, A., Partsinevelos, P., Agouris, P., Doucette, P.: Summarizing Video Datasets in the Spatiotemporal Domain, London, UK, September 2000, pp. 906–912. IEEE Press, Los Alamitos (2000)
Christel, M., Duygulu, P., Hauptmann, A., Ng, D., Yang, J.: Extensible News Video Information Exploitation, http://www.informedia.cs.cmu.edu/arda/vaceII.html
Chiu, P., Girgensohn, A., Polak, W., Rieffel, E., Wilcox, L.: A Genetic Algorithm for Video Segmentation and Summarization. In: Proceedings of ICME (IEEE International Conference on Multimedia and Expo), New York City, USA (August 2000)
Manjunath, B., Ohm, J., Vasudevan, V., Yamada, A.: Color and Texture Descriptors. IEEE Transactions on circuits and systems for video technology 11(6), 703–715 (2001)
Hillis, D., Moritz, C., Mable, B.: Molecular Systematics. Sinauer Pub., Boston (1996)
http://phalanx.lis.e-technik.tu-muenchen.de/research/bv/topics/mmdb/e_mpeg7.html
Koprinska, I., Clark, J., Carrato, S.: Video GCS - A clustering-based system for video summarization and browsing. In: Proc. 6th COST 276 Workshop, Thessaloniki (Greece), May 2004, pp. 34–40 (2004)
Kohonen, T.: Self-Organizing Maps, 2nd edn. Springer, Heidelberg (1997)
Hodge, V.J., Austin, J.: Hierarchical Growing Cell Structures: TreeGCS. IEEE Trans Know & Data Eng. 13(2), 207–218 (2001)
Ferman, A.M., Tekalp, A.M.: Efficient Filtering and Clustering Methods for Temporal Video Representation and Visual Summarization. J. Visual Com. & Image Rep. 9, 336–351 (1998)
Drew, M.S., Au, J.: Video Keyframe Production by Efficient Clustering of Compressed Chromaticity Signa-tures. ACM Multimedia (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Saberi, M.D., Carrato, S., Koprinska, I., Clark, J. (2005). Estimation of the Hierarchical Structure of a Video Sequence Using MPEG-7 Descriptors and GCS. In: Khosla, R., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2005. Lecture Notes in Computer Science(), vol 3682. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11552451_2
Download citation
DOI: https://doi.org/10.1007/11552451_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28895-4
Online ISBN: 978-3-540-31986-3
eBook Packages: Computer ScienceComputer Science (R0)