Abstract
How to build semantic index for multimedia data is an important and challenging problem for multimedia information systems. In this paper, we present a novel approach to build a semantic video index for digital videos by analyzing the subtitle files of DVD/DivX videos. The proposed approach for building semantic video index consists of 3 stages, viz., script extraction, script partition and script vector representation. First, the scripts are extracted from the subtitle files that are available in the DVD/DivX videos. Then, the extracted scripts are partitioned into segments. Finally, the partitioned script segments are converted into a tfidf vector based representation, which acts as the semantic index. The efficiency of the semantic index is demonstrated through video retrieval and summarization applications. Experimental results demonstrate that the proposed approach is very promising.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Berry, M.W., Drmavc, Z., Jessup, E.R.: Matrices, vector spaces, and information retrieval. SIAM Review 41(2), 335–362 (1999)
Lin, C.-Y., Tseng, B.L., Smith, J.R.: VideoAnnEx: IBM MPEG-7 annotation tool for multimedia indexing and concept learning. In: IEEE International Conference on Multimedia & Expo, Baltimore, USA (July 2003)
Berry, M.W., Dumais, S.T., O’Brien, G.W.: Using linear algebra for intelligent information retrieval. SIAM Review 37, 301–328 (1995)
Porter, M.F.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)
Smoliar, S., Zhang, H.: Content-based video indexing and retrieval. IEEE Multimedia 1, 62–72 (1994)
Sun, X., Manjunath, B.S., Divakaran, A.: Representation of motion activity in hierarchical levels for video indexing and filtering. IEEE International Conference on Image Processing 1, 149–152 (2002)
Wactlar, H.D.: The challanges of continuous capture, contemporaneous analysis and customized summarization of video content. CMU
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yi, H., Rajan, D., Chia, LT. (2004). Semantic Video Indexing and Summarization Using Subtitles. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds) Advances in Multimedia Information Processing - PCM 2004. PCM 2004. Lecture Notes in Computer Science, vol 3331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30541-5_78
Download citation
DOI: https://doi.org/10.1007/978-3-540-30541-5_78
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23974-1
Online ISBN: 978-3-540-30541-5
eBook Packages: Computer ScienceComputer Science (R0)