Abstract
Text information, which plays important role in news video concept detection, has been ignored in state-of-the-art movie analysis technology. It is so because movie subtitles are speech of roles which do not directly describe content of movie and contributes little to movie analysis. In this paper, we import collaborative-editing synopsis from professional movie sites for movie analysis, which gives detailed descriptive text of movie. Two aligning methods, subtitle alignment and RoleNet alignment, are proposed complementarily to align synopsis to movie to get scene-level text information of movie. The experiment show that proposed methods can effectively align synopsis to movie scene and the imported text information can give a more user-preferred summarization than merely using audiovisual feature.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Rapantzikos, K., Evangelopoulos, G., Maragos, P., Avrithis, Y.: An audio-visual saliency model for movie summarization. In: IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007, pp. 320–323 (October 2007)
Liu, A., Li, J., Zhang, Y., Tang, S., Song, Y., Zhaoxuan, Y.: An innovative model of tempo and its application in action scene detection for movie analysis. In: IEEE 2008 Workshop on Application of Computer Vision, WACV 2008 (2008)
Wang, H.L., Cheong, L.-F.: Affective understanding in film. In: IEEE Transactions on Circuits and Systems for Video Technology, pp. 689–704 (June 2006)
Li, Y., Lee, S.-H., Yeh, C.-H., Kuo, J.C.-C.: Techniques for movie content analysis and skimming. IEEE Signal Processing Magazine, vol. 22(2), 79–89 (March 2006)
Li, Y., Narayanan, S., Kuo, C.C.J.: Content-Based Movie Analysis and Indexing Based on AudioVisual. IEEE Transactions on Circuits and Systems for Video Technology, 1073–1085 (August 2004)
Weng, C.-Y., Chu, W.-T., Wu, J.-L.: RoleNet: Treat a Movie as a Small Society. In: Multimedia Information Retrieval, MIR 2007, pp. 51–60 (2007)
Fellbaum, C., et al.: WordNet: An Electronic Lexical Database. MIT press, Cambridge (1998)
Wikipedia, www.wikipedia.org
Blondel, D., Vincent, G., Anahi, H., Maureen, S.P., Van Dooren, P.: A measure of similarity between graph vertices: applications to synonym extraction and web searching. Society for industrial and applied mathmatics 46(4), 647–666 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, M., Liu, Y., Zhang, YD., Lin, SX. (2008). Synopsis Alignment: Importing External Text Information for Multi-model Movie Analysis. In: Huang, YM.R., et al. Advances in Multimedia Information Processing - PCM 2008. PCM 2008. Lecture Notes in Computer Science, vol 5353. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89796-5_30
Download citation
DOI: https://doi.org/10.1007/978-3-540-89796-5_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89795-8
Online ISBN: 978-3-540-89796-5
eBook Packages: Computer ScienceComputer Science (R0)