Abstract
Scene boundary detection is an essential research in content-based video summary, retrieval, and browsing. In this paper, we present an efficient and robust scene extraction algorithm. The proposed algorithm consists of three stages. The first stage is shot boundary detection, and the second stage is the musical scene boundary detection through detection of musical shot. In the last stage, scene detection among non-musical shots is accomplished. In order to detect musical shots, audio categorization is accomplished on audio clips that are divided into visual shot unit. Then low level audio features are calculated for categorization of audio clips. Finally, the parts of video which are containing music component are discriminated on the assumption that the shots in a scene contain same background music. In scene change detection among non-musical shots, distance matrix among shots is calculated based on visual information and time distances between each shot. To provide a reasonable limitation of time distance, variable length time-window method is proposed. The scene boundaries are detected by using shot clustering and scene formation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yeung, M., Yeo, B.-L.: Segmentation of Video by Clustering and Graph Analysis. Computer Vision and Image Understanding 71(1), 94–109 (1998)
Yeung, M.M., Liu, B.: Efficient matching and clustering of video shots. In: Proceedings of the International Conference on Image Processing 1995, vol. 1, pp. 338–341 (1995)
Kwon, Y.-M., Song, C.-J., Kim, I.-J.: A new approach for high level video structuring. In: 2000 IEEE International Conference on Multimedia and Expo. ICME 2000, vol. 2(30), pp. 773–776 (2000)
Truong, B.T., Venkatesh, S., Dorai, C.: Scene extraction in motion pictures. IEEE Transactions on Circuits and Systems for Video Technology 13(1), 5–15 (2003)
Hong, S.B., Nah, W., Baek, J.H.: Abrupt Shot Change Detection Using Multiple Features and Classification Tree. In: Liu, J., Cheung, Y.-m., Yin, H. (eds.) IDEAL 2003. LNCS, vol. 2690, pp. 553–560. Springer, Heidelberg (2003)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn., pp. 259–265. Wiley Interscience, Hoboken (2001)
Zhang, T., Kuo, C.-C.J.: Audio content analysis for online audiovisual data segmentation and classification Speech and Audio Processing. IEEE Transactions on 9(4), 441–457 (2001)
Lu, L., Zhang, H.-J., Jiang, H.: Content analysis for audio classification and segmentation Speech and Audio Processing. IEEE Transactions on 10(7), 504–516 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baek, Js., Lee, St., Baek, Jh. (2005). Scene Boundary Detection by Audiovisual Contents Analysis. In: Zhang, S., Jarvis, R. (eds) AI 2005: Advances in Artificial Intelligence. AI 2005. Lecture Notes in Computer Science(), vol 3809. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11589990_55
Download citation
DOI: https://doi.org/10.1007/11589990_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30462-3
Online ISBN: 978-3-540-31652-7
eBook Packages: Computer ScienceComputer Science (R0)