Abstract
Automatic story unit segmentation is an essential technique for content based video retrieval and summarization. A good video story unit has complete content and natural boundary in visual and acoustic perception, respectively. In this paper, a method of acoustic perception friendly story unit segmentation for broadcast soccer video is proposed. The approach combines replay detection, view pattern and non-speech detection to segment story units. Firstly, a replay detection method is implemented to find the highlight events in soccer video. Secondly, based on positions of replay clips, an FSM (Fine State Machine) is used to obtain rough starting points of story units. Finally, audio boundary alignment is employed to locate natural audio boundaries for acoustic perception. The algorithm is tested on several broadcast soccer videos. The story units segmented by algorithms with and without audio alignment are compared in acoustic perception. The experimental results indicate the performance of the proposed algorithm is encouraging and effective.
This work is supported by National High-Tech R&D Program (863 Program) under the grant No. 2006AA01Z117 and NEC Labs, China.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Li, B., Errico, J.H., Pan, H., Sezan, I.: Bridging the semantic gap in sports video retrieval and summarization. Journal of Visual Communication & Image Representation, 393–424 (2004)
Ekin, A., Tekalo, A.M., Mehrotra, R.: Automatic Soccer Video Analysis and Summarization. IEEE transactions on Image Processing 12(7) (July 2003)
Ren, R., Jose, J.M.: Football Video Segmentation Based on Video Production Strategy. In: Proceedings of 27th European Conference on Information Retrieval March 2005, Sandiago (2005)
Noboru, N., Babaguchi, N., Kitahashi, T.: Story Based Presentation for Broadcasted Sports Video and Automatic Story Segmentation. In: Proceedings of 2002 IEEE International Conference on Multimedia and Expo, August 2002, Switzerland (2002)
Wang, J., Xu, C., Chng, E., Wan, K., Tian, Q.: Automatic Replay Generation for Soccer Video Broadcasting. In: Proc. of 13th ACM International Conference on Multimedia (2004)
Liu, C., Huang, Q., Jiang, S., Zhang, W.: Extracting Story Units in Sports Video Based on Unsupervised Video Scene Clustering. In: Proc. of 2006 IEEE International Conference on Multimedia and Expo, Toronto, Canada, pp. 1613–1616 (2006)
Tong, X., u, Q., Zhang, Y., Lu, H.: Highlight Ranking for Sports Video Browsing. In: Proc. of 13th ACM International Conference on Multimedia, Singapore, November 2005, pp. 519–522 (2005)
Babaguchi, N., Kawai, Y., Yasugi, Y., Kitahashi, T.: Linking Live and Replay Scenes in Broadcasted Sports Video. In: Proc. of ACM Multimedia 2000, Worshop on Multimedia Information Retrieval, Marina del Rey, pp. 205–208 (2000)
Zhao, Z., Jiang, S., Huang, Q., Zhu, G.: Highlight Summarization in Sports Video Based on Replay Detection. In: Proc. of 2006 IEEE International Conference on Multimedia and Expo, Toronto, Ontario, Canada, pp. 1613–1616 (2006)
Rjondronegoro, D., Chen, C., Pham, B.: Sports Video Summarization using Highlights and Play-Breaks. In: Proc. of 11th ACM International Conference on MIR (2003)
Lu, L., Zhang, H., Li, S.: Content-based audio classification and segmentation by using support vector machines. Multimedia Systems, pp. 482–492 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Yan, L., Du, J., Huang, Q., Jiang, S. (2007). Story Unit Segmentation with Friendly Acoustic Perception. In: Sebe, N., Liu, Y., Zhuang, Y., Huang, T.S. (eds) Multimedia Content Analysis and Mining. MCAM 2007. Lecture Notes in Computer Science, vol 4577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73417-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-73417-8_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73416-1
Online ISBN: 978-3-540-73417-8
eBook Packages: Computer ScienceComputer Science (R0)