research-article

Rushes video summarization using audio-visual information and sequence alignment

Authors:

Yang Liu,

Yan Liu,

Tongwei Ren,

Keith C.C. ChanAuthors Info & Claims

TVS '08: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

Pages 114 - 118

https://doi.org/10.1145/1463563.1463584

Published: 31 October 2008 Publication History

Get Access

Abstract

This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary generation. First, we segment the original rushes video into subshots according to the difference and accumulative difference of local color histogram between consecutive frames. Second, we recognize the irrelevant subshots, such as subshots of color bar, pure gray frames, and clapper board. We propose a novel video sequence alignment algorithm to detect repetitive subshots. After removing the irrelevant and repetitive subshots, we generate the final summary using the remaining informative and representative subshots. The evaluation from TRECVID 2008 shows that our system can generate good video summaries.

References

[1]

Takao, S., Haru, T., and Ariki, Y. Summarization of News Speech with Unknown Topic Boundary. In Proceedings of the IEEE International Conference on Multimedia and Expo. pp: 615--618, 2001.

Crossref

Google Scholar

[2]

Ekin, A., Tekalp, A. M., and Mehrotra, R. Automatic Soccer Video Analysis and Summarization. IEEE Transactions on Image Processing. vol. 12, no. 7, pp. 796--807, July 2003.

Digital Library

Google Scholar

[3]

Choudary, C. and Liu. T.-C. Summarization of Visual Content in Instructional Videos. IEEE Transactions on Multimedia. vol. 9, no. 7, pp. 1443--1455, Nov. 2007.

Digital Library

Google Scholar

[4]

Over, P., Smeaton, A. F., and Kelly, P. The TRECVID 2008 BBC rushes summarization evaluation. In Proceedings of the International Workshop on TRECVID Video Summarization (TVS'08), Vancouver, British Columbia, Canada, October 31, 2008, ACM Press, New York, NY, pp. 1--20, 2008.

Digital Library

Google Scholar

[5]

Zhang, H. J., Kankanhalli, A., and Smoliar, S.W. Automatic Partitioning of Full-Motion Video. Journal of Multimedia Systems 1, 10--28. 1993.

Digital Library

Google Scholar

[6]

Liu, Y., Liu, Y., and Zhang, Y. The Hong Kong Polytechnic University at TRECVID 2007 BBC Rushes Summarization. In Proceedings of the International Workshop on TRECVID Video Summarization (TVS'07), Augsburg, Bavaria, Germany, September 28, 2007, ACM Press, New York, NY, 2007.

Digital Library

Google Scholar

[7]

Pfeiffer, S., Lienhart, R., Fischer, S., and Effelsberg, W. Abstracting Digital Movies Automatically. Journal of Visual Communication and Image Representation, 7, 4, pp: 345--353. Dec. 1996.

Crossref

Google Scholar

[8]

Yan, J. X, Dou, W. B., and Dong, Z. W. Time-Domain Detection Method of Transient Signals in Audio Coding. Journal of Electronics & Information Technology, vol. 28, no. 2, Feb. 2006.

Google Scholar

[9]

Chang, C. C. and Lin, C. J. LIBSVM: a library for support vector machines, 2001.

Google Scholar

[10]

Manjunath, B. S., Ohm, J. R., Vasudevan, V. V., and Yamada, A. Color and Texture Descriptors. IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, pp. 703--715, 2001.

Digital Library

Google Scholar

[11]

Needleman, S. and Wunsch, C. A General Method Applicable to the Search for Similarities in the Amino Acid Sequence of Two Proteins. Journal of Molecular Biology, vol. 48, no. 3, pp. 443--453, 1970.

Crossref

Google Scholar

Cited By

View all

Apostolidis EApostolidis KPatras IMezaris V(2019)Video Fragmentation and Reverse Search on the WebVideo Verification in the Fake News Era10.1007/978-3-030-26752-0_3(53-90)Online publication date: 18-Sep-2019
https://doi.org/10.1007/978-3-030-26752-0_3
Apostolidis KApostolidis EMezaris V(2018)A Motion-Driven Approach for Fine-Grained Temporal Segmentation of User-Generated VideosMultiMedia Modeling10.1007/978-3-319-73603-7_3(29-41)Online publication date: 13-Jan-2018
https://doi.org/10.1007/978-3-319-73603-7_3
Teyssou DLeung JApostolidis EApostolidis KPapadopoulos SZampoglou MPapadopoulou OMezaris VMezaris VNixon LPapadopoulos SSpangenberg J(2017)The InVID Plug-inProceedings of the First International Workshop on Multimedia Verification10.1145/3132384.3132387(23-30)Online publication date: 27-Oct-2017
https://dl.acm.org/doi/10.1145/3132384.3132387
Show More Cited By

Index Terms

Rushes video summarization using audio-visual information and sequence alignment

Recommendations

Rushes video summarization and evaluation

During the post-production stage of film making, the film editor is faced with large amounts of unedited raw material, called rushes. Developing tools to view and organize this material is an important component of video processing. This paper describes ...
Rushes video summarization using a collaborative approach
TVS '08: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

This paper describes the video summarization system developed by the partners of the K-Space European Network of Excellence for the TRECVID 2008 BBC rushes summarization evaluation. We propose an original method based on individual content segmentation ...
Sequence alignment for redundancy removal in video rushes summarization
TVS '08: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

In this paper, we describe our approach to the TRECVID 2008 BBC Rushes Summarization task. First, we remove junk frames and dynamically accelerate videos according to their motion activity to maximize the content per time unit. Then, we search identical ...

Comments

Information & Contributors

Information

Published In

TVS '08: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

October 2008

156 pages

ISBN:9781605583099

DOI:10.1145/1463563

General Chairs:
Paul Over
NIST, USA
,
Alan F. Smeaton
Dublin City University, Ireland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 31, 2008

British Columbia, Vancouver, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
206
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Apostolidis EApostolidis KPatras IMezaris V(2019)Video Fragmentation and Reverse Search on the WebVideo Verification in the Fake News Era10.1007/978-3-030-26752-0_3(53-90)Online publication date: 18-Sep-2019
https://doi.org/10.1007/978-3-030-26752-0_3
Apostolidis KApostolidis EMezaris V(2018)A Motion-Driven Approach for Fine-Grained Temporal Segmentation of User-Generated VideosMultiMedia Modeling10.1007/978-3-319-73603-7_3(29-41)Online publication date: 13-Jan-2018
https://doi.org/10.1007/978-3-319-73603-7_3
Teyssou DLeung JApostolidis EApostolidis KPapadopoulos SZampoglou MPapadopoulou OMezaris VMezaris VNixon LPapadopoulos SSpangenberg J(2017)The InVID Plug-inProceedings of the First International Workshop on Multimedia Verification10.1145/3132384.3132387(23-30)Online publication date: 27-Oct-2017
https://dl.acm.org/doi/10.1145/3132384.3132387
Tran QLe DDuong DSatoh S(2013)A Classification-Based Approach for Retake and Scene Detection in Rushes VideoNeural Information Processing10.1007/978-3-642-42051-1_75(608-615)Online publication date: 2013
https://doi.org/10.1007/978-3-642-42051-1_75
Wang FNgo C(2012)Summarizing Rushes Videos by Motion, Object, and Event UnderstandingIEEE Transactions on Multimedia10.1109/TMM.2011.216553114:1(76-87)Online publication date: 1-Feb-2012
https://dl.acm.org/doi/10.1109/TMM.2011.2165531
Tanapichet PCooharojananone NLipikorn R(2011)Automatic comic strip generation using extracted keyframes from cartoon animation2011 International Symposium on Intelligent Signal Processing and Communications Systems (ISPACS)10.1109/ISPACS.2011.6146180(1-6)Online publication date: Dec-2011
https://doi.org/10.1109/ISPACS.2011.6146180
Dumont EMérialdo B(2010)Rushes video summarization and evaluationMultimedia Tools and Applications10.1007/s11042-009-0374-948:1(51-68)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1007/s11042-009-0374-9
Dumont EMerialdo B(2009)Rushes Video Parsing Using Video Sequence AlignmentProceedings of the 2009 Seventh International Workshop on Content-Based Multimedia Indexing10.1109/CBMI.2009.49(44-49)Online publication date: 3-Jun-2009
https://dl.acm.org/doi/10.1109/CBMI.2009.49
Over PSmeaton AAwad GOver PSmeaton A(2008)The trecvid 2008 BBC rushes summarization evaluationProceedings of the 2nd ACM TRECVid Video Summarization Workshop10.1145/1463563.1463564(1-20)Online publication date: 31-Oct-2008
https://dl.acm.org/doi/10.1145/1463563.1463564

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Rushes video summarization and evaluation

Rushes video summarization using a collaborative approach

Sequence alignment for redundancy removal in video rushes summarization

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations