research-article

Hierarchical modeling and adaptive clustering for real-time summarization of rush videos in trecvid'08

Authors:

Christian EckesAuthors Info & Claims

TVS '08: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

Pages 26 - 30

https://doi.org/10.1145/1463563.1463566

Published: 31 October 2008 Publication History

Abstract

In this paper, our techniques used in TRECVID'08 on BBC rush summarization are described. Firstly, rush videos are hierarchical modeled using formal language description. Then, shot detection and V-unit determination are applied for video structuring; junk frames within the model are also effectively removed. Thirdly, adaptive clustering is employed to group shots into clusters to remove retakes. Then, each selected shot is ranked according to its length and sum of activity level for summarization. Competitive results have proved the effectiveness and efficiency of our techniques fully implemented in compressed-domain.

References

[1]

Xu, L.-Q., Hanjalic, A. 2005. Affective video content representation and modelling. IEEE T-Multimedia. 7,1 (Feb. 2005), 143--154.

Digital Library

[2]

Ferman, A. M., and Tekalp, A. M. 2003. Two-stage hierarchical video summary extraction to match low-level user browsing preferences. IEEE T--Multimedia. 5, 2 (2003), 244--256.

Digital Library

[3]

Zhu, X., Elmagarmid, A. K., Xue, X., Wu, L., and Catlin, A. C. 2005. InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval. IEEE T-Multimedia. 7,4 (2005), 648--666.

Digital Library

[4]

Guironnet, M., Pellerin, D., Guyader, N., and Ladret, P. 2007. Video summarization based on camera motion and a subjective evaluation model. EURASIP J. Image and Video Processing. Article ID 60245.

[5]

Ma, Y. F., Lu, L., Zhang, H. J., and Li, M. 2002. A user attention model for video summarization. In Proc. the 10th ACM Int. Conf. Multimedia (Dec. 01--06, 2002), Juan-les-Pins, France, 533--542.

Digital Library

[6]

Money, A. G., and Agius, H. 2008. Video summarization: a conceptual framework and survey of the state of the art. J. Visual Commu. Image Repres. 19, 2 (Feb. 2008), 121--143.

Digital Library

[7]

Ngo, C. W., Ma, Y. F., Zhang, H. J. 2003. Automatic video summarization by graph modelling. In Proc. the 9th Int. Conf. Computer Vision (Oct. 13--16, 2003), Nice, France, 104--109.

Digital Library

[8]

Ray, S., and Turi, R. H. 1999. Determination of number clusters in K-means clustering and application in colour image segmentation. In Proc. the 4th Int. Conf. Advances in Pattern Recognition and Digital techniques (Dec. 27--29, 1999), Calcutta, India, 137--143.

[9]

Over, P., Smeaton, A. F., Awad, G. 2008. The TRECVID 2008 BBC rushes summarization evaluation. In Proc. of the Int. Workshop on TRECVID Video Summarization (TVS '08, Oct. 31, 2008), Vancouver, BC, Canada, 1--20.

Digital Library

[10]

Ren, J.-C., Jiang, J. M., and Chen, J. 2007. Determination of shot boundary in MPEG videos for TRECVID 2007. In TREC Video Retrieval Evaluation Online Proceedings, http://www-nlpir.nist.gov/ projects/tvpubs/tv7.papers/bradford.pdf.

[11]

Shi L., King, I., Lyu, M.R. 2004. Video summarization by video structure analysis and graph optimization. In Proceedings Int. Conf. Multimedia and Expo (June 27--30, 2004), Taipei, R.O.C., 1959--1962.

[12]

Truong, B. T., and Venkatesh, S. 2007. Video abstraction: a systematic review and classification. ACM T-Multimedia Computing Commun. Appl. 3,1, http://doi.acm.org/10.1145/1198302.1198305

Digital Library

[13]

Li, Y., Lee, S.-H., yeh, C.-H., and Kuo, C.-C. J. 2006. Techniques for movie content analysis and skimming. IEEE Signal Proc. Magaz., 23, 2(March 2006), 79--89.

[14]

Li, Z., Schuster, G. M., and Katsaggelos, A. K. 2005. Rate-distortion optimal video summary generation. IEEE Trans. Image Proc. 14, 10(Oct. 2005), 1550--1560.

Digital Library

[15]

Wang, T., Gao, Y., Li, J., Wang, P. P., Tong, X., Hu, W., Zhang, Y., Li, J. 2007. THU-ICRC at rush summarization of TRECVID 2007. In Proc. of the Int. Workshop on TRECVID Video Summarization (TVS '07, Sept. 28, 2007), Augsburg, Bavaria, Germany, 79--83.

Digital Library

Cited By

Gupta DSharma A(2023)A comprehensive study of automatic video summarization techniquesArtificial Intelligence Review10.1007/s10462-023-10429-z56:10(11473-11633)Online publication date: 13-Mar-2023
https://doi.org/10.1007/s10462-023-10429-z
Candir OKarsligil M(2016)Detection of the Periodicity of Human Actions for Efficient Video Summarization2016 IEEE International Symposium on Multimedia (ISM)10.1109/ISM.2016.0086(391-394)Online publication date: Dec-2016
https://doi.org/10.1109/ISM.2016.0086
Bhaumik HBhattacharyya SChakraborty S(2016)Redundancy Elimination in Video SummarizationImage Feature Detectors and Descriptors10.1007/978-3-319-28854-3_7(173-202)Online publication date: 23-Feb-2016
https://doi.org/10.1007/978-3-319-28854-3_7
Show More Cited By

Index Terms

Hierarchical modeling and adaptive clustering for real-time summarization of rush videos in trecvid'08

Recommendations

Hierarchical modeling and adaptive clustering for real-time summarization of rush videos

In this paper, we provide detailed descriptions of a proposed new algorithm for video summarization, which are also included in our submission to TRECVID'08 on BBC rush summarization. Firstly, rush videos are hierarchically modeled using the formal ...
Unsupervised summarization of rushes videos
MM '10: Proceedings of the 18th ACM international conference on Multimedia

This paper proposes a new framework to formulate summarization of rushes video as an unsupervised learning problem. We pose the problem of video summarization as one of time-series clustering, and proposed Constrained Aligned Cluster Analysis (CACA). ...
Rushes video summarization using audio-visual information and sequence alignment
TVS '08: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TVS '08: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop

October 2008

156 pages

ISBN:9781605583099

DOI:10.1145/1463563

General Chairs:
Paul Over
NIST, USA
,
Alan F. Smeaton
Dublin City University, Ireland

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 31, 2008

British Columbia, Vancouver, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
201
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gupta DSharma A(2023)A comprehensive study of automatic video summarization techniquesArtificial Intelligence Review10.1007/s10462-023-10429-z56:10(11473-11633)Online publication date: 13-Mar-2023
https://doi.org/10.1007/s10462-023-10429-z
Candir OKarsligil M(2016)Detection of the Periodicity of Human Actions for Efficient Video Summarization2016 IEEE International Symposium on Multimedia (ISM)10.1109/ISM.2016.0086(391-394)Online publication date: Dec-2016
https://doi.org/10.1109/ISM.2016.0086
Bhaumik HBhattacharyya SChakraborty S(2016)Redundancy Elimination in Video SummarizationImage Feature Detectors and Descriptors10.1007/978-3-319-28854-3_7(173-202)Online publication date: 23-Feb-2016
https://doi.org/10.1007/978-3-319-28854-3_7
Wang FNgo C(2012)Summarizing Rushes Videos by Motion, Object, and Event UnderstandingIEEE Transactions on Multimedia10.1109/TMM.2011.216553114:1(76-87)Online publication date: 1-Feb-2012
https://dl.acm.org/doi/10.1109/TMM.2011.2165531
Jiang JKohler JWilliams CZaletelj JGuntner GHorstmann HRen JLoffler JWeng Y(2011)LIVE: An Integrated Production and Feedback System for Intelligent and Interactive TV BroadcastingIEEE Transactions on Broadcasting10.1109/TBC.2011.215825257:3(646-661)Online publication date: Sep-2011
https://doi.org/10.1109/TBC.2011.2158252
Furini MGeraci FMontangero MPellegrini M(2010)STIMOMultimedia Tools and Applications10.1007/s11042-009-0307-746:1(47-69)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.1007/s11042-009-0307-7
Ren JJiang J(2009)Hierarchical modeling and adaptive clustering for real-time summarization of rush videosIEEE Transactions on Multimedia10.1109/TMM.2009.202178211:5(906-917)Online publication date: 1-Aug-2009
https://dl.acm.org/doi/10.1109/TMM.2009.2021782
Over PSmeaton AAwad GOver PSmeaton A(2008)The trecvid 2008 BBC rushes summarization evaluationProceedings of the 2nd ACM TRECVid Video Summarization Workshop10.1145/1463563.1463564(1-20)Online publication date: 31-Oct-2008
https://dl.acm.org/doi/10.1145/1463563.1463564

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten