Skip to main content
SpringerLink
Log in

Rushes video summarization and evaluation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

During the post-production stage of film making, the film editor is faced with large amounts of unedited raw material, called rushes. Developing tools to view and organize this material is an important component of video processing. This paper describes an approach for summarizing rushes video based on the detection of repetitive sequences, using a variant of the Smith-Waterman algorithm to find matching subsequences. We rely on the evaluation methodology that has been introduced in the TRECVID BBC Rushes Summarization Task. We propose an automation of the manual TRECVID evaluation using machine learning techniques to train an automatic assessor. We compare the automatic assessor evaluation to the evaluations provided by the TRECVID manual assessors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Bailer W, Lee F, Thallinger G (2009) A distance measure for repeated takes of one scene. Vis Comput 25:53–68

    Article  Google Scholar 

  2. Benmokhtar R, Dumont E, Mérialdo B, Huet B (2006) Eurecom In: TrecVid 2006: high level features extractions and rushes study. TrecVid 2006, 10th international workshop on video retrieval evaluation, November 2006, Gaithersburg, USA

  3. Chasanis V, Likas A, Galatsanos NP (2008) Video rushes summarization using spectral clustering and sequence alignment. In: TRECVID BBC rushes summarization workshop (TVS’08), ACM international conference on multimedia, Vancouver, pp 75–79

  4. Detyniecki M, Marsala C (2008) Adaptive acceleration and shot stacking for video rushes summarization. In: Proceedings of the TRECVID workshop on video summarization (TVS’08), Vancouver

  5. Dumont E, Mérialdo B (2007) Split-screen dynamically accelerated video summaries. In: MM 2007, 15th international ACM conference on multimedia, September 24–29, 2007, Augsburg

  6. Dumont E, Mérialdo B (2008) Automatic evaluation method for rushes summarization: experimentation and analysis. In: CBMI 2008, 6th international workshop on content-based multimedia indexing, June 18–20, 2008, London

  7. Ekin A, Tekalp AM, Mehrotra R (2003) Automatic soccer video analysis and summarization. IEEE Trans Image Process 12(7):796–807

    Article  Google Scholar 

  8. Ferman AM, Tekalp AM (2003) Two-stage hierarchical video summary extraction to match low-level user browsing preferences. IEEE Trans Multimedia 5(2):244–256

    Article  Google Scholar 

  9. Hauptmann AG, Christel MG, Lin W-H, Maher B, Yang J, Baron RV, Xiang G (2007) Clever clustering vs. simple speed-up for summarizing rushes. In: TVS ’07: Proceedings of the international workshop on TRECVID video summarization, Augsburg

  10. Liu Y, Liu Y, Ren T, Chan KCC (2008) Rushes video summarization using audio-visual information and sequence alignment. In: TRECVID BBC rushes summarization workshop (TVS’08), ACM international conference on multimedia, Vancouver, pp 114–118

  11. Money A, Agius H (2007) Video summarisation: a conceptual framework and survey of the state of the art. J Vis Commun Image Represent 19:121–143

    Article  Google Scholar 

  12. Needleman S, Wunsch C (1970) A general method applicable to the search for similarities in the amino acid sequence of two proteins. J Mol Biol 48:443–453

    Article  Google Scholar 

  13. Over P, Smeaton AF, Awad G (2008) The TRECVID 2008 BBC rushes summarization evaluation. In: Proceedings of the TRECVID workshop on video summarization (TVS’08), Vancouver

  14. Smith TF, Waterman MS (1981) Identification of common molecular subsequences. J Mol Biol 147:195–197

    Article  Google Scholar 

  15. Taskiran CM (2006) Evaluation of automatic video summarization systems. In: Chang EY, Hanjalic A, Sebe N (eds) Multimedia content analysis, management, and retrieval 2006. SPIE

  16. Truong BT, Venkatesh S (2007) Video abstraction: a systematic review and classification. ACM Trans Multimedia Comput Commun Appl 3(1)

  17. Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques. In: 2nd Edition. Morgan Kaufmann, San Francisco

Download references

Author information

Authors and Affiliations

  1. Multimedia Department, Institut Eurecom, 2229 route des Crêtes – BP 193, 06904, Sophia-Antipolis CEDEX, France

    Emilie Dumont & Bernard Mérialdo

Authors
  1. Emilie Dumont
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernard Mérialdo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bernard Mérialdo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dumont, E., Mérialdo, B. Rushes video summarization and evaluation. Multimed Tools Appl 48, 51–68 (2010). https://doi.org/10.1007/s11042-009-0374-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0374-9

Keywords

Search

Navigation