Skip to main content
SpringerLink
Log in

A framework for video abstraction systems analysis and modelling from an operational point of view

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Nowadays the huge amount of video material stored in multimedia repositories makes its search and retrieval a very slow and usually difficult task. Existing video abstraction systems aim to relieve this problem by providing short versions of the original content which ease the search and navigation processes and reduce the browsing time. There are many approaches for video abstraction based on the optimal selection and presentation of a subset of fragments (keyframes, shots, etc.) from the original video attending to different criteria, usually dependent on the application scenario. Nevertheless, given the huge size and growth rate of existing video repositories there is an increasing need for providing efficient techniques. This paper presents a unified taxonomy and a generic architectural model aimed for the study of existing abstraction systems computational performance and characteristics. The taxonomy has been developed taking into account and identifying the operative characteristics of current state of the art video abstraction techniques. The proposed video abstraction architecture model characterizes the stages needed to build a generic abstraction process and establishes the basic architectural aspects and requirements for the modeling of systems with specific operative requirements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. www.youtube.com

  2. www.metacafe.com

  3. www.break.com

  4. www.dailymotion.com

  5. video.google.com

  6. www.imeem.com

  7. www.open-video.org

  8. www.open-video.org

References

  1. Albanese M, Fayzullin M, Picariello A, Subrahmanian VS (2006) The priority curve algorithm for video summarization. Inf Syst 31(7):679–695

    Article  Google Scholar 

  2. Beran V et al (2007) Video summarization at Brno University of Technology. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 16–19

  3. Byrne D et al (2007) A user-centered approach to rushes summarisation via highlight-detected keyframes. In: Proc of. ACM multimedia 2007 (TVS workshop), pp 35–39

  4. Chang HS, Sull S, Lee SU (1999) Efficient video indexing scheme for content-based retrieval. IEEE Trans Circuits Syst Video Technol 9(8):1269–1279

    Article  Google Scholar 

  5. Chen F, Cooper M, Adcock J (2007) Video summarization preserving dynamic content. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 40–44

  6. Chen F, Adcock J, Cooper M (2008) A simplified approach to rushes summarization. In: Proc. of ACM multimedia 2008 (TVS workshop), pp 60–64

  7. Christel MG (2006) Evaluation and user studies with respect to video summarization and browsing. In: Proc. of SPIE, vol 6073, pp 196–210

  8. Christel MG, Hauptmann AG, Lin W-H, Chen M-Y, Yang J, Maher B, Baron RV (2008) Exploring the utility of fast-forward surrogates for BBC rushes. In: Proc. of ACM multimedia 2008 (TVS workshop), pp 35–39

  9. Ciocca G, Schettini R (2004) Dynamic key-frame extraction for video summarization. In: Proc. of SPIE, vol 5670, pp 137–142

  10. Ciocca G, Schettini R (2006) An innovative algorithm for key frame extraction in video summarization. Journal of Real-Time Image Processing 1(1):69–88

    Article  Google Scholar 

  11. Divakaran A, Radhakrishnan R, Peker KA (2002) Motion activity-based extraction of key-frames from video shots. In: Proc. of ICIP2002, pp 932–935

  12. Doulamis ND, Doulamis AD, Avrithis YS, Kollias SD (1998) Video content representation using optimal extraction of frames and scenes. In: Proc. of ICIP 1998, vol 1, pp 875–879

  13. Dumont E, Merialdo B (2007) Split-screen dynamically accelerated video summaries. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 55–59

  14. Dundaram H, Chang S-F (2001) Condensing computable scenes using visual complexity and film syntax analysis. In: Proc. of ICME2001, pp 273–276

  15. Fayzullim M, Subrahmanian VS, Picariello A, Sapino ML (2003) The CPR model for summarizing video. In: Proc. of ACM multimedia databases 2003, pp 2–9

  16. Günsel B, Tekalp AM (1998) Content-based video abstraction. In: Proc. of ICIP 1998, vol 3, pp 128–132

  17. Hanjalic A, Zhang HJ (1999) An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis. IEEE Trans Circuits Syst Video Technol 9(8):1280–1289

    Article  Google Scholar 

  18. Hauptmann AG, Christel MG, Lin WH, Maher B, Yang J, Baron RV, Xiang G (2007) Clever clustering vs. simple speed-up for summarizing BBC rushes. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 94–98

  19. Hua XS, Lu L, Zhang HJ (2004) Optimization-based automated home video editing system. IEEE Trans Circuits Syst Video Technol 14(5):572–583

    Article  Google Scholar 

  20. Hun-Cheol L, Seong-Dae K (2003) Iterative keyframe selection in the rate-constraint environment. Signal Process Image Commun 18(1):1–15

    Article  Google Scholar 

  21. Kalic J, Izquierdo E (2002) Efficient key-frame extraction and video analysis. in: Proc. of ITCC2002, pp 28–33

  22. Keblan J et al (2007) Feature fusion and redundancy pruning for rush video summarization. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 84–88

  23. Koskela M et al (2007) Rushes summarization with self-organizing maps. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 45–49

  24. Latecki LJ, DeMenthon D, Rosenfeld A (2001) Extraction of key frames from videos by polygon simplification. In: Proc. of signal processing and its applications 2001, pp 643–646

  25. Li B, Pan H, Sezan I (2003) A general framework for sports video summarization with its application to soccer. In: Proc. of ICASSP 2003, vol 3, pp 169–172

  26. Li Z, Schuster GM, Katsaggelos AK, Ghandi B (2005) Rate-distortion optimal video summary generation. IEEE Trans Image Process 14(10):1550–1560

    Article  Google Scholar 

  27. Li Y, Lee S-H, Yeh C-H, Jay Cuo C-C (2006) Techniques for movie content analysis and skimming. IEEE Signal Process Mag 23(2):79–89

    Article  MATH  Google Scholar 

  28. Lienhart R, Pfeiffer S, Effelsberg W (1997) Video abstracting. Commun ACM 40(12):54–62

    Article  Google Scholar 

  29. Liu T, Kender JR (2002) Optimization algorithms for the selection of key frame sequences of variable length. In: Proc. of ECCV 2002, pp 403–417

  30. Liu T, Zhang H-J, Qi F (2003) A novel video key-frame-extraction algorithm based on perceived motion energy model. IEEE Trans Circuits Syst Video Technol 13(10):1006–1013

    Article  Google Scholar 

  31. Liu Z, Shahraray B, Gibbon D, Basso A (2008) Brief and high-interest video summary generation: evaluating the AT&T labs rushes summarizations. In: Proc. of ACM multimedia 2008 (TVS Workshop), pp 21–25

  32. Ma YF, Zhang HJ, Li M (2002) A user attention model for video summarization. In: Proc. of ACM multimedia 2002, pp 533–542

  33. Money AG, Agius H (2008) Video summarization: a conceptual framework and survey of the state of the art. J Vis Commun Image Represent 19(2):121–143

    Article  Google Scholar 

  34. Nam J, AHTewfik (1999) Video abstract of video. In: Proc. of MSP’99, pp 117–122

  35. Over P, Smeaton AF, Kelly P (2007) The TRECVID 2007 BBC rushes summarization evaluation pilot. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 1–15

  36. Over P, Smeaton AF, Awad G (2008) The TRECVID 2008 BBC rushes summarization evaluation. In: Proc. of ACM multimedia 2008 (TVS workshop), pp 1–20

  37. Ratakonda K, Sezan MI, Crinon RJ (1999) Hierarchical video summarization. In: Proc. of SPIE, vol 3653, p 1531–1541

  38. Troung BT, Venkatesh S (2007) Video abstraction: a systematic review and classification. ACM Transactions on Multimedia Computing, Communications and Applications 3(1, 3):1–37

    Google Scholar 

  39. Uchihashi S, Foote J, Gingersohn A, Boreczky J (1999) Video manga: generating semantically meaningful video summaries. In: Proc. of ACM multimedia 1999, pp 383–392

  40. Valdés V, Martínez JM (2007) On-line video skimming based on histogram similarity. In: Proc. of ACM multimedia 2007 (TVS workshop), pp 94–98

  41. Valdés V, Martínez JM (2007) Post-processing techniques for on-line adaptive video summarization based on relevance curves. In: Semantic media and digital media technologies-SAMT07, lecture notes in computer science, vol 4816. Springer, New York, pp 144–157

    Google Scholar 

  42. Valdés V, Martínez JM (2008) On-line video summarization based on signature-based junk and redundancy filtering. In: Proc.of WIAMIS’08, pp 88–91

  43. Wildemuth BM, et al (2003) How fast is too fast? Evaluating fast forward surrogates for digital video. in: Proc. of DL2003, pp 221–230

  44. Xiong Z, Radhakrishnan R, Divakaran A (2003) Generation of sports highlights using motion activity in combination with a common audio feature extraction framework. In: Proc. of ICIP2003, vol 1, pp 5–8

  45. Yu XD, Wang L, Tian Q, Xue P (2004) Multi-level video representation with application to keyframe extraction. In: Proc. of MMM2004, p 117–123

  46. Zhuang Y, Rui Y, Huang TS, Mehrotra S (1998) Adaptive key frame extraction using unsupervised clustering. In: Proc. of ICIP1998, pp 866–870

Download references

Acknowledgements

Work supported by the European Commission (IST-FP6-027685—Mesh), Spanish Government (TEC2007-65400—SemanticVideo) and Comunidad de Madrid (S-0505/TIC-0223—ProMultiDis-CM), by the Consejería de Educación of the Comunidad de Madrid and by the European Social Fund.

Author information

Authors and Affiliations

  1. Escuela Politécnica Superior, Universidad Autónoma de Madrid, C/Francisco Tomás y Valiente 11, 28049, Madrid, Spain

    Víctor Valdés & José M. Martínez

Authors
  1. Víctor Valdés
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. José M. Martínez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Víctor Valdés.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Valdés, V., Martínez, J.M. A framework for video abstraction systems analysis and modelling from an operational point of view. Multimed Tools Appl 49, 7–35 (2010). https://doi.org/10.1007/s11042-009-0392-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0392-7

Keywords

Search

Navigation