skip to main content
10.1145/1178677.1178713acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Dynamic storyboards for video content summarization

Published:26 October 2006Publication History

ABSTRACT

We propose an innovative, general purpose, approach to the selection and hierarchical representation of key frames of a video sequence for video summarization. In the first stage the shot detection module performs the video structural analysis; in the second stage the key frame extraction module creates the visual summary; and the last stage the summary post-processing module, after a pre-a classification aimed remove meaningless key frames, create a multilevel storyboard that the user may browse.

References

  1. Agraim P., Zhang H., Petkovic D., "Content-Based Representation and Retrieval of Visual Media: A State of the Art review", Multimedia Tools and Applications, vol. 3, pp. 179--202, 1996.Google ScholarGoogle ScholarCross RefCross Ref
  2. Breiman L., Friedman J. H., Olshen R. A.and Stone C. J., Classification and Regression Trees, (Wadsworth and Brooks/Cole), 1984.Google ScholarGoogle Scholar
  3. Chetverikov D. and Szabo Zs. "A Simple and Efficient Algorithm for Detection of High Curvature Points in Planar Curves", Proc. 23rd Workshop of the Austrian Pattern Recognition Group, pp. 175--184, 1999.Google ScholarGoogle Scholar
  4. Ciocca G., Gagliardi I., Schettini R. "Quicklook2: An Integrated Multimedia System", International Journal of Visual Languages and Computing, Special issue on Querying Multiple Data Sources, vol. 12. pp. 81--103, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  5. Corchs S., Deco G., "Large-scale neural model for visual attention: integration of experimental single-cell and fMRI data", Cerebral Cortex, vol. 12, pp. 339--348, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  6. Deng Y.N., Henny C., Moore M.S., Manjunath B.S., "Peer group filtering and perceptual color quantization", IEEE Int. Symposium on Circuits and Systems, vol. 4, pp. 21--24, 1999.Google ScholarGoogle Scholar
  7. Divakaran A., Cabasson R., "Content Based Browsing System for Personal Video Recorders", Proc. Int. Conference on Consumer Electronics, pp. 114--115, 2002.Google ScholarGoogle Scholar
  8. Fernando W. A. C., Canaharajah C. N., Bull D. R., "Fade-In and Fade-Out Detection in Video Sequences Using Histograms", Proc. ISCAS 2000 -- IEEE International Symposium on Circuits and System, IV 709--712, Geneva, Switzerland, 2000.Google ScholarGoogle Scholar
  9. Fisher R.A., "The use of multiple measures in taxonomic problems", Ann. Eugenics, vol. 7, pp.179--188, 1936.Google ScholarGoogle ScholarCross RefCross Ref
  10. Gonzalez R., Woods R., Digital Image Processing, Addison Wesley, pp. 414--428, 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Idris F., Panchanathan S., "Storage and retrieval of compressed images using wavelet vector quantization", Journal of Visual Languages and Computing,vol. 8, pp. 289--301, 1997.Google ScholarGoogle ScholarCross RefCross Ref
  12. Kenney C., Deng Y.N., Manjunath B.S., Hewer G., "Peer Group image enhancement", IEEE Trans. Image Processing, 10(2), 326--334, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Lee J.H., Lee G.G., Kim W.Y. "Automatic Video Summarization Tool using MPEG-7 Descriptors for Personal Video Recorder", IEEE Transaction on Consumer Electronics, Vol. 49, No. 3, pp.742--249, 2003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Lu H., Tan Y.P., "Unsupervised clustering of dominant scenes in sports video", Pattern Recognition Letters, vol. 24, pp. 2651--2662, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Rumelhart D.E., Hinton G.E., Williams R.J., "Learning Internal Representations by Error Propagation", Parallel Distributed Processing, MIT Press, Cambridge, MA, Volume 1, pp. 318--362, 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Schettini R., Brambilla C., Cusano C., Ciocca G., "Automatic classification of digital photographs based on decision forests", Int. J. of Pattern Recognition and Artificial Intelligence, vol. 18(5), pp. 819--846, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  17. Scheunders P., Livens S., Van de Wouwer G., Vautrot P., Van Dyck D. "Wavelet-based texture analysis", Int. Journal Computer Science and Information management, vol. 1(2), pp. 22--34, 1998.Google ScholarGoogle Scholar
  18. URL: Archivio di Etnografie e Storia Sociale, Regione Lombardia (AESS Archive): http://aess.itc.cnr.it/index.htm.Google ScholarGoogle Scholar
  19. Vercauteren D., Quality assurance for digital camera images, EPFL-IVRG Project Report, 2003.Google ScholarGoogle Scholar

Index Terms

  1. Dynamic storyboards for video content summarization

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              MIR '06: Proceedings of the 8th ACM international workshop on Multimedia information retrieval
              October 2006
              344 pages
              ISBN:1595934952
              DOI:10.1145/1178677

              Copyright © 2006 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 26 October 2006

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • Article

              Upcoming Conference

              MM '24
              MM '24: The 32nd ACM International Conference on Multimedia
              October 28 - November 1, 2024
              Melbourne , VIC , Australia

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader