ABSTRACT
We propose an innovative, general purpose, approach to the selection and hierarchical representation of key frames of a video sequence for video summarization. In the first stage the shot detection module performs the video structural analysis; in the second stage the key frame extraction module creates the visual summary; and the last stage the summary post-processing module, after a pre-a classification aimed remove meaningless key frames, create a multilevel storyboard that the user may browse.
- Agraim P., Zhang H., Petkovic D., "Content-Based Representation and Retrieval of Visual Media: A State of the Art review", Multimedia Tools and Applications, vol. 3, pp. 179--202, 1996.Google ScholarCross Ref
- Breiman L., Friedman J. H., Olshen R. A.and Stone C. J., Classification and Regression Trees, (Wadsworth and Brooks/Cole), 1984.Google Scholar
- Chetverikov D. and Szabo Zs. "A Simple and Efficient Algorithm for Detection of High Curvature Points in Planar Curves", Proc. 23rd Workshop of the Austrian Pattern Recognition Group, pp. 175--184, 1999.Google Scholar
- Ciocca G., Gagliardi I., Schettini R. "Quicklook2: An Integrated Multimedia System", International Journal of Visual Languages and Computing, Special issue on Querying Multiple Data Sources, vol. 12. pp. 81--103, 2001.Google ScholarCross Ref
- Corchs S., Deco G., "Large-scale neural model for visual attention: integration of experimental single-cell and fMRI data", Cerebral Cortex, vol. 12, pp. 339--348, 2002.Google ScholarCross Ref
- Deng Y.N., Henny C., Moore M.S., Manjunath B.S., "Peer group filtering and perceptual color quantization", IEEE Int. Symposium on Circuits and Systems, vol. 4, pp. 21--24, 1999.Google Scholar
- Divakaran A., Cabasson R., "Content Based Browsing System for Personal Video Recorders", Proc. Int. Conference on Consumer Electronics, pp. 114--115, 2002.Google Scholar
- Fernando W. A. C., Canaharajah C. N., Bull D. R., "Fade-In and Fade-Out Detection in Video Sequences Using Histograms", Proc. ISCAS 2000 -- IEEE International Symposium on Circuits and System, IV 709--712, Geneva, Switzerland, 2000.Google Scholar
- Fisher R.A., "The use of multiple measures in taxonomic problems", Ann. Eugenics, vol. 7, pp.179--188, 1936.Google ScholarCross Ref
- Gonzalez R., Woods R., Digital Image Processing, Addison Wesley, pp. 414--428, 1992. Google ScholarDigital Library
- Idris F., Panchanathan S., "Storage and retrieval of compressed images using wavelet vector quantization", Journal of Visual Languages and Computing,vol. 8, pp. 289--301, 1997.Google ScholarCross Ref
- Kenney C., Deng Y.N., Manjunath B.S., Hewer G., "Peer Group image enhancement", IEEE Trans. Image Processing, 10(2), 326--334, 2001. Google ScholarDigital Library
- Lee J.H., Lee G.G., Kim W.Y. "Automatic Video Summarization Tool using MPEG-7 Descriptors for Personal Video Recorder", IEEE Transaction on Consumer Electronics, Vol. 49, No. 3, pp.742--249, 2003 Google ScholarDigital Library
- Lu H., Tan Y.P., "Unsupervised clustering of dominant scenes in sports video", Pattern Recognition Letters, vol. 24, pp. 2651--2662, 2003. Google ScholarDigital Library
- Rumelhart D.E., Hinton G.E., Williams R.J., "Learning Internal Representations by Error Propagation", Parallel Distributed Processing, MIT Press, Cambridge, MA, Volume 1, pp. 318--362, 1986. Google ScholarDigital Library
- Schettini R., Brambilla C., Cusano C., Ciocca G., "Automatic classification of digital photographs based on decision forests", Int. J. of Pattern Recognition and Artificial Intelligence, vol. 18(5), pp. 819--846, 2004.Google ScholarCross Ref
- Scheunders P., Livens S., Van de Wouwer G., Vautrot P., Van Dyck D. "Wavelet-based texture analysis", Int. Journal Computer Science and Information management, vol. 1(2), pp. 22--34, 1998.Google Scholar
- URL: Archivio di Etnografie e Storia Sociale, Regione Lombardia (AESS Archive): http://aess.itc.cnr.it/index.htm.Google Scholar
- Vercauteren D., Quality assurance for digital camera images, EPFL-IVRG Project Report, 2003.Google Scholar
Index Terms
- Dynamic storyboards for video content summarization
Recommendations
Exploring video content structure for hierarchical summarization
In this paper, we propose a hierarchical video summarization strategy that explores video content structure to provide the users with a scalable, multilevel video summary. First, video-shot- segmentation and keyframe-extraction algorithms are applied to ...
A Dynamic Reconstruction Approach to Topic Summarization of User-Generated-Content
CIKM '14: Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge ManagementUser generated contents (UGCs) from various social media sites give analysts the opportunity to obtain a comprehensive and dynamic view of any topic from multiple heterogeneous information sources. Summarization provides a promising means of distilling ...
Hierarchical video summarization in reference subspace
In this paper, a hierarchical video structure summarization approach using Laplacian Eigenmap is proposed, where a small set of reference frames is selected from the video sequence to form a reference subspace to measure the dissimilarity between two ...
Comments