Abstract
Key frame extraction has been recognized as one of the important research issues in video information retrieval. Until now, in spite of a lot of research efforts on the key frame extraction for video sequences, existing approaches cannot quantitatively evaluate the importance of extracted frames in representing the video contents. In this paper, we propose a new algorithm for key frame extraction using shot coverage and distortion. The algorithm finds significant key frames from candidate key frames. When selecting the candidate frames, the coverage rate for each frame to the whole frames in a shot is computed by using the difference between adjacent frames. The frames with the coverage rate within 10% from the top are regarded as the candidates. Then, by computing the distortion rate of a candidate against all frames, the most representative frame is selected as a key frame in the shot. The performance of the proposed algorithm has been verified by a statistical test. Experimental results show that the proposed algorithm improves the performance by 13 – 50% over the existing methods.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Idis, F., Panchanathan, S.: Review of Image and Video Indexing Technique. Journal of Visual Communication and Image Representation 8(2), 146–166 (1997)
Naphade, M.R., Ferman, A.M., Warnick, J., Huang, T.S., Tekalp, A.M.: A High-performance Shot Boundary Detection Algorithm Using Multiple Cues. Proc. of IEEE Int. Conf. on Image Processing, Vol. 1, 884–887 (1998)
Rui, Y., Huang, T.S., Mehrotra, S.: Exploring Video Structures beyond The Shots. In: Proc. of IEEE Int. Conf. Multimedia Computing and Systems, pp. 237–240 (1998)
Aigrain, P., Zhang, H., Petkovic, D.: Content-based Representation and Retrieval of Visual Media: A State-of-the-art Review. Multimedia Tools and Application 3, 179–202 (1996)
Zhuang, Y., Rui, Y., Huang, T.S., Mehrotra, S.: Adaptive Key Frame Extraction Using Unsupervised Clustering. In: Proc. of IEEE Int. Conf. on Image Processing, pp. 866–870 (1998)
Gresle, P.O., Huang, T.S.: Gisting of Video Documents: A Key Frames Selection Algorithm Using Relative Activity Measure. In: Proc. of the second Int. Conf. on Visual Information Systems, pp. 279–286 (1997)
Brunelli, R., Mich, O., Modena, C.M.: A Survey on The Automatic Indexing of Video Data. Journal of Visual Communication and Image Representation 10, 78–112 (1999)
Ju, X., Black, J.: Summarization of Videotaped Presentations: Automatic Analysis of Motion and Gesture. IEEE Trans. on Circuits and Systems for Video Technology 8(5), 686–696 (1998)
Nagasaga, A., Tanaka, Y.: Automatic Video Indexing and Full Video Search for Object Appearances. In: Proc. of Visual Database Systems, pp. 113–127 (1992)
Zhang, H., Wu, J., Zhong, D., Smoliar, S.W.: An Integrated System for Content based Video Retrieval and Browsing. Pattern Recognition 30(4), 643–658 (1997)
Wolf, W.: Key Frame Selection by Motion Analysis. In: Proc. of IEEE Int. Conf. on Acoustic, Speech, and Signal Processing, pp. 1228–1231 (1996)
Horn, B.K.P., Schunk, B.G.: Determining Optical Flow. Artificial Intelligence 17, 185–203 (1981)
Han, K.J., Tewfik, A.H., Eigen, L.: Image based Video Segmentation and Indexing. In: Proc. of IEEE Int. Conf. on Image Processing, vol. 2, pp. 26–29 (1997)
Vlachos, T.: Cut Detection in Video Sequences Using Phase Correlation. IEEE signal Processing Letters 7(7), 173–175 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, K.T., Lee, J.Y., Rim, K.W., Moon, Y.S. (2005). Key Frame Extraction Based on Shot Coverage and Distortion. In: Ho, YS., Kim, HJ. (eds) Advances in Multimedia Information Processing - PCM 2005. PCM 2005. Lecture Notes in Computer Science, vol 3768. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11582267_26
Download citation
DOI: https://doi.org/10.1007/11582267_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30040-3
Online ISBN: 978-3-540-32131-6
eBook Packages: Computer ScienceComputer Science (R0)