Abstract
We present a novel constraint-based keyframe extraction technique, Key Probe. Based on animator-specified constraints, the method converts a skeleton-based motion or animated mesh to a keyframe-based representation. In contrast to previous curve simplification or clustering methods, we cast the keyframe extraction problem as a constrained matrix factorization problem and solve the problem based on the least-squares optimization technique. The extracted keyframes have two uses: they could be used for browsing or they may be blended to reconstruct all other frames of an animation. Our approach is general and suitable for both rigid-body and soft-body animations. Experiments on various types of animation examples show that the proposed method produces remarkable results in terms of quality and compression ratio. Empirical tests also show that our algorithm consistently offers better efficiency than those by principal component analysis (PCA) and independent component analysis (ICA).
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alexa, M., Müller, W.: Representing animations by principal components. Comput. Graph. Forum 19(3), 411–418 (2000)
Arikan, O., Forsyth, D.A.: Interactive motion generation from examples. ACM Trans. Graph. 21(3), 483–490 (2002)
Arikan, O., Forsyth, D.A., O’Brien, J.F.: Motion synthesis from annotations. ACM Trans. Graph. 22(3), 402–408 (2003)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3d faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194. ACM Press/Addison-Wesley, New York (1999)
Briceño, H.M., Sander, P.V., McMillan, L., Gortler, S., Hoppe, H.: Geometry videos: a new representation for 3d animations. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 136–146. Eurographics Association, Aire-la-Ville, Switzerland (2003)
Chao, S.P., Chiu, C.Y., Yang, S.N., Lin, T.G.: Tai chi synthesizer: a motion synthesis framework based on key-postures and motion instructions. Comput. Animat. Virtual Worlds 15(3–4), 259–268 (2004)
Cooper, M., Foote, J.: Summarizing video using non-negative similarity matrix factorization. In: IEEE Workshop on Multimedia Signal Processing, pp. 25– 28 (2002)
DeMenthon, D., Kobla, V., Doermann, D.: Video summarization by curve simplification. In: Proceedings of the 6th ACM International Conference on Multimedia, pp. 211–218. ACM Press, New York (1998)
Dimitrova, N., McGee, T., Elenbaas, H.: Video keyframe extraction and filtering: a keyframe is not a keyframe to everyone. In: Proceedings of the 6th International Conference on Information and Knowledge Management, pp. 113–120. ACM Press, New York (1997)
Girgensohn, A., Boreczky, J.: Time-constrained keyframe selection technique. Multimedia Tools Appl. 11(3), 347–358 (2000)
Golub, G.H., Loan, C.F.V.: Matrix Computations. Johns Hopkins University Press, Baltimore, MD (1996)
Gong, Y., Liu, X.: Video summarization using singular value decomposition. In: Computer Vision and Pattern Recognition, pp. 174–180 (2000)
Guskov, I., Khodakovsky, A.: Wavelet compression of parametrically coherent mesh sequences. In: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 183–192. Eurographics Association, Aire-la-Ville, Switzerland (2004)
Hurri, J., Gävert, H., Särelä, J., Hyvärinen, A.: FastICA. http://www.cis.hut.fi/projects/ica/fastica/ (2004)
Hyvarinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley, New York (2001)
Jolliffe, I.T.: Principal Component Analysis. Springer, Berlin Heidelberg New York (2002)
Kim, T.H., Park, S.I., Shin, S.Y.: Rhythmic-motion synthesis based on motion-beat analysis. ACM Trans. Graph. 22(3), 392–401 (2003)
Kovar, L., Gleicher, M.: Automated extraction and parameterization of motions in large data sets. ACM Trans. Graph. 23(3), 559–568 (2004)
Kovar, L., Gleicher, M., Pighin, F.: Motion graphs. ACM Trans. Graph. 21(3), 473–482 (2002)
Lee, J., Chai, J., Reitsma, P.S.A., Hodgins, J.K., Pollard, N.S.: Interactive control of avatars animated with human motion data. ACM Trans. Graph. 21(3), 491–500 (2002)
Lim, I.S., Thalmann, D.: A key-posture extraction out of human motion data. In: Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2001), pp. 1167–1169 (2001)
Lim, I.S., Thalmann, D.: A vector-space representation of motion data for example-based motion synthesis. In: Proceedings of the IFIP TC5/WG5.10 DEFORM’2000 Workshop and AVATARS’2000 Workshop on Deformable Avatars, pp. 169–179. Kluwer, Dordrecht (2001)
Liu, F., Zhuang, Y., Wu, F., Pan, Y.: 3d motion retrieval with motion index tree. Comput. Vis. Image Understand. 92(2), 265–284 (2003)
Parent, R.: Computer Animation: Algorithms and Techniques. Morgan Kaufmann, San Francisco (2001)
Park, M.J., Shin, S.Y.: Example-based motion cloning. Comput. Animat. Virtual Worlds 15(3-4), 245–257 (2004)
Pickering, M.J., Rüger, S.: Evaluation of key frame-based retrieval techniques for video. Comput. Vis. Image Understand. 92(2), 217–235 (2003)
Shelton, C.R.: Morphable surface models. Int. J. Comput. Vis. 38(1), 75–91 (2000)
Uchihashi, S., Foote, J., Girgensohn, A., Boreczky, J.: Video manga: generating semantically meaningful video summaries. In: Proceedings of the 7th ACM International Conference on Multimedia (Part 1), pp. 383–392. ACM Press, New York (1999)
Whitaker, H., Halas, J.: Timing for Animation. Focal Press, Burlington, MA (1981)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Huang, KS., Chang, CF., Hsu, YY. et al. Key Probe: a technique for animation keyframe extraction. Visual Comput 21, 532–541 (2005). https://doi.org/10.1007/s00371-005-0316-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-005-0316-0