skip to main content
research-article

Animating animal motion from still

Published: 01 December 2008 Publication History

Abstract

Even though the temporal information is lost, a still picture of moving animals hints at their motion. In this paper, we infer motion cycle of animals from the "motion snapshots" (snapshots of different individuals) captured in a still picture. By finding the motion path in the graph connecting motion snapshots, we can infer the order of motion snapshots with respect to time, and hence the motion cycle. Both "half-cycle" and "full-cycle" motions can be inferred in a unified manner. Therefore, we can animate a still picture of a moving animal group by morphing among the ordered snapshots. By refining the pose, morphology, and appearance consistencies, smooth and realistic animal motion can be synthesized. Our results demonstrate the applicability of the proposed method to a wide range of species, including birds, fishes, mammals, and reptiles.

Supplementary Material

JPG File (a117-xu-mp4_hi.jpg)
MOV File (a117-xu-mp4_hi.mov)

References

[1]
Agarwal, A., and Triggs, B. 2005. Monocular human motion capture with a mixture of regressors. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2005 - Workshops, 72.
[2]
Agarwal, A. 2006. Machine learning for image based motion capture. PhD Thesis, Institut National Polytechnique de Grenoble.
[3]
Barrett, W. A., and Cheney, A. S. 2002. Object-based image editing. In Proc. ACM SIGGRAPH 2002, 777--784.
[4]
Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligience 24, 4, 509--522.
[5]
Bookstein, F. L. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transaction on Pattern Analysis and Machine Intelligience 11, 6, 567--585.
[6]
Brostow, G. J., and Essa, I. 2001. Image-based motion blur for stop motion animation. In Proc. ACM SIGGRAPH 2001, 561--566.
[7]
Chetverikov, D., and Fazekas, S. 2006. On motion periodicity of dynamic textures. In British Machine Vision Conference (BMVC), vol. I, 167--175.
[8]
Chuang, Y.-Y., Goldman, D. B., Zheng, K. C., Curless, B., Salesin, D. H., and Szeliski, R. 2005. Animating pictures with stochastic motion textures. In Proc. ACM SIGGRAPH 2005, 853--860.
[9]
Criminisi, A., Reid, I. D., and Zisserman, A. 2000. Single view metrology. International Journal of Computer Vision 40, 2, 123--148.
[10]
Criminisi, A., Perez, P., and Toyama, K. 2003. Object removal by exemplar-based inpainting. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2003, 721--728.
[11]
Horry, Y., Anjyo, K.-I., and Arai, K. 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. In Proc. ACM SIGGRAPH 1997, 225--232.
[12]
Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. In Proc. ACM SIGGRAPH 2005, 1134--1141.
[13]
Lin, Z., Wang, L., Wang, Y., Kang, S. B., and Fang, T. 2007. High resolution animated scenes from stills. IEEE Transactions on Visualization and Computer Graphics 13, 3, 562--568.
[14]
Litwinowicz, P., and Williams, L. 1994. Animating images with drawings. In Proc. ACM SIGGRAPH 1994, 409--412.
[15]
Mori, G., Belongie, S., and Malik, J. 2005. Efficient shape matching using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 11, 1832--1837.
[16]
Ngo, T., Cutrell, D., Dana, J., Donald, B., Loeb, L., and Zhu, S. 2000. Accessible animation and customizable graphics via simplicial configuration modeling. In Proc. ACM SIGGRAPH 2000, 403--410.
[17]
Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In Proc. ACM SIGGRAPH 2001, 433--442.
[18]
Pepper, J. W., Golden, B. L., and Wasil, E. A. 2002. Solving the traveling salesman problem with annealing-basedheuristics: a computational study. IEEE Transactions on Systems, Man and Cybernetics, Part A 32, 1, 72--77.
[19]
Rother, C., Kolmogorov, V., and Blake, A. 2004. "grab-cut": interactive foreground extraction using iterated graph cuts. ACM Transaction on Graphics 23, 3, 309--314.
[20]
Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. In Proc. ACM SIGGRAPH 2006, 533--540.
[21]
Schindler, G., Dellaert, F., and Kang, S. B. 2007. Inferring temporal order of images from 3D structure. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2007.
[22]
Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proc. ACM SIGGRAPH 2000, 489--498.
[23]
Shinya, M., Aoki, M., Tsutsuguchi, K., and Kotani, N. 1999. Dynamic texture: physically based 2D animation. In Proc. ACM SIGGRAPH 1999, 239.
[24]
Sminchisescu, C. 2006. 3D human motion analysis in monocular video techniques and challenges. In Proc. the IEEE International Conference on Video and Signal Based Surveillance, 76.
[25]
Soatto, S., Doretto, G., and Wu, Y. N. 2001. Dynamic textures. In International Conference on Computer Vision, 439--446.
[26]
Wang, Y., and Zhu, S.-C. 2003. Modeling textured motion: Particle, wave and sketch. In Proc. the 9th IEEE International Conference on Computer Vision(ICCV) 2003, 213--220.

Cited By

View all
  • (2022)A benchmark dataset and baseline model for co-salient object detection within RGB-D imagesMultimedia Tools and Applications10.1007/s11042-021-11555-y81:25(35831-35842)Online publication date: 2-Jun-2022
  • (2022)Animation Generation Technology Based on Deep Learning: Opportunities and ChallengesArtificial Intelligence and Security10.1007/978-3-031-06794-5_26(311-325)Online publication date: 15-Jul-2022
  • (2021)Reconstruction of a fluttering flag from a single imageJournal of Algorithms & Computational Technology10.1177/174830262098365615Online publication date: 20-Feb-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 27, Issue 5
December 2008
552 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1409060
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2008
Published in TOG Volume 27, Issue 5

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. animal group
  2. consistency refinement
  3. motion cycle
  4. motion inference
  5. still picture

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)A benchmark dataset and baseline model for co-salient object detection within RGB-D imagesMultimedia Tools and Applications10.1007/s11042-021-11555-y81:25(35831-35842)Online publication date: 2-Jun-2022
  • (2022)Animation Generation Technology Based on Deep Learning: Opportunities and ChallengesArtificial Intelligence and Security10.1007/978-3-031-06794-5_26(311-325)Online publication date: 15-Jul-2022
  • (2021)Reconstruction of a fluttering flag from a single imageJournal of Algorithms & Computational Technology10.1177/174830262098365615Online publication date: 20-Feb-2021
  • (2021)Endless loopsACM Transactions on Graphics10.1145/3450626.345993540:4(1-12)Online publication date: 19-Jul-2021
  • (2021)Video Snapshot: Single Image Motion Expansion via Invertible Motion EmbeddingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2020.300164443:12(4491-4504)Online publication date: 1-Dec-2021
  • (2020)Automatic Video Creation From a Web PageProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415814(279-292)Online publication date: 20-Oct-2020
  • (2020)A New Method and Benchmark for Detecting Co-Saliency Within a Single ImageIEEE Transactions on Multimedia10.1109/TMM.2020.297216522:12(3051-3063)Online publication date: 17-Nov-2020
  • (2020)Generating video animation from single still image in social media based on intelligent computingJournal of Visual Communication and Image Representation10.1016/j.jvcir.2020.10281271(102812)Online publication date: Aug-2020
  • (2019)FashionOnProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3351075(275-283)Online publication date: 15-Oct-2019
  • (2019)Based on Super-Pixels to Simulate Water Ripples from a Single Image2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00284(1590-1594)Online publication date: Aug-2019
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media