E-StopMotion: digitizing stop motion for enhanced animation and games
Authors: 
Anamaria Ciucanu, Naval Bhandari, Xiaokun Wu, Shridhar Ravikumar, Yong-Liang Yang, Darren CoskerAuthors Info & Claims
Anamaria Ciucanu, Naval Bhandari, Xiaokun Wu, Shridhar Ravikumar, Yong-Liang Yang, Darren CoskerAuthors Info & ClaimsArticle No.: 9, Pages 1 - 11
Abstract
Stop Motion Animation is the traditional craft of giving life to handmade models. The unique look and feel of this art form is hard to reproduce with 3D computer generated techniques. This is due to the unexpected details that appear from frame to frame and to the sometimes choppy appearance of the character movement. The artist's task can be overwhelming as he has to reshape a character into hundreds of poses to obtain just a few seconds of animation. The results of the animation are usually applied in 2D mediums like films or platform games. Character features that took a lot of effort to create thus remain unseen. We propose a novel system that allows the creation of 3D stop motion-like animations from 3D character shapes reconstructed from multi-view images. Given two or more reconstructed shapes from key frames, our method uses a combination of non-rigid registration and as-rigid-as-possible interpolation to generate plausible in-between shapes. This significantly reduces the artist's workload since much fewer poses are required. The reconstructed and interpolated shapes with complete 3D geometry can be manipulated even further through deformation techniques. The resulting shapes can then be used as animated characters in games or fused with 2D animation frames for enhanced stop motion films.
Supplementary Material
MP4 File (a9-ciucanu.mp4)
- Download
- 50.05 MB
References
[1]
Agisoft. 2018. Photoscan. http://www.agisoft.com/.
[2]
Marc Alexa, Daniel Cohen-Or, and David Levin. 2000. As-rigid-as-possible Shape Interpolation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 157--164.
[3]
Brett Allen, Brian Curless, and Zoran Popović. 2003. The Space of Human Body Shapes: Reconstruction and Parameterization from Range Scans. ACM Trans. Graph. 22, 3 (July 2003), 587--594.
[4]
Brian Amberg, Sami Romdhani, and Thomas Vetter. 2007. Optimal Step Nonrigid ICP Algorithms for Surface Registration. 2007 IEEE Conference on Computer Vision and Pattern Recognition (2007), 1--8.
[5]
William Baxter, Pascal Barla, and Ken-ichi Anjyo. 2008. Rigid Shape Interpolation Using Normal Equations. In Proceedings of the 6th International Symposium on Non-photorealistic Animation and Rendering (NPAR '08). ACM, 59--64.
[6]
P. J. Besl and N. D. McKay. 1992. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2 (Feb 1992), 239--256.
[7]
S. Biasotti, A. Cerri, A. Bronstein, and M. Bronstein. 2016. Recent Trends, Applications, and Perspectives in 3D Shape Similarity Assessment. Computer Graphics Forum (2016).
[8]
Guillaume Dewaele and Marie-Paule Cani. 2004. Interactive Global and Local Deformations for Virtual Clay. Graphic Models 66, 6 (Nov 2004), 352--369.
[9]
Stefan Fröhlich and Mario Botsch. 2011. Example-Driven Deformations Based on Discrete Shells. Computer Graphics Forum 30, 8 (2011), 2246--2257.
[10]
V. Ganapathi-Subramanian, B. Thibert, M. Ovsjanikov, and L. Guibas. 2016. Stable Region Correspondences Between Non-Isometric Shapes. Computer Graphics Forum 35, 5 (2016), 121--133.
[11]
Angjoo Kanazawa, Shahar Kovalsky, Ronen Basri, and David Jacobs. 2016. Learning 3D Deformation of Animals from 2D Images. Computer Graphics Forum 35, 2 (May 2016), 365--374.
[12]
Hao Li. 2010. Animation Reconstruction of Deformable Surfaces. Ph.D. Dissertation. ETH Zurich.
[13]
Hao Li, Bart Adams, Leonidas J. Guibas, and Mark Pauly. 2009. Robust Single-view Geometry and Motion Reconstruction. ACM Trans. Graph. 28, 5, Article 175 (Dec. 2009), 10 pages.
[14]
Hao Li, Robert W. Sumner, and Mark Pauly. 2008. Global Correspondence Optimization for Non-rigid Registration of Depth Scans. In Proceedings of the Symposium on Geometry Processing (SGP '08). Eurographics Association, 1421--1430.
[15]
K. Li, J. Yang, Y. K. Lai, and D. Guo. 2018. Robust Non-Rigid Registration with Reweighted Position and Transformation Sparsity. IEEE Transactions on Visualization and Computer Graphics (2018).
[16]
Xin Li and S. S. Iyengar. 2014. On Computing Mapping of 3D Objects: A Survey. ACM Comput. Surv. 47, 2, Article 34 (Dec. 2014), 45 pages.
[17]
Ya-Shu Liu, Han-Bing Yan, and Ralph R. Martin. 2011. As-Rigid-As-Possible Surface Morphing. Journal of Computer Science and Technology 26, 3 (01 May 2011), 548--557.
[18]
OrbitVU. 2018. Alphashot360. https://orbitvu.com/alphashot-360.
[19]
Maks Ovsjanikov, Mirela Ben-Chen, Justin Solomon, Adrian Butscher, and Leonidas Guibas. 2012. Functional Maps: A Flexible Representation of Maps Between Shapes. ACM Trans. Graph. 31, 4, Article 30 (July 2012), 11 pages.
[20]
Chavdar Papazov and Darius Burschka. 2011. Deformable 3D Shape Registration Based on Local Similarity Transforms. Computer Graphics Forum 30, 5 (2011), 1493--1502.
[21]
Fat Pebble. 2013. Fat Pebble Games. http://www.fatpebble.com/
[22]
Fat Pebble. 2014. Clay Jam. https://play.google.com/store/apps/details?id=com.zynga.fatpebble.clayjam
[23]
Barry JC Purves. 2016. Stop-Motion Animation: Frame by Frame Film-making with Puppets and Models, 2nd edition. Fairchild Books.
[24]
Andrei Sharf, Dan A. Alcantara, Thomas Lewiner, Chen Greif, Alla Sheffer, Nina Amenta, and Daniel Cohen-Or. 2008. Space-time Surface Reconstruction Using Incompressible Flow. ACM Trans. Graph. 27, 5, Article 110 (Dec. 2008), 10 pages.
[25]
Olga Sorkine and Marc Alexa. 2007. As-rigid-as-possible Surface Modeling. In Proceedings of the Fifth Eurographics Symposium on Geometry Processing (SGP '07). Eurographics Association, 109--116.
[26]
Jochen Süßmuth, Marco Winter, and Günther Greiner. 2008. Reconstructing Animated Meshes from Time Varying Point Clouds. Computer Graphics Forum 27, 5 (2008), 1469--1476.
[27]
Andrea Tagliasacchi, Thomas Delame, Michela Spagnuolo, Nina Amenta, and Alexandru Telea. 2016. 3D Skeletons: A State-of-the-Art Report. Computer Graphics Forum (2016).
[28]
Gary K. Tam, Zhi-Quan Cheng, Yu-Kun Lai, Frank Langbein, Yonghuai Liu, A. David Marshall, Ralph Martin, Xianfang Sun, and Paul Rosin. 2013. Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid. IEEE Transactions on Visualization and Computer Graphics 19, 7 (July 2013), 1199--1217.
[29]
Unity Technologies. 2018. Unity3D. https://unity3d.com/.
[30]
Art Tevs, Alexander Berner, Michael Wand, Ivo Ihrke, Martin Bokeloh, Jens Kerber, and Hans-Peter Seidel. 2012. Animation Cartography - Intrinsic Reconstruction of Shape and Motion. ACM Trans. Graph. 31, 2, Article 12 (April 2012), 15 pages.
[31]
Oliver van Kaick, Hao Zhang, Ghassan Hamarneh, and Daniel Cohen-Or. 2011. A Survey on Shape Correspondence. Computer Graphics Forum 30, 6 (2011), 1681--1707.
[32]
M. Vestner, Z. Lähner, A. Boyarski, O. Litany, R. Slossberg, T. Remez, E. Rodola, A. Bronstein, M. Bronstein, R. Kimmel, and D. Cremers. 2017a. Efficient Deformable Shape Correspondence via Kernel Matching. In 2017 International Conference on 3D Vision (3DV). 517--526.
[33]
Matthias Vestner, Roee Litman, Emanuele Rodolà, Alexander M. Bronstein, and Daniel Cremers. 2017b. Product Manifold Filter: Non-rigid Shape Correspondence via Kernel Density Estimation in the Product Space. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), 6681--6690.
[34]
Kevin Wampler. 2016. Fast and Reliable Example-based Mesh IK for Stylized Deformations. ACM Trans. Graph. 35, 6, Article 235 (Nov. 2016), 12 pages.
[35]
Michael Wand, Bart Adams, Maksim Ovsjanikov, Alexander Berner, Martin Bokeloh, Philipp Jenke, Leonidas Guibas, Hans-Peter Seidel, and Andreas Schilling. 2009. Efficient Reconstruction of Nonrigid Shape and Motion from Real-time 3D Scanner Data. ACM Trans. Graph. 28, 2, Article 15 (May 2009), 15 pages.
[36]
Yusuke Yoshiyasu, Wan-Chun Ma, Eiichi Yoshida, and Fumio Kanehiro. 2014. As-conformal-as-possible Surface Registration. In Proceedings of the Symposium on Geometry Processing (SGP '14). Eurographics Association, 257--267.
[37]
Eduard Zell and Mario Botsch. 2013. ELASTI FACE: Matching and Blending Textured Faces. Npar (2013), 15--24.
Index Terms
- E-StopMotion: digitizing stop motion for enhanced animation and games
Recommendations
Image-based motion blur for stop motion animation
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesStop motion animation is a well-established technique where still pictures of static scenes are taken and then played at film speeds to show motion. A major limitation of this method appears when fast motions are desired; most motion appears to have ...
Robust single-view geometry and motion reconstruction
We present a framework and algorithms for robust geometry and motion reconstruction of complex deforming shapes. Our method makes use of a smooth template that provides a crude approximation of the scanned object and serves as a geometric and topological ...
Animation transplantation
CASA' 2010 Special IssueWe present a novel method to animate a static geometry by cloning a captured animation sequence. More precisely, given a sequence of range scans of a deforming object which has been captured by a real-time 3D scanner, we describe a novel algorithm to ...
Comments
Information & Contributors
Information
Published In
November 2018
185 pages
ISBN:9781450360159
DOI:10.1145/3274247
- Conference Chairs:
- Panayiotis Charalambous,
- Yiorgos Chrysanthou,
- Program Chairs:
- Ben Jones,
- Jehee Lee
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 November 2018
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
MIG '18
Sponsor:
Acceptance Rates
Overall Acceptance Rate -9 of -9 submissions, 100%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 405Total Downloads
- Downloads (Last 12 months)32
- Downloads (Last 6 weeks)2
Reflects downloads up to 25 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in