skip to main content
10.1145/1572614.1572619acmconferencesArticle/Chapter ViewAbstractPublication PagesnparConference Proceedingsconference-collections
research-article

As-rigid-as-possible image registration for hand-drawn cartoon animations

Published: 01 August 2009 Publication History

Abstract

We present a new approach to deformable image registration suitable for articulated images such as hand-drawn cartoon characters and human postures. For such type of data state-of-the-art techniques typically yield undesirable results. We propose a novel geometrically motivated iterative scheme where point movements are decoupled from shape consistency. By combining locally optimal block matching with as-rigid-as-possible shape regularization, our algorithm allows us to register images undergoing large free-form deformations and appearance variations. We demonstrate its practical usability in various challenging tasks performed in the cartoon animation production pipeline including unsupervised inbetweening, example-based shape deformation, auto-painting, editing, and motion retargeting.

References

[1]
Alexa, M., Cohen-Or, D., and Levin, D. 2000. As-rigid-as-possible shape interpolation. In ACM SIGGRAPH Conference Proceedings, 157--164.
[2]
Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 24, 509--522.
[3]
Bergen, J. R., Anandan, P., Hanna, K. J., and Hingorani, R. 1992. Hierarchical model-based motion estimation. In Proceedings of European Conference on Computer Vision, 237--252.
[4]
Botsch, M., Pauly, M., Wicke, M., and Gross, M. H. 2007. Adaptive space deformations based on rigid cells. Computer Graphics Forum 26, 3, 339--347.
[5]
Bregler, C., Loeb, L., Chuang, E., and Deshpande, H. 2002. Turning to the masters: Motion capturing cartoons. ACM Transactions on Graphics 21, 3, 399--407.
[6]
Chang, C. W., and Lee, S. Y. 1997. Automatic cel painting in computer-assisted cartoon production using similarity recognition. The Journal of Visualization and Computer Animation 8, 3, 165--185.
[7]
Gholipour, A., Kehtarnavaz, N., Briggs, R. W., Devous, M., and Gopinath, K. S. 2007. Brain functional localization: A survey of image registration techniques. IEEE Transactions on Medical Imaging 26, 4, 427--451.
[8]
Glocker, B., Komodakis, N., Tziritas, G., Navab, N., and Paragios, N. 2008. Dense image registration through MRFs and efficient linear programming. Medical Image Analysis 12, 6, 731--741.
[9]
Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Transactions on Graphics 24, 3, 1134--1141.
[10]
De Juan, C. N., and Bodenheimer, B. 2006. Reusing traditional animation: methods for semi-automatic segmentation and inbetweening. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 223--232.
[11]
Klein, S., Staring, M., and Pluim, J. P. W. 2007. Evaluation of optimization methods for nonrigid medical image registration using mutual information and B-splines. IEEE Transactions on Image Processing 16, 12, 2879--2890.
[12]
Kort, A. 2002. Computer aided inbetweening. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering, 125--132.
[13]
Li, W., and Salari, E. 1995. Successive elimination algorithm for motion estimation. IEEE Transactions on Image Processing 4, 1, 105--107.
[14]
Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2, 91--110.
[15]
Lucas, B. D., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Proceedings of International Joint Conference on Artificial Intelligence, 674--679.
[16]
Madeira, J. S., Stork, A., and Gross, M. H. 1996. An approach to computer-supported cartooning. The Visual Computer 12, 1, 1--17.
[17]
Maintz, J. B. A., and Viergever, M. A. 1998. A survey of medical image registration. Medical Image Analysis 2, 1, 1--16.
[18]
Modersitzki, J. 2004. Numerical Methods for Image Registration. Oxford University Press, UK.
[19]
Müller, M., Heidelberger, B., Teschner, M., and Gross, M. 2005. Meshless deformations based on shape matching. ACM Transactions on Graphics 24, 3, 471--478.
[20]
Papenberg, N., Schumacher, H., Heldmann, S., Wirtz, S., Bommersheim, S., Ens, K., Modersitzki, J., and Fischer, B. 2007. A fast and flexible image registration toolbox. In Bildverarbeitung für die Medizin, 106--110.
[21]
Qiu, J., Seah, H. S., Tian, F., Chen, Q., and Wu, Z. 2005. Enhanced auto coloring with hierarchical region matching. Computer Animation and Virtual Worlds 16, 3--4, 463--473.
[22]
Qiu, J., Seah, H. S., Tian, F., Chen, Q., Wu, Z., and Melikhov, K. 2008. Auto coloring with enhanced character registration. International Journal of Computer Games Technology, 1, 2.
[23]
Rivers, A. R., and James, D. L. 2007. FastLSM: Fast lattice shape matching for robust real-time deformation. ACM Transactions on Graphics 26, 3, 82.
[24]
Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. ACM Transactions on Graphics 25, 3, 533--540.
[25]
Seah, H. S., and Feng, T. 2000. Computer-assisted coloring by matching line drawings. The Visual Computer 16, 5, 289--304.
[26]
Shekhovtsov, A., Kovtun, I., and Hlaváč, V. 2008. Efficient MRF deformation model for non-rigid image matching. Computer Vision and Image Understanding 112, 1, 91--99.
[27]
Sorkine, O., and Alexa, M. 2007. As-rigid-as-possible surface modeling. In Proceedings of Eurographics/ACM SIGGRAPH Symposium on Geometry Processing, 109--116.
[28]
Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. ACM Transactions on Graphics 26, 3, 80.
[29]
Sýkora, D., Buriánek, J., and Žára, J. 2005. Colorization of black-and-white cartoons. Image and Vision Computing 23, 9, 767--782.
[30]
Sýkora, D., Dingliana, J., and Collins, S. 2009. Lazy-Brush: Flexible painting tool for hand-drawn cartoons. Computer Graphics Forum 28, 2, 599--608.
[31]
Szeliski, R. S., Zabih, R., Scharstein, D., Veksler, O., Kolmogorov, V., Agarwala, A., Tappen, M., and Rother, C. 2008. A comparative study of energy minimization methods for markov random fields with smoothness-based priors. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 6, 1068--1080.
[32]
Wang, Y., Xu, K., Xiong, Y., and Cheng, Z.-Q. 2008. 2D shape deformation based on rigid square matching. Computer Animation and Virtual Worlds 19, 3--4, 411--420.
[33]
Weng, Y., Xu, W., Wu, Y., Zhou, K., and Guo, B. 2006. 2D shape deformation using nonlinear least squares optimization. The Visual Computer 22, 9, 653--660.
[34]
Wirtz, S., Fischer, G., Modersitzki, J., and Schmitt, O. 2004. Superfast elastic registration of histologic images of a whole rat brain for 3d reconstruction. In Proceedings of the SPIE, vol. 5370, 328--334.
[35]
Xie, M. 1995. Feature matching and affine transformation for 2D cell animation. The Visual Computer 11, 8, 419--428.
[36]
Xu, X., Wan, L., Liu, X., Wong, T.-T., Wang, L., and Leung, C.-S. 2008. Animating animal motion from still. ACM Transactions on Graphics 27, 5, 117.

Cited By

View all
  • (2025)Motion-guided semantic alignment for line art animation colorizationPattern Recognition10.1016/j.patcog.2024.111055158(111055)Online publication date: Feb-2025
  • (2024)Skeleton-Driven Inbetweening of Bitmap Character DrawingsACM Transactions on Graphics10.1145/368795543:6(1-19)Online publication date: 19-Dec-2024
  • (2024)Bridging the Gap: Sketch-Aware Interpolation Network for High-Quality Animation Sketch InbetweeningProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681146(10287-10295)Online publication date: 28-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
NPAR '09: Proceedings of the 7th International Symposium on Non-Photorealistic Animation and Rendering
August 2009
75 pages
ISBN:9781605586045
DOI:10.1145/1572614
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. as-rigid-as-possible deformation
  2. deformable image registration
  3. interactive shape manipulation

Qualifiers

  • Research-article

Funding Sources

Conference

NPAR '09
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)37
  • Downloads (Last 6 weeks)10
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Motion-guided semantic alignment for line art animation colorizationPattern Recognition10.1016/j.patcog.2024.111055158(111055)Online publication date: Feb-2025
  • (2024)Skeleton-Driven Inbetweening of Bitmap Character DrawingsACM Transactions on Graphics10.1145/368795543:6(1-19)Online publication date: 19-Dec-2024
  • (2024)Bridging the Gap: Sketch-Aware Interpolation Network for High-Quality Animation Sketch InbetweeningProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681146(10287-10295)Online publication date: 28-Oct-2024
  • (2024)Joint Stroke Tracing and Correspondence for 2D AnimationACM Transactions on Graphics10.1145/364989043:3(1-17)Online publication date: 9-Apr-2024
  • (2024)Automatic Inbetweening for Stroke‐Based Painterly AnimationComputer Graphics Forum10.1111/cgf.15201Online publication date: 8-Oct-2024
  • (2024)Learning Inclusion Matching for Animation Paint Bucket Colorization2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02413(25544-25553)Online publication date: 16-Jun-2024
  • (2023)Efficient Interpolation of Rough Line DrawingsComputer Graphics Forum10.1111/cgf.1494642:7Online publication date: 5-Nov-2023
  • (2023)Non‐linear Rough 2D Animation using Transient EmbeddingsComputer Graphics Forum10.1111/cgf.1477142:2(411-425)Online publication date: 23-May-2023
  • (2023)Exploring inbetween charts with trajectory-guided sliders for cutout animationMultimedia Tools and Applications10.1007/s11042-023-17354-x83:15(44581-44594)Online publication date: 18-Oct-2023
  • (2022)Interactive image manipulation using morphological trees and spline-based skeletonsComputers & Graphics10.1016/j.cag.2022.09.002108(61-73)Online publication date: Nov-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media