skip to main content
research-article

SketchiMo: sketch-based motion editing for articulated characters

Published: 11 July 2016 Publication History

Abstract

We present SketchiMo, a novel approach for the expressive editing of articulated character motion. SketchiMo solves for the motion given a set of projective constraints that relate the sketch inputs to the unknown 3D poses. We introduce the concept of sketch space, a contextual geometric representation of sketch targets---motion properties that are editable via sketch input---that enhances, right on the viewport, different aspects of the motion. The combination of the proposed sketch targets and space allows for seamless editing of a wide range of properties, from simple joint trajectories to local parent-child spatiotemporal relationships and more abstract properties such as coordinated motions. This is made possible by interpreting the user's input through a new sketch-based optimization engine in a uniform way. In addition, our view-dependent sketch space also serves the purpose of disambiguating the user inputs by visualizing their range of effect and transparently defining the necessary constraints to set the temporal boundaries for the optimization.

Supplementary Material

ZIP File (a146-choi-supp.zip)
Supplemental files.
MP4 File (a146.mp4)

References

[1]
Annett, M., Anderson, F., Bischof, W. F., and Gupta, A. 2014. The pen is mightier: Understanding stylus behaviour while inking on tablets. In Proceedings of GI '14, 193--200.
[2]
Assa, J., Caspi, Y., and Cohen-Or, D. 2005. Action synopsis: Pose selection and illustration. ACM Trans. Graph. 24, 3 (July), 667--676.
[3]
Autodesk. Maya, MotionBuilder products. www.autodesk.com.
[4]
Autodesk. Mudbox. www.autodesk.com/mudbox.
[5]
Blender Foundation. Blender. www.blender.org.
[6]
Borosán, P., Jin, M., DeCarlo, D., Gingold, Y., and Nealen, A. 2012. Rigmesh: Automatic rigging for part-based shape modeling and deformation. ACM Trans. Graph. 31, 6 (Nov.), 198:1--198:9.
[7]
Brand, M., and Hertzmann, A. 2000. Style machines. In Proceedings of SIGGRAPH '00, 183--192.
[8]
Choi, M. G., Yang, K., Igarashi, T., Mitani, J., and Lee, J. 2012. Retrieval and visualization of human motion data via stick figures. Comput. Graph. Forum 31, 7pt1 (Sept.), 2057--2065.
[9]
Coleman, P., Bibliowicz, J., Singh, K., and Gleicher, M. 2008. Staggered poses: A character motion representation for detail-preserving editing of pose and coordinated timing. In Proceedings of SCA '08, 137--146.
[10]
De Paoli, C., and Singh, K. 2015. Secondskin: Sketch-based construction of layered 3d models. ACM Trans. Graph. 34, 4 (July), 126:1--126:10.
[11]
Gleicher, M. 1997. Motion editing with spacetime constraints. In Proceedings of I3D '97, 139--148.
[12]
Gleicher, M. 1998. Retargetting motion to new characters. In Proceedings of SIGGRAPH '98, 33--42.
[13]
Gleicher, M. 2001. Motion path editing. In Proceedings of I3D '01, 195--202.
[14]
Grochow, K., Martin, S. L., Hertzmann, A., and Popović, Z. 2004. Style-based inverse kinematics. ACM Trans. Graph. 23, 3 (Aug.), 522--531.
[15]
Guay, M., Cani, M.-P., and Ronfard, R. 2013. The line of action: An intuitive interface for expressive character posing. ACM Trans. Graph. 32, 6 (Nov.), 205:1--205:8.
[16]
Guay, M., Ronfard, R., Gleicher, M., and Cani, M.-P. 2015. Adding dynamics to sketch-based character animations. In Proceedings of SBIM '15, 27--34.
[17]
Guay, M., Ronfard, R., Gleicher, M., and Cani, M.-P. 2015. Space-time sketching of character animation. ACM Trans. Graph. 34, 4 (July), 118:1--118:10.
[18]
Hahn, F., Mutzel, F., Coros, S., Thomaszewski, B., Nitti, M., Gross, M., and Sumner, R. W. 2015. Sketch abstractions for character posing. In Proceedings of SCA '15, 185--191.
[19]
Ho, E. S. L., Komura, T., and Tai, C.-L. 2010. Spatial relationship preserving character motion adaptation. ACM Trans. Graph. 29, 4 (July), 33:1--33:8.
[20]
Hsu, E., Pulli, K., and Popović, J. 2005. Style translation for human motion. ACM Trans. Graph. 24, 3 (July), 1082--1089.
[21]
Hsu, E., da Silva, M., and Popović, J. 2007. Guided time warping for motion editing. In Proceedings of SCA '07, 45--52.
[22]
Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3d freeform design. In Proceedings of SIGGRAPH '99, 409--416.
[23]
Johnson, S. G., 2010. The nlopt nonlinear-optimization package. http://ab-initio.mit.edu/nlopt.
[24]
Kho, Y., and Garland, M. 2005. Sketching mesh deformations. ACM Trans. Graph. 24, 3 (July), 934--934.
[25]
Kim, M., Hyun, K., Kim, J., and Lee, J. 2009. Synchronized multi-character motion editing. ACM Trans. Graph. 28, 3 (July), 79:1--79:9.
[26]
Lasseter, J. 1987. Principles of traditional animation applied to 3d computer animation. Comput. Graph. 21, 4 (Aug.), 35--44.
[27]
Le Callennec, B., and Boulic, R. 2006. Robust kinematic constraint detection for motion data. In Proceedings of SCA '06, 281--290.
[28]
Lee, J., and Shin, S. Y. 1999. A hierarchical approach to interactive motion editing for human-like figures. In Proceedings of SIGGRAPH '99, 39--48.
[29]
Lee, J. 2008. Representing rotations and orientations in geometric computing. IEEE Comput. Graph. Appl. 28, 2 (Mar.), 75--83.
[30]
Levi, Z., and Gotsman, C. 2013. ArtiSketch: A system for articulated sketch modeling. Comput. Graph. Forum 32, 2pt2 (May), 235--244.
[31]
Lin, J., Igarashi, T., Mitani, J., and Saul, G. 2010. A sketching interface for sitting-pose design. In Proceedings of SBIM '10, 111--118.
[32]
McLaughlin, T., Cutler, L., and Coleman, D. 2011. Character rigging, deformations, and simulations in film and game production. In SIGGRAPH '11 Courses, 5:1--5:18.
[33]
Mukai, T., and Kuriyama, S. 2009. Pose-timeline for propagating motion edits. In Proceedings of SCA '09, 113--122.
[34]
Nealen, A., Sorkine, O., Alexa, M., and Cohen-Or, D. 2005. A sketch-based interface for detail-preserving mesh editing. ACM Trans. Graph. 24, 3 (July), 1142--1147.
[35]
Neff, M., and Fiume, E. 2003. Aesthetic edits for character animation. In Proceedings of SCA '03, 239--244.
[36]
Nocedal, J., and Wright, S. 2006. Numerical optimization. Springer Science & Business Media.
[37]
Öztireli, A. C., Baran, I., Popa, T., Dalstein, B., Sumner, R. W., and Gross, M. 2013. Differential blending for expressive sketch-based posing. In Proceedings of SCA '13, 155--164.
[38]
Pixologic. Zbrush. www.pixologic.com.
[39]
Popović, Z., and Witkin, A. 1999. Physically based motion transformation. In Proceedings of SIGGRAPH '99, 11--20.
[40]
Popović, J., Seitz, S. M., and Erdmann, M. 2003. Motion sketching for control of rigid-body simulations. ACM Trans. Graph. 22, 4 (Oct.), 1034--1054.
[41]
Rose, C., Cohen, M. F., and Bodenheimer, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. IEEE Comput. Graph. Appl. 18, 5 (Sept.), 32--40.
[42]
Schmid, J., Senn, M. S., Gross, M., and Sumner, R. W. 2011. Overcoat: An implicit canvas for 3d painting. ACM Trans. Graph. 30, 4 (July), 28:1--28:10.
[43]
Shapiro, A., Cao, Y., and Faloutsos, P. 2006. Style components. In Proceedings of GI '06, 33--39.
[44]
Takayama, K., Panozzo, D., Sorkine-Hornung, A., and Sorkine-Hornung, O. 2013. Sketch-based generation and editing of quad meshes. ACM Trans. Graph. 32, 4 (July), 97:1--97:8.
[45]
Tassa, Y., Erez, T., and Todorov, E. 2012. Synthesis and stabilization of complex behaviors through online trajectory optimization. Intelligent Robots and Systems (Oct.), 4906--4913.
[46]
Terra, S. C. L., and Metoyer, R. A. 2004. Performance timing for keyframe animation. In Proceedings of SCA '04, 253--258.
[47]
Thorne, M., Burke, D., and van de Panne, M. 2004. Motion doodles: An interface for sketching character motion. ACM Trans. Graph. 23, 3 (Aug.), 424--431.
[48]
Wang, J., Drucker, S. M., Agrawala, M., and Cohen, M. F. 2006. The cartoon animation filter. ACM Trans. Graph. 25, 3 (July), 1169--1173.
[49]
Wei, X., and Chai, J. 2011. Intuitive interactive human-character posing with millions of example poses. IEEE Comput. Graph. Appl. 31, 4 (July), 78--88.
[50]
Witkin, A., and Popovic, Z. 1995. Motion warping. In Proceedings of SIGGRAPH '95, 105--108.
[51]
Yoo, I., Vanek, J., Nizovtseva, M., Adamo-Villani, N., and Benes, B. 2014. Sketching human character animations by composing sequences from large motion database. Vis. Comput. 30, 2 (Feb.), 213--227.
[52]
Yoo, I., Massih, M. A., Ziamtsov, I., Hassan, R., and Benes, B. 2015. Motion retiming by using bilateral time control surfaces. Computers & Graphics 47, 59--67.

Cited By

View all
  • (2024)Expressive Animation Retiming from Impulse-Based GesturesProceedings of the 17th ACM SIGGRAPH Conference on Motion, Interaction, and Games10.1145/3677388.3696323(1-7)Online publication date: 21-Nov-2024
  • (2024)TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641927(1-17)Online publication date: 11-May-2024
  • (2024)Keyframe Control of Music-Driven 3D Dance GenerationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323553830:7(3474-3486)Online publication date: 1-Jul-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 35, Issue 4
July 2016
1396 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2897824
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2016
Published in TOG Volume 35, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. articulated character motion
  2. character animation
  3. motion editing
  4. sketch-based interface

Qualifiers

  • Research-article

Funding Sources

  • Korea government (MSIP)

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)126
  • Downloads (Last 6 weeks)15
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Expressive Animation Retiming from Impulse-Based GesturesProceedings of the 17th ACM SIGGRAPH Conference on Motion, Interaction, and Games10.1145/3677388.3696323(1-7)Online publication date: 21-Nov-2024
  • (2024)TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641927(1-17)Online publication date: 11-May-2024
  • (2024)Keyframe Control of Music-Driven 3D Dance GenerationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323553830:7(3474-3486)Online publication date: 1-Jul-2024
  • (2023)DualMotion: Global-to-Local Casual Motion Design for Character AnimationsIEICE Transactions on Information and Systems10.1587/transinf.2022IIP0011E106.D:4(459-468)Online publication date: 1-Apr-2023
  • (2023)A Sketch-Based Interface for Facial Animation in Immersive Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.218573140:12(3234-3252)Online publication date: 10-Mar-2023
  • (2023)Avoiding virtual humans in a constrained environmentComputers and Graphics10.1016/j.cag.2023.01.001110:C(162-172)Online publication date: 1-Feb-2023
  • (2023)Warping character animations using visual motion featuresComputers & Graphics10.1016/j.cag.2022.11.008110(38-48)Online publication date: Feb-2023
  • (2023)Exploring inbetween charts with trajectory-guided sliders for cutout animationMultimedia Tools and Applications10.1007/s11042-023-17354-x83:15(44581-44594)Online publication date: 18-Oct-2023
  • (2022)SNeRFACM Transactions on Graphics10.1145/3528223.353010741:4(1-11)Online publication date: 22-Jul-2022
  • (2022)Sketch2PoseACM Transactions on Graphics10.1145/3528223.353010641:4(1-15)Online publication date: 22-Jul-2022
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media