Skip to main content

Sketching-Out Virtual Humans: A Smart Interface for Human Modelling and Animation

  • Conference paper
Smart Graphics (SG 2007)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 4569))

Included in the following conference series:

  • 817 Accesses

Abstract

In this paper, we present a fast and intuitive interface for sketching out 3D virtual humans and animation. The user draws stick figure key frames first and chooses one for “fleshing-out” with freehand body contours. The system automatically constructs a plausible 3D skin surface from the rendered figure, and maps it onto the posed stick figures to produce the 3D character animation. A “creative model-based method” is developed, which performs a human perception process to generate 3D human bodies of various body sizes, shapes and fat distributions. In this approach, an anatomical 3D generic model has been created with three distinct layers: skeleton, fat tissue, and skin. It can be transformed sequentially through rigid morphing, fatness morphing, and surface fitting to match the original 2D sketch. An auto-beautification function is also offered to regularise the 3D asymmetrical bodies from users’ imperfect figure sketches. Our current system delivers character animation in various forms, including articulated figure animation, 3D mesh model animation, 2D contour figure animation, and even 2D NPR animation with personalised drawing styles. The system has been formally tested by various users on Tablet PC. After minimal training, even a beginner can create vivid virtual humans and animate them within minutes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Turner, R., Gobbetti, E.: Interactive Construction and Aanimation of Layered Elastically Deformable Characters. Computer Graphics Forum 17(2), 135–152 (1998)

    Article  Google Scholar 

  2. Choi, J.J.: MAYA Character Animation. 2nd edition, San Francisco, Calif.: London: SYBEX (2004)

    Google Scholar 

  3. Fua, P.: Human Modelling from Video Sequence. Geometric Info Magazine 13(7), 63–65 (1999)

    Google Scholar 

  4. Lee, W., Gu, J., Magnenat-Thalmann, N.: Generating Animatable 3D Virtual Humans from Photographs, Computer Graphics Forum 19, 3. In: Proc. Eurographics 2000, pp. 1–10 (2000)

    Google Scholar 

  5. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J.: SCAPE: Shape Completion and Animation of People. In: Proc. SIGGRAPH 05, pp. 408–416 (2005)

    Google Scholar 

  6. Seo, H., Magnenat-Thalmann, N.: An Example-based Approach to Human Body Manipulation. Graphical Models 66(1), 1–23 (2004)

    Article  MATH  Google Scholar 

  7. Igarashi, T., Matsuoka, S., Tanaka, H.: Teddy: A Sketching Interface for 3D Freeform Design. In: Proc. SIGGRAPH ‘99, pp. 409–416 (1999)

    Google Scholar 

  8. Karpenko, O., Hughes, J.F., Raskar, R.: Free-form Sketching with Variational Implicit Surfaces. In: Proc. Eurographics 2002, vol. 21(3) (2002)

    Google Scholar 

  9. Davis, J., Agrawala, M., Chuang, E., Popović, Z., Salesin, D.: A Sketching Interface for Articulated Figure Animation. In: Proc. Eurographics/ SIGGRAPH Symposium on Computer Animation, pp. 320–328 (2003)

    Google Scholar 

  10. Mao, C., Qin, S.F., Wright, D.K.: A Sketch-based Gesture Interface for Rough 3D Stick Figure Animation. In: Proc. of Eurographics Workshop on Sketch Based Interfaces and Modeling, pp. 175–183 (2005)

    Google Scholar 

  11. Thorne, M., Burke, D., van de Panne, M.: Motion Doodles: An Interface for Sketching Character Animation. ACM Transactions on Graphics (TOG) 23(3), 424–431 (2004)

    Article  Google Scholar 

  12. Hoshino, J., Hoshino, Y.: Intelligent Storyboard for Prototyping Animation. In: Proc. IEEE Int. Conf. On Multimedia and Expo, IEEE Computer Society Press, Los Alamitos (2001)

    Google Scholar 

  13. National Library of Medicine: The Virtual Human Project, http://www.nlm.nih.gov/research/visible/visiblehuman.html

  14. Lipson, H., Shpitalni, M.: Correlation-based Reconstruction of a 3D Object from a Single Freehand Sketch. In: Proc. AAAI Spring Symposium Series - Sketch Understanding (2002)

    Google Scholar 

  15. EPA: Information on Whole Body Scanning, http://www.epa.nsw.gov.au/radiation/ctbodyscans.htm

  16. Weber, J.: Run-time Skin Deformation, Intel Architecture Labs, http://www.intel.com/ial/3dsoftware/index.htm

  17. Mao, C., Qin, S.F., Wright, D.K.: Sketching-out Virtual Humans: from 2D Storyboarding to Immediate 3D Character Animation. In: Proc.of ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, Hollywood, Los Angeles (2006)

    Google Scholar 

  18. Mao, C., Qin, S.F., Wright, D.K., Peng, J.: Applying Scenarios in User-Centred Design to Develop A Sketching Interface for Human Modelling and Animation. In: Proc. of Eurographics Workshop on Sketch Based Interfaces and Modeling, pp. 147–156 (2006)

    Google Scholar 

  19. DeCarlo, D., Finkelstein, A., Rusinkiewics, S., Santella, A.: Suggestive Contours for Conveying Shape. ACM Transaction on Graphics 22(3), 848–855 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Andreas Butz Brian Fisher Antonio Krüger Patrick Olivier Shigeru Owada

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mao, C., Qin, S.F., Wright, D. (2007). Sketching-Out Virtual Humans: A Smart Interface for Human Modelling and Animation. In: Butz, A., Fisher, B., Krüger, A., Olivier, P., Owada, S. (eds) Smart Graphics. SG 2007. Lecture Notes in Computer Science, vol 4569. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73214-3_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-73214-3_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-73213-6

  • Online ISBN: 978-3-540-73214-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics