Skip to main content
SpringerLink
Log in

Towards Real-Time Monocular Video-Based Avatar Animation

  • Conference paper
Advances in Visual Computing (ISVC 2008)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5359))

Included in the following conference series:

Abstract

Most of the commercial motion capture techniques, be they marker-based or marker-free, are either expensive or require complex laboratory setup. These constraints limit their use for home entertainment or interactive gaming oriented applications. In this paper we present a real-time system for color marker-based human motion capture in a monocular image space for avatar animation. The proposed system requires a single webcam and cheap color markers for its operation resulting in low cost and user friendliness. Real-time efficiency is achieved by tracking through variable-sized window search based on a process noise-adaptive Kalman filter. The depth information is recovered with the aid of human anthropometric information in a perspective projection model. Finally experimental results of the system are presented as tested with a number of video sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Chapman, D.: Vision, instruction and action. MIT Press, Cambridge (1991)

    Google Scholar 

  • Liu, F., Zhuang, Y., Luo, Z., Pan, Y.: A Robust Algorithm for Video Based Human Motion Tracking. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, pp. 1161–1168. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  • Pylkko, H., Riekki, J., Roning, J.: Real-time color-based tracking via a marker interface. In: Proc. of IEEE International Conference on Robotics and Automation, ICRA, pp. 1214–1219. IEEE Computer Society, Washington (2001)

    Google Scholar 

  • Zhuang, Y., Zhu, Q., Pan, Y.: Hierarchical model based human motion tracking. In: Proc. of IEEE International Conference on Image Processing, vol. 3, pp. 86–89. IEEE Computer Society, Washington (2000)

    Google Scholar 

  • Tao, Y., Hu, H.: Colour based human motion tracking for home-based rehabilitation. In: Proc. of IEEE International Conference on Systems, Man and Cybernetics, 2004, vol. 1, pp. 773–778. IEEE Computer Society, Washington (2004)

    Google Scholar 

  • Ukida, H., Kaji, S., Tanimoto, Y., Yamamoto, H.: Human Motion Capture System using Color Markers and Silhouette. In: Proc. of IEEE Instrumentation and Measurement Technology Conference, IMTC 2006, pp. 151–156. IEEE Computer Society, Washington (2006)

    Chapter  Google Scholar 

  • Remondino, F., Roditakis, A.: Human figure reconstruction and modeling from single image or monocular video sequence. In: Proc. of Fourth International Conference on 3-D Digital Imaging and Modeling, 3DIM 2003, pp. 116–123. IEEE Computer Society, Washington (2003)

    Chapter  Google Scholar 

  • Dreyfuss, H.: The Measure of Man: human factors in design, Whitney Library of Design, New York (1959-1967)

    Google Scholar 

  • Welch, G., Bishop, G.: An introduction to the Kalman filter, from,UNC-ChapelHill, TR95-041 (November 2000), http://www.cs.unc.edu

  • Michoud, B., Guillou, E., Briceño, H., Bouakaz, S.: Real-Time and Marker-Free 3D Motion Capture for Home Entertainment Oriented Applications. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part I. LNCS, vol. 4843, pp. 678–687. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  • Nguyen, H.T., Worring, M., van den Boomgaard, R.: Occlusion robust adaptive template tracking. In: Proc. IEEE Conf. on Computer Vision, ICCV 2001, vol. 1, pp. 678–683 (July 2001)

    Google Scholar 

  • http://en.wikipedia.org/wiki/Vitruvian_Man

  • Remondino, F.: 3-D reconstruction of static human body shape from image sequence. In: Proc.of Computer Vision and Image Understanding, vol. 93, pp. 65–68. Elsevier Science Inc., New York (2004)

    Google Scholar 

  • TrueVision3D Commercial Game Engine, http://www.truevision3d.com

Download references

Author information

Authors and Affiliations

  1. University of California, Riverside, CA, USA

    Utkarsh Gaur

  2. Cornell University, Ithaca, NY, USA

    Amrita Jain

  3. Jaypee Institute of Information Technology University, Noida, India

    Utkarsh Gaur, Amrita Jain & Sanjay Goel

Authors
  1. Utkarsh Gaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amrita Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sanjay Goel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada, Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. Digital Image Research Center, Kingston University, London, UK

    Paolo Remagnino

  6. Mitsubishi Electric Research Laboratories, P.O. Box 02139, Cambridge, MA, USA

    Fatih Porikli

  7. Computer and Information Science and Engineering, University of Florida, P.O. Box, FL 32611-6120, Gainsville, USA

    Jörg Peters

  8. IBM T.J. Watson Research Center, 19 Skyline Drive, NY 10532, Hawthorne, USA

    James Klosowski

  9. 128 Memorial Mall, Stewart B001, IN 47907, West Lafayette, USA

    Laura Arns

  10. Denver Museum of Nature and Space, 2001 Colorade Blvd. Denver,, CO 80205, USA

    Yu Ka Chun

  11. Departmen of Computer Science,, NC State University, Campus Box 8206, NC 27695-8206, Raleigh, USA

    Theresa-Marie Rhyne

  12. Los Alamos National Labs, P.O. Box 1663, NM 87545, Los Alamos, USA

    Laura Monroe

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gaur, U., Jain, A., Goel, S. (2008). Towards Real-Time Monocular Video-Based Avatar Animation. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2008. Lecture Notes in Computer Science, vol 5359. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89646-3_95

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89646-3_95

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89645-6

  • Online ISBN: 978-3-540-89646-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation