Skip to main content
SpringerLink
Log in

Robust Real-Time Face Tracking and Modeling from Video

  • Conference paper
  • First Online:
Computational Science and Its Applications — ICCSA 2003 (ICCSA 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2667))

Included in the following conference series:

  • 771 Accesses

Abstract

Real-time face tracking and 3D reconstruction from video is a challenge in computer graphics and computer vision. We develop a system to track face by integrating image pyramid algorithm and Kalman filter. First, Facial features of the first frame are acquired automatically by Plessey corner detector according to FDP in MPEG-4 and FACS based on anatomical knowledge and general 3D model. And then corner disparity is obtained by image pyramid algorithm and Kalman filter. Kalman filter is employed to resolve the tracking speed and occlusion problems. Finally, 3D model is reconstructed by SfM (Structure from motion). Experimental results show the high prospect of this algorithm, and the two issues of real-time face tracking and modeling are resolved in our algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Reference

  1. C. Hang, I. Lin, M. Ouhyong. High Resoluation Calibration of Motion Capture Data for Realistic Facial Animation. Journal of software, China, 2000, 11(9):1141–1150.

    Google Scholar 

  2. J. Lee, J. Chai, P. S. A. Reitsma et al. Interactive Control of Avatars Animated With Human Motion Data. In: Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, 2002, 491–500.

    Google Scholar 

  3. Y. Li, T. Wang, H.Y. Shum. Motion Texture: A Two-Level Statistical Model for Character Motion Synthesis. In: Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, 2002, 465–472.

    Google Scholar 

  4. L. Kovar, M. Gleicher, F. Pighin. Motion Graphs. In: Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, 2002,473–482.

    Google Scholar 

  5. H. Tao, T. S. Huang. Explanation-based Facial Motion Tracking Using a Piecewise Bézier Volume Deformation Model. IEEE CVPR, 1999.

    Google Scholar 

  6. Y. Wu, J. Y. Lin, T. S. Huang. Capturing Natural Hand Articulation. IEEE ICCV2001, 2001.

    Google Scholar 

  7. Y. Zhang, E. C. Prakash, E. Sung. Real-time Physically-based Expression Animation Using Mass-Spring System. IEEE Computer Graphics International 2001, Hong Kong, 2001.

    Google Scholar 

  8. J. Ström, T. Jebara, S. Basu. A. Pentland. Real Time Tracking and Modeling of Faces: An EKF-based Analysis by Synthesis. IEEE ICCV1999.

    Google Scholar 

  9. C. Harris and M. Stephens. A combined corner and edge detector. In: Proceeding 4th Alvey Vision Conference, 1988, 189–192.

    Google Scholar 

  10. R. E. Kalman,. A New Approach to Linear Filtering and Prediction Problems. Transaction of the ASME — Journal of Basic Engineering, 1960, 82(Series D):35–45.

    Google Scholar 

  11. Z. Zhang, et al. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence, 1995, 78(1-2):87–119.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computer Science, Zhejiang University, Hangzhou, P.R.China

    Ronghua Liang, Chun Chen & Jiajun Bu

  2. Institute of VR and Multimedia, Hangzhou Inst. of Electronics Engineering, Hangzhou, P.R.China

    Ronghua Liang

  3. State Key Lab of CAD&CG, Zhejiang University, Hangzhou, P.R.China

    Zhigeng Pan

Authors
  1. Ronghua Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chun Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhigeng Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jiajun Bu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Army High Performance Computing Research Center, USA

    Vipin Kumar

  2. Department of Computer Science, University of Calgary, Calgary, AB, T2N1N4, Canada

    Marina L. Gavrilova

  3. Heuchera Technologies Inc., 122 9251-8 Yonge Street, Richmond Hill, ON, Canada, L4C 9T3

    Chih Jeng Kenneth Tan

  4. Département d’informatique et de recherche opérationelle, Université de Montréal, Montréal, Québec, H3C 3J7, Canada

    Pierre L’Ecuyer

  5. Department of Computer Science and Engineering, University of Minessota, MN, 55455, USA

    Vipin Kumar

  6. The Queen’s University of Belfast, School of Computer Science, Belfast BT7 1NN, Northern Ireland, UK

    Chih Jeng Kenneth Tan

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Liang, R., Chen, C., Pan, Z., Bu, J. (2003). Robust Real-Time Face Tracking and Modeling from Video. In: Kumar, V., Gavrilova, M.L., Tan, C.J.K., L’Ecuyer, P. (eds) Computational Science and Its Applications — ICCSA 2003. ICCSA 2003. Lecture Notes in Computer Science, vol 2667. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44839-X_13

Download citation

  • DOI: https://doi.org/10.1007/3-540-44839-X_13

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40155-1

  • Online ISBN: 978-3-540-44839-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation