Skip to main content

Estimating 3D Facial Shape and Motion from Stereo Image Using Active Appearance Models with Stereo Constraints

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 4142))

Abstract

This paper proposes a new fitting algorithm which we call Stereo Active Appearance Model (STAAM). This algorithm fits a 2D+3D Active Appearance Model to stereo images acquired from calibrated vision system and computes the 3D shape and rigid motion parameters. The use of calibration information reduces the number of model parameters, restricts the degree of freedom in the model parameters, and increases the accuracy and speed of fitting. Moreover, the STAAM uses a modified inverse compositional simultaneous update fitting algorithm to reduce the fitting computation greatly. Experimental results show that (1) the modified inverse compositional simultaneous update algorithm accelerates the AAM fitting speed while keeping its fitting accuracy, (2) the STAAM improves fitting stability using calibration information.

This research was performed for the Intelligent Robotics Development Program, one of the 21st Century Frontier R&D Programs partially funded by the Ministry of Science and Technology of Korea. Also it was partially supported by the Ministry of Education and Human Resources Development(MOE), the Ministry of Commerce, Industry and Energy(MOCIE) and the Ministry of Labor(MOLAB) through the fostering project of the Lab of Excellency.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Trans. on Pattern Recognition and Machine Intelligence 23(6), 681–685 (2001)

    Article  Google Scholar 

  2. Ahlberg, J.: Using the Active Appearance Algorithm for Face and Facial Feature Tracking. In: IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems (RATFG-RTS 2001), p. 68 (2001)

    Google Scholar 

  3. Li, Y., Gong, S., Liddell, H.: Modelling Faces Dynamically Across Views and Over Time. In: IEEE International Conference on Computer Vision (2001)

    Google Scholar 

  4. Xiao, J., Baker, S., Matthews, I., Kanade, T.: Real-Time Combined 2D+3D Active Appearance Models. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition (January 2004)

    Google Scholar 

  5. Hu, C., Xiao, J., Matthews, I., Baker, S., Cohn, J., Kanade, T.: Fitting a Single Active Appearance Model Simultaneously to Multiple Images. In: Proc. of the British Machine Vision Conference (September 2004)

    Google Scholar 

  6. Koterba, S., Baker, S., Matthews, I.: Multi-View AAM Fitting and Camera Calibration. In: International Conference on Computer Vision (2005)

    Google Scholar 

  7. Matthews, R.G.I., Baker, S.: Lucas-Kanade 20 Years on: A Unifying Framework: Part 3, Cmu-ri-tr-03-05, CMU (November 2003)

    Google Scholar 

  8. Matthews, I., Baker, S.: Active Appearance Models Revisited, CMU-RI-TR-03-01, CMU (April 2003)

    Google Scholar 

  9. Xiao, J., Kanade, T.: Robust Full-Motion Recovery of Head by Dynamic Templates and Registration Techniques. In: IEEE International Conference on Automatic Face and Gesture Recognition (May 2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sung, J., Kim, D. (2006). Estimating 3D Facial Shape and Motion from Stereo Image Using Active Appearance Models with Stereo Constraints. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2006. Lecture Notes in Computer Science, vol 4142. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11867661_41

Download citation

  • DOI: https://doi.org/10.1007/11867661_41

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-44894-5

  • Online ISBN: 978-3-540-44896-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics