Skip to main content
SpringerLink
Log in

Face Tracking

  • Reference work entry
Encyclopedia of Biometrics

Synonym

Facial motion estimation

Definition

In many face recognition systems, the input is a video sequence consisting of one or more faces. It is necessary to track each face over this video sequence so as to extract the information that will be processed by the recognition system. Tracking is also necessary for 3D model-based recognition systems, where the 3D model is estimated from the input video. Face tracking can be divided along different lines depending upon the method used, e.g., head tracking, feature tracking, image-based tracking, model-based tracking. The output of the face tracker can be the 2D position of the face in each image of the video (2D tracking), the 3D pose of the face (3D tracking), or the location of features on the face. Some trackers are also able to output other parameters related to lighting or expression. The major challenges encountered by face tracking systems are robustness to pose changes, lighting variations, and facial deformations due to changes...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 449.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video. Comput. Vision Image Understand. 91, 214–245 (2003)

    Article  Google Scholar 

  2. Fua, P.: Regularized bundle-adjustment to model heads from image sequences without calibration data. Int. J. Comput. Vision 38, 153–171 (2000)

    Article  MATH  Google Scholar 

  3. Shan, Y., Liu, Z., Zhang, Z.: Model-based bundle adjustment with application to face modeling. In: Proceedings of IEEE International Conference on Computer Vision, pp. 644–651 (2001)

    Google Scholar 

  4. Roy-Chowdhury, A., Chellappa, R., Gupta, R.: 3D face modeling from monocular video sequences. In: Face Processing: Advanced Modeling and Methods. Academic Press, New York (2005)

    Google Scholar 

  5. Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, A.: Face Recognition: A Literature Survey. ACM Transactions (2003)

    Google Scholar 

  6. Baker, S., Matthews, I.: Lucas–Kanade 20 years on: A unifying framework. Int. J. Comput. Vision 56, 221–255 (2004)

    Article  Google Scholar 

  7. Xu, Y., Roy-Chowdhury, A.: Integrating motion, illumination and structure in video sequences, with applications in illumination-invariant tracking. IEEE Trans. Pattern Anal. Machine Intell. Vol. 29, 793–806 (2007)

    Google Scholar 

  8. Luenburger, D.: Optimization by Vector Space Methods. Wiley, New York (1969)

    Google Scholar 

  9. Hager, G.D., Belhumeur, P.: Efficient region tracking with parametric models of geometry and illumination. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1025–1039 (1998)

    Article  Google Scholar 

  10. Koterba, S., Baker, S., Matthews, I., Hu, C., Xiao, H., Cohn, J., Kanade, T.: Multi-view aam fitting and camera calibration. In: IEEE Intl. Conf. Comput. Vision (2005)

    Google Scholar 

  11. Lepetit, V., Fua, P.: Monocular Model-Based 3D Tracking of Rigid Objects. Now Publishers Inc. (2005)

    Google Scholar 

  12. Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognit. 86, 259–275 (2003)

    Google Scholar 

  13. Terzopoulos, D., Waters, K.: Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. Pattern Anal. Mach. Intell. 15, 569–579 (1993)

    Article  Google Scholar 

  14. Black, M., Yacoob, Y.: Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In: International Conference on Computer Vision, pp. 374–381 (1995)

    Google Scholar 

  15. Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25, 1063–1074 (2003)

    Article  Google Scholar 

  16. Arulampalam, M., Maskell, A., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50 (2002)

    Google Scholar 

  17. Dedeoglu, G., Baker, S., Kanade, T.: Resolution-aware fitting of active appearance models to low-resolution images. In: European Conference on Computer Vision (2006)

    Google Scholar 

  18. Yu, J., Bhanu, B., Xu, Y., Roy-Chowdhury, A.: Super-resolved facial texture under changing pose and illumination. In: International Conference on Image Processing (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, University of California, Riverside, CA, USA

    Amit K. Roy-Chowdhury & Yilei Xu

Authors
  1. Amit K. Roy-Chowdhury
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yilei Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for Biometrics and Security Research, Chinese Academy of Sciences, Beijing, China

    Stan Z. Li (Professor) (Professor)

  2. Departments of Computer Science & Engineering, Michigan State University, East Lansing, MI, USA

    Anil Jain (Professor) (Professor)

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media, LLC

About this entry

Cite this entry

Roy-Chowdhury, A.K., Xu, Y. (2009). Face Tracking. In: Li, S.Z., Jain, A. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-73003-5_90

Download citation

Publish with us

Policies and ethics

Search

Navigation