Abstract
A feature-based approach to tracking rigid and non-rigid facial motion is described. Feature points are characterised using Gabor wavelets and can be individually tracked by phase-based displacement estimation. In order to achieve robust tracking a flexible shape model is used to impose global constraints upon the local feature points and to constrain the tracker. While there are many applications in facial analysis, the approach can be used for tracking other textured objects.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
D. Banin. Tracking faces with flexible shape models. Master's thesis, Queen Mary and Westfield College, London, September 1996.
A. M. Baumberg and D. C. Hogg. An efficient method for contour tracking using active shape models. Technical report, School of Computer Studies, University of Leeds, April 1994.
A. M. Baumberg and D. C. Hogg. Learning spatio-temporal models from training examples. Technical report, School of Computer Studies, University of Leeds, March 1995.
T. F. Cootes, C. J. Taylor, Cooper D. H., and Graham J. Training models of shape from sets of examples. In BMVC, pages 9–8, 1992.
D. DeCarlo and D. Metaxas. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In CVPR, pages 231–238, 1996.
David J. Fleet. Measurement of Image Velocity. Kluwer Academic Publishers, 1992.
N. Kruger, M. Potzsch, and C. von der Malsburg. Determination of face position and pose with a learned representation based on labeled graphs. Technical Report 96-03, Institut fur Neuroinformatik, Ruhr-Universitat Bochum, January 1996.
Martin Lades, Jan C. Vorbrüggen, Joachim Buhmann, Jörg Lange, Christoph von der Malsburg, Rolf P. Würtz, and Wolfgang Konen. Distortion invariant object recognition in the dynamic link architecture. IEEE Transactions on Computers, 42(3):300–311, 1993.
A. Lanitis, C. J. Taylor, T. F. Cootes, and T. Ahmed. Automatic interpretation of human faces and hand gestures using flexible models. In Int. Workshop Automatic Face and Gesture Recognition, Zurich, 1995.
T. Maurer and C von der Malsburg. Tracking and learning graphs on image sequences of faces. In Proc. Int. Conf. on Artificial Neural Networks, Bochum, 1996.
P. D. Sozou, T. F. Cootes, Taylor C. J., and E. C. Di Mauro. A non-linear generalisation of PDMs using polynomial regression. In 5th BMVC, pages 397–406, York, 1994.
P. D. Sozou, T. F. Cootes, Taylor C. J., and E. C. Di Mauro. Non-linear point distribution modelling using a multi-layer perceptron. In 6th BMVC, pages 107–116, Birmingham, 1995.
L. Wiskott. Labeled Graphs and Dynamic Link Matching for Face Recognition and Scene Analysis. PhD thesis, Ruhr-Universitat Bochum, July 1995.
R. P. Würtz. Multilayer Dynamic Link Networks for Establishing Image Point Correspondences and Visual Object Recognition. Verlag Harri Deutsch, 1995.
Rolf P. Würtz. Object recognition robust under translations, deformations and changes in background. IEEE PAMI, 1996. Submitted.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
McKenna, S.J., Gong, S., Würtz, R.P., Tanner, J., Banin, D. (1997). Tracking facial feature points with Gabor wavelets and shape models. In: Bigün, J., Chollet, G., Borgefors, G. (eds) Audio- and Video-based Biometric Person Authentication. AVBPA 1997. Lecture Notes in Computer Science, vol 1206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0015977
Download citation
DOI: https://doi.org/10.1007/BFb0015977
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62660-2
Online ISBN: 978-3-540-68425-1
eBook Packages: Springer Book Archive